2024-09-12T22:38:06.202 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T22:38:06.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T22:38:06.331 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902947 branch: squid description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-low-osd-mem-target powercycle/default supported-distros/centos_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} email: ceph-qa@ceph.com first_in_suite: false job_id: '7902947' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd memory target: 1610612736 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 8861 sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 sleep_before_teardown: 0 subset: 0/4 suite: powercycle suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_7741f7f9ee20524f89b8f61d1609b32fb3b1570a/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a targets: smithi066.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBND3AKELtFZgbsicPHHPl+pBzZ5t6KLJAJaPjVt1YavtVTFUC1w1w3bNGbMzLMhEDQW5e+GLdVZo/4GcSPyVV94= smithi087.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLY0O598sgj2QaBbZVXcsWUhTctoAKCadMxoeLPOzoCc5+czDAFi8IzMJq8ZcjO4CUl8DUO5kpiL3OcxJm6b2MY= smithi099.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHSR6kESn9r1XT3XkPYI6pDDKwtDxElM31JZnidYDHjIk16WbNBjRjGv5/wf5RXr8lzkWbtrOoDmjPHvC0JPL+I= smithi117.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGeN9g2t3xwkNP5cDW91tYFiIfak+O+567JekTaM/Cx6bZFfH/mY5nERG2GfEL2Z2gU1tbC1SYfbe8ruYymoRvI= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - ceph-fuse: null - workunit: clients: all: - suites/fsstress.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-12_21:32:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T22:38:06.331 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_7741f7f9ee20524f89b8f61d1609b32fb3b1570a/qa; will attempt to use it 2024-09-12T22:38:06.332 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_7741f7f9ee20524f89b8f61d1609b32fb3b1570a/qa/tasks 2024-09-12T22:38:06.332 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T22:38:06.334 INFO:teuthology.task.internal:Checking packages... 2024-09-12T22:38:06.355 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '086c737fa75c22d521a3932c59b31c5e1d1c9ef4' 2024-09-12T22:38:06.355 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T22:38:06.355 INFO:teuthology.packaging:ref: None 2024-09-12T22:38:06.355 INFO:teuthology.packaging:tag: None 2024-09-12T22:38:06.355 INFO:teuthology.packaging:branch: squid 2024-09-12T22:38:06.356 INFO:teuthology.packaging:sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T22:38:06.356 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-12T22:38:06.585 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-322.g7741f7f9 2024-09-12T22:38:06.587 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T22:38:06.595 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T22:38:06.596 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T22:38:06.621 INFO:teuthology.task.internal:Saving configuration 2024-09-12T22:38:06.633 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T22:38:06.642 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T22:38:06.665 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi066.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902947', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 22:32:23.418718', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBND3AKELtFZgbsicPHHPl+pBzZ5t6KLJAJaPjVt1YavtVTFUC1w1w3bNGbMzLMhEDQW5e+GLdVZo/4GcSPyVV94='} 2024-09-12T22:38:06.682 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi087.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902947', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 22:32:23.421218', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLY0O598sgj2QaBbZVXcsWUhTctoAKCadMxoeLPOzoCc5+czDAFi8IzMJq8ZcjO4CUl8DUO5kpiL3OcxJm6b2MY='} 2024-09-12T22:38:06.700 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902947', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 22:32:23.420033', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHSR6kESn9r1XT3XkPYI6pDDKwtDxElM31JZnidYDHjIk16WbNBjRjGv5/wf5RXr8lzkWbtrOoDmjPHvC0JPL+I='} 2024-09-12T22:38:06.720 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi117.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902947', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 22:32:23.417195', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGeN9g2t3xwkNP5cDW91tYFiIfak+O+567JekTaM/Cx6bZFfH/mY5nERG2GfEL2Z2gU1tbC1SYfbe8ruYymoRvI='} 2024-09-12T22:38:06.720 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T22:38:06.732 INFO:teuthology.task.internal:roles: ubuntu@smithi066.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2024-09-12T22:38:06.732 INFO:teuthology.task.internal:roles: ubuntu@smithi087.front.sepia.ceph.com - ['osd.0'] 2024-09-12T22:38:06.732 INFO:teuthology.task.internal:roles: ubuntu@smithi099.front.sepia.ceph.com - ['osd.1'] 2024-09-12T22:38:06.732 INFO:teuthology.task.internal:roles: ubuntu@smithi117.front.sepia.ceph.com - ['osd.2'] 2024-09-12T22:38:06.732 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T22:38:06.853 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9dfc53f2e0>, signals=[15]) 2024-09-12T22:38:06.853 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T22:38:06.864 INFO:teuthology.task.internal:Opening connections... 2024-09-12T22:38:06.864 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi066.front.sepia.ceph.com 2024-09-12T22:38:06.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:38:06.942 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi087.front.sepia.ceph.com 2024-09-12T22:38:06.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:38:07.014 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi099.front.sepia.ceph.com 2024-09-12T22:38:07.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:38:07.130 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi117.front.sepia.ceph.com 2024-09-12T22:38:07.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:38:07.207 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T22:38:07.216 DEBUG:teuthology.orchestra.run.smithi066:> uname -m 2024-09-12T22:38:07.235 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64 2024-09-12T22:38:07.235 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2024-09-12T22:38:07.294 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream" 2024-09-12T22:38:07.294 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="9" 2024-09-12T22:38:07.294 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos" 2024-09-12T22:38:07.294 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora" 2024-09-12T22:38:07.294 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="9" 2024-09-12T22:38:07.294 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el9" 2024-09-12T22:38:07.294 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T22:38:07.294 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31" 2024-09-12T22:38:07.294 INFO:teuthology.orchestra.run.smithi066.stdout:LOGO="fedora-logo-icon" 2024-09-12T22:38:07.294 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T22:38:07.294 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/" 2024-09-12T22:38:07.295 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T22:38:07.295 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T22:38:07.295 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T22:38:07.295 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2024-09-12T22:38:07.315 DEBUG:teuthology.orchestra.run.smithi087:> uname -m 2024-09-12T22:38:07.334 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64 2024-09-12T22:38:07.334 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2024-09-12T22:38:07.392 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="CentOS Stream" 2024-09-12T22:38:07.392 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="9" 2024-09-12T22:38:07.392 INFO:teuthology.orchestra.run.smithi087.stdout:ID="centos" 2024-09-12T22:38:07.393 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE="rhel fedora" 2024-09-12T22:38:07.393 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="9" 2024-09-12T22:38:07.393 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM_ID="platform:el9" 2024-09-12T22:38:07.393 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T22:38:07.393 INFO:teuthology.orchestra.run.smithi087.stdout:ANSI_COLOR="0;31" 2024-09-12T22:38:07.393 INFO:teuthology.orchestra.run.smithi087.stdout:LOGO="fedora-logo-icon" 2024-09-12T22:38:07.393 INFO:teuthology.orchestra.run.smithi087.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T22:38:07.393 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://centos.org/" 2024-09-12T22:38:07.393 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T22:38:07.393 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T22:38:07.393 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T22:38:07.394 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2024-09-12T22:38:07.415 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2024-09-12T22:38:07.434 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2024-09-12T22:38:07.434 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-09-12T22:38:07.493 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2024-09-12T22:38:07.493 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="9" 2024-09-12T22:38:07.494 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2024-09-12T22:38:07.494 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2024-09-12T22:38:07.494 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="9" 2024-09-12T22:38:07.494 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el9" 2024-09-12T22:38:07.494 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T22:38:07.494 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2024-09-12T22:38:07.494 INFO:teuthology.orchestra.run.smithi099.stdout:LOGO="fedora-logo-icon" 2024-09-12T22:38:07.494 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T22:38:07.494 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2024-09-12T22:38:07.494 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T22:38:07.494 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T22:38:07.494 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T22:38:07.495 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-09-12T22:38:07.544 DEBUG:teuthology.orchestra.run.smithi117:> uname -m 2024-09-12T22:38:07.563 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2024-09-12T22:38:07.563 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2024-09-12T22:38:07.621 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="CentOS Stream" 2024-09-12T22:38:07.621 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="9" 2024-09-12T22:38:07.621 INFO:teuthology.orchestra.run.smithi117.stdout:ID="centos" 2024-09-12T22:38:07.621 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="rhel fedora" 2024-09-12T22:38:07.621 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="9" 2024-09-12T22:38:07.621 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el9" 2024-09-12T22:38:07.622 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T22:38:07.622 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31" 2024-09-12T22:38:07.622 INFO:teuthology.orchestra.run.smithi117.stdout:LOGO="fedora-logo-icon" 2024-09-12T22:38:07.622 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T22:38:07.622 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://centos.org/" 2024-09-12T22:38:07.622 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T22:38:07.622 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T22:38:07.622 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T22:38:07.623 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2024-09-12T22:38:07.657 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T22:38:07.668 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T22:38:07.680 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T22:38:07.681 DEBUG:teuthology.orchestra.run.smithi066:> test '!' -e /home/ubuntu/cephtest 2024-09-12T22:38:07.683 DEBUG:teuthology.orchestra.run.smithi087:> test '!' -e /home/ubuntu/cephtest 2024-09-12T22:38:07.686 DEBUG:teuthology.orchestra.run.smithi099:> test '!' -e /home/ubuntu/cephtest 2024-09-12T22:38:07.688 DEBUG:teuthology.orchestra.run.smithi117:> test '!' -e /home/ubuntu/cephtest 2024-09-12T22:38:07.705 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T22:38:07.716 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T22:38:07.716 DEBUG:teuthology.orchestra.run.smithi066:> test -z $(ls -A /var/lib/ceph) 2024-09-12T22:38:07.742 DEBUG:teuthology.orchestra.run.smithi087:> test -z $(ls -A /var/lib/ceph) 2024-09-12T22:38:07.744 DEBUG:teuthology.orchestra.run.smithi099:> test -z $(ls -A /var/lib/ceph) 2024-09-12T22:38:07.747 DEBUG:teuthology.orchestra.run.smithi117:> test -z $(ls -A /var/lib/ceph) 2024-09-12T22:38:07.848 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T22:38:07.951 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T22:38:07.970 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T22:38:07.971 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.0': {'kdb': 1, 'sha1': 'distro'}, 'osd.1': {'kdb': 1, 'sha1': 'distro'}, 'osd.2': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T22:38:07.971 DEBUG:teuthology.orchestra.run.smithi066:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T22:38:07.971 DEBUG:teuthology.orchestra.run.smithi087:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T22:38:07.972 DEBUG:teuthology.orchestra.run.smithi099:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T22:38:07.972 DEBUG:teuthology.orchestra.run.smithi117:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T22:38:07.990 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:38:07.990 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:38:07.991 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2024-09-12T22:38:07.992 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2024-09-12T22:38:07.993 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:38:07.993 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:38:07.993 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2024-09-12T22:38:07.994 DEBUG:teuthology.orchestra.run.smithi066:> uname -r 2024-09-12T22:38:08.048 INFO:teuthology.orchestra.run.smithi099.stdout:5.14.0-503.el9.x86_64 2024-09-12T22:38:08.049 INFO:teuthology.task.kernel:Running kernel on smithi099: 5.14.0-503.el9.x86_64 2024-09-12T22:38:08.049 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum install -y kernel 2024-09-12T22:38:08.050 INFO:teuthology.orchestra.run.smithi087.stdout:5.14.0-503.el9.x86_64 2024-09-12T22:38:08.050 INFO:teuthology.task.kernel:Running kernel on smithi087: 5.14.0-503.el9.x86_64 2024-09-12T22:38:08.050 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum install -y kernel 2024-09-12T22:38:08.051 INFO:teuthology.orchestra.run.smithi117.stdout:5.14.0-503.el9.x86_64 2024-09-12T22:38:08.051 INFO:teuthology.task.kernel:Running kernel on smithi117: 5.14.0-503.el9.x86_64 2024-09-12T22:38:08.052 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum install -y kernel 2024-09-12T22:38:08.053 INFO:teuthology.orchestra.run.smithi066.stdout:5.14.0-503.el9.x86_64 2024-09-12T22:38:08.053 INFO:teuthology.task.kernel:Running kernel on smithi066: 5.14.0-503.el9.x86_64 2024-09-12T22:38:08.053 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum install -y kernel 2024-09-12T22:38:10.351 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-12T22:38:10.389 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-12T22:38:10.427 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-09-12T22:38:10.531 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-12T22:38:12.135 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - AppStream 29 MB/s | 20 MB 00:00 2024-09-12T22:38:12.406 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-12T22:38:12.932 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - AppStream 16 MB/s | 20 MB 00:01 2024-09-12T22:38:14.952 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - AppStream 6.0 MB/s | 20 MB 00:03 2024-09-12T22:38:17.769 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 6.5 MB 00:01 2024-09-12T22:38:18.191 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 6.5 MB 00:01 2024-09-12T22:38:18.240 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 6.5 MB 00:01 2024-09-12T22:38:19.203 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-12T22:38:19.661 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - Extras packages 28 kB/s | 19 kB 00:00 2024-09-12T22:38:19.708 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - Extras packages 93 kB/s | 19 kB 00:00 2024-09-12T22:38:20.484 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 19 kB 00:01 2024-09-12T22:38:20.937 INFO:teuthology.orchestra.run.smithi066.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-12T22:38:21.106 INFO:teuthology.orchestra.run.smithi117.stdout:Extra Packages for Enterprise Linux 17 MB/s | 23 MB 00:01 2024-09-12T22:38:21.121 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 19 kB 00:00 2024-09-12T22:38:21.929 INFO:teuthology.orchestra.run.smithi099.stdout:Extra Packages for Enterprise Linux 17 MB/s | 23 MB 00:01 2024-09-12T22:38:22.066 INFO:teuthology.orchestra.run.smithi087.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-12T22:38:26.462 INFO:teuthology.orchestra.run.smithi117.stdout:lab-extras 45 kB/s | 1.7 kB 00:00 2024-09-12T22:38:26.626 INFO:teuthology.orchestra.run.smithi066.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-12T22:38:27.326 INFO:teuthology.orchestra.run.smithi099.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-12T22:38:27.514 INFO:teuthology.orchestra.run.smithi087.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-12T22:38:28.402 INFO:teuthology.orchestra.run.smithi117.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T22:38:28.402 INFO:teuthology.orchestra.run.smithi117.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T22:38:28.493 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-12T22:38:28.504 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-12T22:38:28.504 INFO:teuthology.orchestra.run.smithi117.stdout: Package Architecture Version Repository Size 2024-09-12T22:38:28.504 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-12T22:38:28.504 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-12T22:38:28.504 INFO:teuthology.orchestra.run.smithi117.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T22:38:28.504 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-09-12T22:38:28.504 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T22:38:28.504 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T22:38:28.504 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T22:38:28.504 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:38:28.504 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-12T22:38:28.505 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-12T22:38:28.505 INFO:teuthology.orchestra.run.smithi117.stdout:Install 4 Packages 2024-09-12T22:38:28.505 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:38:28.505 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 79 M 2024-09-12T22:38:28.505 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 126 M 2024-09-12T22:38:28.505 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-12T22:38:28.674 INFO:teuthology.orchestra.run.smithi066.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T22:38:28.674 INFO:teuthology.orchestra.run.smithi066.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T22:38:28.769 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-09-12T22:38:28.778 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T22:38:28.778 INFO:teuthology.orchestra.run.smithi066.stdout: Package Architecture Version Repository Size 2024-09-12T22:38:28.778 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T22:38:28.778 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2024-09-12T22:38:28.778 INFO:teuthology.orchestra.run.smithi066.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T22:38:28.778 INFO:teuthology.orchestra.run.smithi066.stdout:Installing dependencies: 2024-09-12T22:38:28.778 INFO:teuthology.orchestra.run.smithi066.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T22:38:28.778 INFO:teuthology.orchestra.run.smithi066.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T22:38:28.779 INFO:teuthology.orchestra.run.smithi066.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T22:38:28.779 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:38:28.779 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2024-09-12T22:38:28.779 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T22:38:28.779 INFO:teuthology.orchestra.run.smithi066.stdout:Install 4 Packages 2024-09-12T22:38:28.779 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:38:28.779 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 79 M 2024-09-12T22:38:28.780 INFO:teuthology.orchestra.run.smithi066.stdout:Installed size: 126 M 2024-09-12T22:38:28.780 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2024-09-12T22:38:28.855 INFO:teuthology.orchestra.run.smithi117.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 320 kB/s | 23 kB 00:00 2024-09-12T22:38:29.261 INFO:teuthology.orchestra.run.smithi066.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 50 kB/s | 23 kB 00:00 2024-09-12T22:38:29.299 INFO:teuthology.orchestra.run.smithi099.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T22:38:29.299 INFO:teuthology.orchestra.run.smithi099.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T22:38:29.372 INFO:teuthology.orchestra.run.smithi117.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-09-12T22:38:29.383 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-12T22:38:29.390 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-12T22:38:29.390 INFO:teuthology.orchestra.run.smithi099.stdout: Package Architecture Version Repository Size 2024-09-12T22:38:29.390 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-12T22:38:29.390 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-12T22:38:29.390 INFO:teuthology.orchestra.run.smithi099.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T22:38:29.390 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-09-12T22:38:29.390 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T22:38:29.390 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T22:38:29.390 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T22:38:29.391 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:38:29.391 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-12T22:38:29.391 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-12T22:38:29.391 INFO:teuthology.orchestra.run.smithi099.stdout:Install 4 Packages 2024-09-12T22:38:29.391 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:38:29.391 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 79 M 2024-09-12T22:38:29.392 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 126 M 2024-09-12T22:38:29.392 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-12T22:38:29.503 INFO:teuthology.orchestra.run.smithi087.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T22:38:29.504 INFO:teuthology.orchestra.run.smithi087.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T22:38:29.569 INFO:teuthology.orchestra.run.smithi099.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 145 kB/s | 23 kB 00:00 2024-09-12T22:38:29.604 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-09-12T22:38:29.610 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-12T22:38:29.611 INFO:teuthology.orchestra.run.smithi087.stdout: Package Architecture Version Repository Size 2024-09-12T22:38:29.611 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-12T22:38:29.611 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-09-12T22:38:29.611 INFO:teuthology.orchestra.run.smithi087.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T22:38:29.611 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-09-12T22:38:29.611 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T22:38:29.611 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T22:38:29.611 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T22:38:29.611 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:38:29.611 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-09-12T22:38:29.612 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-12T22:38:29.612 INFO:teuthology.orchestra.run.smithi087.stdout:Install 4 Packages 2024-09-12T22:38:29.612 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:38:29.612 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 79 M 2024-09-12T22:38:29.612 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 126 M 2024-09-12T22:38:29.613 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-09-12T22:38:29.724 INFO:teuthology.orchestra.run.smithi087.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 247 kB/s | 23 kB 00:00 2024-09-12T22:38:29.855 INFO:teuthology.orchestra.run.smithi117.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 32 MB/s | 35 MB 00:01 2024-09-12T22:38:30.344 INFO:teuthology.orchestra.run.smithi099.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-09-12T22:38:30.928 INFO:teuthology.orchestra.run.smithi099.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 23 MB/s | 35 MB 00:01 2024-09-12T22:38:31.278 INFO:teuthology.orchestra.run.smithi099.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 17 MB/s | 29 MB 00:01 2024-09-12T22:38:31.279 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-12T22:38:31.279 INFO:teuthology.orchestra.run.smithi099.stdout:Total 42 MB/s | 79 MB 00:01 2024-09-12T22:38:31.954 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-12T22:38:32.325 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-12T22:38:32.325 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-12T22:38:32.511 INFO:teuthology.orchestra.run.smithi066.stdout:(2/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 9.3 MB/s | 35 MB 00:03 2024-09-12T22:38:32.558 INFO:teuthology.orchestra.run.smithi117.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 7.7 MB/s | 29 MB 00:03 2024-09-12T22:38:32.558 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-12T22:38:32.558 INFO:teuthology.orchestra.run.smithi117.stdout:Total 19 MB/s | 79 MB 00:04 2024-09-12T22:38:33.049 INFO:teuthology.orchestra.run.smithi087.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 4.6 MB/s | 16 MB 00:03 2024-09-12T22:38:33.238 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-12T22:38:33.291 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-12T22:38:33.292 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-12T22:38:33.609 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-12T22:38:33.609 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-12T22:38:34.585 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-12T22:38:34.585 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-12T22:38:35.207 INFO:teuthology.orchestra.run.smithi087.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 6.2 MB/s | 35 MB 00:05 2024-09-12T22:38:35.797 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-12T22:38:36.360 INFO:teuthology.orchestra.run.smithi066.stdout:(3/4): kernel-core-5.14.0-505.el9.x86_64.rpm 2.1 MB/s | 16 MB 00:07 2024-09-12T22:38:36.473 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T22:38:36.571 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T22:38:37.025 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-12T22:38:37.419 INFO:teuthology.orchestra.run.smithi066.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 3.5 MB/s | 29 MB 00:08 2024-09-12T22:38:37.419 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2024-09-12T22:38:37.419 INFO:teuthology.orchestra.run.smithi066.stdout:Total 9.1 MB/s | 79 MB 00:08 2024-09-12T22:38:37.773 INFO:teuthology.orchestra.run.smithi087.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 3.5 MB/s | 29 MB 00:08 2024-09-12T22:38:37.774 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-09-12T22:38:37.774 INFO:teuthology.orchestra.run.smithi087.stdout:Total 9.6 MB/s | 79 MB 00:08 2024-09-12T22:38:37.785 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T22:38:37.873 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T22:38:38.133 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2024-09-12T22:38:38.468 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-09-12T22:38:38.544 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2024-09-12T22:38:38.544 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2024-09-12T22:38:38.811 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-09-12T22:38:38.811 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-09-12T22:38:39.395 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T22:38:39.534 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T22:38:39.566 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2024-09-12T22:38:39.566 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2024-09-12T22:38:39.772 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-09-12T22:38:39.773 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-09-12T22:38:40.670 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T22:38:40.808 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T22:38:42.191 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2024-09-12T22:38:42.218 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-09-12T22:38:42.863 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T22:38:42.944 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T22:38:42.974 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T22:38:43.059 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T22:38:44.351 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T22:38:44.385 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:38:45.745 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T22:38:45.845 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T22:38:45.868 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:38:45.870 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T22:38:45.970 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T22:38:45.996 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T22:38:49.250 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:38:50.719 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:38:50.805 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T22:38:50.929 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:38:51.220 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T22:38:51.263 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:38:55.771 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:38:56.508 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:39:27.167 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:39:27.207 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:39:27.529 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:39:27.529 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T22:39:27.529 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T22:39:27.529 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T22:39:28.380 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:39:28.381 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:39:28.381 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-12T22:39:28.381 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T22:39:28.381 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T22:39:28.381 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T22:39:28.381 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T22:39:28.381 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:39:28.381 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-12T22:39:28.706 DEBUG:teuthology.orchestra.run.smithi099:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T22:39:28.840 INFO:teuthology.orchestra.run.smithi099.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T22:39:28.841 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T22:39:28.842 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T22:39:28.842 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T22:39:28.842 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T22:39:28.842 INFO:teuthology.task.kernel:Installing distro kernel on osd.1... 2024-09-12T22:39:28.842 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi099.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T22:39:28.842 DEBUG:teuthology.orchestra.run.smithi099:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T22:39:28.868 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:39:28.900 INFO:teuthology.orchestra.run.smithi099.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T22:39:28.901 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T22:39:28.901 DEBUG:teuthology.orchestra.run.smithi099:> sudo rpm -qi grub2-tools 2024-09-12T22:39:28.908 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:39:28.935 INFO:teuthology.orchestra.run.smithi099.stdout:Name : grub2-tools 2024-09-12T22:39:28.935 INFO:teuthology.orchestra.run.smithi099.stdout:Epoch : 1 2024-09-12T22:39:28.935 INFO:teuthology.orchestra.run.smithi099.stdout:Version : 2.06 2024-09-12T22:39:28.936 INFO:teuthology.orchestra.run.smithi099.stdout:Release : 82.el9 2024-09-12T22:39:28.936 INFO:teuthology.orchestra.run.smithi099.stdout:Architecture: x86_64 2024-09-12T22:39:28.936 INFO:teuthology.orchestra.run.smithi099.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T22:39:28.936 INFO:teuthology.orchestra.run.smithi099.stdout:Group : Unspecified 2024-09-12T22:39:28.936 INFO:teuthology.orchestra.run.smithi099.stdout:Size : 8274670 2024-09-12T22:39:28.936 INFO:teuthology.orchestra.run.smithi099.stdout:License : GPLv3+ 2024-09-12T22:39:28.936 INFO:teuthology.orchestra.run.smithi099.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T22:39:28.936 INFO:teuthology.orchestra.run.smithi099.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T22:39:28.936 INFO:teuthology.orchestra.run.smithi099.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T22:39:28.936 INFO:teuthology.orchestra.run.smithi099.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T22:39:28.936 INFO:teuthology.orchestra.run.smithi099.stdout:Packager : builder@centos.org 2024-09-12T22:39:28.937 INFO:teuthology.orchestra.run.smithi099.stdout:Vendor : CentOS 2024-09-12T22:39:28.937 INFO:teuthology.orchestra.run.smithi099.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T22:39:28.937 INFO:teuthology.orchestra.run.smithi099.stdout:Summary : Support tools for GRUB. 2024-09-12T22:39:28.937 INFO:teuthology.orchestra.run.smithi099.stdout:Description : 2024-09-12T22:39:28.937 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:39:28.937 INFO:teuthology.orchestra.run.smithi099.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T22:39:28.937 INFO:teuthology.orchestra.run.smithi099.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T22:39:28.937 INFO:teuthology.orchestra.run.smithi099.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T22:39:28.937 INFO:teuthology.orchestra.run.smithi099.stdout:hardware devices. 2024-09-12T22:39:28.937 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:39:28.937 INFO:teuthology.orchestra.run.smithi099.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T22:39:28.938 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T22:39:28.938 INFO:teuthology.task.kernel:Updating grub on smithi099 to boot 5.14.0-505.el9.x86_64 2024-09-12T22:39:28.938 DEBUG:teuthology.orchestra.run.smithi099:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T22:39:29.262 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:39:29.262 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T22:39:29.262 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T22:39:29.263 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T22:39:29.585 INFO:teuthology.orchestra.run.smithi099.stderr:Generating grub configuration file ... 2024-09-12T22:39:30.078 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:39:30.078 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:39:30.078 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-12T22:39:30.079 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T22:39:30.079 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T22:39:30.079 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T22:39:30.079 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T22:39:30.079 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:39:30.079 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-12T22:39:30.441 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T22:39:30.530 INFO:teuthology.orchestra.run.smithi117.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T22:39:30.530 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T22:39:30.531 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T22:39:30.531 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T22:39:30.531 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T22:39:30.531 INFO:teuthology.task.kernel:Installing distro kernel on osd.2... 2024-09-12T22:39:30.531 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi117.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T22:39:30.531 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T22:39:30.590 INFO:teuthology.orchestra.run.smithi117.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T22:39:30.591 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T22:39:30.591 DEBUG:teuthology.orchestra.run.smithi117:> sudo rpm -qi grub2-tools 2024-09-12T22:39:30.623 INFO:teuthology.orchestra.run.smithi117.stdout:Name : grub2-tools 2024-09-12T22:39:30.623 INFO:teuthology.orchestra.run.smithi117.stdout:Epoch : 1 2024-09-12T22:39:30.623 INFO:teuthology.orchestra.run.smithi117.stdout:Version : 2.06 2024-09-12T22:39:30.623 INFO:teuthology.orchestra.run.smithi117.stdout:Release : 82.el9 2024-09-12T22:39:30.623 INFO:teuthology.orchestra.run.smithi117.stdout:Architecture: x86_64 2024-09-12T22:39:30.623 INFO:teuthology.orchestra.run.smithi117.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T22:39:30.623 INFO:teuthology.orchestra.run.smithi117.stdout:Group : Unspecified 2024-09-12T22:39:30.623 INFO:teuthology.orchestra.run.smithi117.stdout:Size : 8274670 2024-09-12T22:39:30.624 INFO:teuthology.orchestra.run.smithi117.stdout:License : GPLv3+ 2024-09-12T22:39:30.624 INFO:teuthology.orchestra.run.smithi117.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T22:39:30.624 INFO:teuthology.orchestra.run.smithi117.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T22:39:30.624 INFO:teuthology.orchestra.run.smithi117.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T22:39:30.624 INFO:teuthology.orchestra.run.smithi117.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T22:39:30.624 INFO:teuthology.orchestra.run.smithi117.stdout:Packager : builder@centos.org 2024-09-12T22:39:30.624 INFO:teuthology.orchestra.run.smithi117.stdout:Vendor : CentOS 2024-09-12T22:39:30.624 INFO:teuthology.orchestra.run.smithi117.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T22:39:30.624 INFO:teuthology.orchestra.run.smithi117.stdout:Summary : Support tools for GRUB. 2024-09-12T22:39:30.624 INFO:teuthology.orchestra.run.smithi117.stdout:Description : 2024-09-12T22:39:30.624 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:39:30.624 INFO:teuthology.orchestra.run.smithi117.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T22:39:30.625 INFO:teuthology.orchestra.run.smithi117.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T22:39:30.625 INFO:teuthology.orchestra.run.smithi117.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T22:39:30.625 INFO:teuthology.orchestra.run.smithi117.stdout:hardware devices. 2024-09-12T22:39:30.625 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:39:30.625 INFO:teuthology.orchestra.run.smithi117.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T22:39:30.626 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T22:39:30.626 INFO:teuthology.task.kernel:Updating grub on smithi117 to boot 5.14.0-505.el9.x86_64 2024-09-12T22:39:30.626 DEBUG:teuthology.orchestra.run.smithi117:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T22:39:30.866 INFO:teuthology.orchestra.run.smithi099.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T22:39:30.899 INFO:teuthology.orchestra.run.smithi099.stderr:done 2024-09-12T22:39:30.902 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2024-09-12T22:39:30.917 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.G1agXBpEhZ 2024-09-12T22:39:30.917 DEBUG:teuthology.orchestra.run.smithi099:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.G1agXBpEhZ 2024-09-12T22:39:30.983 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.G1agXBpEhZ 2024-09-12T22:39:31.126 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.G1agXBpEhZ is 6KB 2024-09-12T22:39:31.174 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.G1agXBpEhZ 2024-09-12T22:39:31.189 DEBUG:teuthology.orchestra.run.smithi099:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T22:39:31.219 INFO:teuthology.orchestra.run.smithi117.stderr:Generating grub configuration file ... 2024-09-12T22:39:31.256 INFO:teuthology.orchestra.run.smithi099.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T22:39:31.256 INFO:teuthology.orchestra.run.smithi099.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T22:39:31.256 INFO:teuthology.orchestra.run.smithi099.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T22:39:31.256 INFO:teuthology.orchestra.run.smithi099.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T22:39:31.257 DEBUG:teuthology.orchestra.run.smithi099:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T22:39:31.426 DEBUG:teuthology.orchestra.run.smithi099:> sudo shutdown -r now 2024-09-12T22:39:32.561 INFO:teuthology.orchestra.run.smithi117.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T22:39:32.601 INFO:teuthology.orchestra.run.smithi117.stderr:done 2024-09-12T22:39:32.604 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2024-09-12T22:39:32.619 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.Bam0UOVOj9 2024-09-12T22:39:32.619 DEBUG:teuthology.orchestra.run.smithi117:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Bam0UOVOj9 2024-09-12T22:39:32.686 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.Bam0UOVOj9 2024-09-12T22:39:32.830 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.Bam0UOVOj9 is 6KB 2024-09-12T22:39:32.878 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.Bam0UOVOj9 2024-09-12T22:39:32.893 DEBUG:teuthology.orchestra.run.smithi117:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T22:39:32.955 INFO:teuthology.orchestra.run.smithi117.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T22:39:32.955 INFO:teuthology.orchestra.run.smithi117.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T22:39:32.955 INFO:teuthology.orchestra.run.smithi117.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T22:39:32.955 INFO:teuthology.orchestra.run.smithi117.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T22:39:32.957 DEBUG:teuthology.orchestra.run.smithi117:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T22:39:33.095 DEBUG:teuthology.orchestra.run.smithi117:> sudo shutdown -r now 2024-09-12T22:39:34.297 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:39:34.336 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:39:34.713 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:39:34.713 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T22:39:34.713 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T22:39:34.713 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T22:39:35.504 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:39:35.504 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:39:35.504 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-09-12T22:39:35.504 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T22:39:35.504 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T22:39:35.504 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T22:39:35.504 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T22:39:35.504 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:39:35.504 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-09-12T22:39:35.863 DEBUG:teuthology.orchestra.run.smithi087:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T22:39:35.950 INFO:teuthology.orchestra.run.smithi087.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T22:39:35.951 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T22:39:35.951 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T22:39:35.951 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T22:39:35.951 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T22:39:35.951 INFO:teuthology.task.kernel:Installing distro kernel on osd.0... 2024-09-12T22:39:35.951 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi087.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T22:39:35.951 DEBUG:teuthology.orchestra.run.smithi087:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T22:39:36.009 INFO:teuthology.orchestra.run.smithi087.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T22:39:36.010 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T22:39:36.010 DEBUG:teuthology.orchestra.run.smithi087:> sudo rpm -qi grub2-tools 2024-09-12T22:39:36.044 INFO:teuthology.orchestra.run.smithi087.stdout:Name : grub2-tools 2024-09-12T22:39:36.044 INFO:teuthology.orchestra.run.smithi087.stdout:Epoch : 1 2024-09-12T22:39:36.045 INFO:teuthology.orchestra.run.smithi087.stdout:Version : 2.06 2024-09-12T22:39:36.045 INFO:teuthology.orchestra.run.smithi087.stdout:Release : 82.el9 2024-09-12T22:39:36.045 INFO:teuthology.orchestra.run.smithi087.stdout:Architecture: x86_64 2024-09-12T22:39:36.045 INFO:teuthology.orchestra.run.smithi087.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T22:39:36.045 INFO:teuthology.orchestra.run.smithi087.stdout:Group : Unspecified 2024-09-12T22:39:36.045 INFO:teuthology.orchestra.run.smithi087.stdout:Size : 8274670 2024-09-12T22:39:36.045 INFO:teuthology.orchestra.run.smithi087.stdout:License : GPLv3+ 2024-09-12T22:39:36.045 INFO:teuthology.orchestra.run.smithi087.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T22:39:36.045 INFO:teuthology.orchestra.run.smithi087.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T22:39:36.048 INFO:teuthology.orchestra.run.smithi087.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T22:39:36.048 INFO:teuthology.orchestra.run.smithi087.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T22:39:36.048 INFO:teuthology.orchestra.run.smithi087.stdout:Packager : builder@centos.org 2024-09-12T22:39:36.048 INFO:teuthology.orchestra.run.smithi087.stdout:Vendor : CentOS 2024-09-12T22:39:36.048 INFO:teuthology.orchestra.run.smithi087.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T22:39:36.048 INFO:teuthology.orchestra.run.smithi087.stdout:Summary : Support tools for GRUB. 2024-09-12T22:39:36.049 INFO:teuthology.orchestra.run.smithi087.stdout:Description : 2024-09-12T22:39:36.049 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:39:36.049 INFO:teuthology.orchestra.run.smithi087.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T22:39:36.049 INFO:teuthology.orchestra.run.smithi087.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T22:39:36.049 INFO:teuthology.orchestra.run.smithi087.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T22:39:36.049 INFO:teuthology.orchestra.run.smithi087.stdout:hardware devices. 2024-09-12T22:39:36.049 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:39:36.049 INFO:teuthology.orchestra.run.smithi087.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T22:39:36.050 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T22:39:36.050 INFO:teuthology.task.kernel:Updating grub on smithi087 to boot 5.14.0-505.el9.x86_64 2024-09-12T22:39:36.051 DEBUG:teuthology.orchestra.run.smithi087:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T22:39:36.664 INFO:teuthology.orchestra.run.smithi087.stderr:Generating grub configuration file ... 2024-09-12T22:39:36.869 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:39:36.911 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:39:37.198 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:39:37.198 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T22:39:37.198 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T22:39:37.198 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T22:39:37.955 INFO:teuthology.orchestra.run.smithi087.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T22:39:37.990 INFO:teuthology.orchestra.run.smithi087.stderr:done 2024-09-12T22:39:37.992 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2024-09-12T22:39:38.008 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.nAPEJEaw6S 2024-09-12T22:39:38.008 DEBUG:teuthology.orchestra.run.smithi087:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.nAPEJEaw6S 2024-09-12T22:39:38.021 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:39:38.021 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:39:38.021 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2024-09-12T22:39:38.021 INFO:teuthology.orchestra.run.smithi066.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T22:39:38.021 INFO:teuthology.orchestra.run.smithi066.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T22:39:38.021 INFO:teuthology.orchestra.run.smithi066.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T22:39:38.021 INFO:teuthology.orchestra.run.smithi066.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T22:39:38.021 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:39:38.022 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2024-09-12T22:39:38.085 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.nAPEJEaw6S 2024-09-12T22:39:38.233 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.nAPEJEaw6S is 6KB 2024-09-12T22:39:38.282 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.nAPEJEaw6S 2024-09-12T22:39:38.296 DEBUG:teuthology.orchestra.run.smithi087:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T22:39:38.359 INFO:teuthology.orchestra.run.smithi087.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T22:39:38.359 INFO:teuthology.orchestra.run.smithi087.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T22:39:38.359 INFO:teuthology.orchestra.run.smithi087.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T22:39:38.359 INFO:teuthology.orchestra.run.smithi087.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T22:39:38.361 DEBUG:teuthology.orchestra.run.smithi087:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T22:39:38.380 DEBUG:teuthology.orchestra.run.smithi066:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T22:39:38.470 INFO:teuthology.orchestra.run.smithi066.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T22:39:38.471 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T22:39:38.471 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T22:39:38.471 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T22:39:38.471 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T22:39:38.471 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T22:39:38.471 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi066.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T22:39:38.471 DEBUG:teuthology.orchestra.run.smithi066:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T22:39:38.514 DEBUG:teuthology.orchestra.run.smithi087:> sudo shutdown -r now 2024-09-12T22:39:38.530 INFO:teuthology.orchestra.run.smithi066.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T22:39:38.531 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T22:39:38.531 DEBUG:teuthology.orchestra.run.smithi066:> sudo rpm -qi grub2-tools 2024-09-12T22:39:38.573 INFO:teuthology.orchestra.run.smithi066.stdout:Name : grub2-tools 2024-09-12T22:39:38.573 INFO:teuthology.orchestra.run.smithi066.stdout:Epoch : 1 2024-09-12T22:39:38.573 INFO:teuthology.orchestra.run.smithi066.stdout:Version : 2.06 2024-09-12T22:39:38.573 INFO:teuthology.orchestra.run.smithi066.stdout:Release : 82.el9 2024-09-12T22:39:38.573 INFO:teuthology.orchestra.run.smithi066.stdout:Architecture: x86_64 2024-09-12T22:39:38.573 INFO:teuthology.orchestra.run.smithi066.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T22:39:38.573 INFO:teuthology.orchestra.run.smithi066.stdout:Group : Unspecified 2024-09-12T22:39:38.573 INFO:teuthology.orchestra.run.smithi066.stdout:Size : 8274670 2024-09-12T22:39:38.573 INFO:teuthology.orchestra.run.smithi066.stdout:License : GPLv3+ 2024-09-12T22:39:38.573 INFO:teuthology.orchestra.run.smithi066.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T22:39:38.573 INFO:teuthology.orchestra.run.smithi066.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T22:39:38.573 INFO:teuthology.orchestra.run.smithi066.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T22:39:38.574 INFO:teuthology.orchestra.run.smithi066.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T22:39:38.574 INFO:teuthology.orchestra.run.smithi066.stdout:Packager : builder@centos.org 2024-09-12T22:39:38.574 INFO:teuthology.orchestra.run.smithi066.stdout:Vendor : CentOS 2024-09-12T22:39:38.574 INFO:teuthology.orchestra.run.smithi066.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T22:39:38.574 INFO:teuthology.orchestra.run.smithi066.stdout:Summary : Support tools for GRUB. 2024-09-12T22:39:38.574 INFO:teuthology.orchestra.run.smithi066.stdout:Description : 2024-09-12T22:39:38.574 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:39:38.574 INFO:teuthology.orchestra.run.smithi066.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T22:39:38.574 INFO:teuthology.orchestra.run.smithi066.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T22:39:38.574 INFO:teuthology.orchestra.run.smithi066.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T22:39:38.574 INFO:teuthology.orchestra.run.smithi066.stdout:hardware devices. 2024-09-12T22:39:38.574 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:39:38.574 INFO:teuthology.orchestra.run.smithi066.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T22:39:38.575 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T22:39:38.575 INFO:teuthology.task.kernel:Updating grub on smithi066 to boot 5.14.0-505.el9.x86_64 2024-09-12T22:39:38.575 DEBUG:teuthology.orchestra.run.smithi066:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T22:39:39.224 INFO:teuthology.orchestra.run.smithi066.stderr:Generating grub configuration file ... 2024-09-12T22:39:40.567 INFO:teuthology.orchestra.run.smithi066.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T22:39:40.607 INFO:teuthology.orchestra.run.smithi066.stderr:done 2024-09-12T22:39:40.609 DEBUG:teuthology.orchestra.run.smithi066:> mktemp 2024-09-12T22:39:40.625 INFO:teuthology.orchestra.run.smithi066.stdout:/tmp/tmp.MtLU7uXbX5 2024-09-12T22:39:40.625 DEBUG:teuthology.orchestra.run.smithi066:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.MtLU7uXbX5 2024-09-12T22:39:40.692 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 0666 /tmp/tmp.MtLU7uXbX5 2024-09-12T22:39:40.833 DEBUG:teuthology.orchestra.remote:smithi066:/tmp/tmp.MtLU7uXbX5 is 6KB 2024-09-12T22:39:40.882 DEBUG:teuthology.orchestra.run.smithi066:> rm -fr /tmp/tmp.MtLU7uXbX5 2024-09-12T22:39:40.897 DEBUG:teuthology.orchestra.run.smithi066:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T22:39:40.962 INFO:teuthology.orchestra.run.smithi066.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T22:39:40.962 INFO:teuthology.orchestra.run.smithi066.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T22:39:40.964 INFO:teuthology.orchestra.run.smithi066.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T22:39:40.964 INFO:teuthology.orchestra.run.smithi066.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T22:39:40.965 DEBUG:teuthology.orchestra.run.smithi066:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T22:39:41.116 DEBUG:teuthology.orchestra.run.smithi066:> sudo shutdown -r now 2024-09-12T22:40:01.445 INFO:teuthology.task.kernel:Checking client osd.1 for new kernel version... 2024-09-12T22:40:01.446 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-12T22:40:01.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:40:03.099 INFO:teuthology.task.kernel:Checking client osd.2 for new kernel version... 2024-09-12T22:40:03.100 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-12T22:40:03.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:40:08.521 INFO:teuthology.task.kernel:Checking client osd.0 for new kernel version... 2024-09-12T22:40:08.521 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-09-12T22:40:08.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:40:11.121 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T22:40:11.121 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-12T22:40:11.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:40:19.773 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-09-12T22:40:21.569 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-09-12T22:40:26.941 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-09-12T22:40:28.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-12T22:40:28.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:40:29.501 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-09-12T22:40:30.571 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-12T22:40:30.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:40:31.837 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-09-12T22:40:33.629 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-09-12T22:40:35.945 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-09-12T22:40:35.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:40:38.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-12T22:40:38.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:40:39.005 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-09-12T22:40:41.569 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-09-12T22:40:43.840 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-12T22:40:43.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:40:45.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-12T22:40:45.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:40:51.009 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-09-12T22:40:51.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:40:53.573 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-12T22:40:53.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:40:56.701 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-09-12T22:41:04.061 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-09-12T22:41:11.705 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-12T22:41:11.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:41:15.813 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-09-12T22:41:16.139 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-12T22:41:16.139 INFO:teuthology.task.kernel:Checking kernel version of osd.1, want "5.14.0-505.el9.x86_64"... 2024-09-12T22:41:16.139 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2024-09-12T22:41:16.154 INFO:teuthology.orchestra.run.smithi099.stdout:5.14.0-505.el9.x86_64 2024-09-12T22:41:16.154 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T22:41:16.154 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T22:41:16.154 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T22:41:17.155 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2024-09-12T22:41:17.155 DEBUG:teuthology.orchestra.run.smithi099:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T22:41:17.235 INFO:teuthology.orchestra.run.smithi099.stdout:ttyS1 2024-09-12T22:41:17.264 DEBUG:teuthology.parallel:result is None 2024-09-12T22:41:19.062 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-12T22:41:19.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:41:19.456 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-09-12T22:41:19.859 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-12T22:41:19.859 INFO:teuthology.task.kernel:Checking kernel version of osd.2, want "5.14.0-505.el9.x86_64"... 2024-09-12T22:41:19.859 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2024-09-12T22:41:19.874 INFO:teuthology.orchestra.run.smithi117.stdout:5.14.0-505.el9.x86_64 2024-09-12T22:41:19.874 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T22:41:19.874 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T22:41:19.874 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T22:41:20.875 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2024-09-12T22:41:20.876 DEBUG:teuthology.orchestra.run.smithi117:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T22:41:20.971 INFO:teuthology.orchestra.run.smithi117.stdout:ttyS1 2024-09-12T22:41:20.998 DEBUG:teuthology.parallel:result is None 2024-09-12T22:41:22.821 DEBUG:teuthology.orchestra.run.smithi087:> true 2024-09-12T22:41:23.158 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-09-12T22:41:23.158 INFO:teuthology.task.kernel:Checking kernel version of osd.0, want "5.14.0-505.el9.x86_64"... 2024-09-12T22:41:23.158 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2024-09-12T22:41:23.173 INFO:teuthology.orchestra.run.smithi087.stdout:5.14.0-505.el9.x86_64 2024-09-12T22:41:23.173 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T22:41:23.173 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T22:41:23.173 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T22:41:24.174 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2024-09-12T22:41:24.174 DEBUG:teuthology.orchestra.run.smithi087:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T22:41:24.238 INFO:teuthology.orchestra.run.smithi087.stdout:ttyS1 2024-09-12T22:41:24.268 DEBUG:teuthology.parallel:result is None 2024-09-12T22:41:30.173 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-09-12T22:41:48.174 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-12T22:41:48.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:41:48.564 DEBUG:teuthology.orchestra.run.smithi066:> true 2024-09-12T22:41:48.936 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-12T22:41:48.936 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-12T22:41:48.936 DEBUG:teuthology.orchestra.run.smithi066:> uname -r 2024-09-12T22:41:48.951 INFO:teuthology.orchestra.run.smithi066.stdout:5.14.0-505.el9.x86_64 2024-09-12T22:41:48.952 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T22:41:48.952 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T22:41:48.952 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T22:41:49.953 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T22:41:49.953 DEBUG:teuthology.orchestra.run.smithi066:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T22:41:50.032 INFO:teuthology.orchestra.run.smithi066.stdout:ttyS1 2024-09-12T22:41:50.064 DEBUG:teuthology.parallel:result is None 2024-09-12T22:41:50.065 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T22:41:50.074 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T22:41:50.074 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T22:41:50.076 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T22:41:50.079 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T22:41:50.081 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T22:41:50.100 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T22:41:50.107 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T22:41:50.116 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T22:41:50.117 DEBUG:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T22:41:50.135 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T22:41:50.138 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T22:41:50.140 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T22:41:50.220 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T22:41:50.226 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T22:41:50.227 DEBUG:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T22:41:50.229 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T22:41:50.232 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T22:41:50.234 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T22:41:50.253 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T22:41:50.263 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T22:41:50.264 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T22:41:50.264 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T22:41:50.274 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T22:41:50.275 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T22:41:50.280 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T22:41:50.293 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T22:41:50.294 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T22:41:50.301 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T22:41:50.302 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T22:41:50.309 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T22:41:50.319 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T22:41:50.321 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T22:41:50.350 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T22:41:50.359 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T22:41:50.359 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T22:41:50.376 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T22:41:50.387 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T22:41:50.389 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T22:41:50.407 DEBUG:teuthology.orchestra.run.smithi066:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T22:41:50.473 DEBUG:teuthology.orchestra.run.smithi066:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T22:41:50.521 DEBUG:teuthology.orchestra.run.smithi066:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T22:41:50.603 DEBUG:teuthology.orchestra.run.smithi066:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T22:41:50.646 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T22:41:50.646 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T22:41:50.712 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T22:41:50.755 DEBUG:teuthology.orchestra.run.smithi087:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T22:41:50.814 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T22:41:50.898 DEBUG:teuthology.orchestra.run.smithi087:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T22:41:50.941 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-12T22:41:50.941 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T22:41:51.008 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T22:41:51.055 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T22:41:51.118 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T22:41:51.161 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T22:41:51.204 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-12T22:41:51.204 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T22:41:51.270 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T22:41:51.314 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T22:41:51.375 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T22:41:51.461 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T22:41:51.503 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T22:41:51.504 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T22:41:51.572 DEBUG:teuthology.orchestra.run.smithi066:> sudo service rsyslog restart 2024-09-12T22:41:51.575 DEBUG:teuthology.orchestra.run.smithi087:> sudo service rsyslog restart 2024-09-12T22:41:51.577 DEBUG:teuthology.orchestra.run.smithi099:> sudo service rsyslog restart 2024-09-12T22:41:51.580 DEBUG:teuthology.orchestra.run.smithi117:> sudo service rsyslog restart 2024-09-12T22:41:51.620 INFO:teuthology.orchestra.run.smithi087.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T22:41:51.622 INFO:teuthology.orchestra.run.smithi099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T22:41:51.661 INFO:teuthology.orchestra.run.smithi117.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T22:41:51.663 INFO:teuthology.orchestra.run.smithi066.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T22:41:52.094 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T22:41:52.102 INFO:teuthology.task.internal:Starting timer... 2024-09-12T22:41:52.102 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T22:41:52.113 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T22:41:52.121 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-12T22:41:52.122 DEBUG:teuthology.orchestra.run.smithi066:> sudo service auditd rotate 2024-09-12T22:41:52.249 INFO:teuthology.orchestra.run.smithi066.stdout:Rotating logs: 2024-09-12T22:41:52.255 DEBUG:teuthology.orchestra.run.smithi087:> sudo service auditd rotate 2024-09-12T22:41:52.296 INFO:teuthology.orchestra.run.smithi087.stdout:Rotating logs: 2024-09-12T22:41:52.297 DEBUG:teuthology.orchestra.run.smithi099:> sudo service auditd rotate 2024-09-12T22:41:52.354 INFO:teuthology.orchestra.run.smithi099.stdout:Rotating logs: 2024-09-12T22:41:52.356 DEBUG:teuthology.orchestra.run.smithi117:> sudo service auditd rotate 2024-09-12T22:41:52.397 INFO:teuthology.orchestra.run.smithi117.stdout:Rotating logs: 2024-09-12T22:41:52.398 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T22:41:52.399 DEBUG:teuthology.orchestra.run.smithi066:> /usr/sbin/getenforce 2024-09-12T22:41:52.452 INFO:teuthology.orchestra.run.smithi066.stdout:Permissive 2024-09-12T22:41:52.453 DEBUG:teuthology.orchestra.run.smithi087:> /usr/sbin/getenforce 2024-09-12T22:41:52.477 INFO:teuthology.orchestra.run.smithi087.stdout:Permissive 2024-09-12T22:41:52.477 DEBUG:teuthology.orchestra.run.smithi099:> /usr/sbin/getenforce 2024-09-12T22:41:52.506 INFO:teuthology.orchestra.run.smithi099.stdout:Permissive 2024-09-12T22:41:52.506 DEBUG:teuthology.orchestra.run.smithi117:> /usr/sbin/getenforce 2024-09-12T22:41:52.547 INFO:teuthology.orchestra.run.smithi117.stdout:Permissive 2024-09-12T22:41:52.547 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi066.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi087.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi099.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi117.front.sepia.ceph.com': 'permissive'} 2024-09-12T22:41:52.547 DEBUG:teuthology.orchestra.run.smithi066:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T22:41:52.612 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:41:52.613 DEBUG:teuthology.orchestra.run.smithi087:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T22:41:52.643 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:41:52.644 DEBUG:teuthology.orchestra.run.smithi099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T22:41:52.673 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:41:52.673 DEBUG:teuthology.orchestra.run.smithi117:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T22:41:52.701 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:41:52.702 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T22:41:52.702 DEBUG:teuthology.orchestra.run.smithi066:> sudo /usr/sbin/setenforce permissive 2024-09-12T22:41:52.782 DEBUG:teuthology.orchestra.run.smithi087:> sudo /usr/sbin/setenforce permissive 2024-09-12T22:41:52.813 DEBUG:teuthology.orchestra.run.smithi099:> sudo /usr/sbin/setenforce permissive 2024-09-12T22:41:52.843 DEBUG:teuthology.orchestra.run.smithi117:> sudo /usr/sbin/setenforce permissive 2024-09-12T22:41:52.886 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T22:41:52.895 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T22:41:52.906 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T22:41:52.907 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi066.front.sepia.ceph.com,smithi087.front.sepia.ceph.com,smithi099.front.sepia.ceph.com,smithi117.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T22:45:46.996 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi066.front.sepia.ceph.com'), Remote(name='ubuntu@smithi087.front.sepia.ceph.com'), Remote(name='ubuntu@smithi099.front.sepia.ceph.com'), Remote(name='ubuntu@smithi117.front.sepia.ceph.com')] 2024-09-12T22:45:46.997 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-12T22:45:46.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:45:47.076 DEBUG:teuthology.orchestra.run.smithi066:> true 2024-09-12T22:45:47.153 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-12T22:45:47.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-09-12T22:45:47.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:45:47.225 DEBUG:teuthology.orchestra.run.smithi087:> true 2024-09-12T22:45:47.295 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-09-12T22:45:47.295 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-12T22:45:47.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:45:47.371 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-09-12T22:45:47.454 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-12T22:45:47.454 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-12T22:45:47.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:45:47.531 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-09-12T22:45:47.619 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-12T22:45:47.620 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T22:45:47.630 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T22:45:47.630 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T22:45:47.631 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T22:45:47.633 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T22:45:47.634 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T22:45:47.636 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T22:45:47.636 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T22:45:47.638 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T22:45:47.638 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T22:45:47.663 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T22:45:47.666 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T22:45:47.669 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T22:45:47.677 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T22:45:47.682 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T22:45:47.685 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T22:45:47.692 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T22:45:47.701 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: ntpd: command not found 2024-09-12T22:45:47.707 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T22:45:47.710 INFO:teuthology.orchestra.run.smithi066.stderr:sudo: ntpd: command not found 2024-09-12T22:45:47.711 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: ntpd: command not found 2024-09-12T22:45:47.712 INFO:teuthology.orchestra.run.smithi087.stdout:506 Cannot talk to daemon 2024-09-12T22:45:47.723 INFO:teuthology.orchestra.run.smithi066.stdout:506 Cannot talk to daemon 2024-09-12T22:45:47.723 INFO:teuthology.orchestra.run.smithi099.stdout:506 Cannot talk to daemon 2024-09-12T22:45:47.726 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T22:45:47.733 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: ntpd: command not found 2024-09-12T22:45:47.738 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T22:45:47.738 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T22:45:47.740 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T22:45:47.744 INFO:teuthology.orchestra.run.smithi117.stdout:506 Cannot talk to daemon 2024-09-12T22:45:47.753 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T22:45:47.753 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T22:45:47.758 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T22:45:47.773 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T22:45:47.797 INFO:teuthology.orchestra.run.smithi087.stderr:bash: line 1: ntpq: command not found 2024-09-12T22:45:47.801 INFO:teuthology.orchestra.run.smithi087.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T22:45:47.801 INFO:teuthology.orchestra.run.smithi087.stdout:=============================================================================== 2024-09-12T22:45:47.801 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:45:47.801 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:45:47.802 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:45:47.802 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:45:47.814 INFO:teuthology.orchestra.run.smithi099.stderr:bash: line 1: ntpq: command not found 2024-09-12T22:45:47.815 INFO:teuthology.orchestra.run.smithi066.stderr:bash: line 1: ntpq: command not found 2024-09-12T22:45:47.817 INFO:teuthology.orchestra.run.smithi099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T22:45:47.817 INFO:teuthology.orchestra.run.smithi099.stdout:=============================================================================== 2024-09-12T22:45:47.818 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:45:47.818 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:45:47.818 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:45:47.818 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:45:47.819 INFO:teuthology.orchestra.run.smithi066.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T22:45:47.819 INFO:teuthology.orchestra.run.smithi066.stdout:=============================================================================== 2024-09-12T22:45:47.819 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:45:47.819 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:45:47.819 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:45:47.820 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:45:47.827 INFO:teuthology.orchestra.run.smithi117.stderr:bash: line 1: ntpq: command not found 2024-09-12T22:45:47.830 INFO:teuthology.orchestra.run.smithi117.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T22:45:47.830 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================== 2024-09-12T22:45:47.830 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:45:47.830 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:45:47.830 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:45:47.831 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:45:47.831 INFO:teuthology.run_tasks:Running task install... 2024-09-12T22:45:47.839 DEBUG:teuthology.task.install:project ceph 2024-09-12T22:45:47.839 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}} 2024-09-12T22:45:47.839 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'} 2024-09-12T22:45:47.840 INFO:teuthology.task.install:Using flavor: default 2024-09-12T22:45:47.845 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T22:45:47.845 INFO:teuthology.task.install:extra packages: [] 2024-09-12T22:45:47.846 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'tag': None, 'wait_for_package': False} 2024-09-12T22:45:47.846 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T22:45:47.848 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'tag': None, 'wait_for_package': False} 2024-09-12T22:45:47.848 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T22:45:47.852 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'tag': None, 'wait_for_package': False} 2024-09-12T22:45:47.852 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T22:45:47.853 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'tag': None, 'wait_for_package': False} 2024-09-12T22:45:47.853 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T22:45:48.009 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/ 2024-09-12T22:45:48.010 INFO:teuthology.task.install.rpm:Package version is 19.1.1-314.g086c737f 2024-09-12T22:45:48.017 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/ 2024-09-12T22:45:48.017 INFO:teuthology.task.install.rpm:Package version is 19.1.1-314.g086c737f 2024-09-12T22:45:48.020 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/ 2024-09-12T22:45:48.020 INFO:teuthology.task.install.rpm:Package version is 19.1.1-314.g086c737f 2024-09-12T22:45:48.024 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/ 2024-09-12T22:45:48.024 INFO:teuthology.task.install.rpm:Package version is 19.1.1-314.g086c737f 2024-09-12T22:45:48.127 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T22:45:48.128 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T22:45:48.128 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T22:45:48.130 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T22:45:48.130 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T22:45:48.130 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T22:45:48.142 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T22:45:48.142 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-12T22:45:48.142 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T22:45:48.147 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T22:45:48.147 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-12T22:45:48.147 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T22:45:48.156 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-09-12T22:45:48.156 DEBUG:teuthology.orchestra.run.smithi117:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T22:45:48.157 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-09-12T22:45:48.158 DEBUG:teuthology.orchestra.run.smithi066:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T22:45:48.169 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-09-12T22:45:48.169 DEBUG:teuthology.orchestra.run.smithi087:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T22:45:48.173 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-09-12T22:45:48.173 DEBUG:teuthology.orchestra.run.smithi099:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T22:45:48.222 DEBUG:teuthology.orchestra.run.smithi117:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T22:45:48.225 DEBUG:teuthology.orchestra.run.smithi066:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T22:45:48.234 DEBUG:teuthology.orchestra.run.smithi087:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T22:45:48.238 DEBUG:teuthology.orchestra.run.smithi099:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T22:45:48.297 DEBUG:teuthology.orchestra.run.smithi117:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T22:45:48.301 DEBUG:teuthology.orchestra.run.smithi066:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T22:45:48.309 DEBUG:teuthology.orchestra.run.smithi087:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T22:45:48.313 DEBUG:teuthology.orchestra.run.smithi099:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T22:45:48.360 INFO:teuthology.orchestra.run.smithi117.stdout:check_obsoletes = 1 2024-09-12T22:45:48.362 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum clean all 2024-09-12T22:45:48.366 INFO:teuthology.orchestra.run.smithi066.stdout:check_obsoletes = 1 2024-09-12T22:45:48.368 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum clean all 2024-09-12T22:45:48.372 INFO:teuthology.orchestra.run.smithi087.stdout:check_obsoletes = 1 2024-09-12T22:45:48.374 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum clean all 2024-09-12T22:45:48.377 INFO:teuthology.orchestra.run.smithi099.stdout:check_obsoletes = 1 2024-09-12T22:45:48.378 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum clean all 2024-09-12T22:45:48.605 INFO:teuthology.orchestra.run.smithi099.stdout:45 files removed 2024-09-12T22:45:48.606 INFO:teuthology.orchestra.run.smithi087.stdout:45 files removed 2024-09-12T22:45:48.607 INFO:teuthology.orchestra.run.smithi066.stdout:45 files removed 2024-09-12T22:45:48.610 INFO:teuthology.orchestra.run.smithi117.stdout:45 files removed 2024-09-12T22:45:48.632 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-09-12T22:45:48.633 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-09-12T22:45:48.635 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-09-12T22:45:48.640 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-09-12T22:45:49.178 INFO:teuthology.orchestra.run.smithi099.stdout:ceph packages for x86_64 320 kB/s | 83 kB 00:00 2024-09-12T22:45:49.190 INFO:teuthology.orchestra.run.smithi087.stdout:ceph packages for x86_64 306 kB/s | 83 kB 00:00 2024-09-12T22:45:49.197 INFO:teuthology.orchestra.run.smithi117.stdout:ceph packages for x86_64 305 kB/s | 83 kB 00:00 2024-09-12T22:45:49.205 INFO:teuthology.orchestra.run.smithi066.stdout:ceph packages for x86_64 308 kB/s | 83 kB 00:00 2024-09-12T22:45:49.470 INFO:teuthology.orchestra.run.smithi099.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-12T22:45:49.474 INFO:teuthology.orchestra.run.smithi087.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-12T22:45:49.489 INFO:teuthology.orchestra.run.smithi066.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-12T22:45:49.490 INFO:teuthology.orchestra.run.smithi117.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-12T22:45:49.746 INFO:teuthology.orchestra.run.smithi099.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-09-12T22:45:49.749 INFO:teuthology.orchestra.run.smithi087.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-09-12T22:45:49.765 INFO:teuthology.orchestra.run.smithi117.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-09-12T22:45:49.773 INFO:teuthology.orchestra.run.smithi066.stdout:ceph source packages 7.6 kB/s | 1.9 kB 00:00 2024-09-12T22:45:51.590 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.2 MB 00:01 2024-09-12T22:45:52.008 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - BaseOS 3.7 MB/s | 8.2 MB 00:02 2024-09-12T22:45:52.071 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - BaseOS 3.6 MB/s | 8.2 MB 00:02 2024-09-12T22:45:54.118 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - AppStream 20 MB/s | 20 MB 00:01 2024-09-12T22:45:54.167 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - AppStream 14 MB/s | 20 MB 00:01 2024-09-12T22:45:54.289 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - AppStream 18 MB/s | 20 MB 00:01 2024-09-12T22:45:54.673 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - BaseOS 1.7 MB/s | 8.2 MB 00:04 2024-09-12T22:45:56.866 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - AppStream 19 MB/s | 20 MB 00:01 2024-09-12T22:45:58.435 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-12T22:45:58.517 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-12T22:45:58.798 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - CRB 9.5 MB/s | 6.5 MB 00:00 2024-09-12T22:45:59.861 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - Extras packages 93 kB/s | 19 kB 00:00 2024-09-12T22:45:59.976 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - Extras packages 80 kB/s | 19 kB 00:00 2024-09-12T22:46:00.532 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 19 kB 00:00 2024-09-12T22:46:01.299 INFO:teuthology.orchestra.run.smithi087.stdout:Extra Packages for Enterprise Linux 17 MB/s | 23 MB 00:01 2024-09-12T22:46:01.397 INFO:teuthology.orchestra.run.smithi117.stdout:Extra Packages for Enterprise Linux 17 MB/s | 23 MB 00:01 2024-09-12T22:46:01.867 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - CRB 6.2 MB/s | 6.5 MB 00:01 2024-09-12T22:46:01.927 INFO:teuthology.orchestra.run.smithi099.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-12T22:46:03.376 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - Extras packages 97 kB/s | 19 kB 00:00 2024-09-12T22:46:04.339 INFO:teuthology.orchestra.run.smithi066.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-12T22:46:06.772 INFO:teuthology.orchestra.run.smithi087.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-12T22:46:07.094 INFO:teuthology.orchestra.run.smithi117.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-12T22:46:07.441 INFO:teuthology.orchestra.run.smithi099.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-09-12T22:46:09.083 INFO:teuthology.orchestra.run.smithi087.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T22:46:09.083 INFO:teuthology.orchestra.run.smithi087.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T22:46:09.151 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-09-12T22:46:09.169 INFO:teuthology.orchestra.run.smithi087.stdout:====================================================================================== 2024-09-12T22:46:09.169 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-09-12T22:46:09.170 INFO:teuthology.orchestra.run.smithi087.stdout:====================================================================================== 2024-09-12T22:46:09.170 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-09-12T22:46:09.170 INFO:teuthology.orchestra.run.smithi087.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T22:46:09.170 INFO:teuthology.orchestra.run.smithi087.stdout: ceph x86_64 2:19.1.1-314.g086c737f.el9 ceph 6.5 k 2024-09-12T22:46:09.170 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.4 M 2024-09-12T22:46:09.170 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 896 k 2024-09-12T22:46:09.170 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-314.g086c737f.el9 ceph 145 k 2024-09-12T22:46:09.170 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr x86_64 2:19.1.1-314.g086c737f.el9 ceph 1.5 M 2024-09-12T22:46:09.170 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 146 k 2024-09-12T22:46:09.170 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-dashboard noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 3.6 M 2024-09-12T22:46:09.170 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 7.4 M 2024-09-12T22:46:09.170 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-rook noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 49 k 2024-09-12T22:46:09.171 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-radosgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 11 M 2024-09-12T22:46:09.171 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-test x86_64 2:19.1.1-314.g086c737f.el9 ceph 49 M 2024-09-12T22:46:09.171 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-volume noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 285 k 2024-09-12T22:46:09.171 INFO:teuthology.orchestra.run.smithi087.stdout: cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 765 k 2024-09-12T22:46:09.171 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T22:46:09.171 INFO:teuthology.orchestra.run.smithi087.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T22:46:09.171 INFO:teuthology.orchestra.run.smithi087.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T22:46:09.171 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 32 k 2024-09-12T22:46:09.171 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 753 k 2024-09-12T22:46:09.171 INFO:teuthology.orchestra.run.smithi087.stdout: librados-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 127 k 2024-09-12T22:46:09.172 INFO:teuthology.orchestra.run.smithi087.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T22:46:09.172 INFO:teuthology.orchestra.run.smithi087.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T22:46:09.172 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T22:46:09.172 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cephfs x86_64 2:19.1.1-314.g086c737f.el9 ceph 162 k 2024-09-12T22:46:09.172 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rados x86_64 2:19.1.1-314.g086c737f.el9 ceph 320 k 2024-09-12T22:46:09.172 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 301 k 2024-09-12T22:46:09.172 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 99 k 2024-09-12T22:46:09.172 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 85 k 2024-09-12T22:46:09.172 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-mirror x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.1 M 2024-09-12T22:46:09.172 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-nbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 171 k 2024-09-12T22:46:09.172 INFO:teuthology.orchestra.run.smithi087.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T22:46:09.172 INFO:teuthology.orchestra.run.smithi087.stdout:Upgrading: 2024-09-12T22:46:09.173 INFO:teuthology.orchestra.run.smithi087.stdout: librados2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.4 M 2024-09-12T22:46:09.173 INFO:teuthology.orchestra.run.smithi087.stdout: librbd1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.2 M 2024-09-12T22:46:09.173 INFO:teuthology.orchestra.run.smithi087.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T22:46:09.173 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T22:46:09.173 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-09-12T22:46:09.173 INFO:teuthology.orchestra.run.smithi087.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T22:46:09.173 INFO:teuthology.orchestra.run.smithi087.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T22:46:09.173 INFO:teuthology.orchestra.run.smithi087.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T22:46:09.173 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 21 M 2024-09-12T22:46:09.173 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-grafana-dashboards noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 32 k 2024-09-12T22:46:09.173 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mds x86_64 2:19.1.1-314.g086c737f.el9 ceph 2.4 M 2024-09-12T22:46:09.174 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 249 k 2024-09-12T22:46:09.174 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mon x86_64 2:19.1.1-314.g086c737f.el9 ceph 4.7 M 2024-09-12T22:46:09.174 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-osd x86_64 2:19.1.1-314.g086c737f.el9 ceph 17 M 2024-09-12T22:46:09.174 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-prometheus-alerts noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 16 k 2024-09-12T22:46:09.174 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-selinux x86_64 2:19.1.1-314.g086c737f.el9 ceph 25 k 2024-09-12T22:46:09.174 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T22:46:09.174 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T22:46:09.174 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T22:46:09.174 INFO:teuthology.orchestra.run.smithi087.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T22:46:09.174 INFO:teuthology.orchestra.run.smithi087.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T22:46:09.174 INFO:teuthology.orchestra.run.smithi087.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T22:46:09.175 INFO:teuthology.orchestra.run.smithi087.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T22:46:09.175 INFO:teuthology.orchestra.run.smithi087.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T22:46:09.175 INFO:teuthology.orchestra.run.smithi087.stdout: libcephsqlite x86_64 2:19.1.1-314.g086c737f.el9 ceph 164 k 2024-09-12T22:46:09.175 INFO:teuthology.orchestra.run.smithi087.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T22:46:09.175 INFO:teuthology.orchestra.run.smithi087.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T22:46:09.175 INFO:teuthology.orchestra.run.smithi087.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T22:46:09.175 INFO:teuthology.orchestra.run.smithi087.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T22:46:09.175 INFO:teuthology.orchestra.run.smithi087.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T22:46:09.175 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 506 k 2024-09-12T22:46:09.175 INFO:teuthology.orchestra.run.smithi087.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T22:46:09.175 INFO:teuthology.orchestra.run.smithi087.stdout: librgw2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.3 M 2024-09-12T22:46:09.175 INFO:teuthology.orchestra.run.smithi087.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T22:46:09.176 INFO:teuthology.orchestra.run.smithi087.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T22:46:09.176 INFO:teuthology.orchestra.run.smithi087.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T22:46:09.176 INFO:teuthology.orchestra.run.smithi087.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T22:46:09.176 INFO:teuthology.orchestra.run.smithi087.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T22:46:09.176 INFO:teuthology.orchestra.run.smithi087.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T22:46:09.176 INFO:teuthology.orchestra.run.smithi087.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T22:46:09.176 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T22:46:09.176 INFO:teuthology.orchestra.run.smithi087.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T22:46:09.176 INFO:teuthology.orchestra.run.smithi087.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T22:46:09.176 INFO:teuthology.orchestra.run.smithi087.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T22:46:09.176 INFO:teuthology.orchestra.run.smithi087.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T22:46:09.176 INFO:teuthology.orchestra.run.smithi087.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T22:46:09.176 INFO:teuthology.orchestra.run.smithi087.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T22:46:09.177 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T22:46:09.177 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-argparse x86_64 2:19.1.1-314.g086c737f.el9 ceph 45 k 2024-09-12T22:46:09.177 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 136 k 2024-09-12T22:46:09.177 INFO:teuthology.orchestra.run.smithi087.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T22:46:09.177 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T22:46:09.177 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T22:46:09.177 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T22:46:09.177 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T22:46:09.177 INFO:teuthology.orchestra.run.smithi087.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T22:46:09.177 INFO:teuthology.orchestra.run.smithi087.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T22:46:09.177 INFO:teuthology.orchestra.run.smithi087.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T22:46:09.177 INFO:teuthology.orchestra.run.smithi087.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T22:46:09.177 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T22:46:09.178 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T22:46:09.178 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T22:46:09.178 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T22:46:09.178 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T22:46:09.178 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T22:46:09.178 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T22:46:09.178 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T22:46:09.178 INFO:teuthology.orchestra.run.smithi087.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T22:46:09.178 INFO:teuthology.orchestra.run.smithi087.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T22:46:09.178 INFO:teuthology.orchestra.run.smithi087.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T22:46:09.178 INFO:teuthology.orchestra.run.smithi087.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T22:46:09.178 INFO:teuthology.orchestra.run.smithi087.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T22:46:09.178 INFO:teuthology.orchestra.run.smithi087.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T22:46:09.179 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T22:46:09.179 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T22:46:09.179 INFO:teuthology.orchestra.run.smithi087.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T22:46:09.179 INFO:teuthology.orchestra.run.smithi087.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T22:46:09.179 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T22:46:09.179 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T22:46:09.179 INFO:teuthology.orchestra.run.smithi087.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T22:46:09.179 INFO:teuthology.orchestra.run.smithi087.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T22:46:09.179 INFO:teuthology.orchestra.run.smithi087.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T22:46:09.179 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T22:46:09.179 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T22:46:09.179 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T22:46:09.179 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T22:46:09.180 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T22:46:09.180 INFO:teuthology.orchestra.run.smithi087.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T22:46:09.180 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T22:46:09.180 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T22:46:09.180 INFO:teuthology.orchestra.run.smithi087.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T22:46:09.180 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T22:46:09.180 INFO:teuthology.orchestra.run.smithi087.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T22:46:09.180 INFO:teuthology.orchestra.run.smithi087.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T22:46:09.180 INFO:teuthology.orchestra.run.smithi087.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T22:46:09.180 INFO:teuthology.orchestra.run.smithi087.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T22:46:09.180 INFO:teuthology.orchestra.run.smithi087.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T22:46:09.180 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T22:46:09.180 INFO:teuthology.orchestra.run.smithi087.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T22:46:09.181 INFO:teuthology.orchestra.run.smithi087.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T22:46:09.181 INFO:teuthology.orchestra.run.smithi087.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T22:46:09.181 INFO:teuthology.orchestra.run.smithi087.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T22:46:09.181 INFO:teuthology.orchestra.run.smithi087.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T22:46:09.181 INFO:teuthology.orchestra.run.smithi087.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T22:46:09.181 INFO:teuthology.orchestra.run.smithi087.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T22:46:09.181 INFO:teuthology.orchestra.run.smithi087.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T22:46:09.181 INFO:teuthology.orchestra.run.smithi087.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T22:46:09.181 INFO:teuthology.orchestra.run.smithi087.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T22:46:09.181 INFO:teuthology.orchestra.run.smithi087.stdout:Installing weak dependencies: 2024-09-12T22:46:09.181 INFO:teuthology.orchestra.run.smithi087.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T22:46:09.181 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:46:09.182 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-09-12T22:46:09.182 INFO:teuthology.orchestra.run.smithi087.stdout:====================================================================================== 2024-09-12T22:46:09.182 INFO:teuthology.orchestra.run.smithi087.stdout:Install 135 Packages 2024-09-12T22:46:09.182 INFO:teuthology.orchestra.run.smithi087.stdout:Upgrade 4 Packages 2024-09-12T22:46:09.182 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:46:09.182 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 213 M 2024-09-12T22:46:09.182 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-09-12T22:46:09.397 INFO:teuthology.orchestra.run.smithi117.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T22:46:09.398 INFO:teuthology.orchestra.run.smithi117.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T22:46:09.467 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-12T22:46:09.495 INFO:teuthology.orchestra.run.smithi117.stdout:====================================================================================== 2024-09-12T22:46:09.495 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-09-12T22:46:09.495 INFO:teuthology.orchestra.run.smithi117.stdout:====================================================================================== 2024-09-12T22:46:09.495 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-12T22:46:09.495 INFO:teuthology.orchestra.run.smithi117.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T22:46:09.495 INFO:teuthology.orchestra.run.smithi117.stdout: ceph x86_64 2:19.1.1-314.g086c737f.el9 ceph 6.5 k 2024-09-12T22:46:09.495 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.4 M 2024-09-12T22:46:09.495 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 896 k 2024-09-12T22:46:09.495 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-314.g086c737f.el9 ceph 145 k 2024-09-12T22:46:09.496 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr x86_64 2:19.1.1-314.g086c737f.el9 ceph 1.5 M 2024-09-12T22:46:09.496 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 146 k 2024-09-12T22:46:09.496 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 3.6 M 2024-09-12T22:46:09.496 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 7.4 M 2024-09-12T22:46:09.496 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 49 k 2024-09-12T22:46:09.496 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 11 M 2024-09-12T22:46:09.496 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test x86_64 2:19.1.1-314.g086c737f.el9 ceph 49 M 2024-09-12T22:46:09.496 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-volume noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 285 k 2024-09-12T22:46:09.496 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 765 k 2024-09-12T22:46:09.496 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T22:46:09.496 INFO:teuthology.orchestra.run.smithi117.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T22:46:09.496 INFO:teuthology.orchestra.run.smithi117.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T22:46:09.497 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 32 k 2024-09-12T22:46:09.497 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 753 k 2024-09-12T22:46:09.497 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 127 k 2024-09-12T22:46:09.497 INFO:teuthology.orchestra.run.smithi117.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T22:46:09.497 INFO:teuthology.orchestra.run.smithi117.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T22:46:09.497 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T22:46:09.497 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs x86_64 2:19.1.1-314.g086c737f.el9 ceph 162 k 2024-09-12T22:46:09.497 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados x86_64 2:19.1.1-314.g086c737f.el9 ceph 320 k 2024-09-12T22:46:09.497 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 301 k 2024-09-12T22:46:09.497 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 99 k 2024-09-12T22:46:09.497 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 85 k 2024-09-12T22:46:09.497 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.1 M 2024-09-12T22:46:09.497 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 171 k 2024-09-12T22:46:09.498 INFO:teuthology.orchestra.run.smithi117.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T22:46:09.498 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrading: 2024-09-12T22:46:09.498 INFO:teuthology.orchestra.run.smithi117.stdout: librados2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.4 M 2024-09-12T22:46:09.498 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.2 M 2024-09-12T22:46:09.498 INFO:teuthology.orchestra.run.smithi117.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T22:46:09.498 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T22:46:09.498 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-09-12T22:46:09.498 INFO:teuthology.orchestra.run.smithi117.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T22:46:09.498 INFO:teuthology.orchestra.run.smithi117.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T22:46:09.498 INFO:teuthology.orchestra.run.smithi117.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T22:46:09.498 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 21 M 2024-09-12T22:46:09.498 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 32 k 2024-09-12T22:46:09.498 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds x86_64 2:19.1.1-314.g086c737f.el9 ceph 2.4 M 2024-09-12T22:46:09.498 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 249 k 2024-09-12T22:46:09.499 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon x86_64 2:19.1.1-314.g086c737f.el9 ceph 4.7 M 2024-09-12T22:46:09.499 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd x86_64 2:19.1.1-314.g086c737f.el9 ceph 17 M 2024-09-12T22:46:09.499 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 16 k 2024-09-12T22:46:09.499 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux x86_64 2:19.1.1-314.g086c737f.el9 ceph 25 k 2024-09-12T22:46:09.499 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T22:46:09.499 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T22:46:09.499 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T22:46:09.499 INFO:teuthology.orchestra.run.smithi117.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T22:46:09.499 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T22:46:09.499 INFO:teuthology.orchestra.run.smithi117.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T22:46:09.499 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T22:46:09.499 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T22:46:09.499 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite x86_64 2:19.1.1-314.g086c737f.el9 ceph 164 k 2024-09-12T22:46:09.500 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T22:46:09.500 INFO:teuthology.orchestra.run.smithi117.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T22:46:09.500 INFO:teuthology.orchestra.run.smithi117.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T22:46:09.500 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T22:46:09.500 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T22:46:09.500 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 506 k 2024-09-12T22:46:09.500 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T22:46:09.500 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.3 M 2024-09-12T22:46:09.500 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T22:46:09.500 INFO:teuthology.orchestra.run.smithi117.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T22:46:09.500 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T22:46:09.500 INFO:teuthology.orchestra.run.smithi117.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T22:46:09.501 INFO:teuthology.orchestra.run.smithi117.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T22:46:09.501 INFO:teuthology.orchestra.run.smithi117.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T22:46:09.501 INFO:teuthology.orchestra.run.smithi117.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T22:46:09.501 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T22:46:09.501 INFO:teuthology.orchestra.run.smithi117.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T22:46:09.501 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T22:46:09.501 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T22:46:09.501 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T22:46:09.501 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T22:46:09.501 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T22:46:09.501 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T22:46:09.501 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse x86_64 2:19.1.1-314.g086c737f.el9 ceph 45 k 2024-09-12T22:46:09.501 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 136 k 2024-09-12T22:46:09.502 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T22:46:09.502 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T22:46:09.502 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T22:46:09.502 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T22:46:09.502 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T22:46:09.502 INFO:teuthology.orchestra.run.smithi117.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T22:46:09.502 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T22:46:09.502 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T22:46:09.502 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T22:46:09.502 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T22:46:09.502 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T22:46:09.502 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T22:46:09.502 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T22:46:09.503 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T22:46:09.503 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T22:46:09.503 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T22:46:09.503 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T22:46:09.503 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T22:46:09.503 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T22:46:09.503 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T22:46:09.503 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T22:46:09.503 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T22:46:09.503 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T22:46:09.503 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T22:46:09.503 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T22:46:09.503 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T22:46:09.504 INFO:teuthology.orchestra.run.smithi117.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T22:46:09.504 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T22:46:09.504 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T22:46:09.504 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T22:46:09.504 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T22:46:09.504 INFO:teuthology.orchestra.run.smithi117.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T22:46:09.504 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T22:46:09.504 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T22:46:09.504 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T22:46:09.504 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T22:46:09.504 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T22:46:09.504 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T22:46:09.504 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T22:46:09.505 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T22:46:09.505 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T22:46:09.505 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T22:46:09.505 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T22:46:09.505 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T22:46:09.505 INFO:teuthology.orchestra.run.smithi117.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T22:46:09.505 INFO:teuthology.orchestra.run.smithi117.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T22:46:09.505 INFO:teuthology.orchestra.run.smithi117.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T22:46:09.505 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T22:46:09.505 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T22:46:09.505 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T22:46:09.505 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T22:46:09.505 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T22:46:09.505 INFO:teuthology.orchestra.run.smithi117.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T22:46:09.506 INFO:teuthology.orchestra.run.smithi117.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T22:46:09.506 INFO:teuthology.orchestra.run.smithi117.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T22:46:09.506 INFO:teuthology.orchestra.run.smithi117.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T22:46:09.506 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T22:46:09.506 INFO:teuthology.orchestra.run.smithi117.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T22:46:09.506 INFO:teuthology.orchestra.run.smithi117.stdout:Installing weak dependencies: 2024-09-12T22:46:09.506 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T22:46:09.506 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:46:09.506 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-12T22:46:09.506 INFO:teuthology.orchestra.run.smithi117.stdout:====================================================================================== 2024-09-12T22:46:09.506 INFO:teuthology.orchestra.run.smithi117.stdout:Install 135 Packages 2024-09-12T22:46:09.506 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrade 4 Packages 2024-09-12T22:46:09.506 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:46:09.507 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 213 M 2024-09-12T22:46:09.507 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-12T22:46:09.802 INFO:teuthology.orchestra.run.smithi099.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T22:46:09.803 INFO:teuthology.orchestra.run.smithi099.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T22:46:09.872 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-12T22:46:09.898 INFO:teuthology.orchestra.run.smithi099.stdout:====================================================================================== 2024-09-12T22:46:09.898 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-09-12T22:46:09.898 INFO:teuthology.orchestra.run.smithi099.stdout:====================================================================================== 2024-09-12T22:46:09.898 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-12T22:46:09.898 INFO:teuthology.orchestra.run.smithi099.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T22:46:09.898 INFO:teuthology.orchestra.run.smithi099.stdout: ceph x86_64 2:19.1.1-314.g086c737f.el9 ceph 6.5 k 2024-09-12T22:46:09.898 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.4 M 2024-09-12T22:46:09.898 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 896 k 2024-09-12T22:46:09.899 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-314.g086c737f.el9 ceph 145 k 2024-09-12T22:46:09.899 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr x86_64 2:19.1.1-314.g086c737f.el9 ceph 1.5 M 2024-09-12T22:46:09.899 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 146 k 2024-09-12T22:46:09.899 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 3.6 M 2024-09-12T22:46:09.899 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 7.4 M 2024-09-12T22:46:09.899 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-rook noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 49 k 2024-09-12T22:46:09.899 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-radosgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 11 M 2024-09-12T22:46:09.899 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-test x86_64 2:19.1.1-314.g086c737f.el9 ceph 49 M 2024-09-12T22:46:09.899 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-volume noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 285 k 2024-09-12T22:46:09.899 INFO:teuthology.orchestra.run.smithi099.stdout: cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 765 k 2024-09-12T22:46:09.899 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T22:46:09.899 INFO:teuthology.orchestra.run.smithi099.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T22:46:09.899 INFO:teuthology.orchestra.run.smithi099.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T22:46:09.900 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 32 k 2024-09-12T22:46:09.900 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 753 k 2024-09-12T22:46:09.900 INFO:teuthology.orchestra.run.smithi099.stdout: librados-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 127 k 2024-09-12T22:46:09.900 INFO:teuthology.orchestra.run.smithi099.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T22:46:09.900 INFO:teuthology.orchestra.run.smithi099.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T22:46:09.900 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T22:46:09.900 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cephfs x86_64 2:19.1.1-314.g086c737f.el9 ceph 162 k 2024-09-12T22:46:09.900 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rados x86_64 2:19.1.1-314.g086c737f.el9 ceph 320 k 2024-09-12T22:46:09.900 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 301 k 2024-09-12T22:46:09.900 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 99 k 2024-09-12T22:46:09.900 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 85 k 2024-09-12T22:46:09.900 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-mirror x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.1 M 2024-09-12T22:46:09.901 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-nbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 171 k 2024-09-12T22:46:09.901 INFO:teuthology.orchestra.run.smithi099.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T22:46:09.901 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrading: 2024-09-12T22:46:09.901 INFO:teuthology.orchestra.run.smithi099.stdout: librados2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.4 M 2024-09-12T22:46:09.901 INFO:teuthology.orchestra.run.smithi099.stdout: librbd1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.2 M 2024-09-12T22:46:09.901 INFO:teuthology.orchestra.run.smithi099.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T22:46:09.901 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T22:46:09.901 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-09-12T22:46:09.901 INFO:teuthology.orchestra.run.smithi099.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T22:46:09.901 INFO:teuthology.orchestra.run.smithi099.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T22:46:09.901 INFO:teuthology.orchestra.run.smithi099.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T22:46:09.901 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 21 M 2024-09-12T22:46:09.902 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-grafana-dashboards noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 32 k 2024-09-12T22:46:09.902 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mds x86_64 2:19.1.1-314.g086c737f.el9 ceph 2.4 M 2024-09-12T22:46:09.902 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 249 k 2024-09-12T22:46:09.902 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon x86_64 2:19.1.1-314.g086c737f.el9 ceph 4.7 M 2024-09-12T22:46:09.902 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-osd x86_64 2:19.1.1-314.g086c737f.el9 ceph 17 M 2024-09-12T22:46:09.903 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-prometheus-alerts noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 16 k 2024-09-12T22:46:09.903 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-selinux x86_64 2:19.1.1-314.g086c737f.el9 ceph 25 k 2024-09-12T22:46:09.903 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T22:46:09.904 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T22:46:09.904 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T22:46:09.904 INFO:teuthology.orchestra.run.smithi099.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T22:46:09.904 INFO:teuthology.orchestra.run.smithi099.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T22:46:09.904 INFO:teuthology.orchestra.run.smithi099.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T22:46:09.904 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T22:46:09.904 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T22:46:09.904 INFO:teuthology.orchestra.run.smithi099.stdout: libcephsqlite x86_64 2:19.1.1-314.g086c737f.el9 ceph 164 k 2024-09-12T22:46:09.904 INFO:teuthology.orchestra.run.smithi099.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T22:46:09.904 INFO:teuthology.orchestra.run.smithi099.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T22:46:09.904 INFO:teuthology.orchestra.run.smithi099.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T22:46:09.905 INFO:teuthology.orchestra.run.smithi099.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T22:46:09.905 INFO:teuthology.orchestra.run.smithi099.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T22:46:09.905 INFO:teuthology.orchestra.run.smithi099.stdout: libradosstriper1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 506 k 2024-09-12T22:46:09.905 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T22:46:09.905 INFO:teuthology.orchestra.run.smithi099.stdout: librgw2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.3 M 2024-09-12T22:46:09.905 INFO:teuthology.orchestra.run.smithi099.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T22:46:09.905 INFO:teuthology.orchestra.run.smithi099.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T22:46:09.905 INFO:teuthology.orchestra.run.smithi099.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T22:46:09.905 INFO:teuthology.orchestra.run.smithi099.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T22:46:09.905 INFO:teuthology.orchestra.run.smithi099.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T22:46:09.905 INFO:teuthology.orchestra.run.smithi099.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T22:46:09.905 INFO:teuthology.orchestra.run.smithi099.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T22:46:09.905 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T22:46:09.906 INFO:teuthology.orchestra.run.smithi099.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T22:46:09.906 INFO:teuthology.orchestra.run.smithi099.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T22:46:09.906 INFO:teuthology.orchestra.run.smithi099.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T22:46:09.906 INFO:teuthology.orchestra.run.smithi099.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T22:46:09.906 INFO:teuthology.orchestra.run.smithi099.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T22:46:09.906 INFO:teuthology.orchestra.run.smithi099.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T22:46:09.906 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T22:46:09.906 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse x86_64 2:19.1.1-314.g086c737f.el9 ceph 45 k 2024-09-12T22:46:09.906 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 136 k 2024-09-12T22:46:09.906 INFO:teuthology.orchestra.run.smithi099.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T22:46:09.906 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T22:46:09.906 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T22:46:09.907 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T22:46:09.907 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T22:46:09.907 INFO:teuthology.orchestra.run.smithi099.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T22:46:09.907 INFO:teuthology.orchestra.run.smithi099.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T22:46:09.907 INFO:teuthology.orchestra.run.smithi099.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T22:46:09.907 INFO:teuthology.orchestra.run.smithi099.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T22:46:09.907 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T22:46:09.907 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T22:46:09.907 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T22:46:09.907 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T22:46:09.907 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T22:46:09.907 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T22:46:09.908 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T22:46:09.908 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T22:46:09.908 INFO:teuthology.orchestra.run.smithi099.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T22:46:09.908 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T22:46:09.908 INFO:teuthology.orchestra.run.smithi099.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T22:46:09.908 INFO:teuthology.orchestra.run.smithi099.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T22:46:09.908 INFO:teuthology.orchestra.run.smithi099.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T22:46:09.908 INFO:teuthology.orchestra.run.smithi099.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T22:46:09.908 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T22:46:09.908 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T22:46:09.908 INFO:teuthology.orchestra.run.smithi099.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T22:46:09.908 INFO:teuthology.orchestra.run.smithi099.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T22:46:09.909 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T22:46:09.909 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T22:46:09.909 INFO:teuthology.orchestra.run.smithi099.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T22:46:09.909 INFO:teuthology.orchestra.run.smithi099.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T22:46:09.909 INFO:teuthology.orchestra.run.smithi099.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T22:46:09.909 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T22:46:09.909 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T22:46:09.909 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T22:46:09.909 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T22:46:09.909 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T22:46:09.909 INFO:teuthology.orchestra.run.smithi099.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T22:46:09.909 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T22:46:09.910 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T22:46:09.910 INFO:teuthology.orchestra.run.smithi099.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T22:46:09.910 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T22:46:09.910 INFO:teuthology.orchestra.run.smithi099.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T22:46:09.910 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T22:46:09.910 INFO:teuthology.orchestra.run.smithi099.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T22:46:09.910 INFO:teuthology.orchestra.run.smithi099.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T22:46:09.910 INFO:teuthology.orchestra.run.smithi099.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T22:46:09.910 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T22:46:09.910 INFO:teuthology.orchestra.run.smithi099.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T22:46:09.910 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T22:46:09.910 INFO:teuthology.orchestra.run.smithi099.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T22:46:09.910 INFO:teuthology.orchestra.run.smithi099.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T22:46:09.911 INFO:teuthology.orchestra.run.smithi099.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T22:46:09.911 INFO:teuthology.orchestra.run.smithi099.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T22:46:09.911 INFO:teuthology.orchestra.run.smithi099.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T22:46:09.911 INFO:teuthology.orchestra.run.smithi099.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T22:46:09.911 INFO:teuthology.orchestra.run.smithi099.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T22:46:09.911 INFO:teuthology.orchestra.run.smithi099.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T22:46:09.911 INFO:teuthology.orchestra.run.smithi099.stdout:Installing weak dependencies: 2024-09-12T22:46:09.911 INFO:teuthology.orchestra.run.smithi099.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T22:46:09.911 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:46:09.911 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-12T22:46:09.911 INFO:teuthology.orchestra.run.smithi099.stdout:====================================================================================== 2024-09-12T22:46:09.911 INFO:teuthology.orchestra.run.smithi099.stdout:Install 135 Packages 2024-09-12T22:46:09.911 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrade 4 Packages 2024-09-12T22:46:09.912 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:46:09.912 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 213 M 2024-09-12T22:46:09.912 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-12T22:46:09.987 INFO:teuthology.orchestra.run.smithi117.stdout:(1/139): ceph-19.1.1-314.g086c737f.el9.x86_64.r 48 kB/s | 6.5 kB 00:00 2024-09-12T22:46:10.028 INFO:teuthology.orchestra.run.smithi066.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-12T22:46:10.157 INFO:teuthology.orchestra.run.smithi087.stdout:(1/139): ceph-19.1.1-314.g086c737f.el9.x86_64.r 50 kB/s | 6.5 kB 00:00 2024-09-12T22:46:10.179 INFO:teuthology.orchestra.run.smithi117.stdout:(2/139): ceph-fuse-19.1.1-314.g086c737f.el9.x86 4.6 MB/s | 896 kB 00:00 2024-09-12T22:46:10.229 INFO:teuthology.orchestra.run.smithi117.stdout:(3/139): ceph-immutable-object-cache-19.1.1-314 2.9 MB/s | 145 kB 00:00 2024-09-12T22:46:10.390 INFO:teuthology.orchestra.run.smithi087.stdout:(2/139): ceph-fuse-19.1.1-314.g086c737f.el9.x86 3.8 MB/s | 896 kB 00:00 2024-09-12T22:46:10.448 INFO:teuthology.orchestra.run.smithi087.stdout:(3/139): ceph-immutable-object-cache-19.1.1-314 2.5 MB/s | 145 kB 00:00 2024-09-12T22:46:10.521 INFO:teuthology.orchestra.run.smithi117.stdout:(4/139): ceph-base-19.1.1-314.g086c737f.el9.x86 8.1 MB/s | 5.4 MB 00:00 2024-09-12T22:46:10.550 INFO:teuthology.orchestra.run.smithi099.stdout:(1/139): ceph-19.1.1-314.g086c737f.el9.x86_64.r 46 kB/s | 6.5 kB 00:00 2024-09-12T22:46:10.572 INFO:teuthology.orchestra.run.smithi117.stdout:(5/139): ceph-mds-19.1.1-314.g086c737f.el9.x86_ 7.0 MB/s | 2.4 MB 00:00 2024-09-12T22:46:10.705 INFO:teuthology.orchestra.run.smithi117.stdout:(6/139): ceph-mgr-19.1.1-314.g086c737f.el9.x86_ 8.3 MB/s | 1.5 MB 00:00 2024-09-12T22:46:10.774 INFO:teuthology.orchestra.run.smithi087.stdout:(4/139): ceph-mds-19.1.1-314.g086c737f.el9.x86_ 7.3 MB/s | 2.4 MB 00:00 2024-09-12T22:46:10.874 INFO:teuthology.orchestra.run.smithi087.stdout:(5/139): ceph-base-19.1.1-314.g086c737f.el9.x86 6.4 MB/s | 5.4 MB 00:00 2024-09-12T22:46:11.099 INFO:teuthology.orchestra.run.smithi087.stdout:(6/139): ceph-mgr-19.1.1-314.g086c737f.el9.x86_ 4.7 MB/s | 1.5 MB 00:00 2024-09-12T22:46:11.214 INFO:teuthology.orchestra.run.smithi117.stdout:(7/139): ceph-mon-19.1.1-314.g086c737f.el9.x86_ 7.3 MB/s | 4.7 MB 00:00 2024-09-12T22:46:11.242 INFO:teuthology.orchestra.run.smithi099.stdout:(2/139): ceph-fuse-19.1.1-314.g086c737f.el9.x86 1.3 MB/s | 896 kB 00:00 2024-09-12T22:46:11.574 INFO:teuthology.orchestra.run.smithi087.stdout:(7/139): ceph-mon-19.1.1-314.g086c737f.el9.x86_ 6.7 MB/s | 4.7 MB 00:00 2024-09-12T22:46:11.668 INFO:teuthology.orchestra.run.smithi099.stdout:(3/139): ceph-immutable-object-cache-19.1.1-314 342 kB/s | 145 kB 00:00 2024-09-12T22:46:12.055 INFO:teuthology.orchestra.run.smithi117.stdout:(8/139): ceph-common-19.1.1-314.g086c737f.el9.x 9.6 MB/s | 21 MB 00:02 2024-09-12T22:46:12.084 INFO:teuthology.orchestra.run.smithi099.stdout:(4/139): ceph-base-19.1.1-314.g086c737f.el9.x86 3.2 MB/s | 5.4 MB 00:01 2024-09-12T22:46:12.131 INFO:teuthology.orchestra.run.smithi117.stdout:(9/139): ceph-selinux-19.1.1-314.g086c737f.el9. 336 kB/s | 25 kB 00:00 2024-09-12T22:46:12.400 INFO:teuthology.orchestra.run.smithi066.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T22:46:12.400 INFO:teuthology.orchestra.run.smithi066.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T22:46:12.456 INFO:teuthology.orchestra.run.smithi117.stdout:(10/139): ceph-osd-19.1.1-314.g086c737f.el9.x86 9.6 MB/s | 17 MB 00:01 2024-09-12T22:46:12.476 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-09-12T22:46:12.485 INFO:teuthology.orchestra.run.smithi099.stdout:(5/139): ceph-mgr-19.1.1-314.g086c737f.el9.x86_ 3.8 MB/s | 1.5 MB 00:00 2024-09-12T22:46:12.506 INFO:teuthology.orchestra.run.smithi066.stdout:====================================================================================== 2024-09-12T22:46:12.506 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repository Size 2024-09-12T22:46:12.506 INFO:teuthology.orchestra.run.smithi066.stdout:====================================================================================== 2024-09-12T22:46:12.506 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2024-09-12T22:46:12.506 INFO:teuthology.orchestra.run.smithi066.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T22:46:12.506 INFO:teuthology.orchestra.run.smithi066.stdout: ceph x86_64 2:19.1.1-314.g086c737f.el9 ceph 6.5 k 2024-09-12T22:46:12.506 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-base x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.4 M 2024-09-12T22:46:12.506 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 896 k 2024-09-12T22:46:12.506 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-314.g086c737f.el9 ceph 145 k 2024-09-12T22:46:12.506 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr x86_64 2:19.1.1-314.g086c737f.el9 ceph 1.5 M 2024-09-12T22:46:12.506 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 146 k 2024-09-12T22:46:12.507 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-dashboard noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 3.6 M 2024-09-12T22:46:12.507 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 7.4 M 2024-09-12T22:46:12.507 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-rook noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 49 k 2024-09-12T22:46:12.507 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-radosgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 11 M 2024-09-12T22:46:12.507 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-test x86_64 2:19.1.1-314.g086c737f.el9 ceph 49 M 2024-09-12T22:46:12.507 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-volume noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 285 k 2024-09-12T22:46:12.507 INFO:teuthology.orchestra.run.smithi066.stdout: cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 765 k 2024-09-12T22:46:12.507 INFO:teuthology.orchestra.run.smithi066.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T22:46:12.507 INFO:teuthology.orchestra.run.smithi066.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T22:46:12.507 INFO:teuthology.orchestra.run.smithi066.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T22:46:12.507 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 32 k 2024-09-12T22:46:12.507 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 753 k 2024-09-12T22:46:12.507 INFO:teuthology.orchestra.run.smithi066.stdout: librados-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 127 k 2024-09-12T22:46:12.508 INFO:teuthology.orchestra.run.smithi066.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T22:46:12.508 INFO:teuthology.orchestra.run.smithi066.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T22:46:12.508 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T22:46:12.508 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cephfs x86_64 2:19.1.1-314.g086c737f.el9 ceph 162 k 2024-09-12T22:46:12.508 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rados x86_64 2:19.1.1-314.g086c737f.el9 ceph 320 k 2024-09-12T22:46:12.508 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 301 k 2024-09-12T22:46:12.508 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 99 k 2024-09-12T22:46:12.508 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 85 k 2024-09-12T22:46:12.508 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-mirror x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.1 M 2024-09-12T22:46:12.508 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-nbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 171 k 2024-09-12T22:46:12.508 INFO:teuthology.orchestra.run.smithi066.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T22:46:12.509 INFO:teuthology.orchestra.run.smithi066.stdout:Upgrading: 2024-09-12T22:46:12.509 INFO:teuthology.orchestra.run.smithi066.stdout: librados2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.4 M 2024-09-12T22:46:12.509 INFO:teuthology.orchestra.run.smithi066.stdout: librbd1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.2 M 2024-09-12T22:46:12.509 INFO:teuthology.orchestra.run.smithi066.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T22:46:12.509 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T22:46:12.509 INFO:teuthology.orchestra.run.smithi066.stdout:Installing dependencies: 2024-09-12T22:46:12.509 INFO:teuthology.orchestra.run.smithi066.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T22:46:12.509 INFO:teuthology.orchestra.run.smithi066.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T22:46:12.509 INFO:teuthology.orchestra.run.smithi066.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T22:46:12.509 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 21 M 2024-09-12T22:46:12.509 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-grafana-dashboards noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 32 k 2024-09-12T22:46:12.509 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mds x86_64 2:19.1.1-314.g086c737f.el9 ceph 2.4 M 2024-09-12T22:46:12.509 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 249 k 2024-09-12T22:46:12.510 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mon x86_64 2:19.1.1-314.g086c737f.el9 ceph 4.7 M 2024-09-12T22:46:12.510 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-osd x86_64 2:19.1.1-314.g086c737f.el9 ceph 17 M 2024-09-12T22:46:12.510 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-prometheus-alerts noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 16 k 2024-09-12T22:46:12.510 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-selinux x86_64 2:19.1.1-314.g086c737f.el9 ceph 25 k 2024-09-12T22:46:12.510 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T22:46:12.510 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T22:46:12.510 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T22:46:12.510 INFO:teuthology.orchestra.run.smithi066.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T22:46:12.510 INFO:teuthology.orchestra.run.smithi066.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T22:46:12.510 INFO:teuthology.orchestra.run.smithi066.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T22:46:12.510 INFO:teuthology.orchestra.run.smithi066.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T22:46:12.510 INFO:teuthology.orchestra.run.smithi066.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T22:46:12.510 INFO:teuthology.orchestra.run.smithi066.stdout: libcephsqlite x86_64 2:19.1.1-314.g086c737f.el9 ceph 164 k 2024-09-12T22:46:12.511 INFO:teuthology.orchestra.run.smithi066.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T22:46:12.511 INFO:teuthology.orchestra.run.smithi066.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T22:46:12.511 INFO:teuthology.orchestra.run.smithi066.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T22:46:12.511 INFO:teuthology.orchestra.run.smithi066.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T22:46:12.511 INFO:teuthology.orchestra.run.smithi066.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T22:46:12.511 INFO:teuthology.orchestra.run.smithi066.stdout: libradosstriper1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 506 k 2024-09-12T22:46:12.511 INFO:teuthology.orchestra.run.smithi066.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T22:46:12.511 INFO:teuthology.orchestra.run.smithi066.stdout: librgw2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.3 M 2024-09-12T22:46:12.511 INFO:teuthology.orchestra.run.smithi066.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T22:46:12.511 INFO:teuthology.orchestra.run.smithi066.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T22:46:12.511 INFO:teuthology.orchestra.run.smithi066.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T22:46:12.511 INFO:teuthology.orchestra.run.smithi066.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T22:46:12.512 INFO:teuthology.orchestra.run.smithi066.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T22:46:12.512 INFO:teuthology.orchestra.run.smithi066.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T22:46:12.512 INFO:teuthology.orchestra.run.smithi066.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T22:46:12.512 INFO:teuthology.orchestra.run.smithi066.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T22:46:12.512 INFO:teuthology.orchestra.run.smithi066.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T22:46:12.512 INFO:teuthology.orchestra.run.smithi066.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T22:46:12.512 INFO:teuthology.orchestra.run.smithi066.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T22:46:12.512 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T22:46:12.512 INFO:teuthology.orchestra.run.smithi066.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T22:46:12.512 INFO:teuthology.orchestra.run.smithi066.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T22:46:12.512 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T22:46:12.512 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-argparse x86_64 2:19.1.1-314.g086c737f.el9 ceph 45 k 2024-09-12T22:46:12.512 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 136 k 2024-09-12T22:46:12.513 INFO:teuthology.orchestra.run.smithi066.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T22:46:12.513 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T22:46:12.513 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T22:46:12.513 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T22:46:12.513 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T22:46:12.513 INFO:teuthology.orchestra.run.smithi066.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T22:46:12.513 INFO:teuthology.orchestra.run.smithi066.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T22:46:12.513 INFO:teuthology.orchestra.run.smithi066.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T22:46:12.513 INFO:teuthology.orchestra.run.smithi066.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T22:46:12.513 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T22:46:12.513 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T22:46:12.513 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T22:46:12.514 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T22:46:12.514 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T22:46:12.514 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T22:46:12.514 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T22:46:12.514 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T22:46:12.514 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T22:46:12.514 INFO:teuthology.orchestra.run.smithi066.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T22:46:12.514 INFO:teuthology.orchestra.run.smithi066.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T22:46:12.514 INFO:teuthology.orchestra.run.smithi066.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T22:46:12.514 INFO:teuthology.orchestra.run.smithi066.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T22:46:12.514 INFO:teuthology.orchestra.run.smithi066.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T22:46:12.514 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T22:46:12.514 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T22:46:12.514 INFO:teuthology.orchestra.run.smithi066.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T22:46:12.515 INFO:teuthology.orchestra.run.smithi066.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T22:46:12.515 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T22:46:12.515 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T22:46:12.515 INFO:teuthology.orchestra.run.smithi066.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T22:46:12.515 INFO:teuthology.orchestra.run.smithi066.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T22:46:12.515 INFO:teuthology.orchestra.run.smithi066.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T22:46:12.515 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T22:46:12.515 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T22:46:12.515 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T22:46:12.515 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T22:46:12.515 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T22:46:12.515 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T22:46:12.515 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T22:46:12.516 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T22:46:12.516 INFO:teuthology.orchestra.run.smithi066.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T22:46:12.516 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T22:46:12.516 INFO:teuthology.orchestra.run.smithi066.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T22:46:12.516 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T22:46:12.516 INFO:teuthology.orchestra.run.smithi066.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T22:46:12.516 INFO:teuthology.orchestra.run.smithi066.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T22:46:12.516 INFO:teuthology.orchestra.run.smithi066.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T22:46:12.516 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T22:46:12.516 INFO:teuthology.orchestra.run.smithi066.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T22:46:12.516 INFO:teuthology.orchestra.run.smithi066.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T22:46:12.516 INFO:teuthology.orchestra.run.smithi066.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T22:46:12.516 INFO:teuthology.orchestra.run.smithi066.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T22:46:12.517 INFO:teuthology.orchestra.run.smithi066.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T22:46:12.517 INFO:teuthology.orchestra.run.smithi066.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T22:46:12.517 INFO:teuthology.orchestra.run.smithi066.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T22:46:12.517 INFO:teuthology.orchestra.run.smithi066.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T22:46:12.517 INFO:teuthology.orchestra.run.smithi066.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T22:46:12.517 INFO:teuthology.orchestra.run.smithi066.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T22:46:12.517 INFO:teuthology.orchestra.run.smithi066.stdout:Installing weak dependencies: 2024-09-12T22:46:12.517 INFO:teuthology.orchestra.run.smithi066.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T22:46:12.517 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:46:12.517 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2024-09-12T22:46:12.517 INFO:teuthology.orchestra.run.smithi066.stdout:====================================================================================== 2024-09-12T22:46:12.517 INFO:teuthology.orchestra.run.smithi066.stdout:Install 135 Packages 2024-09-12T22:46:12.517 INFO:teuthology.orchestra.run.smithi066.stdout:Upgrade 4 Packages 2024-09-12T22:46:12.517 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:46:12.518 INFO:teuthology.orchestra.run.smithi117.stdout:(11/139): libcephfs-devel-19.1.1-314.g086c737f. 546 kB/s | 32 kB 00:00 2024-09-12T22:46:12.518 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 213 M 2024-09-12T22:46:12.518 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2024-09-12T22:46:12.574 INFO:teuthology.orchestra.run.smithi087.stdout:(8/139): ceph-common-19.1.1-314.g086c737f.el9.x 8.3 MB/s | 21 MB 00:02 2024-09-12T22:46:12.631 INFO:teuthology.orchestra.run.smithi117.stdout:(12/139): ceph-radosgw-19.1.1-314.g086c737f.el9 7.5 MB/s | 11 MB 00:01 2024-09-12T22:46:12.641 INFO:teuthology.orchestra.run.smithi087.stdout:(9/139): ceph-selinux-19.1.1-314.g086c737f.el9. 378 kB/s | 25 kB 00:00 2024-09-12T22:46:12.673 INFO:teuthology.orchestra.run.smithi117.stdout:(13/139): libcephfs2-19.1.1-314.g086c737f.el9.x 4.6 MB/s | 753 kB 00:00 2024-09-12T22:46:12.698 INFO:teuthology.orchestra.run.smithi117.stdout:(14/139): libcephsqlite-19.1.1-314.g086c737f.el 2.4 MB/s | 164 kB 00:00 2024-09-12T22:46:12.749 INFO:teuthology.orchestra.run.smithi117.stdout:(15/139): librados-devel-19.1.1-314.g086c737f.e 1.6 MB/s | 127 kB 00:00 2024-09-12T22:46:12.782 INFO:teuthology.orchestra.run.smithi117.stdout:(16/139): libradosstriper1-19.1.1-314.g086c737f 5.9 MB/s | 506 kB 00:00 2024-09-12T22:46:12.800 INFO:teuthology.orchestra.run.smithi087.stdout:(10/139): ceph-radosgw-19.1.1-314.g086c737f.el9 8.7 MB/s | 11 MB 00:01 2024-09-12T22:46:12.849 INFO:teuthology.orchestra.run.smithi117.stdout:(17/139): python3-ceph-argparse-19.1.1-314.g086 678 kB/s | 45 kB 00:00 2024-09-12T22:46:12.884 INFO:teuthology.orchestra.run.smithi087.stdout:(11/139): libcephfs-devel-19.1.1-314.g086c737f. 381 kB/s | 32 kB 00:00 2024-09-12T22:46:12.941 INFO:teuthology.orchestra.run.smithi117.stdout:(18/139): python3-ceph-common-19.1.1-314.g086c7 1.4 MB/s | 136 kB 00:00 2024-09-12T22:46:13.041 INFO:teuthology.orchestra.run.smithi117.stdout:(19/139): python3-cephfs-19.1.1-314.g086c737f.e 1.6 MB/s | 162 kB 00:00 2024-09-12T22:46:13.042 INFO:teuthology.orchestra.run.smithi087.stdout:(12/139): libcephfs2-19.1.1-314.g086c737f.el9.x 4.6 MB/s | 753 kB 00:00 2024-09-12T22:46:13.043 INFO:teuthology.orchestra.run.smithi099.stdout:(6/139): ceph-mds-19.1.1-314.g086c737f.el9.x86_ 1.7 MB/s | 2.4 MB 00:01 2024-09-12T22:46:13.134 INFO:teuthology.orchestra.run.smithi117.stdout:(20/139): python3-rados-19.1.1-314.g086c737f.el 3.4 MB/s | 320 kB 00:00 2024-09-12T22:46:13.134 INFO:teuthology.orchestra.run.smithi087.stdout:(13/139): libcephsqlite-19.1.1-314.g086c737f.el 1.7 MB/s | 164 kB 00:00 2024-09-12T22:46:13.225 INFO:teuthology.orchestra.run.smithi117.stdout:(21/139): python3-rbd-19.1.1-314.g086c737f.el9. 3.2 MB/s | 301 kB 00:00 2024-09-12T22:46:13.226 INFO:teuthology.orchestra.run.smithi087.stdout:(14/139): librados-devel-19.1.1-314.g086c737f.e 1.4 MB/s | 127 kB 00:00 2024-09-12T22:46:13.301 INFO:teuthology.orchestra.run.smithi117.stdout:(22/139): librgw2-19.1.1-314.g086c737f.el9.x86_ 9.7 MB/s | 5.3 MB 00:00 2024-09-12T22:46:13.310 INFO:teuthology.orchestra.run.smithi087.stdout:(15/139): libradosstriper1-19.1.1-314.g086c737f 5.9 MB/s | 506 kB 00:00 2024-09-12T22:46:13.326 INFO:teuthology.orchestra.run.smithi117.stdout:(23/139): python3-rgw-19.1.1-314.g086c737f.el9. 991 kB/s | 99 kB 00:00 2024-09-12T22:46:13.359 INFO:teuthology.orchestra.run.smithi117.stdout:(24/139): rbd-fuse-19.1.1-314.g086c737f.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-12T22:46:13.385 INFO:teuthology.orchestra.run.smithi099.stdout:(7/139): ceph-mon-19.1.1-314.g086c737f.el9.x86_ 5.2 MB/s | 4.7 MB 00:00 2024-09-12T22:46:13.435 INFO:teuthology.orchestra.run.smithi117.stdout:(25/139): rbd-nbd-19.1.1-314.g086c737f.el9.x86_ 2.2 MB/s | 171 kB 00:00 2024-09-12T22:46:13.518 INFO:teuthology.orchestra.run.smithi117.stdout:(26/139): ceph-grafana-dashboards-19.1.1-314.g0 381 kB/s | 32 kB 00:00 2024-09-12T22:46:13.535 INFO:teuthology.orchestra.run.smithi087.stdout:(16/139): ceph-osd-19.1.1-314.g086c737f.el9.x86 6.9 MB/s | 17 MB 00:02 2024-09-12T22:46:13.546 INFO:teuthology.orchestra.run.smithi066.stdout:(1/139): ceph-19.1.1-314.g086c737f.el9.x86_64.r 28 kB/s | 6.5 kB 00:00 2024-09-12T22:46:13.602 INFO:teuthology.orchestra.run.smithi117.stdout:(27/139): ceph-mgr-cephadm-19.1.1-314.g086c737f 1.7 MB/s | 146 kB 00:00 2024-09-12T22:46:13.628 INFO:teuthology.orchestra.run.smithi087.stdout:(17/139): python3-ceph-argparse-19.1.1-314.g086 493 kB/s | 45 kB 00:00 2024-09-12T22:46:13.719 INFO:teuthology.orchestra.run.smithi117.stdout:(28/139): rbd-mirror-19.1.1-314.g086c737f.el9.x 7.9 MB/s | 3.1 MB 00:00 2024-09-12T22:46:13.727 INFO:teuthology.orchestra.run.smithi087.stdout:(18/139): python3-ceph-common-19.1.1-314.g086c7 1.3 MB/s | 136 kB 00:00 2024-09-12T22:46:13.828 INFO:teuthology.orchestra.run.smithi087.stdout:(19/139): python3-cephfs-19.1.1-314.g086c737f.e 1.6 MB/s | 162 kB 00:00 2024-09-12T22:46:13.945 INFO:teuthology.orchestra.run.smithi087.stdout:(20/139): python3-rados-19.1.1-314.g086c737f.el 2.7 MB/s | 320 kB 00:00 2024-09-12T22:46:14.053 INFO:teuthology.orchestra.run.smithi117.stdout:(29/139): ceph-mgr-dashboard-19.1.1-314.g086c73 7.9 MB/s | 3.6 MB 00:00 2024-09-12T22:46:14.058 INFO:teuthology.orchestra.run.smithi087.stdout:(21/139): librgw2-19.1.1-314.g086c737f.el9.x86_ 7.1 MB/s | 5.3 MB 00:00 2024-09-12T22:46:14.096 INFO:teuthology.orchestra.run.smithi087.stdout:(22/139): python3-rbd-19.1.1-314.g086c737f.el9. 2.0 MB/s | 301 kB 00:00 2024-09-12T22:46:14.136 INFO:teuthology.orchestra.run.smithi117.stdout:(30/139): ceph-mgr-modules-core-19.1.1-314.g086 2.9 MB/s | 249 kB 00:00 2024-09-12T22:46:14.137 INFO:teuthology.orchestra.run.smithi087.stdout:(23/139): python3-rgw-19.1.1-314.g086c737f.el9. 1.2 MB/s | 99 kB 00:00 2024-09-12T22:46:14.171 INFO:teuthology.orchestra.run.smithi087.stdout:(24/139): rbd-fuse-19.1.1-314.g086c737f.el9.x86 1.1 MB/s | 85 kB 00:00 2024-09-12T22:46:14.220 INFO:teuthology.orchestra.run.smithi117.stdout:(31/139): ceph-mgr-rook-19.1.1-314.g086c737f.el 592 kB/s | 49 kB 00:00 2024-09-12T22:46:14.255 INFO:teuthology.orchestra.run.smithi066.stdout:(2/139): ceph-fuse-19.1.1-314.g086c737f.el9.x86 1.2 MB/s | 896 kB 00:00 2024-09-12T22:46:14.262 INFO:teuthology.orchestra.run.smithi087.stdout:(25/139): rbd-nbd-19.1.1-314.g086c737f.el9.x86_ 1.8 MB/s | 171 kB 00:00 2024-09-12T22:46:14.295 INFO:teuthology.orchestra.run.smithi117.stdout:(32/139): ceph-prometheus-alerts-19.1.1-314.g08 220 kB/s | 16 kB 00:00 2024-09-12T22:46:14.363 INFO:teuthology.orchestra.run.smithi087.stdout:(26/139): ceph-grafana-dashboards-19.1.1-314.g0 317 kB/s | 32 kB 00:00 2024-09-12T22:46:14.388 INFO:teuthology.orchestra.run.smithi066.stdout:(3/139): ceph-immutable-object-cache-19.1.1-314 1.1 MB/s | 145 kB 00:00 2024-09-12T22:46:14.395 INFO:teuthology.orchestra.run.smithi117.stdout:(33/139): ceph-volume-19.1.1-314.g086c737f.el9. 2.8 MB/s | 285 kB 00:00 2024-09-12T22:46:14.447 INFO:teuthology.orchestra.run.smithi087.stdout:(27/139): ceph-mgr-cephadm-19.1.1-314.g086c737f 1.7 MB/s | 146 kB 00:00 2024-09-12T22:46:14.554 INFO:teuthology.orchestra.run.smithi117.stdout:(34/139): cephadm-19.1.1-314.g086c737f.el9.noar 4.7 MB/s | 765 kB 00:00 2024-09-12T22:46:14.555 INFO:teuthology.orchestra.run.smithi087.stdout:(28/139): rbd-mirror-19.1.1-314.g086c737f.el9.x 7.4 MB/s | 3.1 MB 00:00 2024-09-12T22:46:14.696 INFO:teuthology.orchestra.run.smithi117.stdout:(35/139): fuse-2.9.9-16.el9.x86_64.rpm 563 kB/s | 80 kB 00:00 2024-09-12T22:46:14.863 INFO:teuthology.orchestra.run.smithi117.stdout:(36/139): ceph-mgr-diskprediction-local-19.1.1- 6.5 MB/s | 7.4 MB 00:01 2024-09-12T22:46:14.955 INFO:teuthology.orchestra.run.smithi117.stdout:(37/139): libgfortran-11.5.0-2.el9.x86_64.rpm 3.0 MB/s | 801 kB 00:00 2024-09-12T22:46:15.014 INFO:teuthology.orchestra.run.smithi087.stdout:(29/139): ceph-mgr-dashboard-19.1.1-314.g086c73 6.3 MB/s | 3.6 MB 00:00 2024-09-12T22:46:15.022 INFO:teuthology.orchestra.run.smithi117.stdout:(38/139): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-09-12T22:46:15.072 INFO:teuthology.orchestra.run.smithi117.stdout:(39/139): libquadmath-11.5.0-2.el9.x86_64.rpm 915 kB/s | 191 kB 00:00 2024-09-12T22:46:15.089 INFO:teuthology.orchestra.run.smithi087.stdout:(30/139): ceph-mgr-modules-core-19.1.1-314.g086 3.3 MB/s | 249 kB 00:00 2024-09-12T22:46:15.123 INFO:teuthology.orchestra.run.smithi117.stdout:(40/139): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-12T22:46:15.173 INFO:teuthology.orchestra.run.smithi087.stdout:(31/139): ceph-mgr-rook-19.1.1-314.g086c737f.el 591 kB/s | 49 kB 00:00 2024-09-12T22:46:15.181 INFO:teuthology.orchestra.run.smithi117.stdout:(41/139): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-12T22:46:15.232 INFO:teuthology.orchestra.run.smithi117.stdout:(42/139): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-12T22:46:15.256 INFO:teuthology.orchestra.run.smithi087.stdout:(32/139): ceph-prometheus-alerts-19.1.1-314.g08 197 kB/s | 16 kB 00:00 2024-09-12T22:46:15.290 INFO:teuthology.orchestra.run.smithi117.stdout:(43/139): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-12T22:46:15.398 INFO:teuthology.orchestra.run.smithi087.stdout:(33/139): ceph-mgr-diskprediction-local-19.1.1- 8.8 MB/s | 7.4 MB 00:00 2024-09-12T22:46:15.423 INFO:teuthology.orchestra.run.smithi087.stdout:(34/139): ceph-volume-19.1.1-314.g086c737f.el9. 1.7 MB/s | 285 kB 00:00 2024-09-12T22:46:15.424 INFO:teuthology.orchestra.run.smithi117.stdout:(44/139): python3-cryptography-36.0.1-4.el9.x86 3.1 MB/s | 1.2 MB 00:00 2024-09-12T22:46:15.466 INFO:teuthology.orchestra.run.smithi117.stdout:(45/139): automake-1.16.2-8.el9.noarch.rpm 3.8 MB/s | 689 kB 00:00 2024-09-12T22:46:15.524 INFO:teuthology.orchestra.run.smithi087.stdout:(35/139): cephadm-19.1.1-314.g086c737f.el9.noar 6.0 MB/s | 765 kB 00:00 2024-09-12T22:46:15.558 INFO:teuthology.orchestra.run.smithi087.stdout:(36/139): fuse-2.9.9-16.el9.x86_64.rpm 597 kB/s | 80 kB 00:00 2024-09-12T22:46:15.568 INFO:teuthology.orchestra.run.smithi099.stdout:(8/139): ceph-radosgw-19.1.1-314.g086c737f.el9. 4.9 MB/s | 11 MB 00:02 2024-09-12T22:46:15.605 INFO:teuthology.orchestra.run.smithi066.stdout:(4/139): ceph-base-19.1.1-314.g086c737f.el9.x86 2.4 MB/s | 5.4 MB 00:02 2024-09-12T22:46:15.649 INFO:teuthology.orchestra.run.smithi087.stdout:(37/139): libquadmath-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 191 kB 00:00 2024-09-12T22:46:15.714 INFO:teuthology.orchestra.run.smithi066.stdout:(5/139): ceph-mds-19.1.1-314.g086c737f.el9.x86_ 1.8 MB/s | 2.4 MB 00:01 2024-09-12T22:46:15.716 INFO:teuthology.orchestra.run.smithi087.stdout:(38/139): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-09-12T22:46:15.750 INFO:teuthology.orchestra.run.smithi087.stdout:(39/139): libgfortran-11.5.0-2.el9.x86_64.rpm 3.5 MB/s | 801 kB 00:00 2024-09-12T22:46:15.772 INFO:teuthology.orchestra.run.smithi066.stdout:(6/139): ceph-mgr-19.1.1-314.g086c737f.el9.x86_ 9.1 MB/s | 1.5 MB 00:00 2024-09-12T22:46:15.785 INFO:teuthology.orchestra.run.smithi099.stdout:(9/139): ceph-common-19.1.1-314.g086c737f.el9.x 3.9 MB/s | 21 MB 00:05 2024-09-12T22:46:15.800 INFO:teuthology.orchestra.run.smithi087.stdout:(40/139): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-12T22:46:15.802 INFO:teuthology.orchestra.run.smithi099.stdout:(10/139): ceph-selinux-19.1.1-314.g086c737f.el9 108 kB/s | 25 kB 00:00 2024-09-12T22:46:15.834 INFO:teuthology.orchestra.run.smithi087.stdout:(41/139): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.2 MB 00:00 2024-09-12T22:46:15.852 INFO:teuthology.orchestra.run.smithi099.stdout:(11/139): libcephfs-devel-19.1.1-314.g086c737f. 635 kB/s | 32 kB 00:00 2024-09-12T22:46:15.859 INFO:teuthology.orchestra.run.smithi087.stdout:(42/139): python3-pycparser-2.20-6.el9.noarch.r 2.2 MB/s | 135 kB 00:00 2024-09-12T22:46:15.885 INFO:teuthology.orchestra.run.smithi087.stdout:(43/139): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-12T22:46:15.909 INFO:teuthology.orchestra.run.smithi087.stdout:(44/139): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-12T22:46:15.933 INFO:teuthology.orchestra.run.smithi117.stdout:(46/139): ceph-test-19.1.1-314.g086c737f.el9.x8 13 MB/s | 49 MB 00:03 2024-09-12T22:46:15.958 INFO:teuthology.orchestra.run.smithi117.stdout:(47/139): boost-program-options-1.75.0-8.el9.x8 217 kB/s | 107 kB 00:00 2024-09-12T22:46:16.002 INFO:teuthology.orchestra.run.smithi099.stdout:(12/139): libcephfs2-19.1.1-314.g086c737f.el9.x 4.9 MB/s | 753 kB 00:00 2024-09-12T22:46:16.025 INFO:teuthology.orchestra.run.smithi117.stdout:(48/139): elfutils-libelf-devel-0.191-4.el9.x86 237 kB/s | 22 kB 00:00 2024-09-12T22:46:16.059 INFO:teuthology.orchestra.run.smithi117.stdout:(49/139): flex-2.6.4-9.el9.x86_64.rpm 3.1 MB/s | 313 kB 00:00 2024-09-12T22:46:16.060 INFO:teuthology.orchestra.run.smithi087.stdout:(45/139): automake-1.16.2-8.el9.noarch.rpm 3.8 MB/s | 689 kB 00:00 2024-09-12T22:46:16.078 INFO:teuthology.orchestra.run.smithi099.stdout:(13/139): libcephsqlite-19.1.1-314.g086c737f.el 2.1 MB/s | 164 kB 00:00 2024-09-12T22:46:16.084 INFO:teuthology.orchestra.run.smithi117.stdout:(50/139): flexiblas-3.0.4-8.el9.x86_64.rpm 560 kB/s | 33 kB 00:00 2024-09-12T22:46:16.102 INFO:teuthology.orchestra.run.smithi087.stdout:(46/139): bison-3.7.4-5.el9.x86_64.rpm 4.8 MB/s | 943 kB 00:00 2024-09-12T22:46:16.118 INFO:teuthology.orchestra.run.smithi117.stdout:(51/139): bison-3.7.4-5.el9.x86_64.rpm 1.3 MB/s | 943 kB 00:00 2024-09-12T22:46:16.127 INFO:teuthology.orchestra.run.smithi087.stdout:(47/139): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-09-12T22:46:16.134 INFO:teuthology.orchestra.run.smithi117.stdout:(52/139): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-09-12T22:46:16.145 INFO:teuthology.orchestra.run.smithi099.stdout:(14/139): librados-devel-19.1.1-314.g086c737f.e 1.9 MB/s | 127 kB 00:00 2024-09-12T22:46:16.152 INFO:teuthology.orchestra.run.smithi087.stdout:(48/139): elfutils-libelf-devel-0.191-4.el9.x86 431 kB/s | 22 kB 00:00 2024-09-12T22:46:16.178 INFO:teuthology.orchestra.run.smithi087.stdout:(49/139): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-09-12T22:46:16.201 INFO:teuthology.orchestra.run.smithi117.stdout:(53/139): flexiblas-netlib-3.0.4-8.el9.x86_64.r 21 MB/s | 3.0 MB 00:00 2024-09-12T22:46:16.203 INFO:teuthology.orchestra.run.smithi087.stdout:(50/139): flexiblas-3.0.4-8.el9.x86_64.rpm 652 kB/s | 33 kB 00:00 2024-09-12T22:46:16.218 INFO:teuthology.orchestra.run.smithi117.stdout:(54/139): libaio-devel-0.3.111-13.el9.x86_64.rp 111 kB/s | 11 kB 00:00 2024-09-12T22:46:16.244 INFO:teuthology.orchestra.run.smithi117.stdout:(55/139): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-09-12T22:46:16.245 INFO:teuthology.orchestra.run.smithi087.stdout:(51/139): flexiblas-openblas-openmp-3.0.4-8.el9 437 kB/s | 18 kB 00:00 2024-09-12T22:46:16.260 INFO:teuthology.orchestra.run.smithi117.stdout:(56/139): librabbitmq-0.11.0-7.el9.x86_64.rpm 771 kB/s | 45 kB 00:00 2024-09-12T22:46:16.261 INFO:teuthology.orchestra.run.smithi099.stdout:(15/139): libradosstriper1-19.1.1-314.g086c737f 4.2 MB/s | 506 kB 00:00 2024-09-12T22:46:16.304 INFO:teuthology.orchestra.run.smithi087.stdout:(52/139): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-09-12T22:46:16.327 INFO:teuthology.orchestra.run.smithi117.stdout:(57/139): libtool-2.4.6-46.el9.x86_64.rpm 6.8 MB/s | 581 kB 00:00 2024-09-12T22:46:16.329 INFO:teuthology.orchestra.run.smithi087.stdout:(53/139): libaio-devel-0.3.111-13.el9.x86_64.rp 133 kB/s | 11 kB 00:00 2024-09-12T22:46:16.344 INFO:teuthology.orchestra.run.smithi117.stdout:(58/139): libuuid-devel-2.37.4-20.el9.x86_64.rp 292 kB/s | 24 kB 00:00 2024-09-12T22:46:16.354 INFO:teuthology.orchestra.run.smithi087.stdout:(54/139): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-12T22:46:16.378 INFO:teuthology.orchestra.run.smithi117.stdout:(59/139): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 662 kB 00:00 2024-09-12T22:46:16.380 INFO:teuthology.orchestra.run.smithi087.stdout:(55/139): librabbitmq-0.11.0-7.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-09-12T22:46:16.404 INFO:teuthology.orchestra.run.smithi117.stdout:(60/139): libzstd-devel-1.5.1-2.el9.x86_64.rpm 627 kB/s | 47 kB 00:00 2024-09-12T22:46:16.413 INFO:teuthology.orchestra.run.smithi087.stdout:(56/139): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-12T22:46:16.446 INFO:teuthology.orchestra.run.smithi117.stdout:(61/139): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-12T22:46:16.447 INFO:teuthology.orchestra.run.smithi087.stdout:(57/139): libtool-2.4.6-46.el9.x86_64.rpm 8.5 MB/s | 581 kB 00:00 2024-09-12T22:46:16.471 INFO:teuthology.orchestra.run.smithi117.stdout:(62/139): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-09-12T22:46:16.472 INFO:teuthology.orchestra.run.smithi087.stdout:(58/139): libuuid-devel-2.37.4-20.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-09-12T22:46:16.496 INFO:teuthology.orchestra.run.smithi117.stdout:(63/139): openblas-0.3.26-2.el9.x86_64.rpm 418 kB/s | 38 kB 00:00 2024-09-12T22:46:16.497 INFO:teuthology.orchestra.run.smithi087.stdout:(59/139): libzstd-devel-1.5.1-2.el9.x86_64.rpm 948 kB/s | 47 kB 00:00 2024-09-12T22:46:16.523 INFO:teuthology.orchestra.run.smithi087.stdout:(60/139): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-12T22:46:16.548 INFO:teuthology.orchestra.run.smithi087.stdout:(61/139): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-12T22:46:16.582 INFO:teuthology.orchestra.run.smithi087.stdout:(62/139): openblas-0.3.26-2.el9.x86_64.rpm 661 kB/s | 38 kB 00:00 2024-09-12T22:46:16.605 INFO:teuthology.orchestra.run.smithi117.stdout:(64/139): openblas-openmp-0.3.26-2.el9.x86_64.r 31 MB/s | 4.9 MB 00:00 2024-09-12T22:46:16.638 INFO:teuthology.orchestra.run.smithi117.stdout:(65/139): protobuf-3.14.0-13.el9.x86_64.rpm 7.1 MB/s | 1.0 MB 00:00 2024-09-12T22:46:16.647 INFO:teuthology.orchestra.run.smithi066.stdout:(7/139): ceph-common-19.1.1-314.g086c737f.el9.x 6.4 MB/s | 21 MB 00:03 2024-09-12T22:46:16.674 INFO:teuthology.orchestra.run.smithi087.stdout:(63/139): openblas-openmp-0.3.26-2.el9.x86_64.r 39 MB/s | 4.9 MB 00:00 2024-09-12T22:46:16.705 INFO:teuthology.orchestra.run.smithi117.stdout:(66/139): python3-devel-3.9.19-8.el9.x86_64.rpm 3.6 MB/s | 245 kB 00:00 2024-09-12T22:46:16.741 INFO:teuthology.orchestra.run.smithi087.stdout:(64/139): openssl-devel-3.2.2-6.el9.x86_64.rpm 28 MB/s | 4.4 MB 00:00 2024-09-12T22:46:16.772 INFO:teuthology.orchestra.run.smithi117.stdout:(67/139): openssl-devel-3.2.2-6.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-12T22:46:16.783 INFO:teuthology.orchestra.run.smithi087.stdout:(65/139): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-09-12T22:46:16.797 INFO:teuthology.orchestra.run.smithi117.stdout:(68/139): python3-jinja2-2.11.3-6.el9.noarch.rp 2.6 MB/s | 248 kB 00:00 2024-09-12T22:46:16.825 INFO:teuthology.orchestra.run.smithi087.stdout:(66/139): python3-devel-3.9.19-8.el9.x86_64.rpm 5.8 MB/s | 245 kB 00:00 2024-09-12T22:46:16.831 INFO:teuthology.orchestra.run.smithi117.stdout:(69/139): python3-jsonpatch-1.21-16.el9.noarch. 437 kB/s | 26 kB 00:00 2024-09-12T22:46:16.900 INFO:teuthology.orchestra.run.smithi087.stdout:(67/139): python3-babel-2.9.1-2.el9.noarch.rpm 38 MB/s | 6.0 MB 00:00 2024-09-12T22:46:16.906 INFO:teuthology.orchestra.run.smithi117.stdout:(70/139): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 6.0 MB 00:00 2024-09-12T22:46:16.925 INFO:teuthology.orchestra.run.smithi087.stdout:(68/139): python3-jinja2-2.11.3-6.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-09-12T22:46:16.931 INFO:teuthology.orchestra.run.smithi117.stdout:(71/139): python3-jsonpointer-2.0-4.el9.noarch. 143 kB/s | 19 kB 00:00 2024-09-12T22:46:16.957 INFO:teuthology.orchestra.run.smithi117.stdout:(72/139): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-12T22:46:16.959 INFO:teuthology.orchestra.run.smithi087.stdout:(69/139): python3-jsonpatch-1.21-16.el9.noarch. 438 kB/s | 26 kB 00:00 2024-09-12T22:46:16.984 INFO:teuthology.orchestra.run.smithi087.stdout:(70/139): python3-jsonpointer-2.0-4.el9.noarch. 327 kB/s | 19 kB 00:00 2024-09-12T22:46:16.990 INFO:teuthology.orchestra.run.smithi117.stdout:(73/139): python3-markupsafe-1.1.1-12.el9.x86_6 414 kB/s | 35 kB 00:00 2024-09-12T22:46:17.009 INFO:teuthology.orchestra.run.smithi087.stdout:(71/139): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-12T22:46:17.014 INFO:teuthology.orchestra.run.smithi066.stdout:(8/139): ceph-osd-19.1.1-314.g086c737f.el9.x86_ 14 MB/s | 17 MB 00:01 2024-09-12T22:46:17.028 INFO:teuthology.orchestra.run.smithi099.stdout:(16/139): librgw2-19.1.1-314.g086c737f.el9.x86_ 7.0 MB/s | 5.3 MB 00:00 2024-09-12T22:46:17.034 INFO:teuthology.orchestra.run.smithi087.stdout:(72/139): python3-markupsafe-1.1.1-12.el9.x86_6 694 kB/s | 35 kB 00:00 2024-09-12T22:46:17.041 INFO:teuthology.orchestra.run.smithi117.stdout:(74/139): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-09-12T22:46:17.065 INFO:teuthology.orchestra.run.smithi066.stdout:(9/139): ceph-selinux-19.1.1-314.g086c737f.el9. 505 kB/s | 25 kB 00:00 2024-09-12T22:46:17.077 INFO:teuthology.orchestra.run.smithi087.stdout:(73/139): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.9 MB/s | 250 kB 00:00 2024-09-12T22:46:17.087 INFO:teuthology.orchestra.run.smithi099.stdout:(17/139): python3-ceph-argparse-19.1.1-314.g086 776 kB/s | 45 kB 00:00 2024-09-12T22:46:17.116 INFO:teuthology.orchestra.run.smithi117.stdout:(75/139): python3-numpy-1.20.1-5.el9.x86_64.rpm 28 MB/s | 5.1 MB 00:00 2024-09-12T22:46:17.141 INFO:teuthology.orchestra.run.smithi117.stdout:(76/139): python3-packaging-20.9-5.el9.noarch.r 770 kB/s | 77 kB 00:00 2024-09-12T22:46:17.152 INFO:teuthology.orchestra.run.smithi087.stdout:(74/139): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 5.1 MB 00:00 2024-09-12T22:46:17.166 INFO:teuthology.orchestra.run.smithi117.stdout:(77/139): python3-oauthlib-3.1.1-5.el9.noarch.r 1.2 MB/s | 222 kB 00:00 2024-09-12T22:46:17.177 INFO:teuthology.orchestra.run.smithi087.stdout:(75/139): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-09-12T22:46:17.179 INFO:teuthology.orchestra.run.smithi099.stdout:(18/139): python3-ceph-common-19.1.1-314.g086c7 1.5 MB/s | 136 kB 00:00 2024-09-12T22:46:17.183 INFO:teuthology.orchestra.run.smithi117.stdout:(78/139): python3-prettytable-0.7.2-27.el9.noar 630 kB/s | 42 kB 00:00 2024-09-12T22:46:17.211 INFO:teuthology.orchestra.run.smithi087.stdout:(76/139): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-12T22:46:17.217 INFO:teuthology.orchestra.run.smithi117.stdout:(79/139): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-09-12T22:46:17.236 INFO:teuthology.orchestra.run.smithi087.stdout:(77/139): python3-prettytable-0.7.2-27.el9.noar 721 kB/s | 42 kB 00:00 2024-09-12T22:46:17.251 INFO:teuthology.orchestra.run.smithi117.stdout:(80/139): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-09-12T22:46:17.262 INFO:teuthology.orchestra.run.smithi099.stdout:(19/139): python3-cephfs-19.1.1-314.g086c737f.e 1.9 MB/s | 162 kB 00:00 2024-09-12T22:46:17.269 INFO:teuthology.orchestra.run.smithi087.stdout:(78/139): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-12T22:46:17.284 INFO:teuthology.orchestra.run.smithi117.stdout:(81/139): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 279 kB 00:00 2024-09-12T22:46:17.295 INFO:teuthology.orchestra.run.smithi087.stdout:(79/139): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-09-12T22:46:17.301 INFO:teuthology.orchestra.run.smithi117.stdout:(82/139): python3-pytz-2021.1-5.el9.noarch.rpm 608 kB/s | 51 kB 00:00 2024-09-12T22:46:17.306 INFO:teuthology.orchestra.run.smithi066.stdout:(10/139): ceph-radosgw-19.1.1-314.g086c737f.el9 16 MB/s | 11 MB 00:00 2024-09-12T22:46:17.320 INFO:teuthology.orchestra.run.smithi087.stdout:(80/139): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-12T22:46:17.326 INFO:teuthology.orchestra.run.smithi117.stdout:(83/139): python3-requests-oauthlib-1.3.0-12.el 711 kB/s | 54 kB 00:00 2024-09-12T22:46:17.345 INFO:teuthology.orchestra.run.smithi087.stdout:(81/139): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-12T22:46:17.357 INFO:teuthology.orchestra.run.smithi066.stdout:(11/139): libcephfs-devel-19.1.1-314.g086c737f. 636 kB/s | 32 kB 00:00 2024-09-12T22:46:17.360 INFO:teuthology.orchestra.run.smithi117.stdout:(84/139): python3-toml-0.10.2-6.el9.noarch.rpm 714 kB/s | 42 kB 00:00 2024-09-12T22:46:17.363 INFO:teuthology.orchestra.run.smithi099.stdout:(20/139): python3-rados-19.1.1-314.g086c737f.el 3.1 MB/s | 320 kB 00:00 2024-09-12T22:46:17.396 INFO:teuthology.orchestra.run.smithi087.stdout:(82/139): python3-requests-oauthlib-1.3.0-12.el 712 kB/s | 54 kB 00:00 2024-09-12T22:46:17.402 INFO:teuthology.orchestra.run.smithi117.stdout:(85/139): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-09-12T22:46:17.419 INFO:teuthology.orchestra.run.smithi117.stdout:(86/139): qatlib-service-24.02.0-1.el9.x86_64.r 612 kB/s | 36 kB 00:00 2024-09-12T22:46:17.440 INFO:teuthology.orchestra.run.smithi066.stdout:(12/139): libcephfs2-19.1.1-314.g086c737f.el9.x 8.9 MB/s | 753 kB 00:00 2024-09-12T22:46:17.446 INFO:teuthology.orchestra.run.smithi099.stdout:(21/139): python3-rbd-19.1.1-314.g086c737f.el9. 3.5 MB/s | 301 kB 00:00 2024-09-12T22:46:17.452 INFO:teuthology.orchestra.run.smithi117.stdout:(87/139): qatzip-libs-1.2.0-1.el9.x86_64.rpm 948 kB/s | 47 kB 00:00 2024-09-12T22:46:17.486 INFO:teuthology.orchestra.run.smithi117.stdout:(88/139): socat-1.7.4.1-6.el9.x86_64.rpm 4.5 MB/s | 304 kB 00:00 2024-09-12T22:46:17.507 INFO:teuthology.orchestra.run.smithi066.stdout:(13/139): libcephsqlite-19.1.1-314.g086c737f.el 2.4 MB/s | 164 kB 00:00 2024-09-12T22:46:17.513 INFO:teuthology.orchestra.run.smithi099.stdout:(22/139): python3-rgw-19.1.1-314.g086c737f.el9. 1.5 MB/s | 99 kB 00:00 2024-09-12T22:46:17.566 INFO:teuthology.orchestra.run.smithi066.stdout:(14/139): librados-devel-19.1.1-314.g086c737f.e 2.1 MB/s | 127 kB 00:00 2024-09-12T22:46:17.588 INFO:teuthology.orchestra.run.smithi099.stdout:(23/139): rbd-fuse-19.1.1-314.g086c737f.el9.x86 1.1 MB/s | 85 kB 00:00 2024-09-12T22:46:17.641 INFO:teuthology.orchestra.run.smithi066.stdout:(15/139): ceph-mon-19.1.1-314.g086c737f.el9.x86 2.4 MB/s | 4.7 MB 00:01 2024-09-12T22:46:17.674 INFO:teuthology.orchestra.run.smithi066.stdout:(16/139): libradosstriper1-19.1.1-314.g086c737f 4.6 MB/s | 506 kB 00:00 2024-09-12T22:46:17.686 INFO:teuthology.orchestra.run.smithi117.stdout:(89/139): python3-scipy-1.6.2-8.el9.x86_64.rpm 40 MB/s | 16 MB 00:00 2024-09-12T22:46:17.712 INFO:teuthology.orchestra.run.smithi117.stdout:(90/139): xmlstarlet-1.6.1-20.el9.x86_64.rpm 282 kB/s | 64 kB 00:00 2024-09-12T22:46:17.737 INFO:teuthology.orchestra.run.smithi117.stdout:(91/139): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 337 kB/s | 96 kB 00:00 2024-09-12T22:46:17.754 INFO:teuthology.orchestra.run.smithi117.stdout:(92/139): zlib-devel-1.2.11-41.el9.x86_64.rpm 668 kB/s | 45 kB 00:00 2024-09-12T22:46:17.766 INFO:teuthology.orchestra.run.smithi066.stdout:(17/139): python3-ceph-argparse-19.1.1-314.g086 492 kB/s | 45 kB 00:00 2024-09-12T22:46:17.813 INFO:teuthology.orchestra.run.smithi117.stdout:(93/139): abseil-cpp-20211102.0-3.el9.x86_64.rp 9.2 MB/s | 548 kB 00:00 2024-09-12T22:46:17.821 INFO:teuthology.orchestra.run.smithi087.stdout:(83/139): ceph-test-19.1.1-314.g086c737f.el9.x8 9.4 MB/s | 49 MB 00:05 2024-09-12T22:46:17.842 INFO:teuthology.orchestra.run.smithi066.stdout:(18/139): python3-ceph-common-19.1.1-314.g086c7 1.8 MB/s | 136 kB 00:00 2024-09-12T22:46:17.846 INFO:teuthology.orchestra.run.smithi117.stdout:(94/139): gperftools-libs-2.9.1-3.el9.x86_64.rp 9.1 MB/s | 308 kB 00:00 2024-09-12T22:46:17.847 INFO:teuthology.orchestra.run.smithi087.stdout:(84/139): python3-toml-0.10.2-6.el9.noarch.rpm 92 kB/s | 42 kB 00:00 2024-09-12T22:46:17.863 INFO:teuthology.orchestra.run.smithi117.stdout:(95/139): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-12T22:46:17.889 INFO:teuthology.orchestra.run.smithi087.stdout:(85/139): qatlib-service-24.02.0-1.el9.x86_64.r 865 kB/s | 36 kB 00:00 2024-09-12T22:46:17.917 INFO:teuthology.orchestra.run.smithi066.stdout:(19/139): python3-cephfs-19.1.1-314.g086c737f.e 2.1 MB/s | 162 kB 00:00 2024-09-12T22:46:17.931 INFO:teuthology.orchestra.run.smithi087.stdout:(86/139): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-12T22:46:17.964 INFO:teuthology.orchestra.run.smithi087.stdout:(87/139): qatlib-24.02.0-1.el9.x86_64.rpm 1.5 MB/s | 221 kB 00:00 2024-09-12T22:46:17.989 INFO:teuthology.orchestra.run.smithi087.stdout:(88/139): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-12T22:46:18.000 INFO:teuthology.orchestra.run.smithi066.stdout:(20/139): python3-rados-19.1.1-314.g086c737f.el 3.8 MB/s | 320 kB 00:00 2024-09-12T22:46:18.015 INFO:teuthology.orchestra.run.smithi087.stdout:(89/139): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-09-12T22:46:18.030 INFO:teuthology.orchestra.run.smithi117.stdout:(96/139): libarrow-9.0.0-11.el9.x86_64.rpm 27 MB/s | 4.4 MB 00:00 2024-09-12T22:46:18.040 INFO:teuthology.orchestra.run.smithi087.stdout:(90/139): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-12T22:46:18.064 INFO:teuthology.orchestra.run.smithi117.stdout:(97/139): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.4 MB/s | 26 kB 00:00 2024-09-12T22:46:18.065 INFO:teuthology.orchestra.run.smithi087.stdout:(91/139): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-09-12T22:46:18.089 INFO:teuthology.orchestra.run.smithi117.stdout:(98/139): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T22:46:18.090 INFO:teuthology.orchestra.run.smithi087.stdout:(92/139): lua-devel-5.4.4-4.el9.x86_64.rpm 445 kB/s | 22 kB 00:00 2024-09-12T22:46:18.092 INFO:teuthology.orchestra.run.smithi066.stdout:(21/139): python3-rbd-19.1.1-314.g086c737f.el9. 3.2 MB/s | 301 kB 00:00 2024-09-12T22:46:18.114 INFO:teuthology.orchestra.run.smithi117.stdout:(99/139): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-12T22:46:18.148 INFO:teuthology.orchestra.run.smithi117.stdout:(100/139): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-12T22:46:18.157 INFO:teuthology.orchestra.run.smithi087.stdout:(93/139): protobuf-compiler-3.14.0-13.el9.x86_6 9.2 MB/s | 863 kB 00:00 2024-09-12T22:46:18.164 INFO:teuthology.orchestra.run.smithi099.stdout:(24/139): rbd-mirror-19.1.1-314.g086c737f.el9.x 5.4 MB/s | 3.1 MB 00:00 2024-09-12T22:46:18.167 INFO:teuthology.orchestra.run.smithi066.stdout:(22/139): python3-rgw-19.1.1-314.g086c737f.el9. 1.3 MB/s | 99 kB 00:00 2024-09-12T22:46:18.198 INFO:teuthology.orchestra.run.smithi117.stdout:(101/139): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-12T22:46:18.231 INFO:teuthology.orchestra.run.smithi099.stdout:(25/139): rbd-nbd-19.1.1-314.g086c737f.el9.x86_ 2.5 MB/s | 171 kB 00:00 2024-09-12T22:46:18.232 INFO:teuthology.orchestra.run.smithi117.stdout:(102/139): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-12T22:46:18.243 INFO:teuthology.orchestra.run.smithi066.stdout:(23/139): rbd-fuse-19.1.1-314.g086c737f.el9.x86 1.1 MB/s | 85 kB 00:00 2024-09-12T22:46:18.257 INFO:teuthology.orchestra.run.smithi117.stdout:(103/139): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T22:46:18.282 INFO:teuthology.orchestra.run.smithi117.stdout:(104/139): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-12T22:46:18.308 INFO:teuthology.orchestra.run.smithi117.stdout:(105/139): python3-certifi-2023.05.07-4.el9.noa 563 kB/s | 14 kB 00:00 2024-09-12T22:46:18.323 INFO:teuthology.orchestra.run.smithi099.stdout:(26/139): ceph-grafana-dashboards-19.1.1-314.g0 346 kB/s | 32 kB 00:00 2024-09-12T22:46:18.324 INFO:teuthology.orchestra.run.smithi087.stdout:(94/139): python3-scipy-1.6.2-8.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-09-12T22:46:18.333 INFO:teuthology.orchestra.run.smithi117.stdout:(106/139): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-12T22:46:18.366 INFO:teuthology.orchestra.run.smithi087.stdout:(95/139): abseil-cpp-20211102.0-3.el9.x86_64.rp 1.9 MB/s | 548 kB 00:00 2024-09-12T22:46:18.367 INFO:teuthology.orchestra.run.smithi117.stdout:(107/139): python3-cherrypy-18.6.1-2.el9.noarch 11 MB/s | 358 kB 00:00 2024-09-12T22:46:18.392 INFO:teuthology.orchestra.run.smithi117.stdout:(108/139): lua-devel-5.4.4-4.el9.x86_64.rpm 33 kB/s | 22 kB 00:00 2024-09-12T22:46:18.400 INFO:teuthology.orchestra.run.smithi087.stdout:(96/139): grpc-data-1.46.7-10.el9.noarch.rpm 267 kB/s | 19 kB 00:00 2024-09-12T22:46:18.425 INFO:teuthology.orchestra.run.smithi087.stdout:(97/139): gperftools-libs-2.9.1-3.el9.x86_64.rp 1.1 MB/s | 308 kB 00:00 2024-09-12T22:46:18.434 INFO:teuthology.orchestra.run.smithi117.stdout:(109/139): python3-google-auth-2.34.0-1.el9.noa 3.3 MB/s | 220 kB 00:00 2024-09-12T22:46:18.440 INFO:teuthology.orchestra.run.smithi099.stdout:(27/139): ceph-mgr-cephadm-19.1.1-314.g086c737f 1.2 MB/s | 146 kB 00:00 2024-09-12T22:46:18.450 INFO:teuthology.orchestra.run.smithi087.stdout:(98/139): libarrow-doc-9.0.0-11.el9.noarch.rpm 518 kB/s | 26 kB 00:00 2024-09-12T22:46:18.459 INFO:teuthology.orchestra.run.smithi117.stdout:(110/139): python3-grpcio-tools-1.46.7-10.el9.x 6.1 MB/s | 144 kB 00:00 2024-09-12T22:46:18.476 INFO:teuthology.orchestra.run.smithi087.stdout:(99/139): liboath-2.6.7-2.el9.x86_64.rpm 967 kB/s | 49 kB 00:00 2024-09-12T22:46:18.484 INFO:teuthology.orchestra.run.smithi117.stdout:(111/139): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-12T22:46:18.501 INFO:teuthology.orchestra.run.smithi087.stdout:(100/139): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-12T22:46:18.510 INFO:teuthology.orchestra.run.smithi117.stdout:(112/139): python3-jaraco-classes-3.2.1-5.el9.n 710 kB/s | 18 kB 00:00 2024-09-12T22:46:18.526 INFO:teuthology.orchestra.run.smithi087.stdout:(101/139): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-12T22:46:18.535 INFO:teuthology.orchestra.run.smithi117.stdout:(113/139): python3-jaraco-collections-3.0.0-8.e 934 kB/s | 23 kB 00:00 2024-09-12T22:46:18.560 INFO:teuthology.orchestra.run.smithi117.stdout:(114/139): python3-jaraco-functools-3.5.0-2.el9 781 kB/s | 19 kB 00:00 2024-09-12T22:46:18.586 INFO:teuthology.orchestra.run.smithi117.stdout:(115/139): python3-jaraco-text-3.2.0-6.el9.noar 792 kB/s | 20 kB 00:00 2024-09-12T22:46:18.593 INFO:teuthology.orchestra.run.smithi087.stdout:(102/139): python3-asyncssh-2.13.2-5.el9.noarch 8.0 MB/s | 548 kB 00:00 2024-09-12T22:46:18.618 INFO:teuthology.orchestra.run.smithi087.stdout:(103/139): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T22:46:18.635 INFO:teuthology.orchestra.run.smithi087.stdout:(104/139): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-12T22:46:18.661 INFO:teuthology.orchestra.run.smithi087.stdout:(105/139): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.1 MB/s | 839 kB 00:00 2024-09-12T22:46:18.661 INFO:teuthology.orchestra.run.smithi117.stdout:(116/139): python3-grpcio-1.46.7-10.el9.x86_64. 7.6 MB/s | 2.0 MB 00:00 2024-09-12T22:46:18.677 INFO:teuthology.orchestra.run.smithi087.stdout:(106/139): python3-certifi-2023.05.07-4.el9.noa 337 kB/s | 14 kB 00:00 2024-09-12T22:46:18.703 INFO:teuthology.orchestra.run.smithi117.stdout:(117/139): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-09-12T22:46:18.711 INFO:teuthology.orchestra.run.smithi087.stdout:(107/139): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-12T22:46:18.719 INFO:teuthology.orchestra.run.smithi117.stdout:(118/139): python3-logutils-0.3.5-21.el9.noarch 791 kB/s | 46 kB 00:00 2024-09-12T22:46:18.745 INFO:teuthology.orchestra.run.smithi087.stdout:(108/139): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-12T22:46:18.745 INFO:teuthology.orchestra.run.smithi117.stdout:(119/139): python3-more-itertools-8.12.0-2.el9. 1.8 MB/s | 79 kB 00:00 2024-09-12T22:46:18.757 INFO:teuthology.orchestra.run.smithi099.stdout:(28/139): ceph-mgr-dashboard-19.1.1-314.g086c73 11 MB/s | 3.6 MB 00:00 2024-09-12T22:46:18.762 INFO:teuthology.orchestra.run.smithi117.stdout:(120/139): python3-natsort-7.1.1-5.el9.noarch.r 1.3 MB/s | 58 kB 00:00 2024-09-12T22:46:18.770 INFO:teuthology.orchestra.run.smithi087.stdout:(109/139): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-12T22:46:18.779 INFO:teuthology.orchestra.run.smithi117.stdout:(121/139): python3-portend-3.1.0-2.el9.noarch.r 1.0 MB/s | 16 kB 00:00 2024-09-12T22:46:18.803 INFO:teuthology.orchestra.run.smithi087.stdout:(110/139): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-12T22:46:18.804 INFO:teuthology.orchestra.run.smithi117.stdout:(122/139): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-09-12T22:46:18.829 INFO:teuthology.orchestra.run.smithi087.stdout:(111/139): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-12T22:46:18.830 INFO:teuthology.orchestra.run.smithi117.stdout:(123/139): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-12T22:46:18.835 INFO:teuthology.orchestra.run.smithi066.stdout:(24/139): ceph-test-19.1.1-314.g086c737f.el9.x8 28 MB/s | 49 MB 00:01 2024-09-12T22:46:18.847 INFO:teuthology.orchestra.run.smithi117.stdout:(124/139): python3-repoze-lru-0.7-16.el9.noarch 733 kB/s | 31 kB 00:00 2024-09-12T22:46:18.881 INFO:teuthology.orchestra.run.smithi117.stdout:(125/139): protobuf-compiler-3.14.0-13.el9.x86_ 756 kB/s | 863 kB 00:01 2024-09-12T22:46:18.894 INFO:teuthology.orchestra.run.smithi066.stdout:(25/139): rbd-mirror-19.1.1-314.g086c737f.el9.x 4.8 MB/s | 3.1 MB 00:00 2024-09-12T22:46:18.896 INFO:teuthology.orchestra.run.smithi087.stdout:(112/139): libarrow-9.0.0-11.el9.x86_64.rpm 8.4 MB/s | 4.4 MB 00:00 2024-09-12T22:46:18.905 INFO:teuthology.orchestra.run.smithi117.stdout:(126/139): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-12T22:46:18.919 INFO:teuthology.orchestra.run.smithi066.stdout:(26/139): rbd-nbd-19.1.1-314.g086c737f.el9.x86_ 2.0 MB/s | 171 kB 00:00 2024-09-12T22:46:18.921 INFO:teuthology.orchestra.run.smithi087.stdout:(113/139): python3-jaraco-classes-3.2.1-5.el9.n 192 kB/s | 18 kB 00:00 2024-09-12T22:46:18.940 INFO:teuthology.orchestra.run.smithi099.stdout:(29/139): ceph-osd-19.1.1-314.g086c737f.el9.x86 2.9 MB/s | 17 MB 00:05 2024-09-12T22:46:18.944 INFO:teuthology.orchestra.run.smithi066.stdout:(27/139): ceph-grafana-dashboards-19.1.1-314.g0 636 kB/s | 32 kB 00:00 2024-09-12T22:46:19.046 INFO:teuthology.orchestra.run.smithi099.stdout:(30/139): ceph-mgr-modules-core-19.1.1-314.g086 3.7 MB/s | 249 kB 00:00 2024-09-12T22:46:19.047 INFO:teuthology.orchestra.run.smithi066.stdout:(28/139): ceph-mgr-cephadm-19.1.1-314.g086c737f 2.1 MB/s | 146 kB 00:00 2024-09-12T22:46:19.047 INFO:teuthology.orchestra.run.smithi117.stdout:(127/139): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-09-12T22:46:19.047 INFO:teuthology.orchestra.run.smithi117.stdout:(128/139): python3-typing-extensions-4.12.2-2.e 1.2 MB/s | 74 kB 00:00 2024-09-12T22:46:19.047 INFO:teuthology.orchestra.run.smithi117.stdout:(129/139): python3-tempora-5.0.0-2.el9.noarch.r 305 kB/s | 36 kB 00:00 2024-09-12T22:46:19.047 INFO:teuthology.orchestra.run.smithi117.stdout:(130/139): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-12T22:46:19.048 INFO:teuthology.orchestra.run.smithi087.stdout:(114/139): python3-jaraco-collections-3.0.0-8.e 460 kB/s | 23 kB 00:00 2024-09-12T22:46:19.048 INFO:teuthology.orchestra.run.smithi087.stdout:(115/139): python3-jaraco-functools-3.5.0-2.el9 291 kB/s | 19 kB 00:00 2024-09-12T22:46:19.048 INFO:teuthology.orchestra.run.smithi087.stdout:(116/139): python3-jaraco-text-3.2.0-6.el9.noar 294 kB/s | 20 kB 00:00 2024-09-12T22:46:19.048 INFO:teuthology.orchestra.run.smithi087.stdout:(117/139): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T22:46:19.048 INFO:teuthology.orchestra.run.smithi117.stdout:(131/139): python3-webob-1.8.8-2.el9.noarch.rpm 2.3 MB/s | 230 kB 00:00 2024-09-12T22:46:19.073 INFO:teuthology.orchestra.run.smithi087.stdout:(118/139): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-12T22:46:19.085 INFO:teuthology.orchestra.run.smithi117.stdout:(132/139): python3-zc-lockfile-2.0-10.el9.noarc 342 kB/s | 20 kB 00:00 2024-09-12T22:46:19.085 INFO:teuthology.orchestra.run.smithi099.stdout:(31/139): ceph-mgr-rook-19.1.1-314.g086c737f.el 659 kB/s | 49 kB 00:00 2024-09-12T22:46:19.098 INFO:teuthology.orchestra.run.smithi087.stdout:(119/139): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T22:46:19.107 INFO:teuthology.orchestra.run.smithi117.stdout:(133/139): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-12T22:46:19.132 INFO:teuthology.orchestra.run.smithi087.stdout:(120/139): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-12T22:46:19.133 INFO:teuthology.orchestra.run.smithi117.stdout:(134/139): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-12T22:46:19.174 INFO:teuthology.orchestra.run.smithi099.stdout:(32/139): ceph-prometheus-alerts-19.1.1-314.g08 179 kB/s | 16 kB 00:00 2024-09-12T22:46:19.182 INFO:teuthology.orchestra.run.smithi087.stdout:(121/139): python3-grpcio-1.46.7-10.el9.x86_64. 4.7 MB/s | 2.0 MB 00:00 2024-09-12T22:46:19.183 INFO:teuthology.orchestra.run.smithi117.stdout:(135/139): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-12T22:46:19.194 INFO:teuthology.orchestra.run.smithi066.stdout:(29/139): ceph-mgr-dashboard-19.1.1-314.g086c73 14 MB/s | 3.6 MB 00:00 2024-09-12T22:46:19.232 INFO:teuthology.orchestra.run.smithi087.stdout:(122/139): python3-kubernetes-26.1.0-2.el9.noar 4.2 MB/s | 1.0 MB 00:00 2024-09-12T22:46:19.253 INFO:teuthology.orchestra.run.smithi066.stdout:(30/139): ceph-mgr-modules-core-19.1.1-314.g086 4.2 MB/s | 249 kB 00:00 2024-09-12T22:46:19.257 INFO:teuthology.orchestra.run.smithi087.stdout:(123/139): python3-portend-3.1.0-2.el9.noarch.r 131 kB/s | 16 kB 00:00 2024-09-12T22:46:19.275 INFO:teuthology.orchestra.run.smithi099.stdout:(33/139): ceph-volume-19.1.1-314.g086c737f.el9. 2.8 MB/s | 285 kB 00:00 2024-09-12T22:46:19.282 INFO:teuthology.orchestra.run.smithi087.stdout:(124/139): python3-repoze-lru-0.7-16.el9.noarch 617 kB/s | 31 kB 00:00 2024-09-12T22:46:19.308 INFO:teuthology.orchestra.run.smithi087.stdout:(125/139): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-12T22:46:19.333 INFO:teuthology.orchestra.run.smithi087.stdout:(126/139): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-12T22:46:19.345 INFO:teuthology.orchestra.run.smithi066.stdout:(31/139): ceph-mgr-diskprediction-local-19.1.1- 21 MB/s | 7.4 MB 00:00 2024-09-12T22:46:19.358 INFO:teuthology.orchestra.run.smithi087.stdout:(127/139): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-12T22:46:19.371 INFO:teuthology.orchestra.run.smithi066.stdout:(32/139): ceph-mgr-rook-19.1.1-314.g086c737f.el 421 kB/s | 49 kB 00:00 2024-09-12T22:46:19.383 INFO:teuthology.orchestra.run.smithi087.stdout:(128/139): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-12T22:46:19.404 INFO:teuthology.orchestra.run.smithi066.stdout:(33/139): ceph-prometheus-alerts-19.1.1-314.g08 281 kB/s | 16 kB 00:00 2024-09-12T22:46:19.409 INFO:teuthology.orchestra.run.smithi087.stdout:(129/139): python3-typing-extensions-4.12.2-2.e 987 kB/s | 74 kB 00:00 2024-09-12T22:46:19.434 INFO:teuthology.orchestra.run.smithi087.stdout:(130/139): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-12T22:46:19.438 INFO:teuthology.orchestra.run.smithi066.stdout:(34/139): ceph-volume-19.1.1-314.g086c737f.el9. 4.2 MB/s | 285 kB 00:00 2024-09-12T22:46:19.458 INFO:teuthology.orchestra.run.smithi099.stdout:(34/139): cephadm-19.1.1-314.g086c737f.el9.noar 4.1 MB/s | 765 kB 00:00 2024-09-12T22:46:19.467 INFO:teuthology.orchestra.run.smithi087.stdout:(131/139): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-12T22:46:19.480 INFO:teuthology.orchestra.run.smithi066.stdout:(35/139): cephadm-19.1.1-314.g086c737f.el9.noar 10 MB/s | 765 kB 00:00 2024-09-12T22:46:19.483 INFO:teuthology.orchestra.run.smithi117.stdout:(136/139): openssl-3.2.2-6.el9.x86_64.rpm 4.5 MB/s | 1.4 MB 00:00 2024-09-12T22:46:19.493 INFO:teuthology.orchestra.run.smithi087.stdout:(132/139): python3-zc-lockfile-2.0-10.el9.noarc 341 kB/s | 20 kB 00:00 2024-09-12T22:46:19.518 INFO:teuthology.orchestra.run.smithi087.stdout:(133/139): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T22:46:19.542 INFO:teuthology.orchestra.run.smithi117.stdout:(137/139): librbd1-19.1.1-314.g086c737f.el9.x86 7.7 MB/s | 3.2 MB 00:00 2024-09-12T22:46:19.542 INFO:teuthology.orchestra.run.smithi087.stdout:(134/139): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-12T22:46:19.597 INFO:teuthology.orchestra.run.smithi066.stdout:(36/139): librgw2-19.1.1-314.g086c737f.el9.x86_ 2.7 MB/s | 5.3 MB 00:01 2024-09-12T22:46:19.600 INFO:teuthology.orchestra.run.smithi117.stdout:(138/139): librados2-19.1.1-314.g086c737f.el9.x 6.9 MB/s | 3.4 MB 00:00 2024-09-12T22:46:19.601 INFO:teuthology.orchestra.run.smithi087.stdout:(135/139): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-12T22:46:19.622 INFO:teuthology.orchestra.run.smithi066.stdout:(37/139): fuse-2.9.9-16.el9.x86_64.rpm 434 kB/s | 80 kB 00:00 2024-09-12T22:46:19.676 INFO:teuthology.orchestra.run.smithi087.stdout:(136/139): openssl-3.2.2-6.el9.x86_64.rpm 18 MB/s | 1.4 MB 00:00 2024-09-12T22:46:19.700 INFO:teuthology.orchestra.run.smithi099.stdout:(35/139): ceph-mgr-diskprediction-local-19.1.1- 7.9 MB/s | 7.4 MB 00:00 2024-09-12T22:46:19.726 INFO:teuthology.orchestra.run.smithi099.stdout:(36/139): fuse-2.9.9-16.el9.x86_64.rpm 299 kB/s | 80 kB 00:00 2024-09-12T22:46:19.731 INFO:teuthology.orchestra.run.smithi066.stdout:(38/139): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-09-12T22:46:19.756 INFO:teuthology.orchestra.run.smithi066.stdout:(39/139): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-12T22:46:19.760 INFO:teuthology.orchestra.run.smithi087.stdout:(137/139): openssl-libs-3.2.2-6.el9.x86_64.rpm 29 MB/s | 2.4 MB 00:00 2024-09-12T22:46:19.789 INFO:teuthology.orchestra.run.smithi066.stdout:(40/139): libgfortran-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 801 kB 00:00 2024-09-12T22:46:19.823 INFO:teuthology.orchestra.run.smithi066.stdout:(41/139): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-12T22:46:19.857 INFO:teuthology.orchestra.run.smithi066.stdout:(42/139): python3-cryptography-36.0.1-4.el9.x86 9.8 MB/s | 1.2 MB 00:00 2024-09-12T22:46:19.882 INFO:teuthology.orchestra.run.smithi066.stdout:(43/139): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-09-12T22:46:19.885 INFO:teuthology.orchestra.run.smithi087.stdout:(138/139): librbd1-19.1.1-314.g086c737f.el9.x86 9.2 MB/s | 3.2 MB 00:00 2024-09-12T22:46:19.907 INFO:teuthology.orchestra.run.smithi066.stdout:(44/139): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-09-12T22:46:19.932 INFO:teuthology.orchestra.run.smithi066.stdout:(45/139): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-12T22:46:19.934 INFO:teuthology.orchestra.run.smithi099.stdout:(37/139): libquadmath-11.5.0-2.el9.x86_64.rpm 918 kB/s | 191 kB 00:00 2024-09-12T22:46:19.935 INFO:teuthology.orchestra.run.smithi087.stdout:(139/139): librados2-19.1.1-314.g086c737f.el9.x 8.2 MB/s | 3.4 MB 00:00 2024-09-12T22:46:19.941 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-09-12T22:46:19.942 INFO:teuthology.orchestra.run.smithi087.stdout:Total 20 MB/s | 213 MB 00:10 2024-09-12T22:46:20.024 INFO:teuthology.orchestra.run.smithi066.stdout:(46/139): automake-1.16.2-8.el9.noarch.rpm 4.7 MB/s | 689 kB 00:00 2024-09-12T22:46:20.041 INFO:teuthology.orchestra.run.smithi066.stdout:(47/139): boost-program-options-1.75.0-8.el9.x8 987 kB/s | 107 kB 00:00 2024-09-12T22:46:20.066 INFO:teuthology.orchestra.run.smithi066.stdout:(48/139): elfutils-libelf-devel-0.191-4.el9.x86 520 kB/s | 22 kB 00:00 2024-09-12T22:46:20.101 INFO:teuthology.orchestra.run.smithi099.stdout:(38/139): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2024-09-12T22:46:20.109 INFO:teuthology.orchestra.run.smithi066.stdout:(49/139): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 313 kB 00:00 2024-09-12T22:46:20.134 INFO:teuthology.orchestra.run.smithi066.stdout:(50/139): flexiblas-3.0.4-8.el9.x86_64.rpm 489 kB/s | 33 kB 00:00 2024-09-12T22:46:20.159 INFO:teuthology.orchestra.run.smithi066.stdout:(51/139): bison-3.7.4-5.el9.x86_64.rpm 3.7 MB/s | 943 kB 00:00 2024-09-12T22:46:20.184 INFO:teuthology.orchestra.run.smithi066.stdout:(52/139): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-12T22:46:20.201 INFO:teuthology.orchestra.run.smithi066.stdout:(53/139): libaio-devel-0.3.111-13.el9.x86_64.rp 267 kB/s | 11 kB 00:00 2024-09-12T22:46:20.218 INFO:teuthology.orchestra.run.smithi066.stdout:(54/139): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.7 MB/s | 160 kB 00:00 2024-09-12T22:46:20.235 INFO:teuthology.orchestra.run.smithi066.stdout:(55/139): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-09-12T22:46:20.269 INFO:teuthology.orchestra.run.smithi066.stdout:(56/139): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 662 kB 00:00 2024-09-12T22:46:20.302 INFO:teuthology.orchestra.run.smithi066.stdout:(57/139): libtool-2.4.6-46.el9.x86_64.rpm 8.5 MB/s | 581 kB 00:00 2024-09-12T22:46:20.318 INFO:teuthology.orchestra.run.smithi117.stdout:(139/139): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.9 MB/s | 2.4 MB 00:00 2024-09-12T22:46:20.319 INFO:teuthology.orchestra.run.smithi066.stdout:(58/139): libuuid-devel-2.37.4-20.el9.x86_64.rp 489 kB/s | 24 kB 00:00 2024-09-12T22:46:20.324 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-12T22:46:20.324 INFO:teuthology.orchestra.run.smithi117.stdout:Total 20 MB/s | 213 MB 00:10 2024-09-12T22:46:20.336 INFO:teuthology.orchestra.run.smithi066.stdout:(59/139): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-12T22:46:20.351 INFO:teuthology.orchestra.run.smithi099.stdout:(39/139): libgfortran-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 801 kB 00:00 2024-09-12T22:46:20.361 INFO:teuthology.orchestra.run.smithi066.stdout:(60/139): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.8 MB/s | 292 kB 00:00 2024-09-12T22:46:20.386 INFO:teuthology.orchestra.run.smithi066.stdout:(61/139): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-12T22:46:20.412 INFO:teuthology.orchestra.run.smithi066.stdout:(62/139): openblas-0.3.26-2.el9.x86_64.rpm 770 kB/s | 38 kB 00:00 2024-09-12T22:46:20.470 INFO:teuthology.orchestra.run.smithi066.stdout:(63/139): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.3 MB/s | 3.0 MB 00:00 2024-09-12T22:46:20.493 INFO:teuthology.orchestra.run.smithi099.stdout:(40/139): python3-ply-3.11-14.el9.noarch.rpm 753 kB/s | 106 kB 00:00 2024-09-12T22:46:20.571 INFO:teuthology.orchestra.run.smithi066.stdout:(64/139): openblas-openmp-0.3.26-2.el9.x86_64.r 27 MB/s | 4.9 MB 00:00 2024-09-12T22:46:20.604 INFO:teuthology.orchestra.run.smithi066.stdout:(65/139): protobuf-3.14.0-13.el9.x86_64.rpm 7.6 MB/s | 1.0 MB 00:00 2024-09-12T22:46:20.610 INFO:teuthology.orchestra.run.smithi099.stdout:(41/139): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-12T22:46:20.652 INFO:teuthology.orchestra.run.smithi099.stdout:(42/139): python3-cryptography-36.0.1-4.el9.x86 2.2 MB/s | 1.2 MB 00:00 2024-09-12T22:46:20.663 INFO:teuthology.orchestra.run.smithi066.stdout:(66/139): openssl-devel-3.2.2-6.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-12T22:46:20.688 INFO:teuthology.orchestra.run.smithi066.stdout:(67/139): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-12T22:46:20.713 INFO:teuthology.orchestra.run.smithi066.stdout:(68/139): python3-jinja2-2.11.3-6.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-09-12T22:46:20.736 INFO:teuthology.orchestra.run.smithi099.stdout:(43/139): python3-requests-2.25.1-8.el9.noarch. 997 kB/s | 125 kB 00:00 2024-09-12T22:46:20.739 INFO:teuthology.orchestra.run.smithi066.stdout:(69/139): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-09-12T22:46:20.764 INFO:teuthology.orchestra.run.smithi066.stdout:(70/139): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-12T22:46:20.789 INFO:teuthology.orchestra.run.smithi066.stdout:(71/139): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-12T22:46:20.803 INFO:teuthology.orchestra.run.smithi099.stdout:(44/139): python3-urllib3-1.26.5-6.el9.noarch.r 1.4 MB/s | 215 kB 00:00 2024-09-12T22:46:20.814 INFO:teuthology.orchestra.run.smithi066.stdout:(72/139): python3-markupsafe-1.1.1-12.el9.x86_6 693 kB/s | 35 kB 00:00 2024-09-12T22:46:20.865 INFO:teuthology.orchestra.run.smithi066.stdout:(73/139): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-09-12T22:46:20.940 INFO:teuthology.orchestra.run.smithi066.stdout:(74/139): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-12T22:46:20.962 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-09-12T22:46:20.965 INFO:teuthology.orchestra.run.smithi066.stdout:(75/139): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-09-12T22:46:20.990 INFO:teuthology.orchestra.run.smithi066.stdout:(76/139): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-12T22:46:21.016 INFO:teuthology.orchestra.run.smithi066.stdout:(77/139): python3-prettytable-0.7.2-27.el9.noar 840 kB/s | 42 kB 00:00 2024-09-12T22:46:21.041 INFO:teuthology.orchestra.run.smithi066.stdout:(78/139): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-12T22:46:21.066 INFO:teuthology.orchestra.run.smithi066.stdout:(79/139): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-12T22:46:21.086 INFO:teuthology.orchestra.run.smithi099.stdout:(45/139): bison-3.7.4-5.el9.x86_64.rpm 3.3 MB/s | 943 kB 00:00 2024-09-12T22:46:21.091 INFO:teuthology.orchestra.run.smithi066.stdout:(80/139): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-12T22:46:21.100 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-09-12T22:46:21.100 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-09-12T22:46:21.117 INFO:teuthology.orchestra.run.smithi066.stdout:(81/139): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-12T22:46:21.120 INFO:teuthology.orchestra.run.smithi099.stdout:(46/139): automake-1.16.2-8.el9.noarch.rpm 1.8 MB/s | 689 kB 00:00 2024-09-12T22:46:21.154 INFO:teuthology.orchestra.run.smithi099.stdout:(47/139): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-09-12T22:46:21.159 INFO:teuthology.orchestra.run.smithi066.stdout:(82/139): python3-requests-oauthlib-1.3.0-12.el 802 kB/s | 54 kB 00:00 2024-09-12T22:46:21.187 INFO:teuthology.orchestra.run.smithi099.stdout:(48/139): elfutils-libelf-devel-0.191-4.el9.x86 325 kB/s | 22 kB 00:00 2024-09-12T22:46:21.226 INFO:teuthology.orchestra.run.smithi066.stdout:(83/139): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-12T22:46:21.238 INFO:teuthology.orchestra.run.smithi099.stdout:(49/139): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 313 kB 00:00 2024-09-12T22:46:21.251 INFO:teuthology.orchestra.run.smithi066.stdout:(84/139): python3-toml-0.10.2-6.el9.noarch.rpm 454 kB/s | 42 kB 00:00 2024-09-12T22:46:21.263 INFO:teuthology.orchestra.run.smithi099.stdout:(50/139): flexiblas-3.0.4-8.el9.x86_64.rpm 434 kB/s | 33 kB 00:00 2024-09-12T22:46:21.276 INFO:teuthology.orchestra.run.smithi066.stdout:(85/139): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-12T22:46:21.302 INFO:teuthology.orchestra.run.smithi066.stdout:(86/139): qatlib-service-24.02.0-1.el9.x86_64.r 713 kB/s | 36 kB 00:00 2024-09-12T22:46:21.321 INFO:teuthology.orchestra.run.smithi099.stdout:(51/139): flexiblas-openblas-openmp-3.0.4-8.el9 312 kB/s | 18 kB 00:00 2024-09-12T22:46:21.327 INFO:teuthology.orchestra.run.smithi066.stdout:(87/139): qatzip-libs-1.2.0-1.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-09-12T22:46:21.344 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-12T22:46:21.360 INFO:teuthology.orchestra.run.smithi066.stdout:(88/139): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-12T22:46:21.371 INFO:teuthology.orchestra.run.smithi099.stdout:(52/139): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-09-12T22:46:21.385 INFO:teuthology.orchestra.run.smithi066.stdout:(89/139): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.6 MB/s | 96 kB 00:00 2024-09-12T22:46:21.411 INFO:teuthology.orchestra.run.smithi066.stdout:(90/139): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-12T22:46:21.430 INFO:teuthology.orchestra.run.smithi099.stdout:(53/139): flexiblas-netlib-3.0.4-8.el9.x86_64.r 16 MB/s | 3.0 MB 00:00 2024-09-12T22:46:21.436 INFO:teuthology.orchestra.run.smithi066.stdout:(91/139): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-09-12T22:46:21.482 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-12T22:46:21.483 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-12T22:46:21.489 INFO:teuthology.orchestra.run.smithi099.stdout:(54/139): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-12T22:46:21.523 INFO:teuthology.orchestra.run.smithi099.stdout:(55/139): librabbitmq-0.11.0-7.el9.x86_64.rpm 491 kB/s | 45 kB 00:00 2024-09-12T22:46:21.631 INFO:teuthology.orchestra.run.smithi099.stdout:(56/139): libtool-2.4.6-46.el9.x86_64.rpm 5.2 MB/s | 581 kB 00:00 2024-09-12T22:46:21.682 INFO:teuthology.orchestra.run.smithi099.stdout:(57/139): libuuid-devel-2.37.4-20.el9.x86_64.rp 491 kB/s | 24 kB 00:00 2024-09-12T22:46:21.761 INFO:teuthology.orchestra.run.smithi066.stdout:(92/139): python3-scipy-1.6.2-8.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2024-09-12T22:46:21.845 INFO:teuthology.orchestra.run.smithi066.stdout:(93/139): abseil-cpp-20211102.0-3.el9.x86_64.rp 7.9 MB/s | 548 kB 00:00 2024-09-12T22:46:21.878 INFO:teuthology.orchestra.run.smithi066.stdout:(94/139): gperftools-libs-2.9.1-3.el9.x86_64.rp 9.0 MB/s | 308 kB 00:00 2024-09-12T22:46:21.895 INFO:teuthology.orchestra.run.smithi066.stdout:(95/139): grpc-data-1.46.7-10.el9.noarch.rpm 1.2 MB/s | 19 kB 00:00 2024-09-12T22:46:22.087 INFO:teuthology.orchestra.run.smithi066.stdout:(96/139): libarrow-9.0.0-11.el9.x86_64.rpm 23 MB/s | 4.4 MB 00:00 2024-09-12T22:46:22.104 INFO:teuthology.orchestra.run.smithi066.stdout:(97/139): lua-devel-5.4.4-4.el9.x86_64.rpm 32 kB/s | 22 kB 00:00 2024-09-12T22:46:22.107 INFO:teuthology.orchestra.run.smithi099.stdout:(58/139): ceph-test-19.1.1-314.g086c737f.el9.x8 7.7 MB/s | 49 MB 00:06 2024-09-12T22:46:22.121 INFO:teuthology.orchestra.run.smithi066.stdout:(98/139): libarrow-doc-9.0.0-11.el9.noarch.rpm 773 kB/s | 26 kB 00:00 2024-09-12T22:46:22.132 INFO:teuthology.orchestra.run.smithi099.stdout:(59/139): libzstd-devel-1.5.1-2.el9.x86_64.rpm 105 kB/s | 47 kB 00:00 2024-09-12T22:46:22.155 INFO:teuthology.orchestra.run.smithi066.stdout:(99/139): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-12T22:46:22.165 INFO:teuthology.orchestra.run.smithi099.stdout:(60/139): librdkafka-1.6.1-102.el9.x86_64.rpm 979 kB/s | 662 kB 00:00 2024-09-12T22:46:22.188 INFO:teuthology.orchestra.run.smithi066.stdout:(100/139): luarocks-3.9.2-5.el9.noarch.rpm 4.7 MB/s | 151 kB 00:00 2024-09-12T22:46:22.191 INFO:teuthology.orchestra.run.smithi099.stdout:(61/139): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-09-12T22:46:22.214 INFO:teuthology.orchestra.run.smithi066.stdout:(101/139): liboath-2.6.7-2.el9.x86_64.rpm 446 kB/s | 49 kB 00:00 2024-09-12T22:46:22.216 INFO:teuthology.orchestra.run.smithi099.stdout:(62/139): openblas-0.3.26-2.el9.x86_64.rpm 768 kB/s | 38 kB 00:00 2024-09-12T22:46:22.264 INFO:teuthology.orchestra.run.smithi066.stdout:(102/139): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-12T22:46:22.289 INFO:teuthology.orchestra.run.smithi066.stdout:(103/139): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T22:46:22.314 INFO:teuthology.orchestra.run.smithi066.stdout:(104/139): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-12T22:46:22.340 INFO:teuthology.orchestra.run.smithi066.stdout:(105/139): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-09-12T22:46:22.365 INFO:teuthology.orchestra.run.smithi066.stdout:(106/139): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-12T22:46:22.366 INFO:teuthology.orchestra.run.smithi099.stdout:(63/139): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.1 MB/s | 292 kB 00:00 2024-09-12T22:46:22.390 INFO:teuthology.orchestra.run.smithi066.stdout:(107/139): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-09-12T22:46:22.415 INFO:teuthology.orchestra.run.smithi066.stdout:(108/139): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-12T22:46:22.433 INFO:teuthology.orchestra.run.smithi099.stdout:(64/139): openblas-openmp-0.3.26-2.el9.x86_64.r 20 MB/s | 4.9 MB 00:00 2024-09-12T22:46:22.441 INFO:teuthology.orchestra.run.smithi066.stdout:(109/139): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-12T22:46:22.475 INFO:teuthology.orchestra.run.smithi066.stdout:(110/139): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-12T22:46:22.491 INFO:teuthology.orchestra.run.smithi066.stdout:(111/139): python3-jaraco-8.2.1-3.el9.noarch.rp 651 kB/s | 11 kB 00:00 2024-09-12T22:46:22.492 INFO:teuthology.orchestra.run.smithi099.stdout:(65/139): protobuf-3.14.0-13.el9.x86_64.rpm 8.1 MB/s | 1.0 MB 00:00 2024-09-12T22:46:22.508 INFO:teuthology.orchestra.run.smithi066.stdout:(112/139): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-12T22:46:22.525 INFO:teuthology.orchestra.run.smithi066.stdout:(113/139): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-12T22:46:22.551 INFO:teuthology.orchestra.run.smithi066.stdout:(114/139): python3-jaraco-functools-3.5.0-2.el9 782 kB/s | 19 kB 00:00 2024-09-12T22:46:22.567 INFO:teuthology.orchestra.run.smithi099.stdout:(66/139): python3-devel-3.9.19-8.el9.x86_64.rpm 3.2 MB/s | 245 kB 00:00 2024-09-12T22:46:22.576 INFO:teuthology.orchestra.run.smithi066.stdout:(115/139): python3-jaraco-text-3.2.0-6.el9.noar 788 kB/s | 20 kB 00:00 2024-09-12T22:46:22.642 INFO:teuthology.orchestra.run.smithi099.stdout:(67/139): python3-jinja2-2.11.3-6.el9.noarch.rp 3.2 MB/s | 248 kB 00:00 2024-09-12T22:46:22.643 INFO:teuthology.orchestra.run.smithi066.stdout:(116/139): python3-grpcio-1.46.7-10.el9.x86_64. 9.0 MB/s | 2.0 MB 00:00 2024-09-12T22:46:22.696 INFO:teuthology.orchestra.run.smithi066.stdout:(117/139): python3-logutils-0.3.5-21.el9.noarch 885 kB/s | 46 kB 00:00 2024-09-12T22:46:22.726 INFO:teuthology.orchestra.run.smithi099.stdout:(68/139): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 6.0 MB 00:00 2024-09-12T22:46:22.727 INFO:teuthology.orchestra.run.smithi066.stdout:(118/139): python3-more-itertools-8.12.0-2.el9. 2.5 MB/s | 79 kB 00:00 2024-09-12T22:46:22.751 INFO:teuthology.orchestra.run.smithi099.stdout:(69/139): python3-jsonpatch-1.21-16.el9.noarch. 236 kB/s | 26 kB 00:00 2024-09-12T22:46:22.760 INFO:teuthology.orchestra.run.smithi066.stdout:(119/139): python3-kubernetes-26.1.0-2.el9.noar 5.5 MB/s | 1.0 MB 00:00 2024-09-12T22:46:22.776 INFO:teuthology.orchestra.run.smithi099.stdout:(70/139): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-12T22:46:22.802 INFO:teuthology.orchestra.run.smithi099.stdout:(71/139): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-12T22:46:22.802 INFO:teuthology.orchestra.run.smithi066.stdout:(120/139): protobuf-compiler-3.14.0-13.el9.x86_ 632 kB/s | 863 kB 00:01 2024-09-12T22:46:22.827 INFO:teuthology.orchestra.run.smithi099.stdout:(72/139): python3-markupsafe-1.1.1-12.el9.x86_6 690 kB/s | 35 kB 00:00 2024-09-12T22:46:22.828 INFO:teuthology.orchestra.run.smithi066.stdout:(121/139): python3-natsort-7.1.1-5.el9.noarch.r 575 kB/s | 58 kB 00:00 2024-09-12T22:46:22.861 INFO:teuthology.orchestra.run.smithi066.stdout:(122/139): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-12T22:46:22.886 INFO:teuthology.orchestra.run.smithi099.stdout:(73/139): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-12T22:46:22.887 INFO:teuthology.orchestra.run.smithi066.stdout:(123/139): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-09-12T22:46:22.912 INFO:teuthology.orchestra.run.smithi066.stdout:(124/139): python3-portend-3.1.0-2.el9.noarch.r 151 kB/s | 16 kB 00:00 2024-09-12T22:46:22.937 INFO:teuthology.orchestra.run.smithi066.stdout:(125/139): python3-repoze-lru-0.7-16.el9.noarch 419 kB/s | 31 kB 00:00 2024-09-12T22:46:22.952 INFO:teuthology.orchestra.run.smithi099.stdout:(74/139): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-09-12T22:46:22.964 INFO:teuthology.orchestra.run.smithi066.stdout:(126/139): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-12T22:46:22.996 INFO:teuthology.orchestra.run.smithi066.stdout:(127/139): python3-tempora-5.0.0-2.el9.noarch.r 609 kB/s | 36 kB 00:00 2024-09-12T22:46:23.011 INFO:teuthology.orchestra.run.smithi099.stdout:(75/139): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-12T22:46:23.021 INFO:teuthology.orchestra.run.smithi066.stdout:(128/139): python3-typing-extensions-4.12.2-2.e 1.2 MB/s | 74 kB 00:00 2024-09-12T22:46:23.047 INFO:teuthology.orchestra.run.smithi066.stdout:(129/139): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-12T22:46:23.072 INFO:teuthology.orchestra.run.smithi066.stdout:(130/139): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-12T22:46:23.087 INFO:teuthology.orchestra.run.smithi099.stdout:(76/139): python3-numpy-1.20.1-5.el9.x86_64.rpm 18 MB/s | 5.1 MB 00:00 2024-09-12T22:46:23.097 INFO:teuthology.orchestra.run.smithi066.stdout:(131/139): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-12T22:46:23.112 INFO:teuthology.orchestra.run.smithi099.stdout:(77/139): python3-prettytable-0.7.2-27.el9.noar 422 kB/s | 42 kB 00:00 2024-09-12T22:46:23.122 INFO:teuthology.orchestra.run.smithi066.stdout:(132/139): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-09-12T22:46:23.148 INFO:teuthology.orchestra.run.smithi066.stdout:(133/139): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T22:46:23.154 INFO:teuthology.orchestra.run.smithi099.stdout:(78/139): python3-protobuf-3.14.0-13.el9.noarch 3.9 MB/s | 269 kB 00:00 2024-09-12T22:46:23.173 INFO:teuthology.orchestra.run.smithi066.stdout:(134/139): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-12T22:46:23.179 INFO:teuthology.orchestra.run.smithi099.stdout:(79/139): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-09-12T22:46:23.213 INFO:teuthology.orchestra.run.smithi099.stdout:(80/139): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-12T22:46:23.230 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-09-12T22:46:23.231 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-09-12T22:46:23.238 INFO:teuthology.orchestra.run.smithi099.stdout:(81/139): python3-pytz-2021.1-5.el9.noarch.rpm 871 kB/s | 51 kB 00:00 2024-09-12T22:46:23.240 INFO:teuthology.orchestra.run.smithi066.stdout:(135/139): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-12T22:46:23.322 INFO:teuthology.orchestra.run.smithi099.stdout:(82/139): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.0 MB/s | 4.4 MB 00:01 2024-09-12T22:46:23.323 INFO:teuthology.orchestra.run.smithi066.stdout:(136/139): openssl-3.2.2-6.el9.x86_64.rpm 16 MB/s | 1.4 MB 00:00 2024-09-12T22:46:23.347 INFO:teuthology.orchestra.run.smithi099.stdout:(83/139): python3-requests-oauthlib-1.3.0-12.el 401 kB/s | 54 kB 00:00 2024-09-12T22:46:23.381 INFO:teuthology.orchestra.run.smithi099.stdout:(84/139): python3-toml-0.10.2-6.el9.noarch.rpm 710 kB/s | 42 kB 00:00 2024-09-12T22:46:23.406 INFO:teuthology.orchestra.run.smithi099.stdout:(85/139): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-12T22:46:23.432 INFO:teuthology.orchestra.run.smithi066.stdout:(137/139): openssl-libs-3.2.2-6.el9.x86_64.rpm 22 MB/s | 2.4 MB 00:00 2024-09-12T22:46:23.439 INFO:teuthology.orchestra.run.smithi099.stdout:(86/139): qatlib-service-24.02.0-1.el9.x86_64.r 613 kB/s | 36 kB 00:00 2024-09-12T22:46:23.465 INFO:teuthology.orchestra.run.smithi099.stdout:(87/139): qatzip-libs-1.2.0-1.el9.x86_64.rpm 808 kB/s | 47 kB 00:00 2024-09-12T22:46:23.482 INFO:teuthology.orchestra.run.smithi066.stdout:(138/139): librbd1-19.1.1-314.g086c737f.el9.x86 10 MB/s | 3.2 MB 00:00 2024-09-12T22:46:23.515 INFO:teuthology.orchestra.run.smithi099.stdout:(88/139): socat-1.7.4.1-6.el9.x86_64.rpm 3.9 MB/s | 304 kB 00:00 2024-09-12T22:46:23.540 INFO:teuthology.orchestra.run.smithi099.stdout:(89/139): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.2 MB/s | 96 kB 00:00 2024-09-12T22:46:23.565 INFO:teuthology.orchestra.run.smithi099.stdout:(90/139): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-12T22:46:23.583 INFO:teuthology.orchestra.run.smithi099.stdout:(91/139): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.0 MB/s | 45 kB 00:00 2024-09-12T22:46:23.602 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-12T22:46:23.602 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-12T22:46:23.608 INFO:teuthology.orchestra.run.smithi099.stdout:(92/139): lua-devel-5.4.4-4.el9.x86_64.rpm 531 kB/s | 22 kB 00:00 2024-09-12T22:46:23.650 INFO:teuthology.orchestra.run.smithi099.stdout:(93/139): protobuf-compiler-3.14.0-13.el9.x86_6 13 MB/s | 863 kB 00:00 2024-09-12T22:46:23.708 INFO:teuthology.orchestra.run.smithi099.stdout:(94/139): abseil-cpp-20211102.0-3.el9.x86_64.rp 5.4 MB/s | 548 kB 00:00 2024-09-12T22:46:23.807 INFO:teuthology.orchestra.run.smithi066.stdout:(139/139): librados2-19.1.1-314.g086c737f.el9.x 5.2 MB/s | 3.4 MB 00:00 2024-09-12T22:46:23.814 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2024-09-12T22:46:23.814 INFO:teuthology.orchestra.run.smithi066.stdout:Total 19 MB/s | 213 MB 00:11 2024-09-12T22:46:23.876 INFO:teuthology.orchestra.run.smithi099.stdout:(95/139): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-09-12T22:46:23.892 INFO:teuthology.orchestra.run.smithi099.stdout:(96/139): grpc-data-1.46.7-10.el9.noarch.rpm 106 kB/s | 19 kB 00:00 2024-09-12T22:46:23.926 INFO:teuthology.orchestra.run.smithi099.stdout:(97/139): gperftools-libs-2.9.1-3.el9.x86_64.rp 1.1 MB/s | 308 kB 00:00 2024-09-12T22:46:23.951 INFO:teuthology.orchestra.run.smithi099.stdout:(98/139): libarrow-doc-9.0.0-11.el9.noarch.rpm 507 kB/s | 26 kB 00:00 2024-09-12T22:46:23.976 INFO:teuthology.orchestra.run.smithi099.stdout:(99/139): liboath-2.6.7-2.el9.x86_64.rpm 1.0 MB/s | 49 kB 00:00 2024-09-12T22:46:24.002 INFO:teuthology.orchestra.run.smithi099.stdout:(100/139): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-12T22:46:24.035 INFO:teuthology.orchestra.run.smithi099.stdout:(101/139): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-12T22:46:24.102 INFO:teuthology.orchestra.run.smithi099.stdout:(102/139): python3-asyncssh-2.13.2-5.el9.noarch 8.0 MB/s | 548 kB 00:00 2024-09-12T22:46:24.136 INFO:teuthology.orchestra.run.smithi099.stdout:(103/139): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.1 MB/s | 839 kB 00:00 2024-09-12T22:46:24.153 INFO:teuthology.orchestra.run.smithi099.stdout:(104/139): python3-bcrypt-3.2.2-1.el9.x86_64.rp 867 kB/s | 43 kB 00:00 2024-09-12T22:46:24.170 INFO:teuthology.orchestra.run.smithi099.stdout:(105/139): python3-cachetools-4.2.4-1.el9.noarc 963 kB/s | 32 kB 00:00 2024-09-12T22:46:24.186 INFO:teuthology.orchestra.run.smithi099.stdout:(106/139): python3-certifi-2023.05.07-4.el9.noa 422 kB/s | 14 kB 00:00 2024-09-12T22:46:24.212 INFO:teuthology.orchestra.run.smithi099.stdout:(107/139): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-12T22:46:24.254 INFO:teuthology.orchestra.run.smithi099.stdout:(108/139): python3-google-auth-2.34.0-1.el9.noa 5.2 MB/s | 220 kB 00:00 2024-09-12T22:46:24.354 INFO:teuthology.orchestra.run.smithi099.stdout:(109/139): python3-cherrypy-18.6.1-2.el9.noarch 2.1 MB/s | 358 kB 00:00 2024-09-12T22:46:24.388 INFO:teuthology.orchestra.run.smithi099.stdout:(110/139): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-12T22:46:24.405 INFO:teuthology.orchestra.run.smithi099.stdout:(111/139): python3-jaraco-8.2.1-3.el9.noarch.rp 648 kB/s | 11 kB 00:00 2024-09-12T22:46:24.422 INFO:teuthology.orchestra.run.smithi099.stdout:(112/139): python3-jaraco-classes-3.2.1-5.el9.n 1.1 MB/s | 18 kB 00:00 2024-09-12T22:46:24.439 INFO:teuthology.orchestra.run.smithi099.stdout:(113/139): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-12T22:46:24.456 INFO:teuthology.orchestra.run.smithi099.stdout:(114/139): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-09-12T22:46:24.473 INFO:teuthology.orchestra.run.smithi099.stdout:(115/139): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-09-12T22:46:24.548 INFO:teuthology.orchestra.run.smithi099.stdout:(116/139): libarrow-9.0.0-11.el9.x86_64.rpm 6.6 MB/s | 4.4 MB 00:00 2024-09-12T22:46:24.565 INFO:teuthology.orchestra.run.smithi099.stdout:(117/139): python3-logutils-0.3.5-21.el9.noarch 2.8 MB/s | 46 kB 00:00 2024-09-12T22:46:24.607 INFO:teuthology.orchestra.run.smithi099.stdout:(118/139): python3-grpcio-1.46.7-10.el9.x86_64. 5.8 MB/s | 2.0 MB 00:00 2024-09-12T22:46:24.632 INFO:teuthology.orchestra.run.smithi099.stdout:(119/139): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-09-12T22:46:24.657 INFO:teuthology.orchestra.run.smithi099.stdout:(120/139): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-12T22:46:24.683 INFO:teuthology.orchestra.run.smithi099.stdout:(121/139): python3-portend-3.1.0-2.el9.noarch.r 656 kB/s | 16 kB 00:00 2024-09-12T22:46:24.708 INFO:teuthology.orchestra.run.smithi099.stdout:(122/139): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-12T22:46:24.733 INFO:teuthology.orchestra.run.smithi099.stdout:(123/139): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-12T22:46:24.758 INFO:teuthology.orchestra.run.smithi099.stdout:(124/139): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-12T22:46:24.792 INFO:teuthology.orchestra.run.smithi099.stdout:(125/139): python3-routes-2.5.1-5.el9.noarch.rp 3.2 MB/s | 188 kB 00:00 2024-09-12T22:46:24.842 INFO:teuthology.orchestra.run.smithi099.stdout:(126/139): python3-kubernetes-26.1.0-2.el9.noar 2.8 MB/s | 1.0 MB 00:00 2024-09-12T22:46:24.858 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2024-09-12T22:46:24.868 INFO:teuthology.orchestra.run.smithi099.stdout:(127/139): python3-rsa-4.9-2.el9.noarch.rpm 543 kB/s | 59 kB 00:00 2024-09-12T22:46:24.893 INFO:teuthology.orchestra.run.smithi099.stdout:(128/139): python3-tempora-5.0.0-2.el9.noarch.r 356 kB/s | 36 kB 00:00 2024-09-12T22:46:24.918 INFO:teuthology.orchestra.run.smithi099.stdout:(129/139): python3-typing-extensions-4.12.2-2.e 987 kB/s | 74 kB 00:00 2024-09-12T22:46:24.943 INFO:teuthology.orchestra.run.smithi099.stdout:(130/139): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T22:46:24.969 INFO:teuthology.orchestra.run.smithi099.stdout:(131/139): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-12T22:46:24.994 INFO:teuthology.orchestra.run.smithi099.stdout:(132/139): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-12T22:46:25.012 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2024-09-12T22:46:25.012 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2024-09-12T22:46:25.019 INFO:teuthology.orchestra.run.smithi099.stdout:(133/139): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T22:46:25.045 INFO:teuthology.orchestra.run.smithi099.stdout:(134/139): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-12T22:46:25.111 INFO:teuthology.orchestra.run.smithi099.stdout:(135/139): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-12T22:46:25.387 INFO:teuthology.orchestra.run.smithi099.stdout:(136/139): librbd1-19.1.1-314.g086c737f.el9.x86 9.2 MB/s | 3.2 MB 00:00 2024-09-12T22:46:25.579 INFO:teuthology.orchestra.run.smithi099.stdout:(137/139): librados2-19.1.1-314.g086c737f.el9.x 6.1 MB/s | 3.4 MB 00:00 2024-09-12T22:46:25.920 INFO:teuthology.orchestra.run.smithi099.stdout:(138/139): openssl-3.2.2-6.el9.x86_64.rpm 1.7 MB/s | 1.4 MB 00:00 2024-09-12T22:46:26.496 INFO:teuthology.orchestra.run.smithi099.stdout:(139/139): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.2 MB/s | 2.4 MB 00:01 2024-09-12T22:46:26.502 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-12T22:46:26.502 INFO:teuthology.orchestra.run.smithi099.stdout:Total 13 MB/s | 213 MB 00:16 2024-09-12T22:46:27.199 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2024-09-12T22:46:27.199 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2024-09-12T22:46:27.511 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-12T22:46:27.649 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-12T22:46:27.649 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-12T22:46:28.986 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-09-12T22:46:29.106 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/143 2024-09-12T22:46:29.144 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/143 2024-09-12T22:46:29.198 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/143 2024-09-12T22:46:29.231 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/143 2024-09-12T22:46:29.257 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/143 2024-09-12T22:46:29.279 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-12T22:46:29.305 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/143 2024-09-12T22:46:29.362 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/143 2024-09-12T22:46:29.402 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/143 2024-09-12T22:46:29.472 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/143 2024-09-12T22:46:29.522 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/143 2024-09-12T22:46:29.547 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/143 2024-09-12T22:46:29.596 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/143 2024-09-12T22:46:29.637 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/143 2024-09-12T22:46:29.749 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:46:29.871 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:46:29.900 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:46:29.915 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-12T22:46:29.916 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-12T22:46:29.933 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/143 2024-09-12T22:46:29.992 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:46:30.031 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T22:46:30.032 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:46:30.060 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:46:30.147 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:46:30.157 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:46:30.169 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T22:46:30.192 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:46:30.232 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T22:46:30.253 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T22:46:30.280 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T22:46:30.283 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:46:30.332 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T22:46:30.472 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T22:46:30.503 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T22:46:30.510 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:46:30.609 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/143 2024-09-12T22:46:30.614 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:46:30.652 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T22:46:30.702 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/143 2024-09-12T22:46:30.732 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T22:46:30.735 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/143 2024-09-12T22:46:30.770 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T22:46:30.771 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/143 2024-09-12T22:46:30.795 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T22:46:30.844 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/143 2024-09-12T22:46:30.897 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/143 2024-09-12T22:46:30.937 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/143 2024-09-12T22:46:30.981 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/143 2024-09-12T22:46:30.989 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T22:46:31.013 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/143 2024-09-12T22:46:31.020 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T22:46:31.040 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/143 2024-09-12T22:46:31.123 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/143 2024-09-12T22:46:31.127 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/143 2024-09-12T22:46:31.179 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/143 2024-09-12T22:46:31.218 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/143 2024-09-12T22:46:31.223 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/143 2024-09-12T22:46:31.253 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/143 2024-09-12T22:46:31.262 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/143 2024-09-12T22:46:31.287 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/143 2024-09-12T22:46:31.338 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/143 2024-09-12T22:46:31.351 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/143 2024-09-12T22:46:31.381 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 30/143 2024-09-12T22:46:31.404 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/143 2024-09-12T22:46:31.424 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 31/143 2024-09-12T22:46:31.436 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/143 2024-09-12T22:46:31.453 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 32/143 2024-09-12T22:46:31.480 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/143 2024-09-12T22:46:31.513 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/143 2024-09-12T22:46:31.521 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/143 2024-09-12T22:46:31.541 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/143 2024-09-12T22:46:31.568 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/143 2024-09-12T22:46:31.609 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/143 2024-09-12T22:46:31.640 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/143 2024-09-12T22:46:31.671 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/143 2024-09-12T22:46:31.709 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/143 2024-09-12T22:46:31.745 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/143 2024-09-12T22:46:31.775 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/143 2024-09-12T22:46:31.822 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/143 2024-09-12T22:46:31.827 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/143 2024-09-12T22:46:31.865 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 30/143 2024-09-12T22:46:31.926 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 31/143 2024-09-12T22:46:31.954 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 32/143 2024-09-12T22:46:32.025 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/143 2024-09-12T22:46:32.068 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/143 2024-09-12T22:46:32.142 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/143 2024-09-12T22:46:32.275 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/143 2024-09-12T22:46:32.329 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/143 2024-09-12T22:46:32.358 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/143 2024-09-12T22:46:32.439 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/143 2024-09-12T22:46:32.469 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/143 2024-09-12T22:46:32.504 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/143 2024-09-12T22:46:32.541 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 42/143 2024-09-12T22:46:32.587 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/143 2024-09-12T22:46:32.765 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 44/143 2024-09-12T22:46:32.827 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 45/143 2024-09-12T22:46:32.863 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/143 2024-09-12T22:46:32.882 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 46/143 2024-09-12T22:46:32.941 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/143 2024-09-12T22:46:32.956 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 47/143 2024-09-12T22:46:32.970 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/143 2024-09-12T22:46:32.996 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 48/143 2024-09-12T22:46:33.014 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/143 2024-09-12T22:46:33.031 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 49/143 2024-09-12T22:46:33.051 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 42/143 2024-09-12T22:46:33.079 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 50/143 2024-09-12T22:46:33.102 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/143 2024-09-12T22:46:33.123 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 51/143 2024-09-12T22:46:33.165 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/143 2024-09-12T22:46:33.247 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2024-09-12T22:46:33.262 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 44/143 2024-09-12T22:46:33.302 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/143 2024-09-12T22:46:33.338 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 45/143 2024-09-12T22:46:33.341 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/143 2024-09-12T22:46:33.345 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/143 2024-09-12T22:46:33.383 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/143 2024-09-12T22:46:33.384 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/143 2024-09-12T22:46:33.393 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 46/143 2024-09-12T22:46:33.438 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/143 2024-09-12T22:46:33.464 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 47/143 2024-09-12T22:46:33.479 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/143 2024-09-12T22:46:33.494 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/143 2024-09-12T22:46:33.497 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 48/143 2024-09-12T22:46:33.504 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/143 2024-09-12T22:46:33.533 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 49/143 2024-09-12T22:46:33.533 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/143 2024-09-12T22:46:33.555 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/143 2024-09-12T22:46:33.580 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 50/143 2024-09-12T22:46:33.585 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/143 2024-09-12T22:46:33.615 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 59/143 2024-09-12T22:46:33.625 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 51/143 2024-09-12T22:46:33.640 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/143 2024-09-12T22:46:33.675 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/143 2024-09-12T22:46:33.749 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/143 2024-09-12T22:46:33.813 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/143 2024-09-12T22:46:33.861 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/143 2024-09-12T22:46:33.875 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/143 2024-09-12T22:46:33.902 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/143 2024-09-12T22:46:33.906 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/143 2024-09-12T22:46:33.913 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/143 2024-09-12T22:46:33.942 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/143 2024-09-12T22:46:33.978 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/143 2024-09-12T22:46:34.006 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/143 2024-09-12T22:46:34.033 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 66/143 2024-09-12T22:46:34.045 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/143 2024-09-12T22:46:34.076 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 67/143 2024-09-12T22:46:34.085 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/143 2024-09-12T22:46:34.113 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 68/143 2024-09-12T22:46:34.117 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 59/143 2024-09-12T22:46:34.123 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:46:34.142 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/143 2024-09-12T22:46:34.151 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 69/143 2024-09-12T22:46:34.185 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 70/143 2024-09-12T22:46:34.238 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/143 2024-09-12T22:46:34.265 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:46:34.272 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 71/143 2024-09-12T22:46:34.315 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:46:34.324 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 72/143 2024-09-12T22:46:34.369 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/143 2024-09-12T22:46:34.408 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:46:34.408 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/143 2024-09-12T22:46:34.436 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/143 2024-09-12T22:46:34.439 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T22:46:34.466 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:46:34.473 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/143 2024-09-12T22:46:34.503 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 66/143 2024-09-12T22:46:34.538 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 67/143 2024-09-12T22:46:34.556 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:46:34.571 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 68/143 2024-09-12T22:46:34.584 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T22:46:34.589 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 73/143 2024-09-12T22:46:34.612 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 69/143 2024-09-12T22:46:34.630 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T22:46:34.647 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 70/143 2024-09-12T22:46:34.668 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T22:46:34.696 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T22:46:34.700 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 74/143 2024-09-12T22:46:34.734 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 71/143 2024-09-12T22:46:34.751 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 75/143 2024-09-12T22:46:34.785 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 72/143 2024-09-12T22:46:34.825 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 73/143 2024-09-12T22:46:34.864 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T22:46:34.894 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T22:46:34.928 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 74/143 2024-09-12T22:46:35.005 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/143 2024-09-12T22:46:35.108 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/143 2024-09-12T22:46:35.229 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 75/143 2024-09-12T22:46:35.268 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/143 2024-09-12T22:46:35.312 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/143 2024-09-12T22:46:35.387 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/143 2024-09-12T22:46:35.438 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/143 2024-09-12T22:46:35.468 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-12T22:46:35.477 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/143 2024-09-12T22:46:35.479 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/143 2024-09-12T22:46:35.531 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 77/143 2024-09-12T22:46:35.546 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/143 2024-09-12T22:46:35.565 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 78/143 2024-09-12T22:46:35.582 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/143 2024-09-12T22:46:35.582 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/143 2024-09-12T22:46:35.617 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/143 2024-09-12T22:46:35.624 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/143 2024-09-12T22:46:35.667 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 79/143 2024-09-12T22:46:35.685 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/143 2024-09-12T22:46:35.707 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 80/143 2024-09-12T22:46:35.708 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/143 2024-09-12T22:46:35.724 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/143 2024-09-12T22:46:35.750 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/143 2024-09-12T22:46:35.771 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/143 2024-09-12T22:46:35.800 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/143 2024-09-12T22:46:35.804 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/143 2024-09-12T22:46:35.844 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/143 2024-09-12T22:46:35.893 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openblas-0.3.26-2.el9.x86_64 81/143 2024-09-12T22:46:35.921 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 82/143 2024-09-12T22:46:35.922 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/143 2024-09-12T22:46:35.954 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 30/143 2024-09-12T22:46:35.998 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 31/143 2024-09-12T22:46:35.999 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 83/143 2024-09-12T22:46:36.018 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 32/143 2024-09-12T22:46:36.040 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/143 2024-09-12T22:46:36.092 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/143 2024-09-12T22:46:36.132 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/143 2024-09-12T22:46:36.141 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/143 2024-09-12T22:46:36.219 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/143 2024-09-12T22:46:36.252 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 77/143 2024-09-12T22:46:36.275 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:46:36.294 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 78/143 2024-09-12T22:46:36.364 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/143 2024-09-12T22:46:36.393 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 79/143 2024-09-12T22:46:36.419 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/143 2024-09-12T22:46:36.436 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 80/143 2024-09-12T22:46:36.620 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-0.3.26-2.el9.x86_64 81/143 2024-09-12T22:46:36.641 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:46:36.642 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 82/143 2024-09-12T22:46:36.653 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 84/143 2024-09-12T22:46:36.668 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:46:36.732 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 83/143 2024-09-12T22:46:36.744 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:46:36.779 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 85/143 2024-09-12T22:46:36.783 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T22:46:36.811 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:46:36.916 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:46:36.954 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T22:46:36.976 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/143 2024-09-12T22:46:37.000 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T22:46:37.038 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T22:46:37.061 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T22:46:37.066 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/143 2024-09-12T22:46:37.101 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/143 2024-09-12T22:46:37.144 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/143 2024-09-12T22:46:37.182 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 42/143 2024-09-12T22:46:37.232 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T22:46:37.236 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/143 2024-09-12T22:46:37.264 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T22:46:37.378 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/143 2024-09-12T22:46:37.404 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 44/143 2024-09-12T22:46:37.410 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 84/143 2024-09-12T22:46:37.460 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 45/143 2024-09-12T22:46:37.472 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/143 2024-09-12T22:46:37.512 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/143 2024-09-12T22:46:37.516 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 46/143 2024-09-12T22:46:37.524 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 85/143 2024-09-12T22:46:37.547 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/143 2024-09-12T22:46:37.598 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 47/143 2024-09-12T22:46:37.620 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/143 2024-09-12T22:46:37.635 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 48/143 2024-09-12T22:46:37.664 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/143 2024-09-12T22:46:37.671 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 49/143 2024-09-12T22:46:37.713 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/143 2024-09-12T22:46:37.719 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 50/143 2024-09-12T22:46:37.763 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 51/143 2024-09-12T22:46:37.765 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/143 2024-09-12T22:46:37.798 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/143 2024-09-12T22:46:37.806 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/143 2024-09-12T22:46:37.825 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/143 2024-09-12T22:46:37.895 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/143 2024-09-12T22:46:37.949 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/143 2024-09-12T22:46:37.956 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/143 2024-09-12T22:46:37.990 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/143 2024-09-12T22:46:37.992 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/143 2024-09-12T22:46:38.030 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/143 2024-09-12T22:46:38.032 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/143 2024-09-12T22:46:38.040 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 86/143 2024-09-12T22:46:38.116 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/143 2024-09-12T22:46:38.133 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 87/143 2024-09-12T22:46:38.139 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/143 2024-09-12T22:46:38.158 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 30/143 2024-09-12T22:46:38.161 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 88/143 2024-09-12T22:46:38.174 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/143 2024-09-12T22:46:38.194 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 89/143 2024-09-12T22:46:38.201 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 31/143 2024-09-12T22:46:38.215 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/143 2024-09-12T22:46:38.238 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 32/143 2024-09-12T22:46:38.247 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 59/143 2024-09-12T22:46:38.288 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/143 2024-09-12T22:46:38.308 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/143 2024-09-12T22:46:38.353 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/143 2024-09-12T22:46:38.390 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/143 2024-09-12T22:46:38.427 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/143 2024-09-12T22:46:38.514 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 90/143 2024-09-12T22:46:38.529 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/143 2024-09-12T22:46:38.557 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T22:46:38.561 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/143 2024-09-12T22:46:38.622 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/143 2024-09-12T22:46:38.647 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T22:46:38.678 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 92/143 2024-09-12T22:46:38.723 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 93/143 2024-09-12T22:46:38.754 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/143 2024-09-12T22:46:38.787 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/143 2024-09-12T22:46:38.791 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 86/143 2024-09-12T22:46:38.828 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/143 2024-09-12T22:46:38.857 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 66/143 2024-09-12T22:46:38.880 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 87/143 2024-09-12T22:46:38.892 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 67/143 2024-09-12T22:46:38.907 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 88/143 2024-09-12T22:46:38.925 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 68/143 2024-09-12T22:46:38.941 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 89/143 2024-09-12T22:46:38.967 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 69/143 2024-09-12T22:46:39.000 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 70/143 2024-09-12T22:46:39.091 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 71/143 2024-09-12T22:46:39.136 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/143 2024-09-12T22:46:39.140 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 72/143 2024-09-12T22:46:39.178 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 73/143 2024-09-12T22:46:39.211 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 94/143 2024-09-12T22:46:39.241 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/143 2024-09-12T22:46:39.243 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T22:46:39.260 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 90/143 2024-09-12T22:46:39.279 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/143 2024-09-12T22:46:39.286 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 74/143 2024-09-12T22:46:39.304 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T22:46:39.314 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T22:46:39.322 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/143 2024-09-12T22:46:39.339 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 75/143 2024-09-12T22:46:39.345 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 96/143 2024-09-12T22:46:39.360 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 42/143 2024-09-12T22:46:39.397 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T22:46:39.402 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/143 2024-09-12T22:46:39.426 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 92/143 2024-09-12T22:46:39.462 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 93/143 2024-09-12T22:46:39.585 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 44/143 2024-09-12T22:46:39.654 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 45/143 2024-09-12T22:46:39.709 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 46/143 2024-09-12T22:46:39.791 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 47/143 2024-09-12T22:46:39.822 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 48/143 2024-09-12T22:46:39.858 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 49/143 2024-09-12T22:46:39.904 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 50/143 2024-09-12T22:46:39.950 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 51/143 2024-09-12T22:46:39.957 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 94/143 2024-09-12T22:46:39.992 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/143 2024-09-12T22:46:39.999 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T22:46:40.070 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T22:46:40.105 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/143 2024-09-12T22:46:40.109 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 96/143 2024-09-12T22:46:40.127 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/143 2024-09-12T22:46:40.151 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 77/143 2024-09-12T22:46:40.177 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/143 2024-09-12T22:46:40.185 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 78/143 2024-09-12T22:46:40.218 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/143 2024-09-12T22:46:40.288 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 79/143 2024-09-12T22:46:40.322 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/143 2024-09-12T22:46:40.327 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 80/143 2024-09-12T22:46:40.360 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/143 2024-09-12T22:46:40.401 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/143 2024-09-12T22:46:40.434 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 59/143 2024-09-12T22:46:40.459 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/143 2024-09-12T22:46:40.521 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : openblas-0.3.26-2.el9.x86_64 81/143 2024-09-12T22:46:40.549 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 82/143 2024-09-12T22:46:40.553 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/143 2024-09-12T22:46:40.630 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 83/143 2024-09-12T22:46:40.685 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/143 2024-09-12T22:46:40.724 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/143 2024-09-12T22:46:40.752 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/143 2024-09-12T22:46:40.789 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/143 2024-09-12T22:46:40.819 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 66/143 2024-09-12T22:46:40.853 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 67/143 2024-09-12T22:46:40.886 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 68/143 2024-09-12T22:46:40.928 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 69/143 2024-09-12T22:46:40.963 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 70/143 2024-09-12T22:46:41.056 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 71/143 2024-09-12T22:46:41.109 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 72/143 2024-09-12T22:46:41.141 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 73/143 2024-09-12T22:46:41.243 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 74/143 2024-09-12T22:46:41.291 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 75/143 2024-09-12T22:46:41.317 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 84/143 2024-09-12T22:46:41.438 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 85/143 2024-09-12T22:46:42.011 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/143 2024-09-12T22:46:42.055 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 77/143 2024-09-12T22:46:42.089 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 78/143 2024-09-12T22:46:42.140 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:46:42.176 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:46:42.189 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 79/143 2024-09-12T22:46:42.223 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 80/143 2024-09-12T22:46:42.407 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openblas-0.3.26-2.el9.x86_64 81/143 2024-09-12T22:46:42.434 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:46:42.448 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 82/143 2024-09-12T22:46:42.473 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:46:42.527 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 83/143 2024-09-12T22:46:42.725 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:46:42.770 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T22:46:42.776 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 86/143 2024-09-12T22:46:42.856 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 87/143 2024-09-12T22:46:42.861 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T22:46:42.861 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T22:46:42.861 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T22:46:42.861 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:46:42.884 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 88/143 2024-09-12T22:46:42.896 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T22:46:42.917 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 89/143 2024-09-12T22:46:43.037 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:46:43.093 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T22:46:43.170 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 84/143 2024-09-12T22:46:43.184 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T22:46:43.184 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T22:46:43.184 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T22:46:43.184 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:46:43.228 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T22:46:43.252 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 90/143 2024-09-12T22:46:43.287 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T22:46:43.303 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 85/143 2024-09-12T22:46:43.379 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T22:46:43.409 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 92/143 2024-09-12T22:46:43.453 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 93/143 2024-09-12T22:46:43.962 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 94/143 2024-09-12T22:46:43.990 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T22:46:44.062 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T22:46:44.092 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 96/143 2024-09-12T22:46:44.553 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 86/143 2024-09-12T22:46:44.637 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 87/143 2024-09-12T22:46:44.664 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 88/143 2024-09-12T22:46:44.696 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 89/143 2024-09-12T22:46:45.018 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 90/143 2024-09-12T22:46:45.067 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T22:46:45.157 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T22:46:45.189 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 92/143 2024-09-12T22:46:45.225 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 93/143 2024-09-12T22:46:45.710 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 94/143 2024-09-12T22:46:45.737 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T22:46:45.807 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T22:46:45.838 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 96/143 2024-09-12T22:46:46.576 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:46:46.613 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:46:47.196 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:46:47.241 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T22:46:47.316 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T22:46:47.316 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T22:46:47.316 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T22:46:47.316 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:46:47.359 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T22:46:48.166 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:46:48.201 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:46:48.760 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:46:48.805 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T22:46:48.895 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T22:46:48.895 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T22:46:48.895 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T22:46:48.895 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:46:48.931 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T22:46:54.500 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T22:46:54.500 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /sys 2024-09-12T22:46:54.500 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /proc 2024-09-12T22:46:54.500 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /mnt 2024-09-12T22:46:54.500 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /var/tmp 2024-09-12T22:46:54.500 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /home 2024-09-12T22:46:54.500 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /root 2024-09-12T22:46:54.500 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /tmp 2024-09-12T22:46:54.501 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:46:54.681 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T22:46:54.696 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T22:46:54.696 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:46:54.696 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T22:46:54.696 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:46:54.826 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T22:46:54.827 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /sys 2024-09-12T22:46:54.827 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /proc 2024-09-12T22:46:54.827 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /mnt 2024-09-12T22:46:54.827 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /var/tmp 2024-09-12T22:46:54.827 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /home 2024-09-12T22:46:54.827 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /root 2024-09-12T22:46:54.827 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /tmp 2024-09-12T22:46:54.827 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:46:55.005 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T22:46:55.021 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T22:46:55.021 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:46:55.021 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T22:46:55.021 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:46:56.183 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T22:46:56.210 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T22:46:56.210 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:46:56.210 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T22:46:56.211 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T22:46:56.211 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T22:46:56.211 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:46:56.442 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T22:46:56.465 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T22:46:56.465 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:46:56.466 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T22:46:56.466 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T22:46:56.466 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T22:46:56.466 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:46:56.557 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T22:46:56.585 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T22:46:56.585 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:46:56.585 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T22:46:56.585 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T22:46:56.585 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T22:46:56.585 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:46:56.816 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T22:46:56.840 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T22:46:56.840 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:46:56.841 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T22:46:56.841 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T22:46:56.841 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T22:46:56.841 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:46:56.909 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T22:46:56.933 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T22:46:56.933 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:46:56.933 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T22:46:56.933 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T22:46:56.933 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T22:46:56.933 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:46:57.047 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : automake-1.16.2-8.el9.noarch 104/143 2024-09-12T22:46:57.096 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ply-3.11-14.el9.noarch 105/143 2024-09-12T22:46:57.151 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 106/143 2024-09-12T22:46:57.284 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T22:46:57.307 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T22:46:57.308 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:46:57.308 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T22:46:57.308 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T22:46:57.308 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T22:46:57.308 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:46:57.337 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 107/143 2024-09-12T22:46:57.385 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 108/143 2024-09-12T22:46:57.431 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : automake-1.16.2-8.el9.noarch 104/143 2024-09-12T22:46:57.463 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 109/143 2024-09-12T22:46:57.479 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ply-3.11-14.el9.noarch 105/143 2024-09-12T22:46:57.534 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 106/143 2024-09-12T22:46:57.551 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 110/143 2024-09-12T22:46:57.698 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 111/143 2024-09-12T22:46:57.722 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 107/143 2024-09-12T22:46:57.761 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 112/143 2024-09-12T22:46:57.768 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 108/143 2024-09-12T22:46:57.800 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 113/143 2024-09-12T22:46:57.827 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : fuse-2.9.9-16.el9.x86_64 114/143 2024-09-12T22:46:57.846 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 109/143 2024-09-12T22:46:57.935 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 110/143 2024-09-12T22:46:58.074 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 111/143 2024-09-12T22:46:58.118 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 112/143 2024-09-12T22:46:58.149 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 113/143 2024-09-12T22:46:58.177 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : fuse-2.9.9-16.el9.x86_64 114/143 2024-09-12T22:46:58.281 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T22:46:58.309 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T22:46:58.340 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 116/143 2024-09-12T22:46:58.402 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 117/143 2024-09-12T22:46:58.432 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T22:46:58.632 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T22:46:58.659 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T22:46:58.691 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 116/143 2024-09-12T22:46:58.753 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 117/143 2024-09-12T22:46:58.782 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T22:46:59.339 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T22:46:59.339 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /sys 2024-09-12T22:46:59.340 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /proc 2024-09-12T22:46:59.340 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /mnt 2024-09-12T22:46:59.340 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /var/tmp 2024-09-12T22:46:59.340 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /home 2024-09-12T22:46:59.340 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /root 2024-09-12T22:46:59.340 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /tmp 2024-09-12T22:46:59.340 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:46:59.473 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T22:46:59.510 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T22:46:59.517 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T22:46:59.526 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T22:46:59.526 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:46:59.526 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T22:46:59.526 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:46:59.837 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T22:46:59.876 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T22:47:00.475 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T22:47:00.501 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T22:47:00.603 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T22:47:00.618 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T22:47:00.618 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /sys 2024-09-12T22:47:00.618 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /proc 2024-09-12T22:47:00.618 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /mnt 2024-09-12T22:47:00.618 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /var/tmp 2024-09-12T22:47:00.618 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /home 2024-09-12T22:47:00.618 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /root 2024-09-12T22:47:00.618 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /tmp 2024-09-12T22:47:00.618 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:00.786 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 121/143 2024-09-12T22:47:00.791 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T22:47:00.807 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T22:47:00.808 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:47:00.808 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T22:47:00.808 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:00.819 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T22:47:00.844 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T22:47:00.844 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:47:00.844 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T22:47:00.844 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T22:47:00.844 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T22:47:00.844 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:47:00.859 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T22:47:00.895 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T22:47:00.901 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T22:47:00.906 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T22:47:01.004 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-2:19.1.1-314.g086c737f.el9.x86_64 124/143 2024-09-12T22:47:01.007 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T22:47:01.063 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 125/143 2024-09-12T22:47:01.070 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T22:47:01.099 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T22:47:01.099 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:47:01.099 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T22:47:01.099 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T22:47:01.099 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T22:47:01.099 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:01.165 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 121/143 2024-09-12T22:47:01.203 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T22:47:01.227 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T22:47:01.227 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:47:01.228 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T22:47:01.228 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T22:47:01.228 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T22:47:01.228 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:47:01.270 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T22:47:01.282 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T22:47:01.347 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T22:47:01.372 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T22:47:01.372 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:47:01.372 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T22:47:01.372 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T22:47:01.373 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T22:47:01.373 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:01.374 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-2:19.1.1-314.g086c737f.el9.x86_64 124/143 2024-09-12T22:47:01.436 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 125/143 2024-09-12T22:47:01.831 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T22:47:01.857 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T22:47:01.857 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:47:01.857 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T22:47:01.857 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T22:47:01.857 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T22:47:01.857 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:01.979 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : automake-1.16.2-8.el9.noarch 104/143 2024-09-12T22:47:01.984 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libtool-2.4.6-46.el9.x86_64 126/143 2024-09-12T22:47:02.014 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T22:47:02.037 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-ply-3.11-14.el9.noarch 105/143 2024-09-12T22:47:02.038 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T22:47:02.038 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:47:02.038 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T22:47:02.038 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T22:47:02.038 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T22:47:02.038 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:47:02.082 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T22:47:02.101 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 106/143 2024-09-12T22:47:02.104 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T22:47:02.105 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:47:02.105 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T22:47:02.105 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:47:02.294 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T22:47:02.295 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 107/143 2024-09-12T22:47:02.322 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T22:47:02.322 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:47:02.322 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T22:47:02.322 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T22:47:02.322 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T22:47:02.322 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:02.349 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 108/143 2024-09-12T22:47:02.401 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libtool-2.4.6-46.el9.x86_64 126/143 2024-09-12T22:47:02.415 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T22:47:02.430 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 109/143 2024-09-12T22:47:02.431 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T22:47:02.439 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T22:47:02.439 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:47:02.439 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T22:47:02.439 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T22:47:02.439 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T22:47:02.439 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:47:02.456 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T22:47:02.456 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:47:02.456 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T22:47:02.456 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T22:47:02.456 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T22:47:02.456 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:47:02.498 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T22:47:02.519 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 110/143 2024-09-12T22:47:02.522 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T22:47:02.522 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:47:02.522 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T22:47:02.522 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:47:02.545 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T22:47:02.568 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T22:47:02.568 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:47:02.568 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T22:47:02.568 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T22:47:02.569 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T22:47:02.569 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:02.661 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 111/143 2024-09-12T22:47:02.702 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 112/143 2024-09-12T22:47:02.739 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 113/143 2024-09-12T22:47:02.766 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : fuse-2.9.9-16.el9.x86_64 114/143 2024-09-12T22:47:02.832 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T22:47:02.856 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T22:47:02.856 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:47:02.856 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T22:47:02.856 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T22:47:02.856 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T22:47:02.856 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:47:03.003 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T22:47:03.027 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T22:47:03.027 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:47:03.027 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T22:47:03.027 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T22:47:03.027 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T22:47:03.028 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:03.141 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : automake-1.16.2-8.el9.noarch 104/143 2024-09-12T22:47:03.190 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ply-3.11-14.el9.noarch 105/143 2024-09-12T22:47:03.207 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T22:47:03.232 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T22:47:03.254 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 106/143 2024-09-12T22:47:03.264 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 116/143 2024-09-12T22:47:03.329 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 117/143 2024-09-12T22:47:03.363 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T22:47:03.447 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 107/143 2024-09-12T22:47:03.504 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 108/143 2024-09-12T22:47:03.582 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 109/143 2024-09-12T22:47:03.678 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 110/143 2024-09-12T22:47:03.827 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 111/143 2024-09-12T22:47:03.886 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 112/143 2024-09-12T22:47:03.919 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 113/143 2024-09-12T22:47:03.947 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : fuse-2.9.9-16.el9.x86_64 114/143 2024-09-12T22:47:04.402 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T22:47:04.429 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T22:47:04.460 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 116/143 2024-09-12T22:47:04.468 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T22:47:04.506 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T22:47:04.522 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 117/143 2024-09-12T22:47:04.552 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T22:47:05.524 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T22:47:05.557 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T22:47:05.589 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T22:47:05.620 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T22:47:05.667 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T22:47:05.834 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 121/143 2024-09-12T22:47:05.859 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T22:47:05.884 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T22:47:05.884 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:47:05.884 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T22:47:05.885 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T22:47:05.885 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T22:47:05.885 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:05.934 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T22:47:05.946 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T22:47:06.048 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-2:19.1.1-314.g086c737f.el9.x86_64 124/143 2024-09-12T22:47:06.109 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 125/143 2024-09-12T22:47:06.583 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T22:47:06.612 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T22:47:06.714 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T22:47:06.890 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 121/143 2024-09-12T22:47:06.922 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T22:47:06.947 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T22:47:06.947 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:47:06.947 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T22:47:06.948 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T22:47:06.948 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T22:47:06.948 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:07.006 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T22:47:07.019 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T22:47:07.044 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 130/143 2024-09-12T22:47:07.085 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 131/143 2024-09-12T22:47:07.105 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libtool-2.4.6-46.el9.x86_64 126/143 2024-09-12T22:47:07.115 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-2:19.1.1-314.g086c737f.el9.x86_64 124/143 2024-09-12T22:47:07.125 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 132/143 2024-09-12T22:47:07.137 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T22:47:07.158 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 133/143 2024-09-12T22:47:07.162 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T22:47:07.162 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:47:07.162 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T22:47:07.162 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T22:47:07.162 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T22:47:07.162 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:07.177 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 125/143 2024-09-12T22:47:07.184 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 134/143 2024-09-12T22:47:07.204 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T22:47:07.229 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T22:47:07.229 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:47:07.229 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T22:47:07.229 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:07.555 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T22:47:07.577 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 130/143 2024-09-12T22:47:07.579 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T22:47:07.579 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:47:07.580 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T22:47:07.580 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T22:47:07.580 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T22:47:07.580 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:07.619 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 131/143 2024-09-12T22:47:07.683 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 132/143 2024-09-12T22:47:07.716 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 133/143 2024-09-12T22:47:07.743 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 134/143 2024-09-12T22:47:08.018 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 135/143 2024-09-12T22:47:08.101 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libtool-2.4.6-46.el9.x86_64 126/143 2024-09-12T22:47:08.110 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 136/143 2024-09-12T22:47:08.134 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T22:47:08.158 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T22:47:08.158 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:47:08.159 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T22:47:08.159 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T22:47:08.159 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T22:47:08.159 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:08.171 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 137/143 2024-09-12T22:47:08.201 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T22:47:08.224 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T22:47:08.224 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:47:08.224 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T22:47:08.225 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:08.274 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flex-2.6.4-9.el9.x86_64 138/143 2024-09-12T22:47:08.305 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : bison-3.7.4-5.el9.x86_64 139/143 2024-09-12T22:47:08.355 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/143 2024-09-12T22:47:08.356 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T22:47:08.439 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T22:47:08.440 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T22:47:08.524 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T22:47:08.535 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T22:47:08.558 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T22:47:08.559 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:47:08.559 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T22:47:08.559 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T22:47:08.559 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T22:47:08.559 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:08.574 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 135/143 2024-09-12T22:47:08.588 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:47:08.677 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 136/143 2024-09-12T22:47:08.744 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 137/143 2024-09-12T22:47:08.837 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flex-2.6.4-9.el9.x86_64 138/143 2024-09-12T22:47:08.872 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : bison-3.7.4-5.el9.x86_64 139/143 2024-09-12T22:47:08.906 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/143 2024-09-12T22:47:08.906 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T22:47:08.999 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T22:47:08.999 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T22:47:09.090 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T22:47:09.156 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:47:12.419 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 130/143 2024-09-12T22:47:12.460 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 131/143 2024-09-12T22:47:12.501 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 132/143 2024-09-12T22:47:12.532 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 133/143 2024-09-12T22:47:12.559 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 134/143 2024-09-12T22:47:13.163 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 130/143 2024-09-12T22:47:13.221 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 131/143 2024-09-12T22:47:13.262 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 132/143 2024-09-12T22:47:13.294 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 133/143 2024-09-12T22:47:13.320 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 134/143 2024-09-12T22:47:13.469 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 135/143 2024-09-12T22:47:13.560 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 136/143 2024-09-12T22:47:13.618 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 137/143 2024-09-12T22:47:13.742 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flex-2.6.4-9.el9.x86_64 138/143 2024-09-12T22:47:13.771 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : bison-3.7.4-5.el9.x86_64 139/143 2024-09-12T22:47:13.805 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/143 2024-09-12T22:47:13.805 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T22:47:13.897 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T22:47:13.898 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T22:47:13.982 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T22:47:14.038 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:47:14.038 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-2:19.1.1-314.g086c737f.el9.x86_64 1/143 2024-09-12T22:47:14.039 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2/143 2024-09-12T22:47:14.039 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 3/143 2024-09-12T22:47:14.039 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 4/143 2024-09-12T22:47:14.039 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-314.g086c73 5/143 2024-09-12T22:47:14.039 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 6/143 2024-09-12T22:47:14.039 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 7/143 2024-09-12T22:47:14.039 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:47:14.039 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:47:14.039 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T22:47:14.039 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:47:14.040 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 12/143 2024-09-12T22:47:14.040 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 13/143 2024-09-12T22:47:14.040 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 14/143 2024-09-12T22:47:14.040 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 15/143 2024-09-12T22:47:14.040 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 16/143 2024-09-12T22:47:14.040 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 17/143 2024-09-12T22:47:14.040 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 18/143 2024-09-12T22:47:14.040 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 19/143 2024-09-12T22:47:14.040 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 20/143 2024-09-12T22:47:14.040 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 21/143 2024-09-12T22:47:14.040 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 22/143 2024-09-12T22:47:14.040 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 23/143 2024-09-12T22:47:14.041 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 24/143 2024-09-12T22:47:14.041 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 25/143 2024-09-12T22:47:14.041 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 26/143 2024-09-12T22:47:14.041 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 27/143 2024-09-12T22:47:14.041 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 28/143 2024-09-12T22:47:14.052 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 29/143 2024-09-12T22:47:14.052 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 30/143 2024-09-12T22:47:14.052 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 31/143 2024-09-12T22:47:14.052 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 32/143 2024-09-12T22:47:14.052 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 33/143 2024-09-12T22:47:14.052 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 34/143 2024-09-12T22:47:14.052 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 35/143 2024-09-12T22:47:14.052 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : cephadm-2:19.1.1-314.g086c737f.el9.noarch 36/143 2024-09-12T22:47:14.053 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 37/143 2024-09-12T22:47:14.053 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 38/143 2024-09-12T22:47:14.053 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 39/143 2024-09-12T22:47:14.053 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/143 2024-09-12T22:47:14.053 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/143 2024-09-12T22:47:14.053 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/143 2024-09-12T22:47:14.053 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/143 2024-09-12T22:47:14.054 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/143 2024-09-12T22:47:14.054 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 45/143 2024-09-12T22:47:14.054 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/143 2024-09-12T22:47:14.054 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/143 2024-09-12T22:47:14.054 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/143 2024-09-12T22:47:14.054 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 49/143 2024-09-12T22:47:14.054 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/143 2024-09-12T22:47:14.054 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/143 2024-09-12T22:47:14.054 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/143 2024-09-12T22:47:14.054 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/143 2024-09-12T22:47:14.055 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/143 2024-09-12T22:47:14.055 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/143 2024-09-12T22:47:14.055 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/143 2024-09-12T22:47:14.055 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/143 2024-09-12T22:47:14.055 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 58/143 2024-09-12T22:47:14.055 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 59/143 2024-09-12T22:47:14.055 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/143 2024-09-12T22:47:14.055 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/143 2024-09-12T22:47:14.055 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : lua-5.4.4-4.el9.x86_64 62/143 2024-09-12T22:47:14.055 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 63/143 2024-09-12T22:47:14.056 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 64/143 2024-09-12T22:47:14.056 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 65/143 2024-09-12T22:47:14.056 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 66/143 2024-09-12T22:47:14.056 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 67/143 2024-09-12T22:47:14.056 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 68/143 2024-09-12T22:47:14.056 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 69/143 2024-09-12T22:47:14.056 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 70/143 2024-09-12T22:47:14.056 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 71/143 2024-09-12T22:47:14.056 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 72/143 2024-09-12T22:47:14.057 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 73/143 2024-09-12T22:47:14.057 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 74/143 2024-09-12T22:47:14.057 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 75/143 2024-09-12T22:47:14.057 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 76/143 2024-09-12T22:47:14.057 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 77/143 2024-09-12T22:47:14.057 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 78/143 2024-09-12T22:47:14.057 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 79/143 2024-09-12T22:47:14.057 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 80/143 2024-09-12T22:47:14.057 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 81/143 2024-09-12T22:47:14.058 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 82/143 2024-09-12T22:47:14.058 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/143 2024-09-12T22:47:14.058 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 84/143 2024-09-12T22:47:14.058 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 85/143 2024-09-12T22:47:14.058 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 86/143 2024-09-12T22:47:14.058 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 87/143 2024-09-12T22:47:14.058 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 88/143 2024-09-12T22:47:14.058 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/143 2024-09-12T22:47:14.058 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 90/143 2024-09-12T22:47:14.058 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/143 2024-09-12T22:47:14.058 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 92/143 2024-09-12T22:47:14.058 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 93/143 2024-09-12T22:47:14.059 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 94/143 2024-09-12T22:47:14.059 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 95/143 2024-09-12T22:47:14.059 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 96/143 2024-09-12T22:47:14.059 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 97/143 2024-09-12T22:47:14.059 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 98/143 2024-09-12T22:47:14.059 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 99/143 2024-09-12T22:47:14.059 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/143 2024-09-12T22:47:14.059 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/143 2024-09-12T22:47:14.059 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 102/143 2024-09-12T22:47:14.059 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 103/143 2024-09-12T22:47:14.059 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 104/143 2024-09-12T22:47:14.059 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/143 2024-09-12T22:47:14.060 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/143 2024-09-12T22:47:14.060 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 107/143 2024-09-12T22:47:14.060 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/143 2024-09-12T22:47:14.060 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/143 2024-09-12T22:47:14.060 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 110/143 2024-09-12T22:47:14.060 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 111/143 2024-09-12T22:47:14.060 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 112/143 2024-09-12T22:47:14.060 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 113/143 2024-09-12T22:47:14.060 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 114/143 2024-09-12T22:47:14.060 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 115/143 2024-09-12T22:47:14.060 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 116/143 2024-09-12T22:47:14.060 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 117/143 2024-09-12T22:47:14.060 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/143 2024-09-12T22:47:14.061 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/143 2024-09-12T22:47:14.061 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/143 2024-09-12T22:47:14.061 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/143 2024-09-12T22:47:14.061 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/143 2024-09-12T22:47:14.061 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/143 2024-09-12T22:47:14.061 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/143 2024-09-12T22:47:14.061 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/143 2024-09-12T22:47:14.061 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/143 2024-09-12T22:47:14.061 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/143 2024-09-12T22:47:14.061 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/143 2024-09-12T22:47:14.061 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 129/143 2024-09-12T22:47:14.061 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 130/143 2024-09-12T22:47:14.062 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/143 2024-09-12T22:47:14.062 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/143 2024-09-12T22:47:14.062 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/143 2024-09-12T22:47:14.062 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : re2-1:20211101-20.el9.x86_64 134/143 2024-09-12T22:47:14.062 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/143 2024-09-12T22:47:14.062 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados2-2:19.1.1-314.g086c737f.el9.x86_64 136/143 2024-09-12T22:47:14.062 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/143 2024-09-12T22:47:14.062 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 138/143 2024-09-12T22:47:14.062 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/143 2024-09-12T22:47:14.062 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 140/143 2024-09-12T22:47:14.062 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 141/143 2024-09-12T22:47:14.062 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 142/143 2024-09-12T22:47:14.063 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:47:14.153 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 135/143 2024-09-12T22:47:14.246 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 136/143 2024-09-12T22:47:14.303 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 137/143 2024-09-12T22:47:14.402 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flex-2.6.4-9.el9.x86_64 138/143 2024-09-12T22:47:14.433 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : bison-3.7.4-5.el9.x86_64 139/143 2024-09-12T22:47:14.466 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/143 2024-09-12T22:47:14.467 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T22:47:14.550 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T22:47:14.551 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T22:47:14.581 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:47:14.581 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-2:19.1.1-314.g086c737f.el9.x86_64 1/143 2024-09-12T22:47:14.581 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2/143 2024-09-12T22:47:14.581 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 3/143 2024-09-12T22:47:14.581 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 4/143 2024-09-12T22:47:14.581 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-314.g086c73 5/143 2024-09-12T22:47:14.582 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 6/143 2024-09-12T22:47:14.582 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 7/143 2024-09-12T22:47:14.582 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:47:14.582 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:47:14.582 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T22:47:14.582 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:47:14.582 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 12/143 2024-09-12T22:47:14.582 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 13/143 2024-09-12T22:47:14.582 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 14/143 2024-09-12T22:47:14.582 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 15/143 2024-09-12T22:47:14.582 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 16/143 2024-09-12T22:47:14.582 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 17/143 2024-09-12T22:47:14.582 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 18/143 2024-09-12T22:47:14.582 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 19/143 2024-09-12T22:47:14.583 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 20/143 2024-09-12T22:47:14.583 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 21/143 2024-09-12T22:47:14.583 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 22/143 2024-09-12T22:47:14.583 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 23/143 2024-09-12T22:47:14.583 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 24/143 2024-09-12T22:47:14.583 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 25/143 2024-09-12T22:47:14.583 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 26/143 2024-09-12T22:47:14.583 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 27/143 2024-09-12T22:47:14.583 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 28/143 2024-09-12T22:47:14.583 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 29/143 2024-09-12T22:47:14.583 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 30/143 2024-09-12T22:47:14.583 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 31/143 2024-09-12T22:47:14.584 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 32/143 2024-09-12T22:47:14.584 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 33/143 2024-09-12T22:47:14.584 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 34/143 2024-09-12T22:47:14.584 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 35/143 2024-09-12T22:47:14.584 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephadm-2:19.1.1-314.g086c737f.el9.noarch 36/143 2024-09-12T22:47:14.584 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 37/143 2024-09-12T22:47:14.584 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 38/143 2024-09-12T22:47:14.584 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 39/143 2024-09-12T22:47:14.584 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/143 2024-09-12T22:47:14.584 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/143 2024-09-12T22:47:14.584 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/143 2024-09-12T22:47:14.584 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/143 2024-09-12T22:47:14.585 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/143 2024-09-12T22:47:14.585 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 45/143 2024-09-12T22:47:14.585 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/143 2024-09-12T22:47:14.585 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/143 2024-09-12T22:47:14.585 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/143 2024-09-12T22:47:14.585 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 49/143 2024-09-12T22:47:14.585 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/143 2024-09-12T22:47:14.585 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/143 2024-09-12T22:47:14.585 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/143 2024-09-12T22:47:14.585 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/143 2024-09-12T22:47:14.585 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/143 2024-09-12T22:47:14.585 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/143 2024-09-12T22:47:14.586 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/143 2024-09-12T22:47:14.586 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/143 2024-09-12T22:47:14.586 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 58/143 2024-09-12T22:47:14.586 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 59/143 2024-09-12T22:47:14.586 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/143 2024-09-12T22:47:14.586 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/143 2024-09-12T22:47:14.586 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lua-5.4.4-4.el9.x86_64 62/143 2024-09-12T22:47:14.586 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 63/143 2024-09-12T22:47:14.586 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 64/143 2024-09-12T22:47:14.586 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 65/143 2024-09-12T22:47:14.586 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 66/143 2024-09-12T22:47:14.586 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 67/143 2024-09-12T22:47:14.586 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 68/143 2024-09-12T22:47:14.587 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 69/143 2024-09-12T22:47:14.587 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 70/143 2024-09-12T22:47:14.587 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 71/143 2024-09-12T22:47:14.587 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 72/143 2024-09-12T22:47:14.587 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 73/143 2024-09-12T22:47:14.587 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 74/143 2024-09-12T22:47:14.587 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 75/143 2024-09-12T22:47:14.587 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 76/143 2024-09-12T22:47:14.587 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 77/143 2024-09-12T22:47:14.587 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 78/143 2024-09-12T22:47:14.587 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 79/143 2024-09-12T22:47:14.587 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 80/143 2024-09-12T22:47:14.587 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 81/143 2024-09-12T22:47:14.587 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 82/143 2024-09-12T22:47:14.588 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/143 2024-09-12T22:47:14.588 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 84/143 2024-09-12T22:47:14.588 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 85/143 2024-09-12T22:47:14.588 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 86/143 2024-09-12T22:47:14.588 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 87/143 2024-09-12T22:47:14.588 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 88/143 2024-09-12T22:47:14.588 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/143 2024-09-12T22:47:14.588 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 90/143 2024-09-12T22:47:14.588 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/143 2024-09-12T22:47:14.588 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 92/143 2024-09-12T22:47:14.588 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 93/143 2024-09-12T22:47:14.588 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 94/143 2024-09-12T22:47:14.589 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 95/143 2024-09-12T22:47:14.589 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 96/143 2024-09-12T22:47:14.589 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 97/143 2024-09-12T22:47:14.589 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 98/143 2024-09-12T22:47:14.589 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 99/143 2024-09-12T22:47:14.589 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/143 2024-09-12T22:47:14.589 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/143 2024-09-12T22:47:14.589 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 102/143 2024-09-12T22:47:14.589 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 103/143 2024-09-12T22:47:14.589 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 104/143 2024-09-12T22:47:14.589 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/143 2024-09-12T22:47:14.589 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/143 2024-09-12T22:47:14.589 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 107/143 2024-09-12T22:47:14.590 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/143 2024-09-12T22:47:14.590 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/143 2024-09-12T22:47:14.590 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 110/143 2024-09-12T22:47:14.590 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 111/143 2024-09-12T22:47:14.590 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 112/143 2024-09-12T22:47:14.590 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 113/143 2024-09-12T22:47:14.590 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 114/143 2024-09-12T22:47:14.590 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 115/143 2024-09-12T22:47:14.590 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 116/143 2024-09-12T22:47:14.590 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 117/143 2024-09-12T22:47:14.590 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/143 2024-09-12T22:47:14.590 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/143 2024-09-12T22:47:14.590 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/143 2024-09-12T22:47:14.591 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/143 2024-09-12T22:47:14.591 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/143 2024-09-12T22:47:14.591 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/143 2024-09-12T22:47:14.591 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/143 2024-09-12T22:47:14.591 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/143 2024-09-12T22:47:14.591 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/143 2024-09-12T22:47:14.591 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/143 2024-09-12T22:47:14.591 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/143 2024-09-12T22:47:14.591 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 129/143 2024-09-12T22:47:14.591 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 130/143 2024-09-12T22:47:14.591 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/143 2024-09-12T22:47:14.591 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/143 2024-09-12T22:47:14.591 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/143 2024-09-12T22:47:14.592 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : re2-1:20211101-20.el9.x86_64 134/143 2024-09-12T22:47:14.592 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/143 2024-09-12T22:47:14.592 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-2:19.1.1-314.g086c737f.el9.x86_64 136/143 2024-09-12T22:47:14.592 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/143 2024-09-12T22:47:14.592 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 138/143 2024-09-12T22:47:14.592 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/143 2024-09-12T22:47:14.592 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 140/143 2024-09-12T22:47:14.592 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 141/143 2024-09-12T22:47:14.592 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 142/143 2024-09-12T22:47:14.643 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T22:47:14.715 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:47:16.363 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:47:16.364 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:47:16.364 INFO:teuthology.orchestra.run.smithi087.stdout:Upgraded: 2024-09-12T22:47:16.364 INFO:teuthology.orchestra.run.smithi087.stdout: librados2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:16.364 INFO:teuthology.orchestra.run.smithi087.stdout: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:16.364 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T22:47:16.364 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T22:47:16.364 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-09-12T22:47:16.364 INFO:teuthology.orchestra.run.smithi087.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T22:47:16.364 INFO:teuthology.orchestra.run.smithi087.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T22:47:16.364 INFO:teuthology.orchestra.run.smithi087.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T22:47:16.364 INFO:teuthology.orchestra.run.smithi087.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T22:47:16.364 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:16.365 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:16.365 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:16.365 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:16.365 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-grafana-dashboards-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:47:16.365 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-immutable-object-cache-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:16.365 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:16.365 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:16.365 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:47:16.365 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:47:16.365 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:47:16.365 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:47:16.365 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:47:16.366 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:16.366 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:16.366 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:47:16.366 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:16.366 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:16.366 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:16.366 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:47:16.366 INFO:teuthology.orchestra.run.smithi087.stdout: cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:47:16.366 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T22:47:16.366 INFO:teuthology.orchestra.run.smithi087.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T22:47:16.366 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T22:47:16.366 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T22:47:16.366 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T22:47:16.367 INFO:teuthology.orchestra.run.smithi087.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T22:47:16.367 INFO:teuthology.orchestra.run.smithi087.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T22:47:16.367 INFO:teuthology.orchestra.run.smithi087.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T22:47:16.367 INFO:teuthology.orchestra.run.smithi087.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T22:47:16.367 INFO:teuthology.orchestra.run.smithi087.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T22:47:16.367 INFO:teuthology.orchestra.run.smithi087.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T22:47:16.367 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:16.367 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:16.367 INFO:teuthology.orchestra.run.smithi087.stdout: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:16.367 INFO:teuthology.orchestra.run.smithi087.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T22:47:16.367 INFO:teuthology.orchestra.run.smithi087.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T22:47:16.367 INFO:teuthology.orchestra.run.smithi087.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T22:47:16.367 INFO:teuthology.orchestra.run.smithi087.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T22:47:16.368 INFO:teuthology.orchestra.run.smithi087.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T22:47:16.368 INFO:teuthology.orchestra.run.smithi087.stdout: librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:16.368 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:16.368 INFO:teuthology.orchestra.run.smithi087.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T22:47:16.368 INFO:teuthology.orchestra.run.smithi087.stdout: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:16.368 INFO:teuthology.orchestra.run.smithi087.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T22:47:16.368 INFO:teuthology.orchestra.run.smithi087.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T22:47:16.368 INFO:teuthology.orchestra.run.smithi087.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T22:47:16.368 INFO:teuthology.orchestra.run.smithi087.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T22:47:16.368 INFO:teuthology.orchestra.run.smithi087.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T22:47:16.368 INFO:teuthology.orchestra.run.smithi087.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T22:47:16.368 INFO:teuthology.orchestra.run.smithi087.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T22:47:16.369 INFO:teuthology.orchestra.run.smithi087.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T22:47:16.369 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T22:47:16.369 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T22:47:16.369 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T22:47:16.369 INFO:teuthology.orchestra.run.smithi087.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T22:47:16.369 INFO:teuthology.orchestra.run.smithi087.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T22:47:16.369 INFO:teuthology.orchestra.run.smithi087.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T22:47:16.369 INFO:teuthology.orchestra.run.smithi087.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T22:47:16.369 INFO:teuthology.orchestra.run.smithi087.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T22:47:16.369 INFO:teuthology.orchestra.run.smithi087.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T22:47:16.369 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T22:47:16.369 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-argparse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:16.370 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:16.370 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:16.370 INFO:teuthology.orchestra.run.smithi087.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T22:47:16.370 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T22:47:16.370 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T22:47:16.370 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T22:47:16.370 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T22:47:16.370 INFO:teuthology.orchestra.run.smithi087.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T22:47:16.370 INFO:teuthology.orchestra.run.smithi087.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T22:47:16.370 INFO:teuthology.orchestra.run.smithi087.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T22:47:16.370 INFO:teuthology.orchestra.run.smithi087.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T22:47:16.370 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T22:47:16.370 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T22:47:16.371 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T22:47:16.371 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T22:47:16.371 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T22:47:16.371 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T22:47:16.371 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T22:47:16.371 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T22:47:16.371 INFO:teuthology.orchestra.run.smithi087.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T22:47:16.371 INFO:teuthology.orchestra.run.smithi087.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T22:47:16.371 INFO:teuthology.orchestra.run.smithi087.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T22:47:16.371 INFO:teuthology.orchestra.run.smithi087.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T22:47:16.371 INFO:teuthology.orchestra.run.smithi087.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T22:47:16.371 INFO:teuthology.orchestra.run.smithi087.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T22:47:16.371 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T22:47:16.371 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T22:47:16.372 INFO:teuthology.orchestra.run.smithi087.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T22:47:16.372 INFO:teuthology.orchestra.run.smithi087.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T22:47:16.372 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T22:47:16.372 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T22:47:16.372 INFO:teuthology.orchestra.run.smithi087.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T22:47:16.372 INFO:teuthology.orchestra.run.smithi087.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T22:47:16.372 INFO:teuthology.orchestra.run.smithi087.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T22:47:16.372 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T22:47:16.372 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T22:47:16.372 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T22:47:16.372 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T22:47:16.372 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T22:47:16.373 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:16.373 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:16.373 INFO:teuthology.orchestra.run.smithi087.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T22:47:16.373 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T22:47:16.373 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T22:47:16.373 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:16.373 INFO:teuthology.orchestra.run.smithi087.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T22:47:16.373 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T22:47:16.373 INFO:teuthology.orchestra.run.smithi087.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T22:47:16.373 INFO:teuthology.orchestra.run.smithi087.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T22:47:16.373 INFO:teuthology.orchestra.run.smithi087.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T22:47:16.373 INFO:teuthology.orchestra.run.smithi087.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T22:47:16.373 INFO:teuthology.orchestra.run.smithi087.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T22:47:16.374 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T22:47:16.374 INFO:teuthology.orchestra.run.smithi087.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T22:47:16.374 INFO:teuthology.orchestra.run.smithi087.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T22:47:16.374 INFO:teuthology.orchestra.run.smithi087.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T22:47:16.374 INFO:teuthology.orchestra.run.smithi087.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T22:47:16.374 INFO:teuthology.orchestra.run.smithi087.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T22:47:16.374 INFO:teuthology.orchestra.run.smithi087.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T22:47:16.374 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:16.374 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:16.374 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:16.374 INFO:teuthology.orchestra.run.smithi087.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T22:47:16.374 INFO:teuthology.orchestra.run.smithi087.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T22:47:16.374 INFO:teuthology.orchestra.run.smithi087.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T22:47:16.375 INFO:teuthology.orchestra.run.smithi087.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T22:47:16.375 INFO:teuthology.orchestra.run.smithi087.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T22:47:16.375 INFO:teuthology.orchestra.run.smithi087.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T22:47:16.375 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:47:16.375 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-09-12T22:47:16.706 DEBUG:teuthology.parallel:result is None 2024-09-12T22:47:17.056 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:47:17.056 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:47:17.056 INFO:teuthology.orchestra.run.smithi117.stdout:Upgraded: 2024-09-12T22:47:17.056 INFO:teuthology.orchestra.run.smithi117.stdout: librados2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:17.056 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:17.056 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T22:47:17.056 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T22:47:17.056 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-12T22:47:17.056 INFO:teuthology.orchestra.run.smithi117.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T22:47:17.056 INFO:teuthology.orchestra.run.smithi117.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T22:47:17.056 INFO:teuthology.orchestra.run.smithi117.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T22:47:17.057 INFO:teuthology.orchestra.run.smithi117.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T22:47:17.057 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:17.057 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:17.057 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:17.057 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:17.057 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:47:17.057 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:17.057 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:17.057 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:17.057 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:47:17.057 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:47:17.057 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:47:17.058 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:47:17.058 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:47:17.058 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:17.058 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:17.058 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:47:17.058 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:17.058 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:17.058 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:17.058 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:47:17.059 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:47:17.059 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T22:47:17.059 INFO:teuthology.orchestra.run.smithi117.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T22:47:17.059 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T22:47:17.059 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T22:47:17.060 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T22:47:17.060 INFO:teuthology.orchestra.run.smithi117.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T22:47:17.060 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T22:47:17.060 INFO:teuthology.orchestra.run.smithi117.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T22:47:17.060 INFO:teuthology.orchestra.run.smithi117.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T22:47:17.060 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T22:47:17.060 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T22:47:17.060 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:17.060 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:17.060 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:17.060 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T22:47:17.060 INFO:teuthology.orchestra.run.smithi117.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T22:47:17.061 INFO:teuthology.orchestra.run.smithi117.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T22:47:17.061 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T22:47:17.061 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T22:47:17.061 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:17.061 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:17.061 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T22:47:17.061 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:17.061 INFO:teuthology.orchestra.run.smithi117.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T22:47:17.061 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T22:47:17.061 INFO:teuthology.orchestra.run.smithi117.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T22:47:17.061 INFO:teuthology.orchestra.run.smithi117.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T22:47:17.061 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T22:47:17.062 INFO:teuthology.orchestra.run.smithi117.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T22:47:17.062 INFO:teuthology.orchestra.run.smithi117.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T22:47:17.062 INFO:teuthology.orchestra.run.smithi117.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T22:47:17.062 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T22:47:17.062 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T22:47:17.062 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T22:47:17.062 INFO:teuthology.orchestra.run.smithi117.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T22:47:17.062 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T22:47:17.062 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T22:47:17.062 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T22:47:17.062 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T22:47:17.062 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T22:47:17.062 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T22:47:17.063 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:17.063 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:17.063 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:17.063 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T22:47:17.063 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T22:47:17.063 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T22:47:17.063 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T22:47:17.063 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T22:47:17.063 INFO:teuthology.orchestra.run.smithi117.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T22:47:17.063 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T22:47:17.063 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T22:47:17.063 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T22:47:17.063 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T22:47:17.064 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T22:47:17.064 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T22:47:17.064 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T22:47:17.064 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T22:47:17.064 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T22:47:17.064 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T22:47:17.064 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T22:47:17.064 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T22:47:17.064 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T22:47:17.064 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T22:47:17.064 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T22:47:17.064 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T22:47:17.064 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T22:47:17.065 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T22:47:17.065 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T22:47:17.065 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T22:47:17.065 INFO:teuthology.orchestra.run.smithi117.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T22:47:17.065 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T22:47:17.065 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T22:47:17.065 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T22:47:17.065 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T22:47:17.065 INFO:teuthology.orchestra.run.smithi117.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T22:47:17.065 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T22:47:17.065 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T22:47:17.065 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T22:47:17.066 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T22:47:17.066 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T22:47:17.066 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:17.066 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:17.066 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T22:47:17.066 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T22:47:17.066 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T22:47:17.066 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:17.066 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T22:47:17.066 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T22:47:17.066 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T22:47:17.066 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T22:47:17.066 INFO:teuthology.orchestra.run.smithi117.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T22:47:17.067 INFO:teuthology.orchestra.run.smithi117.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T22:47:17.067 INFO:teuthology.orchestra.run.smithi117.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T22:47:17.067 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T22:47:17.067 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T22:47:17.067 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T22:47:17.067 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T22:47:17.067 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T22:47:17.067 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T22:47:17.067 INFO:teuthology.orchestra.run.smithi117.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T22:47:17.067 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:17.067 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:17.067 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:17.067 INFO:teuthology.orchestra.run.smithi117.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T22:47:17.068 INFO:teuthology.orchestra.run.smithi117.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T22:47:17.068 INFO:teuthology.orchestra.run.smithi117.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T22:47:17.068 INFO:teuthology.orchestra.run.smithi117.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T22:47:17.068 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T22:47:17.068 INFO:teuthology.orchestra.run.smithi117.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T22:47:17.068 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:47:17.068 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-12T22:47:17.384 DEBUG:teuthology.parallel:result is None 2024-09-12T22:47:19.174 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:47:19.175 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-2:19.1.1-314.g086c737f.el9.x86_64 1/143 2024-09-12T22:47:19.175 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2/143 2024-09-12T22:47:19.175 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 3/143 2024-09-12T22:47:19.175 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 4/143 2024-09-12T22:47:19.175 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-314.g086c73 5/143 2024-09-12T22:47:19.175 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 6/143 2024-09-12T22:47:19.175 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 7/143 2024-09-12T22:47:19.175 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:47:19.175 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:47:19.175 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T22:47:19.176 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:47:19.176 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 12/143 2024-09-12T22:47:19.176 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 13/143 2024-09-12T22:47:19.176 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 14/143 2024-09-12T22:47:19.176 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 15/143 2024-09-12T22:47:19.176 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 16/143 2024-09-12T22:47:19.176 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 17/143 2024-09-12T22:47:19.176 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 18/143 2024-09-12T22:47:19.176 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 19/143 2024-09-12T22:47:19.176 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 20/143 2024-09-12T22:47:19.176 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 21/143 2024-09-12T22:47:19.176 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 22/143 2024-09-12T22:47:19.176 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 23/143 2024-09-12T22:47:19.177 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 24/143 2024-09-12T22:47:19.177 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 25/143 2024-09-12T22:47:19.177 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 26/143 2024-09-12T22:47:19.177 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 27/143 2024-09-12T22:47:19.177 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 28/143 2024-09-12T22:47:19.177 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 29/143 2024-09-12T22:47:19.177 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 30/143 2024-09-12T22:47:19.177 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 31/143 2024-09-12T22:47:19.177 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 32/143 2024-09-12T22:47:19.177 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 33/143 2024-09-12T22:47:19.177 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 34/143 2024-09-12T22:47:19.177 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 35/143 2024-09-12T22:47:19.178 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : cephadm-2:19.1.1-314.g086c737f.el9.noarch 36/143 2024-09-12T22:47:19.178 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 37/143 2024-09-12T22:47:19.178 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 38/143 2024-09-12T22:47:19.178 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 39/143 2024-09-12T22:47:19.178 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/143 2024-09-12T22:47:19.178 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/143 2024-09-12T22:47:19.178 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/143 2024-09-12T22:47:19.178 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/143 2024-09-12T22:47:19.178 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/143 2024-09-12T22:47:19.178 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 45/143 2024-09-12T22:47:19.178 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/143 2024-09-12T22:47:19.178 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/143 2024-09-12T22:47:19.178 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/143 2024-09-12T22:47:19.178 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 49/143 2024-09-12T22:47:19.179 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/143 2024-09-12T22:47:19.179 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/143 2024-09-12T22:47:19.179 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/143 2024-09-12T22:47:19.179 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/143 2024-09-12T22:47:19.179 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/143 2024-09-12T22:47:19.179 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/143 2024-09-12T22:47:19.179 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/143 2024-09-12T22:47:19.179 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/143 2024-09-12T22:47:19.179 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 58/143 2024-09-12T22:47:19.179 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 59/143 2024-09-12T22:47:19.179 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/143 2024-09-12T22:47:19.179 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/143 2024-09-12T22:47:19.179 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : lua-5.4.4-4.el9.x86_64 62/143 2024-09-12T22:47:19.180 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 63/143 2024-09-12T22:47:19.180 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 64/143 2024-09-12T22:47:19.180 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 65/143 2024-09-12T22:47:19.180 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 66/143 2024-09-12T22:47:19.180 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 67/143 2024-09-12T22:47:19.180 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 68/143 2024-09-12T22:47:19.180 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 69/143 2024-09-12T22:47:19.180 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 70/143 2024-09-12T22:47:19.180 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 71/143 2024-09-12T22:47:19.180 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 72/143 2024-09-12T22:47:19.180 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 73/143 2024-09-12T22:47:19.180 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 74/143 2024-09-12T22:47:19.180 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 75/143 2024-09-12T22:47:19.181 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 76/143 2024-09-12T22:47:19.181 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 77/143 2024-09-12T22:47:19.181 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 78/143 2024-09-12T22:47:19.181 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 79/143 2024-09-12T22:47:19.181 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 80/143 2024-09-12T22:47:19.181 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 81/143 2024-09-12T22:47:19.181 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 82/143 2024-09-12T22:47:19.181 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/143 2024-09-12T22:47:19.181 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 84/143 2024-09-12T22:47:19.181 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 85/143 2024-09-12T22:47:19.181 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 86/143 2024-09-12T22:47:19.182 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 87/143 2024-09-12T22:47:19.182 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 88/143 2024-09-12T22:47:19.182 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/143 2024-09-12T22:47:19.182 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 90/143 2024-09-12T22:47:19.182 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/143 2024-09-12T22:47:19.182 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 92/143 2024-09-12T22:47:19.182 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 93/143 2024-09-12T22:47:19.182 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 94/143 2024-09-12T22:47:19.182 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 95/143 2024-09-12T22:47:19.182 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 96/143 2024-09-12T22:47:19.182 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 97/143 2024-09-12T22:47:19.183 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 98/143 2024-09-12T22:47:19.183 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 99/143 2024-09-12T22:47:19.183 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/143 2024-09-12T22:47:19.183 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/143 2024-09-12T22:47:19.183 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 102/143 2024-09-12T22:47:19.183 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 103/143 2024-09-12T22:47:19.183 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 104/143 2024-09-12T22:47:19.183 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/143 2024-09-12T22:47:19.183 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/143 2024-09-12T22:47:19.183 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 107/143 2024-09-12T22:47:19.183 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/143 2024-09-12T22:47:19.183 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/143 2024-09-12T22:47:19.183 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 110/143 2024-09-12T22:47:19.184 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 111/143 2024-09-12T22:47:19.184 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 112/143 2024-09-12T22:47:19.184 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 113/143 2024-09-12T22:47:19.184 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 114/143 2024-09-12T22:47:19.184 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 115/143 2024-09-12T22:47:19.184 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 116/143 2024-09-12T22:47:19.184 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 117/143 2024-09-12T22:47:19.184 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/143 2024-09-12T22:47:19.184 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/143 2024-09-12T22:47:19.184 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/143 2024-09-12T22:47:19.184 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/143 2024-09-12T22:47:19.185 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/143 2024-09-12T22:47:19.185 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/143 2024-09-12T22:47:19.185 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/143 2024-09-12T22:47:19.185 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/143 2024-09-12T22:47:19.185 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/143 2024-09-12T22:47:19.185 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/143 2024-09-12T22:47:19.185 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/143 2024-09-12T22:47:19.185 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 129/143 2024-09-12T22:47:19.185 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 130/143 2024-09-12T22:47:19.185 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/143 2024-09-12T22:47:19.185 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/143 2024-09-12T22:47:19.185 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/143 2024-09-12T22:47:19.185 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : re2-1:20211101-20.el9.x86_64 134/143 2024-09-12T22:47:19.185 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/143 2024-09-12T22:47:19.186 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librados2-2:19.1.1-314.g086c737f.el9.x86_64 136/143 2024-09-12T22:47:19.186 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/143 2024-09-12T22:47:19.186 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 138/143 2024-09-12T22:47:19.186 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/143 2024-09-12T22:47:19.186 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 140/143 2024-09-12T22:47:19.186 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 141/143 2024-09-12T22:47:19.186 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 142/143 2024-09-12T22:47:20.098 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:47:20.098 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-2:19.1.1-314.g086c737f.el9.x86_64 1/143 2024-09-12T22:47:20.098 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2/143 2024-09-12T22:47:20.098 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 3/143 2024-09-12T22:47:20.098 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 4/143 2024-09-12T22:47:20.098 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-314.g086c73 5/143 2024-09-12T22:47:20.098 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 6/143 2024-09-12T22:47:20.098 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 7/143 2024-09-12T22:47:20.098 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:47:20.099 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:47:20.099 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T22:47:20.099 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:47:20.099 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 12/143 2024-09-12T22:47:20.099 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 13/143 2024-09-12T22:47:20.099 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 14/143 2024-09-12T22:47:20.099 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 15/143 2024-09-12T22:47:20.099 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 16/143 2024-09-12T22:47:20.099 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 17/143 2024-09-12T22:47:20.099 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 18/143 2024-09-12T22:47:20.099 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 19/143 2024-09-12T22:47:20.099 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 20/143 2024-09-12T22:47:20.100 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 21/143 2024-09-12T22:47:20.100 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 22/143 2024-09-12T22:47:20.100 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 23/143 2024-09-12T22:47:20.100 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 24/143 2024-09-12T22:47:20.100 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 25/143 2024-09-12T22:47:20.100 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 26/143 2024-09-12T22:47:20.100 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 27/143 2024-09-12T22:47:20.100 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 28/143 2024-09-12T22:47:20.100 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 29/143 2024-09-12T22:47:20.110 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 30/143 2024-09-12T22:47:20.110 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 31/143 2024-09-12T22:47:20.110 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 32/143 2024-09-12T22:47:20.110 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 33/143 2024-09-12T22:47:20.111 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 34/143 2024-09-12T22:47:20.111 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 35/143 2024-09-12T22:47:20.111 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephadm-2:19.1.1-314.g086c737f.el9.noarch 36/143 2024-09-12T22:47:20.111 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 37/143 2024-09-12T22:47:20.111 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 38/143 2024-09-12T22:47:20.111 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 39/143 2024-09-12T22:47:20.111 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/143 2024-09-12T22:47:20.111 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/143 2024-09-12T22:47:20.111 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/143 2024-09-12T22:47:20.111 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/143 2024-09-12T22:47:20.111 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/143 2024-09-12T22:47:20.111 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 45/143 2024-09-12T22:47:20.112 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/143 2024-09-12T22:47:20.112 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/143 2024-09-12T22:47:20.112 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/143 2024-09-12T22:47:20.112 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 49/143 2024-09-12T22:47:20.112 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/143 2024-09-12T22:47:20.112 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/143 2024-09-12T22:47:20.112 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/143 2024-09-12T22:47:20.112 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/143 2024-09-12T22:47:20.112 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/143 2024-09-12T22:47:20.112 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/143 2024-09-12T22:47:20.112 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/143 2024-09-12T22:47:20.112 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/143 2024-09-12T22:47:20.113 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 58/143 2024-09-12T22:47:20.113 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 59/143 2024-09-12T22:47:20.113 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/143 2024-09-12T22:47:20.113 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/143 2024-09-12T22:47:20.113 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : lua-5.4.4-4.el9.x86_64 62/143 2024-09-12T22:47:20.113 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 63/143 2024-09-12T22:47:20.113 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 64/143 2024-09-12T22:47:20.113 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 65/143 2024-09-12T22:47:20.113 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 66/143 2024-09-12T22:47:20.113 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 67/143 2024-09-12T22:47:20.113 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 68/143 2024-09-12T22:47:20.113 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 69/143 2024-09-12T22:47:20.114 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 70/143 2024-09-12T22:47:20.114 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 71/143 2024-09-12T22:47:20.114 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 72/143 2024-09-12T22:47:20.114 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 73/143 2024-09-12T22:47:20.114 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 74/143 2024-09-12T22:47:20.114 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 75/143 2024-09-12T22:47:20.114 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 76/143 2024-09-12T22:47:20.114 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 77/143 2024-09-12T22:47:20.114 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 78/143 2024-09-12T22:47:20.114 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 79/143 2024-09-12T22:47:20.114 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 80/143 2024-09-12T22:47:20.114 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 81/143 2024-09-12T22:47:20.114 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 82/143 2024-09-12T22:47:20.115 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/143 2024-09-12T22:47:20.115 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 84/143 2024-09-12T22:47:20.115 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 85/143 2024-09-12T22:47:20.115 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 86/143 2024-09-12T22:47:20.115 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 87/143 2024-09-12T22:47:20.115 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 88/143 2024-09-12T22:47:20.115 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/143 2024-09-12T22:47:20.115 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 90/143 2024-09-12T22:47:20.115 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/143 2024-09-12T22:47:20.115 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 92/143 2024-09-12T22:47:20.115 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 93/143 2024-09-12T22:47:20.115 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 94/143 2024-09-12T22:47:20.115 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 95/143 2024-09-12T22:47:20.116 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 96/143 2024-09-12T22:47:20.116 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 97/143 2024-09-12T22:47:20.116 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 98/143 2024-09-12T22:47:20.116 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 99/143 2024-09-12T22:47:20.116 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/143 2024-09-12T22:47:20.116 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/143 2024-09-12T22:47:20.116 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 102/143 2024-09-12T22:47:20.116 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 103/143 2024-09-12T22:47:20.116 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 104/143 2024-09-12T22:47:20.116 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/143 2024-09-12T22:47:20.116 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/143 2024-09-12T22:47:20.116 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 107/143 2024-09-12T22:47:20.117 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/143 2024-09-12T22:47:20.117 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/143 2024-09-12T22:47:20.117 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 110/143 2024-09-12T22:47:20.117 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 111/143 2024-09-12T22:47:20.117 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 112/143 2024-09-12T22:47:20.117 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 113/143 2024-09-12T22:47:20.117 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 114/143 2024-09-12T22:47:20.117 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 115/143 2024-09-12T22:47:20.117 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 116/143 2024-09-12T22:47:20.117 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 117/143 2024-09-12T22:47:20.117 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/143 2024-09-12T22:47:20.117 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/143 2024-09-12T22:47:20.118 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/143 2024-09-12T22:47:20.118 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/143 2024-09-12T22:47:20.118 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/143 2024-09-12T22:47:20.118 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/143 2024-09-12T22:47:20.118 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/143 2024-09-12T22:47:20.118 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/143 2024-09-12T22:47:20.118 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/143 2024-09-12T22:47:20.118 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/143 2024-09-12T22:47:20.118 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/143 2024-09-12T22:47:20.118 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 129/143 2024-09-12T22:47:20.118 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 130/143 2024-09-12T22:47:20.118 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/143 2024-09-12T22:47:20.118 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/143 2024-09-12T22:47:20.119 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/143 2024-09-12T22:47:20.119 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : re2-1:20211101-20.el9.x86_64 134/143 2024-09-12T22:47:20.119 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/143 2024-09-12T22:47:20.119 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados2-2:19.1.1-314.g086c737f.el9.x86_64 136/143 2024-09-12T22:47:20.119 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/143 2024-09-12T22:47:20.119 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 138/143 2024-09-12T22:47:20.119 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/143 2024-09-12T22:47:20.119 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 140/143 2024-09-12T22:47:20.119 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 141/143 2024-09-12T22:47:20.119 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 142/143 2024-09-12T22:47:21.821 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:47:21.821 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:21.821 INFO:teuthology.orchestra.run.smithi066.stdout:Upgraded: 2024-09-12T22:47:21.821 INFO:teuthology.orchestra.run.smithi066.stdout: librados2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:21.822 INFO:teuthology.orchestra.run.smithi066.stdout: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:21.822 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T22:47:21.822 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T22:47:21.822 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2024-09-12T22:47:21.822 INFO:teuthology.orchestra.run.smithi066.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T22:47:21.822 INFO:teuthology.orchestra.run.smithi066.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T22:47:21.822 INFO:teuthology.orchestra.run.smithi066.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T22:47:21.822 INFO:teuthology.orchestra.run.smithi066.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T22:47:21.822 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:21.822 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:21.823 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:21.823 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:21.823 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-grafana-dashboards-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:47:21.823 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-immutable-object-cache-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:21.823 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:21.823 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:21.823 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:47:21.823 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:47:21.823 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:47:21.823 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:47:21.824 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:47:21.824 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:21.824 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:21.824 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:47:21.824 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:21.824 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:21.824 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:21.824 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:47:21.824 INFO:teuthology.orchestra.run.smithi066.stdout: cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:47:21.825 INFO:teuthology.orchestra.run.smithi066.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T22:47:21.825 INFO:teuthology.orchestra.run.smithi066.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T22:47:21.825 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T22:47:21.825 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T22:47:21.825 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T22:47:21.825 INFO:teuthology.orchestra.run.smithi066.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T22:47:21.825 INFO:teuthology.orchestra.run.smithi066.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T22:47:21.825 INFO:teuthology.orchestra.run.smithi066.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T22:47:21.825 INFO:teuthology.orchestra.run.smithi066.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T22:47:21.826 INFO:teuthology.orchestra.run.smithi066.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T22:47:21.826 INFO:teuthology.orchestra.run.smithi066.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T22:47:21.826 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:21.826 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:21.826 INFO:teuthology.orchestra.run.smithi066.stdout: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:21.826 INFO:teuthology.orchestra.run.smithi066.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T22:47:21.826 INFO:teuthology.orchestra.run.smithi066.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T22:47:21.826 INFO:teuthology.orchestra.run.smithi066.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T22:47:21.826 INFO:teuthology.orchestra.run.smithi066.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T22:47:21.827 INFO:teuthology.orchestra.run.smithi066.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T22:47:21.827 INFO:teuthology.orchestra.run.smithi066.stdout: librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:21.827 INFO:teuthology.orchestra.run.smithi066.stdout: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:21.827 INFO:teuthology.orchestra.run.smithi066.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T22:47:21.827 INFO:teuthology.orchestra.run.smithi066.stdout: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:21.827 INFO:teuthology.orchestra.run.smithi066.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T22:47:21.827 INFO:teuthology.orchestra.run.smithi066.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T22:47:21.827 INFO:teuthology.orchestra.run.smithi066.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T22:47:21.827 INFO:teuthology.orchestra.run.smithi066.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T22:47:21.827 INFO:teuthology.orchestra.run.smithi066.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T22:47:21.828 INFO:teuthology.orchestra.run.smithi066.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T22:47:21.828 INFO:teuthology.orchestra.run.smithi066.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T22:47:21.828 INFO:teuthology.orchestra.run.smithi066.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T22:47:21.828 INFO:teuthology.orchestra.run.smithi066.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T22:47:21.828 INFO:teuthology.orchestra.run.smithi066.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T22:47:21.828 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T22:47:21.828 INFO:teuthology.orchestra.run.smithi066.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T22:47:21.828 INFO:teuthology.orchestra.run.smithi066.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T22:47:21.828 INFO:teuthology.orchestra.run.smithi066.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T22:47:21.828 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T22:47:21.828 INFO:teuthology.orchestra.run.smithi066.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T22:47:21.828 INFO:teuthology.orchestra.run.smithi066.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T22:47:21.828 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T22:47:21.829 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-argparse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:21.829 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:21.829 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:21.829 INFO:teuthology.orchestra.run.smithi066.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T22:47:21.829 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T22:47:21.829 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T22:47:21.829 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T22:47:21.829 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T22:47:21.829 INFO:teuthology.orchestra.run.smithi066.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T22:47:21.829 INFO:teuthology.orchestra.run.smithi066.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T22:47:21.829 INFO:teuthology.orchestra.run.smithi066.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T22:47:21.829 INFO:teuthology.orchestra.run.smithi066.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T22:47:21.830 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T22:47:21.830 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T22:47:21.830 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T22:47:21.830 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T22:47:21.830 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T22:47:21.830 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T22:47:21.830 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T22:47:21.830 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T22:47:21.830 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T22:47:21.830 INFO:teuthology.orchestra.run.smithi066.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T22:47:21.830 INFO:teuthology.orchestra.run.smithi066.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T22:47:21.830 INFO:teuthology.orchestra.run.smithi066.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T22:47:21.830 INFO:teuthology.orchestra.run.smithi066.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T22:47:21.831 INFO:teuthology.orchestra.run.smithi066.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T22:47:21.831 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T22:47:21.831 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T22:47:21.831 INFO:teuthology.orchestra.run.smithi066.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T22:47:21.831 INFO:teuthology.orchestra.run.smithi066.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T22:47:21.831 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T22:47:21.831 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T22:47:21.831 INFO:teuthology.orchestra.run.smithi066.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T22:47:21.831 INFO:teuthology.orchestra.run.smithi066.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T22:47:21.831 INFO:teuthology.orchestra.run.smithi066.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T22:47:21.831 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T22:47:21.831 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T22:47:21.832 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T22:47:21.832 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T22:47:21.832 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T22:47:21.832 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:21.832 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:21.832 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T22:47:21.832 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T22:47:21.832 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T22:47:21.832 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:21.832 INFO:teuthology.orchestra.run.smithi066.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T22:47:21.832 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T22:47:21.832 INFO:teuthology.orchestra.run.smithi066.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T22:47:21.833 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T22:47:21.833 INFO:teuthology.orchestra.run.smithi066.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T22:47:21.833 INFO:teuthology.orchestra.run.smithi066.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T22:47:21.833 INFO:teuthology.orchestra.run.smithi066.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T22:47:21.833 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T22:47:21.833 INFO:teuthology.orchestra.run.smithi066.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T22:47:21.833 INFO:teuthology.orchestra.run.smithi066.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T22:47:21.833 INFO:teuthology.orchestra.run.smithi066.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T22:47:21.833 INFO:teuthology.orchestra.run.smithi066.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T22:47:21.833 INFO:teuthology.orchestra.run.smithi066.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T22:47:21.833 INFO:teuthology.orchestra.run.smithi066.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T22:47:21.833 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:21.834 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:21.834 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:21.834 INFO:teuthology.orchestra.run.smithi066.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T22:47:21.834 INFO:teuthology.orchestra.run.smithi066.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T22:47:21.834 INFO:teuthology.orchestra.run.smithi066.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T22:47:21.834 INFO:teuthology.orchestra.run.smithi066.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T22:47:21.834 INFO:teuthology.orchestra.run.smithi066.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T22:47:21.835 INFO:teuthology.orchestra.run.smithi066.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T22:47:21.835 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:21.835 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2024-09-12T22:47:22.192 DEBUG:teuthology.parallel:result is None 2024-09-12T22:47:22.489 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:47:22.489 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:22.489 INFO:teuthology.orchestra.run.smithi099.stdout:Upgraded: 2024-09-12T22:47:22.490 INFO:teuthology.orchestra.run.smithi099.stdout: librados2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:22.490 INFO:teuthology.orchestra.run.smithi099.stdout: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:22.490 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T22:47:22.490 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T22:47:22.490 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-12T22:47:22.490 INFO:teuthology.orchestra.run.smithi099.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T22:47:22.490 INFO:teuthology.orchestra.run.smithi099.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T22:47:22.490 INFO:teuthology.orchestra.run.smithi099.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T22:47:22.490 INFO:teuthology.orchestra.run.smithi099.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T22:47:22.490 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:22.490 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:22.490 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:22.491 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:22.491 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-grafana-dashboards-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:47:22.491 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-immutable-object-cache-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:22.491 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:22.491 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:22.491 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:47:22.491 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:47:22.491 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:47:22.491 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:47:22.491 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:47:22.491 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:22.491 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:22.492 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:47:22.492 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:22.492 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:22.492 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:22.492 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:47:22.492 INFO:teuthology.orchestra.run.smithi099.stdout: cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:47:22.492 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T22:47:22.492 INFO:teuthology.orchestra.run.smithi099.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T22:47:22.492 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T22:47:22.492 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T22:47:22.492 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T22:47:22.492 INFO:teuthology.orchestra.run.smithi099.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T22:47:22.493 INFO:teuthology.orchestra.run.smithi099.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T22:47:22.493 INFO:teuthology.orchestra.run.smithi099.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T22:47:22.493 INFO:teuthology.orchestra.run.smithi099.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T22:47:22.493 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T22:47:22.493 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T22:47:22.493 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:22.493 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:22.493 INFO:teuthology.orchestra.run.smithi099.stdout: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:22.493 INFO:teuthology.orchestra.run.smithi099.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T22:47:22.493 INFO:teuthology.orchestra.run.smithi099.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T22:47:22.493 INFO:teuthology.orchestra.run.smithi099.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T22:47:22.493 INFO:teuthology.orchestra.run.smithi099.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T22:47:22.493 INFO:teuthology.orchestra.run.smithi099.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T22:47:22.494 INFO:teuthology.orchestra.run.smithi099.stdout: librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:22.494 INFO:teuthology.orchestra.run.smithi099.stdout: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:22.494 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T22:47:22.494 INFO:teuthology.orchestra.run.smithi099.stdout: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:22.494 INFO:teuthology.orchestra.run.smithi099.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T22:47:22.494 INFO:teuthology.orchestra.run.smithi099.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T22:47:22.494 INFO:teuthology.orchestra.run.smithi099.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T22:47:22.494 INFO:teuthology.orchestra.run.smithi099.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T22:47:22.494 INFO:teuthology.orchestra.run.smithi099.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T22:47:22.494 INFO:teuthology.orchestra.run.smithi099.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T22:47:22.494 INFO:teuthology.orchestra.run.smithi099.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T22:47:22.494 INFO:teuthology.orchestra.run.smithi099.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T22:47:22.495 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T22:47:22.495 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T22:47:22.495 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T22:47:22.495 INFO:teuthology.orchestra.run.smithi099.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T22:47:22.495 INFO:teuthology.orchestra.run.smithi099.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T22:47:22.495 INFO:teuthology.orchestra.run.smithi099.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T22:47:22.495 INFO:teuthology.orchestra.run.smithi099.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T22:47:22.495 INFO:teuthology.orchestra.run.smithi099.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T22:47:22.495 INFO:teuthology.orchestra.run.smithi099.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T22:47:22.495 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T22:47:22.495 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:22.495 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:22.495 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:22.496 INFO:teuthology.orchestra.run.smithi099.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T22:47:22.496 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T22:47:22.496 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T22:47:22.496 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T22:47:22.496 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T22:47:22.496 INFO:teuthology.orchestra.run.smithi099.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T22:47:22.496 INFO:teuthology.orchestra.run.smithi099.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T22:47:22.496 INFO:teuthology.orchestra.run.smithi099.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T22:47:22.496 INFO:teuthology.orchestra.run.smithi099.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T22:47:22.496 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T22:47:22.496 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T22:47:22.496 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T22:47:22.497 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T22:47:22.497 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T22:47:22.497 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T22:47:22.497 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T22:47:22.497 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T22:47:22.497 INFO:teuthology.orchestra.run.smithi099.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T22:47:22.497 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T22:47:22.497 INFO:teuthology.orchestra.run.smithi099.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T22:47:22.497 INFO:teuthology.orchestra.run.smithi099.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T22:47:22.497 INFO:teuthology.orchestra.run.smithi099.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T22:47:22.497 INFO:teuthology.orchestra.run.smithi099.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T22:47:22.497 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T22:47:22.497 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T22:47:22.497 INFO:teuthology.orchestra.run.smithi099.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T22:47:22.498 INFO:teuthology.orchestra.run.smithi099.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T22:47:22.498 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T22:47:22.498 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T22:47:22.498 INFO:teuthology.orchestra.run.smithi099.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T22:47:22.498 INFO:teuthology.orchestra.run.smithi099.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T22:47:22.498 INFO:teuthology.orchestra.run.smithi099.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T22:47:22.498 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T22:47:22.498 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T22:47:22.498 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T22:47:22.498 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T22:47:22.498 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T22:47:22.499 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:22.499 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:22.499 INFO:teuthology.orchestra.run.smithi099.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T22:47:22.499 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T22:47:22.499 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T22:47:22.499 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:22.499 INFO:teuthology.orchestra.run.smithi099.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T22:47:22.499 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T22:47:22.499 INFO:teuthology.orchestra.run.smithi099.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T22:47:22.499 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T22:47:22.499 INFO:teuthology.orchestra.run.smithi099.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T22:47:22.499 INFO:teuthology.orchestra.run.smithi099.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T22:47:22.500 INFO:teuthology.orchestra.run.smithi099.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T22:47:22.500 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T22:47:22.500 INFO:teuthology.orchestra.run.smithi099.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T22:47:22.500 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T22:47:22.500 INFO:teuthology.orchestra.run.smithi099.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T22:47:22.500 INFO:teuthology.orchestra.run.smithi099.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T22:47:22.500 INFO:teuthology.orchestra.run.smithi099.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T22:47:22.500 INFO:teuthology.orchestra.run.smithi099.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T22:47:22.500 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:22.500 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:22.500 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:47:22.500 INFO:teuthology.orchestra.run.smithi099.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T22:47:22.500 INFO:teuthology.orchestra.run.smithi099.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T22:47:22.501 INFO:teuthology.orchestra.run.smithi099.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T22:47:22.501 INFO:teuthology.orchestra.run.smithi099.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T22:47:22.501 INFO:teuthology.orchestra.run.smithi099.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T22:47:22.501 INFO:teuthology.orchestra.run.smithi099.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T22:47:22.501 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:22.501 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-12T22:47:22.873 DEBUG:teuthology.parallel:result is None 2024-09-12T22:47:22.874 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T22:47:23.028 DEBUG:teuthology.orchestra.run.smithi066:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T22:47:23.056 INFO:teuthology.orchestra.run.smithi066.stdout:19.1.1-314.g086c737f.el9 2024-09-12T22:47:23.056 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-314.g086c737f.el9 2024-09-12T22:47:23.056 INFO:teuthology.task.install:The correct ceph version 19.1.1-314.g086c737f is installed. 2024-09-12T22:47:23.058 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T22:47:23.212 DEBUG:teuthology.orchestra.run.smithi087:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T22:47:23.238 INFO:teuthology.orchestra.run.smithi087.stdout:19.1.1-314.g086c737f.el9 2024-09-12T22:47:23.238 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-314.g086c737f.el9 2024-09-12T22:47:23.238 INFO:teuthology.task.install:The correct ceph version 19.1.1-314.g086c737f is installed. 2024-09-12T22:47:23.240 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T22:47:23.383 DEBUG:teuthology.orchestra.run.smithi099:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T22:47:23.407 INFO:teuthology.orchestra.run.smithi099.stdout:19.1.1-314.g086c737f.el9 2024-09-12T22:47:23.408 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-314.g086c737f.el9 2024-09-12T22:47:23.408 INFO:teuthology.task.install:The correct ceph version 19.1.1-314.g086c737f is installed. 2024-09-12T22:47:23.410 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T22:47:23.550 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T22:47:23.576 INFO:teuthology.orchestra.run.smithi117.stdout:19.1.1-314.g086c737f.el9 2024-09-12T22:47:23.576 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-314.g086c737f.el9 2024-09-12T22:47:23.576 INFO:teuthology.task.install:The correct ceph version 19.1.1-314.g086c737f is installed. 2024-09-12T22:47:23.578 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T22:47:23.578 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T22:47:23.578 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T22:47:23.613 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-12T22:47:23.613 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T22:47:23.645 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-12T22:47:23.645 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T22:47:23.676 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T22:47:23.676 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T22:47:23.707 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T22:47:23.707 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T22:47:23.707 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T22:47:23.737 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T22:47:23.806 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-12T22:47:23.806 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T22:47:23.835 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T22:47:23.903 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-12T22:47:23.903 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T22:47:23.932 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T22:47:24.000 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T22:47:24.000 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T22:47:24.029 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T22:47:24.097 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T22:47:24.098 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T22:47:24.098 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T22:47:24.127 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T22:47:24.195 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-12T22:47:24.195 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T22:47:24.224 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T22:47:24.293 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-12T22:47:24.293 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T22:47:24.322 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T22:47:24.391 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T22:47:24.392 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T22:47:24.421 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T22:47:24.489 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T22:47:24.489 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T22:47:24.489 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T22:47:24.519 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T22:47:24.588 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-12T22:47:24.588 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T22:47:24.618 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T22:47:24.687 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-12T22:47:24.688 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T22:47:24.718 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T22:47:24.786 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T22:47:24.787 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T22:47:24.816 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T22:47:24.884 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T22:47:24.965 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T22:47:24.965 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 777 /var/log/ceph 2024-09-12T22:47:24.968 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 777 /var/log/ceph 2024-09-12T22:47:24.971 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 777 /var/log/ceph 2024-09-12T22:47:24.973 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 777 /var/log/ceph 2024-09-12T22:47:25.001 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T22:47:25.001 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T22:47:25.040 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T22:47:25.044 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T22:47:25.047 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T22:47:25.073 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T22:47:25.074 DEBUG:teuthology.orchestra.run.smithi066:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T22:47:25.109 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T22:47:25.112 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T22:47:25.114 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T22:47:25.160 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T22:47:25.160 INFO:tasks.ceph:config {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T22:47:25.161 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902947', 'branch': 'squid', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-low-osd-mem-target powercycle/default supported-distros/centos_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7902947', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 8861, 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'sleep_before_teardown': 0, 'subset': '0/4', 'suite': 'powercycle', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_7741f7f9ee20524f89b8f61d1609b32fb3b1570a/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a', 'targets': {'smithi066.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBND3AKELtFZgbsicPHHPl+pBzZ5t6KLJAJaPjVt1YavtVTFUC1w1w3bNGbMzLMhEDQW5e+GLdVZo/4GcSPyVV94=', 'smithi087.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLY0O598sgj2QaBbZVXcsWUhTctoAKCadMxoeLPOzoCc5+czDAFi8IzMJq8ZcjO4CUl8DUO5kpiL3OcxJm6b2MY=', 'smithi099.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHSR6kESn9r1XT3XkPYI6pDDKwtDxElM31JZnidYDHjIk16WbNBjRjGv5/wf5RXr8lzkWbtrOoDmjPHvC0JPL+I=', 'smithi117.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGeN9g2t3xwkNP5cDW91tYFiIfak+O+567JekTaM/Cx6bZFfH/mY5nERG2GfEL2Z2gU1tbC1SYfbe8ruYymoRvI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-12_21:32:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T22:47:25.161 DEBUG:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T22:47:25.179 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T22:47:25.181 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T22:47:25.183 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T22:47:25.199 DEBUG:teuthology.orchestra.run.smithi066:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T22:47:25.236 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T22:47:25.238 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T22:47:25.241 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T22:47:25.267 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-12T22:47:25.267 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T22:47:25.321 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T22:47:25.321 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_1 2024-09-12T22:47:25.377 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T22:47:25.378 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:47:25.378 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-12T22:47:25.378 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:47:25.378 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:47:25.379 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-09-12 22:47:08.954249406 +0000 2024-09-12T22:47:25.379 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-09-12 22:45:20.659634333 +0000 2024-09-12T22:47:25.379 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-09-12 22:45:20.659634333 +0000 2024-09-12T22:47:25.379 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-09-12 22:45:20.659634333 +0000 2024-09-12T22:47:25.379 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T22:47:25.443 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-09-12T22:47:25.443 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-09-12T22:47:25.443 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.00021022 s, 2.4 MB/s 2024-09-12T22:47:25.444 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T22:47:25.501 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_2 2024-09-12T22:47:25.557 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T22:47:25.557 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:47:25.557 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-12T22:47:25.557 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:47:25.557 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:47:25.557 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-09-12 22:47:08.954249406 +0000 2024-09-12T22:47:25.557 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-09-12 22:45:20.982626592 +0000 2024-09-12T22:47:25.557 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-09-12 22:45:20.982626592 +0000 2024-09-12T22:47:25.557 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-09-12 22:45:20.982626592 +0000 2024-09-12T22:47:25.558 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T22:47:25.620 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-09-12T22:47:25.621 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-09-12T22:47:25.621 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000211025 s, 2.4 MB/s 2024-09-12T22:47:25.622 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T22:47:25.678 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_3 2024-09-12T22:47:25.734 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T22:47:25.734 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:47:25.734 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-12T22:47:25.735 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:47:25.735 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:47:25.735 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-09-12 22:47:08.955249382 +0000 2024-09-12T22:47:25.735 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-09-12 22:45:21.308618779 +0000 2024-09-12T22:47:25.735 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-09-12 22:45:21.308618779 +0000 2024-09-12T22:47:25.735 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-09-12 22:45:21.308618779 +0000 2024-09-12T22:47:25.736 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T22:47:25.798 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-09-12T22:47:25.838 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-09-12T22:47:25.838 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000215167 s, 2.4 MB/s 2024-09-12T22:47:25.839 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T22:47:25.913 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_4 2024-09-12T22:47:25.969 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T22:47:25.970 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:47:25.970 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-12T22:47:25.970 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:47:25.970 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:47:25.970 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-09-12 22:47:08.955249382 +0000 2024-09-12T22:47:25.970 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-09-12 22:45:21.620611301 +0000 2024-09-12T22:47:25.970 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-09-12 22:45:21.620611301 +0000 2024-09-12T22:47:25.970 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-09-12 22:45:21.620611301 +0000 2024-09-12T22:47:25.970 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T22:47:26.033 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-09-12T22:47:26.033 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-09-12T22:47:26.033 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000183762 s, 2.8 MB/s 2024-09-12T22:47:26.035 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T22:47:26.091 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-12T22:47:26.091 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-12T22:47:26.091 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T22:47:26.114 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T22:47:26.114 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_1 2024-09-12T22:47:26.173 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T22:47:26.173 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:47:26.173 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-12T22:47:26.173 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:47:26.173 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:47:26.173 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-12 22:47:15.063732616 +0000 2024-09-12T22:47:26.173 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-12 22:45:27.399154839 +0000 2024-09-12T22:47:26.173 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-12 22:45:27.399154839 +0000 2024-09-12T22:47:26.173 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-09-12 22:45:27.399154839 +0000 2024-09-12T22:47:26.173 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T22:47:26.242 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-12T22:47:26.242 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-12T22:47:26.242 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.00019902 s, 2.6 MB/s 2024-09-12T22:47:26.243 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T22:47:26.302 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_2 2024-09-12T22:47:26.360 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T22:47:26.360 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:47:26.360 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-12T22:47:26.360 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:47:26.361 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:47:26.361 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-12 22:47:15.064732591 +0000 2024-09-12T22:47:26.361 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-12 22:45:27.733146762 +0000 2024-09-12T22:47:26.361 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-12 22:45:27.733146762 +0000 2024-09-12T22:47:26.361 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-09-12 22:45:27.733146762 +0000 2024-09-12T22:47:26.361 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T22:47:26.425 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-12T22:47:26.425 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-12T22:47:26.425 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000224121 s, 2.3 MB/s 2024-09-12T22:47:26.427 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T22:47:26.485 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_3 2024-09-12T22:47:26.541 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T22:47:26.542 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:47:26.542 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-12T22:47:26.542 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:47:26.542 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:47:26.542 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-12 22:47:15.064732591 +0000 2024-09-12T22:47:26.542 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-12 22:45:28.054139001 +0000 2024-09-12T22:47:26.542 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-12 22:45:28.054139001 +0000 2024-09-12T22:47:26.542 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-09-12 22:45:28.054139001 +0000 2024-09-12T22:47:26.542 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T22:47:26.607 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-12T22:47:26.607 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-12T22:47:26.607 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000207838 s, 2.5 MB/s 2024-09-12T22:47:26.608 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T22:47:26.665 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_4 2024-09-12T22:47:26.721 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T22:47:26.721 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:47:26.721 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-12T22:47:26.721 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:47:26.722 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:47:26.722 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-12 22:47:15.064732591 +0000 2024-09-12T22:47:26.722 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-12 22:45:28.377131191 +0000 2024-09-12T22:47:26.722 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-12 22:45:28.377131191 +0000 2024-09-12T22:47:26.722 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-09-12 22:45:28.377131191 +0000 2024-09-12T22:47:26.722 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T22:47:26.786 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-12T22:47:26.787 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-12T22:47:26.787 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000260687 s, 2.0 MB/s 2024-09-12T22:47:26.788 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T22:47:26.846 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-09-12T22:47:26.846 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T22:47:26.846 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T22:47:26.866 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T22:47:26.866 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_1 2024-09-12T22:47:26.925 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T22:47:26.925 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:47:26.925 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-12T22:47:26.925 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:47:26.925 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:47:26.925 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-12 22:47:09.528719424 +0000 2024-09-12T22:47:26.925 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-12 22:45:20.674537568 +0000 2024-09-12T22:47:26.925 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-12 22:45:20.674537568 +0000 2024-09-12T22:47:26.925 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-12 22:45:20.674537568 +0000 2024-09-12T22:47:26.926 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T22:47:26.993 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-12T22:47:26.993 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-12T22:47:26.993 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000360587 s, 1.4 MB/s 2024-09-12T22:47:26.994 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T22:47:27.053 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_2 2024-09-12T22:47:27.111 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T22:47:27.111 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:47:27.111 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-12T22:47:27.111 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:47:27.111 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:47:27.111 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-12 22:47:09.529719405 +0000 2024-09-12T22:47:27.111 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-12 22:45:20.986531395 +0000 2024-09-12T22:47:27.111 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-12 22:45:20.986531395 +0000 2024-09-12T22:47:27.112 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-12 22:45:20.986531395 +0000 2024-09-12T22:47:27.112 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T22:47:27.176 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-12T22:47:27.176 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-12T22:47:27.176 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000222305 s, 2.3 MB/s 2024-09-12T22:47:27.178 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T22:47:27.235 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_3 2024-09-12T22:47:27.292 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T22:47:27.292 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:47:27.292 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-12T22:47:27.293 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:47:27.293 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:47:27.293 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-12 22:47:09.529719405 +0000 2024-09-12T22:47:27.293 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-12 22:45:21.311524965 +0000 2024-09-12T22:47:27.293 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-12 22:45:21.311524965 +0000 2024-09-12T22:47:27.293 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-12 22:45:21.311524965 +0000 2024-09-12T22:47:27.293 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T22:47:27.357 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-12T22:47:27.357 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-12T22:47:27.358 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000218612 s, 2.3 MB/s 2024-09-12T22:47:27.359 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T22:47:27.416 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_4 2024-09-12T22:47:27.472 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T22:47:27.472 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:47:27.472 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-12T22:47:27.472 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:47:27.472 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:47:27.472 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-12 22:47:09.529719405 +0000 2024-09-12T22:47:27.472 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-12 22:45:21.635518555 +0000 2024-09-12T22:47:27.473 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-12 22:45:21.635518555 +0000 2024-09-12T22:47:27.473 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-12 22:45:21.635518555 +0000 2024-09-12T22:47:27.473 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T22:47:27.536 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-12T22:47:27.536 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-12T22:47:27.536 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000197076 s, 2.6 MB/s 2024-09-12T22:47:27.538 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T22:47:27.595 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-09-12T22:47:27.595 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi087.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi099.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-09-12T22:47:27.595 INFO:tasks.ceph:Generating config... 2024-09-12T22:47:27.597 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T22:47:27.597 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T22:47:27.597 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T22:47:27.597 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T22:47:27.597 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T22:47:27.597 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T22:47:27.597 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T22:47:27.597 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T22:47:27.597 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T22:47:27.597 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T22:47:27.597 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T22:47:27.598 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T22:47:27.598 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T22:47:27.598 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T22:47:27.598 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T22:47:27.598 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T22:47:27.598 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T22:47:27.598 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-12T22:47:27.598 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T22:47:27.598 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-12T22:47:27.598 INFO:tasks.ceph:[osd] osd memory target = 1610612736 2024-09-12T22:47:27.598 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T22:47:27.598 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T22:47:27.599 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T22:47:27.669 INFO:teuthology.orchestra.run.smithi066.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T22:47:27.672 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T22:47:27.719 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T22:47:27.746 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.66'), ('mon.b', '[v2:172.21.15.66:3301,v1:172.21.15.66:6790]'), ('mon.c', '[v2:172.21.15.66:3302,v1:172.21.15.66:6791]')] 2024-09-12T22:47:27.748 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.66,[v2:172.21.15.66:3301,v1:172.21.15.66:6790],[v2:172.21.15.66:3302,v1:172.21.15.66:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}} 2024-09-12T22:47:27.749 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T22:47:27.749 DEBUG:teuthology.orchestra.run.smithi066:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T22:47:27.803 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.66 --addv b '[v2:172.21.15.66:3301,v1:172.21.15.66:6790]' --addv c '[v2:172.21.15.66:3302,v1:172.21.15.66:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:47:27.891 INFO:teuthology.orchestra.run.smithi066.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:47:27.891 INFO:teuthology.orchestra.run.smithi066.stdout:monmaptool: generated fsid 5714c6a5-034c-4330-a57b-d22492ad8e43 2024-09-12T22:47:27.891 INFO:teuthology.orchestra.run.smithi066.stdout:setting min_mon_release = quincy 2024-09-12T22:47:27.891 INFO:teuthology.orchestra.run.smithi066.stdout:epoch 0 2024-09-12T22:47:27.891 INFO:teuthology.orchestra.run.smithi066.stdout:fsid 5714c6a5-034c-4330-a57b-d22492ad8e43 2024-09-12T22:47:27.892 INFO:teuthology.orchestra.run.smithi066.stdout:last_changed 2024-09-12T22:47:27.891034+0000 2024-09-12T22:47:27.892 INFO:teuthology.orchestra.run.smithi066.stdout:created 2024-09-12T22:47:27.891034+0000 2024-09-12T22:47:27.892 INFO:teuthology.orchestra.run.smithi066.stdout:min_mon_release 17 (quincy) 2024-09-12T22:47:27.892 INFO:teuthology.orchestra.run.smithi066.stdout:election_strategy: 1 2024-09-12T22:47:27.892 INFO:teuthology.orchestra.run.smithi066.stdout:0: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.a 2024-09-12T22:47:27.892 INFO:teuthology.orchestra.run.smithi066.stdout:1: [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] mon.b 2024-09-12T22:47:27.892 INFO:teuthology.orchestra.run.smithi066.stdout:2: [v2:172.21.15.66:3302/0,v1:172.21.15.66:6791/0] mon.c 2024-09-12T22:47:27.892 INFO:teuthology.orchestra.run.smithi066.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T22:47:27.893 DEBUG:teuthology.orchestra.run.smithi066:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T22:47:27.909 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 5714c6a5-034c-4330-a57b-d22492ad8e43... 2024-09-12T22:47:27.910 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T22:47:27.954 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T22:47:27.956 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T22:47:27.959 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T22:47:27.996 INFO:teuthology.orchestra.run.smithi066.stdout:[global] 2024-09-12T22:47:27.996 INFO:teuthology.orchestra.run.smithi066.stdout: chdir = "" 2024-09-12T22:47:27.996 INFO:teuthology.orchestra.run.smithi066.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T22:47:27.996 INFO:teuthology.orchestra.run.smithi066.stdout: auth supported = cephx 2024-09-12T22:47:27.996 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:27.996 INFO:teuthology.orchestra.run.smithi066.stdout: filestore xattr use omap = true 2024-09-12T22:47:27.996 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:27.997 INFO:teuthology.orchestra.run.smithi066.stdout: mon clock drift allowed = 1.000 2024-09-12T22:47:27.997 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:27.997 INFO:teuthology.orchestra.run.smithi066.stdout: osd crush chooseleaf type = 0 2024-09-12T22:47:27.997 INFO:teuthology.orchestra.run.smithi066.stdout: auth debug = true 2024-09-12T22:47:27.997 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:27.997 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on old message = true 2024-09-12T22:47:27.997 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on bug = true 2024-09-12T22:47:27.997 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:27.997 INFO:teuthology.orchestra.run.smithi066.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T22:47:27.997 INFO:teuthology.orchestra.run.smithi066.stdout: mon pg warn max object skew = 0 2024-09-12T22:47:27.997 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:27.997 INFO:teuthology.orchestra.run.smithi066.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T22:47:27.998 INFO:teuthology.orchestra.run.smithi066.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T22:47:27.998 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:27.998 INFO:teuthology.orchestra.run.smithi066.stdout: osd pool default size = 2 2024-09-12T22:47:27.998 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:27.998 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd allow primary affinity = true 2024-09-12T22:47:27.998 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd allow pg remap = true 2024-09-12T22:47:27.998 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on legacy crush tunables = false 2024-09-12T22:47:27.998 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on crush straw calc version zero = false 2024-09-12T22:47:27.998 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on no sortbitwise = false 2024-09-12T22:47:27.998 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on osd down out interval zero = false 2024-09-12T22:47:27.998 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on too few osds = false 2024-09-12T22:47:27.998 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T22:47:27.999 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T22:47:27.999 INFO:teuthology.orchestra.run.smithi066.stdout: mon_allow_pool_size_one = true 2024-09-12T22:47:27.999 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:27.999 INFO:teuthology.orchestra.run.smithi066.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T22:47:27.999 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:27.999 INFO:teuthology.orchestra.run.smithi066.stdout: osd default data pool replay window = 5 2024-09-12T22:47:27.999 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:27.999 INFO:teuthology.orchestra.run.smithi066.stdout: mon allow pool delete = true 2024-09-12T22:47:27.999 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:27.999 INFO:teuthology.orchestra.run.smithi066.stdout: mon cluster log file level = debug 2024-09-12T22:47:27.999 INFO:teuthology.orchestra.run.smithi066.stdout: debug asserts on shutdown = true 2024-09-12T22:47:27.999 INFO:teuthology.orchestra.run.smithi066.stdout: mon health detail to clog = false 2024-09-12T22:47:27.999 INFO:teuthology.orchestra.run.smithi066.stdout: mon host = "172.21.15.66,[v2:172.21.15.66:3301,v1:172.21.15.66:6790],[v2:172.21.15.66:3302,v1:172.21.15.66:6791]" 2024-09-12T22:47:28.000 INFO:teuthology.orchestra.run.smithi066.stdout: fsid = 5714c6a5-034c-4330-a57b-d22492ad8e43 2024-09-12T22:47:28.000 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:28.000 INFO:teuthology.orchestra.run.smithi066.stdout:[osd] 2024-09-12T22:47:28.000 INFO:teuthology.orchestra.run.smithi066.stdout: osd journal size = 100 2024-09-12T22:47:28.000 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:28.000 INFO:teuthology.orchestra.run.smithi066.stdout: osd scrub load threshold = 5.0 2024-09-12T22:47:28.000 INFO:teuthology.orchestra.run.smithi066.stdout: osd scrub max interval = 600 2024-09-12T22:47:28.000 INFO:teuthology.orchestra.run.smithi066.stdout: osd mclock profile = high_recovery_ops 2024-09-12T22:47:28.000 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:28.000 INFO:teuthology.orchestra.run.smithi066.stdout: osd recover clone overlap = true 2024-09-12T22:47:28.000 INFO:teuthology.orchestra.run.smithi066.stdout: osd recovery max chunk = 1048576 2024-09-12T22:47:28.000 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:28.000 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug shutdown = true 2024-09-12T22:47:28.001 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug op order = true 2024-09-12T22:47:28.001 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug verify stray on activate = true 2024-09-12T22:47:28.001 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug trim objects = true 2024-09-12T22:47:28.001 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:28.001 INFO:teuthology.orchestra.run.smithi066.stdout: osd open classes on start = true 2024-09-12T22:47:28.001 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug pg log writeout = true 2024-09-12T22:47:28.001 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:28.001 INFO:teuthology.orchestra.run.smithi066.stdout: osd deep scrub update digest min age = 30 2024-09-12T22:47:28.001 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:28.001 INFO:teuthology.orchestra.run.smithi066.stdout: osd map max advance = 10 2024-09-12T22:47:28.001 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:28.001 INFO:teuthology.orchestra.run.smithi066.stdout: journal zero on create = true 2024-09-12T22:47:28.001 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:28.002 INFO:teuthology.orchestra.run.smithi066.stdout: filestore ondisk finisher threads = 3 2024-09-12T22:47:28.002 INFO:teuthology.orchestra.run.smithi066.stdout: filestore apply finisher threads = 3 2024-09-12T22:47:28.002 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:28.002 INFO:teuthology.orchestra.run.smithi066.stdout: bdev debug aio = true 2024-09-12T22:47:28.002 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug misdirected ops = true 2024-09-12T22:47:28.002 INFO:teuthology.orchestra.run.smithi066.stdout: bdev async discard = True 2024-09-12T22:47:28.002 INFO:teuthology.orchestra.run.smithi066.stdout: bdev enable discard = True 2024-09-12T22:47:28.002 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore block size = 96636764160 2024-09-12T22:47:28.002 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore fsck on mount = True 2024-09-12T22:47:28.002 INFO:teuthology.orchestra.run.smithi066.stdout: debug bluefs = 1/20 2024-09-12T22:47:28.002 INFO:teuthology.orchestra.run.smithi066.stdout: debug bluestore = 1/20 2024-09-12T22:47:28.002 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2024-09-12T22:47:28.002 INFO:teuthology.orchestra.run.smithi066.stdout: debug osd = 20 2024-09-12T22:47:28.003 INFO:teuthology.orchestra.run.smithi066.stdout: debug rocksdb = 4/10 2024-09-12T22:47:28.003 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T22:47:28.003 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd full ratio = 0.9 2024-09-12T22:47:28.003 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd nearfull ratio = 0.8 2024-09-12T22:47:28.003 INFO:teuthology.orchestra.run.smithi066.stdout: osd blocked scrub grace period = 3600 2024-09-12T22:47:28.003 INFO:teuthology.orchestra.run.smithi066.stdout: osd failsafe full ratio = 0.95 2024-09-12T22:47:28.003 INFO:teuthology.orchestra.run.smithi066.stdout: osd max markdown count = 1000 2024-09-12T22:47:28.003 INFO:teuthology.orchestra.run.smithi066.stdout: osd memory target = 1610612736 2024-09-12T22:47:28.003 INFO:teuthology.orchestra.run.smithi066.stdout: osd objectstore = bluestore 2024-09-12T22:47:28.003 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:28.003 INFO:teuthology.orchestra.run.smithi066.stdout:[mgr] 2024-09-12T22:47:28.003 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2024-09-12T22:47:28.003 INFO:teuthology.orchestra.run.smithi066.stdout: debug mgr = 20 2024-09-12T22:47:28.004 INFO:teuthology.orchestra.run.smithi066.stdout: debug mon = 20 2024-09-12T22:47:28.004 INFO:teuthology.orchestra.run.smithi066.stdout: debug auth = 20 2024-09-12T22:47:28.004 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min pgs per osd = 4 2024-09-12T22:47:28.004 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min bytes per osd = 10 2024-09-12T22:47:28.004 INFO:teuthology.orchestra.run.smithi066.stdout: mgr/telemetry/nag = false 2024-09-12T22:47:28.004 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:28.004 INFO:teuthology.orchestra.run.smithi066.stdout:[mon] 2024-09-12T22:47:28.004 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2024-09-12T22:47:28.004 INFO:teuthology.orchestra.run.smithi066.stdout: debug mon = 20 2024-09-12T22:47:28.004 INFO:teuthology.orchestra.run.smithi066.stdout: debug paxos = 20 2024-09-12T22:47:28.004 INFO:teuthology.orchestra.run.smithi066.stdout: debug auth = 20 2024-09-12T22:47:28.004 INFO:teuthology.orchestra.run.smithi066.stdout: mon data avail warn = 5 2024-09-12T22:47:28.004 INFO:teuthology.orchestra.run.smithi066.stdout: mon mgr mkfs grace = 240 2024-09-12T22:47:28.005 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min pgs per osd = 4 2024-09-12T22:47:28.005 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd reporter subtree level = osd 2024-09-12T22:47:28.005 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd prime pg temp = true 2024-09-12T22:47:28.005 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min bytes per osd = 10 2024-09-12T22:47:28.005 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:28.005 INFO:teuthology.orchestra.run.smithi066.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T22:47:28.005 INFO:teuthology.orchestra.run.smithi066.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T22:47:28.005 INFO:teuthology.orchestra.run.smithi066.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T22:47:28.005 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:28.005 INFO:teuthology.orchestra.run.smithi066.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T22:47:28.005 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T22:47:28.005 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T22:47:28.006 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:28.006 INFO:teuthology.orchestra.run.smithi066.stdout: # 1m isn't quite enough 2024-09-12T22:47:28.006 INFO:teuthology.orchestra.run.smithi066.stdout: mon_down_mkfs_grace = 2m 2024-09-12T22:47:28.006 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:28.006 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_filestore_osds = false 2024-09-12T22:47:28.006 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:28.006 INFO:teuthology.orchestra.run.smithi066.stdout:[client] 2024-09-12T22:47:28.006 INFO:teuthology.orchestra.run.smithi066.stdout: rgw cache enabled = true 2024-09-12T22:47:28.006 INFO:teuthology.orchestra.run.smithi066.stdout: rgw enable ops log = true 2024-09-12T22:47:28.006 INFO:teuthology.orchestra.run.smithi066.stdout: rgw enable usage log = true 2024-09-12T22:47:28.006 INFO:teuthology.orchestra.run.smithi066.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T22:47:28.006 INFO:teuthology.orchestra.run.smithi066.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T22:47:28.006 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.a] 2024-09-12T22:47:28.006 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.b] 2024-09-12T22:47:28.006 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.c] 2024-09-12T22:47:28.007 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.a] 2024-09-12T22:47:28.007 INFO:teuthology.orchestra.run.smithi099.stdout:[global] 2024-09-12T22:47:28.008 INFO:teuthology.orchestra.run.smithi099.stdout: chdir = "" 2024-09-12T22:47:28.008 INFO:teuthology.orchestra.run.smithi099.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T22:47:28.008 INFO:teuthology.orchestra.run.smithi099.stdout: auth supported = cephx 2024-09-12T22:47:28.008 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:28.008 INFO:teuthology.orchestra.run.smithi099.stdout: filestore xattr use omap = true 2024-09-12T22:47:28.008 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:28.008 INFO:teuthology.orchestra.run.smithi099.stdout: mon clock drift allowed = 1.000 2024-09-12T22:47:28.008 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:28.008 INFO:teuthology.orchestra.run.smithi099.stdout: osd crush chooseleaf type = 0 2024-09-12T22:47:28.008 INFO:teuthology.orchestra.run.smithi099.stdout: auth debug = true 2024-09-12T22:47:28.008 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:28.008 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on old message = true 2024-09-12T22:47:28.009 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on bug = true 2024-09-12T22:47:28.009 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:28.009 INFO:teuthology.orchestra.run.smithi099.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T22:47:28.009 INFO:teuthology.orchestra.run.smithi099.stdout: mon pg warn max object skew = 0 2024-09-12T22:47:28.009 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:28.009 INFO:teuthology.orchestra.run.smithi099.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T22:47:28.009 INFO:teuthology.orchestra.run.smithi099.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T22:47:28.009 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:28.009 INFO:teuthology.orchestra.run.smithi099.stdout: osd pool default size = 2 2024-09-12T22:47:28.009 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:28.009 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd allow primary affinity = true 2024-09-12T22:47:28.009 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd allow pg remap = true 2024-09-12T22:47:28.010 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on legacy crush tunables = false 2024-09-12T22:47:28.010 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on crush straw calc version zero = false 2024-09-12T22:47:28.010 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on no sortbitwise = false 2024-09-12T22:47:28.010 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on osd down out interval zero = false 2024-09-12T22:47:28.010 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on too few osds = false 2024-09-12T22:47:28.010 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T22:47:28.010 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T22:47:28.010 INFO:teuthology.orchestra.run.smithi099.stdout: mon_allow_pool_size_one = true 2024-09-12T22:47:28.010 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:28.010 INFO:teuthology.orchestra.run.smithi099.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T22:47:28.010 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:28.010 INFO:teuthology.orchestra.run.smithi099.stdout: osd default data pool replay window = 5 2024-09-12T22:47:28.011 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:28.011 INFO:teuthology.orchestra.run.smithi099.stdout: mon allow pool delete = true 2024-09-12T22:47:28.011 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:28.011 INFO:teuthology.orchestra.run.smithi099.stdout: mon cluster log file level = debug 2024-09-12T22:47:28.011 INFO:teuthology.orchestra.run.smithi099.stdout: debug asserts on shutdown = true 2024-09-12T22:47:28.011 INFO:teuthology.orchestra.run.smithi099.stdout: mon health detail to clog = false 2024-09-12T22:47:28.011 INFO:teuthology.orchestra.run.smithi099.stdout: mon host = "172.21.15.66,[v2:172.21.15.66:3301,v1:172.21.15.66:6790],[v2:172.21.15.66:3302,v1:172.21.15.66:6791]" 2024-09-12T22:47:28.011 INFO:teuthology.orchestra.run.smithi099.stdout: fsid = 5714c6a5-034c-4330-a57b-d22492ad8e43 2024-09-12T22:47:28.011 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:28.011 INFO:teuthology.orchestra.run.smithi099.stdout:[osd] 2024-09-12T22:47:28.011 INFO:teuthology.orchestra.run.smithi099.stdout: osd journal size = 100 2024-09-12T22:47:28.011 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:28.011 INFO:teuthology.orchestra.run.smithi099.stdout: osd scrub load threshold = 5.0 2024-09-12T22:47:28.011 INFO:teuthology.orchestra.run.smithi099.stdout: osd scrub max interval = 600 2024-09-12T22:47:28.012 INFO:teuthology.orchestra.run.smithi099.stdout: osd mclock profile = high_recovery_ops 2024-09-12T22:47:28.012 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:28.012 INFO:teuthology.orchestra.run.smithi099.stdout: osd recover clone overlap = true 2024-09-12T22:47:28.012 INFO:teuthology.orchestra.run.smithi099.stdout: osd recovery max chunk = 1048576 2024-09-12T22:47:28.012 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:28.012 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug shutdown = true 2024-09-12T22:47:28.012 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug op order = true 2024-09-12T22:47:28.012 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug verify stray on activate = true 2024-09-12T22:47:28.012 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug trim objects = true 2024-09-12T22:47:28.012 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:28.012 INFO:teuthology.orchestra.run.smithi099.stdout: osd open classes on start = true 2024-09-12T22:47:28.012 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug pg log writeout = true 2024-09-12T22:47:28.013 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:28.013 INFO:teuthology.orchestra.run.smithi099.stdout: osd deep scrub update digest min age = 30 2024-09-12T22:47:28.013 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:28.013 INFO:teuthology.orchestra.run.smithi099.stdout: osd map max advance = 10 2024-09-12T22:47:28.013 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:28.013 INFO:teuthology.orchestra.run.smithi099.stdout: journal zero on create = true 2024-09-12T22:47:28.013 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:28.013 INFO:teuthology.orchestra.run.smithi099.stdout: filestore ondisk finisher threads = 3 2024-09-12T22:47:28.013 INFO:teuthology.orchestra.run.smithi099.stdout: filestore apply finisher threads = 3 2024-09-12T22:47:28.013 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:28.013 INFO:teuthology.orchestra.run.smithi099.stdout: bdev debug aio = true 2024-09-12T22:47:28.013 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug misdirected ops = true 2024-09-12T22:47:28.013 INFO:teuthology.orchestra.run.smithi099.stdout: bdev async discard = True 2024-09-12T22:47:28.013 INFO:teuthology.orchestra.run.smithi099.stdout: bdev enable discard = True 2024-09-12T22:47:28.014 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore block size = 96636764160 2024-09-12T22:47:28.014 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore fsck on mount = True 2024-09-12T22:47:28.014 INFO:teuthology.orchestra.run.smithi099.stdout: debug bluefs = 1/20 2024-09-12T22:47:28.014 INFO:teuthology.orchestra.run.smithi099.stdout: debug bluestore = 1/20 2024-09-12T22:47:28.014 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-09-12T22:47:28.014 INFO:teuthology.orchestra.run.smithi099.stdout: debug osd = 20 2024-09-12T22:47:28.014 INFO:teuthology.orchestra.run.smithi099.stdout: debug rocksdb = 4/10 2024-09-12T22:47:28.014 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T22:47:28.014 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd full ratio = 0.9 2024-09-12T22:47:28.014 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd nearfull ratio = 0.8 2024-09-12T22:47:28.014 INFO:teuthology.orchestra.run.smithi099.stdout: osd blocked scrub grace period = 3600 2024-09-12T22:47:28.014 INFO:teuthology.orchestra.run.smithi099.stdout: osd failsafe full ratio = 0.95 2024-09-12T22:47:28.014 INFO:teuthology.orchestra.run.smithi099.stdout: osd max markdown count = 1000 2024-09-12T22:47:28.015 INFO:teuthology.orchestra.run.smithi099.stdout: osd memory target = 1610612736 2024-09-12T22:47:28.015 INFO:teuthology.orchestra.run.smithi099.stdout: osd objectstore = bluestore 2024-09-12T22:47:28.015 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:28.015 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr] 2024-09-12T22:47:28.015 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-09-12T22:47:28.015 INFO:teuthology.orchestra.run.smithi099.stdout: debug mgr = 20 2024-09-12T22:47:28.015 INFO:teuthology.orchestra.run.smithi099.stdout: debug mon = 20 2024-09-12T22:47:28.015 INFO:teuthology.orchestra.run.smithi099.stdout: debug auth = 20 2024-09-12T22:47:28.015 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min pgs per osd = 4 2024-09-12T22:47:28.015 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min bytes per osd = 10 2024-09-12T22:47:28.015 INFO:teuthology.orchestra.run.smithi099.stdout: mgr/telemetry/nag = false 2024-09-12T22:47:28.015 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:28.015 INFO:teuthology.orchestra.run.smithi099.stdout:[mon] 2024-09-12T22:47:28.016 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-09-12T22:47:28.016 INFO:teuthology.orchestra.run.smithi099.stdout: debug mon = 20 2024-09-12T22:47:28.016 INFO:teuthology.orchestra.run.smithi099.stdout: debug paxos = 20 2024-09-12T22:47:28.016 INFO:teuthology.orchestra.run.smithi099.stdout: debug auth = 20 2024-09-12T22:47:28.016 INFO:teuthology.orchestra.run.smithi099.stdout: mon data avail warn = 5 2024-09-12T22:47:28.016 INFO:teuthology.orchestra.run.smithi099.stdout: mon mgr mkfs grace = 240 2024-09-12T22:47:28.016 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min pgs per osd = 4 2024-09-12T22:47:28.016 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd reporter subtree level = osd 2024-09-12T22:47:28.016 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd prime pg temp = true 2024-09-12T22:47:28.016 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min bytes per osd = 10 2024-09-12T22:47:28.016 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:28.016 INFO:teuthology.orchestra.run.smithi099.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T22:47:28.017 INFO:teuthology.orchestra.run.smithi099.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T22:47:28.017 INFO:teuthology.orchestra.run.smithi099.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T22:47:28.017 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:28.017 INFO:teuthology.orchestra.run.smithi099.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T22:47:28.017 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T22:47:28.017 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T22:47:28.017 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:28.017 INFO:teuthology.orchestra.run.smithi099.stdout: # 1m isn't quite enough 2024-09-12T22:47:28.017 INFO:teuthology.orchestra.run.smithi099.stdout: mon_down_mkfs_grace = 2m 2024-09-12T22:47:28.017 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:28.017 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_filestore_osds = false 2024-09-12T22:47:28.017 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-12T22:47:28.017 INFO:teuthology.orchestra.run.smithi099.stdout:[client] 2024-09-12T22:47:28.017 INFO:teuthology.orchestra.run.smithi099.stdout: rgw cache enabled = true 2024-09-12T22:47:28.018 INFO:teuthology.orchestra.run.smithi099.stdout: rgw enable ops log = true 2024-09-12T22:47:28.018 INFO:teuthology.orchestra.run.smithi099.stdout: rgw enable usage log = true 2024-09-12T22:47:28.018 INFO:teuthology.orchestra.run.smithi099.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T22:47:28.018 INFO:teuthology.orchestra.run.smithi099.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T22:47:28.018 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.a] 2024-09-12T22:47:28.018 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.b] 2024-09-12T22:47:28.018 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.c] 2024-09-12T22:47:28.018 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.a] 2024-09-12T22:47:28.018 INFO:teuthology.orchestra.run.smithi117.stdout:[global] 2024-09-12T22:47:28.018 INFO:teuthology.orchestra.run.smithi117.stdout: chdir = "" 2024-09-12T22:47:28.018 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T22:47:28.018 INFO:teuthology.orchestra.run.smithi117.stdout: auth supported = cephx 2024-09-12T22:47:28.019 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:47:28.019 INFO:teuthology.orchestra.run.smithi117.stdout: filestore xattr use omap = true 2024-09-12T22:47:28.019 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:47:28.019 INFO:teuthology.orchestra.run.smithi117.stdout: mon clock drift allowed = 1.000 2024-09-12T22:47:28.019 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:47:28.019 INFO:teuthology.orchestra.run.smithi117.stdout: osd crush chooseleaf type = 0 2024-09-12T22:47:28.019 INFO:teuthology.orchestra.run.smithi117.stdout: auth debug = true 2024-09-12T22:47:28.019 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:47:28.019 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on old message = true 2024-09-12T22:47:28.019 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on bug = true 2024-09-12T22:47:28.019 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:47:28.020 INFO:teuthology.orchestra.run.smithi117.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T22:47:28.020 INFO:teuthology.orchestra.run.smithi117.stdout: mon pg warn max object skew = 0 2024-09-12T22:47:28.020 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:47:28.020 INFO:teuthology.orchestra.run.smithi117.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T22:47:28.020 INFO:teuthology.orchestra.run.smithi117.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T22:47:28.020 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:47:28.020 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default size = 2 2024-09-12T22:47:28.020 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:47:28.020 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow primary affinity = true 2024-09-12T22:47:28.020 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow pg remap = true 2024-09-12T22:47:28.020 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on legacy crush tunables = false 2024-09-12T22:47:28.020 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on crush straw calc version zero = false 2024-09-12T22:47:28.021 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on no sortbitwise = false 2024-09-12T22:47:28.021 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on osd down out interval zero = false 2024-09-12T22:47:28.021 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on too few osds = false 2024-09-12T22:47:28.021 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T22:47:28.021 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T22:47:28.021 INFO:teuthology.orchestra.run.smithi117.stdout: mon_allow_pool_size_one = true 2024-09-12T22:47:28.021 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:47:28.021 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T22:47:28.021 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:47:28.021 INFO:teuthology.orchestra.run.smithi117.stdout: osd default data pool replay window = 5 2024-09-12T22:47:28.021 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:47:28.021 INFO:teuthology.orchestra.run.smithi117.stdout: mon allow pool delete = true 2024-09-12T22:47:28.022 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:47:28.022 INFO:teuthology.orchestra.run.smithi117.stdout: mon cluster log file level = debug 2024-09-12T22:47:28.022 INFO:teuthology.orchestra.run.smithi117.stdout: debug asserts on shutdown = true 2024-09-12T22:47:28.022 INFO:teuthology.orchestra.run.smithi117.stdout: mon health detail to clog = false 2024-09-12T22:47:28.022 INFO:teuthology.orchestra.run.smithi117.stdout: mon host = "172.21.15.66,[v2:172.21.15.66:3301,v1:172.21.15.66:6790],[v2:172.21.15.66:3302,v1:172.21.15.66:6791]" 2024-09-12T22:47:28.022 INFO:teuthology.orchestra.run.smithi117.stdout: fsid = 5714c6a5-034c-4330-a57b-d22492ad8e43 2024-09-12T22:47:28.022 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:47:28.022 INFO:teuthology.orchestra.run.smithi117.stdout:[osd] 2024-09-12T22:47:28.022 INFO:teuthology.orchestra.run.smithi117.stdout: osd journal size = 100 2024-09-12T22:47:28.022 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:47:28.022 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub load threshold = 5.0 2024-09-12T22:47:28.022 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub max interval = 600 2024-09-12T22:47:28.022 INFO:teuthology.orchestra.run.smithi117.stdout: osd mclock profile = high_recovery_ops 2024-09-12T22:47:28.022 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:47:28.023 INFO:teuthology.orchestra.run.smithi117.stdout: osd recover clone overlap = true 2024-09-12T22:47:28.023 INFO:teuthology.orchestra.run.smithi117.stdout: osd recovery max chunk = 1048576 2024-09-12T22:47:28.023 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:47:28.023 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug shutdown = true 2024-09-12T22:47:28.023 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug op order = true 2024-09-12T22:47:28.023 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug verify stray on activate = true 2024-09-12T22:47:28.023 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug trim objects = true 2024-09-12T22:47:28.023 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:47:28.023 INFO:teuthology.orchestra.run.smithi117.stdout: osd open classes on start = true 2024-09-12T22:47:28.023 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug pg log writeout = true 2024-09-12T22:47:28.023 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:47:28.023 INFO:teuthology.orchestra.run.smithi117.stdout: osd deep scrub update digest min age = 30 2024-09-12T22:47:28.023 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:47:28.023 INFO:teuthology.orchestra.run.smithi117.stdout: osd map max advance = 10 2024-09-12T22:47:28.024 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:47:28.024 INFO:teuthology.orchestra.run.smithi117.stdout: journal zero on create = true 2024-09-12T22:47:28.024 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:47:28.024 INFO:teuthology.orchestra.run.smithi117.stdout: filestore ondisk finisher threads = 3 2024-09-12T22:47:28.024 INFO:teuthology.orchestra.run.smithi117.stdout: filestore apply finisher threads = 3 2024-09-12T22:47:28.024 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:47:28.024 INFO:teuthology.orchestra.run.smithi117.stdout: bdev debug aio = true 2024-09-12T22:47:28.024 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug misdirected ops = true 2024-09-12T22:47:28.024 INFO:teuthology.orchestra.run.smithi117.stdout: bdev async discard = True 2024-09-12T22:47:28.024 INFO:teuthology.orchestra.run.smithi117.stdout: bdev enable discard = True 2024-09-12T22:47:28.024 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore block size = 96636764160 2024-09-12T22:47:28.024 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore fsck on mount = True 2024-09-12T22:47:28.024 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluefs = 1/20 2024-09-12T22:47:28.024 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluestore = 1/20 2024-09-12T22:47:28.025 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-09-12T22:47:28.025 INFO:teuthology.orchestra.run.smithi117.stdout: debug osd = 20 2024-09-12T22:47:28.025 INFO:teuthology.orchestra.run.smithi117.stdout: debug rocksdb = 4/10 2024-09-12T22:47:28.025 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T22:47:28.025 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd full ratio = 0.9 2024-09-12T22:47:28.025 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd nearfull ratio = 0.8 2024-09-12T22:47:28.025 INFO:teuthology.orchestra.run.smithi117.stdout: osd blocked scrub grace period = 3600 2024-09-12T22:47:28.025 INFO:teuthology.orchestra.run.smithi117.stdout: osd failsafe full ratio = 0.95 2024-09-12T22:47:28.025 INFO:teuthology.orchestra.run.smithi117.stdout: osd max markdown count = 1000 2024-09-12T22:47:28.025 INFO:teuthology.orchestra.run.smithi117.stdout: osd memory target = 1610612736 2024-09-12T22:47:28.025 INFO:teuthology.orchestra.run.smithi117.stdout: osd objectstore = bluestore 2024-09-12T22:47:28.025 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:47:28.025 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr] 2024-09-12T22:47:28.026 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-09-12T22:47:28.026 INFO:teuthology.orchestra.run.smithi117.stdout: debug mgr = 20 2024-09-12T22:47:28.026 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-09-12T22:47:28.026 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-09-12T22:47:28.026 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-09-12T22:47:28.026 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-09-12T22:47:28.026 INFO:teuthology.orchestra.run.smithi117.stdout: mgr/telemetry/nag = false 2024-09-12T22:47:28.026 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:47:28.026 INFO:teuthology.orchestra.run.smithi117.stdout:[mon] 2024-09-12T22:47:28.026 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-09-12T22:47:28.026 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-09-12T22:47:28.026 INFO:teuthology.orchestra.run.smithi117.stdout: debug paxos = 20 2024-09-12T22:47:28.026 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-09-12T22:47:28.026 INFO:teuthology.orchestra.run.smithi117.stdout: mon data avail warn = 5 2024-09-12T22:47:28.026 INFO:teuthology.orchestra.run.smithi117.stdout: mon mgr mkfs grace = 240 2024-09-12T22:47:28.026 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-09-12T22:47:28.027 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd reporter subtree level = osd 2024-09-12T22:47:28.027 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd prime pg temp = true 2024-09-12T22:47:28.027 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-09-12T22:47:28.027 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:47:28.027 INFO:teuthology.orchestra.run.smithi117.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T22:47:28.027 INFO:teuthology.orchestra.run.smithi117.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T22:47:28.027 INFO:teuthology.orchestra.run.smithi117.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T22:47:28.027 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:47:28.027 INFO:teuthology.orchestra.run.smithi117.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T22:47:28.027 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T22:47:28.027 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T22:47:28.027 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:47:28.027 INFO:teuthology.orchestra.run.smithi117.stdout: # 1m isn't quite enough 2024-09-12T22:47:28.027 INFO:teuthology.orchestra.run.smithi117.stdout: mon_down_mkfs_grace = 2m 2024-09-12T22:47:28.028 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:47:28.028 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_filestore_osds = false 2024-09-12T22:47:28.028 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-12T22:47:28.028 INFO:teuthology.orchestra.run.smithi117.stdout:[client] 2024-09-12T22:47:28.028 INFO:teuthology.orchestra.run.smithi117.stdout: rgw cache enabled = true 2024-09-12T22:47:28.028 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable ops log = true 2024-09-12T22:47:28.028 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable usage log = true 2024-09-12T22:47:28.028 INFO:teuthology.orchestra.run.smithi117.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T22:47:28.028 INFO:teuthology.orchestra.run.smithi117.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T22:47:28.028 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.a] 2024-09-12T22:47:28.028 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.b] 2024-09-12T22:47:28.028 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.c] 2024-09-12T22:47:28.028 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.a] 2024-09-12T22:47:28.029 INFO:teuthology.orchestra.run.smithi087.stdout:[global] 2024-09-12T22:47:28.029 INFO:teuthology.orchestra.run.smithi087.stdout: chdir = "" 2024-09-12T22:47:28.029 INFO:teuthology.orchestra.run.smithi087.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T22:47:28.029 INFO:teuthology.orchestra.run.smithi087.stdout: auth supported = cephx 2024-09-12T22:47:28.029 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:47:28.029 INFO:teuthology.orchestra.run.smithi087.stdout: filestore xattr use omap = true 2024-09-12T22:47:28.029 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:47:28.029 INFO:teuthology.orchestra.run.smithi087.stdout: mon clock drift allowed = 1.000 2024-09-12T22:47:28.029 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:47:28.030 INFO:teuthology.orchestra.run.smithi087.stdout: osd crush chooseleaf type = 0 2024-09-12T22:47:28.030 INFO:teuthology.orchestra.run.smithi087.stdout: auth debug = true 2024-09-12T22:47:28.030 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:47:28.030 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on old message = true 2024-09-12T22:47:28.030 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on bug = true 2024-09-12T22:47:28.030 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:47:28.030 INFO:teuthology.orchestra.run.smithi087.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T22:47:28.030 INFO:teuthology.orchestra.run.smithi087.stdout: mon pg warn max object skew = 0 2024-09-12T22:47:28.030 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:47:28.030 INFO:teuthology.orchestra.run.smithi087.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T22:47:28.030 INFO:teuthology.orchestra.run.smithi087.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T22:47:28.030 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:47:28.031 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default size = 2 2024-09-12T22:47:28.031 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:47:28.031 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow primary affinity = true 2024-09-12T22:47:28.031 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow pg remap = true 2024-09-12T22:47:28.031 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on legacy crush tunables = false 2024-09-12T22:47:28.031 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on crush straw calc version zero = false 2024-09-12T22:47:28.031 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on no sortbitwise = false 2024-09-12T22:47:28.031 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on osd down out interval zero = false 2024-09-12T22:47:28.031 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on too few osds = false 2024-09-12T22:47:28.031 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T22:47:28.031 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T22:47:28.031 INFO:teuthology.orchestra.run.smithi087.stdout: mon_allow_pool_size_one = true 2024-09-12T22:47:28.031 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:47:28.031 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T22:47:28.032 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:47:28.032 INFO:teuthology.orchestra.run.smithi087.stdout: osd default data pool replay window = 5 2024-09-12T22:47:28.032 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:47:28.032 INFO:teuthology.orchestra.run.smithi087.stdout: mon allow pool delete = true 2024-09-12T22:47:28.032 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:47:28.032 INFO:teuthology.orchestra.run.smithi087.stdout: mon cluster log file level = debug 2024-09-12T22:47:28.032 INFO:teuthology.orchestra.run.smithi087.stdout: debug asserts on shutdown = true 2024-09-12T22:47:28.032 INFO:teuthology.orchestra.run.smithi087.stdout: mon health detail to clog = false 2024-09-12T22:47:28.032 INFO:teuthology.orchestra.run.smithi087.stdout: mon host = "172.21.15.66,[v2:172.21.15.66:3301,v1:172.21.15.66:6790],[v2:172.21.15.66:3302,v1:172.21.15.66:6791]" 2024-09-12T22:47:28.032 INFO:teuthology.orchestra.run.smithi087.stdout: fsid = 5714c6a5-034c-4330-a57b-d22492ad8e43 2024-09-12T22:47:28.032 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:47:28.032 INFO:teuthology.orchestra.run.smithi087.stdout:[osd] 2024-09-12T22:47:28.033 INFO:teuthology.orchestra.run.smithi087.stdout: osd journal size = 100 2024-09-12T22:47:28.033 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:47:28.033 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub load threshold = 5.0 2024-09-12T22:47:28.033 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub max interval = 600 2024-09-12T22:47:28.033 INFO:teuthology.orchestra.run.smithi087.stdout: osd mclock profile = high_recovery_ops 2024-09-12T22:47:28.033 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:47:28.033 INFO:teuthology.orchestra.run.smithi087.stdout: osd recover clone overlap = true 2024-09-12T22:47:28.033 INFO:teuthology.orchestra.run.smithi087.stdout: osd recovery max chunk = 1048576 2024-09-12T22:47:28.033 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:47:28.033 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug shutdown = true 2024-09-12T22:47:28.033 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug op order = true 2024-09-12T22:47:28.033 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug verify stray on activate = true 2024-09-12T22:47:28.033 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug trim objects = true 2024-09-12T22:47:28.034 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:47:28.034 INFO:teuthology.orchestra.run.smithi087.stdout: osd open classes on start = true 2024-09-12T22:47:28.034 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug pg log writeout = true 2024-09-12T22:47:28.034 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:47:28.034 INFO:teuthology.orchestra.run.smithi087.stdout: osd deep scrub update digest min age = 30 2024-09-12T22:47:28.034 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:47:28.034 INFO:teuthology.orchestra.run.smithi087.stdout: osd map max advance = 10 2024-09-12T22:47:28.034 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:47:28.034 INFO:teuthology.orchestra.run.smithi087.stdout: journal zero on create = true 2024-09-12T22:47:28.034 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:47:28.034 INFO:teuthology.orchestra.run.smithi087.stdout: filestore ondisk finisher threads = 3 2024-09-12T22:47:28.034 INFO:teuthology.orchestra.run.smithi087.stdout: filestore apply finisher threads = 3 2024-09-12T22:47:28.035 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:47:28.035 INFO:teuthology.orchestra.run.smithi087.stdout: bdev debug aio = true 2024-09-12T22:47:28.035 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug misdirected ops = true 2024-09-12T22:47:28.035 INFO:teuthology.orchestra.run.smithi087.stdout: bdev async discard = True 2024-09-12T22:47:28.035 INFO:teuthology.orchestra.run.smithi087.stdout: bdev enable discard = True 2024-09-12T22:47:28.035 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore block size = 96636764160 2024-09-12T22:47:28.035 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore fsck on mount = True 2024-09-12T22:47:28.035 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluefs = 1/20 2024-09-12T22:47:28.035 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluestore = 1/20 2024-09-12T22:47:28.035 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-09-12T22:47:28.035 INFO:teuthology.orchestra.run.smithi087.stdout: debug osd = 20 2024-09-12T22:47:28.035 INFO:teuthology.orchestra.run.smithi087.stdout: debug rocksdb = 4/10 2024-09-12T22:47:28.035 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T22:47:28.036 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd full ratio = 0.9 2024-09-12T22:47:28.036 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd nearfull ratio = 0.8 2024-09-12T22:47:28.036 INFO:teuthology.orchestra.run.smithi087.stdout: osd blocked scrub grace period = 3600 2024-09-12T22:47:28.036 INFO:teuthology.orchestra.run.smithi087.stdout: osd failsafe full ratio = 0.95 2024-09-12T22:47:28.036 INFO:teuthology.orchestra.run.smithi087.stdout: osd max markdown count = 1000 2024-09-12T22:47:28.036 INFO:teuthology.orchestra.run.smithi087.stdout: osd memory target = 1610612736 2024-09-12T22:47:28.036 INFO:teuthology.orchestra.run.smithi087.stdout: osd objectstore = bluestore 2024-09-12T22:47:28.036 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:47:28.036 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr] 2024-09-12T22:47:28.036 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-09-12T22:47:28.036 INFO:teuthology.orchestra.run.smithi087.stdout: debug mgr = 20 2024-09-12T22:47:28.037 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2024-09-12T22:47:28.037 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2024-09-12T22:47:28.037 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2024-09-12T22:47:28.037 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2024-09-12T22:47:28.037 INFO:teuthology.orchestra.run.smithi087.stdout: mgr/telemetry/nag = false 2024-09-12T22:47:28.037 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:47:28.037 INFO:teuthology.orchestra.run.smithi087.stdout:[mon] 2024-09-12T22:47:28.037 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-09-12T22:47:28.037 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2024-09-12T22:47:28.037 INFO:teuthology.orchestra.run.smithi087.stdout: debug paxos = 20 2024-09-12T22:47:28.037 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2024-09-12T22:47:28.037 INFO:teuthology.orchestra.run.smithi087.stdout: mon data avail warn = 5 2024-09-12T22:47:28.038 INFO:teuthology.orchestra.run.smithi087.stdout: mon mgr mkfs grace = 240 2024-09-12T22:47:28.038 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2024-09-12T22:47:28.038 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd reporter subtree level = osd 2024-09-12T22:47:28.038 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd prime pg temp = true 2024-09-12T22:47:28.038 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2024-09-12T22:47:28.038 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:47:28.038 INFO:teuthology.orchestra.run.smithi087.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T22:47:28.038 INFO:teuthology.orchestra.run.smithi087.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T22:47:28.038 INFO:teuthology.orchestra.run.smithi087.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T22:47:28.038 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:47:28.038 INFO:teuthology.orchestra.run.smithi087.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T22:47:28.038 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T22:47:28.038 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T22:47:28.039 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:47:28.039 INFO:teuthology.orchestra.run.smithi087.stdout: # 1m isn't quite enough 2024-09-12T22:47:28.039 INFO:teuthology.orchestra.run.smithi087.stdout: mon_down_mkfs_grace = 2m 2024-09-12T22:47:28.039 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:47:28.039 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_filestore_osds = false 2024-09-12T22:47:28.039 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-12T22:47:28.039 INFO:teuthology.orchestra.run.smithi087.stdout:[client] 2024-09-12T22:47:28.039 INFO:teuthology.orchestra.run.smithi087.stdout: rgw cache enabled = true 2024-09-12T22:47:28.039 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable ops log = true 2024-09-12T22:47:28.039 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable usage log = true 2024-09-12T22:47:28.039 INFO:teuthology.orchestra.run.smithi087.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T22:47:28.040 INFO:teuthology.orchestra.run.smithi087.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T22:47:28.040 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.a] 2024-09-12T22:47:28.040 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.b] 2024-09-12T22:47:28.040 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.c] 2024-09-12T22:47:28.040 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.a] 2024-09-12T22:47:28.042 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T22:47:28.043 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T22:47:28.138 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T22:47:28.138 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T22:47:28.138 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T22:47:28.154 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T22:47:28.154 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T22:47:28.210 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi066.front.sepia.ceph.com 2024-09-12T22:47:28.210 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T22:47:28.210 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T22:47:28.210 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T22:47:28.285 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T22:47:28.285 DEBUG:teuthology.orchestra.run.smithi066:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:47:28.341 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi087.front.sepia.ceph.com 2024-09-12T22:47:28.341 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-12T22:47:28.341 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T22:47:28.341 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T22:47:28.382 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-12T22:47:28.382 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:47:28.440 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi099.front.sepia.ceph.com 2024-09-12T22:47:28.441 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-12T22:47:28.441 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T22:47:28.441 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T22:47:28.482 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-12T22:47:28.482 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:47:28.540 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi117.front.sepia.ceph.com 2024-09-12T22:47:28.540 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T22:47:28.540 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T22:47:28.540 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T22:47:28.581 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T22:47:28.581 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:47:28.639 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T22:47:28.640 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T22:47:28.640 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T22:47:28.693 INFO:teuthology.orchestra.run.smithi066.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T22:47:28.696 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T22:47:28.748 INFO:teuthology.orchestra.run.smithi066.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T22:47:28.750 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T22:47:28.750 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-12T22:47:28.802 INFO:teuthology.orchestra.run.smithi066.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-12T22:47:28.805 DEBUG:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-12T22:47:28.831 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T22:47:28.831 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T22:47:28.913 INFO:teuthology.orchestra.run.smithi066.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T22:47:28.926 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T22:47:28.926 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi087.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi099.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-09-12T22:47:28.926 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T22:47:28.955 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-12T22:47:28.956 INFO:tasks.ceph:role: osd.0 2024-09-12T22:47:28.956 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi087.front.sepia.ceph.com 2024-09-12T22:47:28.956 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T22:47:29.032 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T22:47:29.032 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T22:47:29.032 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T22:47:29.033 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T22:47:29.033 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T22:47:29.033 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2024-09-12T22:47:29.033 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T22:47:29.033 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T22:47:29.033 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T22:47:29.033 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T22:47:29.536 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2024-09-12T22:47:29.538 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2024-09-12T22:47:29.538 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T22:47:29.654 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T22:47:29.688 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:47:29.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-12T22:47:29.788+0000 7fedc1a60640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T22:47:29.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-12T22:47:29.794+0000 7fedc1a60640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T22:47:29.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-12T22:47:29.794+0000 7fedc1a60640 -1 bdev(0x55c97c523800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T22:47:29.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-12T22:47:29.794+0000 7fedc1a60640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T22:47:33.464 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T22:47:33.494 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T22:47:33.524 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-09-12T22:47:33.524 INFO:tasks.ceph:role: osd.1 2024-09-12T22:47:33.524 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-12T22:47:33.524 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T22:47:33.600 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T22:47:33.601 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T22:47:33.601 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T22:47:33.601 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T22:47:33.601 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T22:47:33.601 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2024-09-12T22:47:33.601 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T22:47:33.601 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T22:47:33.601 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T22:47:33.601 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T22:47:34.109 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2024-09-12T22:47:34.111 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2024-09-12T22:47:34.111 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-12T22:47:34.231 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T22:47:34.268 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:47:34.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-12T22:47:34.387+0000 7fa1ee218640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T22:47:34.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-12T22:47:34.390+0000 7fa1ee218640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T22:47:34.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-12T22:47:34.390+0000 7fa1ee218640 -1 bdev(0x55d53462f800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T22:47:34.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-12T22:47:34.390+0000 7fa1ee218640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T22:47:38.040 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T22:47:38.072 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T22:47:38.102 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-09-12T22:47:38.102 INFO:tasks.ceph:role: osd.2 2024-09-12T22:47:38.102 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com 2024-09-12T22:47:38.102 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T22:47:38.177 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T22:47:38.177 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T22:47:38.177 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T22:47:38.177 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T22:47:38.177 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T22:47:38.177 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-09-12T22:47:38.177 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T22:47:38.178 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T22:47:38.178 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T22:47:38.178 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T22:47:38.668 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-09-12T22:47:38.670 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-09-12T22:47:38.670 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-12T22:47:38.783 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T22:47:38.816 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:47:38.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T22:47:38.919+0000 7f1945c1c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T22:47:38.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T22:47:38.925+0000 7f1945c1c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T22:47:38.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T22:47:38.925+0000 7f1945c1c640 -1 bdev(0x55fd1e219800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T22:47:38.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-12T22:47:38.925+0000 7f1945c1c640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T22:47:42.098 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T22:47:42.128 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T22:47:42.128 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T22:47:42.129 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T22:47:42.159 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T22:47:42.160 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T22:47:42.229 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T22:47:42.229 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-12T22:47:42.298 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-12T22:47:42.299 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T22:47:42.327 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-12T22:47:42.328 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T22:47:42.358 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T22:47:42.358 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T22:47:42.388 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T22:47:42.388 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T22:47:42.407 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T22:47:42.408 DEBUG:teuthology.orchestra.run.smithi066:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T22:47:42.477 INFO:teuthology.orchestra.run.smithi066.stdout:[mgr.x] 2024-09-12T22:47:42.477 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQCAb+Nm4ApZKRAAzIHsjHaX8mjpvcQDXNNmGQ== 2024-09-12T22:47:42.477 INFO:teuthology.orchestra.run.smithi066.stdout:[mgr.y] 2024-09-12T22:47:42.477 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQCAb+Nm3ZCULBAAnod24kap28oQffUCr30DZg== 2024-09-12T22:47:42.477 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.a] 2024-09-12T22:47:42.477 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQCAb+NmovXVLxAAS7CldOAFnsRM1UL62XywPg== 2024-09-12T22:47:42.477 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.0] 2024-09-12T22:47:42.477 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQCBb+NmvQ8QLxAAcCb8CGeiZ8GXyOmoAnL1tQ== 2024-09-12T22:47:42.477 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.1] 2024-09-12T22:47:42.477 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQCGb+Nm760gFxAAdPWgM1PZBNKoPld94v/Y6Q== 2024-09-12T22:47:42.478 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.2] 2024-09-12T22:47:42.478 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQCKb+NmudDdNhAA32x5L5CKBpf0RIrD8jaEXw== 2024-09-12T22:47:42.478 INFO:teuthology.orchestra.run.smithi066.stdout:[client.0] 2024-09-12T22:47:42.478 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQCAb+NmZ/RtNhAAetN96p/TZPsi+2BLyOMX7w== 2024-09-12T22:47:42.479 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T22:47:42.576 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T22:47:42.631 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T22:47:42.689 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T22:47:42.742 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T22:47:42.795 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T22:47:42.848 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T22:47:42.904 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T22:47:42.905 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T22:47:42.932 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T22:47:43.033 DEBUG:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T22:47:43.060 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T22:47:43.126 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T22:47:43.226 DEBUG:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T22:47:43.251 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T22:47:43.316 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T22:47:43.412 DEBUG:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T22:47:43.437 DEBUG:teuthology.orchestra.run.smithi066:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:47:43.493 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T22:47:43.494 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T22:47:43.494 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T22:47:43.536 INFO:tasks.ceph.mon.a:Started 2024-09-12T22:47:43.536 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T22:47:43.536 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T22:47:43.538 INFO:tasks.ceph.mon.b:Started 2024-09-12T22:47:43.538 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T22:47:43.539 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T22:47:43.541 INFO:tasks.ceph.mon.c:Started 2024-09-12T22:47:43.541 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T22:47:43.541 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T22:47:43.541 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T22:47:43.544 INFO:tasks.ceph.mgr.x:Started 2024-09-12T22:47:43.544 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T22:47:43.544 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T22:47:43.546 INFO:tasks.ceph.mgr.y:Started 2024-09-12T22:47:43.547 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T22:47:43.547 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T22:47:43.991 INFO:teuthology.orchestra.run.smithi066.stderr:adjusted tunables profile to default 2024-09-12T22:47:44.002 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T22:47:44.002 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T22:47:44.003 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-12T22:47:44.003 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T22:47:44.017 INFO:tasks.ceph.mgr.x.smithi066.stderr:2024-09-12T22:47:44.015+0000 7f4d92f8c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T22:47:44.033 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-12T22:47:44.033 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T22:47:44.059 INFO:tasks.ceph.mgr.x.smithi066.stderr:2024-09-12T22:47:44.057+0000 7f4d92f8c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T22:47:44.062 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-12T22:47:44.062 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T22:47:44.092 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 9ed48fb2-48c2-4ecb-9306-372a05b08cee 0 2024-09-12T22:47:44.203 INFO:tasks.ceph.mgr.x.smithi066.stderr:2024-09-12T22:47:44.201+0000 7f4d92f8c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T22:47:44.258 INFO:tasks.ceph.mgr.x.smithi066.stderr:2024-09-12T22:47:44.255+0000 7f4d92f8c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T22:47:44.322 INFO:teuthology.orchestra.run.smithi117.stdout:0 2024-09-12T22:47:44.333 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new af934313-a6b4-4e15-9818-6fc3fb71b949 1 2024-09-12T22:47:44.333 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-09-12T22:47:44.330+0000 7f8d44123040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T22:47:44.376 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-09-12T22:47:44.374+0000 7f8d44123040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T22:47:44.434 INFO:tasks.ceph.mgr.x.smithi066.stderr:2024-09-12T22:47:44.433+0000 7f4d92f8c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T22:47:44.508 INFO:teuthology.orchestra.run.smithi117.stdout:1 2024-09-12T22:47:44.517 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-09-12T22:47:44.515+0000 7f8d44123040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T22:47:44.519 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 185ee2bd-8c37-4de1-b6ef-2988144d1470 2 2024-09-12T22:47:44.552 INFO:tasks.ceph.mgr.x.smithi066.stderr:2024-09-12T22:47:44.550+0000 7f4d92f8c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T22:47:44.568 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-09-12T22:47:44.567+0000 7f8d44123040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T22:47:44.684 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-09-12T22:47:44.682+0000 7f8d44123040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T22:47:44.697 INFO:teuthology.orchestra.run.smithi117.stdout:2 2024-09-12T22:47:44.709 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T22:47:44.709 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T22:47:44.712 INFO:tasks.ceph.osd.0:Started 2024-09-12T22:47:44.713 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T22:47:44.713 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T22:47:44.715 INFO:tasks.ceph.osd.1:Started 2024-09-12T22:47:44.716 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T22:47:44.716 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T22:47:44.718 INFO:tasks.ceph.osd.2:Started 2024-09-12T22:47:44.719 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:47:44.785 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-09-12T22:47:44.783+0000 7f8d44123040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T22:47:44.890 INFO:tasks.ceph.mgr.x.smithi066.stderr:2024-09-12T22:47:44.888+0000 7f4d92f8c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T22:47:44.894 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:47:44.895 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":5,"fsid":"5714c6a5-034c-4330-a57b-d22492ad8e43","created":"2024-09-12T22:47:43.881551+0000","modified":"2024-09-12T22:47:44.690260+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T22:47:44.690260+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9ed48fb2-48c2-4ecb-9306-372a05b08cee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"af934313-a6b4-4e15-9818-6fc3fb71b949","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"185ee2bd-8c37-4de1-b6ef-2988144d1470","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:47:44.910 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T22:47:44.911 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T22:47:44.959 INFO:tasks.ceph.mgr.x.smithi066.stderr:2024-09-12T22:47:44.957+0000 7f4d92f8c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T22:47:45.074 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-09-12T22:47:45.072+0000 7f8d44123040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T22:47:45.116 INFO:tasks.ceph.mgr.x.smithi066.stderr:2024-09-12T22:47:45.115+0000 7f4d92f8c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T22:47:45.120 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-09-12T22:47:45.119+0000 7f8d44123040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T22:47:45.213 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T22:47:45.245 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-09-12T22:47:45.243+0000 7f8d44123040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T22:47:45.377 INFO:teuthology.misc.health.smithi066.stdout: 2024-09-12T22:47:45.377 INFO:teuthology.misc.health.smithi066.stdout:{"epoch":5,"fsid":"5714c6a5-034c-4330-a57b-d22492ad8e43","created":"2024-09-12T22:47:43.881551+0000","modified":"2024-09-12T22:47:44.690260+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T22:47:44.690260+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9ed48fb2-48c2-4ecb-9306-372a05b08cee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"af934313-a6b4-4e15-9818-6fc3fb71b949","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"185ee2bd-8c37-4de1-b6ef-2988144d1470","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:47:45.386 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-12T22:47:46.110 INFO:tasks.ceph.mgr.x.smithi066.stderr:2024-09-12T22:47:46.108+0000 7f4d92f8c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T22:47:46.110 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-09-12T22:47:46.108+0000 7f8d44123040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T22:47:46.166 INFO:tasks.ceph.mgr.x.smithi066.stderr:2024-09-12T22:47:46.164+0000 7f4d92f8c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T22:47:46.166 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-09-12T22:47:46.164+0000 7f8d44123040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T22:47:46.395 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:47:46.392+0000 7f9e4cc1c640 -1 Falling back to public interface 2024-09-12T22:47:46.557 INFO:tasks.ceph.mgr.x.smithi066.stderr:2024-09-12T22:47:46.555+0000 7f4d92f8c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T22:47:46.557 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-09-12T22:47:46.555+0000 7f8d44123040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T22:47:46.618 INFO:tasks.ceph.osd.2.smithi117.stderr:2024-09-12T22:47:46.616+0000 7f8e67a83640 -1 Falling back to public interface 2024-09-12T22:47:46.620 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:47:46.619+0000 7f4e8962e640 -1 Falling back to public interface 2024-09-12T22:47:46.647 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-09-12T22:47:46.645+0000 7f8d44123040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T22:47:46.647 INFO:tasks.ceph.mgr.x.smithi066.stderr:2024-09-12T22:47:46.645+0000 7f4d92f8c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T22:47:46.760 INFO:tasks.ceph.mgr.x.smithi066.stderr:2024-09-12T22:47:46.758+0000 7f4d92f8c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T22:47:46.760 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-09-12T22:47:46.758+0000 7f8d44123040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T22:47:46.809 INFO:tasks.ceph.mgr.x.smithi066.stderr:2024-09-12T22:47:46.807+0000 7f4d92f8c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T22:47:46.809 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-09-12T22:47:46.807+0000 7f8d44123040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T22:47:46.928 INFO:tasks.ceph.mgr.x.smithi066.stderr:2024-09-12T22:47:46.926+0000 7f4d92f8c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T22:47:46.928 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-09-12T22:47:46.926+0000 7f8d44123040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T22:47:46.984 INFO:tasks.ceph.mgr.x.smithi066.stderr:2024-09-12T22:47:46.982+0000 7f4d92f8c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T22:47:46.985 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-09-12T22:47:46.982+0000 7f8d44123040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T22:47:47.032 INFO:tasks.ceph.mgr.x.smithi066.stderr:2024-09-12T22:47:47.030+0000 7f4d92f8c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T22:47:47.032 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-09-12T22:47:47.030+0000 7f8d44123040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T22:47:47.150 INFO:tasks.ceph.mgr.x.smithi066.stderr:2024-09-12T22:47:47.148+0000 7f4d92f8c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T22:47:47.150 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-09-12T22:47:47.148+0000 7f8d44123040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T22:47:47.203 INFO:tasks.ceph.mgr.x.smithi066.stderr:2024-09-12T22:47:47.201+0000 7f4d92f8c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T22:47:47.204 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-09-12T22:47:47.201+0000 7f8d44123040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T22:47:47.257 INFO:tasks.ceph.mgr.x.smithi066.stderr:2024-09-12T22:47:47.255+0000 7f4d92f8c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T22:47:47.258 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-09-12T22:47:47.255+0000 7f8d44123040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T22:47:47.329 INFO:tasks.ceph.mgr.x.smithi066.stderr:2024-09-12T22:47:47.327+0000 7f4d92f8c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T22:47:47.329 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-09-12T22:47:47.327+0000 7f8d44123040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T22:47:47.377 INFO:tasks.ceph.mgr.x.smithi066.stderr:2024-09-12T22:47:47.374+0000 7f4d92f8c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T22:47:47.377 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-09-12T22:47:47.374+0000 7f8d44123040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T22:47:47.423 INFO:tasks.ceph.mgr.x.smithi066.stderr:2024-09-12T22:47:47.421+0000 7f4d92f8c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T22:47:47.423 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-09-12T22:47:47.421+0000 7f8d44123040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T22:47:48.116 INFO:tasks.ceph.mgr.y.smithi066.stderr:2024-09-12T22:47:48.114+0000 7f8d44123040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T22:47:48.117 INFO:tasks.ceph.mgr.x.smithi066.stderr:2024-09-12T22:47:48.114+0000 7f4d92f8c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T22:47:49.138 INFO:tasks.ceph.mgr.x.smithi066.stderr:2024-09-12T22:47:49.136+0000 7f4d33862640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T22:47:49.139 INFO:tasks.ceph.mgr.x.smithi066.stderr:2024-09-12T22:47:49.137+0000 7f4d33862640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T22:47:50.408 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:47:50.406+0000 7f9e4cc1c640 -1 osd.1 0 log_to_monitors true 2024-09-12T22:47:50.854 INFO:tasks.ceph.osd.2.smithi117.stderr:2024-09-12T22:47:50.852+0000 7f8e67a83640 -1 osd.2 0 log_to_monitors true 2024-09-12T22:47:50.860 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:47:50.856+0000 7f4e8962e640 -1 osd.0 0 log_to_monitors true 2024-09-12T22:47:51.690 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T22:47:51.982 INFO:teuthology.misc.health.smithi066.stdout: 2024-09-12T22:47:51.982 INFO:teuthology.misc.health.smithi066.stdout:{"epoch":6,"fsid":"5714c6a5-034c-4330-a57b-d22492ad8e43","created":"2024-09-12T22:47:43.881551+0000","modified":"2024-09-12T22:47:51.133917+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T22:47:44.690260+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9ed48fb2-48c2-4ecb-9306-372a05b08cee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"af934313-a6b4-4e15-9818-6fc3fb71b949","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"185ee2bd-8c37-4de1-b6ef-2988144d1470","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:47:51.993 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-12T22:47:53.011 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:47:53.010+0000 7f4e8544e640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T22:47:53.022 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:47:53.021+0000 7f4e7ca49640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T22:47:53.067 INFO:tasks.ceph.osd.2.smithi117.stderr:2024-09-12T22:47:53.065+0000 7f8e631ef640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T22:47:53.078 INFO:tasks.ceph.osd.2.smithi117.stderr:2024-09-12T22:47:53.076+0000 7f8e5b821640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T22:47:53.097 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:47:53.096+0000 7f9e47e37640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T22:47:53.111 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:47:53.110+0000 7f9e40469640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T22:47:58.296 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T22:47:58.589 INFO:teuthology.misc.health.smithi066.stdout: 2024-09-12T22:47:58.590 INFO:teuthology.misc.health.smithi066.stdout:{"epoch":11,"fsid":"5714c6a5-034c-4330-a57b-d22492ad8e43","created":"2024-09-12T22:47:43.881551+0000","modified":"2024-09-12T22:47:57.019540+0000","last_up_change":"2024-09-12T22:47:54.013185+0000","last_in_change":"2024-09-12T22:47:44.690260+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:47:54.168813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ed48fb2-48c2-4ecb-9306-372a05b08cee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6801","nonce":1747255146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6803","nonce":1747255146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6807","nonce":1747255146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6805","nonce":1747255146}]},"public_addr":"172.21.15.87:6801/1747255146","cluster_addr":"172.21.15.87:6803/1747255146","heartbeat_back_addr":"172.21.15.87:6807/1747255146","heartbeat_front_addr":"172.21.15.87:6805/1747255146","state":["exists","up"]},{"osd":1,"uuid":"af934313-a6b4-4e15-9818-6fc3fb71b949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6801","nonce":1159429503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6803","nonce":1159429503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6807","nonce":1159429503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6805","nonce":1159429503}]},"public_addr":"172.21.15.99:6801/1159429503","cluster_addr":"172.21.15.99:6803/1159429503","heartbeat_back_addr":"172.21.15.99:6807/1159429503","heartbeat_front_addr":"172.21.15.99:6805/1159429503","state":["exists","up"]},{"osd":2,"uuid":"185ee2bd-8c37-4de1-b6ef-2988144d1470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2828388397},{"type":"v1","addr":"172.21.15.117:6801","nonce":2828388397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2828388397},{"type":"v1","addr":"172.21.15.117:6803","nonce":2828388397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2828388397},{"type":"v1","addr":"172.21.15.117:6807","nonce":2828388397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2828388397},{"type":"v1","addr":"172.21.15.117:6805","nonce":2828388397}]},"public_addr":"172.21.15.117:6801/2828388397","cluster_addr":"172.21.15.117:6803/2828388397","heartbeat_back_addr":"172.21.15.117:6807/2828388397","heartbeat_front_addr":"172.21.15.117:6805/2828388397","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:47:51.816709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:47:51.376989+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:47:51.833489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:47:58.601 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-09-12T22:47:58.601 INFO:tasks.ceph:Creating RBD pool 2024-09-12T22:47:58.602 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T22:47:59.041 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'rbd' created 2024-09-12T22:47:59.054 DEBUG:teuthology.orchestra.run.smithi066:> rbd --cluster ceph pool init rbd 2024-09-12T22:48:02.058 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T22:48:02.059 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T22:48:02.059 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T22:48:02.061 INFO:tasks.ceph.mds.a:Started 2024-09-12T22:48:02.061 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-12T22:48:02.062 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T22:48:02.146 INFO:tasks.ceph.mds.a.smithi066.stdout:starting mds.a at 2024-09-12T22:48:02.398 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:48:02.398 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":2,"btime":"2024-09-12T22:48:02:149077+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6803/2680642428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2680642428},{"type":"v1","addr":"172.21.15.66:6803","nonce":2680642428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T22:48:02.398 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 2 2024-09-12T22:48:02.411 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T22:48:02.699 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:48:02.699 INFO:teuthology.orchestra.run.smithi066.stdout:[ 2024-09-12T22:48:02.699 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-12T22:48:02.699 INFO:teuthology.orchestra.run.smithi066.stdout: "poolnum": 1, 2024-09-12T22:48:02.699 INFO:teuthology.orchestra.run.smithi066.stdout: "poolname": ".mgr" 2024-09-12T22:48:02.699 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:02.699 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-12T22:48:02.699 INFO:teuthology.orchestra.run.smithi066.stdout: "poolnum": 2, 2024-09-12T22:48:02.699 INFO:teuthology.orchestra.run.smithi066.stdout: "poolname": "rbd" 2024-09-12T22:48:02.700 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T22:48:02.700 INFO:teuthology.orchestra.run.smithi066.stdout:] 2024-09-12T22:48:02.711 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T22:48:02.712 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T22:48:03.151 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_metadata' created 2024-09-12T22:48:03.165 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T22:48:04.162 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_data' created 2024-09-12T22:48:04.177 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T22:48:05.163 INFO:teuthology.orchestra.run.smithi066.stderr:new fs with metadata pool 3 and data pool 4 2024-09-12T22:48:05.182 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:48:05.475 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:48:05.475 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":18,"fsid":"5714c6a5-034c-4330-a57b-d22492ad8e43","created":"2024-09-12T22:47:43.881551+0000","modified":"2024-09-12T22:48:04.509147+0000","last_up_change":"2024-09-12T22:47:54.013185+0000","last_in_change":"2024-09-12T22:47:44.690260+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:47:54.168813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:47:58.920007+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:48:03.033410+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:48:03.489928+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ed48fb2-48c2-4ecb-9306-372a05b08cee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6801","nonce":1747255146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6803","nonce":1747255146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6807","nonce":1747255146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6805","nonce":1747255146}]},"public_addr":"172.21.15.87:6801/1747255146","cluster_addr":"172.21.15.87:6803/1747255146","heartbeat_back_addr":"172.21.15.87:6807/1747255146","heartbeat_front_addr":"172.21.15.87:6805/1747255146","state":["exists","up"]},{"osd":1,"uuid":"af934313-a6b4-4e15-9818-6fc3fb71b949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6801","nonce":1159429503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6803","nonce":1159429503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6807","nonce":1159429503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6805","nonce":1159429503}]},"public_addr":"172.21.15.99:6801/1159429503","cluster_addr":"172.21.15.99:6803/1159429503","heartbeat_back_addr":"172.21.15.99:6807/1159429503","heartbeat_front_addr":"172.21.15.99:6805/1159429503","state":["exists","up"]},{"osd":2,"uuid":"185ee2bd-8c37-4de1-b6ef-2988144d1470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2828388397},{"type":"v1","addr":"172.21.15.117:6801","nonce":2828388397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2828388397},{"type":"v1","addr":"172.21.15.117:6803","nonce":2828388397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2828388397},{"type":"v1","addr":"172.21.15.117:6807","nonce":2828388397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2828388397},{"type":"v1","addr":"172.21.15.117:6805","nonce":2828388397}]},"public_addr":"172.21.15.117:6801/2828388397","cluster_addr":"172.21.15.117:6803/2828388397","heartbeat_back_addr":"172.21.15.117:6807/2828388397","heartbeat_front_addr":"172.21.15.117:6805/2828388397","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:47:51.816709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:47:51.376989+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:47:51.833489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:48:05.488 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:48:05.778 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:48:05.779 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":18,"fsid":"5714c6a5-034c-4330-a57b-d22492ad8e43","created":"2024-09-12T22:47:43.881551+0000","modified":"2024-09-12T22:48:04.509147+0000","last_up_change":"2024-09-12T22:47:54.013185+0000","last_in_change":"2024-09-12T22:47:44.690260+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:47:54.168813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:47:58.920007+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:48:03.033410+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:48:03.489928+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ed48fb2-48c2-4ecb-9306-372a05b08cee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6801","nonce":1747255146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6803","nonce":1747255146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6807","nonce":1747255146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6805","nonce":1747255146}]},"public_addr":"172.21.15.87:6801/1747255146","cluster_addr":"172.21.15.87:6803/1747255146","heartbeat_back_addr":"172.21.15.87:6807/1747255146","heartbeat_front_addr":"172.21.15.87:6805/1747255146","state":["exists","up"]},{"osd":1,"uuid":"af934313-a6b4-4e15-9818-6fc3fb71b949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6801","nonce":1159429503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6803","nonce":1159429503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6807","nonce":1159429503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6805","nonce":1159429503}]},"public_addr":"172.21.15.99:6801/1159429503","cluster_addr":"172.21.15.99:6803/1159429503","heartbeat_back_addr":"172.21.15.99:6807/1159429503","heartbeat_front_addr":"172.21.15.99:6805/1159429503","state":["exists","up"]},{"osd":2,"uuid":"185ee2bd-8c37-4de1-b6ef-2988144d1470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2828388397},{"type":"v1","addr":"172.21.15.117:6801","nonce":2828388397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2828388397},{"type":"v1","addr":"172.21.15.117:6803","nonce":2828388397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2828388397},{"type":"v1","addr":"172.21.15.117:6807","nonce":2828388397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2828388397},{"type":"v1","addr":"172.21.15.117:6805","nonce":2828388397}]},"public_addr":"172.21.15.117:6801/2828388397","cluster_addr":"172.21.15.117:6803/2828388397","heartbeat_back_addr":"172.21.15.117:6807/2828388397","heartbeat_front_addr":"172.21.15.117:6805/2828388397","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:47:51.816709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:47:51.376989+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:47:51.833489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:48:05.791 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T22:48:06.195 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T22:48:06.195 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T22:48:07.194 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T22:48:07.195 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T22:48:07.523 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:48:07.523 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":5,"btime":"2024-09-12T22:48:07:173973+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T22:48:04.509445+0000","modified":"2024-09-12T22:48:06.522541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4227},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4227":{"gid":4227,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.66:6803/2680642428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2680642428},{"type":"v1","addr":"172.21.15.66:6803","nonce":2680642428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4227,"qdb_cluster":[4227]},"id":1}]} 2024-09-12T22:48:07.523 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 5 2024-09-12T22:48:07.535 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:48:07.824 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:48:07.824 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":19,"fsid":"5714c6a5-034c-4330-a57b-d22492ad8e43","created":"2024-09-12T22:47:43.881551+0000","modified":"2024-09-12T22:48:06.166729+0000","last_up_change":"2024-09-12T22:47:54.013185+0000","last_in_change":"2024-09-12T22:47:44.690260+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:47:54.168813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:47:58.920007+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:48:03.033410+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:48:03.489928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ed48fb2-48c2-4ecb-9306-372a05b08cee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6801","nonce":1747255146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6803","nonce":1747255146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6807","nonce":1747255146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6805","nonce":1747255146}]},"public_addr":"172.21.15.87:6801/1747255146","cluster_addr":"172.21.15.87:6803/1747255146","heartbeat_back_addr":"172.21.15.87:6807/1747255146","heartbeat_front_addr":"172.21.15.87:6805/1747255146","state":["exists","up"]},{"osd":1,"uuid":"af934313-a6b4-4e15-9818-6fc3fb71b949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6801","nonce":1159429503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6803","nonce":1159429503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6807","nonce":1159429503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6805","nonce":1159429503}]},"public_addr":"172.21.15.99:6801/1159429503","cluster_addr":"172.21.15.99:6803/1159429503","heartbeat_back_addr":"172.21.15.99:6807/1159429503","heartbeat_front_addr":"172.21.15.99:6805/1159429503","state":["exists","up"]},{"osd":2,"uuid":"185ee2bd-8c37-4de1-b6ef-2988144d1470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2828388397},{"type":"v1","addr":"172.21.15.117:6801","nonce":2828388397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2828388397},{"type":"v1","addr":"172.21.15.117:6803","nonce":2828388397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2828388397},{"type":"v1","addr":"172.21.15.117:6807","nonce":2828388397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2828388397},{"type":"v1","addr":"172.21.15.117:6805","nonce":2828388397}]},"public_addr":"172.21.15.117:6801/2828388397","cluster_addr":"172.21.15.117:6803/2828388397","heartbeat_back_addr":"172.21.15.117:6807/2828388397","heartbeat_front_addr":"172.21.15.117:6805/2828388397","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:47:51.816709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:47:51.376989+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:47:51.833489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:48:07.837 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T22:48:07.837 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:48:08.130 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:48:08.132 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-09-12T22:48:08.140 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-12T22:48:06.174164+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":205,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86832,"kb_used_data":1576,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283028688,"statfs":{"total":289910292480,"available":289821376512,"internally_reserved":0,"allocated":1613824,"data_stored":1315003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.047300"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.154640+0000","last_change":"2024-09-12T22:48:03.154640+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.154640+0000","last_undegraded":"2024-09-12T22:48:03.154640+0000","last_fullsized":"2024-09-12T22:48:03.154640+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.156571+0000","last_change":"2024-09-12T22:48:03.156571+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.156571+0000","last_undegraded":"2024-09-12T22:48:03.156571+0000","last_fullsized":"2024-09-12T22:48:03.156571+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.154357+0000","last_change":"2024-09-12T22:48:03.154357+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.154357+0000","last_undegraded":"2024-09-12T22:48:03.154357+0000","last_fullsized":"2024-09-12T22:48:03.154357+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153681+0000","last_change":"2024-09-12T22:48:03.153681+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153681+0000","last_undegraded":"2024-09-12T22:48:03.153681+0000","last_fullsized":"2024-09-12T22:48:03.153681+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153784+0000","last_change":"2024-09-12T22:48:03.153784+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153784+0000","last_undegraded":"2024-09-12T22:48:03.153784+0000","last_fullsized":"2024-09-12T22:48:03.153784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153755+0000","last_change":"2024-09-12T22:48:03.153755+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153755+0000","last_undegraded":"2024-09-12T22:48:03.153755+0000","last_fullsized":"2024-09-12T22:48:03.153755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.154717+0000","last_change":"2024-09-12T22:48:03.154717+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.154717+0000","last_undegraded":"2024-09-12T22:48:03.154717+0000","last_fullsized":"2024-09-12T22:48:03.154717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153799+0000","last_change":"2024-09-12T22:48:03.153799+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153799+0000","last_undegraded":"2024-09-12T22:48:03.153799+0000","last_fullsized":"2024-09-12T22:48:03.153799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.155739+0000","last_change":"2024-09-12T22:48:03.155739+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.155739+0000","last_undegraded":"2024-09-12T22:48:03.155739+0000","last_fullsized":"2024-09-12T22:48:03.155739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153693+0000","last_change":"2024-09-12T22:48:03.153693+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153693+0000","last_undegraded":"2024-09-12T22:48:03.153693+0000","last_fullsized":"2024-09-12T22:48:03.153693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153703+0000","last_change":"2024-09-12T22:48:03.153703+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153703+0000","last_undegraded":"2024-09-12T22:48:03.153703+0000","last_fullsized":"2024-09-12T22:48:03.153703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.154787+0000","last_change":"2024-09-12T22:48:03.154787+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.154787+0000","last_undegraded":"2024-09-12T22:48:03.154787+0000","last_fullsized":"2024-09-12T22:48:03.154787+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":218,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:48:03.155440+0000","last_change":"2024-09-12T22:47:56.028830+0000","last_active":"2024-09-12T22:48:03.155440+0000","last_peered":"2024-09-12T22:48:03.155440+0000","last_clean":"2024-09-12T22:48:03.155440+0000","last_became_active":"2024-09-12T22:47:56.028017+0000","last_became_peered":"2024-09-12T22:47:56.028017+0000","last_unstale":"2024-09-12T22:48:03.155440+0000","last_undegraded":"2024-09-12T22:48:03.155440+0000","last_fullsized":"2024-09-12T22:48:03.155440+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:55.016634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:55.016634+0000","last_clean_scrub_stamp":"2024-09-12T22:47:55.016634+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:03.648827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":22,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:48:03.155607+0000","last_change":"2024-09-12T22:48:02.045816+0000","last_active":"2024-09-12T22:48:03.155607+0000","last_peered":"2024-09-12T22:48:03.155607+0000","last_clean":"2024-09-12T22:48:03.155607+0000","last_became_active":"2024-09-12T22:48:00.045324+0000","last_became_peered":"2024-09-12T22:48:00.045324+0000","last_unstale":"2024-09-12T22:48:03.155607+0000","last_undegraded":"2024-09-12T22:48:03.155607+0000","last_fullsized":"2024-09-12T22:48:03.155607+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:41:33.998543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065526500000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.155711+0000","last_change":"2024-09-12T22:48:03.155711+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.155711+0000","last_undegraded":"2024-09-12T22:48:03.155711+0000","last_fullsized":"2024-09-12T22:48:03.155711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:48:03.155379+0000","last_change":"2024-09-12T22:48:02.045525+0000","last_active":"2024-09-12T22:48:03.155379+0000","last_peered":"2024-09-12T22:48:03.155379+0000","last_clean":"2024-09-12T22:48:03.155379+0000","last_became_active":"2024-09-12T22:48:00.042207+0000","last_became_peered":"2024-09-12T22:48:00.042207+0000","last_unstale":"2024-09-12T22:48:03.155379+0000","last_undegraded":"2024-09-12T22:48:03.155379+0000","last_fullsized":"2024-09-12T22:48:03.155379+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:33.150497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040973099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.155751+0000","last_change":"2024-09-12T22:48:03.155751+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.155751+0000","last_undegraded":"2024-09-12T22:48:03.155751+0000","last_fullsized":"2024-09-12T22:48:03.155751+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:48:03.154476+0000","last_change":"2024-09-12T22:48:02.045209+0000","last_active":"2024-09-12T22:48:03.154476+0000","last_peered":"2024-09-12T22:48:03.154476+0000","last_clean":"2024-09-12T22:48:03.154476+0000","last_became_active":"2024-09-12T22:48:00.042007+0000","last_became_peered":"2024-09-12T22:48:00.042007+0000","last_unstale":"2024-09-12T22:48:03.154476+0000","last_undegraded":"2024-09-12T22:48:03.154476+0000","last_fullsized":"2024-09-12T22:48:03.154476+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:13.536542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036893100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153665+0000","last_change":"2024-09-12T22:48:03.153665+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153665+0000","last_undegraded":"2024-09-12T22:48:03.153665+0000","last_fullsized":"2024-09-12T22:48:03.153665+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":23,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:48:03.155557+0000","last_change":"2024-09-12T22:48:02.045684+0000","last_active":"2024-09-12T22:48:03.155557+0000","last_peered":"2024-09-12T22:48:03.155557+0000","last_clean":"2024-09-12T22:48:03.155557+0000","last_became_active":"2024-09-12T22:48:00.045286+0000","last_became_peered":"2024-09-12T22:48:00.045286+0000","last_unstale":"2024-09-12T22:48:03.155557+0000","last_undegraded":"2024-09-12T22:48:03.155557+0000","last_fullsized":"2024-09-12T22:48:03.155557+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:18:11.667143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052714799999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153693+0000","last_change":"2024-09-12T22:48:03.153693+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153693+0000","last_undegraded":"2024-09-12T22:48:03.153693+0000","last_fullsized":"2024-09-12T22:48:03.153693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153815+0000","last_change":"2024-09-12T22:48:03.153815+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153815+0000","last_undegraded":"2024-09-12T22:48:03.153815+0000","last_fullsized":"2024-09-12T22:48:03.153815+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:48:03.154554+0000","last_change":"2024-09-12T22:48:02.045324+0000","last_active":"2024-09-12T22:48:03.154554+0000","last_peered":"2024-09-12T22:48:03.154554+0000","last_clean":"2024-09-12T22:48:03.154554+0000","last_became_active":"2024-09-12T22:48:00.042132+0000","last_became_peered":"2024-09-12T22:48:00.042132+0000","last_unstale":"2024-09-12T22:48:03.154554+0000","last_undegraded":"2024-09-12T22:48:03.154554+0000","last_fullsized":"2024-09-12T22:48:03.154554+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:24.673019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047590600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.155702+0000","last_change":"2024-09-12T22:48:03.155702+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.155702+0000","last_undegraded":"2024-09-12T22:48:03.155702+0000","last_fullsized":"2024-09-12T22:48:03.155702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:48:03.155196+0000","last_change":"2024-09-12T22:48:02.045390+0000","last_active":"2024-09-12T22:48:03.155196+0000","last_peered":"2024-09-12T22:48:03.155196+0000","last_clean":"2024-09-12T22:48:03.155196+0000","last_became_active":"2024-09-12T22:48:00.045356+0000","last_became_peered":"2024-09-12T22:48:00.045356+0000","last_unstale":"2024-09-12T22:48:03.155196+0000","last_undegraded":"2024-09-12T22:48:03.155196+0000","last_fullsized":"2024-09-12T22:48:03.155196+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:32.072080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040621599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.155721+0000","last_change":"2024-09-12T22:48:03.155721+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.155721+0000","last_undegraded":"2024-09-12T22:48:03.155721+0000","last_fullsized":"2024-09-12T22:48:03.155721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:48:03.154585+0000","last_change":"2024-09-12T22:48:02.045428+0000","last_active":"2024-09-12T22:48:03.154585+0000","last_peered":"2024-09-12T22:48:03.154585+0000","last_clean":"2024-09-12T22:48:03.154585+0000","last_became_active":"2024-09-12T22:48:00.040536+0000","last_became_peered":"2024-09-12T22:48:00.040536+0000","last_unstale":"2024-09-12T22:48:03.154585+0000","last_undegraded":"2024-09-12T22:48:03.154585+0000","last_fullsized":"2024-09-12T22:48:03.154585+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:33.150497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057699499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.155702+0000","last_change":"2024-09-12T22:48:03.155702+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.155702+0000","last_undegraded":"2024-09-12T22:48:03.155702+0000","last_fullsized":"2024-09-12T22:48:03.155702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:48:03.155759+0000","last_change":"2024-09-12T22:48:02.045500+0000","last_active":"2024-09-12T22:48:03.155759+0000","last_peered":"2024-09-12T22:48:03.155759+0000","last_clean":"2024-09-12T22:48:03.155759+0000","last_became_active":"2024-09-12T22:48:00.042210+0000","last_became_peered":"2024-09-12T22:48:00.042210+0000","last_unstale":"2024-09-12T22:48:03.155759+0000","last_undegraded":"2024-09-12T22:48:03.155759+0000","last_fullsized":"2024-09-12T22:48:03.155759+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:35:14.212372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035339799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.154607+0000","last_change":"2024-09-12T22:48:03.154607+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.154607+0000","last_undegraded":"2024-09-12T22:48:03.154607+0000","last_fullsized":"2024-09-12T22:48:03.154607+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153669+0000","last_change":"2024-09-12T22:48:03.153669+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153669+0000","last_undegraded":"2024-09-12T22:48:03.153669+0000","last_fullsized":"2024-09-12T22:48:03.153669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153850+0000","last_change":"2024-09-12T22:48:03.153850+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153850+0000","last_undegraded":"2024-09-12T22:48:03.153850+0000","last_fullsized":"2024-09-12T22:48:03.153850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.156673+0000","last_change":"2024-09-12T22:48:03.156673+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.156673+0000","last_undegraded":"2024-09-12T22:48:03.156673+0000","last_fullsized":"2024-09-12T22:48:03.156673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.157013+0000","last_change":"2024-09-12T22:48:03.157013+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.157013+0000","last_undegraded":"2024-09-12T22:48:03.157013+0000","last_fullsized":"2024-09-12T22:48:03.157013+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.156603+0000","last_change":"2024-09-12T22:48:03.156603+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.156603+0000","last_undegraded":"2024-09-12T22:48:03.156603+0000","last_fullsized":"2024-09-12T22:48:03.156603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153721+0000","last_change":"2024-09-12T22:48:03.153721+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153721+0000","last_undegraded":"2024-09-12T22:48:03.153721+0000","last_fullsized":"2024-09-12T22:48:03.153721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153736+0000","last_change":"2024-09-12T22:48:03.153736+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153736+0000","last_undegraded":"2024-09-12T22:48:03.153736+0000","last_fullsized":"2024-09-12T22:48:03.153736+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.154982+0000","last_change":"2024-09-12T22:48:03.154982+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.154982+0000","last_undegraded":"2024-09-12T22:48:03.154982+0000","last_fullsized":"2024-09-12T22:48:03.154982+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.154307+0000","last_change":"2024-09-12T22:48:03.154307+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.154307+0000","last_undegraded":"2024-09-12T22:48:03.154307+0000","last_fullsized":"2024-09-12T22:48:03.154307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.156689+0000","last_change":"2024-09-12T22:48:03.156689+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.156689+0000","last_undegraded":"2024-09-12T22:48:03.156689+0000","last_fullsized":"2024-09-12T22:48:03.156689+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.157857+0000","last_change":"2024-09-12T22:48:03.157857+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.157857+0000","last_undegraded":"2024-09-12T22:48:03.157857+0000","last_fullsized":"2024-09-12T22:48:03.157857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":737280,"data_stored":635130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":143360,"data_stored":44762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":733184,"data_stored":635111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:48:08.145 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:48:08.476 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:48:08.478 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-09-12T22:48:08.488 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-12T22:48:08.127841+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":205,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86832,"kb_used_data":1576,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283028688,"statfs":{"total":289910292480,"available":289821376512,"internally_reserved":0,"allocated":1613824,"data_stored":1315003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.974821"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.154640+0000","last_change":"2024-09-12T22:48:03.154640+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.154640+0000","last_undegraded":"2024-09-12T22:48:03.154640+0000","last_fullsized":"2024-09-12T22:48:03.154640+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.156571+0000","last_change":"2024-09-12T22:48:03.156571+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.156571+0000","last_undegraded":"2024-09-12T22:48:03.156571+0000","last_fullsized":"2024-09-12T22:48:03.156571+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.154357+0000","last_change":"2024-09-12T22:48:03.154357+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.154357+0000","last_undegraded":"2024-09-12T22:48:03.154357+0000","last_fullsized":"2024-09-12T22:48:03.154357+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153681+0000","last_change":"2024-09-12T22:48:03.153681+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153681+0000","last_undegraded":"2024-09-12T22:48:03.153681+0000","last_fullsized":"2024-09-12T22:48:03.153681+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153784+0000","last_change":"2024-09-12T22:48:03.153784+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153784+0000","last_undegraded":"2024-09-12T22:48:03.153784+0000","last_fullsized":"2024-09-12T22:48:03.153784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153755+0000","last_change":"2024-09-12T22:48:03.153755+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153755+0000","last_undegraded":"2024-09-12T22:48:03.153755+0000","last_fullsized":"2024-09-12T22:48:03.153755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.154717+0000","last_change":"2024-09-12T22:48:03.154717+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.154717+0000","last_undegraded":"2024-09-12T22:48:03.154717+0000","last_fullsized":"2024-09-12T22:48:03.154717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153799+0000","last_change":"2024-09-12T22:48:03.153799+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153799+0000","last_undegraded":"2024-09-12T22:48:03.153799+0000","last_fullsized":"2024-09-12T22:48:03.153799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.155739+0000","last_change":"2024-09-12T22:48:03.155739+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.155739+0000","last_undegraded":"2024-09-12T22:48:03.155739+0000","last_fullsized":"2024-09-12T22:48:03.155739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153693+0000","last_change":"2024-09-12T22:48:03.153693+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153693+0000","last_undegraded":"2024-09-12T22:48:03.153693+0000","last_fullsized":"2024-09-12T22:48:03.153693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153703+0000","last_change":"2024-09-12T22:48:03.153703+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153703+0000","last_undegraded":"2024-09-12T22:48:03.153703+0000","last_fullsized":"2024-09-12T22:48:03.153703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.154787+0000","last_change":"2024-09-12T22:48:03.154787+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.154787+0000","last_undegraded":"2024-09-12T22:48:03.154787+0000","last_fullsized":"2024-09-12T22:48:03.154787+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":218,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:48:03.155440+0000","last_change":"2024-09-12T22:47:56.028830+0000","last_active":"2024-09-12T22:48:03.155440+0000","last_peered":"2024-09-12T22:48:03.155440+0000","last_clean":"2024-09-12T22:48:03.155440+0000","last_became_active":"2024-09-12T22:47:56.028017+0000","last_became_peered":"2024-09-12T22:47:56.028017+0000","last_unstale":"2024-09-12T22:48:03.155440+0000","last_undegraded":"2024-09-12T22:48:03.155440+0000","last_fullsized":"2024-09-12T22:48:03.155440+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:55.016634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:55.016634+0000","last_clean_scrub_stamp":"2024-09-12T22:47:55.016634+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:03.648827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":22,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:48:03.155607+0000","last_change":"2024-09-12T22:48:02.045816+0000","last_active":"2024-09-12T22:48:03.155607+0000","last_peered":"2024-09-12T22:48:03.155607+0000","last_clean":"2024-09-12T22:48:03.155607+0000","last_became_active":"2024-09-12T22:48:00.045324+0000","last_became_peered":"2024-09-12T22:48:00.045324+0000","last_unstale":"2024-09-12T22:48:03.155607+0000","last_undegraded":"2024-09-12T22:48:03.155607+0000","last_fullsized":"2024-09-12T22:48:03.155607+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:41:33.998543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065526500000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.155711+0000","last_change":"2024-09-12T22:48:03.155711+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.155711+0000","last_undegraded":"2024-09-12T22:48:03.155711+0000","last_fullsized":"2024-09-12T22:48:03.155711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:48:03.155379+0000","last_change":"2024-09-12T22:48:02.045525+0000","last_active":"2024-09-12T22:48:03.155379+0000","last_peered":"2024-09-12T22:48:03.155379+0000","last_clean":"2024-09-12T22:48:03.155379+0000","last_became_active":"2024-09-12T22:48:00.042207+0000","last_became_peered":"2024-09-12T22:48:00.042207+0000","last_unstale":"2024-09-12T22:48:03.155379+0000","last_undegraded":"2024-09-12T22:48:03.155379+0000","last_fullsized":"2024-09-12T22:48:03.155379+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:33.150497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040973099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.155751+0000","last_change":"2024-09-12T22:48:03.155751+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.155751+0000","last_undegraded":"2024-09-12T22:48:03.155751+0000","last_fullsized":"2024-09-12T22:48:03.155751+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:48:03.154476+0000","last_change":"2024-09-12T22:48:02.045209+0000","last_active":"2024-09-12T22:48:03.154476+0000","last_peered":"2024-09-12T22:48:03.154476+0000","last_clean":"2024-09-12T22:48:03.154476+0000","last_became_active":"2024-09-12T22:48:00.042007+0000","last_became_peered":"2024-09-12T22:48:00.042007+0000","last_unstale":"2024-09-12T22:48:03.154476+0000","last_undegraded":"2024-09-12T22:48:03.154476+0000","last_fullsized":"2024-09-12T22:48:03.154476+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:13.536542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036893100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153665+0000","last_change":"2024-09-12T22:48:03.153665+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153665+0000","last_undegraded":"2024-09-12T22:48:03.153665+0000","last_fullsized":"2024-09-12T22:48:03.153665+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":23,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:48:03.155557+0000","last_change":"2024-09-12T22:48:02.045684+0000","last_active":"2024-09-12T22:48:03.155557+0000","last_peered":"2024-09-12T22:48:03.155557+0000","last_clean":"2024-09-12T22:48:03.155557+0000","last_became_active":"2024-09-12T22:48:00.045286+0000","last_became_peered":"2024-09-12T22:48:00.045286+0000","last_unstale":"2024-09-12T22:48:03.155557+0000","last_undegraded":"2024-09-12T22:48:03.155557+0000","last_fullsized":"2024-09-12T22:48:03.155557+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:18:11.667143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052714799999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153693+0000","last_change":"2024-09-12T22:48:03.153693+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153693+0000","last_undegraded":"2024-09-12T22:48:03.153693+0000","last_fullsized":"2024-09-12T22:48:03.153693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153815+0000","last_change":"2024-09-12T22:48:03.153815+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153815+0000","last_undegraded":"2024-09-12T22:48:03.153815+0000","last_fullsized":"2024-09-12T22:48:03.153815+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:48:03.154554+0000","last_change":"2024-09-12T22:48:02.045324+0000","last_active":"2024-09-12T22:48:03.154554+0000","last_peered":"2024-09-12T22:48:03.154554+0000","last_clean":"2024-09-12T22:48:03.154554+0000","last_became_active":"2024-09-12T22:48:00.042132+0000","last_became_peered":"2024-09-12T22:48:00.042132+0000","last_unstale":"2024-09-12T22:48:03.154554+0000","last_undegraded":"2024-09-12T22:48:03.154554+0000","last_fullsized":"2024-09-12T22:48:03.154554+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:24.673019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047590600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.155702+0000","last_change":"2024-09-12T22:48:03.155702+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.155702+0000","last_undegraded":"2024-09-12T22:48:03.155702+0000","last_fullsized":"2024-09-12T22:48:03.155702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:48:03.155196+0000","last_change":"2024-09-12T22:48:02.045390+0000","last_active":"2024-09-12T22:48:03.155196+0000","last_peered":"2024-09-12T22:48:03.155196+0000","last_clean":"2024-09-12T22:48:03.155196+0000","last_became_active":"2024-09-12T22:48:00.045356+0000","last_became_peered":"2024-09-12T22:48:00.045356+0000","last_unstale":"2024-09-12T22:48:03.155196+0000","last_undegraded":"2024-09-12T22:48:03.155196+0000","last_fullsized":"2024-09-12T22:48:03.155196+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:32.072080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040621599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.155721+0000","last_change":"2024-09-12T22:48:03.155721+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.155721+0000","last_undegraded":"2024-09-12T22:48:03.155721+0000","last_fullsized":"2024-09-12T22:48:03.155721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:48:03.154585+0000","last_change":"2024-09-12T22:48:02.045428+0000","last_active":"2024-09-12T22:48:03.154585+0000","last_peered":"2024-09-12T22:48:03.154585+0000","last_clean":"2024-09-12T22:48:03.154585+0000","last_became_active":"2024-09-12T22:48:00.040536+0000","last_became_peered":"2024-09-12T22:48:00.040536+0000","last_unstale":"2024-09-12T22:48:03.154585+0000","last_undegraded":"2024-09-12T22:48:03.154585+0000","last_fullsized":"2024-09-12T22:48:03.154585+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:33.150497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057699499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.155702+0000","last_change":"2024-09-12T22:48:03.155702+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.155702+0000","last_undegraded":"2024-09-12T22:48:03.155702+0000","last_fullsized":"2024-09-12T22:48:03.155702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:48:03.155759+0000","last_change":"2024-09-12T22:48:02.045500+0000","last_active":"2024-09-12T22:48:03.155759+0000","last_peered":"2024-09-12T22:48:03.155759+0000","last_clean":"2024-09-12T22:48:03.155759+0000","last_became_active":"2024-09-12T22:48:00.042210+0000","last_became_peered":"2024-09-12T22:48:00.042210+0000","last_unstale":"2024-09-12T22:48:03.155759+0000","last_undegraded":"2024-09-12T22:48:03.155759+0000","last_fullsized":"2024-09-12T22:48:03.155759+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:35:14.212372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035339799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.154607+0000","last_change":"2024-09-12T22:48:03.154607+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.154607+0000","last_undegraded":"2024-09-12T22:48:03.154607+0000","last_fullsized":"2024-09-12T22:48:03.154607+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153669+0000","last_change":"2024-09-12T22:48:03.153669+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153669+0000","last_undegraded":"2024-09-12T22:48:03.153669+0000","last_fullsized":"2024-09-12T22:48:03.153669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153850+0000","last_change":"2024-09-12T22:48:03.153850+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153850+0000","last_undegraded":"2024-09-12T22:48:03.153850+0000","last_fullsized":"2024-09-12T22:48:03.153850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.156673+0000","last_change":"2024-09-12T22:48:03.156673+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.156673+0000","last_undegraded":"2024-09-12T22:48:03.156673+0000","last_fullsized":"2024-09-12T22:48:03.156673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.157013+0000","last_change":"2024-09-12T22:48:03.157013+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.157013+0000","last_undegraded":"2024-09-12T22:48:03.157013+0000","last_fullsized":"2024-09-12T22:48:03.157013+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.156603+0000","last_change":"2024-09-12T22:48:03.156603+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.156603+0000","last_undegraded":"2024-09-12T22:48:03.156603+0000","last_fullsized":"2024-09-12T22:48:03.156603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153721+0000","last_change":"2024-09-12T22:48:03.153721+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153721+0000","last_undegraded":"2024-09-12T22:48:03.153721+0000","last_fullsized":"2024-09-12T22:48:03.153721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153736+0000","last_change":"2024-09-12T22:48:03.153736+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153736+0000","last_undegraded":"2024-09-12T22:48:03.153736+0000","last_fullsized":"2024-09-12T22:48:03.153736+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.154982+0000","last_change":"2024-09-12T22:48:03.154982+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.154982+0000","last_undegraded":"2024-09-12T22:48:03.154982+0000","last_fullsized":"2024-09-12T22:48:03.154982+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.154307+0000","last_change":"2024-09-12T22:48:03.154307+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.154307+0000","last_undegraded":"2024-09-12T22:48:03.154307+0000","last_fullsized":"2024-09-12T22:48:03.154307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.156689+0000","last_change":"2024-09-12T22:48:03.156689+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.156689+0000","last_undegraded":"2024-09-12T22:48:03.156689+0000","last_fullsized":"2024-09-12T22:48:03.156689+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.157857+0000","last_change":"2024-09-12T22:48:03.157857+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.157857+0000","last_undegraded":"2024-09-12T22:48:03.157857+0000","last_fullsized":"2024-09-12T22:48:03.157857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":737280,"data_stored":635130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":143360,"data_stored":44762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":733184,"data_stored":635111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:48:08.492 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:48:08.822 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:48:08.824 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-09-12T22:48:08.834 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-12T22:48:08.671725+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":205,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86832,"kb_used_data":1576,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283028688,"statfs":{"total":289910292480,"available":289821376512,"internally_reserved":0,"allocated":1613824,"data_stored":1315003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.544477"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.154640+0000","last_change":"2024-09-12T22:48:03.154640+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.154640+0000","last_undegraded":"2024-09-12T22:48:03.154640+0000","last_fullsized":"2024-09-12T22:48:03.154640+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.156571+0000","last_change":"2024-09-12T22:48:03.156571+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.156571+0000","last_undegraded":"2024-09-12T22:48:03.156571+0000","last_fullsized":"2024-09-12T22:48:03.156571+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.154357+0000","last_change":"2024-09-12T22:48:03.154357+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.154357+0000","last_undegraded":"2024-09-12T22:48:03.154357+0000","last_fullsized":"2024-09-12T22:48:03.154357+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153681+0000","last_change":"2024-09-12T22:48:03.153681+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153681+0000","last_undegraded":"2024-09-12T22:48:03.153681+0000","last_fullsized":"2024-09-12T22:48:03.153681+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153784+0000","last_change":"2024-09-12T22:48:03.153784+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153784+0000","last_undegraded":"2024-09-12T22:48:03.153784+0000","last_fullsized":"2024-09-12T22:48:03.153784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153755+0000","last_change":"2024-09-12T22:48:03.153755+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153755+0000","last_undegraded":"2024-09-12T22:48:03.153755+0000","last_fullsized":"2024-09-12T22:48:03.153755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.154717+0000","last_change":"2024-09-12T22:48:03.154717+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.154717+0000","last_undegraded":"2024-09-12T22:48:03.154717+0000","last_fullsized":"2024-09-12T22:48:03.154717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153799+0000","last_change":"2024-09-12T22:48:03.153799+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153799+0000","last_undegraded":"2024-09-12T22:48:03.153799+0000","last_fullsized":"2024-09-12T22:48:03.153799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.155739+0000","last_change":"2024-09-12T22:48:03.155739+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.155739+0000","last_undegraded":"2024-09-12T22:48:03.155739+0000","last_fullsized":"2024-09-12T22:48:03.155739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153693+0000","last_change":"2024-09-12T22:48:03.153693+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153693+0000","last_undegraded":"2024-09-12T22:48:03.153693+0000","last_fullsized":"2024-09-12T22:48:03.153693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153703+0000","last_change":"2024-09-12T22:48:03.153703+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153703+0000","last_undegraded":"2024-09-12T22:48:03.153703+0000","last_fullsized":"2024-09-12T22:48:03.153703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.154787+0000","last_change":"2024-09-12T22:48:03.154787+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.154787+0000","last_undegraded":"2024-09-12T22:48:03.154787+0000","last_fullsized":"2024-09-12T22:48:03.154787+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":218,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:48:03.155440+0000","last_change":"2024-09-12T22:47:56.028830+0000","last_active":"2024-09-12T22:48:03.155440+0000","last_peered":"2024-09-12T22:48:03.155440+0000","last_clean":"2024-09-12T22:48:03.155440+0000","last_became_active":"2024-09-12T22:47:56.028017+0000","last_became_peered":"2024-09-12T22:47:56.028017+0000","last_unstale":"2024-09-12T22:48:03.155440+0000","last_undegraded":"2024-09-12T22:48:03.155440+0000","last_fullsized":"2024-09-12T22:48:03.155440+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:55.016634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:55.016634+0000","last_clean_scrub_stamp":"2024-09-12T22:47:55.016634+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:03.648827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":22,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:48:03.155607+0000","last_change":"2024-09-12T22:48:02.045816+0000","last_active":"2024-09-12T22:48:03.155607+0000","last_peered":"2024-09-12T22:48:03.155607+0000","last_clean":"2024-09-12T22:48:03.155607+0000","last_became_active":"2024-09-12T22:48:00.045324+0000","last_became_peered":"2024-09-12T22:48:00.045324+0000","last_unstale":"2024-09-12T22:48:03.155607+0000","last_undegraded":"2024-09-12T22:48:03.155607+0000","last_fullsized":"2024-09-12T22:48:03.155607+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:41:33.998543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065526500000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.155711+0000","last_change":"2024-09-12T22:48:03.155711+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.155711+0000","last_undegraded":"2024-09-12T22:48:03.155711+0000","last_fullsized":"2024-09-12T22:48:03.155711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:48:03.155379+0000","last_change":"2024-09-12T22:48:02.045525+0000","last_active":"2024-09-12T22:48:03.155379+0000","last_peered":"2024-09-12T22:48:03.155379+0000","last_clean":"2024-09-12T22:48:03.155379+0000","last_became_active":"2024-09-12T22:48:00.042207+0000","last_became_peered":"2024-09-12T22:48:00.042207+0000","last_unstale":"2024-09-12T22:48:03.155379+0000","last_undegraded":"2024-09-12T22:48:03.155379+0000","last_fullsized":"2024-09-12T22:48:03.155379+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:33.150497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040973099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.155751+0000","last_change":"2024-09-12T22:48:03.155751+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.155751+0000","last_undegraded":"2024-09-12T22:48:03.155751+0000","last_fullsized":"2024-09-12T22:48:03.155751+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:48:03.154476+0000","last_change":"2024-09-12T22:48:02.045209+0000","last_active":"2024-09-12T22:48:03.154476+0000","last_peered":"2024-09-12T22:48:03.154476+0000","last_clean":"2024-09-12T22:48:03.154476+0000","last_became_active":"2024-09-12T22:48:00.042007+0000","last_became_peered":"2024-09-12T22:48:00.042007+0000","last_unstale":"2024-09-12T22:48:03.154476+0000","last_undegraded":"2024-09-12T22:48:03.154476+0000","last_fullsized":"2024-09-12T22:48:03.154476+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:13.536542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036893100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153665+0000","last_change":"2024-09-12T22:48:03.153665+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153665+0000","last_undegraded":"2024-09-12T22:48:03.153665+0000","last_fullsized":"2024-09-12T22:48:03.153665+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":23,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:48:03.155557+0000","last_change":"2024-09-12T22:48:02.045684+0000","last_active":"2024-09-12T22:48:03.155557+0000","last_peered":"2024-09-12T22:48:03.155557+0000","last_clean":"2024-09-12T22:48:03.155557+0000","last_became_active":"2024-09-12T22:48:00.045286+0000","last_became_peered":"2024-09-12T22:48:00.045286+0000","last_unstale":"2024-09-12T22:48:03.155557+0000","last_undegraded":"2024-09-12T22:48:03.155557+0000","last_fullsized":"2024-09-12T22:48:03.155557+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:18:11.667143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052714799999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153693+0000","last_change":"2024-09-12T22:48:03.153693+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153693+0000","last_undegraded":"2024-09-12T22:48:03.153693+0000","last_fullsized":"2024-09-12T22:48:03.153693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153815+0000","last_change":"2024-09-12T22:48:03.153815+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153815+0000","last_undegraded":"2024-09-12T22:48:03.153815+0000","last_fullsized":"2024-09-12T22:48:03.153815+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:48:03.154554+0000","last_change":"2024-09-12T22:48:02.045324+0000","last_active":"2024-09-12T22:48:03.154554+0000","last_peered":"2024-09-12T22:48:03.154554+0000","last_clean":"2024-09-12T22:48:03.154554+0000","last_became_active":"2024-09-12T22:48:00.042132+0000","last_became_peered":"2024-09-12T22:48:00.042132+0000","last_unstale":"2024-09-12T22:48:03.154554+0000","last_undegraded":"2024-09-12T22:48:03.154554+0000","last_fullsized":"2024-09-12T22:48:03.154554+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:24.673019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047590600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.155702+0000","last_change":"2024-09-12T22:48:03.155702+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.155702+0000","last_undegraded":"2024-09-12T22:48:03.155702+0000","last_fullsized":"2024-09-12T22:48:03.155702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:48:03.155196+0000","last_change":"2024-09-12T22:48:02.045390+0000","last_active":"2024-09-12T22:48:03.155196+0000","last_peered":"2024-09-12T22:48:03.155196+0000","last_clean":"2024-09-12T22:48:03.155196+0000","last_became_active":"2024-09-12T22:48:00.045356+0000","last_became_peered":"2024-09-12T22:48:00.045356+0000","last_unstale":"2024-09-12T22:48:03.155196+0000","last_undegraded":"2024-09-12T22:48:03.155196+0000","last_fullsized":"2024-09-12T22:48:03.155196+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:32.072080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040621599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.155721+0000","last_change":"2024-09-12T22:48:03.155721+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.155721+0000","last_undegraded":"2024-09-12T22:48:03.155721+0000","last_fullsized":"2024-09-12T22:48:03.155721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:48:03.154585+0000","last_change":"2024-09-12T22:48:02.045428+0000","last_active":"2024-09-12T22:48:03.154585+0000","last_peered":"2024-09-12T22:48:03.154585+0000","last_clean":"2024-09-12T22:48:03.154585+0000","last_became_active":"2024-09-12T22:48:00.040536+0000","last_became_peered":"2024-09-12T22:48:00.040536+0000","last_unstale":"2024-09-12T22:48:03.154585+0000","last_undegraded":"2024-09-12T22:48:03.154585+0000","last_fullsized":"2024-09-12T22:48:03.154585+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:33.150497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057699499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.155702+0000","last_change":"2024-09-12T22:48:03.155702+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.155702+0000","last_undegraded":"2024-09-12T22:48:03.155702+0000","last_fullsized":"2024-09-12T22:48:03.155702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:48:03.155759+0000","last_change":"2024-09-12T22:48:02.045500+0000","last_active":"2024-09-12T22:48:03.155759+0000","last_peered":"2024-09-12T22:48:03.155759+0000","last_clean":"2024-09-12T22:48:03.155759+0000","last_became_active":"2024-09-12T22:48:00.042210+0000","last_became_peered":"2024-09-12T22:48:00.042210+0000","last_unstale":"2024-09-12T22:48:03.155759+0000","last_undegraded":"2024-09-12T22:48:03.155759+0000","last_fullsized":"2024-09-12T22:48:03.155759+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:35:14.212372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035339799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.154607+0000","last_change":"2024-09-12T22:48:03.154607+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.154607+0000","last_undegraded":"2024-09-12T22:48:03.154607+0000","last_fullsized":"2024-09-12T22:48:03.154607+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153669+0000","last_change":"2024-09-12T22:48:03.153669+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153669+0000","last_undegraded":"2024-09-12T22:48:03.153669+0000","last_fullsized":"2024-09-12T22:48:03.153669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153850+0000","last_change":"2024-09-12T22:48:03.153850+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153850+0000","last_undegraded":"2024-09-12T22:48:03.153850+0000","last_fullsized":"2024-09-12T22:48:03.153850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.156673+0000","last_change":"2024-09-12T22:48:03.156673+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.156673+0000","last_undegraded":"2024-09-12T22:48:03.156673+0000","last_fullsized":"2024-09-12T22:48:03.156673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.157013+0000","last_change":"2024-09-12T22:48:03.157013+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.157013+0000","last_undegraded":"2024-09-12T22:48:03.157013+0000","last_fullsized":"2024-09-12T22:48:03.157013+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.156603+0000","last_change":"2024-09-12T22:48:03.156603+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.156603+0000","last_undegraded":"2024-09-12T22:48:03.156603+0000","last_fullsized":"2024-09-12T22:48:03.156603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153721+0000","last_change":"2024-09-12T22:48:03.153721+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153721+0000","last_undegraded":"2024-09-12T22:48:03.153721+0000","last_fullsized":"2024-09-12T22:48:03.153721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153736+0000","last_change":"2024-09-12T22:48:03.153736+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153736+0000","last_undegraded":"2024-09-12T22:48:03.153736+0000","last_fullsized":"2024-09-12T22:48:03.153736+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.154982+0000","last_change":"2024-09-12T22:48:03.154982+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.154982+0000","last_undegraded":"2024-09-12T22:48:03.154982+0000","last_fullsized":"2024-09-12T22:48:03.154982+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.154307+0000","last_change":"2024-09-12T22:48:03.154307+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.154307+0000","last_undegraded":"2024-09-12T22:48:03.154307+0000","last_fullsized":"2024-09-12T22:48:03.154307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.156689+0000","last_change":"2024-09-12T22:48:03.156689+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.156689+0000","last_undegraded":"2024-09-12T22:48:03.156689+0000","last_fullsized":"2024-09-12T22:48:03.156689+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.157857+0000","last_change":"2024-09-12T22:48:03.157857+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.157857+0000","last_undegraded":"2024-09-12T22:48:03.157857+0000","last_fullsized":"2024-09-12T22:48:03.157857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":737280,"data_stored":635130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":143360,"data_stored":44762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":733184,"data_stored":635111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:48:08.841 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3f is not active+clean 2024-09-12T22:48:08.841 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.841 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3e is not active+clean 2024-09-12T22:48:08.841 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.841 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3d is not active+clean 2024-09-12T22:48:08.841 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.842 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3c is not active+clean 2024-09-12T22:48:08.842 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.842 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3b is not active+clean 2024-09-12T22:48:08.842 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.842 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3a is not active+clean 2024-09-12T22:48:08.843 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.843 INFO:tasks.ceph.ceph_manager.ceph:PG 4.39 is not active+clean 2024-09-12T22:48:08.843 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.843 INFO:tasks.ceph.ceph_manager.ceph:PG 4.38 is not active+clean 2024-09-12T22:48:08.843 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.843 INFO:tasks.ceph.ceph_manager.ceph:PG 4.37 is not active+clean 2024-09-12T22:48:08.843 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.843 INFO:tasks.ceph.ceph_manager.ceph:PG 4.36 is not active+clean 2024-09-12T22:48:08.843 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.844 INFO:tasks.ceph.ceph_manager.ceph:PG 4.35 is not active+clean 2024-09-12T22:48:08.844 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.844 INFO:tasks.ceph.ceph_manager.ceph:PG 4.34 is not active+clean 2024-09-12T22:48:08.844 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.844 INFO:tasks.ceph.ceph_manager.ceph:PG 4.33 is not active+clean 2024-09-12T22:48:08.844 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.844 INFO:tasks.ceph.ceph_manager.ceph:PG 4.32 is not active+clean 2024-09-12T22:48:08.844 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.844 INFO:tasks.ceph.ceph_manager.ceph:PG 4.31 is not active+clean 2024-09-12T22:48:08.844 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.844 INFO:tasks.ceph.ceph_manager.ceph:PG 4.30 is not active+clean 2024-09-12T22:48:08.845 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.845 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2f is not active+clean 2024-09-12T22:48:08.845 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.845 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2e is not active+clean 2024-09-12T22:48:08.845 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.845 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2d is not active+clean 2024-09-12T22:48:08.845 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.845 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2c is not active+clean 2024-09-12T22:48:08.845 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.845 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2b is not active+clean 2024-09-12T22:48:08.845 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.845 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2a is not active+clean 2024-09-12T22:48:08.846 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.846 INFO:tasks.ceph.ceph_manager.ceph:PG 4.29 is not active+clean 2024-09-12T22:48:08.846 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.846 INFO:tasks.ceph.ceph_manager.ceph:PG 4.28 is not active+clean 2024-09-12T22:48:08.846 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.846 INFO:tasks.ceph.ceph_manager.ceph:PG 4.27 is not active+clean 2024-09-12T22:48:08.846 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.846 INFO:tasks.ceph.ceph_manager.ceph:PG 4.26 is not active+clean 2024-09-12T22:48:08.846 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.846 INFO:tasks.ceph.ceph_manager.ceph:PG 4.25 is not active+clean 2024-09-12T22:48:08.846 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.847 INFO:tasks.ceph.ceph_manager.ceph:PG 4.24 is not active+clean 2024-09-12T22:48:08.847 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.847 INFO:tasks.ceph.ceph_manager.ceph:PG 4.23 is not active+clean 2024-09-12T22:48:08.847 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.847 INFO:tasks.ceph.ceph_manager.ceph:PG 4.22 is not active+clean 2024-09-12T22:48:08.847 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.847 INFO:tasks.ceph.ceph_manager.ceph:PG 4.21 is not active+clean 2024-09-12T22:48:08.847 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.847 INFO:tasks.ceph.ceph_manager.ceph:PG 4.20 is not active+clean 2024-09-12T22:48:08.847 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.847 INFO:tasks.ceph.ceph_manager.ceph:PG 4.14 is not active+clean 2024-09-12T22:48:08.847 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.848 INFO:tasks.ceph.ceph_manager.ceph:PG 3.13 is not active+clean 2024-09-12T22:48:08.848 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:48:03.154640+0000', 'last_change': '2024-09-12T22:48:03.154640+0000', 'last_active': '2024-09-12T22:48:03.149914+0000', 'last_peered': '2024-09-12T22:48:03.149914+0000', 'last_clean': '2024-09-12T22:48:03.149914+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:03.154640+0000', 'last_undegraded': '2024-09-12T22:48:03.154640+0000', 'last_fullsized': '2024-09-12T22:48:03.154640+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:48:08.848 INFO:tasks.ceph.ceph_manager.ceph:PG 4.15 is not active+clean 2024-09-12T22:48:08.848 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.848 INFO:tasks.ceph.ceph_manager.ceph:PG 3.12 is not active+clean 2024-09-12T22:48:08.848 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:48:03.156571+0000', 'last_change': '2024-09-12T22:48:03.156571+0000', 'last_active': '2024-09-12T22:48:03.149914+0000', 'last_peered': '2024-09-12T22:48:03.149914+0000', 'last_clean': '2024-09-12T22:48:03.149914+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:03.156571+0000', 'last_undegraded': '2024-09-12T22:48:03.156571+0000', 'last_fullsized': '2024-09-12T22:48:03.156571+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T22:48:08.848 INFO:tasks.ceph.ceph_manager.ceph:PG 4.16 is not active+clean 2024-09-12T22:48:08.848 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.848 INFO:tasks.ceph.ceph_manager.ceph:PG 3.11 is not active+clean 2024-09-12T22:48:08.848 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:48:03.154357+0000', 'last_change': '2024-09-12T22:48:03.154357+0000', 'last_active': '2024-09-12T22:48:03.149914+0000', 'last_peered': '2024-09-12T22:48:03.149914+0000', 'last_clean': '2024-09-12T22:48:03.149914+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:03.154357+0000', 'last_undegraded': '2024-09-12T22:48:03.154357+0000', 'last_fullsized': '2024-09-12T22:48:03.154357+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T22:48:08.849 INFO:tasks.ceph.ceph_manager.ceph:PG 4.17 is not active+clean 2024-09-12T22:48:08.849 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.849 INFO:tasks.ceph.ceph_manager.ceph:PG 3.10 is not active+clean 2024-09-12T22:48:08.849 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:48:03.153681+0000', 'last_change': '2024-09-12T22:48:03.153681+0000', 'last_active': '2024-09-12T22:48:03.149914+0000', 'last_peered': '2024-09-12T22:48:03.149914+0000', 'last_clean': '2024-09-12T22:48:03.149914+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:03.153681+0000', 'last_undegraded': '2024-09-12T22:48:03.153681+0000', 'last_fullsized': '2024-09-12T22:48:03.153681+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:48:08.849 INFO:tasks.ceph.ceph_manager.ceph:PG 3.f is not active+clean 2024-09-12T22:48:08.849 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:48:03.153784+0000', 'last_change': '2024-09-12T22:48:03.153784+0000', 'last_active': '2024-09-12T22:48:03.149914+0000', 'last_peered': '2024-09-12T22:48:03.149914+0000', 'last_clean': '2024-09-12T22:48:03.149914+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:03.153784+0000', 'last_undegraded': '2024-09-12T22:48:03.153784+0000', 'last_fullsized': '2024-09-12T22:48:03.153784+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:48:08.849 INFO:tasks.ceph.ceph_manager.ceph:PG 4.8 is not active+clean 2024-09-12T22:48:08.849 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.849 INFO:tasks.ceph.ceph_manager.ceph:PG 3.e is not active+clean 2024-09-12T22:48:08.849 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:48:03.153755+0000', 'last_change': '2024-09-12T22:48:03.153755+0000', 'last_active': '2024-09-12T22:48:03.149914+0000', 'last_peered': '2024-09-12T22:48:03.149914+0000', 'last_clean': '2024-09-12T22:48:03.149914+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:03.153755+0000', 'last_undegraded': '2024-09-12T22:48:03.153755+0000', 'last_fullsized': '2024-09-12T22:48:03.153755+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T22:48:08.849 INFO:tasks.ceph.ceph_manager.ceph:PG 4.9 is not active+clean 2024-09-12T22:48:08.849 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.850 INFO:tasks.ceph.ceph_manager.ceph:PG 3.d is not active+clean 2024-09-12T22:48:08.850 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:48:03.154717+0000', 'last_change': '2024-09-12T22:48:03.154717+0000', 'last_active': '2024-09-12T22:48:03.149914+0000', 'last_peered': '2024-09-12T22:48:03.149914+0000', 'last_clean': '2024-09-12T22:48:03.149914+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:03.154717+0000', 'last_undegraded': '2024-09-12T22:48:03.154717+0000', 'last_fullsized': '2024-09-12T22:48:03.154717+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:48:08.850 INFO:tasks.ceph.ceph_manager.ceph:PG 4.a is not active+clean 2024-09-12T22:48:08.850 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.850 INFO:tasks.ceph.ceph_manager.ceph:PG 3.c is not active+clean 2024-09-12T22:48:08.850 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:48:03.153799+0000', 'last_change': '2024-09-12T22:48:03.153799+0000', 'last_active': '2024-09-12T22:48:03.149914+0000', 'last_peered': '2024-09-12T22:48:03.149914+0000', 'last_clean': '2024-09-12T22:48:03.149914+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:03.153799+0000', 'last_undegraded': '2024-09-12T22:48:03.153799+0000', 'last_fullsized': '2024-09-12T22:48:03.153799+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:48:08.850 INFO:tasks.ceph.ceph_manager.ceph:PG 4.b is not active+clean 2024-09-12T22:48:08.850 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.850 INFO:tasks.ceph.ceph_manager.ceph:PG 3.b is not active+clean 2024-09-12T22:48:08.850 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:48:03.155739+0000', 'last_change': '2024-09-12T22:48:03.155739+0000', 'last_active': '2024-09-12T22:48:03.149914+0000', 'last_peered': '2024-09-12T22:48:03.149914+0000', 'last_clean': '2024-09-12T22:48:03.149914+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:03.155739+0000', 'last_undegraded': '2024-09-12T22:48:03.155739+0000', 'last_fullsized': '2024-09-12T22:48:03.155739+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T22:48:08.851 INFO:tasks.ceph.ceph_manager.ceph:PG 4.c is not active+clean 2024-09-12T22:48:08.851 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.851 INFO:tasks.ceph.ceph_manager.ceph:PG 3.a is not active+clean 2024-09-12T22:48:08.851 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:48:03.153693+0000', 'last_change': '2024-09-12T22:48:03.153693+0000', 'last_active': '2024-09-12T22:48:03.149914+0000', 'last_peered': '2024-09-12T22:48:03.149914+0000', 'last_clean': '2024-09-12T22:48:03.149914+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:03.153693+0000', 'last_undegraded': '2024-09-12T22:48:03.153693+0000', 'last_fullsized': '2024-09-12T22:48:03.153693+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:48:08.851 INFO:tasks.ceph.ceph_manager.ceph:PG 4.d is not active+clean 2024-09-12T22:48:08.851 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.851 INFO:tasks.ceph.ceph_manager.ceph:PG 3.9 is not active+clean 2024-09-12T22:48:08.851 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:48:03.153703+0000', 'last_change': '2024-09-12T22:48:03.153703+0000', 'last_active': '2024-09-12T22:48:03.149914+0000', 'last_peered': '2024-09-12T22:48:03.149914+0000', 'last_clean': '2024-09-12T22:48:03.149914+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:03.153703+0000', 'last_undegraded': '2024-09-12T22:48:03.153703+0000', 'last_fullsized': '2024-09-12T22:48:03.153703+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T22:48:08.851 INFO:tasks.ceph.ceph_manager.ceph:PG 4.e is not active+clean 2024-09-12T22:48:08.851 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.851 INFO:tasks.ceph.ceph_manager.ceph:PG 3.8 is not active+clean 2024-09-12T22:48:08.851 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:48:03.154787+0000', 'last_change': '2024-09-12T22:48:03.154787+0000', 'last_active': '2024-09-12T22:48:03.149914+0000', 'last_peered': '2024-09-12T22:48:03.149914+0000', 'last_clean': '2024-09-12T22:48:03.149914+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:03.154787+0000', 'last_undegraded': '2024-09-12T22:48:03.154787+0000', 'last_fullsized': '2024-09-12T22:48:03.154787+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T22:48:08.852 INFO:tasks.ceph.ceph_manager.ceph:PG 4.f is not active+clean 2024-09-12T22:48:08.852 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.852 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2 is not active+clean 2024-09-12T22:48:08.852 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:48:03.155711+0000', 'last_change': '2024-09-12T22:48:03.155711+0000', 'last_active': '2024-09-12T22:48:03.149914+0000', 'last_peered': '2024-09-12T22:48:03.149914+0000', 'last_clean': '2024-09-12T22:48:03.149914+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:03.155711+0000', 'last_undegraded': '2024-09-12T22:48:03.155711+0000', 'last_fullsized': '2024-09-12T22:48:03.155711+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T22:48:08.852 INFO:tasks.ceph.ceph_manager.ceph:PG 4.5 is not active+clean 2024-09-12T22:48:08.852 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.852 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1 is not active+clean 2024-09-12T22:48:08.852 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:48:03.155751+0000', 'last_change': '2024-09-12T22:48:03.155751+0000', 'last_active': '2024-09-12T22:48:03.149914+0000', 'last_peered': '2024-09-12T22:48:03.149914+0000', 'last_clean': '2024-09-12T22:48:03.149914+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:03.155751+0000', 'last_undegraded': '2024-09-12T22:48:03.155751+0000', 'last_fullsized': '2024-09-12T22:48:03.155751+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T22:48:08.852 INFO:tasks.ceph.ceph_manager.ceph:PG 4.6 is not active+clean 2024-09-12T22:48:08.852 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.853 INFO:tasks.ceph.ceph_manager.ceph:PG 3.0 is not active+clean 2024-09-12T22:48:08.853 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:48:03.153665+0000', 'last_change': '2024-09-12T22:48:03.153665+0000', 'last_active': '2024-09-12T22:48:03.149914+0000', 'last_peered': '2024-09-12T22:48:03.149914+0000', 'last_clean': '2024-09-12T22:48:03.149914+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:03.153665+0000', 'last_undegraded': '2024-09-12T22:48:03.153665+0000', 'last_fullsized': '2024-09-12T22:48:03.153665+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T22:48:08.853 INFO:tasks.ceph.ceph_manager.ceph:PG 4.7 is not active+clean 2024-09-12T22:48:08.853 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.854 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3 is not active+clean 2024-09-12T22:48:08.854 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:48:03.153693+0000', 'last_change': '2024-09-12T22:48:03.153693+0000', 'last_active': '2024-09-12T22:48:03.149914+0000', 'last_peered': '2024-09-12T22:48:03.149914+0000', 'last_clean': '2024-09-12T22:48:03.149914+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:03.153693+0000', 'last_undegraded': '2024-09-12T22:48:03.153693+0000', 'last_fullsized': '2024-09-12T22:48:03.153693+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:48:08.854 INFO:tasks.ceph.ceph_manager.ceph:PG 4.4 is not active+clean 2024-09-12T22:48:08.854 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.854 INFO:tasks.ceph.ceph_manager.ceph:PG 3.5 is not active+clean 2024-09-12T22:48:08.854 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:48:03.153815+0000', 'last_change': '2024-09-12T22:48:03.153815+0000', 'last_active': '2024-09-12T22:48:03.149914+0000', 'last_peered': '2024-09-12T22:48:03.149914+0000', 'last_clean': '2024-09-12T22:48:03.149914+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:03.153815+0000', 'last_undegraded': '2024-09-12T22:48:03.153815+0000', 'last_fullsized': '2024-09-12T22:48:03.153815+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:48:08.854 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2 is not active+clean 2024-09-12T22:48:08.854 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.854 INFO:tasks.ceph.ceph_manager.ceph:PG 3.4 is not active+clean 2024-09-12T22:48:08.854 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:48:03.155702+0000', 'last_change': '2024-09-12T22:48:03.155702+0000', 'last_active': '2024-09-12T22:48:03.149914+0000', 'last_peered': '2024-09-12T22:48:03.149914+0000', 'last_clean': '2024-09-12T22:48:03.149914+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:03.155702+0000', 'last_undegraded': '2024-09-12T22:48:03.155702+0000', 'last_fullsized': '2024-09-12T22:48:03.155702+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T22:48:08.855 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3 is not active+clean 2024-09-12T22:48:08.855 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.855 INFO:tasks.ceph.ceph_manager.ceph:PG 3.7 is not active+clean 2024-09-12T22:48:08.855 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:48:03.155721+0000', 'last_change': '2024-09-12T22:48:03.155721+0000', 'last_active': '2024-09-12T22:48:03.149914+0000', 'last_peered': '2024-09-12T22:48:03.149914+0000', 'last_clean': '2024-09-12T22:48:03.149914+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:03.155721+0000', 'last_undegraded': '2024-09-12T22:48:03.155721+0000', 'last_fullsized': '2024-09-12T22:48:03.155721+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T22:48:08.855 INFO:tasks.ceph.ceph_manager.ceph:PG 4.0 is not active+clean 2024-09-12T22:48:08.855 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.855 INFO:tasks.ceph.ceph_manager.ceph:PG 3.6 is not active+clean 2024-09-12T22:48:08.855 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:48:03.155702+0000', 'last_change': '2024-09-12T22:48:03.155702+0000', 'last_active': '2024-09-12T22:48:03.149914+0000', 'last_peered': '2024-09-12T22:48:03.149914+0000', 'last_clean': '2024-09-12T22:48:03.149914+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:03.155702+0000', 'last_undegraded': '2024-09-12T22:48:03.155702+0000', 'last_fullsized': '2024-09-12T22:48:03.155702+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T22:48:08.855 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1 is not active+clean 2024-09-12T22:48:08.855 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.855 INFO:tasks.ceph.ceph_manager.ceph:PG 4.13 is not active+clean 2024-09-12T22:48:08.856 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.856 INFO:tasks.ceph.ceph_manager.ceph:PG 3.14 is not active+clean 2024-09-12T22:48:08.856 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:48:03.154607+0000', 'last_change': '2024-09-12T22:48:03.154607+0000', 'last_active': '2024-09-12T22:48:03.149914+0000', 'last_peered': '2024-09-12T22:48:03.149914+0000', 'last_clean': '2024-09-12T22:48:03.149914+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:03.154607+0000', 'last_undegraded': '2024-09-12T22:48:03.154607+0000', 'last_fullsized': '2024-09-12T22:48:03.154607+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:48:08.856 INFO:tasks.ceph.ceph_manager.ceph:PG 4.12 is not active+clean 2024-09-12T22:48:08.856 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.856 INFO:tasks.ceph.ceph_manager.ceph:PG 3.15 is not active+clean 2024-09-12T22:48:08.856 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:48:03.153669+0000', 'last_change': '2024-09-12T22:48:03.153669+0000', 'last_active': '2024-09-12T22:48:03.149914+0000', 'last_peered': '2024-09-12T22:48:03.149914+0000', 'last_clean': '2024-09-12T22:48:03.149914+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:03.153669+0000', 'last_undegraded': '2024-09-12T22:48:03.153669+0000', 'last_fullsized': '2024-09-12T22:48:03.153669+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T22:48:08.856 INFO:tasks.ceph.ceph_manager.ceph:PG 3.16 is not active+clean 2024-09-12T22:48:08.856 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:48:03.153850+0000', 'last_change': '2024-09-12T22:48:03.153850+0000', 'last_active': '2024-09-12T22:48:03.149914+0000', 'last_peered': '2024-09-12T22:48:03.149914+0000', 'last_clean': '2024-09-12T22:48:03.149914+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:03.153850+0000', 'last_undegraded': '2024-09-12T22:48:03.153850+0000', 'last_fullsized': '2024-09-12T22:48:03.153850+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:48:08.856 INFO:tasks.ceph.ceph_manager.ceph:PG 4.11 is not active+clean 2024-09-12T22:48:08.856 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.857 INFO:tasks.ceph.ceph_manager.ceph:PG 3.17 is not active+clean 2024-09-12T22:48:08.857 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:48:03.156673+0000', 'last_change': '2024-09-12T22:48:03.156673+0000', 'last_active': '2024-09-12T22:48:03.149914+0000', 'last_peered': '2024-09-12T22:48:03.149914+0000', 'last_clean': '2024-09-12T22:48:03.149914+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:03.156673+0000', 'last_undegraded': '2024-09-12T22:48:03.156673+0000', 'last_fullsized': '2024-09-12T22:48:03.156673+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T22:48:08.857 INFO:tasks.ceph.ceph_manager.ceph:PG 4.10 is not active+clean 2024-09-12T22:48:08.857 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.857 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1f is not active+clean 2024-09-12T22:48:08.857 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.857 INFO:tasks.ceph.ceph_manager.ceph:PG 3.18 is not active+clean 2024-09-12T22:48:08.857 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:48:03.157013+0000', 'last_change': '2024-09-12T22:48:03.157013+0000', 'last_active': '2024-09-12T22:48:03.149914+0000', 'last_peered': '2024-09-12T22:48:03.149914+0000', 'last_clean': '2024-09-12T22:48:03.149914+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:03.157013+0000', 'last_undegraded': '2024-09-12T22:48:03.157013+0000', 'last_fullsized': '2024-09-12T22:48:03.157013+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T22:48:08.857 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1e is not active+clean 2024-09-12T22:48:08.857 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.858 INFO:tasks.ceph.ceph_manager.ceph:PG 3.19 is not active+clean 2024-09-12T22:48:08.858 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:48:03.156603+0000', 'last_change': '2024-09-12T22:48:03.156603+0000', 'last_active': '2024-09-12T22:48:03.149914+0000', 'last_peered': '2024-09-12T22:48:03.149914+0000', 'last_clean': '2024-09-12T22:48:03.149914+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:03.156603+0000', 'last_undegraded': '2024-09-12T22:48:03.156603+0000', 'last_fullsized': '2024-09-12T22:48:03.156603+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T22:48:08.858 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1d is not active+clean 2024-09-12T22:48:08.858 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.858 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1a is not active+clean 2024-09-12T22:48:08.858 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:48:03.153721+0000', 'last_change': '2024-09-12T22:48:03.153721+0000', 'last_active': '2024-09-12T22:48:03.149914+0000', 'last_peered': '2024-09-12T22:48:03.149914+0000', 'last_clean': '2024-09-12T22:48:03.149914+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:03.153721+0000', 'last_undegraded': '2024-09-12T22:48:03.153721+0000', 'last_fullsized': '2024-09-12T22:48:03.153721+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T22:48:08.858 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1c is not active+clean 2024-09-12T22:48:08.858 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.858 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1b is not active+clean 2024-09-12T22:48:08.858 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:48:03.153736+0000', 'last_change': '2024-09-12T22:48:03.153736+0000', 'last_active': '2024-09-12T22:48:03.149914+0000', 'last_peered': '2024-09-12T22:48:03.149914+0000', 'last_clean': '2024-09-12T22:48:03.149914+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:03.153736+0000', 'last_undegraded': '2024-09-12T22:48:03.153736+0000', 'last_fullsized': '2024-09-12T22:48:03.153736+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T22:48:08.858 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1b is not active+clean 2024-09-12T22:48:08.858 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.859 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1c is not active+clean 2024-09-12T22:48:08.859 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:48:03.154982+0000', 'last_change': '2024-09-12T22:48:03.154982+0000', 'last_active': '2024-09-12T22:48:03.149914+0000', 'last_peered': '2024-09-12T22:48:03.149914+0000', 'last_clean': '2024-09-12T22:48:03.149914+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:03.154982+0000', 'last_undegraded': '2024-09-12T22:48:03.154982+0000', 'last_fullsized': '2024-09-12T22:48:03.154982+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:48:08.859 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1a is not active+clean 2024-09-12T22:48:08.859 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.859 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1d is not active+clean 2024-09-12T22:48:08.859 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:48:03.154307+0000', 'last_change': '2024-09-12T22:48:03.154307+0000', 'last_active': '2024-09-12T22:48:03.149914+0000', 'last_peered': '2024-09-12T22:48:03.149914+0000', 'last_clean': '2024-09-12T22:48:03.149914+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:03.154307+0000', 'last_undegraded': '2024-09-12T22:48:03.154307+0000', 'last_fullsized': '2024-09-12T22:48:03.154307+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T22:48:08.859 INFO:tasks.ceph.ceph_manager.ceph:PG 4.19 is not active+clean 2024-09-12T22:48:08.860 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.860 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1e is not active+clean 2024-09-12T22:48:08.860 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:48:03.156689+0000', 'last_change': '2024-09-12T22:48:03.156689+0000', 'last_active': '2024-09-12T22:48:03.149914+0000', 'last_peered': '2024-09-12T22:48:03.149914+0000', 'last_clean': '2024-09-12T22:48:03.149914+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:03.156689+0000', 'last_undegraded': '2024-09-12T22:48:03.156689+0000', 'last_fullsized': '2024-09-12T22:48:03.156689+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T22:48:08.860 INFO:tasks.ceph.ceph_manager.ceph:PG 4.18 is not active+clean 2024-09-12T22:48:08.860 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:48:04.151535+0000', 'last_change': '2024-09-12T22:48:04.151535+0000', 'last_active': '2024-09-12T22:48:04.151535+0000', 'last_peered': '2024-09-12T22:48:04.151535+0000', 'last_clean': '2024-09-12T22:48:04.151535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:04.151535+0000', 'last_undegraded': '2024-09-12T22:48:04.151535+0000', 'last_fullsized': '2024-09-12T22:48:04.151535+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:04.151535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:48:08.860 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1f is not active+clean 2024-09-12T22:48:08.860 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:48:03.157857+0000', 'last_change': '2024-09-12T22:48:03.157857+0000', 'last_active': '2024-09-12T22:48:03.149914+0000', 'last_peered': '2024-09-12T22:48:03.149914+0000', 'last_clean': '2024-09-12T22:48:03.149914+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:48:03.157857+0000', 'last_undegraded': '2024-09-12T22:48:03.157857+0000', 'last_fullsized': '2024-09-12T22:48:03.157857+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'last_clean_scrub_stamp': '2024-09-12T22:48:03.149914+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T22:48:08.861 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T22:48:09.231 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:48:09.231 INFO:teuthology.orchestra.run.smithi066.stdout:{"fsid":"5714c6a5-034c-4330-a57b-d22492ad8e43","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":25,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":20,"num_osds":3,"num_up_osds":3,"osd_up_since":1726181274,"num_in_osds":3,"osd_in_since":1726181264,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":4,"data_bytes":590387,"bytes_used":88915968,"bytes_avail":289821376512,"bytes_total":289910292480,"unknown_pgs_ratio":0.60952383279800415,"inactive_pgs_ratio":0.30476191639900208,"write_bytes_sec":411,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":5,"btime":"2024-09-12T22:48:07:173973+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4227}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-12T22:47:43.882445+0000","services":{}},"progress_events":{}} 2024-09-12T22:48:09.244 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T22:48:09.244 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:48:09.537 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:48:09.539 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-09-12T22:48:09.548 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-12T22:48:08.671725+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":205,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86832,"kb_used_data":1576,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283028688,"statfs":{"total":289910292480,"available":289821376512,"internally_reserved":0,"allocated":1613824,"data_stored":1315003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.544477"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.154640+0000","last_change":"2024-09-12T22:48:03.154640+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.154640+0000","last_undegraded":"2024-09-12T22:48:03.154640+0000","last_fullsized":"2024-09-12T22:48:03.154640+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.156571+0000","last_change":"2024-09-12T22:48:03.156571+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.156571+0000","last_undegraded":"2024-09-12T22:48:03.156571+0000","last_fullsized":"2024-09-12T22:48:03.156571+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.154357+0000","last_change":"2024-09-12T22:48:03.154357+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.154357+0000","last_undegraded":"2024-09-12T22:48:03.154357+0000","last_fullsized":"2024-09-12T22:48:03.154357+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153681+0000","last_change":"2024-09-12T22:48:03.153681+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153681+0000","last_undegraded":"2024-09-12T22:48:03.153681+0000","last_fullsized":"2024-09-12T22:48:03.153681+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153784+0000","last_change":"2024-09-12T22:48:03.153784+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153784+0000","last_undegraded":"2024-09-12T22:48:03.153784+0000","last_fullsized":"2024-09-12T22:48:03.153784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153755+0000","last_change":"2024-09-12T22:48:03.153755+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153755+0000","last_undegraded":"2024-09-12T22:48:03.153755+0000","last_fullsized":"2024-09-12T22:48:03.153755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.154717+0000","last_change":"2024-09-12T22:48:03.154717+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.154717+0000","last_undegraded":"2024-09-12T22:48:03.154717+0000","last_fullsized":"2024-09-12T22:48:03.154717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153799+0000","last_change":"2024-09-12T22:48:03.153799+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153799+0000","last_undegraded":"2024-09-12T22:48:03.153799+0000","last_fullsized":"2024-09-12T22:48:03.153799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.155739+0000","last_change":"2024-09-12T22:48:03.155739+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.155739+0000","last_undegraded":"2024-09-12T22:48:03.155739+0000","last_fullsized":"2024-09-12T22:48:03.155739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153693+0000","last_change":"2024-09-12T22:48:03.153693+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153693+0000","last_undegraded":"2024-09-12T22:48:03.153693+0000","last_fullsized":"2024-09-12T22:48:03.153693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153703+0000","last_change":"2024-09-12T22:48:03.153703+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153703+0000","last_undegraded":"2024-09-12T22:48:03.153703+0000","last_fullsized":"2024-09-12T22:48:03.153703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.154787+0000","last_change":"2024-09-12T22:48:03.154787+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.154787+0000","last_undegraded":"2024-09-12T22:48:03.154787+0000","last_fullsized":"2024-09-12T22:48:03.154787+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":218,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:48:03.155440+0000","last_change":"2024-09-12T22:47:56.028830+0000","last_active":"2024-09-12T22:48:03.155440+0000","last_peered":"2024-09-12T22:48:03.155440+0000","last_clean":"2024-09-12T22:48:03.155440+0000","last_became_active":"2024-09-12T22:47:56.028017+0000","last_became_peered":"2024-09-12T22:47:56.028017+0000","last_unstale":"2024-09-12T22:48:03.155440+0000","last_undegraded":"2024-09-12T22:48:03.155440+0000","last_fullsized":"2024-09-12T22:48:03.155440+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:55.016634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:55.016634+0000","last_clean_scrub_stamp":"2024-09-12T22:47:55.016634+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:03.648827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":22,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:48:03.155607+0000","last_change":"2024-09-12T22:48:02.045816+0000","last_active":"2024-09-12T22:48:03.155607+0000","last_peered":"2024-09-12T22:48:03.155607+0000","last_clean":"2024-09-12T22:48:03.155607+0000","last_became_active":"2024-09-12T22:48:00.045324+0000","last_became_peered":"2024-09-12T22:48:00.045324+0000","last_unstale":"2024-09-12T22:48:03.155607+0000","last_undegraded":"2024-09-12T22:48:03.155607+0000","last_fullsized":"2024-09-12T22:48:03.155607+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:41:33.998543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065526500000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.155711+0000","last_change":"2024-09-12T22:48:03.155711+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.155711+0000","last_undegraded":"2024-09-12T22:48:03.155711+0000","last_fullsized":"2024-09-12T22:48:03.155711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:48:03.155379+0000","last_change":"2024-09-12T22:48:02.045525+0000","last_active":"2024-09-12T22:48:03.155379+0000","last_peered":"2024-09-12T22:48:03.155379+0000","last_clean":"2024-09-12T22:48:03.155379+0000","last_became_active":"2024-09-12T22:48:00.042207+0000","last_became_peered":"2024-09-12T22:48:00.042207+0000","last_unstale":"2024-09-12T22:48:03.155379+0000","last_undegraded":"2024-09-12T22:48:03.155379+0000","last_fullsized":"2024-09-12T22:48:03.155379+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:33.150497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040973099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.155751+0000","last_change":"2024-09-12T22:48:03.155751+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.155751+0000","last_undegraded":"2024-09-12T22:48:03.155751+0000","last_fullsized":"2024-09-12T22:48:03.155751+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:48:03.154476+0000","last_change":"2024-09-12T22:48:02.045209+0000","last_active":"2024-09-12T22:48:03.154476+0000","last_peered":"2024-09-12T22:48:03.154476+0000","last_clean":"2024-09-12T22:48:03.154476+0000","last_became_active":"2024-09-12T22:48:00.042007+0000","last_became_peered":"2024-09-12T22:48:00.042007+0000","last_unstale":"2024-09-12T22:48:03.154476+0000","last_undegraded":"2024-09-12T22:48:03.154476+0000","last_fullsized":"2024-09-12T22:48:03.154476+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:13.536542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036893100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153665+0000","last_change":"2024-09-12T22:48:03.153665+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153665+0000","last_undegraded":"2024-09-12T22:48:03.153665+0000","last_fullsized":"2024-09-12T22:48:03.153665+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":23,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:48:03.155557+0000","last_change":"2024-09-12T22:48:02.045684+0000","last_active":"2024-09-12T22:48:03.155557+0000","last_peered":"2024-09-12T22:48:03.155557+0000","last_clean":"2024-09-12T22:48:03.155557+0000","last_became_active":"2024-09-12T22:48:00.045286+0000","last_became_peered":"2024-09-12T22:48:00.045286+0000","last_unstale":"2024-09-12T22:48:03.155557+0000","last_undegraded":"2024-09-12T22:48:03.155557+0000","last_fullsized":"2024-09-12T22:48:03.155557+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:18:11.667143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052714799999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153693+0000","last_change":"2024-09-12T22:48:03.153693+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153693+0000","last_undegraded":"2024-09-12T22:48:03.153693+0000","last_fullsized":"2024-09-12T22:48:03.153693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153815+0000","last_change":"2024-09-12T22:48:03.153815+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153815+0000","last_undegraded":"2024-09-12T22:48:03.153815+0000","last_fullsized":"2024-09-12T22:48:03.153815+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:48:03.154554+0000","last_change":"2024-09-12T22:48:02.045324+0000","last_active":"2024-09-12T22:48:03.154554+0000","last_peered":"2024-09-12T22:48:03.154554+0000","last_clean":"2024-09-12T22:48:03.154554+0000","last_became_active":"2024-09-12T22:48:00.042132+0000","last_became_peered":"2024-09-12T22:48:00.042132+0000","last_unstale":"2024-09-12T22:48:03.154554+0000","last_undegraded":"2024-09-12T22:48:03.154554+0000","last_fullsized":"2024-09-12T22:48:03.154554+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:24.673019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047590600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.155702+0000","last_change":"2024-09-12T22:48:03.155702+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.155702+0000","last_undegraded":"2024-09-12T22:48:03.155702+0000","last_fullsized":"2024-09-12T22:48:03.155702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:48:03.155196+0000","last_change":"2024-09-12T22:48:02.045390+0000","last_active":"2024-09-12T22:48:03.155196+0000","last_peered":"2024-09-12T22:48:03.155196+0000","last_clean":"2024-09-12T22:48:03.155196+0000","last_became_active":"2024-09-12T22:48:00.045356+0000","last_became_peered":"2024-09-12T22:48:00.045356+0000","last_unstale":"2024-09-12T22:48:03.155196+0000","last_undegraded":"2024-09-12T22:48:03.155196+0000","last_fullsized":"2024-09-12T22:48:03.155196+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:32.072080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040621599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.155721+0000","last_change":"2024-09-12T22:48:03.155721+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.155721+0000","last_undegraded":"2024-09-12T22:48:03.155721+0000","last_fullsized":"2024-09-12T22:48:03.155721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:48:03.154585+0000","last_change":"2024-09-12T22:48:02.045428+0000","last_active":"2024-09-12T22:48:03.154585+0000","last_peered":"2024-09-12T22:48:03.154585+0000","last_clean":"2024-09-12T22:48:03.154585+0000","last_became_active":"2024-09-12T22:48:00.040536+0000","last_became_peered":"2024-09-12T22:48:00.040536+0000","last_unstale":"2024-09-12T22:48:03.154585+0000","last_undegraded":"2024-09-12T22:48:03.154585+0000","last_fullsized":"2024-09-12T22:48:03.154585+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:33.150497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057699499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.155702+0000","last_change":"2024-09-12T22:48:03.155702+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.155702+0000","last_undegraded":"2024-09-12T22:48:03.155702+0000","last_fullsized":"2024-09-12T22:48:03.155702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:48:03.155759+0000","last_change":"2024-09-12T22:48:02.045500+0000","last_active":"2024-09-12T22:48:03.155759+0000","last_peered":"2024-09-12T22:48:03.155759+0000","last_clean":"2024-09-12T22:48:03.155759+0000","last_became_active":"2024-09-12T22:48:00.042210+0000","last_became_peered":"2024-09-12T22:48:00.042210+0000","last_unstale":"2024-09-12T22:48:03.155759+0000","last_undegraded":"2024-09-12T22:48:03.155759+0000","last_fullsized":"2024-09-12T22:48:03.155759+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:35:14.212372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035339799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.154607+0000","last_change":"2024-09-12T22:48:03.154607+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.154607+0000","last_undegraded":"2024-09-12T22:48:03.154607+0000","last_fullsized":"2024-09-12T22:48:03.154607+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153669+0000","last_change":"2024-09-12T22:48:03.153669+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153669+0000","last_undegraded":"2024-09-12T22:48:03.153669+0000","last_fullsized":"2024-09-12T22:48:03.153669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153850+0000","last_change":"2024-09-12T22:48:03.153850+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153850+0000","last_undegraded":"2024-09-12T22:48:03.153850+0000","last_fullsized":"2024-09-12T22:48:03.153850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.156673+0000","last_change":"2024-09-12T22:48:03.156673+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.156673+0000","last_undegraded":"2024-09-12T22:48:03.156673+0000","last_fullsized":"2024-09-12T22:48:03.156673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.157013+0000","last_change":"2024-09-12T22:48:03.157013+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.157013+0000","last_undegraded":"2024-09-12T22:48:03.157013+0000","last_fullsized":"2024-09-12T22:48:03.157013+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.156603+0000","last_change":"2024-09-12T22:48:03.156603+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.156603+0000","last_undegraded":"2024-09-12T22:48:03.156603+0000","last_fullsized":"2024-09-12T22:48:03.156603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153721+0000","last_change":"2024-09-12T22:48:03.153721+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153721+0000","last_undegraded":"2024-09-12T22:48:03.153721+0000","last_fullsized":"2024-09-12T22:48:03.153721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.153736+0000","last_change":"2024-09-12T22:48:03.153736+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.153736+0000","last_undegraded":"2024-09-12T22:48:03.153736+0000","last_fullsized":"2024-09-12T22:48:03.153736+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.154982+0000","last_change":"2024-09-12T22:48:03.154982+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.154982+0000","last_undegraded":"2024-09-12T22:48:03.154982+0000","last_fullsized":"2024-09-12T22:48:03.154982+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.154307+0000","last_change":"2024-09-12T22:48:03.154307+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.154307+0000","last_undegraded":"2024-09-12T22:48:03.154307+0000","last_fullsized":"2024-09-12T22:48:03.154307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.156689+0000","last_change":"2024-09-12T22:48:03.156689+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.156689+0000","last_undegraded":"2024-09-12T22:48:03.156689+0000","last_fullsized":"2024-09-12T22:48:03.156689+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:48:04.151535+0000","last_change":"2024-09-12T22:48:04.151535+0000","last_active":"2024-09-12T22:48:04.151535+0000","last_peered":"2024-09-12T22:48:04.151535+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:04.151535+0000","last_undegraded":"2024-09-12T22:48:04.151535+0000","last_fullsized":"2024-09-12T22:48:04.151535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:48:03.157857+0000","last_change":"2024-09-12T22:48:03.157857+0000","last_active":"2024-09-12T22:48:03.149914+0000","last_peered":"2024-09-12T22:48:03.149914+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:48:03.157857+0000","last_undegraded":"2024-09-12T22:48:03.157857+0000","last_fullsized":"2024-09-12T22:48:03.157857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":737280,"data_stored":635130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":143360,"data_stored":44762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":733184,"data_stored":635111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:48:12.554 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:48:12.870 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:48:12.871 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-09-12T22:48:12.881 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-12T22:48:12.128665+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86980,"kb_used_data":1728,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283028540,"statfs":{"total":289910292480,"available":289821224960,"internally_reserved":0,"allocated":1769472,"data_stored":1371148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.969110"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677255+0000","last_change":"2024-09-12T22:48:05.174190+0000","last_active":"2024-09-12T22:48:08.677255+0000","last_peered":"2024-09-12T22:48:08.677255+0000","last_clean":"2024-09-12T22:48:08.677255+0000","last_became_active":"2024-09-12T22:48:05.172964+0000","last_became_peered":"2024-09-12T22:48:05.172964+0000","last_unstale":"2024-09-12T22:48:08.677255+0000","last_undegraded":"2024-09-12T22:48:08.677255+0000","last_fullsized":"2024-09-12T22:48:08.677255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:49.868891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676980+0000","last_change":"2024-09-12T22:48:05.173045+0000","last_active":"2024-09-12T22:48:08.676980+0000","last_peered":"2024-09-12T22:48:08.676980+0000","last_clean":"2024-09-12T22:48:08.676980+0000","last_became_active":"2024-09-12T22:48:05.172684+0000","last_became_peered":"2024-09-12T22:48:05.172684+0000","last_unstale":"2024-09-12T22:48:08.676980+0000","last_undegraded":"2024-09-12T22:48:08.676980+0000","last_fullsized":"2024-09-12T22:48:08.676980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:51.360504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679907+0000","last_change":"2024-09-12T22:48:05.178267+0000","last_active":"2024-09-12T22:48:08.679907+0000","last_peered":"2024-09-12T22:48:08.679907+0000","last_clean":"2024-09-12T22:48:08.679907+0000","last_became_active":"2024-09-12T22:48:05.177555+0000","last_became_peered":"2024-09-12T22:48:05.177555+0000","last_unstale":"2024-09-12T22:48:08.679907+0000","last_undegraded":"2024-09-12T22:48:08.679907+0000","last_fullsized":"2024-09-12T22:48:08.679907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:58.991752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679782+0000","last_change":"2024-09-12T22:48:05.173539+0000","last_active":"2024-09-12T22:48:08.679782+0000","last_peered":"2024-09-12T22:48:08.679782+0000","last_clean":"2024-09-12T22:48:08.679782+0000","last_became_active":"2024-09-12T22:48:05.172647+0000","last_became_peered":"2024-09-12T22:48:05.172647+0000","last_unstale":"2024-09-12T22:48:08.679782+0000","last_undegraded":"2024-09-12T22:48:08.679782+0000","last_fullsized":"2024-09-12T22:48:08.679782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:56:34.490182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676660+0000","last_change":"2024-09-12T22:48:05.170306+0000","last_active":"2024-09-12T22:48:08.676660+0000","last_peered":"2024-09-12T22:48:08.676660+0000","last_clean":"2024-09-12T22:48:08.676660+0000","last_became_active":"2024-09-12T22:48:05.169940+0000","last_became_peered":"2024-09-12T22:48:05.169940+0000","last_unstale":"2024-09-12T22:48:08.676660+0000","last_undegraded":"2024-09-12T22:48:08.676660+0000","last_fullsized":"2024-09-12T22:48:08.676660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:52.341512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679410+0000","last_change":"2024-09-12T22:48:05.173232+0000","last_active":"2024-09-12T22:48:08.679410+0000","last_peered":"2024-09-12T22:48:08.679410+0000","last_clean":"2024-09-12T22:48:08.679410+0000","last_became_active":"2024-09-12T22:48:05.172213+0000","last_became_peered":"2024-09-12T22:48:05.172213+0000","last_unstale":"2024-09-12T22:48:08.679410+0000","last_undegraded":"2024-09-12T22:48:08.679410+0000","last_fullsized":"2024-09-12T22:48:08.679410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:25.994320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679563+0000","last_change":"2024-09-12T22:48:05.172187+0000","last_active":"2024-09-12T22:48:08.679563+0000","last_peered":"2024-09-12T22:48:08.679563+0000","last_clean":"2024-09-12T22:48:08.679563+0000","last_became_active":"2024-09-12T22:48:05.171766+0000","last_became_peered":"2024-09-12T22:48:05.171766+0000","last_unstale":"2024-09-12T22:48:08.679563+0000","last_undegraded":"2024-09-12T22:48:08.679563+0000","last_fullsized":"2024-09-12T22:48:08.679563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:49.868891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679126+0000","last_change":"2024-09-12T22:48:05.174326+0000","last_active":"2024-09-12T22:48:08.679126+0000","last_peered":"2024-09-12T22:48:08.679126+0000","last_clean":"2024-09-12T22:48:08.679126+0000","last_became_active":"2024-09-12T22:48:05.172312+0000","last_became_peered":"2024-09-12T22:48:05.172312+0000","last_unstale":"2024-09-12T22:48:08.679126+0000","last_undegraded":"2024-09-12T22:48:08.679126+0000","last_fullsized":"2024-09-12T22:48:08.679126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:52.071513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674344+0000","last_change":"2024-09-12T22:48:05.178445+0000","last_active":"2024-09-12T22:48:08.674344+0000","last_peered":"2024-09-12T22:48:08.674344+0000","last_clean":"2024-09-12T22:48:08.674344+0000","last_became_active":"2024-09-12T22:48:05.177284+0000","last_became_peered":"2024-09-12T22:48:05.177284+0000","last_unstale":"2024-09-12T22:48:08.674344+0000","last_undegraded":"2024-09-12T22:48:08.674344+0000","last_fullsized":"2024-09-12T22:48:08.674344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:45.140060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677090+0000","last_change":"2024-09-12T22:48:05.172480+0000","last_active":"2024-09-12T22:48:08.677090+0000","last_peered":"2024-09-12T22:48:08.677090+0000","last_clean":"2024-09-12T22:48:08.677090+0000","last_became_active":"2024-09-12T22:48:05.171686+0000","last_became_peered":"2024-09-12T22:48:05.171686+0000","last_unstale":"2024-09-12T22:48:08.677090+0000","last_undegraded":"2024-09-12T22:48:08.677090+0000","last_fullsized":"2024-09-12T22:48:08.677090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:56.158813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680327+0000","last_change":"2024-09-12T22:48:05.172837+0000","last_active":"2024-09-12T22:48:08.680327+0000","last_peered":"2024-09-12T22:48:08.680327+0000","last_clean":"2024-09-12T22:48:08.680327+0000","last_became_active":"2024-09-12T22:48:05.171890+0000","last_became_peered":"2024-09-12T22:48:05.171890+0000","last_unstale":"2024-09-12T22:48:08.680327+0000","last_undegraded":"2024-09-12T22:48:08.680327+0000","last_fullsized":"2024-09-12T22:48:08.680327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:46.965030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676812+0000","last_change":"2024-09-12T22:48:05.175666+0000","last_active":"2024-09-12T22:48:08.676812+0000","last_peered":"2024-09-12T22:48:08.676812+0000","last_clean":"2024-09-12T22:48:08.676812+0000","last_became_active":"2024-09-12T22:48:05.175390+0000","last_became_peered":"2024-09-12T22:48:05.175390+0000","last_unstale":"2024-09-12T22:48:08.676812+0000","last_undegraded":"2024-09-12T22:48:08.676812+0000","last_fullsized":"2024-09-12T22:48:08.676812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:13.160164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676555+0000","last_change":"2024-09-12T22:48:05.171356+0000","last_active":"2024-09-12T22:48:08.676555+0000","last_peered":"2024-09-12T22:48:08.676555+0000","last_clean":"2024-09-12T22:48:08.676555+0000","last_became_active":"2024-09-12T22:48:05.170794+0000","last_became_peered":"2024-09-12T22:48:05.170794+0000","last_unstale":"2024-09-12T22:48:08.676555+0000","last_undegraded":"2024-09-12T22:48:08.676555+0000","last_fullsized":"2024-09-12T22:48:08.676555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:42:56.969660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679530+0000","last_change":"2024-09-12T22:48:05.168780+0000","last_active":"2024-09-12T22:48:08.679530+0000","last_peered":"2024-09-12T22:48:08.679530+0000","last_clean":"2024-09-12T22:48:08.679530+0000","last_became_active":"2024-09-12T22:48:05.168294+0000","last_became_peered":"2024-09-12T22:48:05.168294+0000","last_unstale":"2024-09-12T22:48:08.679530+0000","last_undegraded":"2024-09-12T22:48:08.679530+0000","last_fullsized":"2024-09-12T22:48:08.679530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:30.120804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679600+0000","last_change":"2024-09-12T22:48:05.168344+0000","last_active":"2024-09-12T22:48:08.679600+0000","last_peered":"2024-09-12T22:48:08.679600+0000","last_clean":"2024-09-12T22:48:08.679600+0000","last_became_active":"2024-09-12T22:48:05.167805+0000","last_became_peered":"2024-09-12T22:48:05.167805+0000","last_unstale":"2024-09-12T22:48:08.679600+0000","last_undegraded":"2024-09-12T22:48:08.679600+0000","last_fullsized":"2024-09-12T22:48:08.679600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:32.288419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679162+0000","last_change":"2024-09-12T22:48:05.174663+0000","last_active":"2024-09-12T22:48:08.679162+0000","last_peered":"2024-09-12T22:48:08.679162+0000","last_clean":"2024-09-12T22:48:08.679162+0000","last_became_active":"2024-09-12T22:48:05.173101+0000","last_became_peered":"2024-09-12T22:48:05.173101+0000","last_unstale":"2024-09-12T22:48:08.679162+0000","last_undegraded":"2024-09-12T22:48:08.679162+0000","last_fullsized":"2024-09-12T22:48:08.679162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:25.143572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674747+0000","last_change":"2024-09-12T22:48:05.178721+0000","last_active":"2024-09-12T22:48:08.674747+0000","last_peered":"2024-09-12T22:48:08.674747+0000","last_clean":"2024-09-12T22:48:08.674747+0000","last_became_active":"2024-09-12T22:48:05.177965+0000","last_became_peered":"2024-09-12T22:48:05.177965+0000","last_unstale":"2024-09-12T22:48:08.674747+0000","last_undegraded":"2024-09-12T22:48:08.674747+0000","last_fullsized":"2024-09-12T22:48:08.674747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:32.288419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677222+0000","last_change":"2024-09-12T22:48:05.171053+0000","last_active":"2024-09-12T22:48:08.677222+0000","last_peered":"2024-09-12T22:48:08.677222+0000","last_clean":"2024-09-12T22:48:08.677222+0000","last_became_active":"2024-09-12T22:48:05.170578+0000","last_became_peered":"2024-09-12T22:48:05.170578+0000","last_unstale":"2024-09-12T22:48:08.677222+0000","last_undegraded":"2024-09-12T22:48:08.677222+0000","last_fullsized":"2024-09-12T22:48:08.677222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:58.991752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674239+0000","last_change":"2024-09-12T22:48:05.177369+0000","last_active":"2024-09-12T22:48:08.674239+0000","last_peered":"2024-09-12T22:48:08.674239+0000","last_clean":"2024-09-12T22:48:08.674239+0000","last_became_active":"2024-09-12T22:48:05.176680+0000","last_became_peered":"2024-09-12T22:48:05.176680+0000","last_unstale":"2024-09-12T22:48:08.674239+0000","last_undegraded":"2024-09-12T22:48:08.674239+0000","last_fullsized":"2024-09-12T22:48:08.674239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:25.143572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680241+0000","last_change":"2024-09-12T22:48:05.173232+0000","last_active":"2024-09-12T22:48:08.680241+0000","last_peered":"2024-09-12T22:48:08.680241+0000","last_clean":"2024-09-12T22:48:08.680241+0000","last_became_active":"2024-09-12T22:48:05.172382+0000","last_became_peered":"2024-09-12T22:48:05.172382+0000","last_unstale":"2024-09-12T22:48:08.680241+0000","last_undegraded":"2024-09-12T22:48:08.680241+0000","last_fullsized":"2024-09-12T22:48:08.680241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:28.083344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679924+0000","last_change":"2024-09-12T22:48:05.174799+0000","last_active":"2024-09-12T22:48:08.679924+0000","last_peered":"2024-09-12T22:48:08.679924+0000","last_clean":"2024-09-12T22:48:08.679924+0000","last_became_active":"2024-09-12T22:48:05.174423+0000","last_became_peered":"2024-09-12T22:48:05.174423+0000","last_unstale":"2024-09-12T22:48:08.679924+0000","last_undegraded":"2024-09-12T22:48:08.679924+0000","last_fullsized":"2024-09-12T22:48:08.679924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:56.158813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676495+0000","last_change":"2024-09-12T22:48:05.175363+0000","last_active":"2024-09-12T22:48:08.676495+0000","last_peered":"2024-09-12T22:48:08.676495+0000","last_clean":"2024-09-12T22:48:08.676495+0000","last_became_active":"2024-09-12T22:48:05.174832+0000","last_became_peered":"2024-09-12T22:48:05.174832+0000","last_unstale":"2024-09-12T22:48:08.676495+0000","last_undegraded":"2024-09-12T22:48:08.676495+0000","last_fullsized":"2024-09-12T22:48:08.676495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:25.994320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673471+0000","last_change":"2024-09-12T22:48:05.169838+0000","last_active":"2024-09-12T22:48:08.673471+0000","last_peered":"2024-09-12T22:48:08.673471+0000","last_clean":"2024-09-12T22:48:08.673471+0000","last_became_active":"2024-09-12T22:48:05.169462+0000","last_became_peered":"2024-09-12T22:48:05.169462+0000","last_unstale":"2024-09-12T22:48:08.673471+0000","last_undegraded":"2024-09-12T22:48:08.673471+0000","last_fullsized":"2024-09-12T22:48:08.673471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:42:56.969660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676149+0000","last_change":"2024-09-12T22:48:05.172794+0000","last_active":"2024-09-12T22:48:08.676149+0000","last_peered":"2024-09-12T22:48:08.676149+0000","last_clean":"2024-09-12T22:48:08.676149+0000","last_became_active":"2024-09-12T22:48:05.172437+0000","last_became_peered":"2024-09-12T22:48:05.172437+0000","last_unstale":"2024-09-12T22:48:08.676149+0000","last_undegraded":"2024-09-12T22:48:08.676149+0000","last_fullsized":"2024-09-12T22:48:08.676149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:54:44.278646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677275+0000","last_change":"2024-09-12T22:48:05.173714+0000","last_active":"2024-09-12T22:48:08.677275+0000","last_peered":"2024-09-12T22:48:08.677275+0000","last_clean":"2024-09-12T22:48:08.677275+0000","last_became_active":"2024-09-12T22:48:05.172938+0000","last_became_peered":"2024-09-12T22:48:05.172938+0000","last_unstale":"2024-09-12T22:48:08.677275+0000","last_undegraded":"2024-09-12T22:48:08.677275+0000","last_fullsized":"2024-09-12T22:48:08.677275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:30.120804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674352+0000","last_change":"2024-09-12T22:48:05.177862+0000","last_active":"2024-09-12T22:48:08.674352+0000","last_peered":"2024-09-12T22:48:08.674352+0000","last_clean":"2024-09-12T22:48:08.674352+0000","last_became_active":"2024-09-12T22:48:05.177545+0000","last_became_peered":"2024-09-12T22:48:05.177545+0000","last_unstale":"2024-09-12T22:48:08.674352+0000","last_undegraded":"2024-09-12T22:48:08.674352+0000","last_fullsized":"2024-09-12T22:48:08.674352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:25.994320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680458+0000","last_change":"2024-09-12T22:48:05.178249+0000","last_active":"2024-09-12T22:48:08.680458+0000","last_peered":"2024-09-12T22:48:08.680458+0000","last_clean":"2024-09-12T22:48:08.680458+0000","last_became_active":"2024-09-12T22:48:05.177582+0000","last_became_peered":"2024-09-12T22:48:05.177582+0000","last_unstale":"2024-09-12T22:48:08.680458+0000","last_undegraded":"2024-09-12T22:48:08.680458+0000","last_fullsized":"2024-09-12T22:48:08.680458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:25.556218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677103+0000","last_change":"2024-09-12T22:48:05.171326+0000","last_active":"2024-09-12T22:48:08.677103+0000","last_peered":"2024-09-12T22:48:08.677103+0000","last_clean":"2024-09-12T22:48:08.677103+0000","last_became_active":"2024-09-12T22:48:05.170491+0000","last_became_peered":"2024-09-12T22:48:05.170491+0000","last_unstale":"2024-09-12T22:48:08.677103+0000","last_undegraded":"2024-09-12T22:48:08.677103+0000","last_fullsized":"2024-09-12T22:48:08.677103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:52.071513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674052+0000","last_change":"2024-09-12T22:48:05.177176+0000","last_active":"2024-09-12T22:48:08.674052+0000","last_peered":"2024-09-12T22:48:08.674052+0000","last_clean":"2024-09-12T22:48:08.674052+0000","last_became_active":"2024-09-12T22:48:05.176735+0000","last_became_peered":"2024-09-12T22:48:05.176735+0000","last_unstale":"2024-09-12T22:48:08.674052+0000","last_undegraded":"2024-09-12T22:48:08.674052+0000","last_fullsized":"2024-09-12T22:48:08.674052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:51.360504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676676+0000","last_change":"2024-09-12T22:48:05.171180+0000","last_active":"2024-09-12T22:48:08.676676+0000","last_peered":"2024-09-12T22:48:08.676676+0000","last_clean":"2024-09-12T22:48:08.676676+0000","last_became_active":"2024-09-12T22:48:05.170263+0000","last_became_peered":"2024-09-12T22:48:05.170263+0000","last_unstale":"2024-09-12T22:48:08.676676+0000","last_undegraded":"2024-09-12T22:48:08.676676+0000","last_fullsized":"2024-09-12T22:48:08.676676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:25.143572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673611+0000","last_change":"2024-09-12T22:48:05.176878+0000","last_active":"2024-09-12T22:48:08.673611+0000","last_peered":"2024-09-12T22:48:08.673611+0000","last_clean":"2024-09-12T22:48:08.673611+0000","last_became_active":"2024-09-12T22:48:05.176327+0000","last_became_peered":"2024-09-12T22:48:05.176327+0000","last_unstale":"2024-09-12T22:48:08.673611+0000","last_undegraded":"2024-09-12T22:48:08.673611+0000","last_fullsized":"2024-09-12T22:48:08.673611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:11.781766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679222+0000","last_change":"2024-09-12T22:48:05.174818+0000","last_active":"2024-09-12T22:48:08.679222+0000","last_peered":"2024-09-12T22:48:08.679222+0000","last_clean":"2024-09-12T22:48:08.679222+0000","last_became_active":"2024-09-12T22:48:05.173485+0000","last_became_peered":"2024-09-12T22:48:05.173485+0000","last_unstale":"2024-09-12T22:48:08.679222+0000","last_undegraded":"2024-09-12T22:48:08.679222+0000","last_fullsized":"2024-09-12T22:48:08.679222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:24.124647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676980+0000","last_change":"2024-09-12T22:48:05.171573+0000","last_active":"2024-09-12T22:48:08.676980+0000","last_peered":"2024-09-12T22:48:08.676980+0000","last_clean":"2024-09-12T22:48:08.676980+0000","last_became_active":"2024-09-12T22:48:05.171036+0000","last_became_peered":"2024-09-12T22:48:05.171036+0000","last_unstale":"2024-09-12T22:48:08.676980+0000","last_undegraded":"2024-09-12T22:48:08.676980+0000","last_fullsized":"2024-09-12T22:48:08.676980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:27:07.558853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679924+0000","last_change":"2024-09-12T22:48:04.171960+0000","last_active":"2024-09-12T22:48:08.679924+0000","last_peered":"2024-09-12T22:48:08.679924+0000","last_clean":"2024-09-12T22:48:08.679924+0000","last_became_active":"2024-09-12T22:48:04.171562+0000","last_became_peered":"2024-09-12T22:48:04.171562+0000","last_unstale":"2024-09-12T22:48:08.679924+0000","last_undegraded":"2024-09-12T22:48:08.679924+0000","last_fullsized":"2024-09-12T22:48:08.679924+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:00.271198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677053+0000","last_change":"2024-09-12T22:48:05.173585+0000","last_active":"2024-09-12T22:48:08.677053+0000","last_peered":"2024-09-12T22:48:08.677053+0000","last_clean":"2024-09-12T22:48:08.677053+0000","last_became_active":"2024-09-12T22:48:05.172801+0000","last_became_peered":"2024-09-12T22:48:05.172801+0000","last_unstale":"2024-09-12T22:48:08.677053+0000","last_undegraded":"2024-09-12T22:48:08.677053+0000","last_fullsized":"2024-09-12T22:48:08.677053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:45.140060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674214+0000","last_change":"2024-09-12T22:48:04.167352+0000","last_active":"2024-09-12T22:48:08.674214+0000","last_peered":"2024-09-12T22:48:08.674214+0000","last_clean":"2024-09-12T22:48:08.674214+0000","last_became_active":"2024-09-12T22:48:04.166743+0000","last_became_peered":"2024-09-12T22:48:04.166743+0000","last_unstale":"2024-09-12T22:48:08.674214+0000","last_undegraded":"2024-09-12T22:48:08.674214+0000","last_fullsized":"2024-09-12T22:48:08.674214+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:30:27.547041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674597+0000","last_change":"2024-09-12T22:48:05.178409+0000","last_active":"2024-09-12T22:48:08.674597+0000","last_peered":"2024-09-12T22:48:08.674597+0000","last_clean":"2024-09-12T22:48:08.674597+0000","last_became_active":"2024-09-12T22:48:05.178076+0000","last_became_peered":"2024-09-12T22:48:05.178076+0000","last_unstale":"2024-09-12T22:48:08.674597+0000","last_undegraded":"2024-09-12T22:48:08.674597+0000","last_fullsized":"2024-09-12T22:48:08.674597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:01.401542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676355+0000","last_change":"2024-09-12T22:48:04.171173+0000","last_active":"2024-09-12T22:48:08.676355+0000","last_peered":"2024-09-12T22:48:08.676355+0000","last_clean":"2024-09-12T22:48:08.676355+0000","last_became_active":"2024-09-12T22:48:04.170891+0000","last_became_peered":"2024-09-12T22:48:04.170891+0000","last_unstale":"2024-09-12T22:48:08.676355+0000","last_undegraded":"2024-09-12T22:48:08.676355+0000","last_fullsized":"2024-09-12T22:48:08.676355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:02.023664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674470+0000","last_change":"2024-09-12T22:48:05.177510+0000","last_active":"2024-09-12T22:48:08.674470+0000","last_peered":"2024-09-12T22:48:08.674470+0000","last_clean":"2024-09-12T22:48:08.674470+0000","last_became_active":"2024-09-12T22:48:05.176568+0000","last_became_peered":"2024-09-12T22:48:05.176568+0000","last_unstale":"2024-09-12T22:48:08.674470+0000","last_undegraded":"2024-09-12T22:48:08.674470+0000","last_fullsized":"2024-09-12T22:48:08.674470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:49.868891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679221+0000","last_change":"2024-09-12T22:48:04.173161+0000","last_active":"2024-09-12T22:48:08.679221+0000","last_peered":"2024-09-12T22:48:08.679221+0000","last_clean":"2024-09-12T22:48:08.679221+0000","last_became_active":"2024-09-12T22:48:04.172623+0000","last_became_peered":"2024-09-12T22:48:04.172623+0000","last_unstale":"2024-09-12T22:48:08.679221+0000","last_undegraded":"2024-09-12T22:48:08.679221+0000","last_fullsized":"2024-09-12T22:48:08.679221+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:13.739087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680199+0000","last_change":"2024-09-12T22:48:04.173041+0000","last_active":"2024-09-12T22:48:08.680199+0000","last_peered":"2024-09-12T22:48:08.680199+0000","last_clean":"2024-09-12T22:48:08.680199+0000","last_became_active":"2024-09-12T22:48:04.172527+0000","last_became_peered":"2024-09-12T22:48:04.172527+0000","last_unstale":"2024-09-12T22:48:08.680199+0000","last_undegraded":"2024-09-12T22:48:08.680199+0000","last_fullsized":"2024-09-12T22:48:08.680199+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:20.734653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676178+0000","last_change":"2024-09-12T22:48:05.175921+0000","last_active":"2024-09-12T22:48:08.676178+0000","last_peered":"2024-09-12T22:48:08.676178+0000","last_clean":"2024-09-12T22:48:08.676178+0000","last_became_active":"2024-09-12T22:48:05.175226+0000","last_became_peered":"2024-09-12T22:48:05.175226+0000","last_unstale":"2024-09-12T22:48:08.676178+0000","last_undegraded":"2024-09-12T22:48:08.676178+0000","last_fullsized":"2024-09-12T22:48:08.676178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:08.021196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677320+0000","last_change":"2024-09-12T22:48:04.167564+0000","last_active":"2024-09-12T22:48:08.677320+0000","last_peered":"2024-09-12T22:48:08.677320+0000","last_clean":"2024-09-12T22:48:08.677320+0000","last_became_active":"2024-09-12T22:48:04.167254+0000","last_became_peered":"2024-09-12T22:48:04.167254+0000","last_unstale":"2024-09-12T22:48:08.677320+0000","last_undegraded":"2024-09-12T22:48:08.677320+0000","last_fullsized":"2024-09-12T22:48:08.677320+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:35.879041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676271+0000","last_change":"2024-09-12T22:48:05.171143+0000","last_active":"2024-09-12T22:48:08.676271+0000","last_peered":"2024-09-12T22:48:08.676271+0000","last_clean":"2024-09-12T22:48:08.676271+0000","last_became_active":"2024-09-12T22:48:05.170374+0000","last_became_peered":"2024-09-12T22:48:05.170374+0000","last_unstale":"2024-09-12T22:48:08.676271+0000","last_undegraded":"2024-09-12T22:48:08.676271+0000","last_fullsized":"2024-09-12T22:48:08.676271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:15.887977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680611+0000","last_change":"2024-09-12T22:48:04.173325+0000","last_active":"2024-09-12T22:48:08.680611+0000","last_peered":"2024-09-12T22:48:08.680611+0000","last_clean":"2024-09-12T22:48:08.680611+0000","last_became_active":"2024-09-12T22:48:04.172862+0000","last_became_peered":"2024-09-12T22:48:04.172862+0000","last_unstale":"2024-09-12T22:48:08.680611+0000","last_undegraded":"2024-09-12T22:48:08.680611+0000","last_fullsized":"2024-09-12T22:48:08.680611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:42:33.314407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679603+0000","last_change":"2024-09-12T22:48:05.173382+0000","last_active":"2024-09-12T22:48:08.679603+0000","last_peered":"2024-09-12T22:48:08.679603+0000","last_clean":"2024-09-12T22:48:08.679603+0000","last_became_active":"2024-09-12T22:48:05.172429+0000","last_became_peered":"2024-09-12T22:48:05.172429+0000","last_unstale":"2024-09-12T22:48:08.679603+0000","last_undegraded":"2024-09-12T22:48:08.679603+0000","last_fullsized":"2024-09-12T22:48:08.679603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:44:38.144948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680436+0000","last_change":"2024-09-12T22:48:04.172099+0000","last_active":"2024-09-12T22:48:08.680436+0000","last_peered":"2024-09-12T22:48:08.680436+0000","last_clean":"2024-09-12T22:48:08.680436+0000","last_became_active":"2024-09-12T22:48:04.171746+0000","last_became_peered":"2024-09-12T22:48:04.171746+0000","last_unstale":"2024-09-12T22:48:08.680436+0000","last_undegraded":"2024-09-12T22:48:08.680436+0000","last_fullsized":"2024-09-12T22:48:08.680436+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:35:28.894178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674110+0000","last_change":"2024-09-12T22:48:05.177824+0000","last_active":"2024-09-12T22:48:08.674110+0000","last_peered":"2024-09-12T22:48:08.674110+0000","last_clean":"2024-09-12T22:48:08.674110+0000","last_became_active":"2024-09-12T22:48:05.177344+0000","last_became_peered":"2024-09-12T22:48:05.177344+0000","last_unstale":"2024-09-12T22:48:08.674110+0000","last_undegraded":"2024-09-12T22:48:08.674110+0000","last_fullsized":"2024-09-12T22:48:08.674110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:52.071513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674213+0000","last_change":"2024-09-12T22:48:04.167459+0000","last_active":"2024-09-12T22:48:08.674213+0000","last_peered":"2024-09-12T22:48:08.674213+0000","last_clean":"2024-09-12T22:48:08.674213+0000","last_became_active":"2024-09-12T22:48:04.165825+0000","last_became_peered":"2024-09-12T22:48:04.165825+0000","last_unstale":"2024-09-12T22:48:08.674213+0000","last_undegraded":"2024-09-12T22:48:08.674213+0000","last_fullsized":"2024-09-12T22:48:08.674213+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:20.734653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679998+0000","last_change":"2024-09-12T22:48:05.173859+0000","last_active":"2024-09-12T22:48:08.679998+0000","last_peered":"2024-09-12T22:48:08.679998+0000","last_clean":"2024-09-12T22:48:08.679998+0000","last_became_active":"2024-09-12T22:48:05.173276+0000","last_became_peered":"2024-09-12T22:48:05.173276+0000","last_unstale":"2024-09-12T22:48:08.679998+0000","last_undegraded":"2024-09-12T22:48:08.679998+0000","last_fullsized":"2024-09-12T22:48:08.679998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:06:31.953025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679767+0000","last_change":"2024-09-12T22:48:04.172158+0000","last_active":"2024-09-12T22:48:08.679767+0000","last_peered":"2024-09-12T22:48:08.679767+0000","last_clean":"2024-09-12T22:48:08.679767+0000","last_became_active":"2024-09-12T22:48:04.171514+0000","last_became_peered":"2024-09-12T22:48:04.171514+0000","last_unstale":"2024-09-12T22:48:08.679767+0000","last_undegraded":"2024-09-12T22:48:08.679767+0000","last_fullsized":"2024-09-12T22:48:08.679767+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:40:29.366846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680561+0000","last_change":"2024-09-12T22:48:05.178528+0000","last_active":"2024-09-12T22:48:08.680561+0000","last_peered":"2024-09-12T22:48:08.680561+0000","last_clean":"2024-09-12T22:48:08.680561+0000","last_became_active":"2024-09-12T22:48:05.177904+0000","last_became_peered":"2024-09-12T22:48:05.177904+0000","last_unstale":"2024-09-12T22:48:08.680561+0000","last_undegraded":"2024-09-12T22:48:08.680561+0000","last_fullsized":"2024-09-12T22:48:08.680561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:59.525401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676548+0000","last_change":"2024-09-12T22:48:04.171001+0000","last_active":"2024-09-12T22:48:08.676548+0000","last_peered":"2024-09-12T22:48:08.676548+0000","last_clean":"2024-09-12T22:48:08.676548+0000","last_became_active":"2024-09-12T22:48:04.170667+0000","last_became_peered":"2024-09-12T22:48:04.170667+0000","last_unstale":"2024-09-12T22:48:08.676548+0000","last_undegraded":"2024-09-12T22:48:08.676548+0000","last_fullsized":"2024-09-12T22:48:08.676548+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:04.492449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680316+0000","last_change":"2024-09-12T22:48:05.177804+0000","last_active":"2024-09-12T22:48:08.680316+0000","last_peered":"2024-09-12T22:48:08.680316+0000","last_clean":"2024-09-12T22:48:08.680316+0000","last_became_active":"2024-09-12T22:48:05.177458+0000","last_became_peered":"2024-09-12T22:48:05.177458+0000","last_unstale":"2024-09-12T22:48:08.680316+0000","last_undegraded":"2024-09-12T22:48:08.680316+0000","last_fullsized":"2024-09-12T22:48:08.680316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:47.576598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676227+0000","last_change":"2024-09-12T22:48:04.174281+0000","last_active":"2024-09-12T22:48:08.676227+0000","last_peered":"2024-09-12T22:48:08.676227+0000","last_clean":"2024-09-12T22:48:08.676227+0000","last_became_active":"2024-09-12T22:48:04.173942+0000","last_became_peered":"2024-09-12T22:48:04.173942+0000","last_unstale":"2024-09-12T22:48:08.676227+0000","last_undegraded":"2024-09-12T22:48:08.676227+0000","last_fullsized":"2024-09-12T22:48:08.676227+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:19:38.546747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674466+0000","last_change":"2024-09-12T22:48:05.178246+0000","last_active":"2024-09-12T22:48:08.674466+0000","last_peered":"2024-09-12T22:48:08.674466+0000","last_clean":"2024-09-12T22:48:08.674466+0000","last_became_active":"2024-09-12T22:48:05.176813+0000","last_became_peered":"2024-09-12T22:48:05.176813+0000","last_unstale":"2024-09-12T22:48:08.674466+0000","last_undegraded":"2024-09-12T22:48:08.674466+0000","last_fullsized":"2024-09-12T22:48:08.674466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:58.991752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":226,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679433+0000","last_change":"2024-09-12T22:47:56.028830+0000","last_active":"2024-09-12T22:48:08.679433+0000","last_peered":"2024-09-12T22:48:08.679433+0000","last_clean":"2024-09-12T22:48:08.679433+0000","last_became_active":"2024-09-12T22:47:56.028017+0000","last_became_peered":"2024-09-12T22:47:56.028017+0000","last_unstale":"2024-09-12T22:48:08.679433+0000","last_undegraded":"2024-09-12T22:48:08.679433+0000","last_fullsized":"2024-09-12T22:48:08.679433+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:55.016634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:55.016634+0000","last_clean_scrub_stamp":"2024-09-12T22:47:55.016634+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:03.648827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680145+0000","last_change":"2024-09-12T22:48:02.045816+0000","last_active":"2024-09-12T22:48:08.680145+0000","last_peered":"2024-09-12T22:48:08.680145+0000","last_clean":"2024-09-12T22:48:08.680145+0000","last_became_active":"2024-09-12T22:48:00.045324+0000","last_became_peered":"2024-09-12T22:48:00.045324+0000","last_unstale":"2024-09-12T22:48:08.680145+0000","last_undegraded":"2024-09-12T22:48:08.680145+0000","last_fullsized":"2024-09-12T22:48:08.680145+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:41:33.998543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065526500000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673955+0000","last_change":"2024-09-12T22:48:04.169704+0000","last_active":"2024-09-12T22:48:08.673955+0000","last_peered":"2024-09-12T22:48:08.673955+0000","last_clean":"2024-09-12T22:48:08.673955+0000","last_became_active":"2024-09-12T22:48:04.169474+0000","last_became_peered":"2024-09-12T22:48:04.169474+0000","last_unstale":"2024-09-12T22:48:08.673955+0000","last_undegraded":"2024-09-12T22:48:08.673955+0000","last_fullsized":"2024-09-12T22:48:08.673955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:00.271198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680660+0000","last_change":"2024-09-12T22:48:05.178510+0000","last_active":"2024-09-12T22:48:08.680660+0000","last_peered":"2024-09-12T22:48:08.680660+0000","last_clean":"2024-09-12T22:48:08.680660+0000","last_became_active":"2024-09-12T22:48:05.177910+0000","last_became_peered":"2024-09-12T22:48:05.177910+0000","last_unstale":"2024-09-12T22:48:08.680660+0000","last_undegraded":"2024-09-12T22:48:08.680660+0000","last_fullsized":"2024-09-12T22:48:08.680660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:19.398289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679405+0000","last_change":"2024-09-12T22:48:02.045525+0000","last_active":"2024-09-12T22:48:08.679405+0000","last_peered":"2024-09-12T22:48:08.679405+0000","last_clean":"2024-09-12T22:48:08.679405+0000","last_became_active":"2024-09-12T22:48:00.042207+0000","last_became_peered":"2024-09-12T22:48:00.042207+0000","last_unstale":"2024-09-12T22:48:08.679405+0000","last_undegraded":"2024-09-12T22:48:08.679405+0000","last_fullsized":"2024-09-12T22:48:08.679405+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:33.150497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040973099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673788+0000","last_change":"2024-09-12T22:48:04.167456+0000","last_active":"2024-09-12T22:48:08.673788+0000","last_peered":"2024-09-12T22:48:08.673788+0000","last_clean":"2024-09-12T22:48:08.673788+0000","last_became_active":"2024-09-12T22:48:04.166966+0000","last_became_peered":"2024-09-12T22:48:04.166966+0000","last_unstale":"2024-09-12T22:48:08.673788+0000","last_undegraded":"2024-09-12T22:48:08.673788+0000","last_fullsized":"2024-09-12T22:48:08.673788+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:13.739087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677214+0000","last_change":"2024-09-12T22:48:05.171819+0000","last_active":"2024-09-12T22:48:08.677214+0000","last_peered":"2024-09-12T22:48:08.677214+0000","last_clean":"2024-09-12T22:48:08.677214+0000","last_became_active":"2024-09-12T22:48:05.171293+0000","last_became_peered":"2024-09-12T22:48:05.171293+0000","last_unstale":"2024-09-12T22:48:08.677214+0000","last_undegraded":"2024-09-12T22:48:08.677214+0000","last_fullsized":"2024-09-12T22:48:08.677214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:01.401542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673968+0000","last_change":"2024-09-12T22:48:02.045209+0000","last_active":"2024-09-12T22:48:08.673968+0000","last_peered":"2024-09-12T22:48:08.673968+0000","last_clean":"2024-09-12T22:48:08.673968+0000","last_became_active":"2024-09-12T22:48:00.042007+0000","last_became_peered":"2024-09-12T22:48:00.042007+0000","last_unstale":"2024-09-12T22:48:08.673968+0000","last_undegraded":"2024-09-12T22:48:08.673968+0000","last_fullsized":"2024-09-12T22:48:08.673968+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:13.536542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036893100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676251+0000","last_change":"2024-09-12T22:48:04.171168+0000","last_active":"2024-09-12T22:48:08.676251+0000","last_peered":"2024-09-12T22:48:08.676251+0000","last_clean":"2024-09-12T22:48:08.676251+0000","last_became_active":"2024-09-12T22:48:04.170853+0000","last_became_peered":"2024-09-12T22:48:04.170853+0000","last_unstale":"2024-09-12T22:48:08.676251+0000","last_undegraded":"2024-09-12T22:48:08.676251+0000","last_fullsized":"2024-09-12T22:48:08.676251+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:32:37.715508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674596+0000","last_change":"2024-09-12T22:48:05.178865+0000","last_active":"2024-09-12T22:48:08.674596+0000","last_peered":"2024-09-12T22:48:08.674596+0000","last_clean":"2024-09-12T22:48:08.674596+0000","last_became_active":"2024-09-12T22:48:05.178010+0000","last_became_peered":"2024-09-12T22:48:05.178010+0000","last_unstale":"2024-09-12T22:48:08.674596+0000","last_undegraded":"2024-09-12T22:48:08.674596+0000","last_fullsized":"2024-09-12T22:48:08.674596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:30.120804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679847+0000","last_change":"2024-09-12T22:48:02.045684+0000","last_active":"2024-09-12T22:48:08.679847+0000","last_peered":"2024-09-12T22:48:08.679847+0000","last_clean":"2024-09-12T22:48:08.679847+0000","last_became_active":"2024-09-12T22:48:00.045286+0000","last_became_peered":"2024-09-12T22:48:00.045286+0000","last_unstale":"2024-09-12T22:48:08.679847+0000","last_undegraded":"2024-09-12T22:48:08.679847+0000","last_fullsized":"2024-09-12T22:48:08.679847+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:18:11.667143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052714799999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679984+0000","last_change":"2024-09-12T22:48:04.172355+0000","last_active":"2024-09-12T22:48:08.679984+0000","last_peered":"2024-09-12T22:48:08.679984+0000","last_clean":"2024-09-12T22:48:08.679984+0000","last_became_active":"2024-09-12T22:48:04.171905+0000","last_became_peered":"2024-09-12T22:48:04.171905+0000","last_unstale":"2024-09-12T22:48:08.679984+0000","last_undegraded":"2024-09-12T22:48:08.679984+0000","last_fullsized":"2024-09-12T22:48:08.679984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:35.203049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674351+0000","last_change":"2024-09-12T22:48:05.177561+0000","last_active":"2024-09-12T22:48:08.674351+0000","last_peered":"2024-09-12T22:48:08.674351+0000","last_clean":"2024-09-12T22:48:08.674351+0000","last_became_active":"2024-09-12T22:48:05.177164+0000","last_became_peered":"2024-09-12T22:48:05.177164+0000","last_unstale":"2024-09-12T22:48:08.674351+0000","last_undegraded":"2024-09-12T22:48:08.674351+0000","last_fullsized":"2024-09-12T22:48:08.674351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:24.124647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680715+0000","last_change":"2024-09-12T22:48:04.172271+0000","last_active":"2024-09-12T22:48:08.680715+0000","last_peered":"2024-09-12T22:48:08.680715+0000","last_clean":"2024-09-12T22:48:08.680715+0000","last_became_active":"2024-09-12T22:48:04.171739+0000","last_became_peered":"2024-09-12T22:48:04.171739+0000","last_unstale":"2024-09-12T22:48:08.680715+0000","last_undegraded":"2024-09-12T22:48:08.680715+0000","last_fullsized":"2024-09-12T22:48:08.680715+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:56.929490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674540+0000","last_change":"2024-09-12T22:48:02.045324+0000","last_active":"2024-09-12T22:48:08.674540+0000","last_peered":"2024-09-12T22:48:08.674540+0000","last_clean":"2024-09-12T22:48:08.674540+0000","last_became_active":"2024-09-12T22:48:00.042132+0000","last_became_peered":"2024-09-12T22:48:00.042132+0000","last_unstale":"2024-09-12T22:48:08.674540+0000","last_undegraded":"2024-09-12T22:48:08.674540+0000","last_fullsized":"2024-09-12T22:48:08.674540+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:24.673019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047590600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676518+0000","last_change":"2024-09-12T22:48:05.175609+0000","last_active":"2024-09-12T22:48:08.676518+0000","last_peered":"2024-09-12T22:48:08.676518+0000","last_clean":"2024-09-12T22:48:08.676518+0000","last_became_active":"2024-09-12T22:48:05.175167+0000","last_became_peered":"2024-09-12T22:48:05.175167+0000","last_unstale":"2024-09-12T22:48:08.676518+0000","last_undegraded":"2024-09-12T22:48:08.676518+0000","last_fullsized":"2024-09-12T22:48:08.676518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:11.248179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674322+0000","last_change":"2024-09-12T22:48:04.169109+0000","last_active":"2024-09-12T22:48:08.674322+0000","last_peered":"2024-09-12T22:48:08.674322+0000","last_clean":"2024-09-12T22:48:08.674322+0000","last_became_active":"2024-09-12T22:48:04.168655+0000","last_became_peered":"2024-09-12T22:48:04.168655+0000","last_unstale":"2024-09-12T22:48:08.674322+0000","last_undegraded":"2024-09-12T22:48:08.674322+0000","last_fullsized":"2024-09-12T22:48:08.674322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:02.879935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677463+0000","last_change":"2024-09-12T22:48:02.045390+0000","last_active":"2024-09-12T22:48:08.677463+0000","last_peered":"2024-09-12T22:48:08.677463+0000","last_clean":"2024-09-12T22:48:08.677463+0000","last_became_active":"2024-09-12T22:48:00.045356+0000","last_became_peered":"2024-09-12T22:48:00.045356+0000","last_unstale":"2024-09-12T22:48:08.677463+0000","last_undegraded":"2024-09-12T22:48:08.677463+0000","last_fullsized":"2024-09-12T22:48:08.677463+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:32.072080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040621599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676614+0000","last_change":"2024-09-12T22:48:05.171131+0000","last_active":"2024-09-12T22:48:08.676614+0000","last_peered":"2024-09-12T22:48:08.676614+0000","last_clean":"2024-09-12T22:48:08.676614+0000","last_became_active":"2024-09-12T22:48:05.170591+0000","last_became_peered":"2024-09-12T22:48:05.170591+0000","last_unstale":"2024-09-12T22:48:08.676614+0000","last_undegraded":"2024-09-12T22:48:08.676614+0000","last_fullsized":"2024-09-12T22:48:08.676614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:11.781766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674783+0000","last_change":"2024-09-12T22:48:04.168635+0000","last_active":"2024-09-12T22:48:08.674783+0000","last_peered":"2024-09-12T22:48:08.674783+0000","last_clean":"2024-09-12T22:48:08.674783+0000","last_became_active":"2024-09-12T22:48:04.168244+0000","last_became_peered":"2024-09-12T22:48:04.168244+0000","last_unstale":"2024-09-12T22:48:08.674783+0000","last_undegraded":"2024-09-12T22:48:08.674783+0000","last_fullsized":"2024-09-12T22:48:08.674783+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:56.929490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674718+0000","last_change":"2024-09-12T22:48:02.045428+0000","last_active":"2024-09-12T22:48:08.674718+0000","last_peered":"2024-09-12T22:48:08.674718+0000","last_clean":"2024-09-12T22:48:08.674718+0000","last_became_active":"2024-09-12T22:48:00.040536+0000","last_became_peered":"2024-09-12T22:48:00.040536+0000","last_unstale":"2024-09-12T22:48:08.674718+0000","last_undegraded":"2024-09-12T22:48:08.674718+0000","last_fullsized":"2024-09-12T22:48:08.674718+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:33.150497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057699499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673721+0000","last_change":"2024-09-12T22:48:05.170571+0000","last_active":"2024-09-12T22:48:08.673721+0000","last_peered":"2024-09-12T22:48:08.673721+0000","last_clean":"2024-09-12T22:48:08.673721+0000","last_became_active":"2024-09-12T22:48:05.170087+0000","last_became_peered":"2024-09-12T22:48:05.170087+0000","last_unstale":"2024-09-12T22:48:08.673721+0000","last_undegraded":"2024-09-12T22:48:08.673721+0000","last_fullsized":"2024-09-12T22:48:08.673721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:28.873036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674650+0000","last_change":"2024-09-12T22:48:04.166369+0000","last_active":"2024-09-12T22:48:08.674650+0000","last_peered":"2024-09-12T22:48:08.674650+0000","last_clean":"2024-09-12T22:48:08.674650+0000","last_became_active":"2024-09-12T22:48:04.165966+0000","last_became_peered":"2024-09-12T22:48:04.165966+0000","last_unstale":"2024-09-12T22:48:08.674650+0000","last_undegraded":"2024-09-12T22:48:08.674650+0000","last_fullsized":"2024-09-12T22:48:08.674650+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:40:29.366846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680266+0000","last_change":"2024-09-12T22:48:02.045500+0000","last_active":"2024-09-12T22:48:08.680266+0000","last_peered":"2024-09-12T22:48:08.680266+0000","last_clean":"2024-09-12T22:48:08.680266+0000","last_became_active":"2024-09-12T22:48:00.042210+0000","last_became_peered":"2024-09-12T22:48:00.042210+0000","last_unstale":"2024-09-12T22:48:08.680266+0000","last_undegraded":"2024-09-12T22:48:08.680266+0000","last_fullsized":"2024-09-12T22:48:08.680266+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:35:14.212372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035339799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676300+0000","last_change":"2024-09-12T22:48:05.170712+0000","last_active":"2024-09-12T22:48:08.676300+0000","last_peered":"2024-09-12T22:48:08.676300+0000","last_clean":"2024-09-12T22:48:08.676300+0000","last_became_active":"2024-09-12T22:48:05.169840+0000","last_became_peered":"2024-09-12T22:48:05.169840+0000","last_unstale":"2024-09-12T22:48:08.676300+0000","last_undegraded":"2024-09-12T22:48:08.676300+0000","last_fullsized":"2024-09-12T22:48:08.676300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:24.240533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679770+0000","last_change":"2024-09-12T22:48:05.168203+0000","last_active":"2024-09-12T22:48:08.679770+0000","last_peered":"2024-09-12T22:48:08.679770+0000","last_clean":"2024-09-12T22:48:08.679770+0000","last_became_active":"2024-09-12T22:48:05.167870+0000","last_became_peered":"2024-09-12T22:48:05.167870+0000","last_unstale":"2024-09-12T22:48:08.679770+0000","last_undegraded":"2024-09-12T22:48:08.679770+0000","last_fullsized":"2024-09-12T22:48:08.679770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:45.140060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680214+0000","last_change":"2024-09-12T22:48:04.173355+0000","last_active":"2024-09-12T22:48:08.680214+0000","last_peered":"2024-09-12T22:48:08.680214+0000","last_clean":"2024-09-12T22:48:08.680214+0000","last_became_active":"2024-09-12T22:48:04.173031+0000","last_became_peered":"2024-09-12T22:48:04.173031+0000","last_unstale":"2024-09-12T22:48:08.680214+0000","last_undegraded":"2024-09-12T22:48:08.680214+0000","last_fullsized":"2024-09-12T22:48:08.680214+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:02.879935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673651+0000","last_change":"2024-09-12T22:48:05.176779+0000","last_active":"2024-09-12T22:48:08.673651+0000","last_peered":"2024-09-12T22:48:08.673651+0000","last_clean":"2024-09-12T22:48:08.673651+0000","last_became_active":"2024-09-12T22:48:05.176344+0000","last_became_peered":"2024-09-12T22:48:05.176344+0000","last_unstale":"2024-09-12T22:48:08.673651+0000","last_undegraded":"2024-09-12T22:48:08.673651+0000","last_fullsized":"2024-09-12T22:48:08.673651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:35.645286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677280+0000","last_change":"2024-09-12T22:48:04.171169+0000","last_active":"2024-09-12T22:48:08.677280+0000","last_peered":"2024-09-12T22:48:08.677280+0000","last_clean":"2024-09-12T22:48:08.677280+0000","last_became_active":"2024-09-12T22:48:04.170812+0000","last_became_peered":"2024-09-12T22:48:04.170812+0000","last_unstale":"2024-09-12T22:48:08.677280+0000","last_undegraded":"2024-09-12T22:48:08.677280+0000","last_fullsized":"2024-09-12T22:48:08.677280+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:05:58.510137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680378+0000","last_change":"2024-09-12T22:48:04.172325+0000","last_active":"2024-09-12T22:48:08.680378+0000","last_peered":"2024-09-12T22:48:08.680378+0000","last_clean":"2024-09-12T22:48:08.680378+0000","last_became_active":"2024-09-12T22:48:04.171855+0000","last_became_peered":"2024-09-12T22:48:04.171855+0000","last_unstale":"2024-09-12T22:48:08.680378+0000","last_undegraded":"2024-09-12T22:48:08.680378+0000","last_fullsized":"2024-09-12T22:48:08.680378+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:43.709660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673612+0000","last_change":"2024-09-12T22:48:05.177309+0000","last_active":"2024-09-12T22:48:08.673612+0000","last_peered":"2024-09-12T22:48:08.673612+0000","last_clean":"2024-09-12T22:48:08.673612+0000","last_became_active":"2024-09-12T22:48:05.176412+0000","last_became_peered":"2024-09-12T22:48:05.176412+0000","last_unstale":"2024-09-12T22:48:08.673612+0000","last_undegraded":"2024-09-12T22:48:08.673612+0000","last_fullsized":"2024-09-12T22:48:08.673612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:27:07.558853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674712+0000","last_change":"2024-09-12T22:48:04.166500+0000","last_active":"2024-09-12T22:48:08.674712+0000","last_peered":"2024-09-12T22:48:08.674712+0000","last_clean":"2024-09-12T22:48:08.674712+0000","last_became_active":"2024-09-12T22:48:04.165926+0000","last_became_peered":"2024-09-12T22:48:04.165926+0000","last_unstale":"2024-09-12T22:48:08.674712+0000","last_undegraded":"2024-09-12T22:48:08.674712+0000","last_fullsized":"2024-09-12T22:48:08.674712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:42:33.314407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673624+0000","last_change":"2024-09-12T22:48:05.169648+0000","last_active":"2024-09-12T22:48:08.673624+0000","last_peered":"2024-09-12T22:48:08.673624+0000","last_clean":"2024-09-12T22:48:08.673624+0000","last_became_active":"2024-09-12T22:48:05.168356+0000","last_became_peered":"2024-09-12T22:48:05.168356+0000","last_unstale":"2024-09-12T22:48:08.673624+0000","last_undegraded":"2024-09-12T22:48:08.673624+0000","last_fullsized":"2024-09-12T22:48:08.673624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:52.341512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677376+0000","last_change":"2024-09-12T22:48:05.173822+0000","last_active":"2024-09-12T22:48:08.677376+0000","last_peered":"2024-09-12T22:48:08.677376+0000","last_clean":"2024-09-12T22:48:08.677376+0000","last_became_active":"2024-09-12T22:48:05.172473+0000","last_became_peered":"2024-09-12T22:48:05.172473+0000","last_unstale":"2024-09-12T22:48:08.677376+0000","last_undegraded":"2024-09-12T22:48:08.677376+0000","last_fullsized":"2024-09-12T22:48:08.677376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:32.288419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673686+0000","last_change":"2024-09-12T22:48:04.169111+0000","last_active":"2024-09-12T22:48:08.673686+0000","last_peered":"2024-09-12T22:48:08.673686+0000","last_clean":"2024-09-12T22:48:08.673686+0000","last_became_active":"2024-09-12T22:48:04.168743+0000","last_became_peered":"2024-09-12T22:48:04.168743+0000","last_unstale":"2024-09-12T22:48:08.673686+0000","last_undegraded":"2024-09-12T22:48:08.673686+0000","last_fullsized":"2024-09-12T22:48:08.673686+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:43.709660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674438+0000","last_change":"2024-09-12T22:48:05.175474+0000","last_active":"2024-09-12T22:48:08.674438+0000","last_peered":"2024-09-12T22:48:08.674438+0000","last_clean":"2024-09-12T22:48:08.674438+0000","last_became_active":"2024-09-12T22:48:05.175220+0000","last_became_peered":"2024-09-12T22:48:05.175220+0000","last_unstale":"2024-09-12T22:48:08.674438+0000","last_undegraded":"2024-09-12T22:48:08.674438+0000","last_fullsized":"2024-09-12T22:48:08.674438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:56.158813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673708+0000","last_change":"2024-09-12T22:48:04.165725+0000","last_active":"2024-09-12T22:48:08.673708+0000","last_peered":"2024-09-12T22:48:08.673708+0000","last_clean":"2024-09-12T22:48:08.673708+0000","last_became_active":"2024-09-12T22:48:04.165419+0000","last_became_peered":"2024-09-12T22:48:04.165419+0000","last_unstale":"2024-09-12T22:48:08.673708+0000","last_undegraded":"2024-09-12T22:48:08.673708+0000","last_fullsized":"2024-09-12T22:48:08.673708+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:35:01.771536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677045+0000","last_change":"2024-09-12T22:48:05.174920+0000","last_active":"2024-09-12T22:48:08.677045+0000","last_peered":"2024-09-12T22:48:08.677045+0000","last_clean":"2024-09-12T22:48:08.677045+0000","last_became_active":"2024-09-12T22:48:05.173785+0000","last_became_peered":"2024-09-12T22:48:05.173785+0000","last_unstale":"2024-09-12T22:48:08.677045+0000","last_undegraded":"2024-09-12T22:48:08.677045+0000","last_fullsized":"2024-09-12T22:48:08.677045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:24.124647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676684+0000","last_change":"2024-09-12T22:48:04.174205+0000","last_active":"2024-09-12T22:48:08.676684+0000","last_peered":"2024-09-12T22:48:08.676684+0000","last_clean":"2024-09-12T22:48:08.676684+0000","last_became_active":"2024-09-12T22:48:04.173902+0000","last_became_peered":"2024-09-12T22:48:04.173902+0000","last_unstale":"2024-09-12T22:48:08.676684+0000","last_undegraded":"2024-09-12T22:48:08.676684+0000","last_fullsized":"2024-09-12T22:48:08.676684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:43:39.709214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676806+0000","last_change":"2024-09-12T22:48:05.172917+0000","last_active":"2024-09-12T22:48:08.676806+0000","last_peered":"2024-09-12T22:48:08.676806+0000","last_clean":"2024-09-12T22:48:08.676806+0000","last_became_active":"2024-09-12T22:48:05.172493+0000","last_became_peered":"2024-09-12T22:48:05.172493+0000","last_unstale":"2024-09-12T22:48:08.676806+0000","last_undegraded":"2024-09-12T22:48:08.676806+0000","last_fullsized":"2024-09-12T22:48:08.676806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:35.645286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676666+0000","last_change":"2024-09-12T22:48:04.175808+0000","last_active":"2024-09-12T22:48:08.676666+0000","last_peered":"2024-09-12T22:48:08.676666+0000","last_clean":"2024-09-12T22:48:08.676666+0000","last_became_active":"2024-09-12T22:48:04.175601+0000","last_became_peered":"2024-09-12T22:48:04.175601+0000","last_unstale":"2024-09-12T22:48:08.676666+0000","last_undegraded":"2024-09-12T22:48:08.676666+0000","last_fullsized":"2024-09-12T22:48:08.676666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:19.369251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679733+0000","last_change":"2024-09-12T22:48:05.173989+0000","last_active":"2024-09-12T22:48:08.679733+0000","last_peered":"2024-09-12T22:48:08.679733+0000","last_clean":"2024-09-12T22:48:08.679733+0000","last_became_active":"2024-09-12T22:48:05.172076+0000","last_became_peered":"2024-09-12T22:48:05.172076+0000","last_unstale":"2024-09-12T22:48:08.679733+0000","last_undegraded":"2024-09-12T22:48:08.679733+0000","last_fullsized":"2024-09-12T22:48:08.679733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:51.360504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680072+0000","last_change":"2024-09-12T22:48:04.171884+0000","last_active":"2024-09-12T22:48:08.680072+0000","last_peered":"2024-09-12T22:48:08.680072+0000","last_clean":"2024-09-12T22:48:08.680072+0000","last_became_active":"2024-09-12T22:48:04.171480+0000","last_became_peered":"2024-09-12T22:48:04.171480+0000","last_unstale":"2024-09-12T22:48:08.680072+0000","last_undegraded":"2024-09-12T22:48:08.680072+0000","last_fullsized":"2024-09-12T22:48:08.680072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:56.377664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679739+0000","last_change":"2024-09-12T22:48:05.173551+0000","last_active":"2024-09-12T22:48:08.679739+0000","last_peered":"2024-09-12T22:48:08.679739+0000","last_clean":"2024-09-12T22:48:08.679739+0000","last_became_active":"2024-09-12T22:48:05.172983+0000","last_became_peered":"2024-09-12T22:48:05.172983+0000","last_unstale":"2024-09-12T22:48:08.679739+0000","last_undegraded":"2024-09-12T22:48:08.679739+0000","last_fullsized":"2024-09-12T22:48:08.679739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:22.753741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677213+0000","last_change":"2024-09-12T22:48:04.167853+0000","last_active":"2024-09-12T22:48:08.677213+0000","last_peered":"2024-09-12T22:48:08.677213+0000","last_clean":"2024-09-12T22:48:08.677213+0000","last_became_active":"2024-09-12T22:48:04.167408+0000","last_became_peered":"2024-09-12T22:48:04.167408+0000","last_unstale":"2024-09-12T22:48:08.677213+0000","last_undegraded":"2024-09-12T22:48:08.677213+0000","last_fullsized":"2024-09-12T22:48:08.677213+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:32.031432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676789+0000","last_change":"2024-09-12T22:48:05.171815+0000","last_active":"2024-09-12T22:48:08.676789+0000","last_peered":"2024-09-12T22:48:08.676789+0000","last_clean":"2024-09-12T22:48:08.676789+0000","last_became_active":"2024-09-12T22:48:05.171361+0000","last_became_peered":"2024-09-12T22:48:05.171361+0000","last_unstale":"2024-09-12T22:48:08.676789+0000","last_undegraded":"2024-09-12T22:48:08.676789+0000","last_fullsized":"2024-09-12T22:48:08.676789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:28.873036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674540+0000","last_change":"2024-09-12T22:48:04.169500+0000","last_active":"2024-09-12T22:48:08.674540+0000","last_peered":"2024-09-12T22:48:08.674540+0000","last_clean":"2024-09-12T22:48:08.674540+0000","last_became_active":"2024-09-12T22:48:04.169087+0000","last_became_peered":"2024-09-12T22:48:04.169087+0000","last_unstale":"2024-09-12T22:48:08.674540+0000","last_undegraded":"2024-09-12T22:48:08.674540+0000","last_fullsized":"2024-09-12T22:48:08.674540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:56.377664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679335+0000","last_change":"2024-09-12T22:48:05.174947+0000","last_active":"2024-09-12T22:48:08.679335+0000","last_peered":"2024-09-12T22:48:08.679335+0000","last_clean":"2024-09-12T22:48:08.679335+0000","last_became_active":"2024-09-12T22:48:05.174503+0000","last_became_peered":"2024-09-12T22:48:05.174503+0000","last_unstale":"2024-09-12T22:48:08.679335+0000","last_undegraded":"2024-09-12T22:48:08.679335+0000","last_fullsized":"2024-09-12T22:48:08.679335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:01.401542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674557+0000","last_change":"2024-09-12T22:48:04.166198+0000","last_active":"2024-09-12T22:48:08.674557+0000","last_peered":"2024-09-12T22:48:08.674557+0000","last_clean":"2024-09-12T22:48:08.674557+0000","last_became_active":"2024-09-12T22:48:04.165795+0000","last_became_peered":"2024-09-12T22:48:04.165795+0000","last_unstale":"2024-09-12T22:48:08.674557+0000","last_undegraded":"2024-09-12T22:48:08.674557+0000","last_fullsized":"2024-09-12T22:48:08.674557+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:35.203049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":802816,"data_stored":656071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":176128,"data_stored":59641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":655436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:48:12.886 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T22:48:12.886 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T22:48:12.886 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T22:48:12.887 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T22:48:12.887 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T22:48:13.264 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:48:13.276 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2801025707},{"type":"v1","addr":"172.21.15.66:6801","nonce":2801025707}]},"active_addr":"172.21.15.66:6801/2801025707","active_change":"2024-09-12T22:47:48.117628+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4114,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.66:0","nonce":333673281}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.66:0","nonce":805368411}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.66:0","nonce":1465698942}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.66:0","nonce":3067697084}]}]} 2024-09-12T22:48:13.281 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T22:48:13.281 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T22:48:13.281 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:48:13.572 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:48:13.572 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":20,"fsid":"5714c6a5-034c-4330-a57b-d22492ad8e43","created":"2024-09-12T22:47:43.881551+0000","modified":"2024-09-12T22:48:08.667860+0000","last_up_change":"2024-09-12T22:47:54.013185+0000","last_in_change":"2024-09-12T22:47:44.690260+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:47:54.168813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:47:58.920007+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:48:03.033410+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:48:03.489928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ed48fb2-48c2-4ecb-9306-372a05b08cee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6801","nonce":1747255146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6803","nonce":1747255146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6807","nonce":1747255146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6805","nonce":1747255146}]},"public_addr":"172.21.15.87:6801/1747255146","cluster_addr":"172.21.15.87:6803/1747255146","heartbeat_back_addr":"172.21.15.87:6807/1747255146","heartbeat_front_addr":"172.21.15.87:6805/1747255146","state":["exists","up"]},{"osd":1,"uuid":"af934313-a6b4-4e15-9818-6fc3fb71b949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6801","nonce":1159429503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6803","nonce":1159429503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6807","nonce":1159429503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6805","nonce":1159429503}]},"public_addr":"172.21.15.99:6801/1159429503","cluster_addr":"172.21.15.99:6803/1159429503","heartbeat_back_addr":"172.21.15.99:6807/1159429503","heartbeat_front_addr":"172.21.15.99:6805/1159429503","state":["exists","up"]},{"osd":2,"uuid":"185ee2bd-8c37-4de1-b6ef-2988144d1470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2828388397},{"type":"v1","addr":"172.21.15.117:6801","nonce":2828388397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2828388397},{"type":"v1","addr":"172.21.15.117:6803","nonce":2828388397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2828388397},{"type":"v1","addr":"172.21.15.117:6807","nonce":2828388397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2828388397},{"type":"v1","addr":"172.21.15.117:6805","nonce":2828388397}]},"public_addr":"172.21.15.117:6801/2828388397","cluster_addr":"172.21.15.117:6803/2828388397","heartbeat_back_addr":"172.21.15.117:6807/2828388397","heartbeat_front_addr":"172.21.15.117:6805/2828388397","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:47:51.816709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:47:51.376989+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:47:51.833489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:48:13.585 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T22:48:13.585 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:48:13.874 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:48:13.874 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":20,"fsid":"5714c6a5-034c-4330-a57b-d22492ad8e43","created":"2024-09-12T22:47:43.881551+0000","modified":"2024-09-12T22:48:08.667860+0000","last_up_change":"2024-09-12T22:47:54.013185+0000","last_in_change":"2024-09-12T22:47:44.690260+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:47:54.168813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:47:58.920007+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:48:03.033410+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:48:03.489928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ed48fb2-48c2-4ecb-9306-372a05b08cee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6801","nonce":1747255146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6803","nonce":1747255146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6807","nonce":1747255146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6805","nonce":1747255146}]},"public_addr":"172.21.15.87:6801/1747255146","cluster_addr":"172.21.15.87:6803/1747255146","heartbeat_back_addr":"172.21.15.87:6807/1747255146","heartbeat_front_addr":"172.21.15.87:6805/1747255146","state":["exists","up"]},{"osd":1,"uuid":"af934313-a6b4-4e15-9818-6fc3fb71b949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6801","nonce":1159429503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6803","nonce":1159429503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6807","nonce":1159429503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6805","nonce":1159429503}]},"public_addr":"172.21.15.99:6801/1159429503","cluster_addr":"172.21.15.99:6803/1159429503","heartbeat_back_addr":"172.21.15.99:6807/1159429503","heartbeat_front_addr":"172.21.15.99:6805/1159429503","state":["exists","up"]},{"osd":2,"uuid":"185ee2bd-8c37-4de1-b6ef-2988144d1470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2828388397},{"type":"v1","addr":"172.21.15.117:6801","nonce":2828388397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2828388397},{"type":"v1","addr":"172.21.15.117:6803","nonce":2828388397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2828388397},{"type":"v1","addr":"172.21.15.117:6807","nonce":2828388397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2828388397},{"type":"v1","addr":"172.21.15.117:6805","nonce":2828388397}]},"public_addr":"172.21.15.117:6801/2828388397","cluster_addr":"172.21.15.117:6803/2828388397","heartbeat_back_addr":"172.21.15.117:6807/2828388397","heartbeat_front_addr":"172.21.15.117:6805/2828388397","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:47:51.816709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:47:51.376989+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:47:51.833489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:48:13.887 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T22:48:13.888 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T22:48:13.888 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T22:48:14.032 INFO:teuthology.orchestra.run.smithi066.stdout:34359738375 2024-09-12T22:48:14.032 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T22:48:14.050 INFO:teuthology.orchestra.run.smithi066.stdout:34359738373 2024-09-12T22:48:14.051 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T22:48:14.051 INFO:teuthology.orchestra.run.smithi066.stdout:34359738375 2024-09-12T22:48:14.052 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T22:48:14.334 INFO:teuthology.orchestra.run.smithi066.stdout:34359738374 2024-09-12T22:48:14.352 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.0 2024-09-12T22:48:14.390 INFO:teuthology.orchestra.run.smithi066.stdout:34359738374 2024-09-12T22:48:14.403 INFO:teuthology.orchestra.run.smithi066.stdout:34359738372 2024-09-12T22:48:14.403 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.2 2024-09-12T22:48:14.416 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738372 for osd.1 2024-09-12T22:48:15.354 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T22:48:15.404 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T22:48:15.416 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T22:48:15.663 INFO:teuthology.orchestra.run.smithi066.stdout:34359738375 2024-09-12T22:48:15.676 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738375 for osd.0 2024-09-12T22:48:15.676 DEBUG:teuthology.parallel:result is None 2024-09-12T22:48:15.706 INFO:teuthology.orchestra.run.smithi066.stdout:34359738375 2024-09-12T22:48:15.718 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738375 for osd.2 2024-09-12T22:48:15.719 DEBUG:teuthology.parallel:result is None 2024-09-12T22:48:15.749 INFO:teuthology.orchestra.run.smithi066.stdout:34359738373 2024-09-12T22:48:15.761 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738373 for osd.1 2024-09-12T22:48:15.762 DEBUG:teuthology.parallel:result is None 2024-09-12T22:48:15.762 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T22:48:15.762 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:48:16.096 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:48:16.097 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-09-12T22:48:16.107 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-09-12T22:48:14.129004+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86984,"kb_used_data":1736,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283028536,"statfs":{"total":289910292480,"available":289821220864,"internally_reserved":0,"allocated":1777664,"data_stored":1375416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001432"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677255+0000","last_change":"2024-09-12T22:48:05.174190+0000","last_active":"2024-09-12T22:48:08.677255+0000","last_peered":"2024-09-12T22:48:08.677255+0000","last_clean":"2024-09-12T22:48:08.677255+0000","last_became_active":"2024-09-12T22:48:05.172964+0000","last_became_peered":"2024-09-12T22:48:05.172964+0000","last_unstale":"2024-09-12T22:48:08.677255+0000","last_undegraded":"2024-09-12T22:48:08.677255+0000","last_fullsized":"2024-09-12T22:48:08.677255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:49.868891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676980+0000","last_change":"2024-09-12T22:48:05.173045+0000","last_active":"2024-09-12T22:48:08.676980+0000","last_peered":"2024-09-12T22:48:08.676980+0000","last_clean":"2024-09-12T22:48:08.676980+0000","last_became_active":"2024-09-12T22:48:05.172684+0000","last_became_peered":"2024-09-12T22:48:05.172684+0000","last_unstale":"2024-09-12T22:48:08.676980+0000","last_undegraded":"2024-09-12T22:48:08.676980+0000","last_fullsized":"2024-09-12T22:48:08.676980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:51.360504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679907+0000","last_change":"2024-09-12T22:48:05.178267+0000","last_active":"2024-09-12T22:48:08.679907+0000","last_peered":"2024-09-12T22:48:08.679907+0000","last_clean":"2024-09-12T22:48:08.679907+0000","last_became_active":"2024-09-12T22:48:05.177555+0000","last_became_peered":"2024-09-12T22:48:05.177555+0000","last_unstale":"2024-09-12T22:48:08.679907+0000","last_undegraded":"2024-09-12T22:48:08.679907+0000","last_fullsized":"2024-09-12T22:48:08.679907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:58.991752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679782+0000","last_change":"2024-09-12T22:48:05.173539+0000","last_active":"2024-09-12T22:48:08.679782+0000","last_peered":"2024-09-12T22:48:08.679782+0000","last_clean":"2024-09-12T22:48:08.679782+0000","last_became_active":"2024-09-12T22:48:05.172647+0000","last_became_peered":"2024-09-12T22:48:05.172647+0000","last_unstale":"2024-09-12T22:48:08.679782+0000","last_undegraded":"2024-09-12T22:48:08.679782+0000","last_fullsized":"2024-09-12T22:48:08.679782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:56:34.490182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676660+0000","last_change":"2024-09-12T22:48:05.170306+0000","last_active":"2024-09-12T22:48:08.676660+0000","last_peered":"2024-09-12T22:48:08.676660+0000","last_clean":"2024-09-12T22:48:08.676660+0000","last_became_active":"2024-09-12T22:48:05.169940+0000","last_became_peered":"2024-09-12T22:48:05.169940+0000","last_unstale":"2024-09-12T22:48:08.676660+0000","last_undegraded":"2024-09-12T22:48:08.676660+0000","last_fullsized":"2024-09-12T22:48:08.676660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:52.341512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679410+0000","last_change":"2024-09-12T22:48:05.173232+0000","last_active":"2024-09-12T22:48:08.679410+0000","last_peered":"2024-09-12T22:48:08.679410+0000","last_clean":"2024-09-12T22:48:08.679410+0000","last_became_active":"2024-09-12T22:48:05.172213+0000","last_became_peered":"2024-09-12T22:48:05.172213+0000","last_unstale":"2024-09-12T22:48:08.679410+0000","last_undegraded":"2024-09-12T22:48:08.679410+0000","last_fullsized":"2024-09-12T22:48:08.679410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:25.994320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679563+0000","last_change":"2024-09-12T22:48:05.172187+0000","last_active":"2024-09-12T22:48:08.679563+0000","last_peered":"2024-09-12T22:48:08.679563+0000","last_clean":"2024-09-12T22:48:08.679563+0000","last_became_active":"2024-09-12T22:48:05.171766+0000","last_became_peered":"2024-09-12T22:48:05.171766+0000","last_unstale":"2024-09-12T22:48:08.679563+0000","last_undegraded":"2024-09-12T22:48:08.679563+0000","last_fullsized":"2024-09-12T22:48:08.679563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:49.868891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679126+0000","last_change":"2024-09-12T22:48:05.174326+0000","last_active":"2024-09-12T22:48:08.679126+0000","last_peered":"2024-09-12T22:48:08.679126+0000","last_clean":"2024-09-12T22:48:08.679126+0000","last_became_active":"2024-09-12T22:48:05.172312+0000","last_became_peered":"2024-09-12T22:48:05.172312+0000","last_unstale":"2024-09-12T22:48:08.679126+0000","last_undegraded":"2024-09-12T22:48:08.679126+0000","last_fullsized":"2024-09-12T22:48:08.679126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:52.071513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674344+0000","last_change":"2024-09-12T22:48:05.178445+0000","last_active":"2024-09-12T22:48:08.674344+0000","last_peered":"2024-09-12T22:48:08.674344+0000","last_clean":"2024-09-12T22:48:08.674344+0000","last_became_active":"2024-09-12T22:48:05.177284+0000","last_became_peered":"2024-09-12T22:48:05.177284+0000","last_unstale":"2024-09-12T22:48:08.674344+0000","last_undegraded":"2024-09-12T22:48:08.674344+0000","last_fullsized":"2024-09-12T22:48:08.674344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:45.140060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677090+0000","last_change":"2024-09-12T22:48:05.172480+0000","last_active":"2024-09-12T22:48:08.677090+0000","last_peered":"2024-09-12T22:48:08.677090+0000","last_clean":"2024-09-12T22:48:08.677090+0000","last_became_active":"2024-09-12T22:48:05.171686+0000","last_became_peered":"2024-09-12T22:48:05.171686+0000","last_unstale":"2024-09-12T22:48:08.677090+0000","last_undegraded":"2024-09-12T22:48:08.677090+0000","last_fullsized":"2024-09-12T22:48:08.677090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:56.158813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680327+0000","last_change":"2024-09-12T22:48:05.172837+0000","last_active":"2024-09-12T22:48:08.680327+0000","last_peered":"2024-09-12T22:48:08.680327+0000","last_clean":"2024-09-12T22:48:08.680327+0000","last_became_active":"2024-09-12T22:48:05.171890+0000","last_became_peered":"2024-09-12T22:48:05.171890+0000","last_unstale":"2024-09-12T22:48:08.680327+0000","last_undegraded":"2024-09-12T22:48:08.680327+0000","last_fullsized":"2024-09-12T22:48:08.680327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:46.965030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676812+0000","last_change":"2024-09-12T22:48:05.175666+0000","last_active":"2024-09-12T22:48:08.676812+0000","last_peered":"2024-09-12T22:48:08.676812+0000","last_clean":"2024-09-12T22:48:08.676812+0000","last_became_active":"2024-09-12T22:48:05.175390+0000","last_became_peered":"2024-09-12T22:48:05.175390+0000","last_unstale":"2024-09-12T22:48:08.676812+0000","last_undegraded":"2024-09-12T22:48:08.676812+0000","last_fullsized":"2024-09-12T22:48:08.676812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:13.160164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676555+0000","last_change":"2024-09-12T22:48:05.171356+0000","last_active":"2024-09-12T22:48:08.676555+0000","last_peered":"2024-09-12T22:48:08.676555+0000","last_clean":"2024-09-12T22:48:08.676555+0000","last_became_active":"2024-09-12T22:48:05.170794+0000","last_became_peered":"2024-09-12T22:48:05.170794+0000","last_unstale":"2024-09-12T22:48:08.676555+0000","last_undegraded":"2024-09-12T22:48:08.676555+0000","last_fullsized":"2024-09-12T22:48:08.676555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:42:56.969660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679530+0000","last_change":"2024-09-12T22:48:05.168780+0000","last_active":"2024-09-12T22:48:08.679530+0000","last_peered":"2024-09-12T22:48:08.679530+0000","last_clean":"2024-09-12T22:48:08.679530+0000","last_became_active":"2024-09-12T22:48:05.168294+0000","last_became_peered":"2024-09-12T22:48:05.168294+0000","last_unstale":"2024-09-12T22:48:08.679530+0000","last_undegraded":"2024-09-12T22:48:08.679530+0000","last_fullsized":"2024-09-12T22:48:08.679530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:30.120804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679600+0000","last_change":"2024-09-12T22:48:05.168344+0000","last_active":"2024-09-12T22:48:08.679600+0000","last_peered":"2024-09-12T22:48:08.679600+0000","last_clean":"2024-09-12T22:48:08.679600+0000","last_became_active":"2024-09-12T22:48:05.167805+0000","last_became_peered":"2024-09-12T22:48:05.167805+0000","last_unstale":"2024-09-12T22:48:08.679600+0000","last_undegraded":"2024-09-12T22:48:08.679600+0000","last_fullsized":"2024-09-12T22:48:08.679600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:32.288419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679162+0000","last_change":"2024-09-12T22:48:05.174663+0000","last_active":"2024-09-12T22:48:08.679162+0000","last_peered":"2024-09-12T22:48:08.679162+0000","last_clean":"2024-09-12T22:48:08.679162+0000","last_became_active":"2024-09-12T22:48:05.173101+0000","last_became_peered":"2024-09-12T22:48:05.173101+0000","last_unstale":"2024-09-12T22:48:08.679162+0000","last_undegraded":"2024-09-12T22:48:08.679162+0000","last_fullsized":"2024-09-12T22:48:08.679162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:25.143572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674747+0000","last_change":"2024-09-12T22:48:05.178721+0000","last_active":"2024-09-12T22:48:08.674747+0000","last_peered":"2024-09-12T22:48:08.674747+0000","last_clean":"2024-09-12T22:48:08.674747+0000","last_became_active":"2024-09-12T22:48:05.177965+0000","last_became_peered":"2024-09-12T22:48:05.177965+0000","last_unstale":"2024-09-12T22:48:08.674747+0000","last_undegraded":"2024-09-12T22:48:08.674747+0000","last_fullsized":"2024-09-12T22:48:08.674747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:32.288419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677222+0000","last_change":"2024-09-12T22:48:05.171053+0000","last_active":"2024-09-12T22:48:08.677222+0000","last_peered":"2024-09-12T22:48:08.677222+0000","last_clean":"2024-09-12T22:48:08.677222+0000","last_became_active":"2024-09-12T22:48:05.170578+0000","last_became_peered":"2024-09-12T22:48:05.170578+0000","last_unstale":"2024-09-12T22:48:08.677222+0000","last_undegraded":"2024-09-12T22:48:08.677222+0000","last_fullsized":"2024-09-12T22:48:08.677222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:58.991752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674239+0000","last_change":"2024-09-12T22:48:05.177369+0000","last_active":"2024-09-12T22:48:08.674239+0000","last_peered":"2024-09-12T22:48:08.674239+0000","last_clean":"2024-09-12T22:48:08.674239+0000","last_became_active":"2024-09-12T22:48:05.176680+0000","last_became_peered":"2024-09-12T22:48:05.176680+0000","last_unstale":"2024-09-12T22:48:08.674239+0000","last_undegraded":"2024-09-12T22:48:08.674239+0000","last_fullsized":"2024-09-12T22:48:08.674239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:25.143572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680241+0000","last_change":"2024-09-12T22:48:05.173232+0000","last_active":"2024-09-12T22:48:08.680241+0000","last_peered":"2024-09-12T22:48:08.680241+0000","last_clean":"2024-09-12T22:48:08.680241+0000","last_became_active":"2024-09-12T22:48:05.172382+0000","last_became_peered":"2024-09-12T22:48:05.172382+0000","last_unstale":"2024-09-12T22:48:08.680241+0000","last_undegraded":"2024-09-12T22:48:08.680241+0000","last_fullsized":"2024-09-12T22:48:08.680241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:28.083344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679924+0000","last_change":"2024-09-12T22:48:05.174799+0000","last_active":"2024-09-12T22:48:08.679924+0000","last_peered":"2024-09-12T22:48:08.679924+0000","last_clean":"2024-09-12T22:48:08.679924+0000","last_became_active":"2024-09-12T22:48:05.174423+0000","last_became_peered":"2024-09-12T22:48:05.174423+0000","last_unstale":"2024-09-12T22:48:08.679924+0000","last_undegraded":"2024-09-12T22:48:08.679924+0000","last_fullsized":"2024-09-12T22:48:08.679924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:56.158813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676495+0000","last_change":"2024-09-12T22:48:05.175363+0000","last_active":"2024-09-12T22:48:08.676495+0000","last_peered":"2024-09-12T22:48:08.676495+0000","last_clean":"2024-09-12T22:48:08.676495+0000","last_became_active":"2024-09-12T22:48:05.174832+0000","last_became_peered":"2024-09-12T22:48:05.174832+0000","last_unstale":"2024-09-12T22:48:08.676495+0000","last_undegraded":"2024-09-12T22:48:08.676495+0000","last_fullsized":"2024-09-12T22:48:08.676495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:25.994320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673471+0000","last_change":"2024-09-12T22:48:05.169838+0000","last_active":"2024-09-12T22:48:08.673471+0000","last_peered":"2024-09-12T22:48:08.673471+0000","last_clean":"2024-09-12T22:48:08.673471+0000","last_became_active":"2024-09-12T22:48:05.169462+0000","last_became_peered":"2024-09-12T22:48:05.169462+0000","last_unstale":"2024-09-12T22:48:08.673471+0000","last_undegraded":"2024-09-12T22:48:08.673471+0000","last_fullsized":"2024-09-12T22:48:08.673471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:42:56.969660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676149+0000","last_change":"2024-09-12T22:48:05.172794+0000","last_active":"2024-09-12T22:48:08.676149+0000","last_peered":"2024-09-12T22:48:08.676149+0000","last_clean":"2024-09-12T22:48:08.676149+0000","last_became_active":"2024-09-12T22:48:05.172437+0000","last_became_peered":"2024-09-12T22:48:05.172437+0000","last_unstale":"2024-09-12T22:48:08.676149+0000","last_undegraded":"2024-09-12T22:48:08.676149+0000","last_fullsized":"2024-09-12T22:48:08.676149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:54:44.278646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677275+0000","last_change":"2024-09-12T22:48:05.173714+0000","last_active":"2024-09-12T22:48:08.677275+0000","last_peered":"2024-09-12T22:48:08.677275+0000","last_clean":"2024-09-12T22:48:08.677275+0000","last_became_active":"2024-09-12T22:48:05.172938+0000","last_became_peered":"2024-09-12T22:48:05.172938+0000","last_unstale":"2024-09-12T22:48:08.677275+0000","last_undegraded":"2024-09-12T22:48:08.677275+0000","last_fullsized":"2024-09-12T22:48:08.677275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:30.120804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674352+0000","last_change":"2024-09-12T22:48:05.177862+0000","last_active":"2024-09-12T22:48:08.674352+0000","last_peered":"2024-09-12T22:48:08.674352+0000","last_clean":"2024-09-12T22:48:08.674352+0000","last_became_active":"2024-09-12T22:48:05.177545+0000","last_became_peered":"2024-09-12T22:48:05.177545+0000","last_unstale":"2024-09-12T22:48:08.674352+0000","last_undegraded":"2024-09-12T22:48:08.674352+0000","last_fullsized":"2024-09-12T22:48:08.674352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:25.994320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680458+0000","last_change":"2024-09-12T22:48:05.178249+0000","last_active":"2024-09-12T22:48:08.680458+0000","last_peered":"2024-09-12T22:48:08.680458+0000","last_clean":"2024-09-12T22:48:08.680458+0000","last_became_active":"2024-09-12T22:48:05.177582+0000","last_became_peered":"2024-09-12T22:48:05.177582+0000","last_unstale":"2024-09-12T22:48:08.680458+0000","last_undegraded":"2024-09-12T22:48:08.680458+0000","last_fullsized":"2024-09-12T22:48:08.680458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:25.556218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677103+0000","last_change":"2024-09-12T22:48:05.171326+0000","last_active":"2024-09-12T22:48:08.677103+0000","last_peered":"2024-09-12T22:48:08.677103+0000","last_clean":"2024-09-12T22:48:08.677103+0000","last_became_active":"2024-09-12T22:48:05.170491+0000","last_became_peered":"2024-09-12T22:48:05.170491+0000","last_unstale":"2024-09-12T22:48:08.677103+0000","last_undegraded":"2024-09-12T22:48:08.677103+0000","last_fullsized":"2024-09-12T22:48:08.677103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:52.071513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674052+0000","last_change":"2024-09-12T22:48:05.177176+0000","last_active":"2024-09-12T22:48:08.674052+0000","last_peered":"2024-09-12T22:48:08.674052+0000","last_clean":"2024-09-12T22:48:08.674052+0000","last_became_active":"2024-09-12T22:48:05.176735+0000","last_became_peered":"2024-09-12T22:48:05.176735+0000","last_unstale":"2024-09-12T22:48:08.674052+0000","last_undegraded":"2024-09-12T22:48:08.674052+0000","last_fullsized":"2024-09-12T22:48:08.674052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:51.360504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676676+0000","last_change":"2024-09-12T22:48:05.171180+0000","last_active":"2024-09-12T22:48:08.676676+0000","last_peered":"2024-09-12T22:48:08.676676+0000","last_clean":"2024-09-12T22:48:08.676676+0000","last_became_active":"2024-09-12T22:48:05.170263+0000","last_became_peered":"2024-09-12T22:48:05.170263+0000","last_unstale":"2024-09-12T22:48:08.676676+0000","last_undegraded":"2024-09-12T22:48:08.676676+0000","last_fullsized":"2024-09-12T22:48:08.676676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:25.143572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673611+0000","last_change":"2024-09-12T22:48:05.176878+0000","last_active":"2024-09-12T22:48:08.673611+0000","last_peered":"2024-09-12T22:48:08.673611+0000","last_clean":"2024-09-12T22:48:08.673611+0000","last_became_active":"2024-09-12T22:48:05.176327+0000","last_became_peered":"2024-09-12T22:48:05.176327+0000","last_unstale":"2024-09-12T22:48:08.673611+0000","last_undegraded":"2024-09-12T22:48:08.673611+0000","last_fullsized":"2024-09-12T22:48:08.673611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:11.781766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679222+0000","last_change":"2024-09-12T22:48:05.174818+0000","last_active":"2024-09-12T22:48:08.679222+0000","last_peered":"2024-09-12T22:48:08.679222+0000","last_clean":"2024-09-12T22:48:08.679222+0000","last_became_active":"2024-09-12T22:48:05.173485+0000","last_became_peered":"2024-09-12T22:48:05.173485+0000","last_unstale":"2024-09-12T22:48:08.679222+0000","last_undegraded":"2024-09-12T22:48:08.679222+0000","last_fullsized":"2024-09-12T22:48:08.679222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:24.124647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676980+0000","last_change":"2024-09-12T22:48:05.171573+0000","last_active":"2024-09-12T22:48:08.676980+0000","last_peered":"2024-09-12T22:48:08.676980+0000","last_clean":"2024-09-12T22:48:08.676980+0000","last_became_active":"2024-09-12T22:48:05.171036+0000","last_became_peered":"2024-09-12T22:48:05.171036+0000","last_unstale":"2024-09-12T22:48:08.676980+0000","last_undegraded":"2024-09-12T22:48:08.676980+0000","last_fullsized":"2024-09-12T22:48:08.676980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:27:07.558853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679924+0000","last_change":"2024-09-12T22:48:04.171960+0000","last_active":"2024-09-12T22:48:08.679924+0000","last_peered":"2024-09-12T22:48:08.679924+0000","last_clean":"2024-09-12T22:48:08.679924+0000","last_became_active":"2024-09-12T22:48:04.171562+0000","last_became_peered":"2024-09-12T22:48:04.171562+0000","last_unstale":"2024-09-12T22:48:08.679924+0000","last_undegraded":"2024-09-12T22:48:08.679924+0000","last_fullsized":"2024-09-12T22:48:08.679924+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:00.271198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677053+0000","last_change":"2024-09-12T22:48:05.173585+0000","last_active":"2024-09-12T22:48:08.677053+0000","last_peered":"2024-09-12T22:48:08.677053+0000","last_clean":"2024-09-12T22:48:08.677053+0000","last_became_active":"2024-09-12T22:48:05.172801+0000","last_became_peered":"2024-09-12T22:48:05.172801+0000","last_unstale":"2024-09-12T22:48:08.677053+0000","last_undegraded":"2024-09-12T22:48:08.677053+0000","last_fullsized":"2024-09-12T22:48:08.677053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:45.140060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674214+0000","last_change":"2024-09-12T22:48:04.167352+0000","last_active":"2024-09-12T22:48:08.674214+0000","last_peered":"2024-09-12T22:48:08.674214+0000","last_clean":"2024-09-12T22:48:08.674214+0000","last_became_active":"2024-09-12T22:48:04.166743+0000","last_became_peered":"2024-09-12T22:48:04.166743+0000","last_unstale":"2024-09-12T22:48:08.674214+0000","last_undegraded":"2024-09-12T22:48:08.674214+0000","last_fullsized":"2024-09-12T22:48:08.674214+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:30:27.547041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674597+0000","last_change":"2024-09-12T22:48:05.178409+0000","last_active":"2024-09-12T22:48:08.674597+0000","last_peered":"2024-09-12T22:48:08.674597+0000","last_clean":"2024-09-12T22:48:08.674597+0000","last_became_active":"2024-09-12T22:48:05.178076+0000","last_became_peered":"2024-09-12T22:48:05.178076+0000","last_unstale":"2024-09-12T22:48:08.674597+0000","last_undegraded":"2024-09-12T22:48:08.674597+0000","last_fullsized":"2024-09-12T22:48:08.674597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:01.401542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676355+0000","last_change":"2024-09-12T22:48:04.171173+0000","last_active":"2024-09-12T22:48:08.676355+0000","last_peered":"2024-09-12T22:48:08.676355+0000","last_clean":"2024-09-12T22:48:08.676355+0000","last_became_active":"2024-09-12T22:48:04.170891+0000","last_became_peered":"2024-09-12T22:48:04.170891+0000","last_unstale":"2024-09-12T22:48:08.676355+0000","last_undegraded":"2024-09-12T22:48:08.676355+0000","last_fullsized":"2024-09-12T22:48:08.676355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:02.023664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674470+0000","last_change":"2024-09-12T22:48:05.177510+0000","last_active":"2024-09-12T22:48:08.674470+0000","last_peered":"2024-09-12T22:48:08.674470+0000","last_clean":"2024-09-12T22:48:08.674470+0000","last_became_active":"2024-09-12T22:48:05.176568+0000","last_became_peered":"2024-09-12T22:48:05.176568+0000","last_unstale":"2024-09-12T22:48:08.674470+0000","last_undegraded":"2024-09-12T22:48:08.674470+0000","last_fullsized":"2024-09-12T22:48:08.674470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:49.868891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679221+0000","last_change":"2024-09-12T22:48:04.173161+0000","last_active":"2024-09-12T22:48:08.679221+0000","last_peered":"2024-09-12T22:48:08.679221+0000","last_clean":"2024-09-12T22:48:08.679221+0000","last_became_active":"2024-09-12T22:48:04.172623+0000","last_became_peered":"2024-09-12T22:48:04.172623+0000","last_unstale":"2024-09-12T22:48:08.679221+0000","last_undegraded":"2024-09-12T22:48:08.679221+0000","last_fullsized":"2024-09-12T22:48:08.679221+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:13.739087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680199+0000","last_change":"2024-09-12T22:48:04.173041+0000","last_active":"2024-09-12T22:48:08.680199+0000","last_peered":"2024-09-12T22:48:08.680199+0000","last_clean":"2024-09-12T22:48:08.680199+0000","last_became_active":"2024-09-12T22:48:04.172527+0000","last_became_peered":"2024-09-12T22:48:04.172527+0000","last_unstale":"2024-09-12T22:48:08.680199+0000","last_undegraded":"2024-09-12T22:48:08.680199+0000","last_fullsized":"2024-09-12T22:48:08.680199+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:20.734653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676178+0000","last_change":"2024-09-12T22:48:05.175921+0000","last_active":"2024-09-12T22:48:08.676178+0000","last_peered":"2024-09-12T22:48:08.676178+0000","last_clean":"2024-09-12T22:48:08.676178+0000","last_became_active":"2024-09-12T22:48:05.175226+0000","last_became_peered":"2024-09-12T22:48:05.175226+0000","last_unstale":"2024-09-12T22:48:08.676178+0000","last_undegraded":"2024-09-12T22:48:08.676178+0000","last_fullsized":"2024-09-12T22:48:08.676178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:08.021196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677320+0000","last_change":"2024-09-12T22:48:04.167564+0000","last_active":"2024-09-12T22:48:08.677320+0000","last_peered":"2024-09-12T22:48:08.677320+0000","last_clean":"2024-09-12T22:48:08.677320+0000","last_became_active":"2024-09-12T22:48:04.167254+0000","last_became_peered":"2024-09-12T22:48:04.167254+0000","last_unstale":"2024-09-12T22:48:08.677320+0000","last_undegraded":"2024-09-12T22:48:08.677320+0000","last_fullsized":"2024-09-12T22:48:08.677320+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:35.879041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676271+0000","last_change":"2024-09-12T22:48:05.171143+0000","last_active":"2024-09-12T22:48:08.676271+0000","last_peered":"2024-09-12T22:48:08.676271+0000","last_clean":"2024-09-12T22:48:08.676271+0000","last_became_active":"2024-09-12T22:48:05.170374+0000","last_became_peered":"2024-09-12T22:48:05.170374+0000","last_unstale":"2024-09-12T22:48:08.676271+0000","last_undegraded":"2024-09-12T22:48:08.676271+0000","last_fullsized":"2024-09-12T22:48:08.676271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:15.887977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680611+0000","last_change":"2024-09-12T22:48:04.173325+0000","last_active":"2024-09-12T22:48:08.680611+0000","last_peered":"2024-09-12T22:48:08.680611+0000","last_clean":"2024-09-12T22:48:08.680611+0000","last_became_active":"2024-09-12T22:48:04.172862+0000","last_became_peered":"2024-09-12T22:48:04.172862+0000","last_unstale":"2024-09-12T22:48:08.680611+0000","last_undegraded":"2024-09-12T22:48:08.680611+0000","last_fullsized":"2024-09-12T22:48:08.680611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:42:33.314407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679603+0000","last_change":"2024-09-12T22:48:05.173382+0000","last_active":"2024-09-12T22:48:08.679603+0000","last_peered":"2024-09-12T22:48:08.679603+0000","last_clean":"2024-09-12T22:48:08.679603+0000","last_became_active":"2024-09-12T22:48:05.172429+0000","last_became_peered":"2024-09-12T22:48:05.172429+0000","last_unstale":"2024-09-12T22:48:08.679603+0000","last_undegraded":"2024-09-12T22:48:08.679603+0000","last_fullsized":"2024-09-12T22:48:08.679603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:44:38.144948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680436+0000","last_change":"2024-09-12T22:48:04.172099+0000","last_active":"2024-09-12T22:48:08.680436+0000","last_peered":"2024-09-12T22:48:08.680436+0000","last_clean":"2024-09-12T22:48:08.680436+0000","last_became_active":"2024-09-12T22:48:04.171746+0000","last_became_peered":"2024-09-12T22:48:04.171746+0000","last_unstale":"2024-09-12T22:48:08.680436+0000","last_undegraded":"2024-09-12T22:48:08.680436+0000","last_fullsized":"2024-09-12T22:48:08.680436+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:35:28.894178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674110+0000","last_change":"2024-09-12T22:48:05.177824+0000","last_active":"2024-09-12T22:48:08.674110+0000","last_peered":"2024-09-12T22:48:08.674110+0000","last_clean":"2024-09-12T22:48:08.674110+0000","last_became_active":"2024-09-12T22:48:05.177344+0000","last_became_peered":"2024-09-12T22:48:05.177344+0000","last_unstale":"2024-09-12T22:48:08.674110+0000","last_undegraded":"2024-09-12T22:48:08.674110+0000","last_fullsized":"2024-09-12T22:48:08.674110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:52.071513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674213+0000","last_change":"2024-09-12T22:48:04.167459+0000","last_active":"2024-09-12T22:48:08.674213+0000","last_peered":"2024-09-12T22:48:08.674213+0000","last_clean":"2024-09-12T22:48:08.674213+0000","last_became_active":"2024-09-12T22:48:04.165825+0000","last_became_peered":"2024-09-12T22:48:04.165825+0000","last_unstale":"2024-09-12T22:48:08.674213+0000","last_undegraded":"2024-09-12T22:48:08.674213+0000","last_fullsized":"2024-09-12T22:48:08.674213+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:20.734653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679998+0000","last_change":"2024-09-12T22:48:05.173859+0000","last_active":"2024-09-12T22:48:08.679998+0000","last_peered":"2024-09-12T22:48:08.679998+0000","last_clean":"2024-09-12T22:48:08.679998+0000","last_became_active":"2024-09-12T22:48:05.173276+0000","last_became_peered":"2024-09-12T22:48:05.173276+0000","last_unstale":"2024-09-12T22:48:08.679998+0000","last_undegraded":"2024-09-12T22:48:08.679998+0000","last_fullsized":"2024-09-12T22:48:08.679998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:06:31.953025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679767+0000","last_change":"2024-09-12T22:48:04.172158+0000","last_active":"2024-09-12T22:48:08.679767+0000","last_peered":"2024-09-12T22:48:08.679767+0000","last_clean":"2024-09-12T22:48:08.679767+0000","last_became_active":"2024-09-12T22:48:04.171514+0000","last_became_peered":"2024-09-12T22:48:04.171514+0000","last_unstale":"2024-09-12T22:48:08.679767+0000","last_undegraded":"2024-09-12T22:48:08.679767+0000","last_fullsized":"2024-09-12T22:48:08.679767+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:40:29.366846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680561+0000","last_change":"2024-09-12T22:48:05.178528+0000","last_active":"2024-09-12T22:48:08.680561+0000","last_peered":"2024-09-12T22:48:08.680561+0000","last_clean":"2024-09-12T22:48:08.680561+0000","last_became_active":"2024-09-12T22:48:05.177904+0000","last_became_peered":"2024-09-12T22:48:05.177904+0000","last_unstale":"2024-09-12T22:48:08.680561+0000","last_undegraded":"2024-09-12T22:48:08.680561+0000","last_fullsized":"2024-09-12T22:48:08.680561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:59.525401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676548+0000","last_change":"2024-09-12T22:48:04.171001+0000","last_active":"2024-09-12T22:48:08.676548+0000","last_peered":"2024-09-12T22:48:08.676548+0000","last_clean":"2024-09-12T22:48:08.676548+0000","last_became_active":"2024-09-12T22:48:04.170667+0000","last_became_peered":"2024-09-12T22:48:04.170667+0000","last_unstale":"2024-09-12T22:48:08.676548+0000","last_undegraded":"2024-09-12T22:48:08.676548+0000","last_fullsized":"2024-09-12T22:48:08.676548+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:04.492449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680316+0000","last_change":"2024-09-12T22:48:05.177804+0000","last_active":"2024-09-12T22:48:08.680316+0000","last_peered":"2024-09-12T22:48:08.680316+0000","last_clean":"2024-09-12T22:48:08.680316+0000","last_became_active":"2024-09-12T22:48:05.177458+0000","last_became_peered":"2024-09-12T22:48:05.177458+0000","last_unstale":"2024-09-12T22:48:08.680316+0000","last_undegraded":"2024-09-12T22:48:08.680316+0000","last_fullsized":"2024-09-12T22:48:08.680316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:47.576598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676227+0000","last_change":"2024-09-12T22:48:04.174281+0000","last_active":"2024-09-12T22:48:08.676227+0000","last_peered":"2024-09-12T22:48:08.676227+0000","last_clean":"2024-09-12T22:48:08.676227+0000","last_became_active":"2024-09-12T22:48:04.173942+0000","last_became_peered":"2024-09-12T22:48:04.173942+0000","last_unstale":"2024-09-12T22:48:08.676227+0000","last_undegraded":"2024-09-12T22:48:08.676227+0000","last_fullsized":"2024-09-12T22:48:08.676227+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:19:38.546747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674466+0000","last_change":"2024-09-12T22:48:05.178246+0000","last_active":"2024-09-12T22:48:08.674466+0000","last_peered":"2024-09-12T22:48:08.674466+0000","last_clean":"2024-09-12T22:48:08.674466+0000","last_became_active":"2024-09-12T22:48:05.176813+0000","last_became_peered":"2024-09-12T22:48:05.176813+0000","last_unstale":"2024-09-12T22:48:08.674466+0000","last_undegraded":"2024-09-12T22:48:08.674466+0000","last_fullsized":"2024-09-12T22:48:08.674466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:58.991752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":226,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679433+0000","last_change":"2024-09-12T22:47:56.028830+0000","last_active":"2024-09-12T22:48:08.679433+0000","last_peered":"2024-09-12T22:48:08.679433+0000","last_clean":"2024-09-12T22:48:08.679433+0000","last_became_active":"2024-09-12T22:47:56.028017+0000","last_became_peered":"2024-09-12T22:47:56.028017+0000","last_unstale":"2024-09-12T22:48:08.679433+0000","last_undegraded":"2024-09-12T22:48:08.679433+0000","last_fullsized":"2024-09-12T22:48:08.679433+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:55.016634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:55.016634+0000","last_clean_scrub_stamp":"2024-09-12T22:47:55.016634+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:03.648827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680145+0000","last_change":"2024-09-12T22:48:02.045816+0000","last_active":"2024-09-12T22:48:08.680145+0000","last_peered":"2024-09-12T22:48:08.680145+0000","last_clean":"2024-09-12T22:48:08.680145+0000","last_became_active":"2024-09-12T22:48:00.045324+0000","last_became_peered":"2024-09-12T22:48:00.045324+0000","last_unstale":"2024-09-12T22:48:08.680145+0000","last_undegraded":"2024-09-12T22:48:08.680145+0000","last_fullsized":"2024-09-12T22:48:08.680145+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:41:33.998543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065526500000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673955+0000","last_change":"2024-09-12T22:48:04.169704+0000","last_active":"2024-09-12T22:48:08.673955+0000","last_peered":"2024-09-12T22:48:08.673955+0000","last_clean":"2024-09-12T22:48:08.673955+0000","last_became_active":"2024-09-12T22:48:04.169474+0000","last_became_peered":"2024-09-12T22:48:04.169474+0000","last_unstale":"2024-09-12T22:48:08.673955+0000","last_undegraded":"2024-09-12T22:48:08.673955+0000","last_fullsized":"2024-09-12T22:48:08.673955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:00.271198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680660+0000","last_change":"2024-09-12T22:48:05.178510+0000","last_active":"2024-09-12T22:48:08.680660+0000","last_peered":"2024-09-12T22:48:08.680660+0000","last_clean":"2024-09-12T22:48:08.680660+0000","last_became_active":"2024-09-12T22:48:05.177910+0000","last_became_peered":"2024-09-12T22:48:05.177910+0000","last_unstale":"2024-09-12T22:48:08.680660+0000","last_undegraded":"2024-09-12T22:48:08.680660+0000","last_fullsized":"2024-09-12T22:48:08.680660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:19.398289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679405+0000","last_change":"2024-09-12T22:48:02.045525+0000","last_active":"2024-09-12T22:48:08.679405+0000","last_peered":"2024-09-12T22:48:08.679405+0000","last_clean":"2024-09-12T22:48:08.679405+0000","last_became_active":"2024-09-12T22:48:00.042207+0000","last_became_peered":"2024-09-12T22:48:00.042207+0000","last_unstale":"2024-09-12T22:48:08.679405+0000","last_undegraded":"2024-09-12T22:48:08.679405+0000","last_fullsized":"2024-09-12T22:48:08.679405+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:33.150497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040973099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673788+0000","last_change":"2024-09-12T22:48:04.167456+0000","last_active":"2024-09-12T22:48:08.673788+0000","last_peered":"2024-09-12T22:48:08.673788+0000","last_clean":"2024-09-12T22:48:08.673788+0000","last_became_active":"2024-09-12T22:48:04.166966+0000","last_became_peered":"2024-09-12T22:48:04.166966+0000","last_unstale":"2024-09-12T22:48:08.673788+0000","last_undegraded":"2024-09-12T22:48:08.673788+0000","last_fullsized":"2024-09-12T22:48:08.673788+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:13.739087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677214+0000","last_change":"2024-09-12T22:48:05.171819+0000","last_active":"2024-09-12T22:48:08.677214+0000","last_peered":"2024-09-12T22:48:08.677214+0000","last_clean":"2024-09-12T22:48:08.677214+0000","last_became_active":"2024-09-12T22:48:05.171293+0000","last_became_peered":"2024-09-12T22:48:05.171293+0000","last_unstale":"2024-09-12T22:48:08.677214+0000","last_undegraded":"2024-09-12T22:48:08.677214+0000","last_fullsized":"2024-09-12T22:48:08.677214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:01.401542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673968+0000","last_change":"2024-09-12T22:48:02.045209+0000","last_active":"2024-09-12T22:48:08.673968+0000","last_peered":"2024-09-12T22:48:08.673968+0000","last_clean":"2024-09-12T22:48:08.673968+0000","last_became_active":"2024-09-12T22:48:00.042007+0000","last_became_peered":"2024-09-12T22:48:00.042007+0000","last_unstale":"2024-09-12T22:48:08.673968+0000","last_undegraded":"2024-09-12T22:48:08.673968+0000","last_fullsized":"2024-09-12T22:48:08.673968+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:13.536542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036893100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676251+0000","last_change":"2024-09-12T22:48:04.171168+0000","last_active":"2024-09-12T22:48:08.676251+0000","last_peered":"2024-09-12T22:48:08.676251+0000","last_clean":"2024-09-12T22:48:08.676251+0000","last_became_active":"2024-09-12T22:48:04.170853+0000","last_became_peered":"2024-09-12T22:48:04.170853+0000","last_unstale":"2024-09-12T22:48:08.676251+0000","last_undegraded":"2024-09-12T22:48:08.676251+0000","last_fullsized":"2024-09-12T22:48:08.676251+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:32:37.715508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674596+0000","last_change":"2024-09-12T22:48:05.178865+0000","last_active":"2024-09-12T22:48:08.674596+0000","last_peered":"2024-09-12T22:48:08.674596+0000","last_clean":"2024-09-12T22:48:08.674596+0000","last_became_active":"2024-09-12T22:48:05.178010+0000","last_became_peered":"2024-09-12T22:48:05.178010+0000","last_unstale":"2024-09-12T22:48:08.674596+0000","last_undegraded":"2024-09-12T22:48:08.674596+0000","last_fullsized":"2024-09-12T22:48:08.674596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:30.120804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679847+0000","last_change":"2024-09-12T22:48:02.045684+0000","last_active":"2024-09-12T22:48:08.679847+0000","last_peered":"2024-09-12T22:48:08.679847+0000","last_clean":"2024-09-12T22:48:08.679847+0000","last_became_active":"2024-09-12T22:48:00.045286+0000","last_became_peered":"2024-09-12T22:48:00.045286+0000","last_unstale":"2024-09-12T22:48:08.679847+0000","last_undegraded":"2024-09-12T22:48:08.679847+0000","last_fullsized":"2024-09-12T22:48:08.679847+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:18:11.667143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052714799999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679984+0000","last_change":"2024-09-12T22:48:04.172355+0000","last_active":"2024-09-12T22:48:08.679984+0000","last_peered":"2024-09-12T22:48:08.679984+0000","last_clean":"2024-09-12T22:48:08.679984+0000","last_became_active":"2024-09-12T22:48:04.171905+0000","last_became_peered":"2024-09-12T22:48:04.171905+0000","last_unstale":"2024-09-12T22:48:08.679984+0000","last_undegraded":"2024-09-12T22:48:08.679984+0000","last_fullsized":"2024-09-12T22:48:08.679984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:35.203049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674351+0000","last_change":"2024-09-12T22:48:05.177561+0000","last_active":"2024-09-12T22:48:08.674351+0000","last_peered":"2024-09-12T22:48:08.674351+0000","last_clean":"2024-09-12T22:48:08.674351+0000","last_became_active":"2024-09-12T22:48:05.177164+0000","last_became_peered":"2024-09-12T22:48:05.177164+0000","last_unstale":"2024-09-12T22:48:08.674351+0000","last_undegraded":"2024-09-12T22:48:08.674351+0000","last_fullsized":"2024-09-12T22:48:08.674351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:24.124647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680715+0000","last_change":"2024-09-12T22:48:04.172271+0000","last_active":"2024-09-12T22:48:08.680715+0000","last_peered":"2024-09-12T22:48:08.680715+0000","last_clean":"2024-09-12T22:48:08.680715+0000","last_became_active":"2024-09-12T22:48:04.171739+0000","last_became_peered":"2024-09-12T22:48:04.171739+0000","last_unstale":"2024-09-12T22:48:08.680715+0000","last_undegraded":"2024-09-12T22:48:08.680715+0000","last_fullsized":"2024-09-12T22:48:08.680715+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:56.929490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674540+0000","last_change":"2024-09-12T22:48:02.045324+0000","last_active":"2024-09-12T22:48:08.674540+0000","last_peered":"2024-09-12T22:48:08.674540+0000","last_clean":"2024-09-12T22:48:08.674540+0000","last_became_active":"2024-09-12T22:48:00.042132+0000","last_became_peered":"2024-09-12T22:48:00.042132+0000","last_unstale":"2024-09-12T22:48:08.674540+0000","last_undegraded":"2024-09-12T22:48:08.674540+0000","last_fullsized":"2024-09-12T22:48:08.674540+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:24.673019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047590600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676518+0000","last_change":"2024-09-12T22:48:05.175609+0000","last_active":"2024-09-12T22:48:08.676518+0000","last_peered":"2024-09-12T22:48:08.676518+0000","last_clean":"2024-09-12T22:48:08.676518+0000","last_became_active":"2024-09-12T22:48:05.175167+0000","last_became_peered":"2024-09-12T22:48:05.175167+0000","last_unstale":"2024-09-12T22:48:08.676518+0000","last_undegraded":"2024-09-12T22:48:08.676518+0000","last_fullsized":"2024-09-12T22:48:08.676518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:11.248179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674322+0000","last_change":"2024-09-12T22:48:04.169109+0000","last_active":"2024-09-12T22:48:08.674322+0000","last_peered":"2024-09-12T22:48:08.674322+0000","last_clean":"2024-09-12T22:48:08.674322+0000","last_became_active":"2024-09-12T22:48:04.168655+0000","last_became_peered":"2024-09-12T22:48:04.168655+0000","last_unstale":"2024-09-12T22:48:08.674322+0000","last_undegraded":"2024-09-12T22:48:08.674322+0000","last_fullsized":"2024-09-12T22:48:08.674322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:02.879935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677463+0000","last_change":"2024-09-12T22:48:02.045390+0000","last_active":"2024-09-12T22:48:08.677463+0000","last_peered":"2024-09-12T22:48:08.677463+0000","last_clean":"2024-09-12T22:48:08.677463+0000","last_became_active":"2024-09-12T22:48:00.045356+0000","last_became_peered":"2024-09-12T22:48:00.045356+0000","last_unstale":"2024-09-12T22:48:08.677463+0000","last_undegraded":"2024-09-12T22:48:08.677463+0000","last_fullsized":"2024-09-12T22:48:08.677463+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:32.072080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040621599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676614+0000","last_change":"2024-09-12T22:48:05.171131+0000","last_active":"2024-09-12T22:48:08.676614+0000","last_peered":"2024-09-12T22:48:08.676614+0000","last_clean":"2024-09-12T22:48:08.676614+0000","last_became_active":"2024-09-12T22:48:05.170591+0000","last_became_peered":"2024-09-12T22:48:05.170591+0000","last_unstale":"2024-09-12T22:48:08.676614+0000","last_undegraded":"2024-09-12T22:48:08.676614+0000","last_fullsized":"2024-09-12T22:48:08.676614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:11.781766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674783+0000","last_change":"2024-09-12T22:48:04.168635+0000","last_active":"2024-09-12T22:48:08.674783+0000","last_peered":"2024-09-12T22:48:08.674783+0000","last_clean":"2024-09-12T22:48:08.674783+0000","last_became_active":"2024-09-12T22:48:04.168244+0000","last_became_peered":"2024-09-12T22:48:04.168244+0000","last_unstale":"2024-09-12T22:48:08.674783+0000","last_undegraded":"2024-09-12T22:48:08.674783+0000","last_fullsized":"2024-09-12T22:48:08.674783+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:56.929490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674718+0000","last_change":"2024-09-12T22:48:02.045428+0000","last_active":"2024-09-12T22:48:08.674718+0000","last_peered":"2024-09-12T22:48:08.674718+0000","last_clean":"2024-09-12T22:48:08.674718+0000","last_became_active":"2024-09-12T22:48:00.040536+0000","last_became_peered":"2024-09-12T22:48:00.040536+0000","last_unstale":"2024-09-12T22:48:08.674718+0000","last_undegraded":"2024-09-12T22:48:08.674718+0000","last_fullsized":"2024-09-12T22:48:08.674718+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:33.150497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057699499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673721+0000","last_change":"2024-09-12T22:48:05.170571+0000","last_active":"2024-09-12T22:48:08.673721+0000","last_peered":"2024-09-12T22:48:08.673721+0000","last_clean":"2024-09-12T22:48:08.673721+0000","last_became_active":"2024-09-12T22:48:05.170087+0000","last_became_peered":"2024-09-12T22:48:05.170087+0000","last_unstale":"2024-09-12T22:48:08.673721+0000","last_undegraded":"2024-09-12T22:48:08.673721+0000","last_fullsized":"2024-09-12T22:48:08.673721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:28.873036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674650+0000","last_change":"2024-09-12T22:48:04.166369+0000","last_active":"2024-09-12T22:48:08.674650+0000","last_peered":"2024-09-12T22:48:08.674650+0000","last_clean":"2024-09-12T22:48:08.674650+0000","last_became_active":"2024-09-12T22:48:04.165966+0000","last_became_peered":"2024-09-12T22:48:04.165966+0000","last_unstale":"2024-09-12T22:48:08.674650+0000","last_undegraded":"2024-09-12T22:48:08.674650+0000","last_fullsized":"2024-09-12T22:48:08.674650+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:40:29.366846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680266+0000","last_change":"2024-09-12T22:48:02.045500+0000","last_active":"2024-09-12T22:48:08.680266+0000","last_peered":"2024-09-12T22:48:08.680266+0000","last_clean":"2024-09-12T22:48:08.680266+0000","last_became_active":"2024-09-12T22:48:00.042210+0000","last_became_peered":"2024-09-12T22:48:00.042210+0000","last_unstale":"2024-09-12T22:48:08.680266+0000","last_undegraded":"2024-09-12T22:48:08.680266+0000","last_fullsized":"2024-09-12T22:48:08.680266+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:35:14.212372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035339799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676300+0000","last_change":"2024-09-12T22:48:05.170712+0000","last_active":"2024-09-12T22:48:08.676300+0000","last_peered":"2024-09-12T22:48:08.676300+0000","last_clean":"2024-09-12T22:48:08.676300+0000","last_became_active":"2024-09-12T22:48:05.169840+0000","last_became_peered":"2024-09-12T22:48:05.169840+0000","last_unstale":"2024-09-12T22:48:08.676300+0000","last_undegraded":"2024-09-12T22:48:08.676300+0000","last_fullsized":"2024-09-12T22:48:08.676300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:24.240533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679770+0000","last_change":"2024-09-12T22:48:05.168203+0000","last_active":"2024-09-12T22:48:08.679770+0000","last_peered":"2024-09-12T22:48:08.679770+0000","last_clean":"2024-09-12T22:48:08.679770+0000","last_became_active":"2024-09-12T22:48:05.167870+0000","last_became_peered":"2024-09-12T22:48:05.167870+0000","last_unstale":"2024-09-12T22:48:08.679770+0000","last_undegraded":"2024-09-12T22:48:08.679770+0000","last_fullsized":"2024-09-12T22:48:08.679770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:45.140060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680214+0000","last_change":"2024-09-12T22:48:04.173355+0000","last_active":"2024-09-12T22:48:08.680214+0000","last_peered":"2024-09-12T22:48:08.680214+0000","last_clean":"2024-09-12T22:48:08.680214+0000","last_became_active":"2024-09-12T22:48:04.173031+0000","last_became_peered":"2024-09-12T22:48:04.173031+0000","last_unstale":"2024-09-12T22:48:08.680214+0000","last_undegraded":"2024-09-12T22:48:08.680214+0000","last_fullsized":"2024-09-12T22:48:08.680214+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:02.879935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673651+0000","last_change":"2024-09-12T22:48:05.176779+0000","last_active":"2024-09-12T22:48:08.673651+0000","last_peered":"2024-09-12T22:48:08.673651+0000","last_clean":"2024-09-12T22:48:08.673651+0000","last_became_active":"2024-09-12T22:48:05.176344+0000","last_became_peered":"2024-09-12T22:48:05.176344+0000","last_unstale":"2024-09-12T22:48:08.673651+0000","last_undegraded":"2024-09-12T22:48:08.673651+0000","last_fullsized":"2024-09-12T22:48:08.673651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:35.645286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677280+0000","last_change":"2024-09-12T22:48:04.171169+0000","last_active":"2024-09-12T22:48:08.677280+0000","last_peered":"2024-09-12T22:48:08.677280+0000","last_clean":"2024-09-12T22:48:08.677280+0000","last_became_active":"2024-09-12T22:48:04.170812+0000","last_became_peered":"2024-09-12T22:48:04.170812+0000","last_unstale":"2024-09-12T22:48:08.677280+0000","last_undegraded":"2024-09-12T22:48:08.677280+0000","last_fullsized":"2024-09-12T22:48:08.677280+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:05:58.510137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680378+0000","last_change":"2024-09-12T22:48:04.172325+0000","last_active":"2024-09-12T22:48:08.680378+0000","last_peered":"2024-09-12T22:48:08.680378+0000","last_clean":"2024-09-12T22:48:08.680378+0000","last_became_active":"2024-09-12T22:48:04.171855+0000","last_became_peered":"2024-09-12T22:48:04.171855+0000","last_unstale":"2024-09-12T22:48:08.680378+0000","last_undegraded":"2024-09-12T22:48:08.680378+0000","last_fullsized":"2024-09-12T22:48:08.680378+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:43.709660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673612+0000","last_change":"2024-09-12T22:48:05.177309+0000","last_active":"2024-09-12T22:48:08.673612+0000","last_peered":"2024-09-12T22:48:08.673612+0000","last_clean":"2024-09-12T22:48:08.673612+0000","last_became_active":"2024-09-12T22:48:05.176412+0000","last_became_peered":"2024-09-12T22:48:05.176412+0000","last_unstale":"2024-09-12T22:48:08.673612+0000","last_undegraded":"2024-09-12T22:48:08.673612+0000","last_fullsized":"2024-09-12T22:48:08.673612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:27:07.558853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674712+0000","last_change":"2024-09-12T22:48:04.166500+0000","last_active":"2024-09-12T22:48:08.674712+0000","last_peered":"2024-09-12T22:48:08.674712+0000","last_clean":"2024-09-12T22:48:08.674712+0000","last_became_active":"2024-09-12T22:48:04.165926+0000","last_became_peered":"2024-09-12T22:48:04.165926+0000","last_unstale":"2024-09-12T22:48:08.674712+0000","last_undegraded":"2024-09-12T22:48:08.674712+0000","last_fullsized":"2024-09-12T22:48:08.674712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:42:33.314407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673624+0000","last_change":"2024-09-12T22:48:05.169648+0000","last_active":"2024-09-12T22:48:08.673624+0000","last_peered":"2024-09-12T22:48:08.673624+0000","last_clean":"2024-09-12T22:48:08.673624+0000","last_became_active":"2024-09-12T22:48:05.168356+0000","last_became_peered":"2024-09-12T22:48:05.168356+0000","last_unstale":"2024-09-12T22:48:08.673624+0000","last_undegraded":"2024-09-12T22:48:08.673624+0000","last_fullsized":"2024-09-12T22:48:08.673624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:52.341512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677376+0000","last_change":"2024-09-12T22:48:05.173822+0000","last_active":"2024-09-12T22:48:08.677376+0000","last_peered":"2024-09-12T22:48:08.677376+0000","last_clean":"2024-09-12T22:48:08.677376+0000","last_became_active":"2024-09-12T22:48:05.172473+0000","last_became_peered":"2024-09-12T22:48:05.172473+0000","last_unstale":"2024-09-12T22:48:08.677376+0000","last_undegraded":"2024-09-12T22:48:08.677376+0000","last_fullsized":"2024-09-12T22:48:08.677376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:32.288419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673686+0000","last_change":"2024-09-12T22:48:04.169111+0000","last_active":"2024-09-12T22:48:08.673686+0000","last_peered":"2024-09-12T22:48:08.673686+0000","last_clean":"2024-09-12T22:48:08.673686+0000","last_became_active":"2024-09-12T22:48:04.168743+0000","last_became_peered":"2024-09-12T22:48:04.168743+0000","last_unstale":"2024-09-12T22:48:08.673686+0000","last_undegraded":"2024-09-12T22:48:08.673686+0000","last_fullsized":"2024-09-12T22:48:08.673686+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:43.709660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674438+0000","last_change":"2024-09-12T22:48:05.175474+0000","last_active":"2024-09-12T22:48:08.674438+0000","last_peered":"2024-09-12T22:48:08.674438+0000","last_clean":"2024-09-12T22:48:08.674438+0000","last_became_active":"2024-09-12T22:48:05.175220+0000","last_became_peered":"2024-09-12T22:48:05.175220+0000","last_unstale":"2024-09-12T22:48:08.674438+0000","last_undegraded":"2024-09-12T22:48:08.674438+0000","last_fullsized":"2024-09-12T22:48:08.674438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:56.158813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673708+0000","last_change":"2024-09-12T22:48:04.165725+0000","last_active":"2024-09-12T22:48:08.673708+0000","last_peered":"2024-09-12T22:48:08.673708+0000","last_clean":"2024-09-12T22:48:08.673708+0000","last_became_active":"2024-09-12T22:48:04.165419+0000","last_became_peered":"2024-09-12T22:48:04.165419+0000","last_unstale":"2024-09-12T22:48:08.673708+0000","last_undegraded":"2024-09-12T22:48:08.673708+0000","last_fullsized":"2024-09-12T22:48:08.673708+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:35:01.771536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677045+0000","last_change":"2024-09-12T22:48:05.174920+0000","last_active":"2024-09-12T22:48:08.677045+0000","last_peered":"2024-09-12T22:48:08.677045+0000","last_clean":"2024-09-12T22:48:08.677045+0000","last_became_active":"2024-09-12T22:48:05.173785+0000","last_became_peered":"2024-09-12T22:48:05.173785+0000","last_unstale":"2024-09-12T22:48:08.677045+0000","last_undegraded":"2024-09-12T22:48:08.677045+0000","last_fullsized":"2024-09-12T22:48:08.677045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:24.124647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676684+0000","last_change":"2024-09-12T22:48:04.174205+0000","last_active":"2024-09-12T22:48:08.676684+0000","last_peered":"2024-09-12T22:48:08.676684+0000","last_clean":"2024-09-12T22:48:08.676684+0000","last_became_active":"2024-09-12T22:48:04.173902+0000","last_became_peered":"2024-09-12T22:48:04.173902+0000","last_unstale":"2024-09-12T22:48:08.676684+0000","last_undegraded":"2024-09-12T22:48:08.676684+0000","last_fullsized":"2024-09-12T22:48:08.676684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:43:39.709214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676806+0000","last_change":"2024-09-12T22:48:05.172917+0000","last_active":"2024-09-12T22:48:08.676806+0000","last_peered":"2024-09-12T22:48:08.676806+0000","last_clean":"2024-09-12T22:48:08.676806+0000","last_became_active":"2024-09-12T22:48:05.172493+0000","last_became_peered":"2024-09-12T22:48:05.172493+0000","last_unstale":"2024-09-12T22:48:08.676806+0000","last_undegraded":"2024-09-12T22:48:08.676806+0000","last_fullsized":"2024-09-12T22:48:08.676806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:35.645286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676666+0000","last_change":"2024-09-12T22:48:04.175808+0000","last_active":"2024-09-12T22:48:08.676666+0000","last_peered":"2024-09-12T22:48:08.676666+0000","last_clean":"2024-09-12T22:48:08.676666+0000","last_became_active":"2024-09-12T22:48:04.175601+0000","last_became_peered":"2024-09-12T22:48:04.175601+0000","last_unstale":"2024-09-12T22:48:08.676666+0000","last_undegraded":"2024-09-12T22:48:08.676666+0000","last_fullsized":"2024-09-12T22:48:08.676666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:19.369251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679733+0000","last_change":"2024-09-12T22:48:05.173989+0000","last_active":"2024-09-12T22:48:08.679733+0000","last_peered":"2024-09-12T22:48:08.679733+0000","last_clean":"2024-09-12T22:48:08.679733+0000","last_became_active":"2024-09-12T22:48:05.172076+0000","last_became_peered":"2024-09-12T22:48:05.172076+0000","last_unstale":"2024-09-12T22:48:08.679733+0000","last_undegraded":"2024-09-12T22:48:08.679733+0000","last_fullsized":"2024-09-12T22:48:08.679733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:51.360504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680072+0000","last_change":"2024-09-12T22:48:04.171884+0000","last_active":"2024-09-12T22:48:08.680072+0000","last_peered":"2024-09-12T22:48:08.680072+0000","last_clean":"2024-09-12T22:48:08.680072+0000","last_became_active":"2024-09-12T22:48:04.171480+0000","last_became_peered":"2024-09-12T22:48:04.171480+0000","last_unstale":"2024-09-12T22:48:08.680072+0000","last_undegraded":"2024-09-12T22:48:08.680072+0000","last_fullsized":"2024-09-12T22:48:08.680072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:56.377664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679739+0000","last_change":"2024-09-12T22:48:05.173551+0000","last_active":"2024-09-12T22:48:08.679739+0000","last_peered":"2024-09-12T22:48:08.679739+0000","last_clean":"2024-09-12T22:48:08.679739+0000","last_became_active":"2024-09-12T22:48:05.172983+0000","last_became_peered":"2024-09-12T22:48:05.172983+0000","last_unstale":"2024-09-12T22:48:08.679739+0000","last_undegraded":"2024-09-12T22:48:08.679739+0000","last_fullsized":"2024-09-12T22:48:08.679739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:22.753741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677213+0000","last_change":"2024-09-12T22:48:04.167853+0000","last_active":"2024-09-12T22:48:08.677213+0000","last_peered":"2024-09-12T22:48:08.677213+0000","last_clean":"2024-09-12T22:48:08.677213+0000","last_became_active":"2024-09-12T22:48:04.167408+0000","last_became_peered":"2024-09-12T22:48:04.167408+0000","last_unstale":"2024-09-12T22:48:08.677213+0000","last_undegraded":"2024-09-12T22:48:08.677213+0000","last_fullsized":"2024-09-12T22:48:08.677213+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:32.031432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676789+0000","last_change":"2024-09-12T22:48:05.171815+0000","last_active":"2024-09-12T22:48:08.676789+0000","last_peered":"2024-09-12T22:48:08.676789+0000","last_clean":"2024-09-12T22:48:08.676789+0000","last_became_active":"2024-09-12T22:48:05.171361+0000","last_became_peered":"2024-09-12T22:48:05.171361+0000","last_unstale":"2024-09-12T22:48:08.676789+0000","last_undegraded":"2024-09-12T22:48:08.676789+0000","last_fullsized":"2024-09-12T22:48:08.676789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:28.873036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674540+0000","last_change":"2024-09-12T22:48:04.169500+0000","last_active":"2024-09-12T22:48:08.674540+0000","last_peered":"2024-09-12T22:48:08.674540+0000","last_clean":"2024-09-12T22:48:08.674540+0000","last_became_active":"2024-09-12T22:48:04.169087+0000","last_became_peered":"2024-09-12T22:48:04.169087+0000","last_unstale":"2024-09-12T22:48:08.674540+0000","last_undegraded":"2024-09-12T22:48:08.674540+0000","last_fullsized":"2024-09-12T22:48:08.674540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:56.377664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679335+0000","last_change":"2024-09-12T22:48:05.174947+0000","last_active":"2024-09-12T22:48:08.679335+0000","last_peered":"2024-09-12T22:48:08.679335+0000","last_clean":"2024-09-12T22:48:08.679335+0000","last_became_active":"2024-09-12T22:48:05.174503+0000","last_became_peered":"2024-09-12T22:48:05.174503+0000","last_unstale":"2024-09-12T22:48:08.679335+0000","last_undegraded":"2024-09-12T22:48:08.679335+0000","last_fullsized":"2024-09-12T22:48:08.679335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:01.401542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674557+0000","last_change":"2024-09-12T22:48:04.166198+0000","last_active":"2024-09-12T22:48:08.674557+0000","last_peered":"2024-09-12T22:48:08.674557+0000","last_clean":"2024-09-12T22:48:08.674557+0000","last_became_active":"2024-09-12T22:48:04.165795+0000","last_became_peered":"2024-09-12T22:48:04.165795+0000","last_unstale":"2024-09-12T22:48:08.674557+0000","last_undegraded":"2024-09-12T22:48:08.674557+0000","last_fullsized":"2024-09-12T22:48:08.674557+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:35.203049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":802816,"data_stored":656071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":63909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":655436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:48:16.111 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:48:16.442 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:48:16.444 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-09-12T22:48:16.454 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-09-12T22:48:16.129643+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86984,"kb_used_data":1736,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283028536,"statfs":{"total":289910292480,"available":289821220864,"internally_reserved":0,"allocated":1777664,"data_stored":1375416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.955478"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677255+0000","last_change":"2024-09-12T22:48:05.174190+0000","last_active":"2024-09-12T22:48:08.677255+0000","last_peered":"2024-09-12T22:48:08.677255+0000","last_clean":"2024-09-12T22:48:08.677255+0000","last_became_active":"2024-09-12T22:48:05.172964+0000","last_became_peered":"2024-09-12T22:48:05.172964+0000","last_unstale":"2024-09-12T22:48:08.677255+0000","last_undegraded":"2024-09-12T22:48:08.677255+0000","last_fullsized":"2024-09-12T22:48:08.677255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:49.868891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676980+0000","last_change":"2024-09-12T22:48:05.173045+0000","last_active":"2024-09-12T22:48:08.676980+0000","last_peered":"2024-09-12T22:48:08.676980+0000","last_clean":"2024-09-12T22:48:08.676980+0000","last_became_active":"2024-09-12T22:48:05.172684+0000","last_became_peered":"2024-09-12T22:48:05.172684+0000","last_unstale":"2024-09-12T22:48:08.676980+0000","last_undegraded":"2024-09-12T22:48:08.676980+0000","last_fullsized":"2024-09-12T22:48:08.676980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:51.360504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679907+0000","last_change":"2024-09-12T22:48:05.178267+0000","last_active":"2024-09-12T22:48:08.679907+0000","last_peered":"2024-09-12T22:48:08.679907+0000","last_clean":"2024-09-12T22:48:08.679907+0000","last_became_active":"2024-09-12T22:48:05.177555+0000","last_became_peered":"2024-09-12T22:48:05.177555+0000","last_unstale":"2024-09-12T22:48:08.679907+0000","last_undegraded":"2024-09-12T22:48:08.679907+0000","last_fullsized":"2024-09-12T22:48:08.679907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:58.991752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679782+0000","last_change":"2024-09-12T22:48:05.173539+0000","last_active":"2024-09-12T22:48:08.679782+0000","last_peered":"2024-09-12T22:48:08.679782+0000","last_clean":"2024-09-12T22:48:08.679782+0000","last_became_active":"2024-09-12T22:48:05.172647+0000","last_became_peered":"2024-09-12T22:48:05.172647+0000","last_unstale":"2024-09-12T22:48:08.679782+0000","last_undegraded":"2024-09-12T22:48:08.679782+0000","last_fullsized":"2024-09-12T22:48:08.679782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:56:34.490182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676660+0000","last_change":"2024-09-12T22:48:05.170306+0000","last_active":"2024-09-12T22:48:08.676660+0000","last_peered":"2024-09-12T22:48:08.676660+0000","last_clean":"2024-09-12T22:48:08.676660+0000","last_became_active":"2024-09-12T22:48:05.169940+0000","last_became_peered":"2024-09-12T22:48:05.169940+0000","last_unstale":"2024-09-12T22:48:08.676660+0000","last_undegraded":"2024-09-12T22:48:08.676660+0000","last_fullsized":"2024-09-12T22:48:08.676660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:52.341512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679410+0000","last_change":"2024-09-12T22:48:05.173232+0000","last_active":"2024-09-12T22:48:08.679410+0000","last_peered":"2024-09-12T22:48:08.679410+0000","last_clean":"2024-09-12T22:48:08.679410+0000","last_became_active":"2024-09-12T22:48:05.172213+0000","last_became_peered":"2024-09-12T22:48:05.172213+0000","last_unstale":"2024-09-12T22:48:08.679410+0000","last_undegraded":"2024-09-12T22:48:08.679410+0000","last_fullsized":"2024-09-12T22:48:08.679410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:25.994320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679563+0000","last_change":"2024-09-12T22:48:05.172187+0000","last_active":"2024-09-12T22:48:08.679563+0000","last_peered":"2024-09-12T22:48:08.679563+0000","last_clean":"2024-09-12T22:48:08.679563+0000","last_became_active":"2024-09-12T22:48:05.171766+0000","last_became_peered":"2024-09-12T22:48:05.171766+0000","last_unstale":"2024-09-12T22:48:08.679563+0000","last_undegraded":"2024-09-12T22:48:08.679563+0000","last_fullsized":"2024-09-12T22:48:08.679563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:49.868891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679126+0000","last_change":"2024-09-12T22:48:05.174326+0000","last_active":"2024-09-12T22:48:08.679126+0000","last_peered":"2024-09-12T22:48:08.679126+0000","last_clean":"2024-09-12T22:48:08.679126+0000","last_became_active":"2024-09-12T22:48:05.172312+0000","last_became_peered":"2024-09-12T22:48:05.172312+0000","last_unstale":"2024-09-12T22:48:08.679126+0000","last_undegraded":"2024-09-12T22:48:08.679126+0000","last_fullsized":"2024-09-12T22:48:08.679126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:52.071513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674344+0000","last_change":"2024-09-12T22:48:05.178445+0000","last_active":"2024-09-12T22:48:08.674344+0000","last_peered":"2024-09-12T22:48:08.674344+0000","last_clean":"2024-09-12T22:48:08.674344+0000","last_became_active":"2024-09-12T22:48:05.177284+0000","last_became_peered":"2024-09-12T22:48:05.177284+0000","last_unstale":"2024-09-12T22:48:08.674344+0000","last_undegraded":"2024-09-12T22:48:08.674344+0000","last_fullsized":"2024-09-12T22:48:08.674344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:45.140060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677090+0000","last_change":"2024-09-12T22:48:05.172480+0000","last_active":"2024-09-12T22:48:08.677090+0000","last_peered":"2024-09-12T22:48:08.677090+0000","last_clean":"2024-09-12T22:48:08.677090+0000","last_became_active":"2024-09-12T22:48:05.171686+0000","last_became_peered":"2024-09-12T22:48:05.171686+0000","last_unstale":"2024-09-12T22:48:08.677090+0000","last_undegraded":"2024-09-12T22:48:08.677090+0000","last_fullsized":"2024-09-12T22:48:08.677090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:56.158813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680327+0000","last_change":"2024-09-12T22:48:05.172837+0000","last_active":"2024-09-12T22:48:08.680327+0000","last_peered":"2024-09-12T22:48:08.680327+0000","last_clean":"2024-09-12T22:48:08.680327+0000","last_became_active":"2024-09-12T22:48:05.171890+0000","last_became_peered":"2024-09-12T22:48:05.171890+0000","last_unstale":"2024-09-12T22:48:08.680327+0000","last_undegraded":"2024-09-12T22:48:08.680327+0000","last_fullsized":"2024-09-12T22:48:08.680327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:46.965030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676812+0000","last_change":"2024-09-12T22:48:05.175666+0000","last_active":"2024-09-12T22:48:08.676812+0000","last_peered":"2024-09-12T22:48:08.676812+0000","last_clean":"2024-09-12T22:48:08.676812+0000","last_became_active":"2024-09-12T22:48:05.175390+0000","last_became_peered":"2024-09-12T22:48:05.175390+0000","last_unstale":"2024-09-12T22:48:08.676812+0000","last_undegraded":"2024-09-12T22:48:08.676812+0000","last_fullsized":"2024-09-12T22:48:08.676812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:13.160164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676555+0000","last_change":"2024-09-12T22:48:05.171356+0000","last_active":"2024-09-12T22:48:08.676555+0000","last_peered":"2024-09-12T22:48:08.676555+0000","last_clean":"2024-09-12T22:48:08.676555+0000","last_became_active":"2024-09-12T22:48:05.170794+0000","last_became_peered":"2024-09-12T22:48:05.170794+0000","last_unstale":"2024-09-12T22:48:08.676555+0000","last_undegraded":"2024-09-12T22:48:08.676555+0000","last_fullsized":"2024-09-12T22:48:08.676555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:42:56.969660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679530+0000","last_change":"2024-09-12T22:48:05.168780+0000","last_active":"2024-09-12T22:48:08.679530+0000","last_peered":"2024-09-12T22:48:08.679530+0000","last_clean":"2024-09-12T22:48:08.679530+0000","last_became_active":"2024-09-12T22:48:05.168294+0000","last_became_peered":"2024-09-12T22:48:05.168294+0000","last_unstale":"2024-09-12T22:48:08.679530+0000","last_undegraded":"2024-09-12T22:48:08.679530+0000","last_fullsized":"2024-09-12T22:48:08.679530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:30.120804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679600+0000","last_change":"2024-09-12T22:48:05.168344+0000","last_active":"2024-09-12T22:48:08.679600+0000","last_peered":"2024-09-12T22:48:08.679600+0000","last_clean":"2024-09-12T22:48:08.679600+0000","last_became_active":"2024-09-12T22:48:05.167805+0000","last_became_peered":"2024-09-12T22:48:05.167805+0000","last_unstale":"2024-09-12T22:48:08.679600+0000","last_undegraded":"2024-09-12T22:48:08.679600+0000","last_fullsized":"2024-09-12T22:48:08.679600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:32.288419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679162+0000","last_change":"2024-09-12T22:48:05.174663+0000","last_active":"2024-09-12T22:48:08.679162+0000","last_peered":"2024-09-12T22:48:08.679162+0000","last_clean":"2024-09-12T22:48:08.679162+0000","last_became_active":"2024-09-12T22:48:05.173101+0000","last_became_peered":"2024-09-12T22:48:05.173101+0000","last_unstale":"2024-09-12T22:48:08.679162+0000","last_undegraded":"2024-09-12T22:48:08.679162+0000","last_fullsized":"2024-09-12T22:48:08.679162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:25.143572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674747+0000","last_change":"2024-09-12T22:48:05.178721+0000","last_active":"2024-09-12T22:48:08.674747+0000","last_peered":"2024-09-12T22:48:08.674747+0000","last_clean":"2024-09-12T22:48:08.674747+0000","last_became_active":"2024-09-12T22:48:05.177965+0000","last_became_peered":"2024-09-12T22:48:05.177965+0000","last_unstale":"2024-09-12T22:48:08.674747+0000","last_undegraded":"2024-09-12T22:48:08.674747+0000","last_fullsized":"2024-09-12T22:48:08.674747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:32.288419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677222+0000","last_change":"2024-09-12T22:48:05.171053+0000","last_active":"2024-09-12T22:48:08.677222+0000","last_peered":"2024-09-12T22:48:08.677222+0000","last_clean":"2024-09-12T22:48:08.677222+0000","last_became_active":"2024-09-12T22:48:05.170578+0000","last_became_peered":"2024-09-12T22:48:05.170578+0000","last_unstale":"2024-09-12T22:48:08.677222+0000","last_undegraded":"2024-09-12T22:48:08.677222+0000","last_fullsized":"2024-09-12T22:48:08.677222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:58.991752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674239+0000","last_change":"2024-09-12T22:48:05.177369+0000","last_active":"2024-09-12T22:48:08.674239+0000","last_peered":"2024-09-12T22:48:08.674239+0000","last_clean":"2024-09-12T22:48:08.674239+0000","last_became_active":"2024-09-12T22:48:05.176680+0000","last_became_peered":"2024-09-12T22:48:05.176680+0000","last_unstale":"2024-09-12T22:48:08.674239+0000","last_undegraded":"2024-09-12T22:48:08.674239+0000","last_fullsized":"2024-09-12T22:48:08.674239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:25.143572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680241+0000","last_change":"2024-09-12T22:48:05.173232+0000","last_active":"2024-09-12T22:48:08.680241+0000","last_peered":"2024-09-12T22:48:08.680241+0000","last_clean":"2024-09-12T22:48:08.680241+0000","last_became_active":"2024-09-12T22:48:05.172382+0000","last_became_peered":"2024-09-12T22:48:05.172382+0000","last_unstale":"2024-09-12T22:48:08.680241+0000","last_undegraded":"2024-09-12T22:48:08.680241+0000","last_fullsized":"2024-09-12T22:48:08.680241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:28.083344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679924+0000","last_change":"2024-09-12T22:48:05.174799+0000","last_active":"2024-09-12T22:48:08.679924+0000","last_peered":"2024-09-12T22:48:08.679924+0000","last_clean":"2024-09-12T22:48:08.679924+0000","last_became_active":"2024-09-12T22:48:05.174423+0000","last_became_peered":"2024-09-12T22:48:05.174423+0000","last_unstale":"2024-09-12T22:48:08.679924+0000","last_undegraded":"2024-09-12T22:48:08.679924+0000","last_fullsized":"2024-09-12T22:48:08.679924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:56.158813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676495+0000","last_change":"2024-09-12T22:48:05.175363+0000","last_active":"2024-09-12T22:48:08.676495+0000","last_peered":"2024-09-12T22:48:08.676495+0000","last_clean":"2024-09-12T22:48:08.676495+0000","last_became_active":"2024-09-12T22:48:05.174832+0000","last_became_peered":"2024-09-12T22:48:05.174832+0000","last_unstale":"2024-09-12T22:48:08.676495+0000","last_undegraded":"2024-09-12T22:48:08.676495+0000","last_fullsized":"2024-09-12T22:48:08.676495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:25.994320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673471+0000","last_change":"2024-09-12T22:48:05.169838+0000","last_active":"2024-09-12T22:48:08.673471+0000","last_peered":"2024-09-12T22:48:08.673471+0000","last_clean":"2024-09-12T22:48:08.673471+0000","last_became_active":"2024-09-12T22:48:05.169462+0000","last_became_peered":"2024-09-12T22:48:05.169462+0000","last_unstale":"2024-09-12T22:48:08.673471+0000","last_undegraded":"2024-09-12T22:48:08.673471+0000","last_fullsized":"2024-09-12T22:48:08.673471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:42:56.969660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676149+0000","last_change":"2024-09-12T22:48:05.172794+0000","last_active":"2024-09-12T22:48:08.676149+0000","last_peered":"2024-09-12T22:48:08.676149+0000","last_clean":"2024-09-12T22:48:08.676149+0000","last_became_active":"2024-09-12T22:48:05.172437+0000","last_became_peered":"2024-09-12T22:48:05.172437+0000","last_unstale":"2024-09-12T22:48:08.676149+0000","last_undegraded":"2024-09-12T22:48:08.676149+0000","last_fullsized":"2024-09-12T22:48:08.676149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:54:44.278646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677275+0000","last_change":"2024-09-12T22:48:05.173714+0000","last_active":"2024-09-12T22:48:08.677275+0000","last_peered":"2024-09-12T22:48:08.677275+0000","last_clean":"2024-09-12T22:48:08.677275+0000","last_became_active":"2024-09-12T22:48:05.172938+0000","last_became_peered":"2024-09-12T22:48:05.172938+0000","last_unstale":"2024-09-12T22:48:08.677275+0000","last_undegraded":"2024-09-12T22:48:08.677275+0000","last_fullsized":"2024-09-12T22:48:08.677275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:30.120804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674352+0000","last_change":"2024-09-12T22:48:05.177862+0000","last_active":"2024-09-12T22:48:08.674352+0000","last_peered":"2024-09-12T22:48:08.674352+0000","last_clean":"2024-09-12T22:48:08.674352+0000","last_became_active":"2024-09-12T22:48:05.177545+0000","last_became_peered":"2024-09-12T22:48:05.177545+0000","last_unstale":"2024-09-12T22:48:08.674352+0000","last_undegraded":"2024-09-12T22:48:08.674352+0000","last_fullsized":"2024-09-12T22:48:08.674352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:25.994320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680458+0000","last_change":"2024-09-12T22:48:05.178249+0000","last_active":"2024-09-12T22:48:08.680458+0000","last_peered":"2024-09-12T22:48:08.680458+0000","last_clean":"2024-09-12T22:48:08.680458+0000","last_became_active":"2024-09-12T22:48:05.177582+0000","last_became_peered":"2024-09-12T22:48:05.177582+0000","last_unstale":"2024-09-12T22:48:08.680458+0000","last_undegraded":"2024-09-12T22:48:08.680458+0000","last_fullsized":"2024-09-12T22:48:08.680458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:25.556218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677103+0000","last_change":"2024-09-12T22:48:05.171326+0000","last_active":"2024-09-12T22:48:08.677103+0000","last_peered":"2024-09-12T22:48:08.677103+0000","last_clean":"2024-09-12T22:48:08.677103+0000","last_became_active":"2024-09-12T22:48:05.170491+0000","last_became_peered":"2024-09-12T22:48:05.170491+0000","last_unstale":"2024-09-12T22:48:08.677103+0000","last_undegraded":"2024-09-12T22:48:08.677103+0000","last_fullsized":"2024-09-12T22:48:08.677103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:52.071513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674052+0000","last_change":"2024-09-12T22:48:05.177176+0000","last_active":"2024-09-12T22:48:08.674052+0000","last_peered":"2024-09-12T22:48:08.674052+0000","last_clean":"2024-09-12T22:48:08.674052+0000","last_became_active":"2024-09-12T22:48:05.176735+0000","last_became_peered":"2024-09-12T22:48:05.176735+0000","last_unstale":"2024-09-12T22:48:08.674052+0000","last_undegraded":"2024-09-12T22:48:08.674052+0000","last_fullsized":"2024-09-12T22:48:08.674052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:51.360504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676676+0000","last_change":"2024-09-12T22:48:05.171180+0000","last_active":"2024-09-12T22:48:08.676676+0000","last_peered":"2024-09-12T22:48:08.676676+0000","last_clean":"2024-09-12T22:48:08.676676+0000","last_became_active":"2024-09-12T22:48:05.170263+0000","last_became_peered":"2024-09-12T22:48:05.170263+0000","last_unstale":"2024-09-12T22:48:08.676676+0000","last_undegraded":"2024-09-12T22:48:08.676676+0000","last_fullsized":"2024-09-12T22:48:08.676676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:25.143572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673611+0000","last_change":"2024-09-12T22:48:05.176878+0000","last_active":"2024-09-12T22:48:08.673611+0000","last_peered":"2024-09-12T22:48:08.673611+0000","last_clean":"2024-09-12T22:48:08.673611+0000","last_became_active":"2024-09-12T22:48:05.176327+0000","last_became_peered":"2024-09-12T22:48:05.176327+0000","last_unstale":"2024-09-12T22:48:08.673611+0000","last_undegraded":"2024-09-12T22:48:08.673611+0000","last_fullsized":"2024-09-12T22:48:08.673611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:11.781766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679222+0000","last_change":"2024-09-12T22:48:05.174818+0000","last_active":"2024-09-12T22:48:08.679222+0000","last_peered":"2024-09-12T22:48:08.679222+0000","last_clean":"2024-09-12T22:48:08.679222+0000","last_became_active":"2024-09-12T22:48:05.173485+0000","last_became_peered":"2024-09-12T22:48:05.173485+0000","last_unstale":"2024-09-12T22:48:08.679222+0000","last_undegraded":"2024-09-12T22:48:08.679222+0000","last_fullsized":"2024-09-12T22:48:08.679222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:24.124647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676980+0000","last_change":"2024-09-12T22:48:05.171573+0000","last_active":"2024-09-12T22:48:08.676980+0000","last_peered":"2024-09-12T22:48:08.676980+0000","last_clean":"2024-09-12T22:48:08.676980+0000","last_became_active":"2024-09-12T22:48:05.171036+0000","last_became_peered":"2024-09-12T22:48:05.171036+0000","last_unstale":"2024-09-12T22:48:08.676980+0000","last_undegraded":"2024-09-12T22:48:08.676980+0000","last_fullsized":"2024-09-12T22:48:08.676980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:27:07.558853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679924+0000","last_change":"2024-09-12T22:48:04.171960+0000","last_active":"2024-09-12T22:48:08.679924+0000","last_peered":"2024-09-12T22:48:08.679924+0000","last_clean":"2024-09-12T22:48:08.679924+0000","last_became_active":"2024-09-12T22:48:04.171562+0000","last_became_peered":"2024-09-12T22:48:04.171562+0000","last_unstale":"2024-09-12T22:48:08.679924+0000","last_undegraded":"2024-09-12T22:48:08.679924+0000","last_fullsized":"2024-09-12T22:48:08.679924+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:00.271198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677053+0000","last_change":"2024-09-12T22:48:05.173585+0000","last_active":"2024-09-12T22:48:08.677053+0000","last_peered":"2024-09-12T22:48:08.677053+0000","last_clean":"2024-09-12T22:48:08.677053+0000","last_became_active":"2024-09-12T22:48:05.172801+0000","last_became_peered":"2024-09-12T22:48:05.172801+0000","last_unstale":"2024-09-12T22:48:08.677053+0000","last_undegraded":"2024-09-12T22:48:08.677053+0000","last_fullsized":"2024-09-12T22:48:08.677053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:45.140060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674214+0000","last_change":"2024-09-12T22:48:04.167352+0000","last_active":"2024-09-12T22:48:08.674214+0000","last_peered":"2024-09-12T22:48:08.674214+0000","last_clean":"2024-09-12T22:48:08.674214+0000","last_became_active":"2024-09-12T22:48:04.166743+0000","last_became_peered":"2024-09-12T22:48:04.166743+0000","last_unstale":"2024-09-12T22:48:08.674214+0000","last_undegraded":"2024-09-12T22:48:08.674214+0000","last_fullsized":"2024-09-12T22:48:08.674214+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:30:27.547041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674597+0000","last_change":"2024-09-12T22:48:05.178409+0000","last_active":"2024-09-12T22:48:08.674597+0000","last_peered":"2024-09-12T22:48:08.674597+0000","last_clean":"2024-09-12T22:48:08.674597+0000","last_became_active":"2024-09-12T22:48:05.178076+0000","last_became_peered":"2024-09-12T22:48:05.178076+0000","last_unstale":"2024-09-12T22:48:08.674597+0000","last_undegraded":"2024-09-12T22:48:08.674597+0000","last_fullsized":"2024-09-12T22:48:08.674597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:01.401542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676355+0000","last_change":"2024-09-12T22:48:04.171173+0000","last_active":"2024-09-12T22:48:08.676355+0000","last_peered":"2024-09-12T22:48:08.676355+0000","last_clean":"2024-09-12T22:48:08.676355+0000","last_became_active":"2024-09-12T22:48:04.170891+0000","last_became_peered":"2024-09-12T22:48:04.170891+0000","last_unstale":"2024-09-12T22:48:08.676355+0000","last_undegraded":"2024-09-12T22:48:08.676355+0000","last_fullsized":"2024-09-12T22:48:08.676355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:02.023664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674470+0000","last_change":"2024-09-12T22:48:05.177510+0000","last_active":"2024-09-12T22:48:08.674470+0000","last_peered":"2024-09-12T22:48:08.674470+0000","last_clean":"2024-09-12T22:48:08.674470+0000","last_became_active":"2024-09-12T22:48:05.176568+0000","last_became_peered":"2024-09-12T22:48:05.176568+0000","last_unstale":"2024-09-12T22:48:08.674470+0000","last_undegraded":"2024-09-12T22:48:08.674470+0000","last_fullsized":"2024-09-12T22:48:08.674470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:49.868891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679221+0000","last_change":"2024-09-12T22:48:04.173161+0000","last_active":"2024-09-12T22:48:08.679221+0000","last_peered":"2024-09-12T22:48:08.679221+0000","last_clean":"2024-09-12T22:48:08.679221+0000","last_became_active":"2024-09-12T22:48:04.172623+0000","last_became_peered":"2024-09-12T22:48:04.172623+0000","last_unstale":"2024-09-12T22:48:08.679221+0000","last_undegraded":"2024-09-12T22:48:08.679221+0000","last_fullsized":"2024-09-12T22:48:08.679221+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:13.739087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680199+0000","last_change":"2024-09-12T22:48:04.173041+0000","last_active":"2024-09-12T22:48:08.680199+0000","last_peered":"2024-09-12T22:48:08.680199+0000","last_clean":"2024-09-12T22:48:08.680199+0000","last_became_active":"2024-09-12T22:48:04.172527+0000","last_became_peered":"2024-09-12T22:48:04.172527+0000","last_unstale":"2024-09-12T22:48:08.680199+0000","last_undegraded":"2024-09-12T22:48:08.680199+0000","last_fullsized":"2024-09-12T22:48:08.680199+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:20.734653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676178+0000","last_change":"2024-09-12T22:48:05.175921+0000","last_active":"2024-09-12T22:48:08.676178+0000","last_peered":"2024-09-12T22:48:08.676178+0000","last_clean":"2024-09-12T22:48:08.676178+0000","last_became_active":"2024-09-12T22:48:05.175226+0000","last_became_peered":"2024-09-12T22:48:05.175226+0000","last_unstale":"2024-09-12T22:48:08.676178+0000","last_undegraded":"2024-09-12T22:48:08.676178+0000","last_fullsized":"2024-09-12T22:48:08.676178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:08.021196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677320+0000","last_change":"2024-09-12T22:48:04.167564+0000","last_active":"2024-09-12T22:48:08.677320+0000","last_peered":"2024-09-12T22:48:08.677320+0000","last_clean":"2024-09-12T22:48:08.677320+0000","last_became_active":"2024-09-12T22:48:04.167254+0000","last_became_peered":"2024-09-12T22:48:04.167254+0000","last_unstale":"2024-09-12T22:48:08.677320+0000","last_undegraded":"2024-09-12T22:48:08.677320+0000","last_fullsized":"2024-09-12T22:48:08.677320+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:35.879041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676271+0000","last_change":"2024-09-12T22:48:05.171143+0000","last_active":"2024-09-12T22:48:08.676271+0000","last_peered":"2024-09-12T22:48:08.676271+0000","last_clean":"2024-09-12T22:48:08.676271+0000","last_became_active":"2024-09-12T22:48:05.170374+0000","last_became_peered":"2024-09-12T22:48:05.170374+0000","last_unstale":"2024-09-12T22:48:08.676271+0000","last_undegraded":"2024-09-12T22:48:08.676271+0000","last_fullsized":"2024-09-12T22:48:08.676271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:15.887977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680611+0000","last_change":"2024-09-12T22:48:04.173325+0000","last_active":"2024-09-12T22:48:08.680611+0000","last_peered":"2024-09-12T22:48:08.680611+0000","last_clean":"2024-09-12T22:48:08.680611+0000","last_became_active":"2024-09-12T22:48:04.172862+0000","last_became_peered":"2024-09-12T22:48:04.172862+0000","last_unstale":"2024-09-12T22:48:08.680611+0000","last_undegraded":"2024-09-12T22:48:08.680611+0000","last_fullsized":"2024-09-12T22:48:08.680611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:42:33.314407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679603+0000","last_change":"2024-09-12T22:48:05.173382+0000","last_active":"2024-09-12T22:48:08.679603+0000","last_peered":"2024-09-12T22:48:08.679603+0000","last_clean":"2024-09-12T22:48:08.679603+0000","last_became_active":"2024-09-12T22:48:05.172429+0000","last_became_peered":"2024-09-12T22:48:05.172429+0000","last_unstale":"2024-09-12T22:48:08.679603+0000","last_undegraded":"2024-09-12T22:48:08.679603+0000","last_fullsized":"2024-09-12T22:48:08.679603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:44:38.144948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680436+0000","last_change":"2024-09-12T22:48:04.172099+0000","last_active":"2024-09-12T22:48:08.680436+0000","last_peered":"2024-09-12T22:48:08.680436+0000","last_clean":"2024-09-12T22:48:08.680436+0000","last_became_active":"2024-09-12T22:48:04.171746+0000","last_became_peered":"2024-09-12T22:48:04.171746+0000","last_unstale":"2024-09-12T22:48:08.680436+0000","last_undegraded":"2024-09-12T22:48:08.680436+0000","last_fullsized":"2024-09-12T22:48:08.680436+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:35:28.894178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674110+0000","last_change":"2024-09-12T22:48:05.177824+0000","last_active":"2024-09-12T22:48:08.674110+0000","last_peered":"2024-09-12T22:48:08.674110+0000","last_clean":"2024-09-12T22:48:08.674110+0000","last_became_active":"2024-09-12T22:48:05.177344+0000","last_became_peered":"2024-09-12T22:48:05.177344+0000","last_unstale":"2024-09-12T22:48:08.674110+0000","last_undegraded":"2024-09-12T22:48:08.674110+0000","last_fullsized":"2024-09-12T22:48:08.674110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:52.071513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674213+0000","last_change":"2024-09-12T22:48:04.167459+0000","last_active":"2024-09-12T22:48:08.674213+0000","last_peered":"2024-09-12T22:48:08.674213+0000","last_clean":"2024-09-12T22:48:08.674213+0000","last_became_active":"2024-09-12T22:48:04.165825+0000","last_became_peered":"2024-09-12T22:48:04.165825+0000","last_unstale":"2024-09-12T22:48:08.674213+0000","last_undegraded":"2024-09-12T22:48:08.674213+0000","last_fullsized":"2024-09-12T22:48:08.674213+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:20.734653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679998+0000","last_change":"2024-09-12T22:48:05.173859+0000","last_active":"2024-09-12T22:48:08.679998+0000","last_peered":"2024-09-12T22:48:08.679998+0000","last_clean":"2024-09-12T22:48:08.679998+0000","last_became_active":"2024-09-12T22:48:05.173276+0000","last_became_peered":"2024-09-12T22:48:05.173276+0000","last_unstale":"2024-09-12T22:48:08.679998+0000","last_undegraded":"2024-09-12T22:48:08.679998+0000","last_fullsized":"2024-09-12T22:48:08.679998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:06:31.953025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679767+0000","last_change":"2024-09-12T22:48:04.172158+0000","last_active":"2024-09-12T22:48:08.679767+0000","last_peered":"2024-09-12T22:48:08.679767+0000","last_clean":"2024-09-12T22:48:08.679767+0000","last_became_active":"2024-09-12T22:48:04.171514+0000","last_became_peered":"2024-09-12T22:48:04.171514+0000","last_unstale":"2024-09-12T22:48:08.679767+0000","last_undegraded":"2024-09-12T22:48:08.679767+0000","last_fullsized":"2024-09-12T22:48:08.679767+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:40:29.366846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680561+0000","last_change":"2024-09-12T22:48:05.178528+0000","last_active":"2024-09-12T22:48:08.680561+0000","last_peered":"2024-09-12T22:48:08.680561+0000","last_clean":"2024-09-12T22:48:08.680561+0000","last_became_active":"2024-09-12T22:48:05.177904+0000","last_became_peered":"2024-09-12T22:48:05.177904+0000","last_unstale":"2024-09-12T22:48:08.680561+0000","last_undegraded":"2024-09-12T22:48:08.680561+0000","last_fullsized":"2024-09-12T22:48:08.680561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:59.525401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676548+0000","last_change":"2024-09-12T22:48:04.171001+0000","last_active":"2024-09-12T22:48:08.676548+0000","last_peered":"2024-09-12T22:48:08.676548+0000","last_clean":"2024-09-12T22:48:08.676548+0000","last_became_active":"2024-09-12T22:48:04.170667+0000","last_became_peered":"2024-09-12T22:48:04.170667+0000","last_unstale":"2024-09-12T22:48:08.676548+0000","last_undegraded":"2024-09-12T22:48:08.676548+0000","last_fullsized":"2024-09-12T22:48:08.676548+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:04.492449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680316+0000","last_change":"2024-09-12T22:48:05.177804+0000","last_active":"2024-09-12T22:48:08.680316+0000","last_peered":"2024-09-12T22:48:08.680316+0000","last_clean":"2024-09-12T22:48:08.680316+0000","last_became_active":"2024-09-12T22:48:05.177458+0000","last_became_peered":"2024-09-12T22:48:05.177458+0000","last_unstale":"2024-09-12T22:48:08.680316+0000","last_undegraded":"2024-09-12T22:48:08.680316+0000","last_fullsized":"2024-09-12T22:48:08.680316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:47.576598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676227+0000","last_change":"2024-09-12T22:48:04.174281+0000","last_active":"2024-09-12T22:48:08.676227+0000","last_peered":"2024-09-12T22:48:08.676227+0000","last_clean":"2024-09-12T22:48:08.676227+0000","last_became_active":"2024-09-12T22:48:04.173942+0000","last_became_peered":"2024-09-12T22:48:04.173942+0000","last_unstale":"2024-09-12T22:48:08.676227+0000","last_undegraded":"2024-09-12T22:48:08.676227+0000","last_fullsized":"2024-09-12T22:48:08.676227+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:19:38.546747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674466+0000","last_change":"2024-09-12T22:48:05.178246+0000","last_active":"2024-09-12T22:48:08.674466+0000","last_peered":"2024-09-12T22:48:08.674466+0000","last_clean":"2024-09-12T22:48:08.674466+0000","last_became_active":"2024-09-12T22:48:05.176813+0000","last_became_peered":"2024-09-12T22:48:05.176813+0000","last_unstale":"2024-09-12T22:48:08.674466+0000","last_undegraded":"2024-09-12T22:48:08.674466+0000","last_fullsized":"2024-09-12T22:48:08.674466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:58.991752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":226,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679433+0000","last_change":"2024-09-12T22:47:56.028830+0000","last_active":"2024-09-12T22:48:08.679433+0000","last_peered":"2024-09-12T22:48:08.679433+0000","last_clean":"2024-09-12T22:48:08.679433+0000","last_became_active":"2024-09-12T22:47:56.028017+0000","last_became_peered":"2024-09-12T22:47:56.028017+0000","last_unstale":"2024-09-12T22:48:08.679433+0000","last_undegraded":"2024-09-12T22:48:08.679433+0000","last_fullsized":"2024-09-12T22:48:08.679433+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:55.016634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:55.016634+0000","last_clean_scrub_stamp":"2024-09-12T22:47:55.016634+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:03.648827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680145+0000","last_change":"2024-09-12T22:48:02.045816+0000","last_active":"2024-09-12T22:48:08.680145+0000","last_peered":"2024-09-12T22:48:08.680145+0000","last_clean":"2024-09-12T22:48:08.680145+0000","last_became_active":"2024-09-12T22:48:00.045324+0000","last_became_peered":"2024-09-12T22:48:00.045324+0000","last_unstale":"2024-09-12T22:48:08.680145+0000","last_undegraded":"2024-09-12T22:48:08.680145+0000","last_fullsized":"2024-09-12T22:48:08.680145+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:41:33.998543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065526500000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673955+0000","last_change":"2024-09-12T22:48:04.169704+0000","last_active":"2024-09-12T22:48:08.673955+0000","last_peered":"2024-09-12T22:48:08.673955+0000","last_clean":"2024-09-12T22:48:08.673955+0000","last_became_active":"2024-09-12T22:48:04.169474+0000","last_became_peered":"2024-09-12T22:48:04.169474+0000","last_unstale":"2024-09-12T22:48:08.673955+0000","last_undegraded":"2024-09-12T22:48:08.673955+0000","last_fullsized":"2024-09-12T22:48:08.673955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:00.271198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680660+0000","last_change":"2024-09-12T22:48:05.178510+0000","last_active":"2024-09-12T22:48:08.680660+0000","last_peered":"2024-09-12T22:48:08.680660+0000","last_clean":"2024-09-12T22:48:08.680660+0000","last_became_active":"2024-09-12T22:48:05.177910+0000","last_became_peered":"2024-09-12T22:48:05.177910+0000","last_unstale":"2024-09-12T22:48:08.680660+0000","last_undegraded":"2024-09-12T22:48:08.680660+0000","last_fullsized":"2024-09-12T22:48:08.680660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:19.398289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679405+0000","last_change":"2024-09-12T22:48:02.045525+0000","last_active":"2024-09-12T22:48:08.679405+0000","last_peered":"2024-09-12T22:48:08.679405+0000","last_clean":"2024-09-12T22:48:08.679405+0000","last_became_active":"2024-09-12T22:48:00.042207+0000","last_became_peered":"2024-09-12T22:48:00.042207+0000","last_unstale":"2024-09-12T22:48:08.679405+0000","last_undegraded":"2024-09-12T22:48:08.679405+0000","last_fullsized":"2024-09-12T22:48:08.679405+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:33.150497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040973099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673788+0000","last_change":"2024-09-12T22:48:04.167456+0000","last_active":"2024-09-12T22:48:08.673788+0000","last_peered":"2024-09-12T22:48:08.673788+0000","last_clean":"2024-09-12T22:48:08.673788+0000","last_became_active":"2024-09-12T22:48:04.166966+0000","last_became_peered":"2024-09-12T22:48:04.166966+0000","last_unstale":"2024-09-12T22:48:08.673788+0000","last_undegraded":"2024-09-12T22:48:08.673788+0000","last_fullsized":"2024-09-12T22:48:08.673788+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:13.739087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677214+0000","last_change":"2024-09-12T22:48:05.171819+0000","last_active":"2024-09-12T22:48:08.677214+0000","last_peered":"2024-09-12T22:48:08.677214+0000","last_clean":"2024-09-12T22:48:08.677214+0000","last_became_active":"2024-09-12T22:48:05.171293+0000","last_became_peered":"2024-09-12T22:48:05.171293+0000","last_unstale":"2024-09-12T22:48:08.677214+0000","last_undegraded":"2024-09-12T22:48:08.677214+0000","last_fullsized":"2024-09-12T22:48:08.677214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:01.401542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673968+0000","last_change":"2024-09-12T22:48:02.045209+0000","last_active":"2024-09-12T22:48:08.673968+0000","last_peered":"2024-09-12T22:48:08.673968+0000","last_clean":"2024-09-12T22:48:08.673968+0000","last_became_active":"2024-09-12T22:48:00.042007+0000","last_became_peered":"2024-09-12T22:48:00.042007+0000","last_unstale":"2024-09-12T22:48:08.673968+0000","last_undegraded":"2024-09-12T22:48:08.673968+0000","last_fullsized":"2024-09-12T22:48:08.673968+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:13.536542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036893100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676251+0000","last_change":"2024-09-12T22:48:04.171168+0000","last_active":"2024-09-12T22:48:08.676251+0000","last_peered":"2024-09-12T22:48:08.676251+0000","last_clean":"2024-09-12T22:48:08.676251+0000","last_became_active":"2024-09-12T22:48:04.170853+0000","last_became_peered":"2024-09-12T22:48:04.170853+0000","last_unstale":"2024-09-12T22:48:08.676251+0000","last_undegraded":"2024-09-12T22:48:08.676251+0000","last_fullsized":"2024-09-12T22:48:08.676251+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:32:37.715508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674596+0000","last_change":"2024-09-12T22:48:05.178865+0000","last_active":"2024-09-12T22:48:08.674596+0000","last_peered":"2024-09-12T22:48:08.674596+0000","last_clean":"2024-09-12T22:48:08.674596+0000","last_became_active":"2024-09-12T22:48:05.178010+0000","last_became_peered":"2024-09-12T22:48:05.178010+0000","last_unstale":"2024-09-12T22:48:08.674596+0000","last_undegraded":"2024-09-12T22:48:08.674596+0000","last_fullsized":"2024-09-12T22:48:08.674596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:30.120804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679847+0000","last_change":"2024-09-12T22:48:02.045684+0000","last_active":"2024-09-12T22:48:08.679847+0000","last_peered":"2024-09-12T22:48:08.679847+0000","last_clean":"2024-09-12T22:48:08.679847+0000","last_became_active":"2024-09-12T22:48:00.045286+0000","last_became_peered":"2024-09-12T22:48:00.045286+0000","last_unstale":"2024-09-12T22:48:08.679847+0000","last_undegraded":"2024-09-12T22:48:08.679847+0000","last_fullsized":"2024-09-12T22:48:08.679847+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:18:11.667143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052714799999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679984+0000","last_change":"2024-09-12T22:48:04.172355+0000","last_active":"2024-09-12T22:48:08.679984+0000","last_peered":"2024-09-12T22:48:08.679984+0000","last_clean":"2024-09-12T22:48:08.679984+0000","last_became_active":"2024-09-12T22:48:04.171905+0000","last_became_peered":"2024-09-12T22:48:04.171905+0000","last_unstale":"2024-09-12T22:48:08.679984+0000","last_undegraded":"2024-09-12T22:48:08.679984+0000","last_fullsized":"2024-09-12T22:48:08.679984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:35.203049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674351+0000","last_change":"2024-09-12T22:48:05.177561+0000","last_active":"2024-09-12T22:48:08.674351+0000","last_peered":"2024-09-12T22:48:08.674351+0000","last_clean":"2024-09-12T22:48:08.674351+0000","last_became_active":"2024-09-12T22:48:05.177164+0000","last_became_peered":"2024-09-12T22:48:05.177164+0000","last_unstale":"2024-09-12T22:48:08.674351+0000","last_undegraded":"2024-09-12T22:48:08.674351+0000","last_fullsized":"2024-09-12T22:48:08.674351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:24.124647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680715+0000","last_change":"2024-09-12T22:48:04.172271+0000","last_active":"2024-09-12T22:48:08.680715+0000","last_peered":"2024-09-12T22:48:08.680715+0000","last_clean":"2024-09-12T22:48:08.680715+0000","last_became_active":"2024-09-12T22:48:04.171739+0000","last_became_peered":"2024-09-12T22:48:04.171739+0000","last_unstale":"2024-09-12T22:48:08.680715+0000","last_undegraded":"2024-09-12T22:48:08.680715+0000","last_fullsized":"2024-09-12T22:48:08.680715+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:56.929490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674540+0000","last_change":"2024-09-12T22:48:02.045324+0000","last_active":"2024-09-12T22:48:08.674540+0000","last_peered":"2024-09-12T22:48:08.674540+0000","last_clean":"2024-09-12T22:48:08.674540+0000","last_became_active":"2024-09-12T22:48:00.042132+0000","last_became_peered":"2024-09-12T22:48:00.042132+0000","last_unstale":"2024-09-12T22:48:08.674540+0000","last_undegraded":"2024-09-12T22:48:08.674540+0000","last_fullsized":"2024-09-12T22:48:08.674540+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:24.673019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047590600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676518+0000","last_change":"2024-09-12T22:48:05.175609+0000","last_active":"2024-09-12T22:48:08.676518+0000","last_peered":"2024-09-12T22:48:08.676518+0000","last_clean":"2024-09-12T22:48:08.676518+0000","last_became_active":"2024-09-12T22:48:05.175167+0000","last_became_peered":"2024-09-12T22:48:05.175167+0000","last_unstale":"2024-09-12T22:48:08.676518+0000","last_undegraded":"2024-09-12T22:48:08.676518+0000","last_fullsized":"2024-09-12T22:48:08.676518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:11.248179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674322+0000","last_change":"2024-09-12T22:48:04.169109+0000","last_active":"2024-09-12T22:48:08.674322+0000","last_peered":"2024-09-12T22:48:08.674322+0000","last_clean":"2024-09-12T22:48:08.674322+0000","last_became_active":"2024-09-12T22:48:04.168655+0000","last_became_peered":"2024-09-12T22:48:04.168655+0000","last_unstale":"2024-09-12T22:48:08.674322+0000","last_undegraded":"2024-09-12T22:48:08.674322+0000","last_fullsized":"2024-09-12T22:48:08.674322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:02.879935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677463+0000","last_change":"2024-09-12T22:48:02.045390+0000","last_active":"2024-09-12T22:48:08.677463+0000","last_peered":"2024-09-12T22:48:08.677463+0000","last_clean":"2024-09-12T22:48:08.677463+0000","last_became_active":"2024-09-12T22:48:00.045356+0000","last_became_peered":"2024-09-12T22:48:00.045356+0000","last_unstale":"2024-09-12T22:48:08.677463+0000","last_undegraded":"2024-09-12T22:48:08.677463+0000","last_fullsized":"2024-09-12T22:48:08.677463+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:32.072080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040621599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676614+0000","last_change":"2024-09-12T22:48:05.171131+0000","last_active":"2024-09-12T22:48:08.676614+0000","last_peered":"2024-09-12T22:48:08.676614+0000","last_clean":"2024-09-12T22:48:08.676614+0000","last_became_active":"2024-09-12T22:48:05.170591+0000","last_became_peered":"2024-09-12T22:48:05.170591+0000","last_unstale":"2024-09-12T22:48:08.676614+0000","last_undegraded":"2024-09-12T22:48:08.676614+0000","last_fullsized":"2024-09-12T22:48:08.676614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:11.781766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674783+0000","last_change":"2024-09-12T22:48:04.168635+0000","last_active":"2024-09-12T22:48:08.674783+0000","last_peered":"2024-09-12T22:48:08.674783+0000","last_clean":"2024-09-12T22:48:08.674783+0000","last_became_active":"2024-09-12T22:48:04.168244+0000","last_became_peered":"2024-09-12T22:48:04.168244+0000","last_unstale":"2024-09-12T22:48:08.674783+0000","last_undegraded":"2024-09-12T22:48:08.674783+0000","last_fullsized":"2024-09-12T22:48:08.674783+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:56.929490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674718+0000","last_change":"2024-09-12T22:48:02.045428+0000","last_active":"2024-09-12T22:48:08.674718+0000","last_peered":"2024-09-12T22:48:08.674718+0000","last_clean":"2024-09-12T22:48:08.674718+0000","last_became_active":"2024-09-12T22:48:00.040536+0000","last_became_peered":"2024-09-12T22:48:00.040536+0000","last_unstale":"2024-09-12T22:48:08.674718+0000","last_undegraded":"2024-09-12T22:48:08.674718+0000","last_fullsized":"2024-09-12T22:48:08.674718+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:33.150497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057699499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673721+0000","last_change":"2024-09-12T22:48:05.170571+0000","last_active":"2024-09-12T22:48:08.673721+0000","last_peered":"2024-09-12T22:48:08.673721+0000","last_clean":"2024-09-12T22:48:08.673721+0000","last_became_active":"2024-09-12T22:48:05.170087+0000","last_became_peered":"2024-09-12T22:48:05.170087+0000","last_unstale":"2024-09-12T22:48:08.673721+0000","last_undegraded":"2024-09-12T22:48:08.673721+0000","last_fullsized":"2024-09-12T22:48:08.673721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:28.873036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674650+0000","last_change":"2024-09-12T22:48:04.166369+0000","last_active":"2024-09-12T22:48:08.674650+0000","last_peered":"2024-09-12T22:48:08.674650+0000","last_clean":"2024-09-12T22:48:08.674650+0000","last_became_active":"2024-09-12T22:48:04.165966+0000","last_became_peered":"2024-09-12T22:48:04.165966+0000","last_unstale":"2024-09-12T22:48:08.674650+0000","last_undegraded":"2024-09-12T22:48:08.674650+0000","last_fullsized":"2024-09-12T22:48:08.674650+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:40:29.366846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680266+0000","last_change":"2024-09-12T22:48:02.045500+0000","last_active":"2024-09-12T22:48:08.680266+0000","last_peered":"2024-09-12T22:48:08.680266+0000","last_clean":"2024-09-12T22:48:08.680266+0000","last_became_active":"2024-09-12T22:48:00.042210+0000","last_became_peered":"2024-09-12T22:48:00.042210+0000","last_unstale":"2024-09-12T22:48:08.680266+0000","last_undegraded":"2024-09-12T22:48:08.680266+0000","last_fullsized":"2024-09-12T22:48:08.680266+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:35:14.212372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035339799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676300+0000","last_change":"2024-09-12T22:48:05.170712+0000","last_active":"2024-09-12T22:48:08.676300+0000","last_peered":"2024-09-12T22:48:08.676300+0000","last_clean":"2024-09-12T22:48:08.676300+0000","last_became_active":"2024-09-12T22:48:05.169840+0000","last_became_peered":"2024-09-12T22:48:05.169840+0000","last_unstale":"2024-09-12T22:48:08.676300+0000","last_undegraded":"2024-09-12T22:48:08.676300+0000","last_fullsized":"2024-09-12T22:48:08.676300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:24.240533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679770+0000","last_change":"2024-09-12T22:48:05.168203+0000","last_active":"2024-09-12T22:48:08.679770+0000","last_peered":"2024-09-12T22:48:08.679770+0000","last_clean":"2024-09-12T22:48:08.679770+0000","last_became_active":"2024-09-12T22:48:05.167870+0000","last_became_peered":"2024-09-12T22:48:05.167870+0000","last_unstale":"2024-09-12T22:48:08.679770+0000","last_undegraded":"2024-09-12T22:48:08.679770+0000","last_fullsized":"2024-09-12T22:48:08.679770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:45.140060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680214+0000","last_change":"2024-09-12T22:48:04.173355+0000","last_active":"2024-09-12T22:48:08.680214+0000","last_peered":"2024-09-12T22:48:08.680214+0000","last_clean":"2024-09-12T22:48:08.680214+0000","last_became_active":"2024-09-12T22:48:04.173031+0000","last_became_peered":"2024-09-12T22:48:04.173031+0000","last_unstale":"2024-09-12T22:48:08.680214+0000","last_undegraded":"2024-09-12T22:48:08.680214+0000","last_fullsized":"2024-09-12T22:48:08.680214+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:02.879935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673651+0000","last_change":"2024-09-12T22:48:05.176779+0000","last_active":"2024-09-12T22:48:08.673651+0000","last_peered":"2024-09-12T22:48:08.673651+0000","last_clean":"2024-09-12T22:48:08.673651+0000","last_became_active":"2024-09-12T22:48:05.176344+0000","last_became_peered":"2024-09-12T22:48:05.176344+0000","last_unstale":"2024-09-12T22:48:08.673651+0000","last_undegraded":"2024-09-12T22:48:08.673651+0000","last_fullsized":"2024-09-12T22:48:08.673651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:35.645286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677280+0000","last_change":"2024-09-12T22:48:04.171169+0000","last_active":"2024-09-12T22:48:08.677280+0000","last_peered":"2024-09-12T22:48:08.677280+0000","last_clean":"2024-09-12T22:48:08.677280+0000","last_became_active":"2024-09-12T22:48:04.170812+0000","last_became_peered":"2024-09-12T22:48:04.170812+0000","last_unstale":"2024-09-12T22:48:08.677280+0000","last_undegraded":"2024-09-12T22:48:08.677280+0000","last_fullsized":"2024-09-12T22:48:08.677280+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:05:58.510137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680378+0000","last_change":"2024-09-12T22:48:04.172325+0000","last_active":"2024-09-12T22:48:08.680378+0000","last_peered":"2024-09-12T22:48:08.680378+0000","last_clean":"2024-09-12T22:48:08.680378+0000","last_became_active":"2024-09-12T22:48:04.171855+0000","last_became_peered":"2024-09-12T22:48:04.171855+0000","last_unstale":"2024-09-12T22:48:08.680378+0000","last_undegraded":"2024-09-12T22:48:08.680378+0000","last_fullsized":"2024-09-12T22:48:08.680378+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:43.709660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673612+0000","last_change":"2024-09-12T22:48:05.177309+0000","last_active":"2024-09-12T22:48:08.673612+0000","last_peered":"2024-09-12T22:48:08.673612+0000","last_clean":"2024-09-12T22:48:08.673612+0000","last_became_active":"2024-09-12T22:48:05.176412+0000","last_became_peered":"2024-09-12T22:48:05.176412+0000","last_unstale":"2024-09-12T22:48:08.673612+0000","last_undegraded":"2024-09-12T22:48:08.673612+0000","last_fullsized":"2024-09-12T22:48:08.673612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:27:07.558853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674712+0000","last_change":"2024-09-12T22:48:04.166500+0000","last_active":"2024-09-12T22:48:08.674712+0000","last_peered":"2024-09-12T22:48:08.674712+0000","last_clean":"2024-09-12T22:48:08.674712+0000","last_became_active":"2024-09-12T22:48:04.165926+0000","last_became_peered":"2024-09-12T22:48:04.165926+0000","last_unstale":"2024-09-12T22:48:08.674712+0000","last_undegraded":"2024-09-12T22:48:08.674712+0000","last_fullsized":"2024-09-12T22:48:08.674712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:42:33.314407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673624+0000","last_change":"2024-09-12T22:48:05.169648+0000","last_active":"2024-09-12T22:48:08.673624+0000","last_peered":"2024-09-12T22:48:08.673624+0000","last_clean":"2024-09-12T22:48:08.673624+0000","last_became_active":"2024-09-12T22:48:05.168356+0000","last_became_peered":"2024-09-12T22:48:05.168356+0000","last_unstale":"2024-09-12T22:48:08.673624+0000","last_undegraded":"2024-09-12T22:48:08.673624+0000","last_fullsized":"2024-09-12T22:48:08.673624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:52.341512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677376+0000","last_change":"2024-09-12T22:48:05.173822+0000","last_active":"2024-09-12T22:48:08.677376+0000","last_peered":"2024-09-12T22:48:08.677376+0000","last_clean":"2024-09-12T22:48:08.677376+0000","last_became_active":"2024-09-12T22:48:05.172473+0000","last_became_peered":"2024-09-12T22:48:05.172473+0000","last_unstale":"2024-09-12T22:48:08.677376+0000","last_undegraded":"2024-09-12T22:48:08.677376+0000","last_fullsized":"2024-09-12T22:48:08.677376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:32.288419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673686+0000","last_change":"2024-09-12T22:48:04.169111+0000","last_active":"2024-09-12T22:48:08.673686+0000","last_peered":"2024-09-12T22:48:08.673686+0000","last_clean":"2024-09-12T22:48:08.673686+0000","last_became_active":"2024-09-12T22:48:04.168743+0000","last_became_peered":"2024-09-12T22:48:04.168743+0000","last_unstale":"2024-09-12T22:48:08.673686+0000","last_undegraded":"2024-09-12T22:48:08.673686+0000","last_fullsized":"2024-09-12T22:48:08.673686+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:43.709660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674438+0000","last_change":"2024-09-12T22:48:05.175474+0000","last_active":"2024-09-12T22:48:08.674438+0000","last_peered":"2024-09-12T22:48:08.674438+0000","last_clean":"2024-09-12T22:48:08.674438+0000","last_became_active":"2024-09-12T22:48:05.175220+0000","last_became_peered":"2024-09-12T22:48:05.175220+0000","last_unstale":"2024-09-12T22:48:08.674438+0000","last_undegraded":"2024-09-12T22:48:08.674438+0000","last_fullsized":"2024-09-12T22:48:08.674438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:56.158813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673708+0000","last_change":"2024-09-12T22:48:04.165725+0000","last_active":"2024-09-12T22:48:08.673708+0000","last_peered":"2024-09-12T22:48:08.673708+0000","last_clean":"2024-09-12T22:48:08.673708+0000","last_became_active":"2024-09-12T22:48:04.165419+0000","last_became_peered":"2024-09-12T22:48:04.165419+0000","last_unstale":"2024-09-12T22:48:08.673708+0000","last_undegraded":"2024-09-12T22:48:08.673708+0000","last_fullsized":"2024-09-12T22:48:08.673708+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:35:01.771536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677045+0000","last_change":"2024-09-12T22:48:05.174920+0000","last_active":"2024-09-12T22:48:08.677045+0000","last_peered":"2024-09-12T22:48:08.677045+0000","last_clean":"2024-09-12T22:48:08.677045+0000","last_became_active":"2024-09-12T22:48:05.173785+0000","last_became_peered":"2024-09-12T22:48:05.173785+0000","last_unstale":"2024-09-12T22:48:08.677045+0000","last_undegraded":"2024-09-12T22:48:08.677045+0000","last_fullsized":"2024-09-12T22:48:08.677045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:24.124647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676684+0000","last_change":"2024-09-12T22:48:04.174205+0000","last_active":"2024-09-12T22:48:08.676684+0000","last_peered":"2024-09-12T22:48:08.676684+0000","last_clean":"2024-09-12T22:48:08.676684+0000","last_became_active":"2024-09-12T22:48:04.173902+0000","last_became_peered":"2024-09-12T22:48:04.173902+0000","last_unstale":"2024-09-12T22:48:08.676684+0000","last_undegraded":"2024-09-12T22:48:08.676684+0000","last_fullsized":"2024-09-12T22:48:08.676684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:43:39.709214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676806+0000","last_change":"2024-09-12T22:48:05.172917+0000","last_active":"2024-09-12T22:48:08.676806+0000","last_peered":"2024-09-12T22:48:08.676806+0000","last_clean":"2024-09-12T22:48:08.676806+0000","last_became_active":"2024-09-12T22:48:05.172493+0000","last_became_peered":"2024-09-12T22:48:05.172493+0000","last_unstale":"2024-09-12T22:48:08.676806+0000","last_undegraded":"2024-09-12T22:48:08.676806+0000","last_fullsized":"2024-09-12T22:48:08.676806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:35.645286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676666+0000","last_change":"2024-09-12T22:48:04.175808+0000","last_active":"2024-09-12T22:48:08.676666+0000","last_peered":"2024-09-12T22:48:08.676666+0000","last_clean":"2024-09-12T22:48:08.676666+0000","last_became_active":"2024-09-12T22:48:04.175601+0000","last_became_peered":"2024-09-12T22:48:04.175601+0000","last_unstale":"2024-09-12T22:48:08.676666+0000","last_undegraded":"2024-09-12T22:48:08.676666+0000","last_fullsized":"2024-09-12T22:48:08.676666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:19.369251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679733+0000","last_change":"2024-09-12T22:48:05.173989+0000","last_active":"2024-09-12T22:48:08.679733+0000","last_peered":"2024-09-12T22:48:08.679733+0000","last_clean":"2024-09-12T22:48:08.679733+0000","last_became_active":"2024-09-12T22:48:05.172076+0000","last_became_peered":"2024-09-12T22:48:05.172076+0000","last_unstale":"2024-09-12T22:48:08.679733+0000","last_undegraded":"2024-09-12T22:48:08.679733+0000","last_fullsized":"2024-09-12T22:48:08.679733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:51.360504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680072+0000","last_change":"2024-09-12T22:48:04.171884+0000","last_active":"2024-09-12T22:48:08.680072+0000","last_peered":"2024-09-12T22:48:08.680072+0000","last_clean":"2024-09-12T22:48:08.680072+0000","last_became_active":"2024-09-12T22:48:04.171480+0000","last_became_peered":"2024-09-12T22:48:04.171480+0000","last_unstale":"2024-09-12T22:48:08.680072+0000","last_undegraded":"2024-09-12T22:48:08.680072+0000","last_fullsized":"2024-09-12T22:48:08.680072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:56.377664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679739+0000","last_change":"2024-09-12T22:48:05.173551+0000","last_active":"2024-09-12T22:48:08.679739+0000","last_peered":"2024-09-12T22:48:08.679739+0000","last_clean":"2024-09-12T22:48:08.679739+0000","last_became_active":"2024-09-12T22:48:05.172983+0000","last_became_peered":"2024-09-12T22:48:05.172983+0000","last_unstale":"2024-09-12T22:48:08.679739+0000","last_undegraded":"2024-09-12T22:48:08.679739+0000","last_fullsized":"2024-09-12T22:48:08.679739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:22.753741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677213+0000","last_change":"2024-09-12T22:48:04.167853+0000","last_active":"2024-09-12T22:48:08.677213+0000","last_peered":"2024-09-12T22:48:08.677213+0000","last_clean":"2024-09-12T22:48:08.677213+0000","last_became_active":"2024-09-12T22:48:04.167408+0000","last_became_peered":"2024-09-12T22:48:04.167408+0000","last_unstale":"2024-09-12T22:48:08.677213+0000","last_undegraded":"2024-09-12T22:48:08.677213+0000","last_fullsized":"2024-09-12T22:48:08.677213+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:32.031432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676789+0000","last_change":"2024-09-12T22:48:05.171815+0000","last_active":"2024-09-12T22:48:08.676789+0000","last_peered":"2024-09-12T22:48:08.676789+0000","last_clean":"2024-09-12T22:48:08.676789+0000","last_became_active":"2024-09-12T22:48:05.171361+0000","last_became_peered":"2024-09-12T22:48:05.171361+0000","last_unstale":"2024-09-12T22:48:08.676789+0000","last_undegraded":"2024-09-12T22:48:08.676789+0000","last_fullsized":"2024-09-12T22:48:08.676789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:28.873036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674540+0000","last_change":"2024-09-12T22:48:04.169500+0000","last_active":"2024-09-12T22:48:08.674540+0000","last_peered":"2024-09-12T22:48:08.674540+0000","last_clean":"2024-09-12T22:48:08.674540+0000","last_became_active":"2024-09-12T22:48:04.169087+0000","last_became_peered":"2024-09-12T22:48:04.169087+0000","last_unstale":"2024-09-12T22:48:08.674540+0000","last_undegraded":"2024-09-12T22:48:08.674540+0000","last_fullsized":"2024-09-12T22:48:08.674540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:56.377664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679335+0000","last_change":"2024-09-12T22:48:05.174947+0000","last_active":"2024-09-12T22:48:08.679335+0000","last_peered":"2024-09-12T22:48:08.679335+0000","last_clean":"2024-09-12T22:48:08.679335+0000","last_became_active":"2024-09-12T22:48:05.174503+0000","last_became_peered":"2024-09-12T22:48:05.174503+0000","last_unstale":"2024-09-12T22:48:08.679335+0000","last_undegraded":"2024-09-12T22:48:08.679335+0000","last_fullsized":"2024-09-12T22:48:08.679335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:01.401542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674557+0000","last_change":"2024-09-12T22:48:04.166198+0000","last_active":"2024-09-12T22:48:08.674557+0000","last_peered":"2024-09-12T22:48:08.674557+0000","last_clean":"2024-09-12T22:48:08.674557+0000","last_became_active":"2024-09-12T22:48:04.165795+0000","last_became_peered":"2024-09-12T22:48:04.165795+0000","last_unstale":"2024-09-12T22:48:08.674557+0000","last_undegraded":"2024-09-12T22:48:08.674557+0000","last_fullsized":"2024-09-12T22:48:08.674557+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:35.203049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":802816,"data_stored":656071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":63909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738376,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":655436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:48:16.458 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T22:48:16.458 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T22:48:16.458 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T22:48:16.458 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T22:48:16.820 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:48:16.821 INFO:teuthology.orchestra.run.smithi066.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T22:48:16.830 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T22:48:16.831 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T22:48:17.155 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:48:17.155 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":5,"btime":"2024-09-12T22:48:07:173973+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T22:48:04.509445+0000","modified":"2024-09-12T22:48:06.522541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4227},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4227":{"gid":4227,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.66:6803/2680642428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2680642428},{"type":"v1","addr":"172.21.15.66:6803","nonce":2680642428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4227,"qdb_cluster":[4227]},"id":1}]} 2024-09-12T22:48:17.155 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 5 2024-09-12T22:48:17.168 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T22:48:17.491 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:48:17.491 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":5,"btime":"2024-09-12T22:48:07:173973+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T22:48:04.509445+0000","modified":"2024-09-12T22:48:06.522541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4227},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4227":{"gid":4227,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.66:6803/2680642428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2680642428},{"type":"v1","addr":"172.21.15.66:6803","nonce":2680642428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4227,"qdb_cluster":[4227]},"id":1}]} 2024-09-12T22:48:17.492 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 5 2024-09-12T22:48:17.505 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:48:17.797 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:48:17.798 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":20,"fsid":"5714c6a5-034c-4330-a57b-d22492ad8e43","created":"2024-09-12T22:47:43.881551+0000","modified":"2024-09-12T22:48:08.667860+0000","last_up_change":"2024-09-12T22:47:54.013185+0000","last_in_change":"2024-09-12T22:47:44.690260+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:47:54.168813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:47:58.920007+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:48:03.033410+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:48:03.489928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ed48fb2-48c2-4ecb-9306-372a05b08cee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6801","nonce":1747255146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6803","nonce":1747255146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6807","nonce":1747255146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6805","nonce":1747255146}]},"public_addr":"172.21.15.87:6801/1747255146","cluster_addr":"172.21.15.87:6803/1747255146","heartbeat_back_addr":"172.21.15.87:6807/1747255146","heartbeat_front_addr":"172.21.15.87:6805/1747255146","state":["exists","up"]},{"osd":1,"uuid":"af934313-a6b4-4e15-9818-6fc3fb71b949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6801","nonce":1159429503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6803","nonce":1159429503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6807","nonce":1159429503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6805","nonce":1159429503}]},"public_addr":"172.21.15.99:6801/1159429503","cluster_addr":"172.21.15.99:6803/1159429503","heartbeat_back_addr":"172.21.15.99:6807/1159429503","heartbeat_front_addr":"172.21.15.99:6805/1159429503","state":["exists","up"]},{"osd":2,"uuid":"185ee2bd-8c37-4de1-b6ef-2988144d1470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2828388397},{"type":"v1","addr":"172.21.15.117:6801","nonce":2828388397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2828388397},{"type":"v1","addr":"172.21.15.117:6803","nonce":2828388397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2828388397},{"type":"v1","addr":"172.21.15.117:6807","nonce":2828388397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2828388397},{"type":"v1","addr":"172.21.15.117:6805","nonce":2828388397}]},"public_addr":"172.21.15.117:6801/2828388397","cluster_addr":"172.21.15.117:6803/2828388397","heartbeat_back_addr":"172.21.15.117:6807/2828388397","heartbeat_front_addr":"172.21.15.117:6805/2828388397","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:47:51.816709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:47:51.376989+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:47:51.833489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:48:17.811 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T22:48:18.132 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:48:18.132 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":5,"btime":"2024-09-12T22:48:07:173973+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T22:48:04.509445+0000","modified":"2024-09-12T22:48:06.522541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4227},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4227":{"gid":4227,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.66:6803/2680642428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2680642428},{"type":"v1","addr":"172.21.15.66:6803","nonce":2680642428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4227,"qdb_cluster":[4227]},"id":1}]} 2024-09-12T22:48:18.132 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 5 2024-09-12T22:48:18.245 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T22:48:04.509445+0000', 'modified': '2024-09-12T22:48:06.522541+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4227}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4227': {'gid': 4227, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.66:6803/2680642428', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6802', 'nonce': 2680642428}, {'type': 'v1', 'addr': '172.21.15.66:6803', 'nonce': 2680642428}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4227, 'qdb_cluster': [4227]} 2024-09-12T22:48:18.245 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T22:48:18.245 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-12T22:48:18.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T22:48:18.360+0000 7facc7fff640 0 client.4399 ms_handle_reset on v2:172.21.15.66:6802/2680642428 2024-09-12T22:48:18.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T22:48:18.382+0000 7facc7fff640 0 client.4424 ms_handle_reset on v2:172.21.15.66:6802/2680642428 2024-09-12T22:48:18.383 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T22:48:18.384 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_fsid": "5714c6a5-034c-4330-a57b-d22492ad8e43", 2024-09-12T22:48:18.384 INFO:teuthology.orchestra.run.smithi066.stdout: "whoami": 0, 2024-09-12T22:48:18.384 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 4227, 2024-09-12T22:48:18.384 INFO:teuthology.orchestra.run.smithi066.stdout: "want_state": "up:active", 2024-09-12T22:48:18.384 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "up:active", 2024-09-12T22:48:18.384 INFO:teuthology.orchestra.run.smithi066.stdout: "fs_name": "cephfs", 2024-09-12T22:48:18.384 INFO:teuthology.orchestra.run.smithi066.stdout: "rank_uptime": 13.223731477999999, 2024-09-12T22:48:18.384 INFO:teuthology.orchestra.run.smithi066.stdout: "mdsmap_epoch": 5, 2024-09-12T22:48:18.384 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch": 20, 2024-09-12T22:48:18.384 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch_barrier": 19, 2024-09-12T22:48:18.384 INFO:teuthology.orchestra.run.smithi066.stdout: "uptime": 16.236264654999999 2024-09-12T22:48:18.384 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T22:48:18.395 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-12T22:48:18.407 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-12T22:48:18.407 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a'}} 2024-09-12T22:48:18.407 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-12T22:48:18.407 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2024-09-12T22:48:18.407 DEBUG:teuthology.orchestra.run.smithi066:> sync 2024-09-12T22:48:18.554 DEBUG:teuthology.orchestra.run.smithi087:> sync 2024-09-12T22:48:18.673 DEBUG:teuthology.orchestra.run.smithi099:> sync 2024-09-12T22:48:18.745 DEBUG:teuthology.orchestra.run.smithi117:> sync 2024-09-12T22:48:18.836 DEBUG:tasks.thrashosds:checking console status of smithi066 2024-09-12T22:48:18.836 DEBUG:teuthology.orchestra.console.smithi066:Waiting for login prompt 2024-09-12T22:48:18.837 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi066 2024-09-12T22:48:18.975 DEBUG:teuthology.orchestra.console.smithi066:expect before: [Enter `^Ec?' for help] 2024-09-12T22:48:18.976 DEBUG:teuthology.orchestra.console.smithi066:expect after: smithi066 login: 2024-09-12T22:48:19.028 DEBUG:teuthology.orchestra.console.smithi066:console disconnect output: [Enter `^Ec?' for help] smithi066 login: [disconnect] 2024-09-12T22:48:19.128 DEBUG:tasks.thrashosds:checking console status of smithi087 2024-09-12T22:48:19.129 DEBUG:teuthology.orchestra.console.smithi087:Waiting for login prompt 2024-09-12T22:48:19.129 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi087 2024-09-12T22:48:19.292 DEBUG:teuthology.orchestra.console.smithi087:expect before: [Enter `^Ec?' for help] 2024-09-12T22:48:19.292 DEBUG:teuthology.orchestra.console.smithi087:expect after: smithi087 login: 2024-09-12T22:48:19.345 DEBUG:teuthology.orchestra.console.smithi087:console disconnect output: [Enter `^Ec?' for help] smithi087 login: [disconnect] 2024-09-12T22:48:19.446 DEBUG:tasks.thrashosds:checking console status of smithi099 2024-09-12T22:48:19.446 DEBUG:teuthology.orchestra.console.smithi099:Waiting for login prompt 2024-09-12T22:48:19.446 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi099 2024-09-12T22:48:19.574 DEBUG:teuthology.orchestra.console.smithi099:expect before: [Enter `^Ec?' for help] 2024-09-12T22:48:19.575 DEBUG:teuthology.orchestra.console.smithi099:expect after: smithi099 login: 2024-09-12T22:48:19.627 DEBUG:teuthology.orchestra.console.smithi099:console disconnect output: [Enter `^Ec?' for help] smithi099 login: [disconnect] 2024-09-12T22:48:19.728 DEBUG:tasks.thrashosds:checking console status of smithi117 2024-09-12T22:48:19.729 DEBUG:teuthology.orchestra.console.smithi117:Waiting for login prompt 2024-09-12T22:48:19.729 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi117 2024-09-12T22:48:19.821 DEBUG:teuthology.orchestra.console.smithi117:expect before: [Enter `^Ec?' for help] 2024-09-12T22:48:19.821 DEBUG:teuthology.orchestra.console.smithi117:expect after: smithi117 login: 2024-09-12T22:48:19.874 DEBUG:teuthology.orchestra.console.smithi117:console disconnect output: [Enter `^Ec?' for help] smithi117 login: [disconnect] 2024-09-12T22:48:19.975 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-12T22:48:20.299 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-12T22:48:20.299 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T22:48:20.299 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:48:20.593 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:48:20.600 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-09-12T22:48:20.602 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-09-12T22:48:20.130274+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86984,"kb_used_data":1736,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283028536,"statfs":{"total":289910292480,"available":289821220864,"internally_reserved":0,"allocated":1777664,"data_stored":1375416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.458549"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677255+0000","last_change":"2024-09-12T22:48:05.174190+0000","last_active":"2024-09-12T22:48:08.677255+0000","last_peered":"2024-09-12T22:48:08.677255+0000","last_clean":"2024-09-12T22:48:08.677255+0000","last_became_active":"2024-09-12T22:48:05.172964+0000","last_became_peered":"2024-09-12T22:48:05.172964+0000","last_unstale":"2024-09-12T22:48:08.677255+0000","last_undegraded":"2024-09-12T22:48:08.677255+0000","last_fullsized":"2024-09-12T22:48:08.677255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:49.868891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676980+0000","last_change":"2024-09-12T22:48:05.173045+0000","last_active":"2024-09-12T22:48:08.676980+0000","last_peered":"2024-09-12T22:48:08.676980+0000","last_clean":"2024-09-12T22:48:08.676980+0000","last_became_active":"2024-09-12T22:48:05.172684+0000","last_became_peered":"2024-09-12T22:48:05.172684+0000","last_unstale":"2024-09-12T22:48:08.676980+0000","last_undegraded":"2024-09-12T22:48:08.676980+0000","last_fullsized":"2024-09-12T22:48:08.676980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:51.360504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679907+0000","last_change":"2024-09-12T22:48:05.178267+0000","last_active":"2024-09-12T22:48:08.679907+0000","last_peered":"2024-09-12T22:48:08.679907+0000","last_clean":"2024-09-12T22:48:08.679907+0000","last_became_active":"2024-09-12T22:48:05.177555+0000","last_became_peered":"2024-09-12T22:48:05.177555+0000","last_unstale":"2024-09-12T22:48:08.679907+0000","last_undegraded":"2024-09-12T22:48:08.679907+0000","last_fullsized":"2024-09-12T22:48:08.679907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:58.991752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679782+0000","last_change":"2024-09-12T22:48:05.173539+0000","last_active":"2024-09-12T22:48:08.679782+0000","last_peered":"2024-09-12T22:48:08.679782+0000","last_clean":"2024-09-12T22:48:08.679782+0000","last_became_active":"2024-09-12T22:48:05.172647+0000","last_became_peered":"2024-09-12T22:48:05.172647+0000","last_unstale":"2024-09-12T22:48:08.679782+0000","last_undegraded":"2024-09-12T22:48:08.679782+0000","last_fullsized":"2024-09-12T22:48:08.679782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:56:34.490182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676660+0000","last_change":"2024-09-12T22:48:05.170306+0000","last_active":"2024-09-12T22:48:08.676660+0000","last_peered":"2024-09-12T22:48:08.676660+0000","last_clean":"2024-09-12T22:48:08.676660+0000","last_became_active":"2024-09-12T22:48:05.169940+0000","last_became_peered":"2024-09-12T22:48:05.169940+0000","last_unstale":"2024-09-12T22:48:08.676660+0000","last_undegraded":"2024-09-12T22:48:08.676660+0000","last_fullsized":"2024-09-12T22:48:08.676660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:52.341512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679410+0000","last_change":"2024-09-12T22:48:05.173232+0000","last_active":"2024-09-12T22:48:08.679410+0000","last_peered":"2024-09-12T22:48:08.679410+0000","last_clean":"2024-09-12T22:48:08.679410+0000","last_became_active":"2024-09-12T22:48:05.172213+0000","last_became_peered":"2024-09-12T22:48:05.172213+0000","last_unstale":"2024-09-12T22:48:08.679410+0000","last_undegraded":"2024-09-12T22:48:08.679410+0000","last_fullsized":"2024-09-12T22:48:08.679410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:25.994320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679563+0000","last_change":"2024-09-12T22:48:05.172187+0000","last_active":"2024-09-12T22:48:08.679563+0000","last_peered":"2024-09-12T22:48:08.679563+0000","last_clean":"2024-09-12T22:48:08.679563+0000","last_became_active":"2024-09-12T22:48:05.171766+0000","last_became_peered":"2024-09-12T22:48:05.171766+0000","last_unstale":"2024-09-12T22:48:08.679563+0000","last_undegraded":"2024-09-12T22:48:08.679563+0000","last_fullsized":"2024-09-12T22:48:08.679563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:49.868891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679126+0000","last_change":"2024-09-12T22:48:05.174326+0000","last_active":"2024-09-12T22:48:08.679126+0000","last_peered":"2024-09-12T22:48:08.679126+0000","last_clean":"2024-09-12T22:48:08.679126+0000","last_became_active":"2024-09-12T22:48:05.172312+0000","last_became_peered":"2024-09-12T22:48:05.172312+0000","last_unstale":"2024-09-12T22:48:08.679126+0000","last_undegraded":"2024-09-12T22:48:08.679126+0000","last_fullsized":"2024-09-12T22:48:08.679126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:52.071513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674344+0000","last_change":"2024-09-12T22:48:05.178445+0000","last_active":"2024-09-12T22:48:08.674344+0000","last_peered":"2024-09-12T22:48:08.674344+0000","last_clean":"2024-09-12T22:48:08.674344+0000","last_became_active":"2024-09-12T22:48:05.177284+0000","last_became_peered":"2024-09-12T22:48:05.177284+0000","last_unstale":"2024-09-12T22:48:08.674344+0000","last_undegraded":"2024-09-12T22:48:08.674344+0000","last_fullsized":"2024-09-12T22:48:08.674344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:45.140060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677090+0000","last_change":"2024-09-12T22:48:05.172480+0000","last_active":"2024-09-12T22:48:08.677090+0000","last_peered":"2024-09-12T22:48:08.677090+0000","last_clean":"2024-09-12T22:48:08.677090+0000","last_became_active":"2024-09-12T22:48:05.171686+0000","last_became_peered":"2024-09-12T22:48:05.171686+0000","last_unstale":"2024-09-12T22:48:08.677090+0000","last_undegraded":"2024-09-12T22:48:08.677090+0000","last_fullsized":"2024-09-12T22:48:08.677090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:56.158813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680327+0000","last_change":"2024-09-12T22:48:05.172837+0000","last_active":"2024-09-12T22:48:08.680327+0000","last_peered":"2024-09-12T22:48:08.680327+0000","last_clean":"2024-09-12T22:48:08.680327+0000","last_became_active":"2024-09-12T22:48:05.171890+0000","last_became_peered":"2024-09-12T22:48:05.171890+0000","last_unstale":"2024-09-12T22:48:08.680327+0000","last_undegraded":"2024-09-12T22:48:08.680327+0000","last_fullsized":"2024-09-12T22:48:08.680327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:46.965030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676812+0000","last_change":"2024-09-12T22:48:05.175666+0000","last_active":"2024-09-12T22:48:08.676812+0000","last_peered":"2024-09-12T22:48:08.676812+0000","last_clean":"2024-09-12T22:48:08.676812+0000","last_became_active":"2024-09-12T22:48:05.175390+0000","last_became_peered":"2024-09-12T22:48:05.175390+0000","last_unstale":"2024-09-12T22:48:08.676812+0000","last_undegraded":"2024-09-12T22:48:08.676812+0000","last_fullsized":"2024-09-12T22:48:08.676812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:13.160164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676555+0000","last_change":"2024-09-12T22:48:05.171356+0000","last_active":"2024-09-12T22:48:08.676555+0000","last_peered":"2024-09-12T22:48:08.676555+0000","last_clean":"2024-09-12T22:48:08.676555+0000","last_became_active":"2024-09-12T22:48:05.170794+0000","last_became_peered":"2024-09-12T22:48:05.170794+0000","last_unstale":"2024-09-12T22:48:08.676555+0000","last_undegraded":"2024-09-12T22:48:08.676555+0000","last_fullsized":"2024-09-12T22:48:08.676555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:42:56.969660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679530+0000","last_change":"2024-09-12T22:48:05.168780+0000","last_active":"2024-09-12T22:48:08.679530+0000","last_peered":"2024-09-12T22:48:08.679530+0000","last_clean":"2024-09-12T22:48:08.679530+0000","last_became_active":"2024-09-12T22:48:05.168294+0000","last_became_peered":"2024-09-12T22:48:05.168294+0000","last_unstale":"2024-09-12T22:48:08.679530+0000","last_undegraded":"2024-09-12T22:48:08.679530+0000","last_fullsized":"2024-09-12T22:48:08.679530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:30.120804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679600+0000","last_change":"2024-09-12T22:48:05.168344+0000","last_active":"2024-09-12T22:48:08.679600+0000","last_peered":"2024-09-12T22:48:08.679600+0000","last_clean":"2024-09-12T22:48:08.679600+0000","last_became_active":"2024-09-12T22:48:05.167805+0000","last_became_peered":"2024-09-12T22:48:05.167805+0000","last_unstale":"2024-09-12T22:48:08.679600+0000","last_undegraded":"2024-09-12T22:48:08.679600+0000","last_fullsized":"2024-09-12T22:48:08.679600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:32.288419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679162+0000","last_change":"2024-09-12T22:48:05.174663+0000","last_active":"2024-09-12T22:48:08.679162+0000","last_peered":"2024-09-12T22:48:08.679162+0000","last_clean":"2024-09-12T22:48:08.679162+0000","last_became_active":"2024-09-12T22:48:05.173101+0000","last_became_peered":"2024-09-12T22:48:05.173101+0000","last_unstale":"2024-09-12T22:48:08.679162+0000","last_undegraded":"2024-09-12T22:48:08.679162+0000","last_fullsized":"2024-09-12T22:48:08.679162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:25.143572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674747+0000","last_change":"2024-09-12T22:48:05.178721+0000","last_active":"2024-09-12T22:48:08.674747+0000","last_peered":"2024-09-12T22:48:08.674747+0000","last_clean":"2024-09-12T22:48:08.674747+0000","last_became_active":"2024-09-12T22:48:05.177965+0000","last_became_peered":"2024-09-12T22:48:05.177965+0000","last_unstale":"2024-09-12T22:48:08.674747+0000","last_undegraded":"2024-09-12T22:48:08.674747+0000","last_fullsized":"2024-09-12T22:48:08.674747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:32.288419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677222+0000","last_change":"2024-09-12T22:48:05.171053+0000","last_active":"2024-09-12T22:48:08.677222+0000","last_peered":"2024-09-12T22:48:08.677222+0000","last_clean":"2024-09-12T22:48:08.677222+0000","last_became_active":"2024-09-12T22:48:05.170578+0000","last_became_peered":"2024-09-12T22:48:05.170578+0000","last_unstale":"2024-09-12T22:48:08.677222+0000","last_undegraded":"2024-09-12T22:48:08.677222+0000","last_fullsized":"2024-09-12T22:48:08.677222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:58.991752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674239+0000","last_change":"2024-09-12T22:48:05.177369+0000","last_active":"2024-09-12T22:48:08.674239+0000","last_peered":"2024-09-12T22:48:08.674239+0000","last_clean":"2024-09-12T22:48:08.674239+0000","last_became_active":"2024-09-12T22:48:05.176680+0000","last_became_peered":"2024-09-12T22:48:05.176680+0000","last_unstale":"2024-09-12T22:48:08.674239+0000","last_undegraded":"2024-09-12T22:48:08.674239+0000","last_fullsized":"2024-09-12T22:48:08.674239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:25.143572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680241+0000","last_change":"2024-09-12T22:48:05.173232+0000","last_active":"2024-09-12T22:48:08.680241+0000","last_peered":"2024-09-12T22:48:08.680241+0000","last_clean":"2024-09-12T22:48:08.680241+0000","last_became_active":"2024-09-12T22:48:05.172382+0000","last_became_peered":"2024-09-12T22:48:05.172382+0000","last_unstale":"2024-09-12T22:48:08.680241+0000","last_undegraded":"2024-09-12T22:48:08.680241+0000","last_fullsized":"2024-09-12T22:48:08.680241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:28.083344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679924+0000","last_change":"2024-09-12T22:48:05.174799+0000","last_active":"2024-09-12T22:48:08.679924+0000","last_peered":"2024-09-12T22:48:08.679924+0000","last_clean":"2024-09-12T22:48:08.679924+0000","last_became_active":"2024-09-12T22:48:05.174423+0000","last_became_peered":"2024-09-12T22:48:05.174423+0000","last_unstale":"2024-09-12T22:48:08.679924+0000","last_undegraded":"2024-09-12T22:48:08.679924+0000","last_fullsized":"2024-09-12T22:48:08.679924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:56.158813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676495+0000","last_change":"2024-09-12T22:48:05.175363+0000","last_active":"2024-09-12T22:48:08.676495+0000","last_peered":"2024-09-12T22:48:08.676495+0000","last_clean":"2024-09-12T22:48:08.676495+0000","last_became_active":"2024-09-12T22:48:05.174832+0000","last_became_peered":"2024-09-12T22:48:05.174832+0000","last_unstale":"2024-09-12T22:48:08.676495+0000","last_undegraded":"2024-09-12T22:48:08.676495+0000","last_fullsized":"2024-09-12T22:48:08.676495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:25.994320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673471+0000","last_change":"2024-09-12T22:48:05.169838+0000","last_active":"2024-09-12T22:48:08.673471+0000","last_peered":"2024-09-12T22:48:08.673471+0000","last_clean":"2024-09-12T22:48:08.673471+0000","last_became_active":"2024-09-12T22:48:05.169462+0000","last_became_peered":"2024-09-12T22:48:05.169462+0000","last_unstale":"2024-09-12T22:48:08.673471+0000","last_undegraded":"2024-09-12T22:48:08.673471+0000","last_fullsized":"2024-09-12T22:48:08.673471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:42:56.969660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676149+0000","last_change":"2024-09-12T22:48:05.172794+0000","last_active":"2024-09-12T22:48:08.676149+0000","last_peered":"2024-09-12T22:48:08.676149+0000","last_clean":"2024-09-12T22:48:08.676149+0000","last_became_active":"2024-09-12T22:48:05.172437+0000","last_became_peered":"2024-09-12T22:48:05.172437+0000","last_unstale":"2024-09-12T22:48:08.676149+0000","last_undegraded":"2024-09-12T22:48:08.676149+0000","last_fullsized":"2024-09-12T22:48:08.676149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:54:44.278646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677275+0000","last_change":"2024-09-12T22:48:05.173714+0000","last_active":"2024-09-12T22:48:08.677275+0000","last_peered":"2024-09-12T22:48:08.677275+0000","last_clean":"2024-09-12T22:48:08.677275+0000","last_became_active":"2024-09-12T22:48:05.172938+0000","last_became_peered":"2024-09-12T22:48:05.172938+0000","last_unstale":"2024-09-12T22:48:08.677275+0000","last_undegraded":"2024-09-12T22:48:08.677275+0000","last_fullsized":"2024-09-12T22:48:08.677275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:30.120804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674352+0000","last_change":"2024-09-12T22:48:05.177862+0000","last_active":"2024-09-12T22:48:08.674352+0000","last_peered":"2024-09-12T22:48:08.674352+0000","last_clean":"2024-09-12T22:48:08.674352+0000","last_became_active":"2024-09-12T22:48:05.177545+0000","last_became_peered":"2024-09-12T22:48:05.177545+0000","last_unstale":"2024-09-12T22:48:08.674352+0000","last_undegraded":"2024-09-12T22:48:08.674352+0000","last_fullsized":"2024-09-12T22:48:08.674352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:25.994320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680458+0000","last_change":"2024-09-12T22:48:05.178249+0000","last_active":"2024-09-12T22:48:08.680458+0000","last_peered":"2024-09-12T22:48:08.680458+0000","last_clean":"2024-09-12T22:48:08.680458+0000","last_became_active":"2024-09-12T22:48:05.177582+0000","last_became_peered":"2024-09-12T22:48:05.177582+0000","last_unstale":"2024-09-12T22:48:08.680458+0000","last_undegraded":"2024-09-12T22:48:08.680458+0000","last_fullsized":"2024-09-12T22:48:08.680458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:25.556218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677103+0000","last_change":"2024-09-12T22:48:05.171326+0000","last_active":"2024-09-12T22:48:08.677103+0000","last_peered":"2024-09-12T22:48:08.677103+0000","last_clean":"2024-09-12T22:48:08.677103+0000","last_became_active":"2024-09-12T22:48:05.170491+0000","last_became_peered":"2024-09-12T22:48:05.170491+0000","last_unstale":"2024-09-12T22:48:08.677103+0000","last_undegraded":"2024-09-12T22:48:08.677103+0000","last_fullsized":"2024-09-12T22:48:08.677103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:52.071513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674052+0000","last_change":"2024-09-12T22:48:05.177176+0000","last_active":"2024-09-12T22:48:08.674052+0000","last_peered":"2024-09-12T22:48:08.674052+0000","last_clean":"2024-09-12T22:48:08.674052+0000","last_became_active":"2024-09-12T22:48:05.176735+0000","last_became_peered":"2024-09-12T22:48:05.176735+0000","last_unstale":"2024-09-12T22:48:08.674052+0000","last_undegraded":"2024-09-12T22:48:08.674052+0000","last_fullsized":"2024-09-12T22:48:08.674052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:51.360504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676676+0000","last_change":"2024-09-12T22:48:05.171180+0000","last_active":"2024-09-12T22:48:08.676676+0000","last_peered":"2024-09-12T22:48:08.676676+0000","last_clean":"2024-09-12T22:48:08.676676+0000","last_became_active":"2024-09-12T22:48:05.170263+0000","last_became_peered":"2024-09-12T22:48:05.170263+0000","last_unstale":"2024-09-12T22:48:08.676676+0000","last_undegraded":"2024-09-12T22:48:08.676676+0000","last_fullsized":"2024-09-12T22:48:08.676676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:25.143572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673611+0000","last_change":"2024-09-12T22:48:05.176878+0000","last_active":"2024-09-12T22:48:08.673611+0000","last_peered":"2024-09-12T22:48:08.673611+0000","last_clean":"2024-09-12T22:48:08.673611+0000","last_became_active":"2024-09-12T22:48:05.176327+0000","last_became_peered":"2024-09-12T22:48:05.176327+0000","last_unstale":"2024-09-12T22:48:08.673611+0000","last_undegraded":"2024-09-12T22:48:08.673611+0000","last_fullsized":"2024-09-12T22:48:08.673611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:11.781766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679222+0000","last_change":"2024-09-12T22:48:05.174818+0000","last_active":"2024-09-12T22:48:08.679222+0000","last_peered":"2024-09-12T22:48:08.679222+0000","last_clean":"2024-09-12T22:48:08.679222+0000","last_became_active":"2024-09-12T22:48:05.173485+0000","last_became_peered":"2024-09-12T22:48:05.173485+0000","last_unstale":"2024-09-12T22:48:08.679222+0000","last_undegraded":"2024-09-12T22:48:08.679222+0000","last_fullsized":"2024-09-12T22:48:08.679222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:24.124647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676980+0000","last_change":"2024-09-12T22:48:05.171573+0000","last_active":"2024-09-12T22:48:08.676980+0000","last_peered":"2024-09-12T22:48:08.676980+0000","last_clean":"2024-09-12T22:48:08.676980+0000","last_became_active":"2024-09-12T22:48:05.171036+0000","last_became_peered":"2024-09-12T22:48:05.171036+0000","last_unstale":"2024-09-12T22:48:08.676980+0000","last_undegraded":"2024-09-12T22:48:08.676980+0000","last_fullsized":"2024-09-12T22:48:08.676980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:27:07.558853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679924+0000","last_change":"2024-09-12T22:48:04.171960+0000","last_active":"2024-09-12T22:48:08.679924+0000","last_peered":"2024-09-12T22:48:08.679924+0000","last_clean":"2024-09-12T22:48:08.679924+0000","last_became_active":"2024-09-12T22:48:04.171562+0000","last_became_peered":"2024-09-12T22:48:04.171562+0000","last_unstale":"2024-09-12T22:48:08.679924+0000","last_undegraded":"2024-09-12T22:48:08.679924+0000","last_fullsized":"2024-09-12T22:48:08.679924+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:00.271198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677053+0000","last_change":"2024-09-12T22:48:05.173585+0000","last_active":"2024-09-12T22:48:08.677053+0000","last_peered":"2024-09-12T22:48:08.677053+0000","last_clean":"2024-09-12T22:48:08.677053+0000","last_became_active":"2024-09-12T22:48:05.172801+0000","last_became_peered":"2024-09-12T22:48:05.172801+0000","last_unstale":"2024-09-12T22:48:08.677053+0000","last_undegraded":"2024-09-12T22:48:08.677053+0000","last_fullsized":"2024-09-12T22:48:08.677053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:45.140060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674214+0000","last_change":"2024-09-12T22:48:04.167352+0000","last_active":"2024-09-12T22:48:08.674214+0000","last_peered":"2024-09-12T22:48:08.674214+0000","last_clean":"2024-09-12T22:48:08.674214+0000","last_became_active":"2024-09-12T22:48:04.166743+0000","last_became_peered":"2024-09-12T22:48:04.166743+0000","last_unstale":"2024-09-12T22:48:08.674214+0000","last_undegraded":"2024-09-12T22:48:08.674214+0000","last_fullsized":"2024-09-12T22:48:08.674214+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:30:27.547041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674597+0000","last_change":"2024-09-12T22:48:05.178409+0000","last_active":"2024-09-12T22:48:08.674597+0000","last_peered":"2024-09-12T22:48:08.674597+0000","last_clean":"2024-09-12T22:48:08.674597+0000","last_became_active":"2024-09-12T22:48:05.178076+0000","last_became_peered":"2024-09-12T22:48:05.178076+0000","last_unstale":"2024-09-12T22:48:08.674597+0000","last_undegraded":"2024-09-12T22:48:08.674597+0000","last_fullsized":"2024-09-12T22:48:08.674597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:01.401542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676355+0000","last_change":"2024-09-12T22:48:04.171173+0000","last_active":"2024-09-12T22:48:08.676355+0000","last_peered":"2024-09-12T22:48:08.676355+0000","last_clean":"2024-09-12T22:48:08.676355+0000","last_became_active":"2024-09-12T22:48:04.170891+0000","last_became_peered":"2024-09-12T22:48:04.170891+0000","last_unstale":"2024-09-12T22:48:08.676355+0000","last_undegraded":"2024-09-12T22:48:08.676355+0000","last_fullsized":"2024-09-12T22:48:08.676355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:02.023664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674470+0000","last_change":"2024-09-12T22:48:05.177510+0000","last_active":"2024-09-12T22:48:08.674470+0000","last_peered":"2024-09-12T22:48:08.674470+0000","last_clean":"2024-09-12T22:48:08.674470+0000","last_became_active":"2024-09-12T22:48:05.176568+0000","last_became_peered":"2024-09-12T22:48:05.176568+0000","last_unstale":"2024-09-12T22:48:08.674470+0000","last_undegraded":"2024-09-12T22:48:08.674470+0000","last_fullsized":"2024-09-12T22:48:08.674470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:49.868891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679221+0000","last_change":"2024-09-12T22:48:04.173161+0000","last_active":"2024-09-12T22:48:08.679221+0000","last_peered":"2024-09-12T22:48:08.679221+0000","last_clean":"2024-09-12T22:48:08.679221+0000","last_became_active":"2024-09-12T22:48:04.172623+0000","last_became_peered":"2024-09-12T22:48:04.172623+0000","last_unstale":"2024-09-12T22:48:08.679221+0000","last_undegraded":"2024-09-12T22:48:08.679221+0000","last_fullsized":"2024-09-12T22:48:08.679221+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:13.739087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680199+0000","last_change":"2024-09-12T22:48:04.173041+0000","last_active":"2024-09-12T22:48:08.680199+0000","last_peered":"2024-09-12T22:48:08.680199+0000","last_clean":"2024-09-12T22:48:08.680199+0000","last_became_active":"2024-09-12T22:48:04.172527+0000","last_became_peered":"2024-09-12T22:48:04.172527+0000","last_unstale":"2024-09-12T22:48:08.680199+0000","last_undegraded":"2024-09-12T22:48:08.680199+0000","last_fullsized":"2024-09-12T22:48:08.680199+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:20.734653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676178+0000","last_change":"2024-09-12T22:48:05.175921+0000","last_active":"2024-09-12T22:48:08.676178+0000","last_peered":"2024-09-12T22:48:08.676178+0000","last_clean":"2024-09-12T22:48:08.676178+0000","last_became_active":"2024-09-12T22:48:05.175226+0000","last_became_peered":"2024-09-12T22:48:05.175226+0000","last_unstale":"2024-09-12T22:48:08.676178+0000","last_undegraded":"2024-09-12T22:48:08.676178+0000","last_fullsized":"2024-09-12T22:48:08.676178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:08.021196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677320+0000","last_change":"2024-09-12T22:48:04.167564+0000","last_active":"2024-09-12T22:48:08.677320+0000","last_peered":"2024-09-12T22:48:08.677320+0000","last_clean":"2024-09-12T22:48:08.677320+0000","last_became_active":"2024-09-12T22:48:04.167254+0000","last_became_peered":"2024-09-12T22:48:04.167254+0000","last_unstale":"2024-09-12T22:48:08.677320+0000","last_undegraded":"2024-09-12T22:48:08.677320+0000","last_fullsized":"2024-09-12T22:48:08.677320+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:35.879041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676271+0000","last_change":"2024-09-12T22:48:05.171143+0000","last_active":"2024-09-12T22:48:08.676271+0000","last_peered":"2024-09-12T22:48:08.676271+0000","last_clean":"2024-09-12T22:48:08.676271+0000","last_became_active":"2024-09-12T22:48:05.170374+0000","last_became_peered":"2024-09-12T22:48:05.170374+0000","last_unstale":"2024-09-12T22:48:08.676271+0000","last_undegraded":"2024-09-12T22:48:08.676271+0000","last_fullsized":"2024-09-12T22:48:08.676271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:15.887977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680611+0000","last_change":"2024-09-12T22:48:04.173325+0000","last_active":"2024-09-12T22:48:08.680611+0000","last_peered":"2024-09-12T22:48:08.680611+0000","last_clean":"2024-09-12T22:48:08.680611+0000","last_became_active":"2024-09-12T22:48:04.172862+0000","last_became_peered":"2024-09-12T22:48:04.172862+0000","last_unstale":"2024-09-12T22:48:08.680611+0000","last_undegraded":"2024-09-12T22:48:08.680611+0000","last_fullsized":"2024-09-12T22:48:08.680611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:42:33.314407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679603+0000","last_change":"2024-09-12T22:48:05.173382+0000","last_active":"2024-09-12T22:48:08.679603+0000","last_peered":"2024-09-12T22:48:08.679603+0000","last_clean":"2024-09-12T22:48:08.679603+0000","last_became_active":"2024-09-12T22:48:05.172429+0000","last_became_peered":"2024-09-12T22:48:05.172429+0000","last_unstale":"2024-09-12T22:48:08.679603+0000","last_undegraded":"2024-09-12T22:48:08.679603+0000","last_fullsized":"2024-09-12T22:48:08.679603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:44:38.144948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680436+0000","last_change":"2024-09-12T22:48:04.172099+0000","last_active":"2024-09-12T22:48:08.680436+0000","last_peered":"2024-09-12T22:48:08.680436+0000","last_clean":"2024-09-12T22:48:08.680436+0000","last_became_active":"2024-09-12T22:48:04.171746+0000","last_became_peered":"2024-09-12T22:48:04.171746+0000","last_unstale":"2024-09-12T22:48:08.680436+0000","last_undegraded":"2024-09-12T22:48:08.680436+0000","last_fullsized":"2024-09-12T22:48:08.680436+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:35:28.894178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674110+0000","last_change":"2024-09-12T22:48:05.177824+0000","last_active":"2024-09-12T22:48:08.674110+0000","last_peered":"2024-09-12T22:48:08.674110+0000","last_clean":"2024-09-12T22:48:08.674110+0000","last_became_active":"2024-09-12T22:48:05.177344+0000","last_became_peered":"2024-09-12T22:48:05.177344+0000","last_unstale":"2024-09-12T22:48:08.674110+0000","last_undegraded":"2024-09-12T22:48:08.674110+0000","last_fullsized":"2024-09-12T22:48:08.674110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:52.071513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674213+0000","last_change":"2024-09-12T22:48:04.167459+0000","last_active":"2024-09-12T22:48:08.674213+0000","last_peered":"2024-09-12T22:48:08.674213+0000","last_clean":"2024-09-12T22:48:08.674213+0000","last_became_active":"2024-09-12T22:48:04.165825+0000","last_became_peered":"2024-09-12T22:48:04.165825+0000","last_unstale":"2024-09-12T22:48:08.674213+0000","last_undegraded":"2024-09-12T22:48:08.674213+0000","last_fullsized":"2024-09-12T22:48:08.674213+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:20.734653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679998+0000","last_change":"2024-09-12T22:48:05.173859+0000","last_active":"2024-09-12T22:48:08.679998+0000","last_peered":"2024-09-12T22:48:08.679998+0000","last_clean":"2024-09-12T22:48:08.679998+0000","last_became_active":"2024-09-12T22:48:05.173276+0000","last_became_peered":"2024-09-12T22:48:05.173276+0000","last_unstale":"2024-09-12T22:48:08.679998+0000","last_undegraded":"2024-09-12T22:48:08.679998+0000","last_fullsized":"2024-09-12T22:48:08.679998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:06:31.953025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679767+0000","last_change":"2024-09-12T22:48:04.172158+0000","last_active":"2024-09-12T22:48:08.679767+0000","last_peered":"2024-09-12T22:48:08.679767+0000","last_clean":"2024-09-12T22:48:08.679767+0000","last_became_active":"2024-09-12T22:48:04.171514+0000","last_became_peered":"2024-09-12T22:48:04.171514+0000","last_unstale":"2024-09-12T22:48:08.679767+0000","last_undegraded":"2024-09-12T22:48:08.679767+0000","last_fullsized":"2024-09-12T22:48:08.679767+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:40:29.366846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680561+0000","last_change":"2024-09-12T22:48:05.178528+0000","last_active":"2024-09-12T22:48:08.680561+0000","last_peered":"2024-09-12T22:48:08.680561+0000","last_clean":"2024-09-12T22:48:08.680561+0000","last_became_active":"2024-09-12T22:48:05.177904+0000","last_became_peered":"2024-09-12T22:48:05.177904+0000","last_unstale":"2024-09-12T22:48:08.680561+0000","last_undegraded":"2024-09-12T22:48:08.680561+0000","last_fullsized":"2024-09-12T22:48:08.680561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:59.525401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676548+0000","last_change":"2024-09-12T22:48:04.171001+0000","last_active":"2024-09-12T22:48:08.676548+0000","last_peered":"2024-09-12T22:48:08.676548+0000","last_clean":"2024-09-12T22:48:08.676548+0000","last_became_active":"2024-09-12T22:48:04.170667+0000","last_became_peered":"2024-09-12T22:48:04.170667+0000","last_unstale":"2024-09-12T22:48:08.676548+0000","last_undegraded":"2024-09-12T22:48:08.676548+0000","last_fullsized":"2024-09-12T22:48:08.676548+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:04.492449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680316+0000","last_change":"2024-09-12T22:48:05.177804+0000","last_active":"2024-09-12T22:48:08.680316+0000","last_peered":"2024-09-12T22:48:08.680316+0000","last_clean":"2024-09-12T22:48:08.680316+0000","last_became_active":"2024-09-12T22:48:05.177458+0000","last_became_peered":"2024-09-12T22:48:05.177458+0000","last_unstale":"2024-09-12T22:48:08.680316+0000","last_undegraded":"2024-09-12T22:48:08.680316+0000","last_fullsized":"2024-09-12T22:48:08.680316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:47.576598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676227+0000","last_change":"2024-09-12T22:48:04.174281+0000","last_active":"2024-09-12T22:48:08.676227+0000","last_peered":"2024-09-12T22:48:08.676227+0000","last_clean":"2024-09-12T22:48:08.676227+0000","last_became_active":"2024-09-12T22:48:04.173942+0000","last_became_peered":"2024-09-12T22:48:04.173942+0000","last_unstale":"2024-09-12T22:48:08.676227+0000","last_undegraded":"2024-09-12T22:48:08.676227+0000","last_fullsized":"2024-09-12T22:48:08.676227+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:19:38.546747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674466+0000","last_change":"2024-09-12T22:48:05.178246+0000","last_active":"2024-09-12T22:48:08.674466+0000","last_peered":"2024-09-12T22:48:08.674466+0000","last_clean":"2024-09-12T22:48:08.674466+0000","last_became_active":"2024-09-12T22:48:05.176813+0000","last_became_peered":"2024-09-12T22:48:05.176813+0000","last_unstale":"2024-09-12T22:48:08.674466+0000","last_undegraded":"2024-09-12T22:48:08.674466+0000","last_fullsized":"2024-09-12T22:48:08.674466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:58.991752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":226,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679433+0000","last_change":"2024-09-12T22:47:56.028830+0000","last_active":"2024-09-12T22:48:08.679433+0000","last_peered":"2024-09-12T22:48:08.679433+0000","last_clean":"2024-09-12T22:48:08.679433+0000","last_became_active":"2024-09-12T22:47:56.028017+0000","last_became_peered":"2024-09-12T22:47:56.028017+0000","last_unstale":"2024-09-12T22:48:08.679433+0000","last_undegraded":"2024-09-12T22:48:08.679433+0000","last_fullsized":"2024-09-12T22:48:08.679433+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:55.016634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:55.016634+0000","last_clean_scrub_stamp":"2024-09-12T22:47:55.016634+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:03.648827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680145+0000","last_change":"2024-09-12T22:48:02.045816+0000","last_active":"2024-09-12T22:48:08.680145+0000","last_peered":"2024-09-12T22:48:08.680145+0000","last_clean":"2024-09-12T22:48:08.680145+0000","last_became_active":"2024-09-12T22:48:00.045324+0000","last_became_peered":"2024-09-12T22:48:00.045324+0000","last_unstale":"2024-09-12T22:48:08.680145+0000","last_undegraded":"2024-09-12T22:48:08.680145+0000","last_fullsized":"2024-09-12T22:48:08.680145+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:41:33.998543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065526500000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673955+0000","last_change":"2024-09-12T22:48:04.169704+0000","last_active":"2024-09-12T22:48:08.673955+0000","last_peered":"2024-09-12T22:48:08.673955+0000","last_clean":"2024-09-12T22:48:08.673955+0000","last_became_active":"2024-09-12T22:48:04.169474+0000","last_became_peered":"2024-09-12T22:48:04.169474+0000","last_unstale":"2024-09-12T22:48:08.673955+0000","last_undegraded":"2024-09-12T22:48:08.673955+0000","last_fullsized":"2024-09-12T22:48:08.673955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:00.271198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680660+0000","last_change":"2024-09-12T22:48:05.178510+0000","last_active":"2024-09-12T22:48:08.680660+0000","last_peered":"2024-09-12T22:48:08.680660+0000","last_clean":"2024-09-12T22:48:08.680660+0000","last_became_active":"2024-09-12T22:48:05.177910+0000","last_became_peered":"2024-09-12T22:48:05.177910+0000","last_unstale":"2024-09-12T22:48:08.680660+0000","last_undegraded":"2024-09-12T22:48:08.680660+0000","last_fullsized":"2024-09-12T22:48:08.680660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:19.398289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679405+0000","last_change":"2024-09-12T22:48:02.045525+0000","last_active":"2024-09-12T22:48:08.679405+0000","last_peered":"2024-09-12T22:48:08.679405+0000","last_clean":"2024-09-12T22:48:08.679405+0000","last_became_active":"2024-09-12T22:48:00.042207+0000","last_became_peered":"2024-09-12T22:48:00.042207+0000","last_unstale":"2024-09-12T22:48:08.679405+0000","last_undegraded":"2024-09-12T22:48:08.679405+0000","last_fullsized":"2024-09-12T22:48:08.679405+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:33.150497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040973099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673788+0000","last_change":"2024-09-12T22:48:04.167456+0000","last_active":"2024-09-12T22:48:08.673788+0000","last_peered":"2024-09-12T22:48:08.673788+0000","last_clean":"2024-09-12T22:48:08.673788+0000","last_became_active":"2024-09-12T22:48:04.166966+0000","last_became_peered":"2024-09-12T22:48:04.166966+0000","last_unstale":"2024-09-12T22:48:08.673788+0000","last_undegraded":"2024-09-12T22:48:08.673788+0000","last_fullsized":"2024-09-12T22:48:08.673788+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:13.739087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677214+0000","last_change":"2024-09-12T22:48:05.171819+0000","last_active":"2024-09-12T22:48:08.677214+0000","last_peered":"2024-09-12T22:48:08.677214+0000","last_clean":"2024-09-12T22:48:08.677214+0000","last_became_active":"2024-09-12T22:48:05.171293+0000","last_became_peered":"2024-09-12T22:48:05.171293+0000","last_unstale":"2024-09-12T22:48:08.677214+0000","last_undegraded":"2024-09-12T22:48:08.677214+0000","last_fullsized":"2024-09-12T22:48:08.677214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:01.401542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673968+0000","last_change":"2024-09-12T22:48:02.045209+0000","last_active":"2024-09-12T22:48:08.673968+0000","last_peered":"2024-09-12T22:48:08.673968+0000","last_clean":"2024-09-12T22:48:08.673968+0000","last_became_active":"2024-09-12T22:48:00.042007+0000","last_became_peered":"2024-09-12T22:48:00.042007+0000","last_unstale":"2024-09-12T22:48:08.673968+0000","last_undegraded":"2024-09-12T22:48:08.673968+0000","last_fullsized":"2024-09-12T22:48:08.673968+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:13.536542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036893100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676251+0000","last_change":"2024-09-12T22:48:04.171168+0000","last_active":"2024-09-12T22:48:08.676251+0000","last_peered":"2024-09-12T22:48:08.676251+0000","last_clean":"2024-09-12T22:48:08.676251+0000","last_became_active":"2024-09-12T22:48:04.170853+0000","last_became_peered":"2024-09-12T22:48:04.170853+0000","last_unstale":"2024-09-12T22:48:08.676251+0000","last_undegraded":"2024-09-12T22:48:08.676251+0000","last_fullsized":"2024-09-12T22:48:08.676251+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:32:37.715508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674596+0000","last_change":"2024-09-12T22:48:05.178865+0000","last_active":"2024-09-12T22:48:08.674596+0000","last_peered":"2024-09-12T22:48:08.674596+0000","last_clean":"2024-09-12T22:48:08.674596+0000","last_became_active":"2024-09-12T22:48:05.178010+0000","last_became_peered":"2024-09-12T22:48:05.178010+0000","last_unstale":"2024-09-12T22:48:08.674596+0000","last_undegraded":"2024-09-12T22:48:08.674596+0000","last_fullsized":"2024-09-12T22:48:08.674596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:30.120804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679847+0000","last_change":"2024-09-12T22:48:02.045684+0000","last_active":"2024-09-12T22:48:08.679847+0000","last_peered":"2024-09-12T22:48:08.679847+0000","last_clean":"2024-09-12T22:48:08.679847+0000","last_became_active":"2024-09-12T22:48:00.045286+0000","last_became_peered":"2024-09-12T22:48:00.045286+0000","last_unstale":"2024-09-12T22:48:08.679847+0000","last_undegraded":"2024-09-12T22:48:08.679847+0000","last_fullsized":"2024-09-12T22:48:08.679847+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:18:11.667143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052714799999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679984+0000","last_change":"2024-09-12T22:48:04.172355+0000","last_active":"2024-09-12T22:48:08.679984+0000","last_peered":"2024-09-12T22:48:08.679984+0000","last_clean":"2024-09-12T22:48:08.679984+0000","last_became_active":"2024-09-12T22:48:04.171905+0000","last_became_peered":"2024-09-12T22:48:04.171905+0000","last_unstale":"2024-09-12T22:48:08.679984+0000","last_undegraded":"2024-09-12T22:48:08.679984+0000","last_fullsized":"2024-09-12T22:48:08.679984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:35.203049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674351+0000","last_change":"2024-09-12T22:48:05.177561+0000","last_active":"2024-09-12T22:48:08.674351+0000","last_peered":"2024-09-12T22:48:08.674351+0000","last_clean":"2024-09-12T22:48:08.674351+0000","last_became_active":"2024-09-12T22:48:05.177164+0000","last_became_peered":"2024-09-12T22:48:05.177164+0000","last_unstale":"2024-09-12T22:48:08.674351+0000","last_undegraded":"2024-09-12T22:48:08.674351+0000","last_fullsized":"2024-09-12T22:48:08.674351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:24.124647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680715+0000","last_change":"2024-09-12T22:48:04.172271+0000","last_active":"2024-09-12T22:48:08.680715+0000","last_peered":"2024-09-12T22:48:08.680715+0000","last_clean":"2024-09-12T22:48:08.680715+0000","last_became_active":"2024-09-12T22:48:04.171739+0000","last_became_peered":"2024-09-12T22:48:04.171739+0000","last_unstale":"2024-09-12T22:48:08.680715+0000","last_undegraded":"2024-09-12T22:48:08.680715+0000","last_fullsized":"2024-09-12T22:48:08.680715+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:56.929490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674540+0000","last_change":"2024-09-12T22:48:02.045324+0000","last_active":"2024-09-12T22:48:08.674540+0000","last_peered":"2024-09-12T22:48:08.674540+0000","last_clean":"2024-09-12T22:48:08.674540+0000","last_became_active":"2024-09-12T22:48:00.042132+0000","last_became_peered":"2024-09-12T22:48:00.042132+0000","last_unstale":"2024-09-12T22:48:08.674540+0000","last_undegraded":"2024-09-12T22:48:08.674540+0000","last_fullsized":"2024-09-12T22:48:08.674540+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:24.673019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047590600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676518+0000","last_change":"2024-09-12T22:48:05.175609+0000","last_active":"2024-09-12T22:48:08.676518+0000","last_peered":"2024-09-12T22:48:08.676518+0000","last_clean":"2024-09-12T22:48:08.676518+0000","last_became_active":"2024-09-12T22:48:05.175167+0000","last_became_peered":"2024-09-12T22:48:05.175167+0000","last_unstale":"2024-09-12T22:48:08.676518+0000","last_undegraded":"2024-09-12T22:48:08.676518+0000","last_fullsized":"2024-09-12T22:48:08.676518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:11.248179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674322+0000","last_change":"2024-09-12T22:48:04.169109+0000","last_active":"2024-09-12T22:48:08.674322+0000","last_peered":"2024-09-12T22:48:08.674322+0000","last_clean":"2024-09-12T22:48:08.674322+0000","last_became_active":"2024-09-12T22:48:04.168655+0000","last_became_peered":"2024-09-12T22:48:04.168655+0000","last_unstale":"2024-09-12T22:48:08.674322+0000","last_undegraded":"2024-09-12T22:48:08.674322+0000","last_fullsized":"2024-09-12T22:48:08.674322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:02.879935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677463+0000","last_change":"2024-09-12T22:48:02.045390+0000","last_active":"2024-09-12T22:48:08.677463+0000","last_peered":"2024-09-12T22:48:08.677463+0000","last_clean":"2024-09-12T22:48:08.677463+0000","last_became_active":"2024-09-12T22:48:00.045356+0000","last_became_peered":"2024-09-12T22:48:00.045356+0000","last_unstale":"2024-09-12T22:48:08.677463+0000","last_undegraded":"2024-09-12T22:48:08.677463+0000","last_fullsized":"2024-09-12T22:48:08.677463+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:32.072080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040621599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676614+0000","last_change":"2024-09-12T22:48:05.171131+0000","last_active":"2024-09-12T22:48:08.676614+0000","last_peered":"2024-09-12T22:48:08.676614+0000","last_clean":"2024-09-12T22:48:08.676614+0000","last_became_active":"2024-09-12T22:48:05.170591+0000","last_became_peered":"2024-09-12T22:48:05.170591+0000","last_unstale":"2024-09-12T22:48:08.676614+0000","last_undegraded":"2024-09-12T22:48:08.676614+0000","last_fullsized":"2024-09-12T22:48:08.676614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:11.781766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674783+0000","last_change":"2024-09-12T22:48:04.168635+0000","last_active":"2024-09-12T22:48:08.674783+0000","last_peered":"2024-09-12T22:48:08.674783+0000","last_clean":"2024-09-12T22:48:08.674783+0000","last_became_active":"2024-09-12T22:48:04.168244+0000","last_became_peered":"2024-09-12T22:48:04.168244+0000","last_unstale":"2024-09-12T22:48:08.674783+0000","last_undegraded":"2024-09-12T22:48:08.674783+0000","last_fullsized":"2024-09-12T22:48:08.674783+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:56.929490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674718+0000","last_change":"2024-09-12T22:48:02.045428+0000","last_active":"2024-09-12T22:48:08.674718+0000","last_peered":"2024-09-12T22:48:08.674718+0000","last_clean":"2024-09-12T22:48:08.674718+0000","last_became_active":"2024-09-12T22:48:00.040536+0000","last_became_peered":"2024-09-12T22:48:00.040536+0000","last_unstale":"2024-09-12T22:48:08.674718+0000","last_undegraded":"2024-09-12T22:48:08.674718+0000","last_fullsized":"2024-09-12T22:48:08.674718+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:33.150497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057699499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673721+0000","last_change":"2024-09-12T22:48:05.170571+0000","last_active":"2024-09-12T22:48:08.673721+0000","last_peered":"2024-09-12T22:48:08.673721+0000","last_clean":"2024-09-12T22:48:08.673721+0000","last_became_active":"2024-09-12T22:48:05.170087+0000","last_became_peered":"2024-09-12T22:48:05.170087+0000","last_unstale":"2024-09-12T22:48:08.673721+0000","last_undegraded":"2024-09-12T22:48:08.673721+0000","last_fullsized":"2024-09-12T22:48:08.673721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:28.873036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674650+0000","last_change":"2024-09-12T22:48:04.166369+0000","last_active":"2024-09-12T22:48:08.674650+0000","last_peered":"2024-09-12T22:48:08.674650+0000","last_clean":"2024-09-12T22:48:08.674650+0000","last_became_active":"2024-09-12T22:48:04.165966+0000","last_became_peered":"2024-09-12T22:48:04.165966+0000","last_unstale":"2024-09-12T22:48:08.674650+0000","last_undegraded":"2024-09-12T22:48:08.674650+0000","last_fullsized":"2024-09-12T22:48:08.674650+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:40:29.366846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680266+0000","last_change":"2024-09-12T22:48:02.045500+0000","last_active":"2024-09-12T22:48:08.680266+0000","last_peered":"2024-09-12T22:48:08.680266+0000","last_clean":"2024-09-12T22:48:08.680266+0000","last_became_active":"2024-09-12T22:48:00.042210+0000","last_became_peered":"2024-09-12T22:48:00.042210+0000","last_unstale":"2024-09-12T22:48:08.680266+0000","last_undegraded":"2024-09-12T22:48:08.680266+0000","last_fullsized":"2024-09-12T22:48:08.680266+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:35:14.212372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035339799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676300+0000","last_change":"2024-09-12T22:48:05.170712+0000","last_active":"2024-09-12T22:48:08.676300+0000","last_peered":"2024-09-12T22:48:08.676300+0000","last_clean":"2024-09-12T22:48:08.676300+0000","last_became_active":"2024-09-12T22:48:05.169840+0000","last_became_peered":"2024-09-12T22:48:05.169840+0000","last_unstale":"2024-09-12T22:48:08.676300+0000","last_undegraded":"2024-09-12T22:48:08.676300+0000","last_fullsized":"2024-09-12T22:48:08.676300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:24.240533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679770+0000","last_change":"2024-09-12T22:48:05.168203+0000","last_active":"2024-09-12T22:48:08.679770+0000","last_peered":"2024-09-12T22:48:08.679770+0000","last_clean":"2024-09-12T22:48:08.679770+0000","last_became_active":"2024-09-12T22:48:05.167870+0000","last_became_peered":"2024-09-12T22:48:05.167870+0000","last_unstale":"2024-09-12T22:48:08.679770+0000","last_undegraded":"2024-09-12T22:48:08.679770+0000","last_fullsized":"2024-09-12T22:48:08.679770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:45.140060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680214+0000","last_change":"2024-09-12T22:48:04.173355+0000","last_active":"2024-09-12T22:48:08.680214+0000","last_peered":"2024-09-12T22:48:08.680214+0000","last_clean":"2024-09-12T22:48:08.680214+0000","last_became_active":"2024-09-12T22:48:04.173031+0000","last_became_peered":"2024-09-12T22:48:04.173031+0000","last_unstale":"2024-09-12T22:48:08.680214+0000","last_undegraded":"2024-09-12T22:48:08.680214+0000","last_fullsized":"2024-09-12T22:48:08.680214+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:02.879935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673651+0000","last_change":"2024-09-12T22:48:05.176779+0000","last_active":"2024-09-12T22:48:08.673651+0000","last_peered":"2024-09-12T22:48:08.673651+0000","last_clean":"2024-09-12T22:48:08.673651+0000","last_became_active":"2024-09-12T22:48:05.176344+0000","last_became_peered":"2024-09-12T22:48:05.176344+0000","last_unstale":"2024-09-12T22:48:08.673651+0000","last_undegraded":"2024-09-12T22:48:08.673651+0000","last_fullsized":"2024-09-12T22:48:08.673651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:35.645286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677280+0000","last_change":"2024-09-12T22:48:04.171169+0000","last_active":"2024-09-12T22:48:08.677280+0000","last_peered":"2024-09-12T22:48:08.677280+0000","last_clean":"2024-09-12T22:48:08.677280+0000","last_became_active":"2024-09-12T22:48:04.170812+0000","last_became_peered":"2024-09-12T22:48:04.170812+0000","last_unstale":"2024-09-12T22:48:08.677280+0000","last_undegraded":"2024-09-12T22:48:08.677280+0000","last_fullsized":"2024-09-12T22:48:08.677280+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:05:58.510137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680378+0000","last_change":"2024-09-12T22:48:04.172325+0000","last_active":"2024-09-12T22:48:08.680378+0000","last_peered":"2024-09-12T22:48:08.680378+0000","last_clean":"2024-09-12T22:48:08.680378+0000","last_became_active":"2024-09-12T22:48:04.171855+0000","last_became_peered":"2024-09-12T22:48:04.171855+0000","last_unstale":"2024-09-12T22:48:08.680378+0000","last_undegraded":"2024-09-12T22:48:08.680378+0000","last_fullsized":"2024-09-12T22:48:08.680378+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:43.709660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673612+0000","last_change":"2024-09-12T22:48:05.177309+0000","last_active":"2024-09-12T22:48:08.673612+0000","last_peered":"2024-09-12T22:48:08.673612+0000","last_clean":"2024-09-12T22:48:08.673612+0000","last_became_active":"2024-09-12T22:48:05.176412+0000","last_became_peered":"2024-09-12T22:48:05.176412+0000","last_unstale":"2024-09-12T22:48:08.673612+0000","last_undegraded":"2024-09-12T22:48:08.673612+0000","last_fullsized":"2024-09-12T22:48:08.673612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:27:07.558853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674712+0000","last_change":"2024-09-12T22:48:04.166500+0000","last_active":"2024-09-12T22:48:08.674712+0000","last_peered":"2024-09-12T22:48:08.674712+0000","last_clean":"2024-09-12T22:48:08.674712+0000","last_became_active":"2024-09-12T22:48:04.165926+0000","last_became_peered":"2024-09-12T22:48:04.165926+0000","last_unstale":"2024-09-12T22:48:08.674712+0000","last_undegraded":"2024-09-12T22:48:08.674712+0000","last_fullsized":"2024-09-12T22:48:08.674712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:42:33.314407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673624+0000","last_change":"2024-09-12T22:48:05.169648+0000","last_active":"2024-09-12T22:48:08.673624+0000","last_peered":"2024-09-12T22:48:08.673624+0000","last_clean":"2024-09-12T22:48:08.673624+0000","last_became_active":"2024-09-12T22:48:05.168356+0000","last_became_peered":"2024-09-12T22:48:05.168356+0000","last_unstale":"2024-09-12T22:48:08.673624+0000","last_undegraded":"2024-09-12T22:48:08.673624+0000","last_fullsized":"2024-09-12T22:48:08.673624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:52.341512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677376+0000","last_change":"2024-09-12T22:48:05.173822+0000","last_active":"2024-09-12T22:48:08.677376+0000","last_peered":"2024-09-12T22:48:08.677376+0000","last_clean":"2024-09-12T22:48:08.677376+0000","last_became_active":"2024-09-12T22:48:05.172473+0000","last_became_peered":"2024-09-12T22:48:05.172473+0000","last_unstale":"2024-09-12T22:48:08.677376+0000","last_undegraded":"2024-09-12T22:48:08.677376+0000","last_fullsized":"2024-09-12T22:48:08.677376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:32.288419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673686+0000","last_change":"2024-09-12T22:48:04.169111+0000","last_active":"2024-09-12T22:48:08.673686+0000","last_peered":"2024-09-12T22:48:08.673686+0000","last_clean":"2024-09-12T22:48:08.673686+0000","last_became_active":"2024-09-12T22:48:04.168743+0000","last_became_peered":"2024-09-12T22:48:04.168743+0000","last_unstale":"2024-09-12T22:48:08.673686+0000","last_undegraded":"2024-09-12T22:48:08.673686+0000","last_fullsized":"2024-09-12T22:48:08.673686+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:43.709660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674438+0000","last_change":"2024-09-12T22:48:05.175474+0000","last_active":"2024-09-12T22:48:08.674438+0000","last_peered":"2024-09-12T22:48:08.674438+0000","last_clean":"2024-09-12T22:48:08.674438+0000","last_became_active":"2024-09-12T22:48:05.175220+0000","last_became_peered":"2024-09-12T22:48:05.175220+0000","last_unstale":"2024-09-12T22:48:08.674438+0000","last_undegraded":"2024-09-12T22:48:08.674438+0000","last_fullsized":"2024-09-12T22:48:08.674438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:56.158813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673708+0000","last_change":"2024-09-12T22:48:04.165725+0000","last_active":"2024-09-12T22:48:08.673708+0000","last_peered":"2024-09-12T22:48:08.673708+0000","last_clean":"2024-09-12T22:48:08.673708+0000","last_became_active":"2024-09-12T22:48:04.165419+0000","last_became_peered":"2024-09-12T22:48:04.165419+0000","last_unstale":"2024-09-12T22:48:08.673708+0000","last_undegraded":"2024-09-12T22:48:08.673708+0000","last_fullsized":"2024-09-12T22:48:08.673708+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:35:01.771536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677045+0000","last_change":"2024-09-12T22:48:05.174920+0000","last_active":"2024-09-12T22:48:08.677045+0000","last_peered":"2024-09-12T22:48:08.677045+0000","last_clean":"2024-09-12T22:48:08.677045+0000","last_became_active":"2024-09-12T22:48:05.173785+0000","last_became_peered":"2024-09-12T22:48:05.173785+0000","last_unstale":"2024-09-12T22:48:08.677045+0000","last_undegraded":"2024-09-12T22:48:08.677045+0000","last_fullsized":"2024-09-12T22:48:08.677045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:24.124647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676684+0000","last_change":"2024-09-12T22:48:04.174205+0000","last_active":"2024-09-12T22:48:08.676684+0000","last_peered":"2024-09-12T22:48:08.676684+0000","last_clean":"2024-09-12T22:48:08.676684+0000","last_became_active":"2024-09-12T22:48:04.173902+0000","last_became_peered":"2024-09-12T22:48:04.173902+0000","last_unstale":"2024-09-12T22:48:08.676684+0000","last_undegraded":"2024-09-12T22:48:08.676684+0000","last_fullsized":"2024-09-12T22:48:08.676684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:43:39.709214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676806+0000","last_change":"2024-09-12T22:48:05.172917+0000","last_active":"2024-09-12T22:48:08.676806+0000","last_peered":"2024-09-12T22:48:08.676806+0000","last_clean":"2024-09-12T22:48:08.676806+0000","last_became_active":"2024-09-12T22:48:05.172493+0000","last_became_peered":"2024-09-12T22:48:05.172493+0000","last_unstale":"2024-09-12T22:48:08.676806+0000","last_undegraded":"2024-09-12T22:48:08.676806+0000","last_fullsized":"2024-09-12T22:48:08.676806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:35.645286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676666+0000","last_change":"2024-09-12T22:48:04.175808+0000","last_active":"2024-09-12T22:48:08.676666+0000","last_peered":"2024-09-12T22:48:08.676666+0000","last_clean":"2024-09-12T22:48:08.676666+0000","last_became_active":"2024-09-12T22:48:04.175601+0000","last_became_peered":"2024-09-12T22:48:04.175601+0000","last_unstale":"2024-09-12T22:48:08.676666+0000","last_undegraded":"2024-09-12T22:48:08.676666+0000","last_fullsized":"2024-09-12T22:48:08.676666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:19.369251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679733+0000","last_change":"2024-09-12T22:48:05.173989+0000","last_active":"2024-09-12T22:48:08.679733+0000","last_peered":"2024-09-12T22:48:08.679733+0000","last_clean":"2024-09-12T22:48:08.679733+0000","last_became_active":"2024-09-12T22:48:05.172076+0000","last_became_peered":"2024-09-12T22:48:05.172076+0000","last_unstale":"2024-09-12T22:48:08.679733+0000","last_undegraded":"2024-09-12T22:48:08.679733+0000","last_fullsized":"2024-09-12T22:48:08.679733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:51.360504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680072+0000","last_change":"2024-09-12T22:48:04.171884+0000","last_active":"2024-09-12T22:48:08.680072+0000","last_peered":"2024-09-12T22:48:08.680072+0000","last_clean":"2024-09-12T22:48:08.680072+0000","last_became_active":"2024-09-12T22:48:04.171480+0000","last_became_peered":"2024-09-12T22:48:04.171480+0000","last_unstale":"2024-09-12T22:48:08.680072+0000","last_undegraded":"2024-09-12T22:48:08.680072+0000","last_fullsized":"2024-09-12T22:48:08.680072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:56.377664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679739+0000","last_change":"2024-09-12T22:48:05.173551+0000","last_active":"2024-09-12T22:48:08.679739+0000","last_peered":"2024-09-12T22:48:08.679739+0000","last_clean":"2024-09-12T22:48:08.679739+0000","last_became_active":"2024-09-12T22:48:05.172983+0000","last_became_peered":"2024-09-12T22:48:05.172983+0000","last_unstale":"2024-09-12T22:48:08.679739+0000","last_undegraded":"2024-09-12T22:48:08.679739+0000","last_fullsized":"2024-09-12T22:48:08.679739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:22.753741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677213+0000","last_change":"2024-09-12T22:48:04.167853+0000","last_active":"2024-09-12T22:48:08.677213+0000","last_peered":"2024-09-12T22:48:08.677213+0000","last_clean":"2024-09-12T22:48:08.677213+0000","last_became_active":"2024-09-12T22:48:04.167408+0000","last_became_peered":"2024-09-12T22:48:04.167408+0000","last_unstale":"2024-09-12T22:48:08.677213+0000","last_undegraded":"2024-09-12T22:48:08.677213+0000","last_fullsized":"2024-09-12T22:48:08.677213+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:32.031432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676789+0000","last_change":"2024-09-12T22:48:05.171815+0000","last_active":"2024-09-12T22:48:08.676789+0000","last_peered":"2024-09-12T22:48:08.676789+0000","last_clean":"2024-09-12T22:48:08.676789+0000","last_became_active":"2024-09-12T22:48:05.171361+0000","last_became_peered":"2024-09-12T22:48:05.171361+0000","last_unstale":"2024-09-12T22:48:08.676789+0000","last_undegraded":"2024-09-12T22:48:08.676789+0000","last_fullsized":"2024-09-12T22:48:08.676789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:28.873036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674540+0000","last_change":"2024-09-12T22:48:04.169500+0000","last_active":"2024-09-12T22:48:08.674540+0000","last_peered":"2024-09-12T22:48:08.674540+0000","last_clean":"2024-09-12T22:48:08.674540+0000","last_became_active":"2024-09-12T22:48:04.169087+0000","last_became_peered":"2024-09-12T22:48:04.169087+0000","last_unstale":"2024-09-12T22:48:08.674540+0000","last_undegraded":"2024-09-12T22:48:08.674540+0000","last_fullsized":"2024-09-12T22:48:08.674540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:56.377664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679335+0000","last_change":"2024-09-12T22:48:05.174947+0000","last_active":"2024-09-12T22:48:08.679335+0000","last_peered":"2024-09-12T22:48:08.679335+0000","last_clean":"2024-09-12T22:48:08.679335+0000","last_became_active":"2024-09-12T22:48:05.174503+0000","last_became_peered":"2024-09-12T22:48:05.174503+0000","last_unstale":"2024-09-12T22:48:08.679335+0000","last_undegraded":"2024-09-12T22:48:08.679335+0000","last_fullsized":"2024-09-12T22:48:08.679335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:01.401542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674557+0000","last_change":"2024-09-12T22:48:04.166198+0000","last_active":"2024-09-12T22:48:08.674557+0000","last_peered":"2024-09-12T22:48:08.674557+0000","last_clean":"2024-09-12T22:48:08.674557+0000","last_became_active":"2024-09-12T22:48:04.165795+0000","last_became_peered":"2024-09-12T22:48:04.165795+0000","last_unstale":"2024-09-12T22:48:08.674557+0000","last_undegraded":"2024-09-12T22:48:08.674557+0000","last_fullsized":"2024-09-12T22:48:08.674557+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:35.203049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":802816,"data_stored":656071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":63909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":655436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:48:20.607 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:48:20.937 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:48:20.939 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-09-12T22:48:20.948 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-09-12T22:48:20.130274+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86984,"kb_used_data":1736,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283028536,"statfs":{"total":289910292480,"available":289821220864,"internally_reserved":0,"allocated":1777664,"data_stored":1375416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.458549"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677255+0000","last_change":"2024-09-12T22:48:05.174190+0000","last_active":"2024-09-12T22:48:08.677255+0000","last_peered":"2024-09-12T22:48:08.677255+0000","last_clean":"2024-09-12T22:48:08.677255+0000","last_became_active":"2024-09-12T22:48:05.172964+0000","last_became_peered":"2024-09-12T22:48:05.172964+0000","last_unstale":"2024-09-12T22:48:08.677255+0000","last_undegraded":"2024-09-12T22:48:08.677255+0000","last_fullsized":"2024-09-12T22:48:08.677255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:49.868891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676980+0000","last_change":"2024-09-12T22:48:05.173045+0000","last_active":"2024-09-12T22:48:08.676980+0000","last_peered":"2024-09-12T22:48:08.676980+0000","last_clean":"2024-09-12T22:48:08.676980+0000","last_became_active":"2024-09-12T22:48:05.172684+0000","last_became_peered":"2024-09-12T22:48:05.172684+0000","last_unstale":"2024-09-12T22:48:08.676980+0000","last_undegraded":"2024-09-12T22:48:08.676980+0000","last_fullsized":"2024-09-12T22:48:08.676980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:51.360504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679907+0000","last_change":"2024-09-12T22:48:05.178267+0000","last_active":"2024-09-12T22:48:08.679907+0000","last_peered":"2024-09-12T22:48:08.679907+0000","last_clean":"2024-09-12T22:48:08.679907+0000","last_became_active":"2024-09-12T22:48:05.177555+0000","last_became_peered":"2024-09-12T22:48:05.177555+0000","last_unstale":"2024-09-12T22:48:08.679907+0000","last_undegraded":"2024-09-12T22:48:08.679907+0000","last_fullsized":"2024-09-12T22:48:08.679907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:58.991752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679782+0000","last_change":"2024-09-12T22:48:05.173539+0000","last_active":"2024-09-12T22:48:08.679782+0000","last_peered":"2024-09-12T22:48:08.679782+0000","last_clean":"2024-09-12T22:48:08.679782+0000","last_became_active":"2024-09-12T22:48:05.172647+0000","last_became_peered":"2024-09-12T22:48:05.172647+0000","last_unstale":"2024-09-12T22:48:08.679782+0000","last_undegraded":"2024-09-12T22:48:08.679782+0000","last_fullsized":"2024-09-12T22:48:08.679782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:56:34.490182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676660+0000","last_change":"2024-09-12T22:48:05.170306+0000","last_active":"2024-09-12T22:48:08.676660+0000","last_peered":"2024-09-12T22:48:08.676660+0000","last_clean":"2024-09-12T22:48:08.676660+0000","last_became_active":"2024-09-12T22:48:05.169940+0000","last_became_peered":"2024-09-12T22:48:05.169940+0000","last_unstale":"2024-09-12T22:48:08.676660+0000","last_undegraded":"2024-09-12T22:48:08.676660+0000","last_fullsized":"2024-09-12T22:48:08.676660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:52.341512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679410+0000","last_change":"2024-09-12T22:48:05.173232+0000","last_active":"2024-09-12T22:48:08.679410+0000","last_peered":"2024-09-12T22:48:08.679410+0000","last_clean":"2024-09-12T22:48:08.679410+0000","last_became_active":"2024-09-12T22:48:05.172213+0000","last_became_peered":"2024-09-12T22:48:05.172213+0000","last_unstale":"2024-09-12T22:48:08.679410+0000","last_undegraded":"2024-09-12T22:48:08.679410+0000","last_fullsized":"2024-09-12T22:48:08.679410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:25.994320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679563+0000","last_change":"2024-09-12T22:48:05.172187+0000","last_active":"2024-09-12T22:48:08.679563+0000","last_peered":"2024-09-12T22:48:08.679563+0000","last_clean":"2024-09-12T22:48:08.679563+0000","last_became_active":"2024-09-12T22:48:05.171766+0000","last_became_peered":"2024-09-12T22:48:05.171766+0000","last_unstale":"2024-09-12T22:48:08.679563+0000","last_undegraded":"2024-09-12T22:48:08.679563+0000","last_fullsized":"2024-09-12T22:48:08.679563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:49.868891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679126+0000","last_change":"2024-09-12T22:48:05.174326+0000","last_active":"2024-09-12T22:48:08.679126+0000","last_peered":"2024-09-12T22:48:08.679126+0000","last_clean":"2024-09-12T22:48:08.679126+0000","last_became_active":"2024-09-12T22:48:05.172312+0000","last_became_peered":"2024-09-12T22:48:05.172312+0000","last_unstale":"2024-09-12T22:48:08.679126+0000","last_undegraded":"2024-09-12T22:48:08.679126+0000","last_fullsized":"2024-09-12T22:48:08.679126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:52.071513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674344+0000","last_change":"2024-09-12T22:48:05.178445+0000","last_active":"2024-09-12T22:48:08.674344+0000","last_peered":"2024-09-12T22:48:08.674344+0000","last_clean":"2024-09-12T22:48:08.674344+0000","last_became_active":"2024-09-12T22:48:05.177284+0000","last_became_peered":"2024-09-12T22:48:05.177284+0000","last_unstale":"2024-09-12T22:48:08.674344+0000","last_undegraded":"2024-09-12T22:48:08.674344+0000","last_fullsized":"2024-09-12T22:48:08.674344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:45.140060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677090+0000","last_change":"2024-09-12T22:48:05.172480+0000","last_active":"2024-09-12T22:48:08.677090+0000","last_peered":"2024-09-12T22:48:08.677090+0000","last_clean":"2024-09-12T22:48:08.677090+0000","last_became_active":"2024-09-12T22:48:05.171686+0000","last_became_peered":"2024-09-12T22:48:05.171686+0000","last_unstale":"2024-09-12T22:48:08.677090+0000","last_undegraded":"2024-09-12T22:48:08.677090+0000","last_fullsized":"2024-09-12T22:48:08.677090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:56.158813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680327+0000","last_change":"2024-09-12T22:48:05.172837+0000","last_active":"2024-09-12T22:48:08.680327+0000","last_peered":"2024-09-12T22:48:08.680327+0000","last_clean":"2024-09-12T22:48:08.680327+0000","last_became_active":"2024-09-12T22:48:05.171890+0000","last_became_peered":"2024-09-12T22:48:05.171890+0000","last_unstale":"2024-09-12T22:48:08.680327+0000","last_undegraded":"2024-09-12T22:48:08.680327+0000","last_fullsized":"2024-09-12T22:48:08.680327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:46.965030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676812+0000","last_change":"2024-09-12T22:48:05.175666+0000","last_active":"2024-09-12T22:48:08.676812+0000","last_peered":"2024-09-12T22:48:08.676812+0000","last_clean":"2024-09-12T22:48:08.676812+0000","last_became_active":"2024-09-12T22:48:05.175390+0000","last_became_peered":"2024-09-12T22:48:05.175390+0000","last_unstale":"2024-09-12T22:48:08.676812+0000","last_undegraded":"2024-09-12T22:48:08.676812+0000","last_fullsized":"2024-09-12T22:48:08.676812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:13.160164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676555+0000","last_change":"2024-09-12T22:48:05.171356+0000","last_active":"2024-09-12T22:48:08.676555+0000","last_peered":"2024-09-12T22:48:08.676555+0000","last_clean":"2024-09-12T22:48:08.676555+0000","last_became_active":"2024-09-12T22:48:05.170794+0000","last_became_peered":"2024-09-12T22:48:05.170794+0000","last_unstale":"2024-09-12T22:48:08.676555+0000","last_undegraded":"2024-09-12T22:48:08.676555+0000","last_fullsized":"2024-09-12T22:48:08.676555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:42:56.969660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679530+0000","last_change":"2024-09-12T22:48:05.168780+0000","last_active":"2024-09-12T22:48:08.679530+0000","last_peered":"2024-09-12T22:48:08.679530+0000","last_clean":"2024-09-12T22:48:08.679530+0000","last_became_active":"2024-09-12T22:48:05.168294+0000","last_became_peered":"2024-09-12T22:48:05.168294+0000","last_unstale":"2024-09-12T22:48:08.679530+0000","last_undegraded":"2024-09-12T22:48:08.679530+0000","last_fullsized":"2024-09-12T22:48:08.679530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:30.120804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679600+0000","last_change":"2024-09-12T22:48:05.168344+0000","last_active":"2024-09-12T22:48:08.679600+0000","last_peered":"2024-09-12T22:48:08.679600+0000","last_clean":"2024-09-12T22:48:08.679600+0000","last_became_active":"2024-09-12T22:48:05.167805+0000","last_became_peered":"2024-09-12T22:48:05.167805+0000","last_unstale":"2024-09-12T22:48:08.679600+0000","last_undegraded":"2024-09-12T22:48:08.679600+0000","last_fullsized":"2024-09-12T22:48:08.679600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:32.288419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679162+0000","last_change":"2024-09-12T22:48:05.174663+0000","last_active":"2024-09-12T22:48:08.679162+0000","last_peered":"2024-09-12T22:48:08.679162+0000","last_clean":"2024-09-12T22:48:08.679162+0000","last_became_active":"2024-09-12T22:48:05.173101+0000","last_became_peered":"2024-09-12T22:48:05.173101+0000","last_unstale":"2024-09-12T22:48:08.679162+0000","last_undegraded":"2024-09-12T22:48:08.679162+0000","last_fullsized":"2024-09-12T22:48:08.679162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:25.143572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674747+0000","last_change":"2024-09-12T22:48:05.178721+0000","last_active":"2024-09-12T22:48:08.674747+0000","last_peered":"2024-09-12T22:48:08.674747+0000","last_clean":"2024-09-12T22:48:08.674747+0000","last_became_active":"2024-09-12T22:48:05.177965+0000","last_became_peered":"2024-09-12T22:48:05.177965+0000","last_unstale":"2024-09-12T22:48:08.674747+0000","last_undegraded":"2024-09-12T22:48:08.674747+0000","last_fullsized":"2024-09-12T22:48:08.674747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:32.288419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677222+0000","last_change":"2024-09-12T22:48:05.171053+0000","last_active":"2024-09-12T22:48:08.677222+0000","last_peered":"2024-09-12T22:48:08.677222+0000","last_clean":"2024-09-12T22:48:08.677222+0000","last_became_active":"2024-09-12T22:48:05.170578+0000","last_became_peered":"2024-09-12T22:48:05.170578+0000","last_unstale":"2024-09-12T22:48:08.677222+0000","last_undegraded":"2024-09-12T22:48:08.677222+0000","last_fullsized":"2024-09-12T22:48:08.677222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:58.991752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674239+0000","last_change":"2024-09-12T22:48:05.177369+0000","last_active":"2024-09-12T22:48:08.674239+0000","last_peered":"2024-09-12T22:48:08.674239+0000","last_clean":"2024-09-12T22:48:08.674239+0000","last_became_active":"2024-09-12T22:48:05.176680+0000","last_became_peered":"2024-09-12T22:48:05.176680+0000","last_unstale":"2024-09-12T22:48:08.674239+0000","last_undegraded":"2024-09-12T22:48:08.674239+0000","last_fullsized":"2024-09-12T22:48:08.674239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:25.143572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680241+0000","last_change":"2024-09-12T22:48:05.173232+0000","last_active":"2024-09-12T22:48:08.680241+0000","last_peered":"2024-09-12T22:48:08.680241+0000","last_clean":"2024-09-12T22:48:08.680241+0000","last_became_active":"2024-09-12T22:48:05.172382+0000","last_became_peered":"2024-09-12T22:48:05.172382+0000","last_unstale":"2024-09-12T22:48:08.680241+0000","last_undegraded":"2024-09-12T22:48:08.680241+0000","last_fullsized":"2024-09-12T22:48:08.680241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:28.083344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679924+0000","last_change":"2024-09-12T22:48:05.174799+0000","last_active":"2024-09-12T22:48:08.679924+0000","last_peered":"2024-09-12T22:48:08.679924+0000","last_clean":"2024-09-12T22:48:08.679924+0000","last_became_active":"2024-09-12T22:48:05.174423+0000","last_became_peered":"2024-09-12T22:48:05.174423+0000","last_unstale":"2024-09-12T22:48:08.679924+0000","last_undegraded":"2024-09-12T22:48:08.679924+0000","last_fullsized":"2024-09-12T22:48:08.679924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:56.158813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676495+0000","last_change":"2024-09-12T22:48:05.175363+0000","last_active":"2024-09-12T22:48:08.676495+0000","last_peered":"2024-09-12T22:48:08.676495+0000","last_clean":"2024-09-12T22:48:08.676495+0000","last_became_active":"2024-09-12T22:48:05.174832+0000","last_became_peered":"2024-09-12T22:48:05.174832+0000","last_unstale":"2024-09-12T22:48:08.676495+0000","last_undegraded":"2024-09-12T22:48:08.676495+0000","last_fullsized":"2024-09-12T22:48:08.676495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:25.994320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673471+0000","last_change":"2024-09-12T22:48:05.169838+0000","last_active":"2024-09-12T22:48:08.673471+0000","last_peered":"2024-09-12T22:48:08.673471+0000","last_clean":"2024-09-12T22:48:08.673471+0000","last_became_active":"2024-09-12T22:48:05.169462+0000","last_became_peered":"2024-09-12T22:48:05.169462+0000","last_unstale":"2024-09-12T22:48:08.673471+0000","last_undegraded":"2024-09-12T22:48:08.673471+0000","last_fullsized":"2024-09-12T22:48:08.673471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:42:56.969660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676149+0000","last_change":"2024-09-12T22:48:05.172794+0000","last_active":"2024-09-12T22:48:08.676149+0000","last_peered":"2024-09-12T22:48:08.676149+0000","last_clean":"2024-09-12T22:48:08.676149+0000","last_became_active":"2024-09-12T22:48:05.172437+0000","last_became_peered":"2024-09-12T22:48:05.172437+0000","last_unstale":"2024-09-12T22:48:08.676149+0000","last_undegraded":"2024-09-12T22:48:08.676149+0000","last_fullsized":"2024-09-12T22:48:08.676149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:54:44.278646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677275+0000","last_change":"2024-09-12T22:48:05.173714+0000","last_active":"2024-09-12T22:48:08.677275+0000","last_peered":"2024-09-12T22:48:08.677275+0000","last_clean":"2024-09-12T22:48:08.677275+0000","last_became_active":"2024-09-12T22:48:05.172938+0000","last_became_peered":"2024-09-12T22:48:05.172938+0000","last_unstale":"2024-09-12T22:48:08.677275+0000","last_undegraded":"2024-09-12T22:48:08.677275+0000","last_fullsized":"2024-09-12T22:48:08.677275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:30.120804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674352+0000","last_change":"2024-09-12T22:48:05.177862+0000","last_active":"2024-09-12T22:48:08.674352+0000","last_peered":"2024-09-12T22:48:08.674352+0000","last_clean":"2024-09-12T22:48:08.674352+0000","last_became_active":"2024-09-12T22:48:05.177545+0000","last_became_peered":"2024-09-12T22:48:05.177545+0000","last_unstale":"2024-09-12T22:48:08.674352+0000","last_undegraded":"2024-09-12T22:48:08.674352+0000","last_fullsized":"2024-09-12T22:48:08.674352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:25.994320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680458+0000","last_change":"2024-09-12T22:48:05.178249+0000","last_active":"2024-09-12T22:48:08.680458+0000","last_peered":"2024-09-12T22:48:08.680458+0000","last_clean":"2024-09-12T22:48:08.680458+0000","last_became_active":"2024-09-12T22:48:05.177582+0000","last_became_peered":"2024-09-12T22:48:05.177582+0000","last_unstale":"2024-09-12T22:48:08.680458+0000","last_undegraded":"2024-09-12T22:48:08.680458+0000","last_fullsized":"2024-09-12T22:48:08.680458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:25.556218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677103+0000","last_change":"2024-09-12T22:48:05.171326+0000","last_active":"2024-09-12T22:48:08.677103+0000","last_peered":"2024-09-12T22:48:08.677103+0000","last_clean":"2024-09-12T22:48:08.677103+0000","last_became_active":"2024-09-12T22:48:05.170491+0000","last_became_peered":"2024-09-12T22:48:05.170491+0000","last_unstale":"2024-09-12T22:48:08.677103+0000","last_undegraded":"2024-09-12T22:48:08.677103+0000","last_fullsized":"2024-09-12T22:48:08.677103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:52.071513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674052+0000","last_change":"2024-09-12T22:48:05.177176+0000","last_active":"2024-09-12T22:48:08.674052+0000","last_peered":"2024-09-12T22:48:08.674052+0000","last_clean":"2024-09-12T22:48:08.674052+0000","last_became_active":"2024-09-12T22:48:05.176735+0000","last_became_peered":"2024-09-12T22:48:05.176735+0000","last_unstale":"2024-09-12T22:48:08.674052+0000","last_undegraded":"2024-09-12T22:48:08.674052+0000","last_fullsized":"2024-09-12T22:48:08.674052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:51.360504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676676+0000","last_change":"2024-09-12T22:48:05.171180+0000","last_active":"2024-09-12T22:48:08.676676+0000","last_peered":"2024-09-12T22:48:08.676676+0000","last_clean":"2024-09-12T22:48:08.676676+0000","last_became_active":"2024-09-12T22:48:05.170263+0000","last_became_peered":"2024-09-12T22:48:05.170263+0000","last_unstale":"2024-09-12T22:48:08.676676+0000","last_undegraded":"2024-09-12T22:48:08.676676+0000","last_fullsized":"2024-09-12T22:48:08.676676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:25.143572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673611+0000","last_change":"2024-09-12T22:48:05.176878+0000","last_active":"2024-09-12T22:48:08.673611+0000","last_peered":"2024-09-12T22:48:08.673611+0000","last_clean":"2024-09-12T22:48:08.673611+0000","last_became_active":"2024-09-12T22:48:05.176327+0000","last_became_peered":"2024-09-12T22:48:05.176327+0000","last_unstale":"2024-09-12T22:48:08.673611+0000","last_undegraded":"2024-09-12T22:48:08.673611+0000","last_fullsized":"2024-09-12T22:48:08.673611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:11.781766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679222+0000","last_change":"2024-09-12T22:48:05.174818+0000","last_active":"2024-09-12T22:48:08.679222+0000","last_peered":"2024-09-12T22:48:08.679222+0000","last_clean":"2024-09-12T22:48:08.679222+0000","last_became_active":"2024-09-12T22:48:05.173485+0000","last_became_peered":"2024-09-12T22:48:05.173485+0000","last_unstale":"2024-09-12T22:48:08.679222+0000","last_undegraded":"2024-09-12T22:48:08.679222+0000","last_fullsized":"2024-09-12T22:48:08.679222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:24.124647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676980+0000","last_change":"2024-09-12T22:48:05.171573+0000","last_active":"2024-09-12T22:48:08.676980+0000","last_peered":"2024-09-12T22:48:08.676980+0000","last_clean":"2024-09-12T22:48:08.676980+0000","last_became_active":"2024-09-12T22:48:05.171036+0000","last_became_peered":"2024-09-12T22:48:05.171036+0000","last_unstale":"2024-09-12T22:48:08.676980+0000","last_undegraded":"2024-09-12T22:48:08.676980+0000","last_fullsized":"2024-09-12T22:48:08.676980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:27:07.558853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679924+0000","last_change":"2024-09-12T22:48:04.171960+0000","last_active":"2024-09-12T22:48:08.679924+0000","last_peered":"2024-09-12T22:48:08.679924+0000","last_clean":"2024-09-12T22:48:08.679924+0000","last_became_active":"2024-09-12T22:48:04.171562+0000","last_became_peered":"2024-09-12T22:48:04.171562+0000","last_unstale":"2024-09-12T22:48:08.679924+0000","last_undegraded":"2024-09-12T22:48:08.679924+0000","last_fullsized":"2024-09-12T22:48:08.679924+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:00.271198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677053+0000","last_change":"2024-09-12T22:48:05.173585+0000","last_active":"2024-09-12T22:48:08.677053+0000","last_peered":"2024-09-12T22:48:08.677053+0000","last_clean":"2024-09-12T22:48:08.677053+0000","last_became_active":"2024-09-12T22:48:05.172801+0000","last_became_peered":"2024-09-12T22:48:05.172801+0000","last_unstale":"2024-09-12T22:48:08.677053+0000","last_undegraded":"2024-09-12T22:48:08.677053+0000","last_fullsized":"2024-09-12T22:48:08.677053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:45.140060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674214+0000","last_change":"2024-09-12T22:48:04.167352+0000","last_active":"2024-09-12T22:48:08.674214+0000","last_peered":"2024-09-12T22:48:08.674214+0000","last_clean":"2024-09-12T22:48:08.674214+0000","last_became_active":"2024-09-12T22:48:04.166743+0000","last_became_peered":"2024-09-12T22:48:04.166743+0000","last_unstale":"2024-09-12T22:48:08.674214+0000","last_undegraded":"2024-09-12T22:48:08.674214+0000","last_fullsized":"2024-09-12T22:48:08.674214+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:30:27.547041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674597+0000","last_change":"2024-09-12T22:48:05.178409+0000","last_active":"2024-09-12T22:48:08.674597+0000","last_peered":"2024-09-12T22:48:08.674597+0000","last_clean":"2024-09-12T22:48:08.674597+0000","last_became_active":"2024-09-12T22:48:05.178076+0000","last_became_peered":"2024-09-12T22:48:05.178076+0000","last_unstale":"2024-09-12T22:48:08.674597+0000","last_undegraded":"2024-09-12T22:48:08.674597+0000","last_fullsized":"2024-09-12T22:48:08.674597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:01.401542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676355+0000","last_change":"2024-09-12T22:48:04.171173+0000","last_active":"2024-09-12T22:48:08.676355+0000","last_peered":"2024-09-12T22:48:08.676355+0000","last_clean":"2024-09-12T22:48:08.676355+0000","last_became_active":"2024-09-12T22:48:04.170891+0000","last_became_peered":"2024-09-12T22:48:04.170891+0000","last_unstale":"2024-09-12T22:48:08.676355+0000","last_undegraded":"2024-09-12T22:48:08.676355+0000","last_fullsized":"2024-09-12T22:48:08.676355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:02.023664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674470+0000","last_change":"2024-09-12T22:48:05.177510+0000","last_active":"2024-09-12T22:48:08.674470+0000","last_peered":"2024-09-12T22:48:08.674470+0000","last_clean":"2024-09-12T22:48:08.674470+0000","last_became_active":"2024-09-12T22:48:05.176568+0000","last_became_peered":"2024-09-12T22:48:05.176568+0000","last_unstale":"2024-09-12T22:48:08.674470+0000","last_undegraded":"2024-09-12T22:48:08.674470+0000","last_fullsized":"2024-09-12T22:48:08.674470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:49.868891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679221+0000","last_change":"2024-09-12T22:48:04.173161+0000","last_active":"2024-09-12T22:48:08.679221+0000","last_peered":"2024-09-12T22:48:08.679221+0000","last_clean":"2024-09-12T22:48:08.679221+0000","last_became_active":"2024-09-12T22:48:04.172623+0000","last_became_peered":"2024-09-12T22:48:04.172623+0000","last_unstale":"2024-09-12T22:48:08.679221+0000","last_undegraded":"2024-09-12T22:48:08.679221+0000","last_fullsized":"2024-09-12T22:48:08.679221+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:13.739087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680199+0000","last_change":"2024-09-12T22:48:04.173041+0000","last_active":"2024-09-12T22:48:08.680199+0000","last_peered":"2024-09-12T22:48:08.680199+0000","last_clean":"2024-09-12T22:48:08.680199+0000","last_became_active":"2024-09-12T22:48:04.172527+0000","last_became_peered":"2024-09-12T22:48:04.172527+0000","last_unstale":"2024-09-12T22:48:08.680199+0000","last_undegraded":"2024-09-12T22:48:08.680199+0000","last_fullsized":"2024-09-12T22:48:08.680199+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:20.734653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676178+0000","last_change":"2024-09-12T22:48:05.175921+0000","last_active":"2024-09-12T22:48:08.676178+0000","last_peered":"2024-09-12T22:48:08.676178+0000","last_clean":"2024-09-12T22:48:08.676178+0000","last_became_active":"2024-09-12T22:48:05.175226+0000","last_became_peered":"2024-09-12T22:48:05.175226+0000","last_unstale":"2024-09-12T22:48:08.676178+0000","last_undegraded":"2024-09-12T22:48:08.676178+0000","last_fullsized":"2024-09-12T22:48:08.676178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:08.021196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677320+0000","last_change":"2024-09-12T22:48:04.167564+0000","last_active":"2024-09-12T22:48:08.677320+0000","last_peered":"2024-09-12T22:48:08.677320+0000","last_clean":"2024-09-12T22:48:08.677320+0000","last_became_active":"2024-09-12T22:48:04.167254+0000","last_became_peered":"2024-09-12T22:48:04.167254+0000","last_unstale":"2024-09-12T22:48:08.677320+0000","last_undegraded":"2024-09-12T22:48:08.677320+0000","last_fullsized":"2024-09-12T22:48:08.677320+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:35.879041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676271+0000","last_change":"2024-09-12T22:48:05.171143+0000","last_active":"2024-09-12T22:48:08.676271+0000","last_peered":"2024-09-12T22:48:08.676271+0000","last_clean":"2024-09-12T22:48:08.676271+0000","last_became_active":"2024-09-12T22:48:05.170374+0000","last_became_peered":"2024-09-12T22:48:05.170374+0000","last_unstale":"2024-09-12T22:48:08.676271+0000","last_undegraded":"2024-09-12T22:48:08.676271+0000","last_fullsized":"2024-09-12T22:48:08.676271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:15.887977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680611+0000","last_change":"2024-09-12T22:48:04.173325+0000","last_active":"2024-09-12T22:48:08.680611+0000","last_peered":"2024-09-12T22:48:08.680611+0000","last_clean":"2024-09-12T22:48:08.680611+0000","last_became_active":"2024-09-12T22:48:04.172862+0000","last_became_peered":"2024-09-12T22:48:04.172862+0000","last_unstale":"2024-09-12T22:48:08.680611+0000","last_undegraded":"2024-09-12T22:48:08.680611+0000","last_fullsized":"2024-09-12T22:48:08.680611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:42:33.314407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679603+0000","last_change":"2024-09-12T22:48:05.173382+0000","last_active":"2024-09-12T22:48:08.679603+0000","last_peered":"2024-09-12T22:48:08.679603+0000","last_clean":"2024-09-12T22:48:08.679603+0000","last_became_active":"2024-09-12T22:48:05.172429+0000","last_became_peered":"2024-09-12T22:48:05.172429+0000","last_unstale":"2024-09-12T22:48:08.679603+0000","last_undegraded":"2024-09-12T22:48:08.679603+0000","last_fullsized":"2024-09-12T22:48:08.679603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:44:38.144948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680436+0000","last_change":"2024-09-12T22:48:04.172099+0000","last_active":"2024-09-12T22:48:08.680436+0000","last_peered":"2024-09-12T22:48:08.680436+0000","last_clean":"2024-09-12T22:48:08.680436+0000","last_became_active":"2024-09-12T22:48:04.171746+0000","last_became_peered":"2024-09-12T22:48:04.171746+0000","last_unstale":"2024-09-12T22:48:08.680436+0000","last_undegraded":"2024-09-12T22:48:08.680436+0000","last_fullsized":"2024-09-12T22:48:08.680436+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:35:28.894178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674110+0000","last_change":"2024-09-12T22:48:05.177824+0000","last_active":"2024-09-12T22:48:08.674110+0000","last_peered":"2024-09-12T22:48:08.674110+0000","last_clean":"2024-09-12T22:48:08.674110+0000","last_became_active":"2024-09-12T22:48:05.177344+0000","last_became_peered":"2024-09-12T22:48:05.177344+0000","last_unstale":"2024-09-12T22:48:08.674110+0000","last_undegraded":"2024-09-12T22:48:08.674110+0000","last_fullsized":"2024-09-12T22:48:08.674110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:52.071513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674213+0000","last_change":"2024-09-12T22:48:04.167459+0000","last_active":"2024-09-12T22:48:08.674213+0000","last_peered":"2024-09-12T22:48:08.674213+0000","last_clean":"2024-09-12T22:48:08.674213+0000","last_became_active":"2024-09-12T22:48:04.165825+0000","last_became_peered":"2024-09-12T22:48:04.165825+0000","last_unstale":"2024-09-12T22:48:08.674213+0000","last_undegraded":"2024-09-12T22:48:08.674213+0000","last_fullsized":"2024-09-12T22:48:08.674213+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:20.734653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679998+0000","last_change":"2024-09-12T22:48:05.173859+0000","last_active":"2024-09-12T22:48:08.679998+0000","last_peered":"2024-09-12T22:48:08.679998+0000","last_clean":"2024-09-12T22:48:08.679998+0000","last_became_active":"2024-09-12T22:48:05.173276+0000","last_became_peered":"2024-09-12T22:48:05.173276+0000","last_unstale":"2024-09-12T22:48:08.679998+0000","last_undegraded":"2024-09-12T22:48:08.679998+0000","last_fullsized":"2024-09-12T22:48:08.679998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:06:31.953025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679767+0000","last_change":"2024-09-12T22:48:04.172158+0000","last_active":"2024-09-12T22:48:08.679767+0000","last_peered":"2024-09-12T22:48:08.679767+0000","last_clean":"2024-09-12T22:48:08.679767+0000","last_became_active":"2024-09-12T22:48:04.171514+0000","last_became_peered":"2024-09-12T22:48:04.171514+0000","last_unstale":"2024-09-12T22:48:08.679767+0000","last_undegraded":"2024-09-12T22:48:08.679767+0000","last_fullsized":"2024-09-12T22:48:08.679767+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:40:29.366846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680561+0000","last_change":"2024-09-12T22:48:05.178528+0000","last_active":"2024-09-12T22:48:08.680561+0000","last_peered":"2024-09-12T22:48:08.680561+0000","last_clean":"2024-09-12T22:48:08.680561+0000","last_became_active":"2024-09-12T22:48:05.177904+0000","last_became_peered":"2024-09-12T22:48:05.177904+0000","last_unstale":"2024-09-12T22:48:08.680561+0000","last_undegraded":"2024-09-12T22:48:08.680561+0000","last_fullsized":"2024-09-12T22:48:08.680561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:59.525401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676548+0000","last_change":"2024-09-12T22:48:04.171001+0000","last_active":"2024-09-12T22:48:08.676548+0000","last_peered":"2024-09-12T22:48:08.676548+0000","last_clean":"2024-09-12T22:48:08.676548+0000","last_became_active":"2024-09-12T22:48:04.170667+0000","last_became_peered":"2024-09-12T22:48:04.170667+0000","last_unstale":"2024-09-12T22:48:08.676548+0000","last_undegraded":"2024-09-12T22:48:08.676548+0000","last_fullsized":"2024-09-12T22:48:08.676548+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:04.492449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680316+0000","last_change":"2024-09-12T22:48:05.177804+0000","last_active":"2024-09-12T22:48:08.680316+0000","last_peered":"2024-09-12T22:48:08.680316+0000","last_clean":"2024-09-12T22:48:08.680316+0000","last_became_active":"2024-09-12T22:48:05.177458+0000","last_became_peered":"2024-09-12T22:48:05.177458+0000","last_unstale":"2024-09-12T22:48:08.680316+0000","last_undegraded":"2024-09-12T22:48:08.680316+0000","last_fullsized":"2024-09-12T22:48:08.680316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:47.576598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676227+0000","last_change":"2024-09-12T22:48:04.174281+0000","last_active":"2024-09-12T22:48:08.676227+0000","last_peered":"2024-09-12T22:48:08.676227+0000","last_clean":"2024-09-12T22:48:08.676227+0000","last_became_active":"2024-09-12T22:48:04.173942+0000","last_became_peered":"2024-09-12T22:48:04.173942+0000","last_unstale":"2024-09-12T22:48:08.676227+0000","last_undegraded":"2024-09-12T22:48:08.676227+0000","last_fullsized":"2024-09-12T22:48:08.676227+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:19:38.546747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674466+0000","last_change":"2024-09-12T22:48:05.178246+0000","last_active":"2024-09-12T22:48:08.674466+0000","last_peered":"2024-09-12T22:48:08.674466+0000","last_clean":"2024-09-12T22:48:08.674466+0000","last_became_active":"2024-09-12T22:48:05.176813+0000","last_became_peered":"2024-09-12T22:48:05.176813+0000","last_unstale":"2024-09-12T22:48:08.674466+0000","last_undegraded":"2024-09-12T22:48:08.674466+0000","last_fullsized":"2024-09-12T22:48:08.674466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:58.991752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":226,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679433+0000","last_change":"2024-09-12T22:47:56.028830+0000","last_active":"2024-09-12T22:48:08.679433+0000","last_peered":"2024-09-12T22:48:08.679433+0000","last_clean":"2024-09-12T22:48:08.679433+0000","last_became_active":"2024-09-12T22:47:56.028017+0000","last_became_peered":"2024-09-12T22:47:56.028017+0000","last_unstale":"2024-09-12T22:48:08.679433+0000","last_undegraded":"2024-09-12T22:48:08.679433+0000","last_fullsized":"2024-09-12T22:48:08.679433+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:55.016634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:55.016634+0000","last_clean_scrub_stamp":"2024-09-12T22:47:55.016634+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:03.648827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680145+0000","last_change":"2024-09-12T22:48:02.045816+0000","last_active":"2024-09-12T22:48:08.680145+0000","last_peered":"2024-09-12T22:48:08.680145+0000","last_clean":"2024-09-12T22:48:08.680145+0000","last_became_active":"2024-09-12T22:48:00.045324+0000","last_became_peered":"2024-09-12T22:48:00.045324+0000","last_unstale":"2024-09-12T22:48:08.680145+0000","last_undegraded":"2024-09-12T22:48:08.680145+0000","last_fullsized":"2024-09-12T22:48:08.680145+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:41:33.998543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065526500000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673955+0000","last_change":"2024-09-12T22:48:04.169704+0000","last_active":"2024-09-12T22:48:08.673955+0000","last_peered":"2024-09-12T22:48:08.673955+0000","last_clean":"2024-09-12T22:48:08.673955+0000","last_became_active":"2024-09-12T22:48:04.169474+0000","last_became_peered":"2024-09-12T22:48:04.169474+0000","last_unstale":"2024-09-12T22:48:08.673955+0000","last_undegraded":"2024-09-12T22:48:08.673955+0000","last_fullsized":"2024-09-12T22:48:08.673955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:00.271198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680660+0000","last_change":"2024-09-12T22:48:05.178510+0000","last_active":"2024-09-12T22:48:08.680660+0000","last_peered":"2024-09-12T22:48:08.680660+0000","last_clean":"2024-09-12T22:48:08.680660+0000","last_became_active":"2024-09-12T22:48:05.177910+0000","last_became_peered":"2024-09-12T22:48:05.177910+0000","last_unstale":"2024-09-12T22:48:08.680660+0000","last_undegraded":"2024-09-12T22:48:08.680660+0000","last_fullsized":"2024-09-12T22:48:08.680660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:19.398289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679405+0000","last_change":"2024-09-12T22:48:02.045525+0000","last_active":"2024-09-12T22:48:08.679405+0000","last_peered":"2024-09-12T22:48:08.679405+0000","last_clean":"2024-09-12T22:48:08.679405+0000","last_became_active":"2024-09-12T22:48:00.042207+0000","last_became_peered":"2024-09-12T22:48:00.042207+0000","last_unstale":"2024-09-12T22:48:08.679405+0000","last_undegraded":"2024-09-12T22:48:08.679405+0000","last_fullsized":"2024-09-12T22:48:08.679405+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:33.150497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040973099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673788+0000","last_change":"2024-09-12T22:48:04.167456+0000","last_active":"2024-09-12T22:48:08.673788+0000","last_peered":"2024-09-12T22:48:08.673788+0000","last_clean":"2024-09-12T22:48:08.673788+0000","last_became_active":"2024-09-12T22:48:04.166966+0000","last_became_peered":"2024-09-12T22:48:04.166966+0000","last_unstale":"2024-09-12T22:48:08.673788+0000","last_undegraded":"2024-09-12T22:48:08.673788+0000","last_fullsized":"2024-09-12T22:48:08.673788+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:13.739087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677214+0000","last_change":"2024-09-12T22:48:05.171819+0000","last_active":"2024-09-12T22:48:08.677214+0000","last_peered":"2024-09-12T22:48:08.677214+0000","last_clean":"2024-09-12T22:48:08.677214+0000","last_became_active":"2024-09-12T22:48:05.171293+0000","last_became_peered":"2024-09-12T22:48:05.171293+0000","last_unstale":"2024-09-12T22:48:08.677214+0000","last_undegraded":"2024-09-12T22:48:08.677214+0000","last_fullsized":"2024-09-12T22:48:08.677214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:01.401542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673968+0000","last_change":"2024-09-12T22:48:02.045209+0000","last_active":"2024-09-12T22:48:08.673968+0000","last_peered":"2024-09-12T22:48:08.673968+0000","last_clean":"2024-09-12T22:48:08.673968+0000","last_became_active":"2024-09-12T22:48:00.042007+0000","last_became_peered":"2024-09-12T22:48:00.042007+0000","last_unstale":"2024-09-12T22:48:08.673968+0000","last_undegraded":"2024-09-12T22:48:08.673968+0000","last_fullsized":"2024-09-12T22:48:08.673968+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:13.536542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036893100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676251+0000","last_change":"2024-09-12T22:48:04.171168+0000","last_active":"2024-09-12T22:48:08.676251+0000","last_peered":"2024-09-12T22:48:08.676251+0000","last_clean":"2024-09-12T22:48:08.676251+0000","last_became_active":"2024-09-12T22:48:04.170853+0000","last_became_peered":"2024-09-12T22:48:04.170853+0000","last_unstale":"2024-09-12T22:48:08.676251+0000","last_undegraded":"2024-09-12T22:48:08.676251+0000","last_fullsized":"2024-09-12T22:48:08.676251+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:32:37.715508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674596+0000","last_change":"2024-09-12T22:48:05.178865+0000","last_active":"2024-09-12T22:48:08.674596+0000","last_peered":"2024-09-12T22:48:08.674596+0000","last_clean":"2024-09-12T22:48:08.674596+0000","last_became_active":"2024-09-12T22:48:05.178010+0000","last_became_peered":"2024-09-12T22:48:05.178010+0000","last_unstale":"2024-09-12T22:48:08.674596+0000","last_undegraded":"2024-09-12T22:48:08.674596+0000","last_fullsized":"2024-09-12T22:48:08.674596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:30.120804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679847+0000","last_change":"2024-09-12T22:48:02.045684+0000","last_active":"2024-09-12T22:48:08.679847+0000","last_peered":"2024-09-12T22:48:08.679847+0000","last_clean":"2024-09-12T22:48:08.679847+0000","last_became_active":"2024-09-12T22:48:00.045286+0000","last_became_peered":"2024-09-12T22:48:00.045286+0000","last_unstale":"2024-09-12T22:48:08.679847+0000","last_undegraded":"2024-09-12T22:48:08.679847+0000","last_fullsized":"2024-09-12T22:48:08.679847+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:18:11.667143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052714799999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679984+0000","last_change":"2024-09-12T22:48:04.172355+0000","last_active":"2024-09-12T22:48:08.679984+0000","last_peered":"2024-09-12T22:48:08.679984+0000","last_clean":"2024-09-12T22:48:08.679984+0000","last_became_active":"2024-09-12T22:48:04.171905+0000","last_became_peered":"2024-09-12T22:48:04.171905+0000","last_unstale":"2024-09-12T22:48:08.679984+0000","last_undegraded":"2024-09-12T22:48:08.679984+0000","last_fullsized":"2024-09-12T22:48:08.679984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:35.203049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674351+0000","last_change":"2024-09-12T22:48:05.177561+0000","last_active":"2024-09-12T22:48:08.674351+0000","last_peered":"2024-09-12T22:48:08.674351+0000","last_clean":"2024-09-12T22:48:08.674351+0000","last_became_active":"2024-09-12T22:48:05.177164+0000","last_became_peered":"2024-09-12T22:48:05.177164+0000","last_unstale":"2024-09-12T22:48:08.674351+0000","last_undegraded":"2024-09-12T22:48:08.674351+0000","last_fullsized":"2024-09-12T22:48:08.674351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:24.124647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680715+0000","last_change":"2024-09-12T22:48:04.172271+0000","last_active":"2024-09-12T22:48:08.680715+0000","last_peered":"2024-09-12T22:48:08.680715+0000","last_clean":"2024-09-12T22:48:08.680715+0000","last_became_active":"2024-09-12T22:48:04.171739+0000","last_became_peered":"2024-09-12T22:48:04.171739+0000","last_unstale":"2024-09-12T22:48:08.680715+0000","last_undegraded":"2024-09-12T22:48:08.680715+0000","last_fullsized":"2024-09-12T22:48:08.680715+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:56.929490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674540+0000","last_change":"2024-09-12T22:48:02.045324+0000","last_active":"2024-09-12T22:48:08.674540+0000","last_peered":"2024-09-12T22:48:08.674540+0000","last_clean":"2024-09-12T22:48:08.674540+0000","last_became_active":"2024-09-12T22:48:00.042132+0000","last_became_peered":"2024-09-12T22:48:00.042132+0000","last_unstale":"2024-09-12T22:48:08.674540+0000","last_undegraded":"2024-09-12T22:48:08.674540+0000","last_fullsized":"2024-09-12T22:48:08.674540+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:24.673019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047590600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676518+0000","last_change":"2024-09-12T22:48:05.175609+0000","last_active":"2024-09-12T22:48:08.676518+0000","last_peered":"2024-09-12T22:48:08.676518+0000","last_clean":"2024-09-12T22:48:08.676518+0000","last_became_active":"2024-09-12T22:48:05.175167+0000","last_became_peered":"2024-09-12T22:48:05.175167+0000","last_unstale":"2024-09-12T22:48:08.676518+0000","last_undegraded":"2024-09-12T22:48:08.676518+0000","last_fullsized":"2024-09-12T22:48:08.676518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:11.248179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674322+0000","last_change":"2024-09-12T22:48:04.169109+0000","last_active":"2024-09-12T22:48:08.674322+0000","last_peered":"2024-09-12T22:48:08.674322+0000","last_clean":"2024-09-12T22:48:08.674322+0000","last_became_active":"2024-09-12T22:48:04.168655+0000","last_became_peered":"2024-09-12T22:48:04.168655+0000","last_unstale":"2024-09-12T22:48:08.674322+0000","last_undegraded":"2024-09-12T22:48:08.674322+0000","last_fullsized":"2024-09-12T22:48:08.674322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:02.879935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677463+0000","last_change":"2024-09-12T22:48:02.045390+0000","last_active":"2024-09-12T22:48:08.677463+0000","last_peered":"2024-09-12T22:48:08.677463+0000","last_clean":"2024-09-12T22:48:08.677463+0000","last_became_active":"2024-09-12T22:48:00.045356+0000","last_became_peered":"2024-09-12T22:48:00.045356+0000","last_unstale":"2024-09-12T22:48:08.677463+0000","last_undegraded":"2024-09-12T22:48:08.677463+0000","last_fullsized":"2024-09-12T22:48:08.677463+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:32.072080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040621599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676614+0000","last_change":"2024-09-12T22:48:05.171131+0000","last_active":"2024-09-12T22:48:08.676614+0000","last_peered":"2024-09-12T22:48:08.676614+0000","last_clean":"2024-09-12T22:48:08.676614+0000","last_became_active":"2024-09-12T22:48:05.170591+0000","last_became_peered":"2024-09-12T22:48:05.170591+0000","last_unstale":"2024-09-12T22:48:08.676614+0000","last_undegraded":"2024-09-12T22:48:08.676614+0000","last_fullsized":"2024-09-12T22:48:08.676614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:11.781766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674783+0000","last_change":"2024-09-12T22:48:04.168635+0000","last_active":"2024-09-12T22:48:08.674783+0000","last_peered":"2024-09-12T22:48:08.674783+0000","last_clean":"2024-09-12T22:48:08.674783+0000","last_became_active":"2024-09-12T22:48:04.168244+0000","last_became_peered":"2024-09-12T22:48:04.168244+0000","last_unstale":"2024-09-12T22:48:08.674783+0000","last_undegraded":"2024-09-12T22:48:08.674783+0000","last_fullsized":"2024-09-12T22:48:08.674783+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:56.929490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674718+0000","last_change":"2024-09-12T22:48:02.045428+0000","last_active":"2024-09-12T22:48:08.674718+0000","last_peered":"2024-09-12T22:48:08.674718+0000","last_clean":"2024-09-12T22:48:08.674718+0000","last_became_active":"2024-09-12T22:48:00.040536+0000","last_became_peered":"2024-09-12T22:48:00.040536+0000","last_unstale":"2024-09-12T22:48:08.674718+0000","last_undegraded":"2024-09-12T22:48:08.674718+0000","last_fullsized":"2024-09-12T22:48:08.674718+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:33.150497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057699499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673721+0000","last_change":"2024-09-12T22:48:05.170571+0000","last_active":"2024-09-12T22:48:08.673721+0000","last_peered":"2024-09-12T22:48:08.673721+0000","last_clean":"2024-09-12T22:48:08.673721+0000","last_became_active":"2024-09-12T22:48:05.170087+0000","last_became_peered":"2024-09-12T22:48:05.170087+0000","last_unstale":"2024-09-12T22:48:08.673721+0000","last_undegraded":"2024-09-12T22:48:08.673721+0000","last_fullsized":"2024-09-12T22:48:08.673721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:28.873036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674650+0000","last_change":"2024-09-12T22:48:04.166369+0000","last_active":"2024-09-12T22:48:08.674650+0000","last_peered":"2024-09-12T22:48:08.674650+0000","last_clean":"2024-09-12T22:48:08.674650+0000","last_became_active":"2024-09-12T22:48:04.165966+0000","last_became_peered":"2024-09-12T22:48:04.165966+0000","last_unstale":"2024-09-12T22:48:08.674650+0000","last_undegraded":"2024-09-12T22:48:08.674650+0000","last_fullsized":"2024-09-12T22:48:08.674650+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:40:29.366846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680266+0000","last_change":"2024-09-12T22:48:02.045500+0000","last_active":"2024-09-12T22:48:08.680266+0000","last_peered":"2024-09-12T22:48:08.680266+0000","last_clean":"2024-09-12T22:48:08.680266+0000","last_became_active":"2024-09-12T22:48:00.042210+0000","last_became_peered":"2024-09-12T22:48:00.042210+0000","last_unstale":"2024-09-12T22:48:08.680266+0000","last_undegraded":"2024-09-12T22:48:08.680266+0000","last_fullsized":"2024-09-12T22:48:08.680266+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:35:14.212372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035339799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676300+0000","last_change":"2024-09-12T22:48:05.170712+0000","last_active":"2024-09-12T22:48:08.676300+0000","last_peered":"2024-09-12T22:48:08.676300+0000","last_clean":"2024-09-12T22:48:08.676300+0000","last_became_active":"2024-09-12T22:48:05.169840+0000","last_became_peered":"2024-09-12T22:48:05.169840+0000","last_unstale":"2024-09-12T22:48:08.676300+0000","last_undegraded":"2024-09-12T22:48:08.676300+0000","last_fullsized":"2024-09-12T22:48:08.676300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:24.240533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679770+0000","last_change":"2024-09-12T22:48:05.168203+0000","last_active":"2024-09-12T22:48:08.679770+0000","last_peered":"2024-09-12T22:48:08.679770+0000","last_clean":"2024-09-12T22:48:08.679770+0000","last_became_active":"2024-09-12T22:48:05.167870+0000","last_became_peered":"2024-09-12T22:48:05.167870+0000","last_unstale":"2024-09-12T22:48:08.679770+0000","last_undegraded":"2024-09-12T22:48:08.679770+0000","last_fullsized":"2024-09-12T22:48:08.679770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:45.140060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680214+0000","last_change":"2024-09-12T22:48:04.173355+0000","last_active":"2024-09-12T22:48:08.680214+0000","last_peered":"2024-09-12T22:48:08.680214+0000","last_clean":"2024-09-12T22:48:08.680214+0000","last_became_active":"2024-09-12T22:48:04.173031+0000","last_became_peered":"2024-09-12T22:48:04.173031+0000","last_unstale":"2024-09-12T22:48:08.680214+0000","last_undegraded":"2024-09-12T22:48:08.680214+0000","last_fullsized":"2024-09-12T22:48:08.680214+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:02.879935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673651+0000","last_change":"2024-09-12T22:48:05.176779+0000","last_active":"2024-09-12T22:48:08.673651+0000","last_peered":"2024-09-12T22:48:08.673651+0000","last_clean":"2024-09-12T22:48:08.673651+0000","last_became_active":"2024-09-12T22:48:05.176344+0000","last_became_peered":"2024-09-12T22:48:05.176344+0000","last_unstale":"2024-09-12T22:48:08.673651+0000","last_undegraded":"2024-09-12T22:48:08.673651+0000","last_fullsized":"2024-09-12T22:48:08.673651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:35.645286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677280+0000","last_change":"2024-09-12T22:48:04.171169+0000","last_active":"2024-09-12T22:48:08.677280+0000","last_peered":"2024-09-12T22:48:08.677280+0000","last_clean":"2024-09-12T22:48:08.677280+0000","last_became_active":"2024-09-12T22:48:04.170812+0000","last_became_peered":"2024-09-12T22:48:04.170812+0000","last_unstale":"2024-09-12T22:48:08.677280+0000","last_undegraded":"2024-09-12T22:48:08.677280+0000","last_fullsized":"2024-09-12T22:48:08.677280+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:05:58.510137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680378+0000","last_change":"2024-09-12T22:48:04.172325+0000","last_active":"2024-09-12T22:48:08.680378+0000","last_peered":"2024-09-12T22:48:08.680378+0000","last_clean":"2024-09-12T22:48:08.680378+0000","last_became_active":"2024-09-12T22:48:04.171855+0000","last_became_peered":"2024-09-12T22:48:04.171855+0000","last_unstale":"2024-09-12T22:48:08.680378+0000","last_undegraded":"2024-09-12T22:48:08.680378+0000","last_fullsized":"2024-09-12T22:48:08.680378+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:43.709660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673612+0000","last_change":"2024-09-12T22:48:05.177309+0000","last_active":"2024-09-12T22:48:08.673612+0000","last_peered":"2024-09-12T22:48:08.673612+0000","last_clean":"2024-09-12T22:48:08.673612+0000","last_became_active":"2024-09-12T22:48:05.176412+0000","last_became_peered":"2024-09-12T22:48:05.176412+0000","last_unstale":"2024-09-12T22:48:08.673612+0000","last_undegraded":"2024-09-12T22:48:08.673612+0000","last_fullsized":"2024-09-12T22:48:08.673612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:27:07.558853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674712+0000","last_change":"2024-09-12T22:48:04.166500+0000","last_active":"2024-09-12T22:48:08.674712+0000","last_peered":"2024-09-12T22:48:08.674712+0000","last_clean":"2024-09-12T22:48:08.674712+0000","last_became_active":"2024-09-12T22:48:04.165926+0000","last_became_peered":"2024-09-12T22:48:04.165926+0000","last_unstale":"2024-09-12T22:48:08.674712+0000","last_undegraded":"2024-09-12T22:48:08.674712+0000","last_fullsized":"2024-09-12T22:48:08.674712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:42:33.314407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673624+0000","last_change":"2024-09-12T22:48:05.169648+0000","last_active":"2024-09-12T22:48:08.673624+0000","last_peered":"2024-09-12T22:48:08.673624+0000","last_clean":"2024-09-12T22:48:08.673624+0000","last_became_active":"2024-09-12T22:48:05.168356+0000","last_became_peered":"2024-09-12T22:48:05.168356+0000","last_unstale":"2024-09-12T22:48:08.673624+0000","last_undegraded":"2024-09-12T22:48:08.673624+0000","last_fullsized":"2024-09-12T22:48:08.673624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:52.341512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677376+0000","last_change":"2024-09-12T22:48:05.173822+0000","last_active":"2024-09-12T22:48:08.677376+0000","last_peered":"2024-09-12T22:48:08.677376+0000","last_clean":"2024-09-12T22:48:08.677376+0000","last_became_active":"2024-09-12T22:48:05.172473+0000","last_became_peered":"2024-09-12T22:48:05.172473+0000","last_unstale":"2024-09-12T22:48:08.677376+0000","last_undegraded":"2024-09-12T22:48:08.677376+0000","last_fullsized":"2024-09-12T22:48:08.677376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:32.288419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673686+0000","last_change":"2024-09-12T22:48:04.169111+0000","last_active":"2024-09-12T22:48:08.673686+0000","last_peered":"2024-09-12T22:48:08.673686+0000","last_clean":"2024-09-12T22:48:08.673686+0000","last_became_active":"2024-09-12T22:48:04.168743+0000","last_became_peered":"2024-09-12T22:48:04.168743+0000","last_unstale":"2024-09-12T22:48:08.673686+0000","last_undegraded":"2024-09-12T22:48:08.673686+0000","last_fullsized":"2024-09-12T22:48:08.673686+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:43.709660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674438+0000","last_change":"2024-09-12T22:48:05.175474+0000","last_active":"2024-09-12T22:48:08.674438+0000","last_peered":"2024-09-12T22:48:08.674438+0000","last_clean":"2024-09-12T22:48:08.674438+0000","last_became_active":"2024-09-12T22:48:05.175220+0000","last_became_peered":"2024-09-12T22:48:05.175220+0000","last_unstale":"2024-09-12T22:48:08.674438+0000","last_undegraded":"2024-09-12T22:48:08.674438+0000","last_fullsized":"2024-09-12T22:48:08.674438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:56.158813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.673708+0000","last_change":"2024-09-12T22:48:04.165725+0000","last_active":"2024-09-12T22:48:08.673708+0000","last_peered":"2024-09-12T22:48:08.673708+0000","last_clean":"2024-09-12T22:48:08.673708+0000","last_became_active":"2024-09-12T22:48:04.165419+0000","last_became_peered":"2024-09-12T22:48:04.165419+0000","last_unstale":"2024-09-12T22:48:08.673708+0000","last_undegraded":"2024-09-12T22:48:08.673708+0000","last_fullsized":"2024-09-12T22:48:08.673708+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:35:01.771536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677045+0000","last_change":"2024-09-12T22:48:05.174920+0000","last_active":"2024-09-12T22:48:08.677045+0000","last_peered":"2024-09-12T22:48:08.677045+0000","last_clean":"2024-09-12T22:48:08.677045+0000","last_became_active":"2024-09-12T22:48:05.173785+0000","last_became_peered":"2024-09-12T22:48:05.173785+0000","last_unstale":"2024-09-12T22:48:08.677045+0000","last_undegraded":"2024-09-12T22:48:08.677045+0000","last_fullsized":"2024-09-12T22:48:08.677045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:24.124647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676684+0000","last_change":"2024-09-12T22:48:04.174205+0000","last_active":"2024-09-12T22:48:08.676684+0000","last_peered":"2024-09-12T22:48:08.676684+0000","last_clean":"2024-09-12T22:48:08.676684+0000","last_became_active":"2024-09-12T22:48:04.173902+0000","last_became_peered":"2024-09-12T22:48:04.173902+0000","last_unstale":"2024-09-12T22:48:08.676684+0000","last_undegraded":"2024-09-12T22:48:08.676684+0000","last_fullsized":"2024-09-12T22:48:08.676684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:43:39.709214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676806+0000","last_change":"2024-09-12T22:48:05.172917+0000","last_active":"2024-09-12T22:48:08.676806+0000","last_peered":"2024-09-12T22:48:08.676806+0000","last_clean":"2024-09-12T22:48:08.676806+0000","last_became_active":"2024-09-12T22:48:05.172493+0000","last_became_peered":"2024-09-12T22:48:05.172493+0000","last_unstale":"2024-09-12T22:48:08.676806+0000","last_undegraded":"2024-09-12T22:48:08.676806+0000","last_fullsized":"2024-09-12T22:48:08.676806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:35.645286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676666+0000","last_change":"2024-09-12T22:48:04.175808+0000","last_active":"2024-09-12T22:48:08.676666+0000","last_peered":"2024-09-12T22:48:08.676666+0000","last_clean":"2024-09-12T22:48:08.676666+0000","last_became_active":"2024-09-12T22:48:04.175601+0000","last_became_peered":"2024-09-12T22:48:04.175601+0000","last_unstale":"2024-09-12T22:48:08.676666+0000","last_undegraded":"2024-09-12T22:48:08.676666+0000","last_fullsized":"2024-09-12T22:48:08.676666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:19.369251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679733+0000","last_change":"2024-09-12T22:48:05.173989+0000","last_active":"2024-09-12T22:48:08.679733+0000","last_peered":"2024-09-12T22:48:08.679733+0000","last_clean":"2024-09-12T22:48:08.679733+0000","last_became_active":"2024-09-12T22:48:05.172076+0000","last_became_peered":"2024-09-12T22:48:05.172076+0000","last_unstale":"2024-09-12T22:48:08.679733+0000","last_undegraded":"2024-09-12T22:48:08.679733+0000","last_fullsized":"2024-09-12T22:48:08.679733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:51.360504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.680072+0000","last_change":"2024-09-12T22:48:04.171884+0000","last_active":"2024-09-12T22:48:08.680072+0000","last_peered":"2024-09-12T22:48:08.680072+0000","last_clean":"2024-09-12T22:48:08.680072+0000","last_became_active":"2024-09-12T22:48:04.171480+0000","last_became_peered":"2024-09-12T22:48:04.171480+0000","last_unstale":"2024-09-12T22:48:08.680072+0000","last_undegraded":"2024-09-12T22:48:08.680072+0000","last_fullsized":"2024-09-12T22:48:08.680072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:56.377664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679739+0000","last_change":"2024-09-12T22:48:05.173551+0000","last_active":"2024-09-12T22:48:08.679739+0000","last_peered":"2024-09-12T22:48:08.679739+0000","last_clean":"2024-09-12T22:48:08.679739+0000","last_became_active":"2024-09-12T22:48:05.172983+0000","last_became_peered":"2024-09-12T22:48:05.172983+0000","last_unstale":"2024-09-12T22:48:08.679739+0000","last_undegraded":"2024-09-12T22:48:08.679739+0000","last_fullsized":"2024-09-12T22:48:08.679739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:22.753741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.677213+0000","last_change":"2024-09-12T22:48:04.167853+0000","last_active":"2024-09-12T22:48:08.677213+0000","last_peered":"2024-09-12T22:48:08.677213+0000","last_clean":"2024-09-12T22:48:08.677213+0000","last_became_active":"2024-09-12T22:48:04.167408+0000","last_became_peered":"2024-09-12T22:48:04.167408+0000","last_unstale":"2024-09-12T22:48:08.677213+0000","last_undegraded":"2024-09-12T22:48:08.677213+0000","last_fullsized":"2024-09-12T22:48:08.677213+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:32.031432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.676789+0000","last_change":"2024-09-12T22:48:05.171815+0000","last_active":"2024-09-12T22:48:08.676789+0000","last_peered":"2024-09-12T22:48:08.676789+0000","last_clean":"2024-09-12T22:48:08.676789+0000","last_became_active":"2024-09-12T22:48:05.171361+0000","last_became_peered":"2024-09-12T22:48:05.171361+0000","last_unstale":"2024-09-12T22:48:08.676789+0000","last_undegraded":"2024-09-12T22:48:08.676789+0000","last_fullsized":"2024-09-12T22:48:08.676789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:28.873036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674540+0000","last_change":"2024-09-12T22:48:04.169500+0000","last_active":"2024-09-12T22:48:08.674540+0000","last_peered":"2024-09-12T22:48:08.674540+0000","last_clean":"2024-09-12T22:48:08.674540+0000","last_became_active":"2024-09-12T22:48:04.169087+0000","last_became_peered":"2024-09-12T22:48:04.169087+0000","last_unstale":"2024-09-12T22:48:08.674540+0000","last_undegraded":"2024-09-12T22:48:08.674540+0000","last_fullsized":"2024-09-12T22:48:08.674540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:56.377664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.679335+0000","last_change":"2024-09-12T22:48:05.174947+0000","last_active":"2024-09-12T22:48:08.679335+0000","last_peered":"2024-09-12T22:48:08.679335+0000","last_clean":"2024-09-12T22:48:08.679335+0000","last_became_active":"2024-09-12T22:48:05.174503+0000","last_became_peered":"2024-09-12T22:48:05.174503+0000","last_unstale":"2024-09-12T22:48:08.679335+0000","last_undegraded":"2024-09-12T22:48:08.679335+0000","last_fullsized":"2024-09-12T22:48:08.679335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:01.401542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:48:08.674557+0000","last_change":"2024-09-12T22:48:04.166198+0000","last_active":"2024-09-12T22:48:08.674557+0000","last_peered":"2024-09-12T22:48:08.674557+0000","last_clean":"2024-09-12T22:48:08.674557+0000","last_became_active":"2024-09-12T22:48:04.165795+0000","last_became_peered":"2024-09-12T22:48:04.165795+0000","last_unstale":"2024-09-12T22:48:08.674557+0000","last_undegraded":"2024-09-12T22:48:08.674557+0000","last_fullsized":"2024-09-12T22:48:08.674557+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:35.203049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":802816,"data_stored":656071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":63909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":655436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:48:20.953 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T22:48:20.953 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-12T22:48:21.276 INFO:teuthology.orchestra.run.smithi066.stdout:epoch 20 2024-09-12T22:48:21.277 INFO:teuthology.orchestra.run.smithi066.stdout:fsid 5714c6a5-034c-4330-a57b-d22492ad8e43 2024-09-12T22:48:21.277 INFO:teuthology.orchestra.run.smithi066.stdout:created 2024-09-12T22:47:43.881551+0000 2024-09-12T22:48:21.277 INFO:teuthology.orchestra.run.smithi066.stdout:modified 2024-09-12T22:48:08.667860+0000 2024-09-12T22:48:21.277 INFO:teuthology.orchestra.run.smithi066.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-12T22:48:21.277 INFO:teuthology.orchestra.run.smithi066.stdout:crush_version 4 2024-09-12T22:48:21.277 INFO:teuthology.orchestra.run.smithi066.stdout:full_ratio 0.95 2024-09-12T22:48:21.277 INFO:teuthology.orchestra.run.smithi066.stdout:backfillfull_ratio 0.9 2024-09-12T22:48:21.277 INFO:teuthology.orchestra.run.smithi066.stdout:nearfull_ratio 0.85 2024-09-12T22:48:21.277 INFO:teuthology.orchestra.run.smithi066.stdout:require_min_compat_client luminous 2024-09-12T22:48:21.277 INFO:teuthology.orchestra.run.smithi066.stdout:min_compat_client jewel 2024-09-12T22:48:21.278 INFO:teuthology.orchestra.run.smithi066.stdout:require_osd_release squid 2024-09-12T22:48:21.278 INFO:teuthology.orchestra.run.smithi066.stdout:stretch_mode_enabled false 2024-09-12T22:48:21.278 INFO:teuthology.orchestra.run.smithi066.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2024-09-12T22:48:21.278 INFO:teuthology.orchestra.run.smithi066.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 15 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 1.50 2024-09-12T22:48:21.278 INFO:teuthology.orchestra.run.smithi066.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2024-09-12T22:48:21.278 INFO:teuthology.orchestra.run.smithi066.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2024-09-12T22:48:21.278 INFO:teuthology.orchestra.run.smithi066.stdout:max_osd 3 2024-09-12T22:48:21.278 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.87:6800/1747255146,v1:172.21.15.87:6801/1747255146] [v2:172.21.15.87:6802/1747255146,v1:172.21.15.87:6803/1747255146] exists,up 9ed48fb2-48c2-4ecb-9306-372a05b08cee 2024-09-12T22:48:21.278 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.99:6800/1159429503,v1:172.21.15.99:6801/1159429503] [v2:172.21.15.99:6802/1159429503,v1:172.21.15.99:6803/1159429503] exists,up af934313-a6b4-4e15-9818-6fc3fb71b949 2024-09-12T22:48:21.278 INFO:teuthology.orchestra.run.smithi066.stdout:osd.2 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.117:6800/2828388397,v1:172.21.15.117:6801/2828388397] [v2:172.21.15.117:6802/2828388397,v1:172.21.15.117:6803/2828388397] exists,up 185ee2bd-8c37-4de1-b6ef-2988144d1470 2024-09-12T22:48:21.291 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.87:6800/1747255146,v1:172.21.15.87:6801/1747255146] [v2:172.21.15.87:6802/1747255146,v1:172.21.15.87:6803/1747255146] exists,up 9ed48fb2-48c2-4ecb-9306-372a05b08cee', 'osd.1 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.99:6800/1159429503,v1:172.21.15.99:6801/1159429503] [v2:172.21.15.99:6802/1159429503,v1:172.21.15.99:6803/1159429503] exists,up af934313-a6b4-4e15-9818-6fc3fb71b949', 'osd.2 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.117:6800/2828388397,v1:172.21.15.117:6801/2828388397] [v2:172.21.15.117:6802/2828388397,v1:172.21.15.117:6803/2828388397] exists,up 185ee2bd-8c37-4de1-b6ef-2988144d1470'] 2024-09-12T22:48:21.292 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-12T22:48:21.394 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T22:48:21.395 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "mon.a", 2024-09-12T22:48:21.395 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster": "ceph", 2024-09-12T22:48:21.395 INFO:teuthology.orchestra.run.smithi066.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-12T22:48:21.395 INFO:teuthology.orchestra.run.smithi066.stdout: "admin_socket_mode": "", 2024-09-12T22:48:21.395 INFO:teuthology.orchestra.run.smithi066.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-12T22:48:21.396 INFO:teuthology.orchestra.run.smithi066.stdout: "auth_client_required": "cephx, none", 2024-09-12T22:48:21.396 INFO:teuthology.orchestra.run.smithi066.stdout: "auth_cluster_required": "cephx", 2024-09-12T22:48:21.396 INFO:teuthology.orchestra.run.smithi066.stdout: "auth_debug": "true", 2024-09-12T22:48:21.396 INFO:teuthology.orchestra.run.smithi066.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-12T22:48:21.396 INFO:teuthology.orchestra.run.smithi066.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-12T22:48:21.397 INFO:teuthology.orchestra.run.smithi066.stdout: "auth_service_required": "cephx", 2024-09-12T22:48:21.397 INFO:teuthology.orchestra.run.smithi066.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-12T22:48:21.397 INFO:teuthology.orchestra.run.smithi066.stdout: "auth_supported": "cephx", 2024-09-12T22:48:21.397 INFO:teuthology.orchestra.run.smithi066.stdout: "bdev_aio": "true", 2024-09-12T22:48:21.397 INFO:teuthology.orchestra.run.smithi066.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-12T22:48:21.397 INFO:teuthology.orchestra.run.smithi066.stdout: "bdev_aio_poll_ms": "250", 2024-09-12T22:48:21.398 INFO:teuthology.orchestra.run.smithi066.stdout: "bdev_aio_reap_max": "16", 2024-09-12T22:48:21.398 INFO:teuthology.orchestra.run.smithi066.stdout: "bdev_async_discard": "false", 2024-09-12T22:48:21.398 INFO:teuthology.orchestra.run.smithi066.stdout: "bdev_block_size": "4096", 2024-09-12T22:48:21.398 INFO:teuthology.orchestra.run.smithi066.stdout: "bdev_debug_aio": "false", 2024-09-12T22:48:21.398 INFO:teuthology.orchestra.run.smithi066.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-12T22:48:21.398 INFO:teuthology.orchestra.run.smithi066.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-12T22:48:21.399 INFO:teuthology.orchestra.run.smithi066.stdout: "bdev_debug_inflight_ios": "false", 2024-09-12T22:48:21.399 INFO:teuthology.orchestra.run.smithi066.stdout: "bdev_enable_discard": "false", 2024-09-12T22:48:21.399 INFO:teuthology.orchestra.run.smithi066.stdout: "bdev_flock_retry": "3", 2024-09-12T22:48:21.399 INFO:teuthology.orchestra.run.smithi066.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-12T22:48:21.399 INFO:teuthology.orchestra.run.smithi066.stdout: "bdev_inject_crash": "0", 2024-09-12T22:48:21.399 INFO:teuthology.orchestra.run.smithi066.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-12T22:48:21.400 INFO:teuthology.orchestra.run.smithi066.stdout: "bdev_ioring": "false", 2024-09-12T22:48:21.400 INFO:teuthology.orchestra.run.smithi066.stdout: "bdev_ioring_hipri": "false", 2024-09-12T22:48:21.400 INFO:teuthology.orchestra.run.smithi066.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-12T22:48:21.400 INFO:teuthology.orchestra.run.smithi066.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-12T22:48:21.400 INFO:teuthology.orchestra.run.smithi066.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-12T22:48:21.401 INFO:teuthology.orchestra.run.smithi066.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-12T22:48:21.401 INFO:teuthology.orchestra.run.smithi066.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-12T22:48:21.401 INFO:teuthology.orchestra.run.smithi066.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-12T22:48:21.401 INFO:teuthology.orchestra.run.smithi066.stdout: "bdev_type": "", 2024-09-12T22:48:21.401 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_alloc_size": "1048576", 2024-09-12T22:48:21.402 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_allocator": "hybrid", 2024-09-12T22:48:21.402 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_buffered_io": "true", 2024-09-12T22:48:21.402 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_check_for_zeros": "false", 2024-09-12T22:48:21.402 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-12T22:48:21.402 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-12T22:48:21.402 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_compact_log_sync": "false", 2024-09-12T22:48:21.403 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-12T22:48:21.403 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-12T22:48:21.403 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-12T22:48:21.403 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-12T22:48:21.403 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_max_log_runway": "4194304", 2024-09-12T22:48:21.404 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_max_prefetch": "1048576", 2024-09-12T22:48:21.404 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_min_flush_size": "524288", 2024-09-12T22:48:21.404 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_min_log_runway": "1048576", 2024-09-12T22:48:21.404 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_replay_recovery": "false", 2024-09-12T22:48:21.404 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-12T22:48:21.405 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-12T22:48:21.405 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_sync_write": "false", 2024-09-12T22:48:21.405 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-12T22:48:21.405 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-12T22:48:21.405 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-12T22:48:21.406 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_allocation_from_file": "true", 2024-09-12T22:48:21.406 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_allocator": "hybrid", 2024-09-12T22:48:21.406 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-12T22:48:21.406 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-12T22:48:21.406 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-12T22:48:21.406 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-12T22:48:21.407 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_bdev_label_multi": "true", 2024-09-12T22:48:21.407 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-12T22:48:21.407 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-12T22:48:21.407 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-12T22:48:21.407 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-12T22:48:21.408 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-12T22:48:21.408 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_block_create": "true", 2024-09-12T22:48:21.408 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_block_db_create": "false", 2024-09-12T22:48:21.408 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_block_db_path": "", 2024-09-12T22:48:21.408 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_block_db_size": "0", 2024-09-12T22:48:21.408 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_block_path": "", 2024-09-12T22:48:21.409 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_block_preallocate_file": "false", 2024-09-12T22:48:21.409 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_block_size": "107374182400", 2024-09-12T22:48:21.409 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_block_wal_create": "false", 2024-09-12T22:48:21.409 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_block_wal_path": "", 2024-09-12T22:48:21.409 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_block_wal_size": "100663296", 2024-09-12T22:48:21.410 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_bluefs": "true", 2024-09-12T22:48:21.410 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-12T22:48:21.410 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-12T22:48:21.410 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-12T22:48:21.410 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-12T22:48:21.411 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T22:48:21.411 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T22:48:21.411 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-12T22:48:21.411 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T22:48:21.411 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_autotune": "true", 2024-09-12T22:48:21.411 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-12T22:48:21.412 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-12T22:48:21.412 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-12T22:48:21.412 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-12T22:48:21.412 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_size": "0", 2024-09-12T22:48:21.412 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-12T22:48:21.413 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-12T22:48:21.413 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-12T22:48:21.413 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-12T22:48:21.413 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_type": "2q", 2024-09-12T22:48:21.413 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-12T22:48:21.413 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_clone_cow": "true", 2024-09-12T22:48:21.414 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-12T22:48:21.414 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-12T22:48:21.414 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-12T22:48:21.414 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-12T22:48:21.414 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-12T22:48:21.415 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-12T22:48:21.415 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-12T22:48:21.415 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_compression_mode": "none", 2024-09-12T22:48:21.415 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-12T22:48:21.415 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_csum_type": "crc32c", 2024-09-12T22:48:21.416 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-12T22:48:21.416 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_debug_freelist": "false", 2024-09-12T22:48:21.416 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-12T22:48:21.416 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-12T22:48:21.416 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-12T22:48:21.417 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-12T22:48:21.417 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-12T22:48:21.417 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-12T22:48:21.417 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-12T22:48:21.417 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-12T22:48:21.417 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-12T22:48:21.418 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-12T22:48:21.418 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-12T22:48:21.418 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-12T22:48:21.418 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_debug_small_allocations": "0", 2024-09-12T22:48:21.418 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-12T22:48:21.419 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_default_buffered_read": "true", 2024-09-12T22:48:21.419 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_default_buffered_write": "false", 2024-09-12T22:48:21.419 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-12T22:48:21.419 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-12T22:48:21.419 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-12T22:48:21.420 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-12T22:48:21.420 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-12T22:48:21.420 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-12T22:48:21.420 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-12T22:48:21.420 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-12T22:48:21.420 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-12T22:48:21.421 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fail_eio": "false", 2024-09-12T22:48:21.421 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-12T22:48:21.421 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-12T22:48:21.421 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-12T22:48:21.421 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-12T22:48:21.422 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-12T22:48:21.422 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-12T22:48:21.422 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_on_mount": "false", 2024-09-12T22:48:21.422 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-12T22:48:21.422 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_on_umount": "false", 2024-09-12T22:48:21.423 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-12T22:48:21.423 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-12T22:48:21.423 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-12T22:48:21.423 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-12T22:48:21.423 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-12T22:48:21.424 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-12T22:48:21.424 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-12T22:48:21.424 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-12T22:48:21.424 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_ignore_data_csum": "false", 2024-09-12T22:48:21.424 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-12T22:48:21.424 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-12T22:48:21.425 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-12T22:48:21.425 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-12T22:48:21.425 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_log_op_age": "5.000000", 2024-09-12T22:48:21.425 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_max_alloc_size": "0", 2024-09-12T22:48:21.425 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_max_blob_size": "0", 2024-09-12T22:48:21.426 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-12T22:48:21.426 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-12T22:48:21.426 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-12T22:48:21.426 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_max_deferred_txc": "32", 2024-09-12T22:48:21.426 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_min_alloc_size": "0", 2024-09-12T22:48:21.427 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-12T22:48:21.427 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-12T22:48:21.427 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_nid_prealloc": "1024", 2024-09-12T22:48:21.427 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-12T22:48:21.427 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-12T22:48:21.427 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-12T22:48:21.428 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-12T22:48:21.428 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_retry_disk_reads": "3", 2024-09-12T22:48:21.428 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_rocksdb_cf": "true", 2024-09-12T22:48:21.428 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-12T22:48:21.428 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-12T22:48:21.429 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-12T22:48:21.429 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-12T22:48:21.429 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-12T22:48:21.429 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-12T22:48:21.430 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-12T22:48:21.430 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-12T22:48:21.430 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_spdk_mem": "512", 2024-09-12T22:48:21.430 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-12T22:48:21.430 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-12T22:48:21.430 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-12T22:48:21.431 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-12T22:48:21.431 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-12T22:48:21.431 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-12T22:48:21.431 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-12T22:48:21.431 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_tracing": "false", 2024-09-12T22:48:21.432 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-12T22:48:21.432 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-12T22:48:21.432 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-12T22:48:21.432 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-12T22:48:21.432 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-12T22:48:21.433 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-12T22:48:21.433 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-12T22:48:21.433 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-12T22:48:21.433 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-12T22:48:21.433 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_zero_block_detection": "false", 2024-09-12T22:48:21.433 INFO:teuthology.orchestra.run.smithi066.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-12T22:48:21.433 INFO:teuthology.orchestra.run.smithi066.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-12T22:48:21.433 INFO:teuthology.orchestra.run.smithi066.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-12T22:48:21.433 INFO:teuthology.orchestra.run.smithi066.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-12T22:48:21.433 INFO:teuthology.orchestra.run.smithi066.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-12T22:48:21.433 INFO:teuthology.orchestra.run.smithi066.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-12T22:48:21.434 INFO:teuthology.orchestra.run.smithi066.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-12T22:48:21.434 INFO:teuthology.orchestra.run.smithi066.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-12T22:48:21.434 INFO:teuthology.orchestra.run.smithi066.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-12T22:48:21.434 INFO:teuthology.orchestra.run.smithi066.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-12T22:48:21.434 INFO:teuthology.orchestra.run.smithi066.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-12T22:48:21.434 INFO:teuthology.orchestra.run.smithi066.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-12T22:48:21.434 INFO:teuthology.orchestra.run.smithi066.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-12T22:48:21.434 INFO:teuthology.orchestra.run.smithi066.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-12T22:48:21.434 INFO:teuthology.orchestra.run.smithi066.stdout: "cephx_cluster_require_signatures": "false", 2024-09-12T22:48:21.434 INFO:teuthology.orchestra.run.smithi066.stdout: "cephx_cluster_require_version": "2", 2024-09-12T22:48:21.434 INFO:teuthology.orchestra.run.smithi066.stdout: "cephx_require_signatures": "false", 2024-09-12T22:48:21.434 INFO:teuthology.orchestra.run.smithi066.stdout: "cephx_require_version": "2", 2024-09-12T22:48:21.434 INFO:teuthology.orchestra.run.smithi066.stdout: "cephx_service_require_signatures": "false", 2024-09-12T22:48:21.435 INFO:teuthology.orchestra.run.smithi066.stdout: "cephx_service_require_version": "2", 2024-09-12T22:48:21.435 INFO:teuthology.orchestra.run.smithi066.stdout: "cephx_sign_messages": "true", 2024-09-12T22:48:21.435 INFO:teuthology.orchestra.run.smithi066.stdout: "chdir": "", 2024-09-12T22:48:21.435 INFO:teuthology.orchestra.run.smithi066.stdout: "client_acl_type": "", 2024-09-12T22:48:21.435 INFO:teuthology.orchestra.run.smithi066.stdout: "client_asio_thread_count": "2", 2024-09-12T22:48:21.435 INFO:teuthology.orchestra.run.smithi066.stdout: "client_cache_mid": "0.750000", 2024-09-12T22:48:21.435 INFO:teuthology.orchestra.run.smithi066.stdout: "client_cache_size": "16384", 2024-09-12T22:48:21.435 INFO:teuthology.orchestra.run.smithi066.stdout: "client_caps_release_delay": "5", 2024-09-12T22:48:21.435 INFO:teuthology.orchestra.run.smithi066.stdout: "client_check_pool_perm": "true", 2024-09-12T22:48:21.435 INFO:teuthology.orchestra.run.smithi066.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-12T22:48:21.435 INFO:teuthology.orchestra.run.smithi066.stdout: "client_debug_force_sync_read": "false", 2024-09-12T22:48:21.435 INFO:teuthology.orchestra.run.smithi066.stdout: "client_debug_getattr_caps": "false", 2024-09-12T22:48:21.435 INFO:teuthology.orchestra.run.smithi066.stdout: "client_debug_inject_features": "", 2024-09-12T22:48:21.436 INFO:teuthology.orchestra.run.smithi066.stdout: "client_debug_inject_tick_delay": "0", 2024-09-12T22:48:21.436 INFO:teuthology.orchestra.run.smithi066.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-12T22:48:21.436 INFO:teuthology.orchestra.run.smithi066.stdout: "client_die_on_failed_remount": "false", 2024-09-12T22:48:21.436 INFO:teuthology.orchestra.run.smithi066.stdout: "client_dirsize_rbytes": "true", 2024-09-12T22:48:21.436 INFO:teuthology.orchestra.run.smithi066.stdout: "client_force_lazyio": "false", 2024-09-12T22:48:21.436 INFO:teuthology.orchestra.run.smithi066.stdout: "client_fs": "", 2024-09-12T22:48:21.436 INFO:teuthology.orchestra.run.smithi066.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-12T22:48:21.436 INFO:teuthology.orchestra.run.smithi066.stdout: "client_inject_release_failure": "false", 2024-09-12T22:48:21.436 INFO:teuthology.orchestra.run.smithi066.stdout: "client_max_inline_size": "4096", 2024-09-12T22:48:21.436 INFO:teuthology.orchestra.run.smithi066.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-12T22:48:21.436 INFO:teuthology.orchestra.run.smithi066.stdout: "client_mds_namespace": "", 2024-09-12T22:48:21.436 INFO:teuthology.orchestra.run.smithi066.stdout: "client_metadata": "", 2024-09-12T22:48:21.437 INFO:teuthology.orchestra.run.smithi066.stdout: "client_mount_gid": "-1", 2024-09-12T22:48:21.437 INFO:teuthology.orchestra.run.smithi066.stdout: "client_mount_timeout": "300", 2024-09-12T22:48:21.437 INFO:teuthology.orchestra.run.smithi066.stdout: "client_mount_uid": "-1", 2024-09-12T22:48:21.437 INFO:teuthology.orchestra.run.smithi066.stdout: "client_mountpoint": "/", 2024-09-12T22:48:21.437 INFO:teuthology.orchestra.run.smithi066.stdout: "client_notify_timeout": "10", 2024-09-12T22:48:21.437 INFO:teuthology.orchestra.run.smithi066.stdout: "client_oc": "true", 2024-09-12T22:48:21.437 INFO:teuthology.orchestra.run.smithi066.stdout: "client_oc_max_dirty": "104857600", 2024-09-12T22:48:21.437 INFO:teuthology.orchestra.run.smithi066.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-12T22:48:21.437 INFO:teuthology.orchestra.run.smithi066.stdout: "client_oc_max_objects": "1000", 2024-09-12T22:48:21.437 INFO:teuthology.orchestra.run.smithi066.stdout: "client_oc_size": "209715200", 2024-09-12T22:48:21.437 INFO:teuthology.orchestra.run.smithi066.stdout: "client_oc_target_dirty": "8388608", 2024-09-12T22:48:21.437 INFO:teuthology.orchestra.run.smithi066.stdout: "client_permissions": "true", 2024-09-12T22:48:21.437 INFO:teuthology.orchestra.run.smithi066.stdout: "client_quota": "true", 2024-09-12T22:48:21.437 INFO:teuthology.orchestra.run.smithi066.stdout: "client_quota_df": "true", 2024-09-12T22:48:21.438 INFO:teuthology.orchestra.run.smithi066.stdout: "client_readahead_max_bytes": "0", 2024-09-12T22:48:21.438 INFO:teuthology.orchestra.run.smithi066.stdout: "client_readahead_max_periods": "4", 2024-09-12T22:48:21.438 INFO:teuthology.orchestra.run.smithi066.stdout: "client_readahead_min": "131072", 2024-09-12T22:48:21.438 INFO:teuthology.orchestra.run.smithi066.stdout: "client_reconnect_stale": "false", 2024-09-12T22:48:21.438 INFO:teuthology.orchestra.run.smithi066.stdout: "client_shutdown_timeout": "30", 2024-09-12T22:48:21.438 INFO:teuthology.orchestra.run.smithi066.stdout: "client_snapdir": ".snap", 2024-09-12T22:48:21.438 INFO:teuthology.orchestra.run.smithi066.stdout: "client_tick_interval": "1", 2024-09-12T22:48:21.438 INFO:teuthology.orchestra.run.smithi066.stdout: "client_trace": "", 2024-09-12T22:48:21.438 INFO:teuthology.orchestra.run.smithi066.stdout: "client_try_dentry_invalidate": "false", 2024-09-12T22:48:21.438 INFO:teuthology.orchestra.run.smithi066.stdout: "client_use_faked_inos": "false", 2024-09-12T22:48:21.438 INFO:teuthology.orchestra.run.smithi066.stdout: "client_use_random_mds": "false", 2024-09-12T22:48:21.438 INFO:teuthology.orchestra.run.smithi066.stdout: "clog_to_graylog": "false", 2024-09-12T22:48:21.438 INFO:teuthology.orchestra.run.smithi066.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-12T22:48:21.438 INFO:teuthology.orchestra.run.smithi066.stdout: "clog_to_graylog_port": "12201", 2024-09-12T22:48:21.439 INFO:teuthology.orchestra.run.smithi066.stdout: "clog_to_monitors": "default=true", 2024-09-12T22:48:21.439 INFO:teuthology.orchestra.run.smithi066.stdout: "clog_to_syslog": "false", 2024-09-12T22:48:21.439 INFO:teuthology.orchestra.run.smithi066.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-12T22:48:21.439 INFO:teuthology.orchestra.run.smithi066.stdout: "clog_to_syslog_level": "info", 2024-09-12T22:48:21.439 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_addr": "-", 2024-09-12T22:48:21.439 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_network": "", 2024-09-12T22:48:21.439 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_network_interface": "", 2024-09-12T22:48:21.439 INFO:teuthology.orchestra.run.smithi066.stdout: "compressor_zlib_isal": "false", 2024-09-12T22:48:21.439 INFO:teuthology.orchestra.run.smithi066.stdout: "compressor_zlib_level": "5", 2024-09-12T22:48:21.439 INFO:teuthology.orchestra.run.smithi066.stdout: "compressor_zlib_winsize": "-15", 2024-09-12T22:48:21.439 INFO:teuthology.orchestra.run.smithi066.stdout: "compressor_zstd_level": "1", 2024-09-12T22:48:21.439 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-12T22:48:21.440 INFO:teuthology.orchestra.run.smithi066.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-12T22:48:21.440 INFO:teuthology.orchestra.run.smithi066.stdout: "crimson_alien_op_num_threads": "6", 2024-09-12T22:48:21.440 INFO:teuthology.orchestra.run.smithi066.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-12T22:48:21.440 INFO:teuthology.orchestra.run.smithi066.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-12T22:48:21.440 INFO:teuthology.orchestra.run.smithi066.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-12T22:48:21.440 INFO:teuthology.orchestra.run.smithi066.stdout: "crimson_osd_stat_interval": "0", 2024-09-12T22:48:21.440 INFO:teuthology.orchestra.run.smithi066.stdout: "crimson_seastar_cpu_cores": "", 2024-09-12T22:48:21.440 INFO:teuthology.orchestra.run.smithi066.stdout: "crimson_seastar_num_threads": "0", 2024-09-12T22:48:21.440 INFO:teuthology.orchestra.run.smithi066.stdout: "crush_location": "", 2024-09-12T22:48:21.440 INFO:teuthology.orchestra.run.smithi066.stdout: "crush_location_hook": "", 2024-09-12T22:48:21.440 INFO:teuthology.orchestra.run.smithi066.stdout: "crush_location_hook_timeout": "10", 2024-09-12T22:48:21.440 INFO:teuthology.orchestra.run.smithi066.stdout: "daemonize": "false", 2024-09-12T22:48:21.440 INFO:teuthology.orchestra.run.smithi066.stdout: "daos_pool": "tank", 2024-09-12T22:48:21.441 INFO:teuthology.orchestra.run.smithi066.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-12T22:48:21.441 INFO:teuthology.orchestra.run.smithi066.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-12T22:48:21.441 INFO:teuthology.orchestra.run.smithi066.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-12T22:48:21.441 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_alienstore": "0/5", 2024-09-12T22:48:21.441 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_allow_any_pool_priority": "false", 2024-09-12T22:48:21.441 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_asok": "1/5", 2024-09-12T22:48:21.441 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_asok_assert_abort": "false", 2024-09-12T22:48:21.441 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_asserts_on_shutdown": "true", 2024-09-12T22:48:21.441 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_auth": "20/20", 2024-09-12T22:48:21.441 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_bdev": "1/3", 2024-09-12T22:48:21.441 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_bluefs": "1/5", 2024-09-12T22:48:21.441 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_bluestore": "1/5", 2024-09-12T22:48:21.441 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_buffer": "0/1", 2024-09-12T22:48:21.442 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_ceph_exporter": "1/5", 2024-09-12T22:48:21.442 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_cephfs_mirror": "0/5", 2024-09-12T22:48:21.442 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_cephsqlite": "0/5", 2024-09-12T22:48:21.442 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_client": "0/5", 2024-09-12T22:48:21.442 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_compressor": "1/5", 2024-09-12T22:48:21.442 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_context": "0/1", 2024-09-12T22:48:21.442 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_crimson_interrupt": "0/5", 2024-09-12T22:48:21.442 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_crush": "1/1", 2024-09-12T22:48:21.442 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_crypto": "1/5", 2024-09-12T22:48:21.442 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_cyanstore": "0/5", 2024-09-12T22:48:21.442 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_deliberately_leak_memory": "false", 2024-09-12T22:48:21.442 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_disable_randomized_ping": "false", 2024-09-12T22:48:21.442 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_dpdk": "1/5", 2024-09-12T22:48:21.443 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_eventtrace": "1/5", 2024-09-12T22:48:21.443 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_filer": "0/1", 2024-09-12T22:48:21.443 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_filestore": "1/3", 2024-09-12T22:48:21.443 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_finisher": "1/1", 2024-09-12T22:48:21.443 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_fuse": "1/5", 2024-09-12T22:48:21.443 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_heartbeat_testing_span": "0", 2024-09-12T22:48:21.443 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_heartbeatmap": "1/5", 2024-09-12T22:48:21.443 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-12T22:48:21.443 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_javaclient": "1/5", 2024-09-12T22:48:21.443 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_journal": "1/3", 2024-09-12T22:48:21.443 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_journaler": "0/5", 2024-09-12T22:48:21.443 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_kstore": "1/5", 2024-09-12T22:48:21.443 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_lockdep": "0/1", 2024-09-12T22:48:21.443 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_mclock": "1/5", 2024-09-12T22:48:21.444 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_mds": "1/5", 2024-09-12T22:48:21.444 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_mds_balancer": "1/5", 2024-09-12T22:48:21.444 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_mds_locker": "1/5", 2024-09-12T22:48:21.444 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_mds_log": "1/5", 2024-09-12T22:48:21.444 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_mds_log_expire": "1/5", 2024-09-12T22:48:21.444 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_mds_migrator": "1/5", 2024-09-12T22:48:21.444 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_mds_quiesce": "3/5", 2024-09-12T22:48:21.444 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_memstore": "1/5", 2024-09-12T22:48:21.444 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_mgr": "2/5", 2024-09-12T22:48:21.444 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_mgrc": "1/5", 2024-09-12T22:48:21.444 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_mon": "20/20", 2024-09-12T22:48:21.444 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_monc": "0/10", 2024-09-12T22:48:21.444 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_ms": "1/1", 2024-09-12T22:48:21.445 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_none": "0/5", 2024-09-12T22:48:21.445 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_objclass": "0/5", 2024-09-12T22:48:21.445 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_objectcacher": "0/5", 2024-09-12T22:48:21.445 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_objecter": "0/1", 2024-09-12T22:48:21.445 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_optracker": "0/5", 2024-09-12T22:48:21.445 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_osd": "1/5", 2024-09-12T22:48:21.445 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_paxos": "20/20", 2024-09-12T22:48:21.445 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_perfcounter": "1/5", 2024-09-12T22:48:21.445 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_prioritycache": "1/5", 2024-09-12T22:48:21.445 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_rados": "0/5", 2024-09-12T22:48:21.445 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_rbd": "0/5", 2024-09-12T22:48:21.445 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_rbd_mirror": "0/5", 2024-09-12T22:48:21.445 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_rbd_pwl": "0/5", 2024-09-12T22:48:21.446 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_rbd_replay": "0/5", 2024-09-12T22:48:21.446 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_refs": "0/0", 2024-09-12T22:48:21.446 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_reserver": "1/1", 2024-09-12T22:48:21.446 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_rgw": "1/5", 2024-09-12T22:48:21.446 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_rgw_access": "1/5", 2024-09-12T22:48:21.446 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_rgw_datacache": "1/5", 2024-09-12T22:48:21.446 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_rgw_dbstore": "1/5", 2024-09-12T22:48:21.446 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_rgw_flight": "1/5", 2024-09-12T22:48:21.446 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-12T22:48:21.446 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_rgw_sync": "1/5", 2024-09-12T22:48:21.447 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_rocksdb": "4/5", 2024-09-12T22:48:21.447 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_seastore": "0/5", 2024-09-12T22:48:21.447 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_seastore_backref": "0/5", 2024-09-12T22:48:21.447 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_seastore_cache": "0/5", 2024-09-12T22:48:21.447 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_seastore_cleaner": "0/5", 2024-09-12T22:48:21.447 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_seastore_device": "0/5", 2024-09-12T22:48:21.447 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_seastore_epm": "0/5", 2024-09-12T22:48:21.447 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-12T22:48:21.447 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_seastore_journal": "0/5", 2024-09-12T22:48:21.447 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_seastore_lba": "0/5", 2024-09-12T22:48:21.447 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_seastore_odata": "0/5", 2024-09-12T22:48:21.447 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_seastore_omap": "0/5", 2024-09-12T22:48:21.447 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_seastore_onode": "0/5", 2024-09-12T22:48:21.448 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_seastore_t": "0/5", 2024-09-12T22:48:21.448 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_seastore_tm": "0/5", 2024-09-12T22:48:21.448 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_striper": "0/1", 2024-09-12T22:48:21.448 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_test": "0/5", 2024-09-12T22:48:21.448 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_throttle": "1/1", 2024-09-12T22:48:21.448 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_timer": "0/1", 2024-09-12T22:48:21.448 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_tp": "0/5", 2024-09-12T22:48:21.448 INFO:teuthology.orchestra.run.smithi066.stdout: "debug_trace": "1/5", 2024-09-12T22:48:21.448 INFO:teuthology.orchestra.run.smithi066.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-12T22:48:21.448 INFO:teuthology.orchestra.run.smithi066.stdout: "device_failure_prediction_mode": "none", 2024-09-12T22:48:21.448 INFO:teuthology.orchestra.run.smithi066.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-12T22:48:21.448 INFO:teuthology.orchestra.run.smithi066.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-09-12T22:48:21.449 INFO:teuthology.orchestra.run.smithi066.stdout: "err_to_graylog": "false", 2024-09-12T22:48:21.449 INFO:teuthology.orchestra.run.smithi066.stdout: "err_to_journald": "false", 2024-09-12T22:48:21.449 INFO:teuthology.orchestra.run.smithi066.stdout: "err_to_stderr": "true", 2024-09-12T22:48:21.449 INFO:teuthology.orchestra.run.smithi066.stdout: "err_to_syslog": "false", 2024-09-12T22:48:21.449 INFO:teuthology.orchestra.run.smithi066.stdout: "event_tracing": "false", 2024-09-12T22:48:21.449 INFO:teuthology.orchestra.run.smithi066.stdout: "exporter_addr": "0.0.0.0", 2024-09-12T22:48:21.449 INFO:teuthology.orchestra.run.smithi066.stdout: "exporter_http_port": "9926", 2024-09-12T22:48:21.449 INFO:teuthology.orchestra.run.smithi066.stdout: "exporter_prio_limit": "5", 2024-09-12T22:48:21.449 INFO:teuthology.orchestra.run.smithi066.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-12T22:48:21.449 INFO:teuthology.orchestra.run.smithi066.stdout: "exporter_sort_metrics": "true", 2024-09-12T22:48:21.449 INFO:teuthology.orchestra.run.smithi066.stdout: "exporter_stats_period": "5", 2024-09-12T22:48:21.449 INFO:teuthology.orchestra.run.smithi066.stdout: "fake_statfs_for_testing": "0", 2024-09-12T22:48:21.449 INFO:teuthology.orchestra.run.smithi066.stdout: "fatal_signal_handlers": "true", 2024-09-12T22:48:21.449 INFO:teuthology.orchestra.run.smithi066.stdout: "filer_max_purge_ops": "10", 2024-09-12T22:48:21.450 INFO:teuthology.orchestra.run.smithi066.stdout: "filer_max_truncate_ops": "128", 2024-09-12T22:48:21.450 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_apply_finisher_threads": "1", 2024-09-12T22:48:21.450 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_blackhole": "false", 2024-09-12T22:48:21.450 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_btrfs_clone_range": "true", 2024-09-12T22:48:21.450 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_btrfs_snap": "true", 2024-09-12T22:48:21.450 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_caller_concurrency": "10", 2024-09-12T22:48:21.450 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_collect_device_partition_information": "true", 2024-09-12T22:48:21.450 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_commit_timeout": "600.000000", 2024-09-12T22:48:21.450 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_debug_inject_read_err": "false", 2024-09-12T22:48:21.450 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_debug_omap_check": "false", 2024-09-12T22:48:21.450 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_debug_random_read_err": "0.000000", 2024-09-12T22:48:21.450 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_debug_verify_split": "false", 2024-09-12T22:48:21.450 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_dump_file": "", 2024-09-12T22:48:21.451 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-12T22:48:21.451 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-12T22:48:21.451 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_fadvise": "true", 2024-09-12T22:48:21.451 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_fail_eio": "true", 2024-09-12T22:48:21.451 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_fd_cache_shards": "16", 2024-09-12T22:48:21.451 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_fd_cache_size": "128", 2024-09-12T22:48:21.451 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_fiemap": "false", 2024-09-12T22:48:21.451 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_fiemap_threshold": "4096", 2024-09-12T22:48:21.451 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-12T22:48:21.451 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-12T22:48:21.451 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_inject_stall": "0", 2024-09-12T22:48:21.451 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_journal_parallel": "false", 2024-09-12T22:48:21.451 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_journal_trailing": "false", 2024-09-12T22:48:21.451 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_journal_writeahead": "false", 2024-09-12T22:48:21.452 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_kill_at": "0", 2024-09-12T22:48:21.452 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-12T22:48:21.452 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-12T22:48:21.452 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-12T22:48:21.452 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-12T22:48:21.452 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-12T22:48:21.452 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_max_inline_xattrs": "0", 2024-09-12T22:48:21.452 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-12T22:48:21.452 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-12T22:48:21.452 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-12T22:48:21.452 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-12T22:48:21.452 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_max_xattr_value_size": "0", 2024-09-12T22:48:21.453 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-12T22:48:21.453 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-12T22:48:21.453 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-12T22:48:21.453 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_merge_threshold": "-10", 2024-09-12T22:48:21.453 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-12T22:48:21.453 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_odsync_write": "false", 2024-09-12T22:48:21.453 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_omap_backend": "rocksdb", 2024-09-12T22:48:21.453 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_omap_backend_path": "", 2024-09-12T22:48:21.453 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-12T22:48:21.453 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-12T22:48:21.453 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-12T22:48:21.453 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_op_thread_timeout": "60", 2024-09-12T22:48:21.453 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_op_threads": "2", 2024-09-12T22:48:21.454 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_punch_hole": "false", 2024-09-12T22:48:21.454 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-12T22:48:21.454 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-12T22:48:21.454 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-12T22:48:21.454 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-12T22:48:21.454 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-12T22:48:21.454 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-12T22:48:21.454 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-12T22:48:21.454 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-12T22:48:21.454 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-12T22:48:21.454 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_queue_max_ops": "50", 2024-09-12T22:48:21.454 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-12T22:48:21.454 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_seek_data_hole": "false", 2024-09-12T22:48:21.455 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_sloppy_crc": "false", 2024-09-12T22:48:21.455 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-12T22:48:21.455 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_splice": "false", 2024-09-12T22:48:21.455 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_split_multiple": "2", 2024-09-12T22:48:21.455 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_split_rand_factor": "20", 2024-09-12T22:48:21.455 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_update_to": "1000", 2024-09-12T22:48:21.455 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-12T22:48:21.455 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-12T22:48:21.455 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-12T22:48:21.455 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-12T22:48:21.455 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-12T22:48:21.455 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-12T22:48:21.455 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_wbthrottle_enable": "true", 2024-09-12T22:48:21.456 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-12T22:48:21.456 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-12T22:48:21.456 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-12T22:48:21.456 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-12T22:48:21.456 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-12T22:48:21.456 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-12T22:48:21.456 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_xfs_extsize": "false", 2024-09-12T22:48:21.456 INFO:teuthology.orchestra.run.smithi066.stdout: "filestore_zfs_snap": "false", 2024-09-12T22:48:21.456 INFO:teuthology.orchestra.run.smithi066.stdout: "fio_dir": "/tmp/fio", 2024-09-12T22:48:21.456 INFO:teuthology.orchestra.run.smithi066.stdout: "fsid": "5714c6a5-034c-4330-a57b-d22492ad8e43", 2024-09-12T22:48:21.456 INFO:teuthology.orchestra.run.smithi066.stdout: "fuse_allow_other": "true", 2024-09-12T22:48:21.456 INFO:teuthology.orchestra.run.smithi066.stdout: "fuse_atomic_o_trunc": "true", 2024-09-12T22:48:21.456 INFO:teuthology.orchestra.run.smithi066.stdout: "fuse_big_writes": "true", 2024-09-12T22:48:21.457 INFO:teuthology.orchestra.run.smithi066.stdout: "fuse_debug": "false", 2024-09-12T22:48:21.457 INFO:teuthology.orchestra.run.smithi066.stdout: "fuse_default_permissions": "false", 2024-09-12T22:48:21.457 INFO:teuthology.orchestra.run.smithi066.stdout: "fuse_disable_pagecache": "false", 2024-09-12T22:48:21.457 INFO:teuthology.orchestra.run.smithi066.stdout: "fuse_max_write": "0", 2024-09-12T22:48:21.457 INFO:teuthology.orchestra.run.smithi066.stdout: "fuse_multithreaded": "true", 2024-09-12T22:48:21.457 INFO:teuthology.orchestra.run.smithi066.stdout: "fuse_require_active_mds": "true", 2024-09-12T22:48:21.457 INFO:teuthology.orchestra.run.smithi066.stdout: "fuse_set_user_groups": "true", 2024-09-12T22:48:21.457 INFO:teuthology.orchestra.run.smithi066.stdout: "fuse_splice_move": "true", 2024-09-12T22:48:21.457 INFO:teuthology.orchestra.run.smithi066.stdout: "fuse_splice_read": "true", 2024-09-12T22:48:21.457 INFO:teuthology.orchestra.run.smithi066.stdout: "fuse_splice_write": "true", 2024-09-12T22:48:21.457 INFO:teuthology.orchestra.run.smithi066.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-12T22:48:21.457 INFO:teuthology.orchestra.run.smithi066.stdout: "fuse_use_invalidate_cb": "true", 2024-09-12T22:48:21.457 INFO:teuthology.orchestra.run.smithi066.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-12T22:48:21.458 INFO:teuthology.orchestra.run.smithi066.stdout: "gss_target_name": "ceph", 2024-09-12T22:48:21.458 INFO:teuthology.orchestra.run.smithi066.stdout: "heartbeat_file": "", 2024-09-12T22:48:21.458 INFO:teuthology.orchestra.run.smithi066.stdout: "heartbeat_inject_failure": "0", 2024-09-12T22:48:21.458 INFO:teuthology.orchestra.run.smithi066.stdout: "heartbeat_interval": "5", 2024-09-12T22:48:21.458 INFO:teuthology.orchestra.run.smithi066.stdout: "host": "smithi066", 2024-09-12T22:48:21.458 INFO:teuthology.orchestra.run.smithi066.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-12T22:48:21.458 INFO:teuthology.orchestra.run.smithi066.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-12T22:48:21.458 INFO:teuthology.orchestra.run.smithi066.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-12T22:48:21.458 INFO:teuthology.orchestra.run.smithi066.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-12T22:48:21.458 INFO:teuthology.orchestra.run.smithi066.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-12T22:48:21.458 INFO:teuthology.orchestra.run.smithi066.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-12T22:48:21.458 INFO:teuthology.orchestra.run.smithi066.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-12T22:48:21.458 INFO:teuthology.orchestra.run.smithi066.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-12T22:48:21.458 INFO:teuthology.orchestra.run.smithi066.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-12T22:48:21.459 INFO:teuthology.orchestra.run.smithi066.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-12T22:48:21.459 INFO:teuthology.orchestra.run.smithi066.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-12T22:48:21.459 INFO:teuthology.orchestra.run.smithi066.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-12T22:48:21.459 INFO:teuthology.orchestra.run.smithi066.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-12T22:48:21.459 INFO:teuthology.orchestra.run.smithi066.stdout: "inject_early_sigterm": "false", 2024-09-12T22:48:21.459 INFO:teuthology.orchestra.run.smithi066.stdout: "jaeger_agent_port": "6799", 2024-09-12T22:48:21.459 INFO:teuthology.orchestra.run.smithi066.stdout: "jaeger_tracing_enable": "false", 2024-09-12T22:48:21.459 INFO:teuthology.orchestra.run.smithi066.stdout: "journal_aio": "true", 2024-09-12T22:48:21.459 INFO:teuthology.orchestra.run.smithi066.stdout: "journal_align_min_size": "65536", 2024-09-12T22:48:21.459 INFO:teuthology.orchestra.run.smithi066.stdout: "journal_block_align": "true", 2024-09-12T22:48:21.459 INFO:teuthology.orchestra.run.smithi066.stdout: "journal_block_size": "4096", 2024-09-12T22:48:21.459 INFO:teuthology.orchestra.run.smithi066.stdout: "journal_dio": "true", 2024-09-12T22:48:21.459 INFO:teuthology.orchestra.run.smithi066.stdout: "journal_discard": "false", 2024-09-12T22:48:21.460 INFO:teuthology.orchestra.run.smithi066.stdout: "journal_force_aio": "false", 2024-09-12T22:48:21.460 INFO:teuthology.orchestra.run.smithi066.stdout: "journal_ignore_corruption": "false", 2024-09-12T22:48:21.460 INFO:teuthology.orchestra.run.smithi066.stdout: "journal_max_write_bytes": "10485760", 2024-09-12T22:48:21.460 INFO:teuthology.orchestra.run.smithi066.stdout: "journal_max_write_entries": "100", 2024-09-12T22:48:21.460 INFO:teuthology.orchestra.run.smithi066.stdout: "journal_replay_from": "0", 2024-09-12T22:48:21.460 INFO:teuthology.orchestra.run.smithi066.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-12T22:48:21.460 INFO:teuthology.orchestra.run.smithi066.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-12T22:48:21.460 INFO:teuthology.orchestra.run.smithi066.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-12T22:48:21.460 INFO:teuthology.orchestra.run.smithi066.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-12T22:48:21.460 INFO:teuthology.orchestra.run.smithi066.stdout: "journal_write_header_frequency": "0", 2024-09-12T22:48:21.460 INFO:teuthology.orchestra.run.smithi066.stdout: "journal_zero_on_create": "false", 2024-09-12T22:48:21.460 INFO:teuthology.orchestra.run.smithi066.stdout: "journaler_prefetch_periods": "10", 2024-09-12T22:48:21.460 INFO:teuthology.orchestra.run.smithi066.stdout: "journaler_prezero_periods": "5", 2024-09-12T22:48:21.460 INFO:teuthology.orchestra.run.smithi066.stdout: "journaler_write_head_interval": "15", 2024-09-12T22:48:21.461 INFO:teuthology.orchestra.run.smithi066.stdout: "key": "", 2024-09-12T22:48:21.461 INFO:teuthology.orchestra.run.smithi066.stdout: "keyfile": "", 2024-09-12T22:48:21.461 INFO:teuthology.orchestra.run.smithi066.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-12T22:48:21.461 INFO:teuthology.orchestra.run.smithi066.stdout: "kstore_backend": "rocksdb", 2024-09-12T22:48:21.461 INFO:teuthology.orchestra.run.smithi066.stdout: "kstore_default_stripe_size": "65536", 2024-09-12T22:48:21.461 INFO:teuthology.orchestra.run.smithi066.stdout: "kstore_fsck_on_mount": "false", 2024-09-12T22:48:21.461 INFO:teuthology.orchestra.run.smithi066.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-12T22:48:21.461 INFO:teuthology.orchestra.run.smithi066.stdout: "kstore_max_bytes": "67108864", 2024-09-12T22:48:21.462 INFO:teuthology.orchestra.run.smithi066.stdout: "kstore_max_ops": "512", 2024-09-12T22:48:21.462 INFO:teuthology.orchestra.run.smithi066.stdout: "kstore_nid_prealloc": "1024", 2024-09-12T22:48:21.462 INFO:teuthology.orchestra.run.smithi066.stdout: "kstore_onode_map_size": "1024", 2024-09-12T22:48:21.462 INFO:teuthology.orchestra.run.smithi066.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-12T22:48:21.462 INFO:teuthology.orchestra.run.smithi066.stdout: "kstore_sync_submit_transaction": "false", 2024-09-12T22:48:21.462 INFO:teuthology.orchestra.run.smithi066.stdout: "kstore_sync_transaction": "false", 2024-09-12T22:48:21.462 INFO:teuthology.orchestra.run.smithi066.stdout: "librados_thread_count": "2", 2024-09-12T22:48:21.462 INFO:teuthology.orchestra.run.smithi066.stdout: "lockdep": "false", 2024-09-12T22:48:21.462 INFO:teuthology.orchestra.run.smithi066.stdout: "lockdep_force_backtrace": "false", 2024-09-12T22:48:21.462 INFO:teuthology.orchestra.run.smithi066.stdout: "log_coarse_timestamps": "true", 2024-09-12T22:48:21.462 INFO:teuthology.orchestra.run.smithi066.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-12T22:48:21.462 INFO:teuthology.orchestra.run.smithi066.stdout: "log_flush_on_exit": "false", 2024-09-12T22:48:21.462 INFO:teuthology.orchestra.run.smithi066.stdout: "log_graylog_host": "127.0.0.1", 2024-09-12T22:48:21.463 INFO:teuthology.orchestra.run.smithi066.stdout: "log_graylog_port": "12201", 2024-09-12T22:48:21.463 INFO:teuthology.orchestra.run.smithi066.stdout: "log_max_new": "1000", 2024-09-12T22:48:21.463 INFO:teuthology.orchestra.run.smithi066.stdout: "log_max_recent": "10000", 2024-09-12T22:48:21.463 INFO:teuthology.orchestra.run.smithi066.stdout: "log_stderr_prefix": "", 2024-09-12T22:48:21.463 INFO:teuthology.orchestra.run.smithi066.stdout: "log_stop_at_utilization": "0.970000", 2024-09-12T22:48:21.463 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": "true", 2024-09-12T22:48:21.463 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_graylog": "false", 2024-09-12T22:48:21.463 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_journald": "false", 2024-09-12T22:48:21.463 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_stderr": "false", 2024-09-12T22:48:21.463 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_syslog": "false", 2024-09-12T22:48:21.463 INFO:teuthology.orchestra.run.smithi066.stdout: "max_rotating_auth_attempts": "10", 2024-09-12T22:48:21.463 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-12T22:48:21.463 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_action_on_write_error": "1", 2024-09-12T22:48:21.464 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_alternate_name_max": "8192", 2024-09-12T22:48:21.464 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_asio_thread_count": "2", 2024-09-12T22:48:21.464 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_bal_export_pin": "true", 2024-09-12T22:48:21.464 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_bal_fragment_dirs": "true", 2024-09-12T22:48:21.464 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-12T22:48:21.464 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_bal_fragment_interval": "5", 2024-09-12T22:48:21.464 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-12T22:48:21.464 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-12T22:48:21.464 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_bal_interval": "10", 2024-09-12T22:48:21.464 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_bal_max": "-1", 2024-09-12T22:48:21.464 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_bal_max_until": "-1", 2024-09-12T22:48:21.464 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_bal_merge_size": "50", 2024-09-12T22:48:21.464 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_bal_midchunk": "0.300000", 2024-09-12T22:48:21.465 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-12T22:48:21.465 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_bal_min_start": "0.200000", 2024-09-12T22:48:21.465 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_bal_minchunk": "0.001000", 2024-09-12T22:48:21.465 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_bal_mode": "0", 2024-09-12T22:48:21.465 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_bal_need_max": "1.200000", 2024-09-12T22:48:21.465 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_bal_need_min": "0.800000", 2024-09-12T22:48:21.465 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_bal_overload_epochs": "2", 2024-09-12T22:48:21.465 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-12T22:48:21.465 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-12T22:48:21.465 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_bal_split_bits": "3", 2024-09-12T22:48:21.465 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-12T22:48:21.465 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_bal_split_size": "10000", 2024-09-12T22:48:21.465 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-12T22:48:21.466 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_bal_target_decay": "10.000000", 2024-09-12T22:48:21.466 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-12T22:48:21.466 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_beacon_grace": "15.000000", 2024-09-12T22:48:21.466 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_beacon_interval": "4.000000", 2024-09-12T22:48:21.466 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-12T22:48:21.466 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-12T22:48:21.466 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_cache_mid": "0.700000", 2024-09-12T22:48:21.466 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-12T22:48:21.466 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_cache_quiesce_delay": "0", 2024-09-12T22:48:21.466 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-12T22:48:21.466 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-12T22:48:21.466 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-12T22:48:21.466 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_cache_release_free_interval": "10", 2024-09-12T22:48:21.467 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_cache_reservation": "0.050000", 2024-09-12T22:48:21.467 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-12T22:48:21.467 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_cache_trim_interval": "1", 2024-09-12T22:48:21.467 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_cache_trim_threshold": "262144", 2024-09-12T22:48:21.467 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-12T22:48:21.467 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-12T22:48:21.467 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-12T22:48:21.467 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_client_prealloc_inos": "1000", 2024-09-12T22:48:21.467 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-12T22:48:21.467 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_connect_bootstrapping": "false", 2024-09-12T22:48:21.467 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_damage_table_max_entries": "10000", 2024-09-12T22:48:21.467 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-12T22:48:21.467 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_debug_auth_pins": "false", 2024-09-12T22:48:21.468 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_debug_frag": "false", 2024-09-12T22:48:21.468 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_debug_scatterstat": "false", 2024-09-12T22:48:21.468 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_debug_subtrees": "false", 2024-09-12T22:48:21.468 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_decay_halflife": "5.000000", 2024-09-12T22:48:21.468 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_default_dir_hash": "2", 2024-09-12T22:48:21.468 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_defer_session_stale": "true", 2024-09-12T22:48:21.468 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_deny_all_reconnect": "false", 2024-09-12T22:48:21.468 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_dir_keys_per_op": "16384", 2024-09-12T22:48:21.468 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_dir_max_commit_size": "10", 2024-09-12T22:48:21.468 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_dir_max_entries": "0", 2024-09-12T22:48:21.468 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_dir_prefetch": "true", 2024-09-12T22:48:21.468 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-12T22:48:21.468 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-12T22:48:21.469 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_dump_cache_on_map": "false", 2024-09-12T22:48:21.469 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-12T22:48:21.469 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-12T22:48:21.469 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_early_reply": "true", 2024-09-12T22:48:21.469 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_enable_op_tracker": "true", 2024-09-12T22:48:21.469 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_enforce_unique_name": "true", 2024-09-12T22:48:21.469 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-12T22:48:21.469 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-12T22:48:21.469 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_export_ephemeral_random": "true", 2024-09-12T22:48:21.469 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-12T22:48:21.469 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-12T22:48:21.469 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-12T22:48:21.469 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-12T22:48:21.470 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-12T22:48:21.470 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-12T22:48:21.470 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-12T22:48:21.470 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-12T22:48:21.470 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_health_summarize_threshold": "10", 2024-09-12T22:48:21.470 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-12T22:48:21.470 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-12T22:48:21.470 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_inject_health_dummy": "false", 2024-09-12T22:48:21.470 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-12T22:48:21.470 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_inject_migrator_session_race": "false", 2024-09-12T22:48:21.470 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-12T22:48:21.470 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-12T22:48:21.470 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-12T22:48:21.471 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_join_fs": "", 2024-09-12T22:48:21.471 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_journal_format": "1", 2024-09-12T22:48:21.471 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-12T22:48:21.471 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_kill_create_at": "0", 2024-09-12T22:48:21.471 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_kill_export_at": "0", 2024-09-12T22:48:21.471 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_kill_import_at": "0", 2024-09-12T22:48:21.471 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_kill_journal_at": "0", 2024-09-12T22:48:21.471 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_kill_journal_expire_at": "0", 2024-09-12T22:48:21.471 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_kill_journal_replay_at": "0", 2024-09-12T22:48:21.471 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_kill_link_at": "0", 2024-09-12T22:48:21.471 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_kill_mdstable_at": "0", 2024-09-12T22:48:21.471 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_kill_openc_at": "0", 2024-09-12T22:48:21.471 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_kill_rename_at": "0", 2024-09-12T22:48:21.471 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_kill_shutdown_at": "0", 2024-09-12T22:48:21.472 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_log_event_large_threshold": "524288", 2024-09-12T22:48:21.472 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_log_events_per_segment": "1024", 2024-09-12T22:48:21.472 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-12T22:48:21.472 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_log_max_events": "-1", 2024-09-12T22:48:21.472 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_log_max_segments": "128", 2024-09-12T22:48:21.472 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_log_pause": "false", 2024-09-12T22:48:21.472 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_log_segment_size": "0", 2024-09-12T22:48:21.472 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-12T22:48:21.472 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-12T22:48:21.472 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-12T22:48:21.472 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_log_trim_threshold": "128", 2024-09-12T22:48:21.472 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-12T22:48:21.472 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_log_warn_factor": "2.000000", 2024-09-12T22:48:21.473 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_max_caps_per_client": "1048576", 2024-09-12T22:48:21.473 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_max_completed_flushes": "100000", 2024-09-12T22:48:21.473 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_max_completed_requests": "100000", 2024-09-12T22:48:21.473 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_max_export_size": "20971520", 2024-09-12T22:48:21.473 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_max_file_recover": "32", 2024-09-12T22:48:21.473 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_max_purge_files": "64", 2024-09-12T22:48:21.473 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_max_purge_ops": "8192", 2024-09-12T22:48:21.473 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-12T22:48:21.473 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-12T22:48:21.473 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_max_snaps_per_dir": "100", 2024-09-12T22:48:21.473 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_metrics_update_interval": "2", 2024-09-12T22:48:21.473 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_min_caps_per_client": "100", 2024-09-12T22:48:21.473 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_min_caps_working_set": "10000", 2024-09-12T22:48:21.474 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-12T22:48:21.474 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_numa_node": "-1", 2024-09-12T22:48:21.474 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-12T22:48:21.474 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_op_complaint_time": "30.000000", 2024-09-12T22:48:21.474 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_op_history_duration": "600", 2024-09-12T22:48:21.474 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_op_history_size": "20", 2024-09-12T22:48:21.474 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_op_history_slow_op_size": "20", 2024-09-12T22:48:21.474 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-12T22:48:21.474 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_op_log_threshold": "5", 2024-09-12T22:48:21.474 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_ping_grace": "15", 2024-09-12T22:48:21.474 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_ping_interval": "5", 2024-09-12T22:48:21.474 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-12T22:48:21.474 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-12T22:48:21.474 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_recall_max_caps": "30000", 2024-09-12T22:48:21.475 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-12T22:48:21.475 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-12T22:48:21.475 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-12T22:48:21.475 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_recall_warning_threshold": "262144", 2024-09-12T22:48:21.475 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-12T22:48:21.475 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_replay_interval": "1.000000", 2024-09-12T22:48:21.475 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-12T22:48:21.475 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-12T22:48:21.475 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_root_ino_gid": "0", 2024-09-12T22:48:21.475 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_root_ino_uid": "0", 2024-09-12T22:48:21.475 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-12T22:48:21.475 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-12T22:48:21.475 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-12T22:48:21.476 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-12T22:48:21.476 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-12T22:48:21.476 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-12T22:48:21.476 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-12T22:48:21.476 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-12T22:48:21.476 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-12T22:48:21.476 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-12T22:48:21.476 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_shutdown_check": "0", 2024-09-12T22:48:21.476 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_skip_ino": "0", 2024-09-12T22:48:21.476 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-12T22:48:21.476 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_snap_max_uid": "4294967294", 2024-09-12T22:48:21.476 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_snap_min_uid": "0", 2024-09-12T22:48:21.476 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_snap_rstat": "false", 2024-09-12T22:48:21.477 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_standby_replay_damaged": "false", 2024-09-12T22:48:21.477 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_symlink_recovery": "true", 2024-09-12T22:48:21.477 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-12T22:48:21.477 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_thrash_exports": "0", 2024-09-12T22:48:21.477 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_thrash_fragments": "0", 2024-09-12T22:48:21.477 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_tick_interval": "5.000000", 2024-09-12T22:48:21.477 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_valgrind_exit": "false", 2024-09-12T22:48:21.477 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_verify_backtrace": "1", 2024-09-12T22:48:21.477 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_verify_scatter": "false", 2024-09-12T22:48:21.477 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-12T22:48:21.477 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_wipe_sessions": "false", 2024-09-12T22:48:21.477 INFO:teuthology.orchestra.run.smithi066.stdout: "mempool_debug": "false", 2024-09-12T22:48:21.477 INFO:teuthology.orchestra.run.smithi066.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-12T22:48:21.478 INFO:teuthology.orchestra.run.smithi066.stdout: "memstore_device_bytes": "1073741824", 2024-09-12T22:48:21.478 INFO:teuthology.orchestra.run.smithi066.stdout: "memstore_page_set": "false", 2024-09-12T22:48:21.478 INFO:teuthology.orchestra.run.smithi066.stdout: "memstore_page_size": "65536", 2024-09-12T22:48:21.478 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr_client_bytes": "134217728", 2024-09-12T22:48:21.478 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr_client_messages": "512", 2024-09-12T22:48:21.478 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-12T22:48:21.478 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-12T22:48:21.478 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-12T22:48:21.478 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-12T22:48:21.478 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr_disabled_modules": "", 2024-09-12T22:48:21.478 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr_enable_op_tracker": "true", 2024-09-12T22:48:21.478 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-12T22:48:21.478 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr_max_pg_num_change": "128", 2024-09-12T22:48:21.479 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr_mds_bytes": "134217728", 2024-09-12T22:48:21.479 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr_mds_messages": "128", 2024-09-12T22:48:21.479 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-12T22:48:21.479 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr_mon_bytes": "134217728", 2024-09-12T22:48:21.479 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr_mon_messages": "128", 2024-09-12T22:48:21.479 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-12T22:48:21.479 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-12T22:48:21.479 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr_op_history_duration": "600", 2024-09-12T22:48:21.479 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr_op_history_size": "20", 2024-09-12T22:48:21.479 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-12T22:48:21.479 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-12T22:48:21.479 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr_op_log_threshold": "5", 2024-09-12T22:48:21.479 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr_osd_bytes": "536870912", 2024-09-12T22:48:21.479 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr_osd_messages": "8192", 2024-09-12T22:48:21.480 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr_pool": "true", 2024-09-12T22:48:21.480 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-12T22:48:21.480 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr_standby_modules": "true", 2024-09-12T22:48:21.480 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr_stats_period": "5", 2024-09-12T22:48:21.480 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr_stats_threshold": "5", 2024-09-12T22:48:21.480 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr_tick_period": "2", 2024-09-12T22:48:21.480 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-12T22:48:21.480 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-12T22:48:21.480 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_allow_pool_delete": "true", 2024-09-12T22:48:21.480 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_allow_pool_size_one": "true", 2024-09-12T22:48:21.480 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_auth_validate_all_caps": "true", 2024-09-12T22:48:21.480 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-12T22:48:21.480 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-12T22:48:21.481 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_client_bytes": "104857600", 2024-09-12T22:48:21.481 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_client_directed_command_retry": "2", 2024-09-12T22:48:21.481 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-12T22:48:21.481 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-12T22:48:21.481 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-12T22:48:21.481 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-12T22:48:21.481 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_client_hunt_parallel": "3", 2024-09-12T22:48:21.481 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_client_log_interval": "1.000000", 2024-09-12T22:48:21.481 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-12T22:48:21.481 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_client_ping_interval": "10.000000", 2024-09-12T22:48:21.481 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-12T22:48:21.481 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_client_target_rank": "-1", 2024-09-12T22:48:21.481 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-12T22:48:21.482 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-12T22:48:21.482 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-12T22:48:21.482 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_cluster_log_file_level": "debug", 2024-09-12T22:48:21.482 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_cluster_log_to_file": "true", 2024-09-12T22:48:21.482 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-12T22:48:21.482 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-12T22:48:21.482 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-12T22:48:21.482 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_cluster_log_to_journald": "false", 2024-09-12T22:48:21.482 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-12T22:48:21.482 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-12T22:48:21.482 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-12T22:48:21.482 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-09-12T22:48:21.482 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_compact_on_bootstrap": "false", 2024-09-12T22:48:21.483 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_compact_on_start": "false", 2024-09-12T22:48:21.483 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_compact_on_trim": "true", 2024-09-12T22:48:21.483 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-12T22:48:21.483 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-12T22:48:21.483 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-12T22:48:21.483 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_cpu_threads": "4", 2024-09-12T22:48:21.483 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_crush_min_required_version": "hammer", 2024-09-12T22:48:21.483 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_daemon_bytes": "419430400", 2024-09-12T22:48:21.483 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-12T22:48:21.483 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_data_avail_crit": "5", 2024-09-12T22:48:21.483 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_data_avail_warn": "5", 2024-09-12T22:48:21.483 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_data_size_warn": "16106127360", 2024-09-12T22:48:21.483 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-12T22:48:21.483 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-12T22:48:21.484 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_debug_dump_json": "false", 2024-09-12T22:48:21.484 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-12T22:48:21.484 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_debug_dump_transactions": "false", 2024-09-12T22:48:21.484 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_debug_extra_checks": "false", 2024-09-12T22:48:21.484 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-12T22:48:21.484 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-12T22:48:21.484 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_debug_no_require_reef": "false", 2024-09-12T22:48:21.484 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_debug_no_require_squid": "false", 2024-09-12T22:48:21.484 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-12T22:48:21.484 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-12T22:48:21.484 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-12T22:48:21.484 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_down_mkfs_grace": "120", 2024-09-12T22:48:21.484 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_down_uptime_grace": "60", 2024-09-12T22:48:21.485 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_election_default_strategy": "1", 2024-09-12T22:48:21.485 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_election_timeout": "5.000000", 2024-09-12T22:48:21.485 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-12T22:48:21.485 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_elector_ping_divisor": "2", 2024-09-12T22:48:21.485 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-12T22:48:21.485 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_enable_op_tracker": "true", 2024-09-12T22:48:21.485 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_fake_pool_delete": "false", 2024-09-12T22:48:21.485 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_force_quorum_join": "false", 2024-09-12T22:48:21.485 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-12T22:48:21.485 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_globalid_prealloc": "10000", 2024-09-12T22:48:21.485 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_health_detail_to_clog": "false", 2024-09-12T22:48:21.485 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_health_log_update_period": "5", 2024-09-12T22:48:21.485 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_health_max_detail": "50", 2024-09-12T22:48:21.485 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_health_to_clog": "true", 2024-09-12T22:48:21.486 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_health_to_clog_interval": "600", 2024-09-12T22:48:21.486 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-12T22:48:21.486 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_host": "172.21.15.66,[v2:172.21.15.66:3301,v1:172.21.15.66:6790],[v2:172.21.15.66:3302,v1:172.21.15.66:6791]", 2024-09-12T22:48:21.486 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_host_override": "", 2024-09-12T22:48:21.486 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_initial_members": "", 2024-09-12T22:48:21.486 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-12T22:48:21.486 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-12T22:48:21.486 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-12T22:48:21.486 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-12T22:48:21.486 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-12T22:48:21.486 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_lease": "5.000000", 2024-09-12T22:48:21.486 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-12T22:48:21.486 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-12T22:48:21.487 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_log_full_interval": "50", 2024-09-12T22:48:21.487 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_log_max": "10000", 2024-09-12T22:48:21.487 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_log_max_summary": "50", 2024-09-12T22:48:21.487 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-12T22:48:21.487 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_max_log_epochs": "500", 2024-09-12T22:48:21.487 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-12T22:48:21.487 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-12T22:48:21.487 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_max_osd": "10000", 2024-09-12T22:48:21.487 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_max_pg_per_osd": "10000", 2024-09-12T22:48:21.487 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_max_pool_pg_num": "65536", 2024-09-12T22:48:21.487 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-12T22:48:21.487 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-12T22:48:21.487 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_mds_force_trim_to": "0", 2024-09-12T22:48:21.488 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_mds_skip_sanity": "false", 2024-09-12T22:48:21.488 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_memory_autotune": "true", 2024-09-12T22:48:21.488 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_memory_target": "2147483648", 2024-09-12T22:48:21.488 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_mgr_beacon_grace": "30", 2024-09-12T22:48:21.488 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-12T22:48:21.488 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_mgr_digest_period": "5", 2024-09-12T22:48:21.488 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_mgr_inactive_grace": "60", 2024-09-12T22:48:21.488 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-12T22:48:21.488 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-12T22:48:21.488 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_min_osdmap_epochs": "500", 2024-09-12T22:48:21.488 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_op_complaint_time": "30", 2024-09-12T22:48:21.488 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_op_history_duration": "600", 2024-09-12T22:48:21.488 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_op_history_size": "20", 2024-09-12T22:48:21.488 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_op_history_slow_op_size": "20", 2024-09-12T22:48:21.489 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-12T22:48:21.489 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_op_log_threshold": "5", 2024-09-12T22:48:21.489 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-12T22:48:21.489 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-12T22:48:21.489 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-12T22:48:21.489 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osd_auto_mark_in": "false", 2024-09-12T22:48:21.489 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-12T22:48:21.489 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-12T22:48:21.489 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-12T22:48:21.489 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osd_cache_size": "500", 2024-09-12T22:48:21.489 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-12T22:48:21.489 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-12T22:48:21.489 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-12T22:48:21.489 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osd_down_out_interval": "600", 2024-09-12T22:48:21.490 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-12T22:48:21.490 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-12T22:48:21.490 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osd_force_trim_to": "0", 2024-09-12T22:48:21.490 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-12T22:48:21.490 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-12T22:48:21.490 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-12T22:48:21.490 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-12T22:48:21.490 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-12T22:48:21.490 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-12T22:48:21.490 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osd_max_creating_pgs": "1024", 2024-09-12T22:48:21.490 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-12T22:48:21.490 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osd_min_down_reporters": "2", 2024-09-12T22:48:21.490 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-12T22:48:21.491 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-12T22:48:21.491 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-12T22:48:21.491 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-12T22:48:21.491 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-12T22:48:21.491 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-12T22:48:21.491 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osd_report_timeout": "900", 2024-09-12T22:48:21.491 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-12T22:48:21.491 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-12T22:48:21.491 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-12T22:48:21.491 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-12T22:48:21.491 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-12T22:48:21.491 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-12T22:48:21.491 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-12T22:48:21.492 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-12T22:48:21.492 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-12T22:48:21.492 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_pg_stuck_threshold": "60", 2024-09-12T22:48:21.492 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-12T22:48:21.492 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-12T22:48:21.492 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-12T22:48:21.492 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-12T22:48:21.492 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-12T22:48:21.492 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-12T22:48:21.492 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_probe_timeout": "2.000000", 2024-09-12T22:48:21.492 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_reweight_max_change": "0.050000", 2024-09-12T22:48:21.492 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_reweight_max_osds": "4", 2024-09-12T22:48:21.492 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-12T22:48:21.493 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-12T22:48:21.493 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-12T22:48:21.493 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-12T22:48:21.493 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-12T22:48:21.493 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_scrub_interval": "86400", 2024-09-12T22:48:21.493 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_scrub_max_keys": "100", 2024-09-12T22:48:21.493 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_scrub_timeout": "300", 2024-09-12T22:48:21.493 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_session_timeout": "300", 2024-09-12T22:48:21.493 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_smart_report_timeout": "5", 2024-09-12T22:48:21.493 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_stat_smooth_intervals": "6", 2024-09-12T22:48:21.493 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-12T22:48:21.493 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_stretch_pool_min_size": "2", 2024-09-12T22:48:21.493 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_stretch_pool_size": "4", 2024-09-12T22:48:21.494 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-12T22:48:21.494 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-12T22:48:21.494 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_sync_debug": "false", 2024-09-12T22:48:21.494 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-12T22:48:21.494 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-12T22:48:21.494 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_sync_provider_kill_at": "0", 2024-09-12T22:48:21.494 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_sync_requester_kill_at": "0", 2024-09-12T22:48:21.494 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_sync_timeout": "60.000000", 2024-09-12T22:48:21.494 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_target_pg_per_osd": "100", 2024-09-12T22:48:21.494 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_tick_interval": "5", 2024-09-12T22:48:21.494 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_timecheck_interval": "300.000000", 2024-09-12T22:48:21.494 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-12T22:48:21.494 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_use_min_delay_socket": "false", 2024-09-12T22:48:21.494 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_warn_older_version_delay": "604800", 2024-09-12T22:48:21.495 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-12T22:48:21.495 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-12T22:48:21.495 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-12T22:48:21.495 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-12T22:48:21.495 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-12T22:48:21.495 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-12T22:48:21.495 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-12T22:48:21.495 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_warn_on_misplaced": "false", 2024-09-12T22:48:21.495 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-12T22:48:21.495 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_warn_on_older_version": "true", 2024-09-12T22:48:21.495 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-12T22:48:21.495 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_warn_on_pool_no_app": "true", 2024-09-12T22:48:21.496 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-12T22:48:21.496 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-12T22:48:21.496 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-12T22:48:21.496 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-12T22:48:21.496 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-12T22:48:21.496 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-12T22:48:21.496 INFO:teuthology.orchestra.run.smithi066.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-12T22:48:21.496 INFO:teuthology.orchestra.run.smithi066.stdout: "monmap": "", 2024-09-12T22:48:21.496 INFO:teuthology.orchestra.run.smithi066.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-12T22:48:21.496 INFO:teuthology.orchestra.run.smithi066.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-12T22:48:21.496 INFO:teuthology.orchestra.run.smithi066.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-12T22:48:21.496 INFO:teuthology.orchestra.run.smithi066.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-12T22:48:21.496 INFO:teuthology.orchestra.run.smithi066.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-12T22:48:21.497 INFO:teuthology.orchestra.run.smithi066.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-12T22:48:21.497 INFO:teuthology.orchestra.run.smithi066.stdout: "motr_tracing_enabled": "false", 2024-09-12T22:48:21.497 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_async_op_threads": "3", 2024-09-12T22:48:21.497 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-12T22:48:21.497 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_async_rdma_cm": "false", 2024-09-12T22:48:21.497 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_async_rdma_device_name": "", 2024-09-12T22:48:21.497 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_async_rdma_dscp": "96", 2024-09-12T22:48:21.497 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-12T22:48:21.497 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-12T22:48:21.497 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_async_rdma_local_gid": "", 2024-09-12T22:48:21.497 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-12T22:48:21.497 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_async_rdma_port_num": "1", 2024-09-12T22:48:21.497 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-12T22:48:21.498 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-12T22:48:21.498 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-12T22:48:21.498 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-12T22:48:21.498 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_async_rdma_sl": "3", 2024-09-12T22:48:21.498 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_async_rdma_support_srq": "true", 2024-09-12T22:48:21.498 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_async_rdma_type": "ib", 2024-09-12T22:48:21.498 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_async_reap_threshold": "5", 2024-09-12T22:48:21.498 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_bind_before_connect": "false", 2024-09-12T22:48:21.498 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_bind_ipv4": "true", 2024-09-12T22:48:21.498 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_bind_ipv6": "false", 2024-09-12T22:48:21.498 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_bind_msgr1": "true", 2024-09-12T22:48:21.498 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_bind_msgr2": "true", 2024-09-12T22:48:21.498 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_bind_port_max": "7568", 2024-09-12T22:48:21.499 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_bind_port_min": "6800", 2024-09-12T22:48:21.499 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-12T22:48:21.499 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_bind_retry_count": "3", 2024-09-12T22:48:21.499 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_bind_retry_delay": "5", 2024-09-12T22:48:21.499 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_blackhole_client": "false", 2024-09-12T22:48:21.499 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_blackhole_mds": "false", 2024-09-12T22:48:21.499 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_blackhole_mgr": "false", 2024-09-12T22:48:21.499 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_blackhole_mon": "false", 2024-09-12T22:48:21.499 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_blackhole_osd": "false", 2024-09-12T22:48:21.499 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_client_mode": "crc secure", 2024-09-12T22:48:21.499 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_cluster_mode": "crc secure", 2024-09-12T22:48:21.499 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_cluster_type": "", 2024-09-12T22:48:21.499 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_compress_secure": "false", 2024-09-12T22:48:21.499 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_connection_idle_timeout": "900", 2024-09-12T22:48:21.500 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_connection_ready_timeout": "10", 2024-09-12T22:48:21.500 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_crc_data": "true", 2024-09-12T22:48:21.500 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_crc_header": "true", 2024-09-12T22:48:21.500 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_die_on_bad_msg": "false", 2024-09-12T22:48:21.500 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_die_on_bug": "true", 2024-09-12T22:48:21.500 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_die_on_old_message": "true", 2024-09-12T22:48:21.500 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_die_on_skipped_message": "false", 2024-09-12T22:48:21.500 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-12T22:48:21.500 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-12T22:48:21.500 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_dpdk_coremask": "0xF", 2024-09-12T22:48:21.500 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-12T22:48:21.500 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-12T22:48:21.500 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_dpdk_enable_tso": "true", 2024-09-12T22:48:21.501 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-12T22:48:21.501 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-12T22:48:21.501 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_dpdk_hugepages": "", 2024-09-12T22:48:21.501 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-12T22:48:21.501 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-12T22:48:21.501 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_dpdk_lro": "true", 2024-09-12T22:48:21.501 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_dpdk_memory_channel": "4", 2024-09-12T22:48:21.501 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-12T22:48:21.501 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_dpdk_pmd": "", 2024-09-12T22:48:21.501 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_dpdk_port_id": "0", 2024-09-12T22:48:21.501 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-12T22:48:21.501 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-12T22:48:21.501 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_dump_on_send": "false", 2024-09-12T22:48:21.501 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_initial_backoff": "0.200000", 2024-09-12T22:48:21.502 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_inject_delay_max": "1.000000", 2024-09-12T22:48:21.502 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-12T22:48:21.502 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_inject_delay_type": "", 2024-09-12T22:48:21.502 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-12T22:48:21.502 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_inject_network_congestion": "0", 2024-09-12T22:48:21.502 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_inject_socket_failures": "0", 2024-09-12T22:48:21.502 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_learn_addr_from_peer": "true", 2024-09-12T22:48:21.502 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_max_accept_failures": "4", 2024-09-12T22:48:21.502 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_max_backoff": "15.000000", 2024-09-12T22:48:21.502 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_mon_client_mode": "secure crc", 2024-09-12T22:48:21.502 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-12T22:48:21.502 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_mon_service_mode": "secure crc", 2024-09-12T22:48:21.502 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_osd_compress_min_size": "1024", 2024-09-12T22:48:21.503 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_osd_compress_mode": "none", 2024-09-12T22:48:21.503 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-12T22:48:21.503 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-12T22:48:21.503 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_pq_min_cost": "65536", 2024-09-12T22:48:21.503 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_public_type": "", 2024-09-12T22:48:21.503 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_service_mode": "crc secure", 2024-09-12T22:48:21.503 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_tcp_listen_backlog": "512", 2024-09-12T22:48:21.503 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_tcp_nodelay": "true", 2024-09-12T22:48:21.503 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-12T22:48:21.503 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_tcp_rcvbuf": "0", 2024-09-12T22:48:21.503 INFO:teuthology.orchestra.run.smithi066.stdout: "ms_type": "async+posix", 2024-09-12T22:48:21.503 INFO:teuthology.orchestra.run.smithi066.stdout: "no_config_file": "false", 2024-09-12T22:48:21.503 INFO:teuthology.orchestra.run.smithi066.stdout: "objecter_completion_locks_per_session": "32", 2024-09-12T22:48:21.503 INFO:teuthology.orchestra.run.smithi066.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-12T22:48:21.504 INFO:teuthology.orchestra.run.smithi066.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-12T22:48:21.504 INFO:teuthology.orchestra.run.smithi066.stdout: "objecter_inflight_ops": "1024", 2024-09-12T22:48:21.504 INFO:teuthology.orchestra.run.smithi066.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-12T22:48:21.504 INFO:teuthology.orchestra.run.smithi066.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-12T22:48:21.504 INFO:teuthology.orchestra.run.smithi066.stdout: "objecter_tick_interval": "5.000000", 2024-09-12T22:48:21.504 INFO:teuthology.orchestra.run.smithi066.stdout: "objecter_timeout": "10.000000", 2024-09-12T22:48:21.504 INFO:teuthology.orchestra.run.smithi066.stdout: "objectstore_blackhole": "false", 2024-09-12T22:48:21.504 INFO:teuthology.orchestra.run.smithi066.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-12T22:48:21.504 INFO:teuthology.orchestra.run.smithi066.stdout: "openssl_engine_opts": "", 2024-09-12T22:48:21.504 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_agent_delay_time": "5.000000", 2024-09-12T22:48:21.504 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_agent_hist_halflife": "1000", 2024-09-12T22:48:21.504 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_agent_max_low_ops": "2", 2024-09-12T22:48:21.504 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_agent_max_ops": "4", 2024-09-12T22:48:21.505 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-12T22:48:21.505 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-12T22:48:21.505 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_agent_slop": "0.020000", 2024-09-12T22:48:21.505 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-12T22:48:21.505 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-12T22:48:21.505 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_asio_thread_count": "2", 2024-09-12T22:48:21.505 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_async_recovery_min_cost": "100", 2024-09-12T22:48:21.505 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-12T22:48:21.505 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-12T22:48:21.505 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_backfill_scan_max": "512", 2024-09-12T22:48:21.505 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_backfill_scan_min": "64", 2024-09-12T22:48:21.505 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_backoff_on_degraded": "false", 2024-09-12T22:48:21.505 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_backoff_on_peering": "false", 2024-09-12T22:48:21.505 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_backoff_on_unfound": "true", 2024-09-12T22:48:21.506 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_beacon_report_interval": "300", 2024-09-12T22:48:21.506 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_bench_duration": "30", 2024-09-12T22:48:21.506 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-12T22:48:21.506 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_bench_max_block_size": "67108864", 2024-09-12T22:48:21.506 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-12T22:48:21.506 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_blkin_trace_all": "false", 2024-09-12T22:48:21.506 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-12T22:48:21.506 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-12T22:48:21.506 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-12T22:48:21.506 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-12T22:48:21.506 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_check_for_log_corruption": "false", 2024-09-12T22:48:21.506 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-12T22:48:21.506 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-12T22:48:21.507 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-09-12T22:48:21.507 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-12T22:48:21.507 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_class_update_on_start": "true", 2024-09-12T22:48:21.507 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_client_message_cap": "256", 2024-09-12T22:48:21.507 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_client_message_size_cap": "524288000", 2024-09-12T22:48:21.507 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_client_op_priority": "63", 2024-09-12T22:48:21.507 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_client_watch_timeout": "30", 2024-09-12T22:48:21.507 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_command_max_records": "256", 2024-09-12T22:48:21.507 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_compact_on_start": "false", 2024-09-12T22:48:21.507 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-12T22:48:21.507 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-12T22:48:21.507 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-12T22:48:21.507 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_crush_update_on_start": "true", 2024-09-12T22:48:21.507 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_crush_update_weight_set": "true", 2024-09-12T22:48:21.508 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-12T22:48:21.508 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-12T22:48:21.508 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-12T22:48:21.508 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-12T22:48:21.508 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-12T22:48:21.508 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_debug_feed_pullee": "-1", 2024-09-12T22:48:21.508 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-12T22:48:21.508 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-12T22:48:21.508 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-12T22:48:21.508 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_debug_misdirected_ops": "false", 2024-09-12T22:48:21.508 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_debug_no_acting_change": "false", 2024-09-12T22:48:21.508 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_debug_no_purge_strays": "false", 2024-09-12T22:48:21.508 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_debug_op_order": "false", 2024-09-12T22:48:21.509 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-12T22:48:21.509 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-12T22:48:21.509 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-12T22:48:21.509 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-12T22:48:21.509 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_debug_shutdown": "false", 2024-09-12T22:48:21.509 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-12T22:48:21.509 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-12T22:48:21.509 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_debug_trim_objects": "false", 2024-09-12T22:48:21.509 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-12T22:48:21.509 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-12T22:48:21.509 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_debug_verify_snaps": "false", 2024-09-12T22:48:21.509 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-12T22:48:21.509 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-12T22:48:21.510 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_deep_scrub_keys": "1024", 2024-09-12T22:48:21.510 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-12T22:48:21.510 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-12T22:48:21.510 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-12T22:48:21.510 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_deep_scrub_stride": "524288", 2024-09-12T22:48:21.510 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-12T22:48:21.510 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-12T22:48:21.510 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_default_notify_timeout": "30", 2024-09-12T22:48:21.510 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_delete_sleep": "0.000000", 2024-09-12T22:48:21.510 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-12T22:48:21.510 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-12T22:48:21.510 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-12T22:48:21.510 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_discard_disconnected_ops": "true", 2024-09-12T22:48:21.510 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_enable_op_tracker": "true", 2024-09-12T22:48:21.511 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-12T22:48:21.511 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-12T22:48:21.511 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-12T22:48:21.511 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-12T22:48:21.511 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_fast_info": "true", 2024-09-12T22:48:21.511 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_fast_shutdown": "true", 2024-09-12T22:48:21.511 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-12T22:48:21.511 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-12T22:48:21.511 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-12T22:48:21.511 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-12T22:48:21.511 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-12T22:48:21.511 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_function_tracing": "false", 2024-09-12T22:48:21.511 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_heartbeat_grace": "20", 2024-09-12T22:48:21.511 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_heartbeat_interval": "6", 2024-09-12T22:48:21.512 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-12T22:48:21.512 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_heartbeat_min_peers": "10", 2024-09-12T22:48:21.512 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_heartbeat_min_size": "2000", 2024-09-12T22:48:21.512 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_heartbeat_stale": "600", 2024-09-12T22:48:21.512 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-12T22:48:21.512 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_hit_set_max_size": "100000", 2024-09-12T22:48:21.512 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_hit_set_min_size": "1000", 2024-09-12T22:48:21.512 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-12T22:48:21.512 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-12T22:48:21.512 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-12T22:48:21.512 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-12T22:48:21.512 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-12T22:48:21.512 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-12T22:48:21.513 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_journal_size": "5120", 2024-09-12T22:48:21.513 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_kill_backfill_at": "0", 2024-09-12T22:48:21.513 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-12T22:48:21.513 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_map_cache_size": "50", 2024-09-12T22:48:21.513 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_map_dedup": "true", 2024-09-12T22:48:21.513 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_map_message_max": "40", 2024-09-12T22:48:21.513 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-12T22:48:21.513 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_map_share_max_epochs": "40", 2024-09-12T22:48:21.513 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_max_attr_name_len": "100", 2024-09-12T22:48:21.513 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_max_attr_size": "0", 2024-09-12T22:48:21.513 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_max_backfills": "1", 2024-09-12T22:48:21.513 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_max_markdown_count": "5", 2024-09-12T22:48:21.513 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_max_markdown_period": "600", 2024-09-12T22:48:21.513 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_max_object_name_len": "2048", 2024-09-12T22:48:21.514 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_max_object_namespace_len": "256", 2024-09-12T22:48:21.514 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_max_object_size": "134217728", 2024-09-12T22:48:21.514 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-12T22:48:21.514 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-12T22:48:21.514 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_max_pg_blocked_by": "16", 2024-09-12T22:48:21.514 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_max_pg_log_entries": "10000", 2024-09-12T22:48:21.514 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-12T22:48:21.514 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_max_pgls": "1024", 2024-09-12T22:48:21.514 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_max_push_cost": "8388608", 2024-09-12T22:48:21.514 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_max_push_objects": "10", 2024-09-12T22:48:21.514 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_max_scrubs": "3", 2024-09-12T22:48:21.514 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-12T22:48:21.514 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_max_trimming_pgs": "2", 2024-09-12T22:48:21.515 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_max_write_op_reply_len": "64", 2024-09-12T22:48:21.515 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_max_write_size": "90", 2024-09-12T22:48:21.515 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-12T22:48:21.515 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-12T22:48:21.515 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-12T22:48:21.515 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-12T22:48:21.515 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-12T22:48:21.515 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-12T22:48:21.515 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-12T22:48:21.515 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-12T22:48:21.515 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mclock_profile": "balanced", 2024-09-12T22:48:21.515 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-12T22:48:21.515 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-12T22:48:21.516 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-12T22:48:21.516 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-12T22:48:21.516 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-12T22:48:21.516 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-12T22:48:21.516 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-12T22:48:21.516 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-12T22:48:21.516 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-12T22:48:21.516 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-12T22:48:21.516 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-12T22:48:21.516 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_memory_base": "805306368", 2024-09-12T22:48:21.516 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_memory_cache_min": "134217728", 2024-09-12T22:48:21.516 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-12T22:48:21.516 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-12T22:48:21.516 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_memory_target": "4294967296", 2024-09-12T22:48:21.517 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_memory_target_autotune": "false", 2024-09-12T22:48:21.517 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-12T22:48:21.517 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_min_pg_log_entries": "250", 2024-09-12T22:48:21.517 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_min_recovery_priority": "0", 2024-09-12T22:48:21.517 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-12T22:48:21.517 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-12T22:48:21.517 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mon_report_interval": "5", 2024-09-12T22:48:21.517 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-12T22:48:21.517 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-12T22:48:21.517 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_num_cache_shards": "32", 2024-09-12T22:48:21.517 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_num_op_tracker_shard": "32", 2024-09-12T22:48:21.517 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_numa_auto_affinity": "true", 2024-09-12T22:48:21.517 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_numa_node": "-1", 2024-09-12T22:48:21.518 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_numa_prefer_iface": "true", 2024-09-12T22:48:21.518 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-12T22:48:21.518 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_objecter_finishers": "1", 2024-09-12T22:48:21.518 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_objectstore": "bluestore", 2024-09-12T22:48:21.518 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_objectstore_fuse": "false", 2024-09-12T22:48:21.518 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_objectstore_tracing": "false", 2024-09-12T22:48:21.518 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_op_complaint_time": "30.000000", 2024-09-12T22:48:21.518 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_op_history_duration": "600", 2024-09-12T22:48:21.518 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_op_history_size": "20", 2024-09-12T22:48:21.518 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_op_history_slow_op_size": "20", 2024-09-12T22:48:21.518 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-12T22:48:21.518 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_op_log_threshold": "5", 2024-09-12T22:48:21.518 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_op_num_shards": "0", 2024-09-12T22:48:21.518 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_op_num_shards_hdd": "5", 2024-09-12T22:48:21.519 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_op_num_shards_ssd": "8", 2024-09-12T22:48:21.519 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-12T22:48:21.519 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-12T22:48:21.519 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-12T22:48:21.519 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-12T22:48:21.519 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_op_pq_min_cost": "65536", 2024-09-12T22:48:21.519 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-12T22:48:21.519 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_op_queue_cut_off": "high", 2024-09-12T22:48:21.519 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-12T22:48:21.519 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_op_thread_timeout": "15", 2024-09-12T22:48:21.519 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_open_classes_on_start": "true", 2024-09-12T22:48:21.519 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_os_flags": "0", 2024-09-12T22:48:21.519 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_peering_op_priority": "255", 2024-09-12T22:48:21.519 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pg_delete_cost": "1048576", 2024-09-12T22:48:21.520 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pg_delete_priority": "5", 2024-09-12T22:48:21.520 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-12T22:48:21.520 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-12T22:48:21.520 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-12T22:48:21.520 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pg_log_trim_max": "10000", 2024-09-12T22:48:21.520 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pg_log_trim_min": "100", 2024-09-12T22:48:21.520 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-12T22:48:21.520 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-12T22:48:21.520 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-12T22:48:21.520 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-12T22:48:21.520 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-12T22:48:21.520 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-12T22:48:21.520 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-12T22:48:21.520 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-12T22:48:21.521 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-12T22:48:21.521 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-12T22:48:21.521 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pool_default_crimson": "false", 2024-09-12T22:48:21.521 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-12T22:48:21.521 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-12T22:48:21.521 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-12T22:48:21.521 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-12T22:48:21.521 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-12T22:48:21.521 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-12T22:48:21.521 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-12T22:48:21.521 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-12T22:48:21.522 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pool_default_flags": "0", 2024-09-12T22:48:21.522 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-12T22:48:21.522 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pool_default_min_size": "0", 2024-09-12T22:48:21.522 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-12T22:48:21.522 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pool_default_pg_num": "32", 2024-09-12T22:48:21.522 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pool_default_pgp_num": "0", 2024-09-12T22:48:21.522 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-12T22:48:21.522 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pool_default_read_ratio": "70", 2024-09-12T22:48:21.522 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pool_default_size": "2", 2024-09-12T22:48:21.522 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pool_default_type": "replicated", 2024-09-12T22:48:21.522 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-12T22:48:21.522 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-12T22:48:21.522 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_push_per_object_cost": "1000", 2024-09-12T22:48:21.523 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-12T22:48:21.523 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_recover_clone_overlap": "true", 2024-09-12T22:48:21.523 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-12T22:48:21.523 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_recovery_cost": "20971520", 2024-09-12T22:48:21.523 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-12T22:48:21.523 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_recovery_max_active": "0", 2024-09-12T22:48:21.523 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-12T22:48:21.523 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-12T22:48:21.523 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-12T22:48:21.523 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-12T22:48:21.523 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_recovery_max_single_start": "1", 2024-09-12T22:48:21.523 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_recovery_op_priority": "3", 2024-09-12T22:48:21.523 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-12T22:48:21.524 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_recovery_priority": "5", 2024-09-12T22:48:21.524 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-12T22:48:21.524 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_recovery_sleep": "0.000000", 2024-09-12T22:48:21.524 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-12T22:48:21.524 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-12T22:48:21.524 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-12T22:48:21.524 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_repair_during_recovery": "false", 2024-09-12T22:48:21.524 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_requested_scrub_priority": "120", 2024-09-12T22:48:21.524 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-12T22:48:21.524 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-12T22:48:21.524 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_scrub_auto_repair": "false", 2024-09-12T22:48:21.524 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-12T22:48:21.524 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-12T22:48:21.525 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_scrub_begin_hour": "0", 2024-09-12T22:48:21.525 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_scrub_begin_week_day": "0", 2024-09-12T22:48:21.525 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_scrub_chunk_max": "25", 2024-09-12T22:48:21.525 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_scrub_chunk_min": "5", 2024-09-12T22:48:21.525 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_scrub_cost": "52428800", 2024-09-12T22:48:21.525 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-12T22:48:21.525 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_scrub_during_recovery": "false", 2024-09-12T22:48:21.525 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_scrub_end_hour": "0", 2024-09-12T22:48:21.525 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_scrub_end_week_day": "0", 2024-09-12T22:48:21.525 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_scrub_event_cost": "4096", 2024-09-12T22:48:21.525 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-12T22:48:21.525 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-12T22:48:21.525 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_scrub_invalid_stats": "true", 2024-09-12T22:48:21.526 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-12T22:48:21.526 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-12T22:48:21.526 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_scrub_max_preemptions": "5", 2024-09-12T22:48:21.526 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-12T22:48:21.526 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_scrub_priority": "5", 2024-09-12T22:48:21.526 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_scrub_sleep": "0.000000", 2024-09-12T22:48:21.526 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-12T22:48:21.526 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-12T22:48:21.526 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-12T22:48:21.526 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_skip_data_digest": "false", 2024-09-12T22:48:21.526 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_smart_report_timeout": "5", 2024-09-12T22:48:21.526 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_snap_trim_cost": "1048576", 2024-09-12T22:48:21.526 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_snap_trim_priority": "5", 2024-09-12T22:48:21.526 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-12T22:48:21.527 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-12T22:48:21.527 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-12T22:48:21.527 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-12T22:48:21.527 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-12T22:48:21.527 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-12T22:48:21.527 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-12T22:48:21.527 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_target_transaction_size": "30", 2024-09-12T22:48:21.527 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-12T22:48:21.527 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-12T22:48:21.527 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-12T22:48:21.527 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-12T22:48:21.527 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-12T22:48:21.527 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-12T22:48:21.528 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-12T22:48:21.528 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-12T22:48:21.528 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-12T22:48:21.528 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-12T22:48:21.528 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_tracing": "false", 2024-09-12T22:48:21.528 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_use_stale_snap": "false", 2024-09-12T22:48:21.528 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T22:48:21.528 INFO:teuthology.orchestra.run.smithi066.stdout: "osdc_blkin_trace_all": "false", 2024-09-12T22:48:21.528 INFO:teuthology.orchestra.run.smithi066.stdout: "paxos_kill_at": "0", 2024-09-12T22:48:21.528 INFO:teuthology.orchestra.run.smithi066.stdout: "paxos_max_join_drift": "10", 2024-09-12T22:48:21.528 INFO:teuthology.orchestra.run.smithi066.stdout: "paxos_min": "500", 2024-09-12T22:48:21.528 INFO:teuthology.orchestra.run.smithi066.stdout: "paxos_min_wait": "0.050000", 2024-09-12T22:48:21.528 INFO:teuthology.orchestra.run.smithi066.stdout: "paxos_propose_interval": "1.000000", 2024-09-12T22:48:21.528 INFO:teuthology.orchestra.run.smithi066.stdout: "paxos_service_trim_max": "500", 2024-09-12T22:48:21.529 INFO:teuthology.orchestra.run.smithi066.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-12T22:48:21.529 INFO:teuthology.orchestra.run.smithi066.stdout: "paxos_service_trim_min": "250", 2024-09-12T22:48:21.529 INFO:teuthology.orchestra.run.smithi066.stdout: "paxos_stash_full_interval": "25", 2024-09-12T22:48:21.529 INFO:teuthology.orchestra.run.smithi066.stdout: "paxos_trim_max": "500", 2024-09-12T22:48:21.529 INFO:teuthology.orchestra.run.smithi066.stdout: "paxos_trim_min": "250", 2024-09-12T22:48:21.529 INFO:teuthology.orchestra.run.smithi066.stdout: "perf": "true", 2024-09-12T22:48:21.529 INFO:teuthology.orchestra.run.smithi066.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-12T22:48:21.529 INFO:teuthology.orchestra.run.smithi066.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-12T22:48:21.529 INFO:teuthology.orchestra.run.smithi066.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-09-12T22:48:21.529 INFO:teuthology.orchestra.run.smithi066.stdout: "public_addr": "-", 2024-09-12T22:48:21.529 INFO:teuthology.orchestra.run.smithi066.stdout: "public_addrv": "", 2024-09-12T22:48:21.529 INFO:teuthology.orchestra.run.smithi066.stdout: "public_bind_addr": "-", 2024-09-12T22:48:21.529 INFO:teuthology.orchestra.run.smithi066.stdout: "public_network": "", 2024-09-12T22:48:21.530 INFO:teuthology.orchestra.run.smithi066.stdout: "public_network_interface": "", 2024-09-12T22:48:21.530 INFO:teuthology.orchestra.run.smithi066.stdout: "qat_compressor_busy_polling": "false", 2024-09-12T22:48:21.530 INFO:teuthology.orchestra.run.smithi066.stdout: "qat_compressor_enabled": "false", 2024-09-12T22:48:21.530 INFO:teuthology.orchestra.run.smithi066.stdout: "qat_compressor_session_max_number": "256", 2024-09-12T22:48:21.530 INFO:teuthology.orchestra.run.smithi066.stdout: "rados_mon_op_timeout": "0", 2024-09-12T22:48:21.530 INFO:teuthology.orchestra.run.smithi066.stdout: "rados_osd_op_timeout": "0", 2024-09-12T22:48:21.530 INFO:teuthology.orchestra.run.smithi066.stdout: "rados_tracing": "false", 2024-09-12T22:48:21.530 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_atime_update_interval": "60", 2024-09-12T22:48:21.530 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-12T22:48:21.530 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_balance_parent_reads": "false", 2024-09-12T22:48:21.530 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_balance_snap_reads": "false", 2024-09-12T22:48:21.530 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_blkin_trace_all": "false", 2024-09-12T22:48:21.530 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-12T22:48:21.531 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-12T22:48:21.531 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_cache": "true", 2024-09-12T22:48:21.531 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-12T22:48:21.531 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-12T22:48:21.531 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-12T22:48:21.531 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-12T22:48:21.531 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_cache_policy": "writearound", 2024-09-12T22:48:21.531 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_cache_size": "33554432", 2024-09-12T22:48:21.531 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-12T22:48:21.531 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-12T22:48:21.531 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_clone_copy_on_read": "false", 2024-09-12T22:48:21.531 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_compression_hint": "none", 2024-09-12T22:48:21.531 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_concurrent_management_ops": "10", 2024-09-12T22:48:21.532 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-12T22:48:21.532 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_default_clone_format": "auto", 2024-09-12T22:48:21.532 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_default_data_pool": "", 2024-09-12T22:48:21.532 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_default_features": "61", 2024-09-12T22:48:21.532 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_default_format": "2", 2024-09-12T22:48:21.532 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_default_map_options": "", 2024-09-12T22:48:21.532 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_default_order": "22", 2024-09-12T22:48:21.532 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_default_pool": "rbd", 2024-09-12T22:48:21.532 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-12T22:48:21.532 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_default_stripe_count": "0", 2024-09-12T22:48:21.532 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_default_stripe_unit": "0", 2024-09-12T22:48:21.532 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-12T22:48:21.532 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-12T22:48:21.533 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-12T22:48:21.533 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_enable_alloc_hint": "true", 2024-09-12T22:48:21.533 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-12T22:48:21.533 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_io_scheduler": "simple", 2024-09-12T22:48:21.533 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-12T22:48:21.533 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-12T22:48:21.533 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-12T22:48:21.533 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-12T22:48:21.533 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-12T22:48:21.533 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-12T22:48:21.533 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-12T22:48:21.533 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-12T22:48:21.533 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-12T22:48:21.534 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_journal_order": "24", 2024-09-12T22:48:21.534 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_journal_pool": "", 2024-09-12T22:48:21.534 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_journal_splay_width": "4", 2024-09-12T22:48:21.534 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_localize_parent_reads": "false", 2024-09-12T22:48:21.534 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_localize_snap_reads": "false", 2024-09-12T22:48:21.534 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-12T22:48:21.534 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-12T22:48:21.534 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-12T22:48:21.534 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-12T22:48:21.534 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-12T22:48:21.534 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-12T22:48:21.534 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-12T22:48:21.534 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-12T22:48:21.534 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-12T22:48:21.535 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-12T22:48:21.535 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-12T22:48:21.535 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-12T22:48:21.535 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-12T22:48:21.535 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-12T22:48:21.535 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-12T22:48:21.535 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-12T22:48:21.535 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-12T22:48:21.535 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-12T22:48:21.535 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-12T22:48:21.535 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-12T22:48:21.535 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-12T22:48:21.535 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-12T22:48:21.536 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-12T22:48:21.536 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-12T22:48:21.536 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-12T22:48:21.536 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-12T22:48:21.536 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-12T22:48:21.536 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-12T22:48:21.536 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-12T22:48:21.536 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-12T22:48:21.536 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-12T22:48:21.536 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_mtime_update_interval": "60", 2024-09-12T22:48:21.536 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_non_blocking_aio": "true", 2024-09-12T22:48:21.536 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_op_thread_timeout": "60", 2024-09-12T22:48:21.536 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_op_threads": "1", 2024-09-12T22:48:21.537 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_parent_cache_enabled": "false", 2024-09-12T22:48:21.537 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-12T22:48:21.537 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-12T22:48:21.537 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-12T22:48:21.537 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_plugins": "", 2024-09-12T22:48:21.537 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_qos_bps_burst": "0", 2024-09-12T22:48:21.537 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-12T22:48:21.537 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_qos_bps_limit": "0", 2024-09-12T22:48:21.537 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_qos_exclude_ops": "0", 2024-09-12T22:48:21.537 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_qos_iops_burst": "0", 2024-09-12T22:48:21.537 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-12T22:48:21.537 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_qos_iops_limit": "0", 2024-09-12T22:48:21.537 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-12T22:48:21.537 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-12T22:48:21.538 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-12T22:48:21.538 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-12T22:48:21.538 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-12T22:48:21.538 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-12T22:48:21.538 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-12T22:48:21.538 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-12T22:48:21.538 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-12T22:48:21.538 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-12T22:48:21.538 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-12T22:48:21.538 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-12T22:48:21.538 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-12T22:48:21.538 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-12T22:48:21.538 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_read_from_replica_policy": "default", 2024-09-12T22:48:21.539 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-12T22:48:21.539 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-12T22:48:21.539 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-12T22:48:21.539 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-12T22:48:21.539 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_skip_partial_discard": "true", 2024-09-12T22:48:21.539 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-12T22:48:21.539 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_tracing": "false", 2024-09-12T22:48:21.539 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_validate_names": "true", 2024-09-12T22:48:21.539 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_validate_pool": "true", 2024-09-12T22:48:21.539 INFO:teuthology.orchestra.run.smithi066.stdout: "restapi_base_url": "", 2024-09-12T22:48:21.539 INFO:teuthology.orchestra.run.smithi066.stdout: "restapi_log_level": "", 2024-09-12T22:48:21.539 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-12T22:48:21.539 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-12T22:48:21.539 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_acl_grants_max_num": "100", 2024-09-12T22:48:21.540 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_admin_entry": "admin", 2024-09-12T22:48:21.540 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-12T22:48:21.540 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_backend_store": "rados", 2024-09-12T22:48:21.540 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_barbican_url": "", 2024-09-12T22:48:21.540 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_beast_enable_async": "true", 2024-09-12T22:48:21.540 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_bucket_counters_cache": "false", 2024-09-12T22:48:21.540 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-12T22:48:21.540 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-12T22:48:21.540 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-12T22:48:21.540 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-12T22:48:21.540 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-12T22:48:21.540 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-12T22:48:21.540 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-12T22:48:21.541 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-12T22:48:21.541 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_cache_enabled": "true", 2024-09-12T22:48:21.541 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_cache_expiry_interval": "900", 2024-09-12T22:48:21.541 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_cache_lru_size": "25000", 2024-09-12T22:48:21.541 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_config_store": "rados", 2024-09-12T22:48:21.541 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_content_length_compat": "false", 2024-09-12T22:48:21.541 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_copy_obj_progress": "true", 2024-09-12T22:48:21.541 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-12T22:48:21.541 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_cors_rules_max_num": "100", 2024-09-12T22:48:21.541 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_cross_domain_policy": "", 2024-09-12T22:48:21.541 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-12T22:48:21.541 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_crypt_kmip_addr": "", 2024-09-12T22:48:21.541 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-12T22:48:21.542 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-12T22:48:21.542 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-12T22:48:21.542 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-12T22:48:21.542 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_crypt_kmip_password": "", 2024-09-12T22:48:21.542 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-12T22:48:21.542 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_crypt_kmip_username": "", 2024-09-12T22:48:21.542 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_crypt_require_ssl": "true", 2024-09-12T22:48:21.542 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-12T22:48:21.542 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-12T22:48:21.542 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-12T22:48:21.542 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-12T22:48:21.542 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-12T22:48:21.542 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-12T22:48:21.543 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-12T22:48:21.543 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-12T22:48:21.543 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-12T22:48:21.543 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-12T22:48:21.543 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-12T22:48:21.543 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-12T22:48:21.543 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-12T22:48:21.543 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-12T22:48:21.543 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-12T22:48:21.543 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_crypt_vault_addr": "", 2024-09-12T22:48:21.543 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_crypt_vault_auth": "token", 2024-09-12T22:48:21.543 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_crypt_vault_namespace": "", 2024-09-12T22:48:21.543 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_crypt_vault_prefix": "", 2024-09-12T22:48:21.543 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-12T22:48:21.544 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-12T22:48:21.544 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-12T22:48:21.544 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-12T22:48:21.544 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_crypt_vault_token_file": "", 2024-09-12T22:48:21.544 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-12T22:48:21.544 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_curl_buffersize": "524288", 2024-09-12T22:48:21.544 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-12T22:48:21.544 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_curl_low_speed_time": "300", 2024-09-12T22:48:21.544 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-12T22:48:21.544 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-12T22:48:21.544 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-12T22:48:21.544 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-12T22:48:21.545 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-12T22:48:21.545 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-12T22:48:21.545 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-12T22:48:21.545 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-12T22:48:21.545 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-12T22:48:21.545 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-12T22:48:21.545 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_d4n_host": "127.0.0.1", 2024-09-12T22:48:21.545 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_d4n_port": "6379", 2024-09-12T22:48:21.545 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-12T22:48:21.545 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_data_log_changes_size": "1000", 2024-09-12T22:48:21.545 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_data_log_num_shards": "128", 2024-09-12T22:48:21.545 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-12T22:48:21.545 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_data_log_window": "30", 2024-09-12T22:48:21.546 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-12T22:48:21.546 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-12T22:48:21.546 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-12T22:48:21.546 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-12T22:48:21.546 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-12T22:48:21.546 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-12T22:48:21.546 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-12T22:48:21.546 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-12T22:48:21.546 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-12T22:48:21.546 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-12T22:48:21.546 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-12T22:48:21.546 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-12T22:48:21.546 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-12T22:48:21.546 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-12T22:48:21.547 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-12T22:48:21.547 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-12T22:48:21.547 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-12T22:48:21.547 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-12T22:48:21.547 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-12T22:48:21.547 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-12T22:48:21.547 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-12T22:48:21.547 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-12T22:48:21.547 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-12T22:48:21.547 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-12T22:48:21.547 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-12T22:48:21.547 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_dns_name": "", 2024-09-12T22:48:21.547 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_dns_s3website_name": "", 2024-09-12T22:48:21.548 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_dynamic_resharding": "true", 2024-09-12T22:48:21.548 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-12T22:48:21.548 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_enable_gc_threads": "true", 2024-09-12T22:48:21.548 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_enable_lc_threads": "true", 2024-09-12T22:48:21.548 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_enable_ops_log": "false", 2024-09-12T22:48:21.548 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_enable_quota_threads": "true", 2024-09-12T22:48:21.548 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_enable_static_website": "false", 2024-09-12T22:48:21.548 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_enable_usage_log": "false", 2024-09-12T22:48:21.548 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_enforce_swift_acls": "true", 2024-09-12T22:48:21.548 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_exit_timeout_secs": "120", 2024-09-12T22:48:21.548 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_expose_bucket": "false", 2024-09-12T22:48:21.548 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_extended_http_attrs": "", 2024-09-12T22:48:21.548 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_filter": "none", 2024-09-12T22:48:21.549 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-12T22:48:21.549 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_frontends": "beast port=7480", 2024-09-12T22:48:21.549 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-12T22:48:21.549 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_gc_max_deferred": "50", 2024-09-12T22:48:21.549 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-12T22:48:21.549 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_gc_max_objs": "32", 2024-09-12T22:48:21.549 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-12T22:48:21.549 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-12T22:48:21.549 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-12T22:48:21.549 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-12T22:48:21.549 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_gc_processor_period": "3600", 2024-09-12T22:48:21.549 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-12T22:48:21.550 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-12T22:48:21.550 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-12T22:48:21.550 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-12T22:48:21.550 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_init_timeout": "300", 2024-09-12T22:48:21.550 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-12T22:48:21.550 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-12T22:48:21.550 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_kafka_connection_idle": "300", 2024-09-12T22:48:21.550 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-12T22:48:21.550 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-12T22:48:21.550 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-12T22:48:21.550 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-12T22:48:21.550 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-12T22:48:21.550 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_keystone_admin_domain": "", 2024-09-12T22:48:21.551 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_keystone_admin_password": "", 2024-09-12T22:48:21.551 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_keystone_admin_password_path": "", 2024-09-12T22:48:21.551 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_keystone_admin_project": "", 2024-09-12T22:48:21.551 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_keystone_admin_tenant": "", 2024-09-12T22:48:21.551 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_keystone_admin_token": "", 2024-09-12T22:48:21.551 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_keystone_admin_token_path": "", 2024-09-12T22:48:21.551 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_keystone_admin_user": "", 2024-09-12T22:48:21.551 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_keystone_api_version": "2", 2024-09-12T22:48:21.551 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_keystone_barbican_domain": "", 2024-09-12T22:48:21.551 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_keystone_barbican_password": "", 2024-09-12T22:48:21.551 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_keystone_barbican_project": "", 2024-09-12T22:48:21.551 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-12T22:48:21.551 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_keystone_barbican_user": "", 2024-09-12T22:48:21.552 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-12T22:48:21.552 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-12T22:48:21.552 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-12T22:48:21.552 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-12T22:48:21.552 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-12T22:48:21.552 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_keystone_url": "", 2024-09-12T22:48:21.552 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-12T22:48:21.552 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_lc_debug_interval": "-1", 2024-09-12T22:48:21.552 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_lc_lock_max_time": "90", 2024-09-12T22:48:21.552 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_lc_max_objs": "32", 2024-09-12T22:48:21.552 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_lc_max_rules": "1000", 2024-09-12T22:48:21.552 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_lc_max_worker": "3", 2024-09-12T22:48:21.552 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-12T22:48:21.553 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_lc_thread_delay": "0", 2024-09-12T22:48:21.553 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-12T22:48:21.553 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_ldap_dnattr": "uid", 2024-09-12T22:48:21.553 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-12T22:48:21.553 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_ldap_searchfilter": "", 2024-09-12T22:48:21.553 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-12T22:48:21.553 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_ldap_uri": "", 2024-09-12T22:48:21.553 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-12T22:48:21.553 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-12T22:48:21.553 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-12T22:48:21.553 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_log_http_headers": "", 2024-09-12T22:48:21.553 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-12T22:48:21.554 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-12T22:48:21.554 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_log_object_name_utc": "false", 2024-09-12T22:48:21.554 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-12T22:48:21.554 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-12T22:48:21.554 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_max_attr_name_len": "0", 2024-09-12T22:48:21.554 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_max_attr_size": "0", 2024-09-12T22:48:21.554 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-12T22:48:21.554 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_max_chunk_size": "4194304", 2024-09-12T22:48:21.554 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-12T22:48:21.554 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-12T22:48:21.554 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-12T22:48:21.554 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_max_listing_results": "1000", 2024-09-12T22:48:21.554 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_max_notify_retries": "10", 2024-09-12T22:48:21.555 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-12T22:48:21.555 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_max_put_param_size": "1048576", 2024-09-12T22:48:21.555 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_max_put_size": "5368709120", 2024-09-12T22:48:21.555 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_max_slo_entries": "1000", 2024-09-12T22:48:21.555 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_md_log_max_shards": "64", 2024-09-12T22:48:21.555 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-12T22:48:21.555 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-12T22:48:21.555 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-12T22:48:21.555 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-12T22:48:21.555 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_mp_lock_max_time": "600", 2024-09-12T22:48:21.555 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-12T22:48:21.555 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-12T22:48:21.555 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-12T22:48:21.555 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-12T22:48:21.556 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-12T22:48:21.556 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-12T22:48:21.556 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-12T22:48:21.556 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-12T22:48:21.556 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_nfs_max_gc": "300", 2024-09-12T22:48:21.556 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-12T22:48:21.556 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-12T22:48:21.556 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-12T22:48:21.556 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-12T22:48:21.556 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-12T22:48:21.556 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-12T22:48:21.556 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-12T22:48:21.556 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_num_async_rados_threads": "32", 2024-09-12T22:48:21.557 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_num_control_oids": "8", 2024-09-12T22:48:21.557 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_numa_node": "-1", 2024-09-12T22:48:21.557 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-12T22:48:21.557 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-12T22:48:21.557 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_objexp_chunk_size": "100", 2024-09-12T22:48:21.557 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_objexp_gc_interval": "600", 2024-09-12T22:48:21.557 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-12T22:48:21.557 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-12T22:48:21.557 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-12T22:48:21.557 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_op_thread_timeout": "600", 2024-09-12T22:48:21.557 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_op_tracing": "false", 2024-09-12T22:48:21.557 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_opa_token": "", 2024-09-12T22:48:21.557 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_opa_url": "", 2024-09-12T22:48:21.558 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_opa_verify_ssl": "true", 2024-09-12T22:48:21.558 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-12T22:48:21.558 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-12T22:48:21.558 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_ops_log_rados": "false", 2024-09-12T22:48:21.558 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_ops_log_socket_path": "", 2024-09-12T22:48:21.558 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-12T22:48:21.558 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-12T22:48:21.558 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-12T22:48:21.558 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_period_push_interval": "2.000000", 2024-09-12T22:48:21.558 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-12T22:48:21.558 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-12T22:48:21.558 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-12T22:48:21.558 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-12T22:48:21.559 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_posix_cache_lanes": "3", 2024-09-12T22:48:21.559 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-12T22:48:21.559 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-12T22:48:21.559 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_posix_cache_partitions": "3", 2024-09-12T22:48:21.559 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-12T22:48:21.559 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_print_continue": "true", 2024-09-12T22:48:21.559 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-12T22:48:21.559 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-12T22:48:21.559 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-12T22:48:21.559 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-12T22:48:21.559 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-12T22:48:21.559 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_rados_tracing": "false", 2024-09-12T22:48:21.559 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_realm": "", 2024-09-12T22:48:21.560 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_realm_id": "", 2024-09-12T22:48:21.560 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-12T22:48:21.560 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_region": "", 2024-09-12T22:48:21.560 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-12T22:48:21.560 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-12T22:48:21.560 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-12T22:48:21.560 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-12T22:48:21.560 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_request_uri": "", 2024-09-12T22:48:21.560 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_reshard_batch_size": "64", 2024-09-12T22:48:21.560 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-12T22:48:21.560 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_reshard_max_aio": "128", 2024-09-12T22:48:21.560 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_reshard_num_logs": "16", 2024-09-12T22:48:21.560 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_reshard_thread_interval": "600", 2024-09-12T22:48:21.561 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_resolve_cname": "false", 2024-09-12T22:48:21.561 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-12T22:48:21.561 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_run_sync_thread": "true", 2024-09-12T22:48:21.561 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-12T22:48:21.561 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-12T22:48:21.561 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-12T22:48:21.561 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-12T22:48:21.561 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-12T22:48:21.561 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-12T22:48:21.561 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-12T22:48:21.561 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-12T22:48:21.561 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-12T22:48:21.561 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_scheduler_type": "throttler", 2024-09-12T22:48:21.562 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_script_uri": "", 2024-09-12T22:48:21.562 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_service_provider_name": "", 2024-09-12T22:48:21.562 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-12T22:48:21.562 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_sts_client_id": "", 2024-09-12T22:48:21.562 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_sts_client_secret": "", 2024-09-12T22:48:21.562 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_sts_entry": "sts", 2024-09-12T22:48:21.562 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_sts_key": "sts", 2024-09-12T22:48:21.562 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-12T22:48:21.562 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_sts_min_session_duration": "900", 2024-09-12T22:48:21.562 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_sts_token_introspection_url": "", 2024-09-12T22:48:21.562 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_swift_account_in_url": "false", 2024-09-12T22:48:21.562 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_swift_auth_entry": "auth", 2024-09-12T22:48:21.562 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_swift_auth_url": "", 2024-09-12T22:48:21.562 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_swift_custom_header": "", 2024-09-12T22:48:21.563 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-12T22:48:21.563 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_swift_need_stats": "true", 2024-09-12T22:48:21.563 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_swift_tenant_name": "", 2024-09-12T22:48:21.563 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_swift_token_expiration": "86400", 2024-09-12T22:48:21.563 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_swift_url": "", 2024-09-12T22:48:21.563 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_swift_url_prefix": "swift", 2024-09-12T22:48:21.563 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-12T22:48:21.563 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-12T22:48:21.563 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-12T22:48:21.563 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_sync_lease_period": "120", 2024-09-12T22:48:21.563 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-12T22:48:21.563 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-12T22:48:21.563 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-12T22:48:21.563 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-12T22:48:21.564 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-12T22:48:21.564 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-12T22:48:21.564 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-12T22:48:21.564 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-12T22:48:21.564 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-12T22:48:21.564 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_thread_pool_size": "512", 2024-09-12T22:48:21.564 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-12T22:48:21.564 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-12T22:48:21.564 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-12T22:48:21.564 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-12T22:48:21.564 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_torrent_comment": "", 2024-09-12T22:48:21.564 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_torrent_createby": "", 2024-09-12T22:48:21.564 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_torrent_encoding": "", 2024-09-12T22:48:21.565 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_torrent_flag": "false", 2024-09-12T22:48:21.565 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-12T22:48:21.565 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_torrent_origin": "", 2024-09-12T22:48:21.565 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-12T22:48:21.565 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_torrent_tracker": "", 2024-09-12T22:48:21.565 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_trust_forwarded_https": "false", 2024-09-12T22:48:21.565 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-12T22:48:21.565 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-12T22:48:21.565 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_usage_max_shards": "32", 2024-09-12T22:48:21.565 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_usage_max_user_shards": "1", 2024-09-12T22:48:21.565 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_use_opa_authz": "false", 2024-09-12T22:48:21.565 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_user_counters_cache": "false", 2024-09-12T22:48:21.565 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-12T22:48:21.566 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-12T22:48:21.566 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-12T22:48:21.566 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_user_max_buckets": "1000", 2024-09-12T22:48:21.566 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_user_policies_max_num": "100", 2024-09-12T22:48:21.566 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-12T22:48:21.566 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-12T22:48:21.566 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-12T22:48:21.566 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-12T22:48:21.566 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_user_unique_email": "true", 2024-09-12T22:48:21.566 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_verify_ssl": "true", 2024-09-12T22:48:21.566 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-12T22:48:21.566 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_zone": "", 2024-09-12T22:48:21.566 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_zone_id": "", 2024-09-12T22:48:21.566 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-12T22:48:21.567 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_zonegroup": "", 2024-09-12T22:48:21.567 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_zonegroup_id": "", 2024-09-12T22:48:21.567 INFO:teuthology.orchestra.run.smithi066.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-12T22:48:21.567 INFO:teuthology.orchestra.run.smithi066.stdout: "rgwlc_auto_session_clear": "true", 2024-09-12T22:48:21.567 INFO:teuthology.orchestra.run.smithi066.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-12T22:48:21.567 INFO:teuthology.orchestra.run.smithi066.stdout: "rocksdb_block_size": "4096", 2024-09-12T22:48:21.567 INFO:teuthology.orchestra.run.smithi066.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-12T22:48:21.567 INFO:teuthology.orchestra.run.smithi066.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-12T22:48:21.567 INFO:teuthology.orchestra.run.smithi066.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-12T22:48:21.567 INFO:teuthology.orchestra.run.smithi066.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-12T22:48:21.567 INFO:teuthology.orchestra.run.smithi066.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-12T22:48:21.567 INFO:teuthology.orchestra.run.smithi066.stdout: "rocksdb_cache_size": "536870912", 2024-09-12T22:48:21.567 INFO:teuthology.orchestra.run.smithi066.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-12T22:48:21.568 INFO:teuthology.orchestra.run.smithi066.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-12T22:48:21.568 INFO:teuthology.orchestra.run.smithi066.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-12T22:48:21.568 INFO:teuthology.orchestra.run.smithi066.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-12T22:48:21.568 INFO:teuthology.orchestra.run.smithi066.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-12T22:48:21.568 INFO:teuthology.orchestra.run.smithi066.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-12T22:48:21.568 INFO:teuthology.orchestra.run.smithi066.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-12T22:48:21.568 INFO:teuthology.orchestra.run.smithi066.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-12T22:48:21.568 INFO:teuthology.orchestra.run.smithi066.stdout: "rocksdb_index_type": "binary_search", 2024-09-12T22:48:21.568 INFO:teuthology.orchestra.run.smithi066.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-12T22:48:21.568 INFO:teuthology.orchestra.run.smithi066.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-12T22:48:21.568 INFO:teuthology.orchestra.run.smithi066.stdout: "rocksdb_partition_filters": "false", 2024-09-12T22:48:21.568 INFO:teuthology.orchestra.run.smithi066.stdout: "rocksdb_perf": "false", 2024-09-12T22:48:21.568 INFO:teuthology.orchestra.run.smithi066.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-12T22:48:21.569 INFO:teuthology.orchestra.run.smithi066.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-12T22:48:21.569 INFO:teuthology.orchestra.run.smithi066.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-12T22:48:21.569 INFO:teuthology.orchestra.run.smithi066.stdout: "run_dir": "/var/run/ceph", 2024-09-12T22:48:21.569 INFO:teuthology.orchestra.run.smithi066.stdout: "seastore_block_create": "true", 2024-09-12T22:48:21.569 INFO:teuthology.orchestra.run.smithi066.stdout: "seastore_cache_lru_size": "67108864", 2024-09-12T22:48:21.569 INFO:teuthology.orchestra.run.smithi066.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-12T22:48:21.569 INFO:teuthology.orchestra.run.smithi066.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-12T22:48:21.569 INFO:teuthology.orchestra.run.smithi066.stdout: "seastore_default_max_object_size": "16777216", 2024-09-12T22:48:21.569 INFO:teuthology.orchestra.run.smithi066.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-12T22:48:21.569 INFO:teuthology.orchestra.run.smithi066.stdout: "seastore_device_size": "53687091200", 2024-09-12T22:48:21.569 INFO:teuthology.orchestra.run.smithi066.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-12T22:48:21.569 INFO:teuthology.orchestra.run.smithi066.stdout: "seastore_full_integrity_check": "false", 2024-09-12T22:48:21.569 INFO:teuthology.orchestra.run.smithi066.stdout: "seastore_journal_batch_capacity": "16", 2024-09-12T22:48:21.569 INFO:teuthology.orchestra.run.smithi066.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-12T22:48:21.570 INFO:teuthology.orchestra.run.smithi066.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-12T22:48:21.570 INFO:teuthology.orchestra.run.smithi066.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-12T22:48:21.570 INFO:teuthology.orchestra.run.smithi066.stdout: "seastore_main_device_type": "SSD", 2024-09-12T22:48:21.570 INFO:teuthology.orchestra.run.smithi066.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-12T22:48:21.570 INFO:teuthology.orchestra.run.smithi066.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-12T22:48:21.570 INFO:teuthology.orchestra.run.smithi066.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-12T22:48:21.570 INFO:teuthology.orchestra.run.smithi066.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-12T22:48:21.570 INFO:teuthology.orchestra.run.smithi066.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-12T22:48:21.570 INFO:teuthology.orchestra.run.smithi066.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-12T22:48:21.570 INFO:teuthology.orchestra.run.smithi066.stdout: "seastore_segment_size": "67108864", 2024-09-12T22:48:21.570 INFO:teuthology.orchestra.run.smithi066.stdout: "set_keepcaps": "false", 2024-09-12T22:48:21.570 INFO:teuthology.orchestra.run.smithi066.stdout: "setgroup": "", 2024-09-12T22:48:21.570 INFO:teuthology.orchestra.run.smithi066.stdout: "setuser": "", 2024-09-12T22:48:21.571 INFO:teuthology.orchestra.run.smithi066.stdout: "setuser_match_path": "", 2024-09-12T22:48:21.571 INFO:teuthology.orchestra.run.smithi066.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-12T22:48:21.571 INFO:teuthology.orchestra.run.smithi066.stdout: "thp": "false", 2024-09-12T22:48:21.571 INFO:teuthology.orchestra.run.smithi066.stdout: "threadpool_default_timeout": "60", 2024-09-12T22:48:21.571 INFO:teuthology.orchestra.run.smithi066.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-12T22:48:21.571 INFO:teuthology.orchestra.run.smithi066.stdout: "throttler_perf_counter": "true" 2024-09-12T22:48:21.571 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T22:48:21.573 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-12T22:48:21.690 INFO:teuthology.orchestra.run.smithi066.stdout:mon.a: {} 2024-09-12T22:48:21.690 INFO:teuthology.orchestra.run.smithi066.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T22:48:21.698 INFO:teuthology.orchestra.run.smithi066.stdout:mon.b: {} 2024-09-12T22:48:21.698 INFO:teuthology.orchestra.run.smithi066.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T22:48:21.707 INFO:teuthology.orchestra.run.smithi066.stdout:mon.c: {} 2024-09-12T22:48:21.707 INFO:teuthology.orchestra.run.smithi066.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T22:48:21.718 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2024-09-12T22:48:21.718 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-12T22:48:21.746 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-12T22:48:21.746 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-12T22:48:21.746 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-12T22:48:21.746 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T22:48:21.746 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T22:48:21.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:48:21.747 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2024-09-12T22:48:21.747 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-12T22:48:21.747 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T22:48:21.747 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T22:48:21.748 INFO:tasks.thrashosds.thrasher:Killing osd 2, live_osds are [0, 1, 2] 2024-09-12T22:48:21.748 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.2 doing powercycle of ubuntu@smithi117.front.sepia.ceph.com 2024-09-12T22:48:21.748 INFO:teuthology.orchestra.console.smithi117:Power off 2024-09-12T22:48:21.748 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-09-12T22:48:21.758 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-12T22:48:21.759 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-12T22:48:21.759 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:48:21.760 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-12T22:48:21.760 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:21.760 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-12T22:48:21.761 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:48:21.763 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:21.759+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:21.774 DEBUG:teuthology.orchestra.console.smithi117:power off output: Chassis Power Control: Down/Off 2024-09-12T22:48:21.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:48:21.779 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link delete ceph-brx 2024-09-12T22:48:21.847 INFO:teuthology.orchestra.run.smithi066.stderr:Cannot find device "ceph-brx" 2024-09-12T22:48:21.849 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:48:21.849 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-12T22:48:21.849 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-12T22:48:21.849 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T22:48:21.860 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:21.859+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:21.877 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:21.877 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:48:21.877 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:48:21.877 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:21.886 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:21.890 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:48:21.891 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:48:21.908 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:48:21.909 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:48:21.926 INFO:teuthology.orchestra.run.smithi066.stdout:osd.2: {} 2024-09-12T22:48:21.927 INFO:teuthology.orchestra.run.smithi066.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:48:21.971 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:21.970+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:22.031 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:22.032 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:22.040 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:22.061 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:22.061+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:22.162 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:22.162+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:22.184 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:22.184 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:22.193 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:22.220 INFO:teuthology.orchestra.run.smithi066.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T22:48:22.233 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T22:48:22.233 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T22:48:22.233 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi066.front.sepia.ceph.com 2024-09-12T22:48:22.234 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T22:48:22.234 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T22:48:22.234 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T22:48:22.234 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T22:48:22.234 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T22:48:22.234 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T22:48:22.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:48:22.234 DEBUG:teuthology.orchestra.run.smithi066:> ip addr 2024-09-12T22:48:22.251 INFO:teuthology.orchestra.run.smithi066.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T22:48:22.251 INFO:teuthology.orchestra.run.smithi066.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T22:48:22.251 INFO:teuthology.orchestra.run.smithi066.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T22:48:22.251 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-09-12T22:48:22.251 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 ::1/128 scope host 2024-09-12T22:48:22.251 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-09-12T22:48:22.251 INFO:teuthology.orchestra.run.smithi066.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T22:48:22.251 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:84 brd ff:ff:ff:ff:ff:ff 2024-09-12T22:48:22.251 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f0 2024-09-12T22:48:22.251 INFO:teuthology.orchestra.run.smithi066.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T22:48:22.251 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:85 brd ff:ff:ff:ff:ff:ff 2024-09-12T22:48:22.252 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f1 2024-09-12T22:48:22.252 INFO:teuthology.orchestra.run.smithi066.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T22:48:22.252 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bc brd ff:ff:ff:ff:ff:ff 2024-09-12T22:48:22.252 INFO:teuthology.orchestra.run.smithi066.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T22:48:22.252 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bd brd ff:ff:ff:ff:ff:ff 2024-09-12T22:48:22.252 INFO:teuthology.orchestra.run.smithi066.stdout: inet 172.21.15.66/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T22:48:22.252 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft 42801sec preferred_lft 42801sec 2024-09-12T22:48:22.252 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::ec4:7aff:feb6:f8bd/64 scope link noprefixroute 2024-09-12T22:48:22.252 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-09-12T22:48:22.252 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T22:48:22.253 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T22:48:22.253 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-09-12T22:48:22.253 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link add name ceph-brx type bridge 2024-09-12T22:48:22.253 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip addr flush dev ceph-brx 2024-09-12T22:48:22.253 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set ceph-brx up 2024-09-12T22:48:22.253 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T22:48:22.253 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-09-12T22:48:22.263 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:22.262+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:22.292 INFO:teuthology.orchestra.run.smithi066.stderr:noscrub is set 2024-09-12T22:48:22.310 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:22.310 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:22.320 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:22.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T22:48:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T22:48:22.404 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:22.403+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:22.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T22:48:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T22:48:22.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:48:22.464 DEBUG:teuthology.orchestra.run.smithi066:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T22:48:22.465 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:22.465 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:22.465 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:22.465+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:22.474 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:22.530 INFO:teuthology.orchestra.run.smithi066.stdout:1 2024-09-12T22:48:22.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:48:22.532 DEBUG:teuthology.orchestra.run.smithi066:> route 2024-09-12T22:48:22.567 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:22.565+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:22.601 INFO:teuthology.orchestra.run.smithi066.stdout:Kernel IP routing table 2024-09-12T22:48:22.602 INFO:teuthology.orchestra.run.smithi066.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T22:48:22.602 INFO:teuthology.orchestra.run.smithi066.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T22:48:22.602 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T22:48:22.602 INFO:teuthology.orchestra.run.smithi066.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T22:48:22.602 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T22:48:22.603 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-09-12T22:48:22.603 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T22:48:22.603 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T22:48:22.603 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T22:48:22.603 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-09-12T22:48:22.617 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:22.617 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:22.626 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:22.670 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:22.669+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:22.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T22:48:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T22:48:22.732 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:22.732 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:22.741 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:22.782 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:22.781+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:22.868 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:22.867+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:22.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T22:48:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T22:48:22.883 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:22.883 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:22.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:48:22.889 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2024-09-12T22:48:22.892 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:22.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:48:22.906 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list-id 2024-09-12T22:48:22.962 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T22:48:22.962 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-09-12T22:48:22.962 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T22:48:22.962 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-12T22:48:22.962 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-09-12T22:48:22.978 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:22.977+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:23.036 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:23.036 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:23.046 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:23.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T22:48:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T22:48:23.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T22:48:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T22:48:23.080 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-12T22:48:23.080 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T22:48:23.080 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-09-12T22:48:23.081 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-12T22:48:23.081 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T22:48:23.081 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-12T22:48:23.081 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-12T22:48:23.081 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-12T22:48:23.081 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-09-12T22:48:23.090 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:23.089+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:23.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T22:48:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T22:48:23.150 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:23.150 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:23.160 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:23.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T22:48:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T22:48:23.203 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:23.201+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:23.207 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T22:48:23.207 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-09-12T22:48:23.207 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set brx.0 up 2024-09-12T22:48:23.207 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T22:48:23.207 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-09-12T22:48:23.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T22:48:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T22:48:23.270 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:23.269+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:23.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T22:48:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T22:48:23.286 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-12T22:48:23.286 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T22:48:23.286 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T22:48:23.302 INFO:teuthology.orchestra.run.smithi066.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T22:48:23.303 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T22:48:23.303 DEBUG:teuthology.orchestra.run.smithi066:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T22:48:23.305 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:23.305 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:23.313 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:23.358 DEBUG:teuthology.orchestra.run.smithi066:> sudo modprobe fuse 2024-09-12T22:48:23.399 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:23.398+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:23.425 DEBUG:teuthology.orchestra.run.smithi066:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T22:48:23.457 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:23.457 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:23.466 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:23.484 INFO:teuthology.orchestra.run.smithi066.stdout:/proc 2024-09-12T22:48:23.484 INFO:teuthology.orchestra.run.smithi066.stdout:/sys 2024-09-12T22:48:23.484 INFO:teuthology.orchestra.run.smithi066.stdout:/dev 2024-09-12T22:48:23.484 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/security 2024-09-12T22:48:23.484 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/shm 2024-09-12T22:48:23.484 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/pts 2024-09-12T22:48:23.484 INFO:teuthology.orchestra.run.smithi066.stdout:/run 2024-09-12T22:48:23.484 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/cgroup 2024-09-12T22:48:23.484 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/pstore 2024-09-12T22:48:23.484 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/bpf 2024-09-12T22:48:23.484 INFO:teuthology.orchestra.run.smithi066.stdout:/ 2024-09-12T22:48:23.485 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/selinux 2024-09-12T22:48:23.485 INFO:teuthology.orchestra.run.smithi066.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T22:48:23.485 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/hugepages 2024-09-12T22:48:23.485 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/mqueue 2024-09-12T22:48:23.485 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/debug 2024-09-12T22:48:23.485 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/tracing 2024-09-12T22:48:23.485 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/fuse/connections 2024-09-12T22:48:23.485 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/config 2024-09-12T22:48:23.485 INFO:teuthology.orchestra.run.smithi066.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T22:48:23.485 INFO:teuthology.orchestra.run.smithi066.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T22:48:23.485 INFO:teuthology.orchestra.run.smithi066.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T22:48:23.485 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T22:48:23.485 INFO:teuthology.orchestra.run.smithi066.stdout:/run/user/1000 2024-09-12T22:48:23.486 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/ceph 2024-09-12T22:48:23.486 INFO:teuthology.orchestra.run.smithi066.stdout:/run/netns 2024-09-12T22:48:23.486 INFO:teuthology.orchestra.run.smithi066.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T22:48:23.486 INFO:teuthology.orchestra.run.smithi066.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T22:48:23.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:48:23.486 DEBUG:teuthology.orchestra.run.smithi066:> ls /sys/fs/fuse/connections 2024-09-12T22:48:23.510 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:23.509+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:23.541 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T22:48:23.541 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-12T22:48:23.571 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:23.571 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:23.574 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:23.573+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:23.580 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:23.584 DEBUG:teuthology.orchestra.run.smithi066:> sudo modprobe fuse 2024-09-12T22:48:23.609 DEBUG:teuthology.orchestra.run.smithi066:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T22:48:23.666 INFO:teuthology.orchestra.run.smithi066.stdout:/proc 2024-09-12T22:48:23.667 INFO:teuthology.orchestra.run.smithi066.stdout:/sys 2024-09-12T22:48:23.667 INFO:teuthology.orchestra.run.smithi066.stdout:/dev 2024-09-12T22:48:23.667 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/security 2024-09-12T22:48:23.667 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/shm 2024-09-12T22:48:23.667 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/pts 2024-09-12T22:48:23.667 INFO:teuthology.orchestra.run.smithi066.stdout:/run 2024-09-12T22:48:23.667 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/cgroup 2024-09-12T22:48:23.667 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/pstore 2024-09-12T22:48:23.667 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/bpf 2024-09-12T22:48:23.667 INFO:teuthology.orchestra.run.smithi066.stdout:/ 2024-09-12T22:48:23.668 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/selinux 2024-09-12T22:48:23.668 INFO:teuthology.orchestra.run.smithi066.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T22:48:23.668 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/hugepages 2024-09-12T22:48:23.668 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/mqueue 2024-09-12T22:48:23.668 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/debug 2024-09-12T22:48:23.668 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/tracing 2024-09-12T22:48:23.668 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/fuse/connections 2024-09-12T22:48:23.668 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/config 2024-09-12T22:48:23.668 INFO:teuthology.orchestra.run.smithi066.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T22:48:23.668 INFO:teuthology.orchestra.run.smithi066.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T22:48:23.668 INFO:teuthology.orchestra.run.smithi066.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T22:48:23.669 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T22:48:23.669 INFO:teuthology.orchestra.run.smithi066.stdout:/run/user/1000 2024-09-12T22:48:23.669 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/ceph 2024-09-12T22:48:23.669 INFO:teuthology.orchestra.run.smithi066.stdout:/run/netns 2024-09-12T22:48:23.669 INFO:teuthology.orchestra.run.smithi066.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T22:48:23.669 INFO:teuthology.orchestra.run.smithi066.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T22:48:23.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:48:23.669 DEBUG:teuthology.orchestra.run.smithi066:> ls /sys/fs/fuse/connections 2024-09-12T22:48:23.675 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:23.674+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:23.686 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi066.stderr:2024-09-12T22:48:23.685+0000 7ffb2662e480 -1 init, newargv = 0x561752fc1090 newargc=15 2024-09-12T22:48:23.686 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi066.stderr:ceph-fuse[32665]: starting ceph client 2024-09-12T22:48:23.691 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi066.stderr:ceph-fuse[32665]: starting fuse 2024-09-12T22:48:23.702 INFO:teuthology.orchestra.run.smithi066.stdout:41 2024-09-12T22:48:23.702 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-12T22:48:23.702 DEBUG:teuthology.orchestra.run.smithi066:> sudo stdin-killer -- python3 -c ' 2024-09-12T22:48:23.702 DEBUG:teuthology.orchestra.run.smithi066:> import glob 2024-09-12T22:48:23.703 DEBUG:teuthology.orchestra.run.smithi066:> import re 2024-09-12T22:48:23.703 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-09-12T22:48:23.703 DEBUG:teuthology.orchestra.run.smithi066:> import subprocess 2024-09-12T22:48:23.703 DEBUG:teuthology.orchestra.run.smithi066:> 2024-09-12T22:48:23.703 DEBUG:teuthology.orchestra.run.smithi066:> def _find_admin_socket(client_name): 2024-09-12T22:48:23.703 DEBUG:teuthology.orchestra.run.smithi066:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-12T22:48:23.703 DEBUG:teuthology.orchestra.run.smithi066:> files = glob.glob(asok_path) 2024-09-12T22:48:23.703 DEBUG:teuthology.orchestra.run.smithi066:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-12T22:48:23.703 DEBUG:teuthology.orchestra.run.smithi066:> 2024-09-12T22:48:23.703 DEBUG:teuthology.orchestra.run.smithi066:> # Given a non-glob path, it better be there 2024-09-12T22:48:23.703 DEBUG:teuthology.orchestra.run.smithi066:> if "*" not in asok_path: 2024-09-12T22:48:23.703 DEBUG:teuthology.orchestra.run.smithi066:> assert(len(files) == 1) 2024-09-12T22:48:23.703 DEBUG:teuthology.orchestra.run.smithi066:> return files[0] 2024-09-12T22:48:23.703 DEBUG:teuthology.orchestra.run.smithi066:> 2024-09-12T22:48:23.704 DEBUG:teuthology.orchestra.run.smithi066:> for f in files: 2024-09-12T22:48:23.704 DEBUG:teuthology.orchestra.run.smithi066:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T22:48:23.704 DEBUG:teuthology.orchestra.run.smithi066:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T22:48:23.704 DEBUG:teuthology.orchestra.run.smithi066:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T22:48:23.704 DEBUG:teuthology.orchestra.run.smithi066:> contents = proc_f.read() 2024-09-12T22:48:23.704 DEBUG:teuthology.orchestra.run.smithi066:> if mountpoint in contents: 2024-09-12T22:48:23.704 DEBUG:teuthology.orchestra.run.smithi066:> return f 2024-09-12T22:48:23.704 DEBUG:teuthology.orchestra.run.smithi066:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T22:48:23.704 DEBUG:teuthology.orchestra.run.smithi066:> 2024-09-12T22:48:23.704 DEBUG:teuthology.orchestra.run.smithi066:> print(_find_admin_socket("client.0")) 2024-09-12T22:48:23.704 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-09-12T22:48:23.724 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:23.724 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:23.733 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:23.775 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:23.774+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:23.822 INFO:teuthology.orchestra.run.smithi066.stdout:/var/run/ceph/ceph-client.0.32665.asok 2024-09-12T22:48:23.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T22:48:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T22:48:23.833 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.32665.asok 2024-09-12T22:48:23.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:48:23.833 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.32665.asok status 2024-09-12T22:48:23.876 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:23.875+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:23.877 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:23.877 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:23.886 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:23.940 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:48:23.970 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T22:48:23.970 INFO:teuthology.orchestra.run.smithi066.stdout: "metadata": { 2024-09-12T22:48:23.970 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_sha1": "086c737fa75c22d521a3932c59b31c5e1d1c9ef4", 2024-09-12T22:48:23.970 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_version": "ceph version 19.1.1-314-g086c737f (086c737fa75c22d521a3932c59b31c5e1d1c9ef4) squid (stable)", 2024-09-12T22:48:23.970 INFO:teuthology.orchestra.run.smithi066.stdout: "entity_id": "0", 2024-09-12T22:48:23.971 INFO:teuthology.orchestra.run.smithi066.stdout: "hostname": "smithi066", 2024-09-12T22:48:23.971 INFO:teuthology.orchestra.run.smithi066.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-12T22:48:23.971 INFO:teuthology.orchestra.run.smithi066.stdout: "pid": "32665", 2024-09-12T22:48:23.971 INFO:teuthology.orchestra.run.smithi066.stdout: "root": "/" 2024-09-12T22:48:23.971 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:23.971 INFO:teuthology.orchestra.run.smithi066.stdout: "dentry_count": 0, 2024-09-12T22:48:23.971 INFO:teuthology.orchestra.run.smithi066.stdout: "dentry_pinned_count": 0, 2024-09-12T22:48:23.971 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 4459, 2024-09-12T22:48:23.971 INFO:teuthology.orchestra.run.smithi066.stdout: "inst": { 2024-09-12T22:48:23.971 INFO:teuthology.orchestra.run.smithi066.stdout: "name": { 2024-09-12T22:48:23.971 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "client", 2024-09-12T22:48:23.971 INFO:teuthology.orchestra.run.smithi066.stdout: "num": 4459 2024-09-12T22:48:23.972 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:23.972 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": { 2024-09-12T22:48:23.972 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v1", 2024-09-12T22:48:23.972 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "192.168.0.1:0", 2024-09-12T22:48:23.972 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 4014885062 2024-09-12T22:48:23.972 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T22:48:23.972 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:23.972 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": { 2024-09-12T22:48:23.972 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v1", 2024-09-12T22:48:23.972 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "192.168.0.1:0", 2024-09-12T22:48:23.972 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 4014885062 2024-09-12T22:48:23.972 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:23.972 INFO:teuthology.orchestra.run.smithi066.stdout: "inst_str": "client.4459 192.168.0.1:0/4014885062", 2024-09-12T22:48:23.973 INFO:teuthology.orchestra.run.smithi066.stdout: "addr_str": "192.168.0.1:0/4014885062", 2024-09-12T22:48:23.973 INFO:teuthology.orchestra.run.smithi066.stdout: "inode_count": 1, 2024-09-12T22:48:23.973 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_epoch": 5, 2024-09-12T22:48:23.973 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_epoch": 21, 2024-09-12T22:48:23.973 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_epoch_barrier": 0, 2024-09-12T22:48:23.973 INFO:teuthology.orchestra.run.smithi066.stdout: "blocklisted": false, 2024-09-12T22:48:23.973 INFO:teuthology.orchestra.run.smithi066.stdout: "fs_name": "cephfs" 2024-09-12T22:48:23.973 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T22:48:23.976 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:23.975+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:23.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:48:23.979 DEBUG:teuthology.orchestra.run.smithi066:> stat --file-system '--printf=%T 2024-09-12T22:48:23.979 DEBUG:teuthology.orchestra.run.smithi066:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-12T22:48:23.990 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:23.990 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:23.999 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:24.037 INFO:teuthology.orchestra.run.smithi066.stdout:fuseblk 2024-09-12T22:48:24.038 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-12T22:48:24.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:48:24.038 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T22:48:24.068 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:48:24.068 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:48:24.083 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:24.082+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:24.086 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:48:24.086 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:48:24.094 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T22:48:24.112 INFO:tasks.workunit:Pulling workunits from ref 7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-12T22:48:24.113 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T22:48:24.113 INFO:tasks.workunit:timeout=3h 2024-09-12T22:48:24.113 INFO:tasks.workunit:cleanup=True 2024-09-12T22:48:24.113 DEBUG:teuthology.orchestra.run.smithi066:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T22:48:24.114 INFO:teuthology.orchestra.run.smithi066.stdout:osd.2: {} 2024-09-12T22:48:24.115 INFO:teuthology.orchestra.run.smithi066.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:48:24.141 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:24.142 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:48:24.142 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:48:24.142 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:48:24.142 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:24.150 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:24.170 INFO:teuthology.orchestra.run.smithi066.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-12T22:48:24.170 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-12T22:48:24.171 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 29h/41d Inode: 1 Links: 2 2024-09-12T22:48:24.172 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:48:24.172 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-12T22:48:24.172 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-12T22:48:24.172 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-09-12 22:48:05.160234033 +0000 2024-09-12T22:48:24.172 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-09-12 22:48:24.092303815 +0000 2024-09-12T22:48:24.172 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: - 2024-09-12T22:48:24.172 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-12T22:48:24.172 DEBUG:teuthology.orchestra.run.smithi066:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-12T22:48:24.191 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:24.190+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:24.241 DEBUG:teuthology.orchestra.run.smithi066:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-12T22:48:24.279 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:24.278+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:24.294 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:24.294 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:48:24.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:48:24.294 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:48:24.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.294 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:48:24.294 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:24.295 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.246096797, 2024-09-12T22:48:24.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:48:24.295 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:24.295 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:24.295 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:24.295 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:24.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:24.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:24.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:24.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:24.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:24.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:24.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:48:24.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:24.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:48:24.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:48:24.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:24.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:48:24.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:48:24.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:48:24.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:48:24.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:24.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:48:24.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:48:24.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:24.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:48:24.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:48:24.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:24.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:48:24.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:48:24.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:24.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:48:24.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:48:24.299 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.299 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:24.299 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.299 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:48:24.299 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:24.299 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.24571607, 2024-09-12T22:48:24.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:48:24.299 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:24.300 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:24.300 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:24.300 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:24.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:24.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:24.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:24.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:24.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:24.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:48:24.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:48:24.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:24.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:48:24.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:48:24.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:24.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:48:24.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:48:24.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:48:24.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:48:24.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:24.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:48:24.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:48:24.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:24.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:48:24.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:48:24.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:24.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:48:24.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:48:24.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:24.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:48:24.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:48:24.304 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.304 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:24.304 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.304 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:48:24.304 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:24.304 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.125119260000002, 2024-09-12T22:48:24.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:48:24.304 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:24.305 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:24.305 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:48:24.305 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:24.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:24.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:24.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:24.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:24.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:24.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:24.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:48:24.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:24.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:48:24.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:48:24.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:24.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:48:24.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:48:24.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:48:24.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:48:24.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:24.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:48:24.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:48:24.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:24.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:48:24.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:48:24.310 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.310 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:24.310 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.310 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:24.311 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:24.311 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.122511079999999, 2024-09-12T22:48:24.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:48:24.311 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:24.311 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:24.311 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:24.311 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:24.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:24.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:24.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:24.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:24.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:24.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:48:24.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:48:24.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:24.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:48:24.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:48:24.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:24.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:48:24.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:48:24.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:48:24.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:48:24.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:24.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:48:24.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:48:24.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:24.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:48:24.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:48:24.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:24.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:48:24.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:48:24.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:24.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:48:24.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:48:24.318 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.318 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:24.318 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.318 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:24.318 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:24.319 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.121617857, 2024-09-12T22:48:24.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:48:24.319 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:24.319 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:24.319 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:24.319 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:24.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:24.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:24.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:24.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:24.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:24.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:48:24.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:48:24.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:24.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:48:24.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:48:24.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:24.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:48:24.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:48:24.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:48:24.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:48:24.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:24.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:48:24.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:48:24.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:24.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:48:24.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:48:24.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:24.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:48:24.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:48:24.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:24.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:48:24.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:48:24.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:24.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:48:24.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:48:24.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:24.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:48:24.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:48:24.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:24.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:48:24.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:48:24.327 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.327 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:24.327 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.328 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:24.328 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:24.328 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.121546199000001, 2024-09-12T22:48:24.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:48:24.328 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:24.328 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:24.329 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:24.329 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:24.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:24.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:24.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:24.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:24.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:24.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:48:24.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:48:24.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:24.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:48:24.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:48:24.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:24.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:48:24.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:48:24.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:48:24.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:48:24.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:24.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:48:24.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:48:24.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:24.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:48:24.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:48:24.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:24.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:48:24.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:48:24.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:24.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:48:24.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:48:24.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:24.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:48:24.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:48:24.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:24.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:48:24.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:48:24.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:24.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:48:24.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:48:24.336 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.336 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:24.336 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.336 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:24.336 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:24.336 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.121503481000001, 2024-09-12T22:48:24.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:48:24.336 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:24.337 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:24.337 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:24.337 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:24.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:24.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:24.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:24.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:24.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:24.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:48:24.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:48:24.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:24.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:48:24.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:48:24.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:24.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:48:24.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:48:24.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:48:24.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:48:24.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:24.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:48:24.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:48:24.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:24.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:48:24.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:48:24.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:24.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:48:24.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:48:24.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:24.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:48:24.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:48:24.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:24.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:48:24.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:48:24.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:24.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:48:24.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:48:24.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:24.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:48:24.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:48:24.342 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.342 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:24.342 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.342 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:24.342 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:24.342 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.121465564000001, 2024-09-12T22:48:24.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:48:24.342 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:24.342 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:24.342 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:24.342 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:24.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:24.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:24.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:24.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:24.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:24.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:48:24.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:48:24.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:24.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:48:24.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:48:24.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:24.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:48:24.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:48:24.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:48:24.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:48:24.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:24.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:48:24.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:48:24.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:24.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:48:24.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:48:24.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:24.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:24.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:48:24.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:24.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:48:24.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:48:24.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:24.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:48:24.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:48:24.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:24.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:48:24.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:48:24.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:24.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:48:24.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:48:24.349 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.350 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:24.350 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.350 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:24.350 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:24.351 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.121442113000001, 2024-09-12T22:48:24.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:48:24.351 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:24.351 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:24.351 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:24.352 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:24.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:24.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:24.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:24.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:24.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:24.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:48:24.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:48:24.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:24.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:48:24.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:48:24.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:24.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:48:24.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:48:24.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:48:24.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:48:24.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:24.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:48:24.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:48:24.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:24.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:48:24.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:48:24.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:24.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:24.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:48:24.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:24.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:48:24.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:48:24.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:24.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:48:24.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:48:24.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:24.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:48:24.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:48:24.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:24.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:48:24.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:48:24.358 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.358 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:24.358 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.359 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:24.359 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:24.359 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.121417875999999, 2024-09-12T22:48:24.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:48:24.359 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:24.359 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:24.359 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:24.360 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:24.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:24.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:24.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:24.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:24.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:24.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:24.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:48:24.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:24.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:48:24.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:48:24.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:24.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:48:24.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:48:24.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:48:24.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:48:24.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:24.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:48:24.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:48:24.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:24.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:48:24.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:48:24.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:24.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:48:24.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:48:24.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:24.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:48:24.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:48:24.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:24.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:48:24.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:48:24.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:24.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:48:24.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:48:24.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:24.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:48:24.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:48:24.365 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.365 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:24.365 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.366 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:24.366 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:24.366 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.121389958999998, 2024-09-12T22:48:24.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:48:24.366 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:24.366 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:24.366 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:24.366 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:24.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:24.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:24.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:24.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:24.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:24.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:24.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:48:24.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:24.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:48:24.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:48:24.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:24.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:48:24.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:48:24.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:48:24.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:48:24.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:24.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:48:24.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:48:24.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:24.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:48:24.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:48:24.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:24.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:48:24.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:48:24.369 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.370 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:24.370 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.370 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:24.370 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:24.370 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.121315463999998, 2024-09-12T22:48:24.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:48:24.370 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:24.370 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:24.370 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:24.370 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:24.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:24.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:24.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:24.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:24.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:24.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:48:24.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:48:24.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:24.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:48:24.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:48:24.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:24.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:48:24.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:48:24.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:48:24.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:48:24.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:24.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:48:24.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:48:24.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:24.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:48:24.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:48:24.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:24.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:48:24.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:48:24.374 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.374 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:24.374 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.375 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:24.375 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:24.375 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.121269435999999, 2024-09-12T22:48:24.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:48:24.375 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:24.375 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:24.375 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:24.375 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:24.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:24.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:24.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:24.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:24.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:24.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:48:24.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:48:24.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:24.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:48:24.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:48:24.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:24.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:48:24.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:48:24.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:48:24.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:48:24.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:24.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:48:24.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:48:24.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:24.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:48:24.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:48:24.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:24.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:48:24.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:48:24.379 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.379 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:24.379 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.379 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:24.379 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:24.379 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.119098552000001, 2024-09-12T22:48:24.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:48:24.379 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:24.379 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:24.379 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:24.379 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:24.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:24.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:24.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:24.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:24.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:24.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:24.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:48:24.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:24.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:48:24.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:48:24.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:24.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:48:24.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:48:24.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:24.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:48:24.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:24.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:48:24.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:48:24.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:24.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:24.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:48:24.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:24.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:48:24.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:48:24.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:24.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:48:24.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:48:24.383 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.383 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:24.384 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.384 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:24.384 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:24.384 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.119048102000001, 2024-09-12T22:48:24.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:48:24.385 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:24.385 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:24.385 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:24.385 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:24.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:24.386 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:24.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:24.386 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:24.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:24.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:48:24.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:48:24.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:24.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:48:24.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:48:24.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:24.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:48:24.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:48:24.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:48:24.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:48:24.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:24.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:48:24.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:48:24.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:24.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:48:24.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:48:24.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:24.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:48:24.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:48:24.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:24.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:48:24.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:48:24.389 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.389 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:24.390 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.390 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:24.390 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:24.390 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.118994663999999, 2024-09-12T22:48:24.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:48:24.390 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:24.390 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:24.390 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:24.390 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:24.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:24.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:24.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:24.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:24.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:24.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:24.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:48:24.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:24.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:48:24.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:48:24.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:24.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:24.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:48:24.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:48:24.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:48:24.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:24.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:48:24.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:48:24.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:24.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:48:24.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:48:24.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:24.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:48:24.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:48:24.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:24.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:48:24.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:48:24.394 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.394 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:24.394 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.395 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:48:24.395 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:24.395 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.115010310999999, 2024-09-12T22:48:24.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:48:24.395 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:24.395 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:24.395 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:24.395 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:24.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:24.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:24.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:24.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:24.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:24.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:48:24.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:48:24.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:24.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:48:24.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:48:24.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:24.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:48:24.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:48:24.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:48:24.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:48:24.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:24.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:48:24.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:48:24.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:24.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:48:24.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:48:24.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:24.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:48:24.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:48:24.399 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.399 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:24.400 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.400 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:48:24.400 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177555+0000", 2024-09-12T22:48:24.400 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.114598572999999, 2024-09-12T22:48:24.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00094215900000000003, 2024-09-12T22:48:24.400 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:24.400 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:24.400 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:24.400 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:24.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:24.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177555+0000", 2024-09-12T22:48:24.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:24.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177555+0000", 2024-09-12T22:48:24.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:24.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177555+0000", 2024-09-12T22:48:24.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:48:24.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:24.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177559+0000", 2024-09-12T22:48:24.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9859999999999996e-06 2024-09-12T22:48:24.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:24.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177567+0000", 2024-09-12T22:48:24.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0609999999999996e-06 2024-09-12T22:48:24.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177575+0000", 2024-09-12T22:48:24.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7880000000000007e-06 2024-09-12T22:48:24.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:24.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178396+0000", 2024-09-12T22:48:24.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00082027800000000002 2024-09-12T22:48:24.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:24.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178402+0000", 2024-09-12T22:48:24.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9129999999999997e-06 2024-09-12T22:48:24.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:24.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178497+0000", 2024-09-12T22:48:24.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4616000000000003e-05 2024-09-12T22:48:24.404 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.404 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:24.404 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.404 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-09-12T22:48:24.404 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177704+0000", 2024-09-12T22:48:24.404 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.114449623999999, 2024-09-12T22:48:24.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010266369999999999, 2024-09-12T22:48:24.404 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:24.405 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:24.405 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:48:24.405 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:24.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:24.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177704+0000", 2024-09-12T22:48:24.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:24.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177704+0000", 2024-09-12T22:48:24.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:24.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177704+0000", 2024-09-12T22:48:24.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7099999999999998e-07 2024-09-12T22:48:24.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:24.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177706+0000", 2024-09-12T22:48:24.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8479999999999999e-06 2024-09-12T22:48:24.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:24.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177729+0000", 2024-09-12T22:48:24.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3229000000000001e-05 2024-09-12T22:48:24.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177734+0000", 2024-09-12T22:48:24.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-06 2024-09-12T22:48:24.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:24.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178650+0000", 2024-09-12T22:48:24.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0009167 2024-09-12T22:48:24.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:24.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178731+0000", 2024-09-12T22:48:24.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0006000000000006e-05 2024-09-12T22:48:24.409 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.409 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:24.409 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.409 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:48:24.409 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:24.409 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 17.129857772000001, 2024-09-12T22:48:24.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:48:24.409 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:24.409 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:24.410 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:24.410 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:24.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:24.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:24.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:24.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:24.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:24.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:24.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:48:24.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:48:24.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:24.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:48:24.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:48:24.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:24.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:48:24.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:48:24.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:48:24.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:48:24.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:24.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:48:24.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:48:24.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:24.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:48:24.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:48:24.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:24.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:48:24.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:48:24.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:24.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:48:24.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:48:24.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:24.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:48:24.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:48:24.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:24.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:48:24.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:48:24.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:24.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:24.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:24.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:48:24.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:48:24.414 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.415 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:24.415 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.415 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:24.415 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:24.415 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:24.415 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:48:24.416 INFO:tasks.workunit.client.0.smithi066.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T22:48:24.418 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:24.416+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:24.418 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:24.518 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:24.518+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:24.524 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:24.524 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:48:24.524 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:48:24.524 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:24.532 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:24.619 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:24.619+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:24.635 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:24.635 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:48:24.635 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:48:24.636 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:48:24.636 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:24.644 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:24.720 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:24.719+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:24.749 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:24.750 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:48:24.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:48:24.750 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:48:24.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.751 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:48:24.751 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:24.751 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 28.362947622, 2024-09-12T22:48:24.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:48:24.751 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:24.751 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:24.752 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:24.752 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:24.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:24.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:24.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:24.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:24.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:24.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:24.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:48:24.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:24.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:48:24.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:48:24.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:24.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:48:24.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:48:24.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:48:24.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:48:24.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:24.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:48:24.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:48:24.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:24.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:48:24.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:48:24.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:24.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:48:24.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:48:24.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:24.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:48:24.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:48:24.761 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.761 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:24.762 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.762 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:48:24.762 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:24.763 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 28.362505038999998, 2024-09-12T22:48:24.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:48:24.763 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:24.763 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:24.763 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:24.763 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:24.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:24.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:24.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:24.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:24.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:24.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:48:24.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:48:24.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:24.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:48:24.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:48:24.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:24.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:48:24.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:48:24.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:48:24.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:48:24.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:24.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:48:24.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:48:24.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:24.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:48:24.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:48:24.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:24.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:48:24.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:48:24.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:24.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:48:24.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:48:24.773 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.773 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:24.773 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.774 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:48:24.774 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:24.774 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 28.362138882, 2024-09-12T22:48:24.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:48:24.774 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:24.775 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:24.775 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:24.775 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:24.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:24.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:24.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:24.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:24.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:24.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:48:24.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:48:24.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:24.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:48:24.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:48:24.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:24.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:48:24.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:48:24.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:48:24.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:48:24.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:24.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:48:24.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:48:24.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:24.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:48:24.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:48:24.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:24.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:48:24.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:48:24.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:24.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:48:24.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:48:24.784 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.784 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:24.784 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.785 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:48:24.785 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:24.785 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 28.361726569999998, 2024-09-12T22:48:24.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:48:24.786 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:24.786 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:24.786 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:24.786 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:24.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:24.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:24.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:24.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:24.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:24.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:24.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:48:24.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:24.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:48:24.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:48:24.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:24.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:48:24.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:48:24.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:48:24.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:48:24.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:24.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:48:24.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:48:24.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:24.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:48:24.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:48:24.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:24.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:48:24.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:48:24.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:24.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:48:24.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:48:24.795 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.796 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:24.796 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.796 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:48:24.796 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:24.797 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 28.227876475999999, 2024-09-12T22:48:24.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:48:24.797 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:24.797 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:24.797 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:24.798 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:24.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:24.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:24.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:24.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:24.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:24.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:24.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:48:24.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:24.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:48:24.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:48:24.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:24.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:48:24.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:48:24.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:48:24.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:48:24.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:24.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:48:24.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:48:24.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:24.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:48:24.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:48:24.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:24.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:48:24.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:48:24.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:24.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:48:24.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:48:24.807 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.807 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:24.808 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.809 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:24.809 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:24.809 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 19.582640922, 2024-09-12T22:48:24.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:48:24.810 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:24.810 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:24.810 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:24.810 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:24.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:24.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:24.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:24.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:24.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:24.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:48:24.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:48:24.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:24.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:48:24.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:48:24.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:24.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:48:24.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:48:24.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:48:24.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:48:24.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:24.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:48:24.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:48:24.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:24.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:48:24.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:48:24.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:24.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:48:24.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:48:24.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:24.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:48:24.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:48:24.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:24.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:48:24.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:48:24.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:24.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:48:24.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:48:24.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:24.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:48:24.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:48:24.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:24.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:48:24.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:48:24.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:24.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:48:24.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:48:24.818 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.819 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:24.819 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.819 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:24.819 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:24.819 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 19.582541405000001, 2024-09-12T22:48:24.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:48:24.819 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:24.819 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:24.819 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:24.819 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:24.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:24.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:24.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:24.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:24.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:24.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:48:24.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:48:24.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:24.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:48:24.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:48:24.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:24.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:48:24.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:48:24.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:48:24.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:48:24.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:24.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:48:24.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:48:24.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:24.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:48:24.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:48:24.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:24.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:48:24.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:48:24.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:24.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:48:24.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:48:24.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:24.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:48:24.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:48:24.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:24.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:48:24.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:48:24.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:24.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:48:24.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:48:24.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:24.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:48:24.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:48:24.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:24.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:48:24.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:48:24.825 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.825 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:24.825 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.825 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:24.825 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:24.825 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 19.582496666000001, 2024-09-12T22:48:24.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:48:24.826 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:24.826 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:24.826 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:24.826 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:24.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:24.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:24.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:24.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:24.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:24.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:48:24.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:48:24.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:24.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:48:24.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:48:24.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:24.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:48:24.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:48:24.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:48:24.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:48:24.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:24.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:48:24.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:48:24.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:24.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:48:24.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:48:24.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:24.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:48:24.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:48:24.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:24.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:48:24.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:48:24.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:24.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:48:24.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:48:24.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:24.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:48:24.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:48:24.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:24.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:48:24.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:48:24.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:24.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:48:24.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:48:24.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:24.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:48:24.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:48:24.831 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.831 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:24.832 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.832 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:24.832 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:24.832 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 19.582268965000001, 2024-09-12T22:48:24.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:48:24.832 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:24.832 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:24.832 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:24.832 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:24.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:24.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:24.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:24.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:24.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:24.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:48:24.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:48:24.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:24.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:48:24.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:48:24.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:24.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:48:24.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:48:24.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:48:24.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:48:24.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:24.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:48:24.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:48:24.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:24.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:48:24.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:48:24.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:24.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:48:24.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:48:24.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:24.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:48:24.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:48:24.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:24.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:48:24.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:48:24.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:24.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:48:24.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:48:24.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:24.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:48:24.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:48:24.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:24.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:48:24.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:48:24.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:24.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:48:24.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:48:24.838 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.838 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:24.838 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.838 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:24.838 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:24.838 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 19.582103857, 2024-09-12T22:48:24.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:48:24.839 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:24.839 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:24.839 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:24.839 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:24.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:24.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:24.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:24.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:24.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:24.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:48:24.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:48:24.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:24.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:48:24.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:48:24.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:24.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:48:24.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:48:24.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:48:24.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:48:24.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:24.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:48:24.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:48:24.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:24.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:48:24.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:48:24.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:24.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:48:24.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:48:24.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:24.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:48:24.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:48:24.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:24.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:48:24.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:48:24.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:24.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:48:24.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:48:24.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:24.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:48:24.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:48:24.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:24.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:48:24.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:48:24.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:24.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:48:24.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:48:24.845 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.845 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:24.845 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.845 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:24.845 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:24.845 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 19.582042571999999, 2024-09-12T22:48:24.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:48:24.845 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:24.845 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:24.845 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:24.846 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:24.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:24.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:24.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:24.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:24.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:24.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:24.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:48:24.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:24.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:48:24.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:48:24.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:24.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:48:24.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:48:24.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:48:24.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:48:24.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:24.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:48:24.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:48:24.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:24.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:48:24.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:48:24.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:24.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:48:24.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:48:24.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:24.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:48:24.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:48:24.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:24.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:48:24.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:48:24.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:24.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:48:24.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:48:24.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:24.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:48:24.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:48:24.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:24.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:48:24.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:48:24.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:24.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:48:24.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:48:24.851 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.851 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:24.851 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.852 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:24.852 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:24.852 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 19.581962464, 2024-09-12T22:48:24.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:48:24.852 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:24.852 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:24.852 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:24.852 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:24.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:24.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:24.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:24.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:24.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:24.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:48:24.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:48:24.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:24.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:48:24.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:48:24.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:24.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:48:24.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:48:24.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:48:24.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:48:24.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:24.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:48:24.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:48:24.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:24.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:48:24.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:48:24.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:24.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:48:24.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:48:24.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:24.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:48:24.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:48:24.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:24.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:48:24.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:48:24.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:24.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:48:24.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:48:24.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:24.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:48:24.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:48:24.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:24.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:48:24.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:48:24.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:24.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:48:24.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:48:24.858 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.858 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:24.858 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.858 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:24.858 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:24.858 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 19.581913511, 2024-09-12T22:48:24.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:48:24.859 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:24.859 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:24.859 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:48:24.859 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:24.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:24.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:24.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:24.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:24.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:24.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:24.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:48:24.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:24.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:48:24.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:48:24.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:24.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:48:24.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:48:24.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:48:24.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:48:24.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:24.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:48:24.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:48:24.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:24.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:48:24.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:48:24.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:24.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:48:24.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:48:24.862 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.862 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:24.862 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.863 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:24.863 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:24.863 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 19.581864411000002, 2024-09-12T22:48:24.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:48:24.863 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:24.863 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:24.863 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:48:24.863 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:24.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:24.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:24.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:24.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:24.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:24.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:48:24.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:48:24.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:24.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:48:24.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:48:24.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:24.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:48:24.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:48:24.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:48:24.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:48:24.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:24.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:48:24.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:48:24.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:24.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:48:24.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:48:24.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:24.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:48:24.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:48:24.867 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.867 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:24.867 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.867 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:24.867 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:24.867 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 19.574923961, 2024-09-12T22:48:24.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:48:24.867 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:24.867 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:24.867 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:24.868 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:24.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:24.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:24.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:24.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:24.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:24.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:48:24.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:48:24.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:24.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:48:24.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:48:24.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:24.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:48:24.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:48:24.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:48:24.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:48:24.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:24.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:48:24.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:48:24.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:24.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:48:24.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:48:24.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:24.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:48:24.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:48:24.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:24.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:48:24.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:48:24.872 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.872 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:24.872 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.872 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:24.872 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:24.872 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 19.573835120999998, 2024-09-12T22:48:24.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:48:24.873 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:24.873 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:24.873 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:24.873 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:24.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:24.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:24.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.874 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:24.874 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:24.874 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.874 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.874 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.874 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:24.874 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:48:24.874 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:48:24.874 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.874 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.874 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:24.874 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:48:24.874 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:48:24.874 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.875 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:24.875 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:48:24.875 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:48:24.875 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.875 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.875 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:48:24.875 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:48:24.875 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.875 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:24.875 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:48:24.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:48:24.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.876 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:24.876 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:48:24.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:48:24.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.876 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:24.876 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:48:24.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:48:24.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:24.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:48:24.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:48:24.877 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.877 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:24.877 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.877 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.877 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:24.877 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:24.877 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 19.57378551, 2024-09-12T22:48:24.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:48:24.877 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:24.878 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:24.878 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:24.878 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:24.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.878 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:24.878 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:24.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.879 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.879 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:24.879 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:24.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.880 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.880 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:24.880 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:24.880 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:48:24.880 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.880 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:24.880 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:24.880 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:48:24.880 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.881 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.881 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:24.881 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:48:24.881 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:48:24.881 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.881 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.881 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.881 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:48:24.881 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:48:24.881 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.881 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.881 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:24.881 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:48:24.881 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:48:24.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.882 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:24.882 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:48:24.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:48:24.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.882 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:24.882 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:48:24.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:48:24.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.883 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:24.883 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:48:24.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:48:24.883 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.883 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:24.883 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.883 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:24.883 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:24.883 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 19.573718200999998, 2024-09-12T22:48:24.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:48:24.884 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:24.884 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:24.884 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:24.884 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:24.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:24.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:24.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:24.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:24.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:24.885 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:24.885 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:48:24.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:24.885 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:48:24.885 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:48:24.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:24.886 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:48:24.886 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:48:24.886 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.886 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.886 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.886 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:48:24.886 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:48:24.886 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.886 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.886 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:24.886 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:48:24.886 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:48:24.886 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.886 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.887 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:24.887 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:48:24.887 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:48:24.887 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.887 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.887 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:24.887 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:48:24.887 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:48:24.887 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.887 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.887 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:24.887 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:48:24.887 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:48:24.888 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.888 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:24.888 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.888 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.888 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.888 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:24.888 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:24.888 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 19.573150282, 2024-09-12T22:48:24.888 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:48:24.888 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:24.888 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:24.888 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:24.888 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:24.889 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.889 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:24.889 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:24.889 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.889 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.890 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:24.890 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:24.890 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.890 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.890 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:24.890 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:24.890 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:48:24.890 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.890 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:24.890 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:48:24.890 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:48:24.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.891 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.891 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:24.891 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:48:24.891 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:48:24.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.891 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.891 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.891 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:48:24.891 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:48:24.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.891 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.891 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:24.891 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:48:24.892 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:48:24.892 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.892 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.892 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:24.892 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:48:24.892 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:48:24.892 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.892 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.892 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:24.892 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:48:24.892 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:48:24.892 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.892 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.893 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:24.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:48:24.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:48:24.893 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.893 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:24.893 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.893 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:48:24.893 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:24.893 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 19.572772678, 2024-09-12T22:48:24.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:48:24.893 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:24.893 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:24.894 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:24.894 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:24.894 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.894 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:24.894 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:24.894 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.894 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.894 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.894 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:24.894 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:24.894 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:24.894 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.894 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.895 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:24.895 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:48:24.895 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:48:24.895 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.895 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.895 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:24.895 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:48:24.895 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:48:24.895 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.895 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.895 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:24.895 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:48:24.895 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:48:24.895 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.895 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.896 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:24.896 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:48:24.896 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:48:24.896 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.896 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.896 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:24.896 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:48:24.896 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:48:24.896 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.896 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.896 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:24.896 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:48:24.897 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:48:24.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.897 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:24.897 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:48:24.897 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:48:24.898 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:24.898 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:24.898 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:24.898 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:48:24.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:48:24.898 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.899 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:24.899 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.899 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:24.899 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:24.899 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:24.902 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:24.903 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:24.900+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:25.001 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:25.000+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:25.007 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:25.008 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:48:25.008 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:48:25.008 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:25.016 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:25.102 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:25.101+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:25.159 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:25.159 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:48:25.159 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:48:25.160 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:48:25.160 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:25.168 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:25.203 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:25.203+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:25.272 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:25.272 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:48:25.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:48:25.272 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:48:25.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.273 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:48:25.273 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:25.273 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.224449162999999, 2024-09-12T22:48:25.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:48:25.273 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:25.273 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:25.273 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:25.273 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:25.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:25.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:25.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:25.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:25.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:25.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:25.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:48:25.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:25.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:48:25.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:48:25.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:25.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:48:25.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:48:25.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:48:25.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:48:25.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:25.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:48:25.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:48:25.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:25.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:48:25.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:48:25.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:25.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:48:25.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:48:25.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:25.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:48:25.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:48:25.278 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.278 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:25.278 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.278 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:48:25.278 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:25.278 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 23.224068436, 2024-09-12T22:48:25.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:48:25.278 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:25.278 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:25.278 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:25.279 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:25.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:25.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:25.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:25.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:25.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:25.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:48:25.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:48:25.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:25.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:48:25.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:48:25.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:25.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:48:25.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:48:25.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:48:25.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:48:25.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:25.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:48:25.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:48:25.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:25.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:48:25.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:48:25.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:25.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:48:25.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:48:25.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:25.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:48:25.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:48:25.282 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.283 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:25.283 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.283 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:48:25.284 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:25.284 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 20.103471626000001, 2024-09-12T22:48:25.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:48:25.284 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:25.284 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:25.284 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:48:25.284 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:25.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:25.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:25.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:25.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:25.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:25.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:25.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:48:25.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:25.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:48:25.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:48:25.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:25.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:48:25.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:48:25.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:48:25.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:48:25.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:25.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:48:25.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:48:25.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:25.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:48:25.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:48:25.287 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.287 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:25.287 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.288 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:25.288 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:25.288 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 20.100863446000002, 2024-09-12T22:48:25.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:48:25.288 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:25.288 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:25.288 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:25.288 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:25.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:25.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:25.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:25.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:25.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:25.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:48:25.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:48:25.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:25.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:48:25.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:48:25.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:25.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:48:25.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:48:25.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:48:25.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:48:25.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:25.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:48:25.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:48:25.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:25.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:48:25.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:48:25.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:25.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:48:25.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:48:25.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:25.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:48:25.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:48:25.292 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.292 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:25.292 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.292 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:25.292 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:25.292 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 20.099970223, 2024-09-12T22:48:25.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:48:25.293 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:25.293 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:25.293 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:25.293 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:25.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:25.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:25.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:25.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:25.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:25.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:48:25.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:48:25.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:25.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:48:25.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:48:25.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:25.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:48:25.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:48:25.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:48:25.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:48:25.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:25.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:48:25.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:48:25.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:25.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:48:25.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:48:25.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:25.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:48:25.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:48:25.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:25.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:48:25.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:48:25.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:25.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:48:25.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:48:25.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:25.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:48:25.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:48:25.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:25.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:48:25.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:48:25.298 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.298 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:25.299 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.299 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:25.299 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:25.299 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 20.099898565, 2024-09-12T22:48:25.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:48:25.299 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:25.299 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:25.299 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:25.299 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:25.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:25.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:25.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:25.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:25.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:25.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:48:25.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:48:25.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:25.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:48:25.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:48:25.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:25.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:48:25.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:48:25.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:48:25.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:48:25.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:25.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:48:25.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:48:25.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:25.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:48:25.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:48:25.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:25.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:48:25.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:48:25.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:25.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:48:25.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:48:25.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:25.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:48:25.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:48:25.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:25.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:48:25.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:48:25.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:25.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:48:25.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:48:25.304 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.304 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:25.304 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.304 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:25.304 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:25.304 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 20.099855847000001, 2024-09-12T22:48:25.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:48:25.305 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:25.305 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:25.305 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:25.305 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:25.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:25.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:25.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:25.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:25.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:25.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:48:25.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:48:25.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:25.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:48:25.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:48:25.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:25.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:48:25.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:48:25.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:48:25.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:48:25.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:25.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:48:25.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:48:25.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:25.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:48:25.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:48:25.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:25.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:48:25.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:48:25.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:25.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:48:25.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:48:25.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:25.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:48:25.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:48:25.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:25.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:48:25.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:48:25.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:25.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:48:25.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:48:25.311 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.311 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:25.311 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.311 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:25.311 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:25.311 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 20.09981793, 2024-09-12T22:48:25.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:48:25.311 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:25.311 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:25.311 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:25.312 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:25.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:25.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:25.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:25.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:25.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:25.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:48:25.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:48:25.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:25.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:48:25.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:48:25.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:25.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:48:25.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:48:25.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:48:25.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:48:25.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:25.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:48:25.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:48:25.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:25.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:48:25.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:48:25.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:25.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:25.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:48:25.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:25.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:48:25.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:48:25.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:25.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:48:25.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:48:25.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:25.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:48:25.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:48:25.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:25.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:48:25.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:48:25.316 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.317 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:25.317 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.317 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:25.317 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:25.317 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 20.099794479, 2024-09-12T22:48:25.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:48:25.317 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:25.317 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:25.317 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:25.317 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:25.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:25.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:25.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:25.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:25.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:25.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:48:25.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:48:25.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:25.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:48:25.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:48:25.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:25.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:48:25.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:48:25.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:48:25.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:48:25.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:25.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:48:25.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:48:25.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:25.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:48:25.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:48:25.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:25.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:25.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:48:25.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:25.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:48:25.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:48:25.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:25.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:48:25.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:48:25.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:25.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:48:25.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:48:25.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:25.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:48:25.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:48:25.322 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.322 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:25.322 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.323 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:25.323 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:25.323 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 20.099770242000002, 2024-09-12T22:48:25.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:48:25.323 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:25.323 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:25.323 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:25.323 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:25.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:25.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:25.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:25.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:25.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:25.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:25.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:48:25.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:25.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:48:25.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:48:25.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:25.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:48:25.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:48:25.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:48:25.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:48:25.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:25.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:48:25.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:48:25.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:25.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:48:25.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:48:25.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:25.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:48:25.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:48:25.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:25.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:48:25.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:48:25.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:25.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:48:25.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:48:25.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:25.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:48:25.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:48:25.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:25.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:48:25.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:48:25.329 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.329 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:25.329 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.329 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:25.329 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:25.329 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 20.099742325000001, 2024-09-12T22:48:25.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:48:25.329 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:25.329 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:25.329 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:25.329 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:25.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:25.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:25.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:25.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:25.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:25.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:25.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:48:25.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:25.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:48:25.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:48:25.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:25.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:48:25.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:48:25.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:48:25.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:48:25.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:25.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:48:25.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:48:25.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:25.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:48:25.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:48:25.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:25.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:48:25.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:48:25.333 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.333 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:25.333 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.333 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:25.333 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:25.333 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 20.099667830000001, 2024-09-12T22:48:25.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:48:25.334 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:25.334 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:25.334 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:25.334 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:25.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:25.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:25.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:25.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:25.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:25.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:48:25.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:48:25.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:25.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:48:25.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:48:25.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:25.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:48:25.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:48:25.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:48:25.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:48:25.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:25.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:48:25.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:48:25.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:25.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:48:25.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:48:25.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:25.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:48:25.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:48:25.337 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.338 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:25.338 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.338 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:25.338 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:25.338 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 20.099621802000001, 2024-09-12T22:48:25.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:48:25.338 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:25.338 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:25.338 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:25.338 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:25.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:25.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:25.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:25.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:25.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:25.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:48:25.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:48:25.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:25.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:48:25.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:48:25.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:25.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:48:25.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:48:25.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:48:25.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:48:25.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:25.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:48:25.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:48:25.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:25.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:48:25.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:48:25.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:25.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:48:25.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:48:25.342 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.342 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:25.342 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.342 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:25.342 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:25.342 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 20.097450918, 2024-09-12T22:48:25.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:48:25.342 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:25.343 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:25.343 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:25.343 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:25.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:25.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:25.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:25.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:25.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:25.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:25.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:48:25.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:25.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:48:25.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:48:25.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:25.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:48:25.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:48:25.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:25.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:48:25.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:25.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:48:25.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:48:25.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:25.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:25.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:48:25.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:25.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:48:25.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:48:25.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:25.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:48:25.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:48:25.346 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.346 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:25.347 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.347 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:25.347 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:25.347 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 20.097400468, 2024-09-12T22:48:25.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:48:25.347 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:25.347 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:25.348 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:25.348 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:25.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:25.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:25.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:25.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:25.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:25.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:48:25.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:48:25.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:25.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:48:25.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:48:25.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:25.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:48:25.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:48:25.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:48:25.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:48:25.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:25.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:48:25.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:48:25.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:25.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:48:25.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:48:25.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:25.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:48:25.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:48:25.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:25.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:48:25.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:48:25.352 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.352 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:25.352 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.353 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:25.353 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:25.353 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 20.097347030000002, 2024-09-12T22:48:25.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:48:25.353 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:25.353 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:25.353 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:25.353 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:25.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:25.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:25.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:25.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:25.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:25.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:25.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:48:25.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:25.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:48:25.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:48:25.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:25.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:25.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:48:25.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:48:25.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:48:25.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:25.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:48:25.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:48:25.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:25.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:48:25.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:48:25.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:25.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:48:25.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:48:25.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:25.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:48:25.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:48:25.357 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.357 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:25.357 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.357 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:48:25.357 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:25.357 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 20.093362677000002, 2024-09-12T22:48:25.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:48:25.358 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:25.358 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:25.358 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:25.358 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:25.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:25.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:25.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:25.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:25.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:25.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:48:25.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:48:25.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:25.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:48:25.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:48:25.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:25.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:48:25.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:48:25.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:48:25.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:48:25.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:25.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:48:25.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:48:25.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:25.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:48:25.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:48:25.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:25.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:48:25.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:48:25.361 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.361 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:25.362 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.362 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:48:25.362 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177555+0000", 2024-09-12T22:48:25.362 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 20.092950939000001, 2024-09-12T22:48:25.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00094215900000000003, 2024-09-12T22:48:25.362 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:25.362 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:25.362 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:25.362 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:25.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:25.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177555+0000", 2024-09-12T22:48:25.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:25.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177555+0000", 2024-09-12T22:48:25.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:25.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177555+0000", 2024-09-12T22:48:25.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:48:25.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:25.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177559+0000", 2024-09-12T22:48:25.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9859999999999996e-06 2024-09-12T22:48:25.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:25.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177567+0000", 2024-09-12T22:48:25.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0609999999999996e-06 2024-09-12T22:48:25.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177575+0000", 2024-09-12T22:48:25.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7880000000000007e-06 2024-09-12T22:48:25.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:25.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178396+0000", 2024-09-12T22:48:25.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00082027800000000002 2024-09-12T22:48:25.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:25.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178402+0000", 2024-09-12T22:48:25.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9129999999999997e-06 2024-09-12T22:48:25.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:25.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178497+0000", 2024-09-12T22:48:25.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4616000000000003e-05 2024-09-12T22:48:25.366 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.366 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:25.366 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.366 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-09-12T22:48:25.366 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177704+0000", 2024-09-12T22:48:25.366 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 20.092801990000002, 2024-09-12T22:48:25.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010266369999999999, 2024-09-12T22:48:25.367 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:25.367 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:25.367 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:48:25.367 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:25.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:25.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177704+0000", 2024-09-12T22:48:25.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:25.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177704+0000", 2024-09-12T22:48:25.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:25.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177704+0000", 2024-09-12T22:48:25.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7099999999999998e-07 2024-09-12T22:48:25.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:25.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177706+0000", 2024-09-12T22:48:25.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8479999999999999e-06 2024-09-12T22:48:25.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:25.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177729+0000", 2024-09-12T22:48:25.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3229000000000001e-05 2024-09-12T22:48:25.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177734+0000", 2024-09-12T22:48:25.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-06 2024-09-12T22:48:25.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:25.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178650+0000", 2024-09-12T22:48:25.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0009167 2024-09-12T22:48:25.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:25.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178731+0000", 2024-09-12T22:48:25.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0006000000000006e-05 2024-09-12T22:48:25.370 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.370 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:25.370 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.370 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:48:25.370 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:25.371 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.108210138, 2024-09-12T22:48:25.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:48:25.371 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:25.371 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:25.371 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:25.371 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:25.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:25.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:25.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:25.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:25.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:25.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:25.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:48:25.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:48:25.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:25.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:48:25.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:48:25.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:25.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:48:25.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:48:25.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:48:25.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:48:25.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:25.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:48:25.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:48:25.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:25.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:48:25.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:48:25.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:25.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:48:25.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:48:25.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:25.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:48:25.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:48:25.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:25.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:48:25.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:48:25.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:25.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:48:25.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:48:25.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:25.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:25.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:25.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:48:25.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:48:25.377 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.377 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:25.377 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.377 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:25.377 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:25.377 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:25.379 INFO:teuthology.orchestra.run.smithi066.stderr:nodeep-scrub is set 2024-09-12T22:48:25.379 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:25.380 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:25.377+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:25.479 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:25.478+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:25.489 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:25.489 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:48:25.489 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:48:25.489 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:25.497 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:25.579 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:25.578+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:25.600 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:25.600 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:48:25.600 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:48:25.600 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:48:25.600 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:25.608 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:25.692 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:25.691+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:25.752 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:25.753 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:48:25.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:48:25.753 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:48:25.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.753 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:48:25.753 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:25.753 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 29.366812588999998, 2024-09-12T22:48:25.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:48:25.753 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:25.753 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:25.753 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:25.754 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:25.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:25.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:25.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:25.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:25.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:25.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:25.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:48:25.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:25.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:48:25.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:48:25.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:25.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:48:25.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:48:25.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:48:25.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:48:25.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:25.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:48:25.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:48:25.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:25.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:48:25.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:48:25.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:25.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:48:25.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:48:25.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:25.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:48:25.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:48:25.758 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.758 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:25.758 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.758 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:48:25.758 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:25.758 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 29.366370006, 2024-09-12T22:48:25.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:48:25.758 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:25.759 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:25.759 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:25.759 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:25.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:25.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:25.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:25.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:25.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:25.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:48:25.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:48:25.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:25.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:48:25.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:48:25.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:25.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:48:25.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:48:25.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:48:25.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:48:25.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:25.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:48:25.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:48:25.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:25.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:48:25.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:48:25.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:25.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:48:25.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:48:25.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:25.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:48:25.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:48:25.762 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.762 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:25.763 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.763 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:48:25.763 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:25.763 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 29.366003848999998, 2024-09-12T22:48:25.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:48:25.763 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:25.763 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:25.763 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:25.763 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:25.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:25.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:25.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:25.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:25.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:25.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:48:25.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:48:25.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:25.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:48:25.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:48:25.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:25.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:48:25.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:48:25.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:48:25.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:48:25.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:25.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:48:25.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:48:25.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:25.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:48:25.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:48:25.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:25.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:48:25.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:48:25.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:25.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:48:25.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:48:25.768 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.768 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:25.768 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.768 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:48:25.768 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:25.768 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 29.365591537, 2024-09-12T22:48:25.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:48:25.768 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:25.768 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:25.768 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:25.768 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:25.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:25.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:25.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:25.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:25.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:25.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:25.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:48:25.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:25.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:48:25.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:48:25.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:25.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:48:25.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:48:25.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:48:25.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:48:25.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:25.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:48:25.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:48:25.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:25.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:48:25.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:48:25.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:25.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:48:25.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:48:25.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:25.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:48:25.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:48:25.772 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.772 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:25.772 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.773 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:48:25.773 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:25.773 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 29.231741443000001, 2024-09-12T22:48:25.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:48:25.773 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:25.773 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:25.773 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:25.773 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:25.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:25.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:25.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:25.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:25.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:25.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:25.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:48:25.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:25.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:48:25.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:48:25.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:25.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:48:25.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:48:25.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:48:25.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:48:25.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:25.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:48:25.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:48:25.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:25.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:48:25.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:48:25.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:25.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:48:25.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:48:25.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:25.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:48:25.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:48:25.777 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.777 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:25.777 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.777 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:25.777 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:25.777 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.586505889000001, 2024-09-12T22:48:25.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:48:25.778 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:25.778 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:25.778 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:25.778 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:25.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:25.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:25.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:25.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:25.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:25.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:48:25.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:48:25.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:25.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:48:25.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:48:25.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:25.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:48:25.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:48:25.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:48:25.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:48:25.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:25.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:48:25.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:48:25.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:25.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:48:25.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:48:25.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:25.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:48:25.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:48:25.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:25.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:48:25.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:48:25.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:25.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:48:25.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:48:25.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:25.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:48:25.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:48:25.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:25.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:48:25.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:48:25.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:25.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:48:25.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:48:25.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:25.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:48:25.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:48:25.784 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.784 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:25.784 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.785 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:25.785 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:25.785 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.586406371999999, 2024-09-12T22:48:25.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:48:25.785 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:25.786 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:25.786 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:25.786 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:25.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:25.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:25.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:25.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:25.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:25.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:48:25.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:48:25.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:25.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:48:25.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:48:25.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:25.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:48:25.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:48:25.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:48:25.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:48:25.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:25.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:48:25.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:48:25.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:25.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:48:25.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:48:25.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:25.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:48:25.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:48:25.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:25.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:48:25.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:48:25.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:25.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:48:25.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:48:25.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:25.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:48:25.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:48:25.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:25.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:48:25.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:48:25.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:25.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:48:25.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:48:25.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:25.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:48:25.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:48:25.792 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.792 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:25.792 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.793 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:25.793 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:25.793 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.586361632999999, 2024-09-12T22:48:25.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:48:25.793 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:25.793 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:25.793 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:25.793 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:25.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:25.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:25.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:25.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:25.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:25.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:48:25.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:48:25.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:25.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:48:25.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:48:25.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:25.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:48:25.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:48:25.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:48:25.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:48:25.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:25.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:48:25.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:48:25.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:25.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:48:25.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:48:25.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:25.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:48:25.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:48:25.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:25.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:48:25.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:48:25.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:25.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:48:25.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:48:25.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:25.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:48:25.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:48:25.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:25.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:48:25.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:48:25.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:25.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:48:25.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:48:25.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:25.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:48:25.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:48:25.799 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.800 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:25.800 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.800 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:25.800 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:25.800 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.586133931999999, 2024-09-12T22:48:25.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:48:25.800 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:25.800 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:25.800 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:25.801 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:25.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:25.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:25.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:25.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:25.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:25.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:48:25.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:48:25.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:25.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:48:25.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:48:25.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:25.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:48:25.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:48:25.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:48:25.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:48:25.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:25.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:48:25.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:48:25.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:25.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:48:25.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:48:25.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:25.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:48:25.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:48:25.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:25.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:48:25.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:48:25.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:25.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:48:25.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:48:25.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:25.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:48:25.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:48:25.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:25.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:48:25.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:48:25.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:25.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:48:25.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:48:25.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:25.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:48:25.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:48:25.807 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.807 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:25.807 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.807 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:25.807 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:25.807 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.585968823999998, 2024-09-12T22:48:25.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:48:25.808 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:25.808 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:25.808 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:25.808 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:25.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:25.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:25.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:25.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:25.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:25.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:48:25.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:48:25.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:25.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:48:25.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:48:25.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:25.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:48:25.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:48:25.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:48:25.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:48:25.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:25.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:48:25.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:48:25.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:25.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:48:25.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:48:25.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:25.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:48:25.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:48:25.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:25.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:48:25.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:48:25.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:25.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:48:25.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:48:25.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:25.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:48:25.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:48:25.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:25.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:48:25.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:48:25.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:25.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:48:25.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:48:25.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:25.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:48:25.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:48:25.815 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.815 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:25.815 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.815 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:25.816 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:25.816 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.585907539000001, 2024-09-12T22:48:25.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:48:25.816 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:25.816 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:25.816 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:25.816 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:25.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:25.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:25.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:25.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:25.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:25.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:25.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:48:25.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:25.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:48:25.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:48:25.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:25.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:48:25.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:48:25.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:48:25.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:48:25.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:25.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:48:25.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:48:25.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:25.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:48:25.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:48:25.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:25.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:48:25.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:48:25.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:25.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:48:25.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:48:25.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:25.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:48:25.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:48:25.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:25.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:48:25.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:48:25.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:25.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:48:25.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:48:25.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:25.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:48:25.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:48:25.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:25.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:48:25.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:48:25.822 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.822 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:25.822 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.822 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:25.822 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:25.822 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.585827430999998, 2024-09-12T22:48:25.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:48:25.822 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:25.822 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:25.823 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:25.823 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:25.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:25.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:25.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:25.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:25.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:25.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:48:25.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:48:25.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:25.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:48:25.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:48:25.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:25.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:48:25.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:48:25.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:48:25.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:48:25.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:25.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:48:25.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:48:25.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:25.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:48:25.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:48:25.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:25.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:48:25.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:48:25.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:25.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:48:25.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:48:25.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:25.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:48:25.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:48:25.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:25.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:48:25.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:48:25.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:25.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:48:25.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:48:25.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:25.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:48:25.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:48:25.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:25.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:48:25.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:48:25.833 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.833 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:25.833 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.833 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:25.833 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:25.833 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.585778478000002, 2024-09-12T22:48:25.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:48:25.833 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:25.834 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:25.834 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:48:25.834 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:25.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:25.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:25.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:25.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:25.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:25.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:25.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:48:25.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:25.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:48:25.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:48:25.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:25.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:48:25.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:48:25.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:48:25.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:48:25.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:25.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:48:25.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:48:25.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:25.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:48:25.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:48:25.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:25.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:48:25.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:48:25.837 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.837 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:25.837 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.837 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:25.837 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:25.837 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.585729378, 2024-09-12T22:48:25.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:48:25.838 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:25.838 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:25.838 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:48:25.838 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:25.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:25.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:25.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:25.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:25.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:25.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:48:25.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:48:25.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:25.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:48:25.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:48:25.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:25.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:48:25.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:48:25.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:48:25.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:48:25.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:25.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:48:25.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:48:25.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:25.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:48:25.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:48:25.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:25.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:48:25.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:48:25.841 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.841 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:25.841 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.841 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:25.842 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:25.842 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.578788928000002, 2024-09-12T22:48:25.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:48:25.842 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:25.842 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:25.842 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:25.842 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:25.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:25.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:25.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:25.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:25.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:25.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:48:25.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:48:25.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:25.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:48:25.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:48:25.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:25.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:48:25.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:48:25.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:48:25.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:48:25.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:25.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:48:25.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:48:25.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:25.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:48:25.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:48:25.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:25.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:48:25.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:48:25.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:25.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:48:25.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:48:25.846 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.846 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:25.846 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.846 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:25.846 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:25.846 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.577700088, 2024-09-12T22:48:25.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:48:25.847 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:25.847 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:25.847 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:25.847 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:25.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:25.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:25.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:25.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:25.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:25.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:48:25.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:48:25.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:25.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:48:25.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:48:25.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:25.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:48:25.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:48:25.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:48:25.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:48:25.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:25.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:48:25.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:48:25.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:25.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:48:25.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:48:25.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:25.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:48:25.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:48:25.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:25.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:48:25.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:48:25.850 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.850 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:25.851 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.851 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:25.851 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:25.851 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.577650476999999, 2024-09-12T22:48:25.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:48:25.851 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:25.851 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:25.851 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:25.851 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:25.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:25.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:25.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:25.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:25.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:25.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:25.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:48:25.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:25.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:25.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:48:25.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:25.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:48:25.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:48:25.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:48:25.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:48:25.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:25.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:48:25.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:48:25.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:25.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:48:25.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:48:25.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:25.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:48:25.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:48:25.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:25.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:48:25.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:48:25.855 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.855 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:25.855 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.856 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:25.856 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:25.856 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.577583168, 2024-09-12T22:48:25.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:48:25.856 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:25.856 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:25.856 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:25.856 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:25.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:25.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:25.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:25.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:25.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:25.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:25.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:48:25.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:25.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:48:25.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:48:25.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:25.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:48:25.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:48:25.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:48:25.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:48:25.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:25.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:48:25.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:48:25.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:25.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:48:25.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:48:25.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:25.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:48:25.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:48:25.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:25.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:48:25.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:48:25.860 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.860 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:25.860 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.860 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:25.860 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:25.860 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.577015248999999, 2024-09-12T22:48:25.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:48:25.861 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:25.861 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:25.861 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:25.861 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:25.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:25.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:25.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:25.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:25.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:25.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:25.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:48:25.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:25.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:48:25.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:48:25.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:25.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:48:25.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:48:25.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:48:25.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:48:25.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:25.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:48:25.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:48:25.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:25.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:48:25.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:48:25.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:25.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:48:25.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:48:25.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:25.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:48:25.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:48:25.865 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.865 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:25.865 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.865 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:48:25.865 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:25.865 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.576637645000002, 2024-09-12T22:48:25.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:48:25.865 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:25.865 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:25.865 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:25.865 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:25.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:25.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:25.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:25.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:25.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:25.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:25.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:48:25.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:48:25.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:25.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:48:25.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:48:25.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:25.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:48:25.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:48:25.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:25.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:48:25.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:48:25.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:25.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:48:25.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:48:25.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:25.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:48:25.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:48:25.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:25.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:48:25.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:48:25.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:25.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:25.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:25.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:48:25.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:48:25.869 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.869 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:25.869 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.869 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:25.870 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:25.870 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:25.870 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-12T22:48:25.882 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:25.883 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:25.879+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:25.980 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is on 2024-09-12T22:48:25.981 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:25.980+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:25.992 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:25.992 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:48:25.992 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:48:25.992 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:26.001 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:26.082 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:26.080+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:26.103 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:26.103 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:48:26.104 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:48:26.104 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:48:26.104 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:26.112 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:26.116 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:48:26.183 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:26.182+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:26.254 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:48:26.255 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:48:26.256 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:26.257 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:48:26.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:48:26.257 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:48:26.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.257 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:48:26.257 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:26.257 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.208788298999998, 2024-09-12T22:48:26.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:48:26.257 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:26.257 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:26.257 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:26.258 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:26.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:26.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:26.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:26.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:26.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:26.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:26.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:48:26.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:26.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:48:26.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:48:26.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:26.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:48:26.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:48:26.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:26.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:48:26.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:48:26.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:26.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:48:26.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:48:26.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:26.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:48:26.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:48:26.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:26.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:48:26.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:48:26.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:26.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:48:26.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:48:26.261 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.262 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:26.262 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.262 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:48:26.262 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:26.262 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.208407571999999, 2024-09-12T22:48:26.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:48:26.262 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:26.262 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:26.262 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:26.262 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:26.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:26.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:26.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:26.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:26.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:26.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:48:26.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:48:26.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:26.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:48:26.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:48:26.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:26.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:48:26.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:48:26.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:26.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:48:26.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:48:26.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:26.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:48:26.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:48:26.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:26.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:48:26.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:48:26.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:26.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:48:26.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:48:26.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:26.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:48:26.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:48:26.267 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.267 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:26.267 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.267 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:48:26.267 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:26.267 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.087810762, 2024-09-12T22:48:26.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:48:26.268 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:26.268 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:26.268 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:48:26.268 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:26.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:26.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:26.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:26.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:26.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:26.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:26.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:48:26.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:26.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:48:26.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:48:26.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:26.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:48:26.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:48:26.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:26.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:48:26.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:48:26.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:26.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:48:26.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:48:26.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:26.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:48:26.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:48:26.271 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.271 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:26.271 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.272 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:26.272 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:26.272 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.085202582000001, 2024-09-12T22:48:26.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:48:26.272 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:26.272 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:26.272 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:26.272 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:26.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:26.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:26.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:26.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:26.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:26.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:48:26.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:48:26.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:26.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:48:26.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:48:26.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:26.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:48:26.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:48:26.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:26.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:48:26.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:48:26.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:26.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:48:26.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:48:26.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:26.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:48:26.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:48:26.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:26.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:48:26.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:48:26.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:26.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:48:26.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:48:26.276 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.276 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:26.276 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.276 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:26.276 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:26.276 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.084309358999999, 2024-09-12T22:48:26.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:48:26.277 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:26.277 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:26.277 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:26.277 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:26.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:26.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:26.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:26.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:26.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:26.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:48:26.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:48:26.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:26.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:48:26.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:48:26.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:26.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:48:26.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:48:26.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:26.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:48:26.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:48:26.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:26.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:48:26.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:48:26.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:26.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:48:26.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:48:26.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:26.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:48:26.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:48:26.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:26.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:48:26.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:48:26.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:26.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:48:26.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:48:26.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:26.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:48:26.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:48:26.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:26.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:48:26.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:48:26.282 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.282 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:26.282 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.282 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:26.283 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:26.283 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.084237700999999, 2024-09-12T22:48:26.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:48:26.283 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:26.283 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:26.283 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:26.283 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:26.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:26.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:26.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:26.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:26.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:26.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:48:26.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:48:26.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:26.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:48:26.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:48:26.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:26.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:48:26.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:48:26.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:26.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:48:26.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:48:26.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:26.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:48:26.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:48:26.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:26.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:48:26.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:48:26.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:26.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:48:26.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:48:26.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:26.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:48:26.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:48:26.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:26.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:48:26.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:48:26.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:26.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:48:26.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:48:26.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:26.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:48:26.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:48:26.288 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.288 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:26.289 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.289 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:26.289 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:26.289 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.084194983, 2024-09-12T22:48:26.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:48:26.289 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:26.289 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:26.289 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:26.289 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:26.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:26.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:26.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:26.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:26.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:26.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:48:26.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:48:26.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:26.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:48:26.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:48:26.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:26.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:48:26.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:48:26.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:26.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:48:26.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:48:26.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:26.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:48:26.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:48:26.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:26.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:48:26.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:48:26.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:26.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:48:26.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:48:26.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:26.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:48:26.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:48:26.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:26.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:48:26.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:48:26.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:26.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:48:26.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:48:26.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:26.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:48:26.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:48:26.294 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.294 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:26.294 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.295 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:26.295 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:26.295 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.084157066, 2024-09-12T22:48:26.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:48:26.295 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:26.295 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:26.295 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:26.295 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:26.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:26.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:26.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:26.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:26.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:26.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:48:26.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:48:26.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:26.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:48:26.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:48:26.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:26.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:48:26.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:48:26.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:26.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:48:26.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:48:26.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:26.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:48:26.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:48:26.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:26.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:48:26.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:48:26.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:26.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:26.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:48:26.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:26.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:48:26.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:48:26.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:26.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:48:26.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:48:26.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:26.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:48:26.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:48:26.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:26.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:48:26.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:48:26.300 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.300 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:26.300 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.300 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:26.301 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:26.301 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.084133614999999, 2024-09-12T22:48:26.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:48:26.301 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:26.301 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:26.301 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:26.301 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:26.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:26.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:26.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:26.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:26.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:26.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:48:26.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:48:26.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:26.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:48:26.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:48:26.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:26.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:48:26.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:48:26.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:26.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:48:26.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:48:26.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:26.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:48:26.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:48:26.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:26.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:48:26.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:48:26.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:26.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:26.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:48:26.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:26.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:48:26.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:48:26.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:26.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:48:26.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:48:26.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:26.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:48:26.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:48:26.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:26.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:48:26.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:48:26.306 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.306 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:26.306 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.306 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:26.306 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:26.307 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.084109378000001, 2024-09-12T22:48:26.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:48:26.307 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:26.307 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:26.307 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:26.307 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:26.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:26.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:26.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:26.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:26.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:26.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:26.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:48:26.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:26.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:48:26.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:48:26.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:26.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:48:26.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:48:26.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:26.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:48:26.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:48:26.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:26.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:48:26.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:48:26.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:26.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:48:26.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:48:26.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:26.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:48:26.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:48:26.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:26.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:48:26.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:48:26.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:26.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:48:26.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:48:26.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:26.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:48:26.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:48:26.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:26.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:48:26.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:48:26.312 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.312 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:26.312 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.313 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:26.313 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:26.313 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.084081461, 2024-09-12T22:48:26.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:48:26.313 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:26.313 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:26.313 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:26.314 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:26.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:26.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:26.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:26.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:26.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:26.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:26.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:48:26.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:26.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:48:26.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:48:26.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:26.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:48:26.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:48:26.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:26.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:48:26.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:48:26.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:26.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:48:26.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:48:26.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:26.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:48:26.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:48:26.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:26.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:48:26.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:48:26.317 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.317 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:26.318 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.318 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:26.318 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:26.318 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.084006966, 2024-09-12T22:48:26.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:48:26.318 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:26.318 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:26.318 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:26.318 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:26.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:26.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:26.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:26.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:26.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:26.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:48:26.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:48:26.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:26.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:48:26.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:48:26.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:26.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:48:26.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:48:26.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:26.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:48:26.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:48:26.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:26.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:48:26.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:48:26.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:26.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:48:26.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:48:26.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:26.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:48:26.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:48:26.322 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.322 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:26.322 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.322 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:26.322 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:26.322 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.083960938000001, 2024-09-12T22:48:26.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:48:26.323 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:26.323 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:26.323 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:26.323 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:26.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:26.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:26.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:26.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:26.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:26.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:48:26.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:48:26.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:26.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:48:26.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:48:26.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:26.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:48:26.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:48:26.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:26.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:48:26.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:48:26.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:26.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:48:26.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:48:26.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:26.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:48:26.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:48:26.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:26.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:48:26.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:48:26.327 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.327 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:26.327 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.327 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:26.327 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:26.327 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.081790053999999, 2024-09-12T22:48:26.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:48:26.327 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:26.328 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:26.328 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:26.328 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:26.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:26.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:26.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:26.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:26.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:26.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:26.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:48:26.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:26.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:48:26.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:48:26.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:26.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:48:26.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:48:26.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:26.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:26.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:48:26.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:26.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:48:26.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:48:26.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:26.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:26.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:48:26.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:26.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:48:26.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:48:26.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:26.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:48:26.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:48:26.332 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.332 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:26.332 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.332 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:26.332 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:26.333 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.081739603999999, 2024-09-12T22:48:26.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:48:26.333 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:26.333 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:26.333 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:26.333 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:26.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:26.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:26.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:26.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:26.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:26.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:48:26.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:48:26.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:26.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:48:26.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:48:26.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:26.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:48:26.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:48:26.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:26.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:48:26.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:48:26.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:26.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:48:26.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:48:26.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:26.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:48:26.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:48:26.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:26.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:48:26.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:48:26.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:26.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:48:26.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:48:26.338 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.338 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:26.338 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.339 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:26.339 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:26.339 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.081686166000001, 2024-09-12T22:48:26.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:48:26.339 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:26.339 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:26.339 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:26.339 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:26.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:26.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:26.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:26.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:26.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:26.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:26.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:48:26.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:26.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:48:26.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:48:26.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:26.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:26.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:48:26.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:26.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:48:26.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:48:26.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:26.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:48:26.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:48:26.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:26.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:48:26.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:48:26.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:26.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:48:26.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:48:26.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:26.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:48:26.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:48:26.343 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.343 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:26.343 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.344 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:48:26.344 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:26.344 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.077701813000001, 2024-09-12T22:48:26.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:48:26.344 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:26.345 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:26.345 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:26.345 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:26.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:26.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:26.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:26.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:26.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:26.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:48:26.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:48:26.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:26.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:48:26.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:48:26.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:26.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:48:26.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:48:26.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:26.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:48:26.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:48:26.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:26.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:48:26.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:48:26.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:26.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:48:26.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:48:26.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:26.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:48:26.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:48:26.350 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.350 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:26.350 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.351 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-09-12T22:48:26.351 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177704+0000", 2024-09-12T22:48:26.351 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.077141126000001, 2024-09-12T22:48:26.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010266369999999999, 2024-09-12T22:48:26.351 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:26.352 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:26.352 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:48:26.352 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:26.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:26.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177704+0000", 2024-09-12T22:48:26.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:26.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177704+0000", 2024-09-12T22:48:26.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:26.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177704+0000", 2024-09-12T22:48:26.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7099999999999998e-07 2024-09-12T22:48:26.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:26.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177706+0000", 2024-09-12T22:48:26.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8479999999999999e-06 2024-09-12T22:48:26.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:26.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177729+0000", 2024-09-12T22:48:26.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3229000000000001e-05 2024-09-12T22:48:26.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:26.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177734+0000", 2024-09-12T22:48:26.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-06 2024-09-12T22:48:26.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:26.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178650+0000", 2024-09-12T22:48:26.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0009167 2024-09-12T22:48:26.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:26.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178731+0000", 2024-09-12T22:48:26.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0006000000000006e-05 2024-09-12T22:48:26.359 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.359 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:26.359 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.360 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:48:26.360 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:26.360 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.092549274, 2024-09-12T22:48:26.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:48:26.360 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:26.360 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:26.361 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:26.361 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:26.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:26.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:26.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:26.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:26.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:26.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:48:26.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:48:26.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:26.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:48:26.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:48:26.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:26.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:48:26.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:48:26.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:26.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:48:26.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:48:26.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:26.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:48:26.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:48:26.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:26.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:48:26.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:48:26.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:26.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:48:26.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:48:26.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:26.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:48:26.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:48:26.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:26.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:48:26.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:48:26.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:26.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:48:26.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:48:26.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:26.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:48:26.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:48:26.372 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.372 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:26.372 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.373 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:48:26.373 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:26.373 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 1.0906330289999999, 2024-09-12T22:48:26.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:48:26.374 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:26.374 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:26.374 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:26.374 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:26.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:26.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:26.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:26.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:26.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:26.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:26.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:48:26.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:48:26.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:26.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:48:26.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:48:26.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:26.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:48:26.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:48:26.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:26.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:48:26.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:48:26.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:26.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:48:26.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:48:26.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:26.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:48:26.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:48:26.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:26.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:48:26.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:48:26.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:26.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:48:26.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:48:26.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:26.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:48:26.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:48:26.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:26.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:48:26.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:48:26.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:26.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:26.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:26.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:48:26.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:48:26.380 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.380 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:26.380 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.380 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:26.380 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:26.380 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:26.381 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:48:26.382 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:26.380+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:26.382 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:48:26.382 INFO:teuthology.orchestra.run.smithi066.stdout:osd.2: {} 2024-09-12T22:48:26.383 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:26.384 INFO:teuthology.orchestra.run.smithi066.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:48:26.483 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:26.481+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:26.491 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:26.491 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:26.500 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:26.584 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:26.582+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:26.602 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:26.602 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:26.612 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:26.684 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:26.683+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:26.717 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:26.717 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:26.726 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:26.785 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:26.785+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:26.830 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:26.830 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:26.839 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:26.886 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:26.884+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:26.940 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:26.940 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:26.948 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:26.990 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:26.988+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:27.088 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:27.087+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:27.091 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:27.091 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:27.100 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:27.188 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:27.187+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:27.205 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:27.205 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:27.213 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:27.289 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:27.287+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:27.359 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:27.359 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:27.369 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:27.379 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:48:27.390 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:27.389+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:27.471 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:27.471 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:27.479 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:27.523 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:27.521+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:27.583 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:27.583 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:27.591 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:27.589+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:27.593 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:27.693 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:27.692+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:27.736 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:27.736 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:27.744 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:27.793 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:27.793+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:27.846 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:27.846 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:27.854 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:27.894 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:27.893+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:27.961 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:27.961 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:27.969 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:27.995 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:27.994+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:28.072 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:28.072 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:28.081 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:28.095 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:28.094+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:28.183 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:28.184 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:28.192 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:28.236 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:28.234+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:28.295 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:28.295 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:28.296 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:28.294+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:28.304 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:28.323 INFO:teuthology.orchestra.run.smithi066.stderr:noscrub is unset 2024-09-12T22:48:28.385 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:48:28.397 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:28.395+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:28.446 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:28.446 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:28.454 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:28.498 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:28.495+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:28.517 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:48:28.518 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:48:28.535 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:48:28.536 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:48:28.536 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:48:28.539 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:48:28.539 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:48:28.599 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:28.599 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:48:28.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:48:28.599 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:48:28.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.600 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:48:28.600 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:28.600 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.551401287000001, 2024-09-12T22:48:28.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:48:28.600 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:28.600 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:28.600 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:28.600 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:28.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:28.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:28.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:28.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:28.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:28.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:28.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:48:28.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:28.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:48:28.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:48:28.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:28.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:48:28.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:48:28.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:28.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:48:28.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:48:28.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.604 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:28.604 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:48:28.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:48:28.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.604 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:28.604 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:48:28.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:48:28.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:28.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:48:28.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:48:28.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:28.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:48:28.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:48:28.605 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.605 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:28.605 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.606 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:48:28.606 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:28.606 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.551020560000001, 2024-09-12T22:48:28.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:48:28.606 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:28.606 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:28.606 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:28.606 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:28.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:28.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:28.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:28.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:28.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:28.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:48:28.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:48:28.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:28.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:48:28.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:48:28.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:28.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:48:28.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:48:28.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:28.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:48:28.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:48:28.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:28.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:48:28.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:48:28.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:28.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:48:28.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:48:28.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:28.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:48:28.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:48:28.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:28.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:48:28.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:48:28.610 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.610 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:28.610 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.610 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:48:28.610 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:28.610 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 23.430423749999999, 2024-09-12T22:48:28.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:48:28.611 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:28.611 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:28.611 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:48:28.611 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:28.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:28.611 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:28.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:28.611 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:28.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:28.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:28.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:48:28.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:28.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:48:28.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:48:28.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:28.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:48:28.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:48:28.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:28.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:48:28.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:48:28.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:28.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:48:28.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:48:28.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:28.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:48:28.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:48:28.614 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.614 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:28.614 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.614 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:28.614 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:28.614 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 23.42781557, 2024-09-12T22:48:28.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:48:28.615 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:28.615 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:28.615 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:28.615 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:28.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:28.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:28.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:28.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:28.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:28.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:48:28.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:48:28.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:28.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:48:28.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:48:28.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:28.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:48:28.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:48:28.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:28.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:48:28.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:48:28.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:28.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:48:28.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:48:28.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:28.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:48:28.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:48:28.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:28.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:48:28.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:48:28.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:28.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:48:28.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:48:28.619 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.619 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:28.619 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.619 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:28.619 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:28.619 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 23.426922347000001, 2024-09-12T22:48:28.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:48:28.619 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:28.619 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:28.619 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:28.620 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:28.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:28.620 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:28.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:28.620 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:28.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.621 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:28.621 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:48:28.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:48:28.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:28.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:48:28.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:48:28.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:28.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:48:28.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:48:28.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:28.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:48:28.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:48:28.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:28.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:48:28.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:48:28.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:28.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:48:28.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:48:28.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:28.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:48:28.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:48:28.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:28.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:48:28.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:48:28.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:28.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:48:28.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:48:28.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:28.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:48:28.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:48:28.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:28.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:48:28.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:48:28.625 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.626 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:28.626 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.626 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:28.626 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:28.626 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 23.426850688999998, 2024-09-12T22:48:28.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:48:28.626 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:28.626 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:28.626 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:28.626 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:28.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:28.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:28.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:28.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:28.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:28.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:48:28.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:48:28.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:28.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:48:28.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:48:28.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:28.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:48:28.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:48:28.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:28.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:48:28.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:48:28.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:28.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:48:28.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:48:28.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:28.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:48:28.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:48:28.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:28.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:48:28.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:48:28.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:28.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:48:28.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:48:28.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:28.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:48:28.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:48:28.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:28.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:48:28.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:48:28.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:28.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:48:28.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:48:28.632 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.632 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:28.632 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.632 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.632 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.632 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:28.632 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:28.632 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 23.426807970999999, 2024-09-12T22:48:28.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:48:28.632 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:28.632 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:28.632 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:28.633 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:28.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:28.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:28.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:28.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:28.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:28.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:48:28.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:48:28.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:28.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:48:28.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:48:28.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:28.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:48:28.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:48:28.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:28.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:48:28.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:48:28.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:28.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:48:28.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:48:28.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:28.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:48:28.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:48:28.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:28.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:48:28.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:48:28.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:28.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:48:28.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:48:28.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.637 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:28.637 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:48:28.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:48:28.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.637 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:28.637 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:48:28.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:48:28.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.637 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:28.637 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:48:28.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:48:28.638 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.638 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:28.638 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.638 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:28.638 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:28.638 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 23.426770053999999, 2024-09-12T22:48:28.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:48:28.638 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:28.638 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:28.638 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:28.638 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:28.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:28.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:28.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:28.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:28.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:28.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:48:28.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:48:28.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:28.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:48:28.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:48:28.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:28.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:48:28.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:48:28.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:28.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:48:28.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:48:28.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:28.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:48:28.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:48:28.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:28.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:48:28.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:48:28.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:28.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:28.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:48:28.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:28.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:48:28.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:48:28.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:28.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:48:28.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:48:28.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:28.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:48:28.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:48:28.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:28.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:48:28.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:48:28.643 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.643 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:28.643 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.643 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:28.644 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:28.644 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 23.426746603000002, 2024-09-12T22:48:28.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:48:28.644 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:28.644 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:28.644 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:28.644 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:28.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:28.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:28.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:28.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:28.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:28.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:48:28.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:48:28.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:28.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:48:28.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:48:28.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:28.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:48:28.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:48:28.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:28.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:48:28.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:48:28.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:28.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:48:28.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:48:28.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:28.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:48:28.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:48:28.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:28.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:28.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:48:28.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:28.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:48:28.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:48:28.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:28.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:48:28.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:48:28.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:28.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:48:28.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:48:28.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:28.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:48:28.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:48:28.649 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.649 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:28.649 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.649 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:28.649 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:28.649 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 23.426722366, 2024-09-12T22:48:28.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:48:28.650 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:28.650 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:28.650 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:28.650 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:28.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:28.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:28.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:28.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:28.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:28.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:28.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:48:28.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:28.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:48:28.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:48:28.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:28.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:48:28.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:48:28.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:28.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:48:28.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:48:28.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:28.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:48:28.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:48:28.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:28.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:48:28.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:48:28.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:28.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:48:28.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:48:28.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:28.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:48:28.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:48:28.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:28.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:48:28.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:48:28.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:28.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:48:28.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:48:28.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:28.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:48:28.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:48:28.655 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.655 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:28.655 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.655 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:28.655 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:28.655 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 23.426694448999999, 2024-09-12T22:48:28.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:48:28.655 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:28.655 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:28.656 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:28.656 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:28.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:28.656 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:28.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:28.656 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:28.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:28.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:28.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:48:28.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:28.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:48:28.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:48:28.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:28.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:48:28.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:48:28.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:28.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:48:28.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:48:28.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:28.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:48:28.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:48:28.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:28.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:48:28.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:48:28.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:28.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:48:28.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:48:28.659 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.659 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:28.659 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.659 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:28.659 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:28.659 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 23.426619954, 2024-09-12T22:48:28.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:48:28.660 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:28.660 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:28.660 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:28.660 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:28.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:28.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:28.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:28.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:28.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:28.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:48:28.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:48:28.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:28.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:48:28.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:48:28.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:28.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:48:28.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:48:28.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:28.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:48:28.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:48:28.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:28.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:48:28.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:48:28.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:28.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:48:28.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:48:28.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:28.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:48:28.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:48:28.663 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.663 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:28.663 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.663 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:28.664 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:28.664 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 23.426573926, 2024-09-12T22:48:28.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:48:28.664 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:28.664 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:28.664 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:28.664 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:28.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:28.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:28.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:28.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:28.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:28.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:48:28.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:48:28.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:28.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:48:28.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:48:28.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:28.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:48:28.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:48:28.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:28.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:48:28.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:48:28.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:28.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:48:28.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:48:28.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:28.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:48:28.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:48:28.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:28.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:48:28.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:48:28.667 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.667 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:28.668 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.668 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:28.668 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:28.668 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 23.424403042000002, 2024-09-12T22:48:28.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:48:28.668 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:28.668 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:28.668 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:28.668 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:28.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:28.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:28.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:28.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:28.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:28.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:28.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:48:28.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:28.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:48:28.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:48:28.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:28.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:48:28.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:48:28.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:28.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:28.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:48:28.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:28.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:48:28.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:48:28.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:28.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:28.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:48:28.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:28.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:48:28.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:48:28.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:28.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:48:28.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:48:28.673 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.673 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:28.673 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.673 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:28.673 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:28.673 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 23.424352591999998, 2024-09-12T22:48:28.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:48:28.674 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:28.674 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:28.674 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:28.674 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:28.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:28.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:28.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:28.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:28.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:28.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:48:28.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:48:28.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:28.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:48:28.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:48:28.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:28.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:48:28.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:48:28.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:28.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:48:28.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:48:28.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:28.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:48:28.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:48:28.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:28.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:48:28.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:48:28.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:28.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:48:28.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:48:28.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:28.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:48:28.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:48:28.678 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.679 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:28.679 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.679 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:28.679 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:28.679 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 23.424299154, 2024-09-12T22:48:28.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:48:28.679 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:28.679 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:28.679 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:28.679 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:28.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:28.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:28.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:28.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:28.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:28.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:28.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:48:28.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:28.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:48:28.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:48:28.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:28.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:28.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:48:28.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:28.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:48:28.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:48:28.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:28.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:48:28.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:48:28.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:28.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:48:28.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:48:28.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:28.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:48:28.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:48:28.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:28.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:48:28.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:48:28.683 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.683 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:28.683 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.683 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:48:28.684 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:28.684 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 23.420314801, 2024-09-12T22:48:28.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:48:28.684 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:28.684 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:28.684 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:28.684 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:28.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:28.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:28.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:28.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:28.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:28.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:48:28.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:48:28.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:28.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:48:28.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:48:28.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:28.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:48:28.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:48:28.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:28.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:48:28.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:48:28.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:28.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:48:28.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:48:28.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:28.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:48:28.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:48:28.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:28.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:48:28.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:48:28.687 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.687 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:28.688 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.688 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-09-12T22:48:28.688 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177704+0000", 2024-09-12T22:48:28.688 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 23.419754114, 2024-09-12T22:48:28.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010266369999999999, 2024-09-12T22:48:28.688 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:28.688 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:28.688 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:48:28.688 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:28.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:28.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177704+0000", 2024-09-12T22:48:28.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:28.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177704+0000", 2024-09-12T22:48:28.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:28.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177704+0000", 2024-09-12T22:48:28.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7099999999999998e-07 2024-09-12T22:48:28.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:28.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177706+0000", 2024-09-12T22:48:28.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8479999999999999e-06 2024-09-12T22:48:28.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:28.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177729+0000", 2024-09-12T22:48:28.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3229000000000001e-05 2024-09-12T22:48:28.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:28.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177734+0000", 2024-09-12T22:48:28.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-06 2024-09-12T22:48:28.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:28.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178650+0000", 2024-09-12T22:48:28.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0009167 2024-09-12T22:48:28.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:28.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178731+0000", 2024-09-12T22:48:28.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0006000000000006e-05 2024-09-12T22:48:28.691 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.692 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:28.692 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.692 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:48:28.692 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:28.692 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.435162261999999, 2024-09-12T22:48:28.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:48:28.693 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:28.693 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:28.693 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:28.693 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:28.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:28.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:28.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:28.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:28.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:28.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:48:28.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:48:28.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:28.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:48:28.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:48:28.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:28.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:48:28.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:48:28.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:28.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:48:28.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:48:28.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:28.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:48:28.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:48:28.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:28.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:48:28.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:48:28.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:28.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:48:28.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:48:28.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:28.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:48:28.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:48:28.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:28.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:48:28.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:48:28.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:28.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:48:28.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:48:28.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:28.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:48:28.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:48:28.698 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.698 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:28.698 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.699 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:48:28.699 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:28.699 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.4332460170000001, 2024-09-12T22:48:28.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:48:28.699 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:28.699 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:28.699 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:28.699 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:28.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:28.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:28.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:28.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:28.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:28.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:28.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:48:28.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:48:28.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:28.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:48:28.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:48:28.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:28.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:48:28.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:48:28.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:28.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:48:28.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:48:28.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:28.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:48:28.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:48:28.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:28.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:48:28.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:48:28.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:28.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:48:28.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:48:28.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:28.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:48:28.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:48:28.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:28.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:48:28.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:48:28.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:28.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:48:28.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:48:28.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:28.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:28.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:28.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:48:28.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:48:28.704 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.704 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:28.704 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.704 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:28.704 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:28.704 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:28.705 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:28.598+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:28.706 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:28.704+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:28.706 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:28.806 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:28.805+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:28.813 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:28.813 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:48:28.813 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:48:28.814 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:28.823 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:28.907 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:28.906+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:28.966 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:28.966 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:48:28.966 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:48:28.966 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:48:28.966 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:28.974 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:29.008 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:29.006+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:29.108 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:29.107+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:29.118 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:29.118 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:48:29.119 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:48:29.119 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:48:29.119 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.119 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:48:29.119 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:29.119 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.732809330999999, 2024-09-12T22:48:29.119 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:48:29.119 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:29.119 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:29.119 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:29.119 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:29.119 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.119 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:29.120 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:29.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.120 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.120 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:29.120 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:29.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.120 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.120 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:29.120 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:29.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:48:29.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.121 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.121 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:29.121 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:48:29.121 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:48:29.121 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.121 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.121 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:29.121 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:48:29.121 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:48:29.121 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.121 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.121 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.121 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:48:29.122 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:48:29.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:29.122 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:48:29.122 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:48:29.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:29.122 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:48:29.122 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:48:29.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.123 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:29.123 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:48:29.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:48:29.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.123 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:29.123 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:48:29.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:48:29.123 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.123 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:29.123 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.124 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:48:29.124 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:29.124 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.732366747999997, 2024-09-12T22:48:29.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:48:29.124 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:29.124 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:29.124 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:29.124 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:29.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:29.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:29.125 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.125 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:29.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:29.125 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.125 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:29.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:48:29.125 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:48:29.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.126 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.126 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:29.126 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:48:29.126 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:48:29.126 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.126 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.126 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:29.126 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:48:29.126 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:48:29.126 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.126 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.126 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.126 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:48:29.127 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:48:29.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.127 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.127 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:29.127 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:48:29.127 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:48:29.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.127 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.127 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:29.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:48:29.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:48:29.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:29.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:48:29.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:48:29.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:29.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:48:29.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:48:29.129 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.129 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:29.129 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.129 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:48:29.129 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:29.129 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.732000591000002, 2024-09-12T22:48:29.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:48:29.129 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:29.129 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:29.129 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:29.129 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:29.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:29.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:29.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:29.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:29.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.131 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:29.131 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:48:29.131 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:48:29.131 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.131 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.131 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:29.131 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:48:29.131 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:48:29.131 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.131 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.131 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:29.131 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:48:29.132 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:48:29.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.132 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.132 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:48:29.132 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:48:29.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.132 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:29.132 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:48:29.132 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:48:29.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:29.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:48:29.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:48:29.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:29.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:48:29.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:48:29.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:29.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:48:29.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:48:29.134 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.134 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:29.134 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.134 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:48:29.134 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:29.134 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.731588279, 2024-09-12T22:48:29.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:48:29.134 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:29.134 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:29.134 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:29.135 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:29.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:29.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:29.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:29.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:29.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:29.136 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:29.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:48:29.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.136 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:29.136 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:48:29.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:48:29.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.136 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:29.136 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:48:29.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:48:29.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.137 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:48:29.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:48:29.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:29.137 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:48:29.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:48:29.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:29.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:48:29.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:48:29.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:29.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:48:29.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:48:29.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:29.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:48:29.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:48:29.138 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.138 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:29.139 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.139 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:48:29.139 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:29.139 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.597738184999997, 2024-09-12T22:48:29.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:48:29.139 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:29.139 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:29.139 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:29.139 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:29.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:29.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:29.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.140 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:29.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:29.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.140 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:29.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:29.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:48:29.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:29.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:48:29.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:48:29.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:29.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:48:29.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:48:29.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:48:29.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:48:29.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:29.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:48:29.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:48:29.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:29.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:48:29.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:48:29.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:29.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:48:29.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:48:29.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:29.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:48:29.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:48:29.143 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.143 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:29.143 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.143 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:29.143 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:29.144 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 23.952502631000002, 2024-09-12T22:48:29.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:48:29.144 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:29.144 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:29.144 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:29.144 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:29.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:29.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:29.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:29.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:29.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:29.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:48:29.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:48:29.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:29.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:48:29.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:48:29.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:29.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:48:29.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:48:29.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:48:29.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:48:29.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:29.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:48:29.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:48:29.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:29.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:48:29.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:48:29.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:29.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:48:29.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:48:29.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:29.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:48:29.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:48:29.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:29.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:48:29.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:48:29.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:29.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:48:29.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:48:29.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:29.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:48:29.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:48:29.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:29.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:48:29.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:48:29.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:29.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:48:29.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:48:29.150 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.150 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:29.150 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.150 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:29.150 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:29.150 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 23.952403113999999, 2024-09-12T22:48:29.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:48:29.150 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:29.150 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:29.150 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:29.150 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:29.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:29.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:29.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:29.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:29.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:29.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:48:29.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:48:29.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.152 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:29.152 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:48:29.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:48:29.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.152 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:29.152 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:48:29.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:48:29.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.153 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.153 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:48:29.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:48:29.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.153 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:29.153 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:48:29.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:48:29.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:29.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:48:29.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:48:29.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:29.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:48:29.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:48:29.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:29.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:48:29.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:48:29.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:29.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:48:29.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:48:29.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:29.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:48:29.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:48:29.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:29.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:48:29.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:48:29.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:29.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:48:29.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:48:29.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:29.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:48:29.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:48:29.156 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.156 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:29.157 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.157 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:29.157 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:29.157 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 23.952358374999999, 2024-09-12T22:48:29.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:48:29.157 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:29.157 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:29.157 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:29.157 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:29.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:29.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:29.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:29.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:29.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:29.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:48:29.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:48:29.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:29.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:48:29.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:48:29.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:29.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:48:29.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:48:29.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:48:29.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:48:29.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.160 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:29.160 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:48:29.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:48:29.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.160 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:29.160 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:48:29.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:48:29.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.160 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:29.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:48:29.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:48:29.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:29.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:48:29.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:48:29.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:29.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:48:29.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:48:29.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:29.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:48:29.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:48:29.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:29.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:48:29.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:48:29.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:29.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:48:29.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:48:29.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.163 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:29.163 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:48:29.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:48:29.163 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.163 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:29.163 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.163 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:29.163 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:29.164 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 23.952130673999999, 2024-09-12T22:48:29.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:48:29.164 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:29.164 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:29.164 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:29.164 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:29.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:29.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:29.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:29.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:29.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:29.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:48:29.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:48:29.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:29.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:48:29.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:48:29.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:29.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:48:29.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:48:29.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:48:29.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:48:29.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:29.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:48:29.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:48:29.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.167 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:29.167 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:48:29.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:48:29.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.167 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:29.167 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:48:29.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:48:29.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.167 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:29.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:48:29.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:48:29.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:29.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:48:29.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:48:29.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:29.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:48:29.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:48:29.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:29.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:48:29.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:48:29.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:29.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:48:29.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:48:29.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:29.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:48:29.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:48:29.170 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.170 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:29.170 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.170 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:29.170 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:29.170 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 23.951965565999998, 2024-09-12T22:48:29.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:48:29.170 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:29.170 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:29.170 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:29.171 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:29.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:29.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:29.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:29.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:29.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:29.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:48:29.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:48:29.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:29.172 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:48:29.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:48:29.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:29.172 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:48:29.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:48:29.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.173 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.173 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:48:29.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:48:29.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.173 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:29.173 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:48:29.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:48:29.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.173 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:29.173 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:48:29.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:48:29.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:29.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:48:29.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:48:29.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:29.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:48:29.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:48:29.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:29.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:48:29.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:48:29.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:29.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:48:29.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:48:29.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:29.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:48:29.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:48:29.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:29.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:48:29.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:48:29.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:29.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:48:29.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:48:29.176 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.176 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:29.176 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.177 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:29.177 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:29.177 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 23.951904281000001, 2024-09-12T22:48:29.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:48:29.177 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:29.177 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:29.177 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:29.177 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:29.177 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.177 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:29.177 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:29.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.177 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.178 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:29.178 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:29.178 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.178 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:29.178 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:29.178 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:48:29.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.178 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:29.178 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:48:29.178 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:48:29.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:29.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:48:29.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:48:29.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:48:29.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:48:29.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:29.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:48:29.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:48:29.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:29.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:48:29.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:48:29.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:29.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:48:29.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:48:29.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.181 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:29.181 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:48:29.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:48:29.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.181 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:29.181 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:48:29.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:48:29.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.181 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:29.181 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:48:29.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:48:29.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.182 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:29.182 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:48:29.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:48:29.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.182 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:29.182 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:48:29.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:48:29.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.182 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:29.183 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:48:29.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:48:29.183 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.183 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:29.183 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.183 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:29.183 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:29.183 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 23.951824172999999, 2024-09-12T22:48:29.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:48:29.183 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:29.183 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:29.184 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:29.184 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:29.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:29.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:29.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:29.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:29.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:29.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:48:29.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:48:29.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:29.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:48:29.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:48:29.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:29.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:48:29.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:48:29.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:48:29.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:48:29.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:29.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:48:29.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:48:29.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:29.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:48:29.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:48:29.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:29.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:48:29.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:48:29.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:29.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:48:29.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:48:29.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:29.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:48:29.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:48:29.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:29.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:48:29.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:48:29.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:29.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:48:29.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:48:29.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:29.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:48:29.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:48:29.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:29.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:48:29.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:48:29.189 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.189 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:29.189 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.190 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:29.190 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:29.190 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 23.951775220000002, 2024-09-12T22:48:29.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:48:29.190 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:29.190 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:29.190 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:48:29.190 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:29.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:29.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:29.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:29.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:29.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:29.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:29.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:48:29.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:29.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:48:29.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:48:29.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:29.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:48:29.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:48:29.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:48:29.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:48:29.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:29.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:48:29.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:48:29.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.193 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:29.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:48:29.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:48:29.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.193 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:29.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:48:29.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:48:29.193 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.194 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:29.194 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.194 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.194 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:29.194 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:29.194 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 23.95172612, 2024-09-12T22:48:29.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:48:29.194 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:29.194 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:29.194 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:48:29.194 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:29.194 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:29.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:29.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:29.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:29.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:29.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:48:29.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:48:29.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:29.196 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:48:29.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:48:29.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:29.196 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:48:29.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:48:29.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.197 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:48:29.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:48:29.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.197 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:29.197 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:48:29.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:48:29.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.197 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:29.197 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:48:29.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:48:29.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:29.198 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:48:29.198 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:48:29.198 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.198 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:29.198 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.198 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:29.198 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:29.198 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 23.944785670000002, 2024-09-12T22:48:29.198 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:48:29.199 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:29.199 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:29.199 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:29.199 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:29.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:29.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:29.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:29.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:29.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:29.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:48:29.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:48:29.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:29.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:48:29.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:48:29.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:29.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:48:29.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:48:29.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:48:29.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:48:29.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:29.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:48:29.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:48:29.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.202 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:29.202 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:48:29.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:48:29.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.202 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:29.202 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:48:29.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:48:29.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.202 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:29.202 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:48:29.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:48:29.203 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.203 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:29.203 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.203 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.203 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.203 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:29.203 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:29.203 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 23.94369683, 2024-09-12T22:48:29.203 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:48:29.203 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:29.203 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:29.203 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:29.203 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:29.204 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.204 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:29.204 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:29.204 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.204 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.204 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:29.204 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:29.204 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.204 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.204 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:29.204 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:48:29.204 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:48:29.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:29.205 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:48:29.205 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:48:29.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:29.205 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:48:29.205 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:48:29.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.206 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:48:29.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:48:29.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.206 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:29.206 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:48:29.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:48:29.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.206 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:29.206 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:48:29.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:48:29.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.207 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.207 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:29.207 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:48:29.207 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:48:29.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.207 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.207 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:29.207 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:48:29.207 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:48:29.207 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.207 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:29.207 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.207 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.208 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:29.208 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:29.208 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 23.943647218999999, 2024-09-12T22:48:29.208 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:48:29.208 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:29.208 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:29.208 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:29.208 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:29.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.208 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:29.208 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:29.208 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.209 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.209 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:29.209 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:29.209 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.209 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.209 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:29.209 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:29.209 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:48:29.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.209 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.209 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:29.209 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:29.210 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:48:29.210 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.210 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.210 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:29.210 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:48:29.210 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:48:29.210 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.210 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.210 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.210 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:48:29.210 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:48:29.210 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.211 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.211 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:29.211 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:48:29.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:48:29.211 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.211 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.211 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:29.211 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:48:29.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:48:29.211 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.211 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.211 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:29.211 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:48:29.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:48:29.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.212 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.212 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:29.212 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:48:29.212 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:48:29.212 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.212 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:29.212 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.212 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.212 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:29.212 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:29.212 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 23.94357991, 2024-09-12T22:48:29.213 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:48:29.213 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:29.213 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:29.213 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:29.213 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:29.213 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.213 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:29.213 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:29.213 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.213 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.213 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.213 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:29.213 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:29.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.214 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:29.214 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:29.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:48:29.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.214 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:29.214 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:48:29.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:48:29.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.214 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:29.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:48:29.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:48:29.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.215 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:48:29.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:48:29.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.215 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:29.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:48:29.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:48:29.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:29.216 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:48:29.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:48:29.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:29.216 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:48:29.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:48:29.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:29.216 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:48:29.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:48:29.217 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.217 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:29.217 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.217 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.217 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.217 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:29.217 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:29.217 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 23.943011990999999, 2024-09-12T22:48:29.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:48:29.217 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:29.217 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:29.217 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:29.218 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:29.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:29.218 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:29.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:29.218 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:29.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:29.218 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:29.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:48:29.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:29.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:48:29.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:48:29.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:29.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:48:29.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:48:29.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.220 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:48:29.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:48:29.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.220 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:29.220 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:48:29.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:48:29.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.220 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:29.220 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:48:29.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:48:29.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.221 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:29.221 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:48:29.221 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:48:29.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.221 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:29.221 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:48:29.221 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:48:29.221 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.221 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:29.221 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.222 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:48:29.222 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:29.222 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 23.942634386999998, 2024-09-12T22:48:29.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:48:29.222 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:29.222 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:29.222 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:29.222 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:29.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.222 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:29.222 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:29.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:29.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:29.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:29.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:29.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:48:29.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:48:29.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:29.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:48:29.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:48:29.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:29.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:48:29.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:48:29.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:48:29.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:48:29.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.225 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:29.225 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:48:29.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:48:29.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.225 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.225 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:29.225 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:48:29.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:48:29.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.225 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.225 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:29.225 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:48:29.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:48:29.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:29.226 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:29.226 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:29.226 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:48:29.226 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:48:29.226 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.226 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:29.226 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.226 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:29.226 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:29.226 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:29.228 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:29.228 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:29.227+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:29.329 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:29.326+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:29.333 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:29.334 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:48:29.334 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:48:29.334 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:29.342 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:29.429 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:29.427+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:29.485 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:29.485 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:48:29.485 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:48:29.486 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:48:29.486 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:29.494 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:29.535 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:29.534+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:29.631 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:29.629+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:29.638 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:29.638 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:48:29.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:48:29.638 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:48:29.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.638 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:48:29.638 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:29.638 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.590316404999999, 2024-09-12T22:48:29.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:48:29.638 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:29.639 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:29.639 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:29.639 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:29.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:29.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:29.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:29.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:29.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:29.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:29.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:48:29.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:29.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:48:29.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:48:29.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:29.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:48:29.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:48:29.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:48:29.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:48:29.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:29.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:48:29.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:48:29.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:29.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:48:29.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:48:29.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:29.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:48:29.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:48:29.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:29.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:48:29.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:48:29.643 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.643 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:29.643 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.643 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:48:29.643 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:29.643 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 27.589935678, 2024-09-12T22:48:29.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:48:29.643 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:29.643 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:29.643 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:29.643 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:29.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:29.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:29.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:29.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:29.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:29.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:48:29.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:48:29.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:29.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:48:29.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:48:29.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:29.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:48:29.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:48:29.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:48:29.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:48:29.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:29.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:48:29.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:48:29.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:29.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:48:29.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:48:29.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:29.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:48:29.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:48:29.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:29.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:48:29.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:48:29.647 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.647 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:29.647 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.648 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:48:29.648 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:29.648 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.469338868000001, 2024-09-12T22:48:29.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:48:29.648 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:29.648 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:29.648 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:48:29.648 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:29.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:29.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:29.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:29.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:29.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:29.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:29.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:48:29.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:29.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:48:29.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:48:29.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:29.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:48:29.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:48:29.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:48:29.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:48:29.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:29.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:48:29.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:48:29.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:29.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:48:29.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:48:29.651 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.651 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:29.651 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.652 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:29.652 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:29.652 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.466730687999998, 2024-09-12T22:48:29.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:48:29.652 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:29.652 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:29.652 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:29.652 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:29.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:29.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:29.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:29.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:29.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:29.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:48:29.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:48:29.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:29.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:48:29.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:48:29.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:29.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:48:29.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:48:29.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:48:29.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:48:29.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:29.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:48:29.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:48:29.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:29.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:48:29.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:48:29.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:29.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:48:29.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:48:29.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:29.656 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:48:29.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:48:29.656 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.656 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:29.656 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.656 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:29.656 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:29.657 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.465837465, 2024-09-12T22:48:29.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:48:29.657 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:29.657 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:29.657 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:29.657 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:29.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:29.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:29.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:29.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:29.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:29.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:48:29.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:48:29.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:29.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:48:29.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:48:29.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:29.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:48:29.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:48:29.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:48:29.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:48:29.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:29.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:48:29.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:48:29.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:29.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:48:29.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:48:29.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:29.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:48:29.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:48:29.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:29.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:48:29.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:48:29.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:29.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:48:29.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:48:29.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:29.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:48:29.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:48:29.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:29.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:48:29.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:48:29.662 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.662 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:29.662 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.662 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:29.662 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:29.662 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.465765807, 2024-09-12T22:48:29.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:48:29.662 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:29.663 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:29.663 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:29.663 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:29.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:29.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:29.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:29.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:29.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:29.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:48:29.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:48:29.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:29.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:48:29.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:48:29.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:29.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:48:29.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:48:29.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:48:29.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:48:29.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:29.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:48:29.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:48:29.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:29.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:48:29.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:48:29.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:29.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:48:29.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:48:29.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:29.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:48:29.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:48:29.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:29.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:48:29.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:48:29.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:29.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:48:29.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:48:29.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:29.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:48:29.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:48:29.668 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.668 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:29.668 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.668 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:29.668 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:29.668 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.465723089000001, 2024-09-12T22:48:29.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:48:29.668 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:29.668 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:29.669 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:29.669 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:29.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:29.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:29.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:29.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:29.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:29.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:48:29.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:48:29.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:29.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:48:29.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:48:29.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:29.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:48:29.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:48:29.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:48:29.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:48:29.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:29.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:48:29.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:48:29.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:29.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:48:29.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:48:29.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:29.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:48:29.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:48:29.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:29.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:48:29.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:48:29.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:29.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:48:29.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:48:29.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:29.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:48:29.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:48:29.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:29.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:48:29.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:48:29.674 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.674 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:29.674 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.674 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:29.674 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:29.674 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.465685172000001, 2024-09-12T22:48:29.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:48:29.674 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:29.674 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:29.674 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:29.674 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:29.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:29.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:29.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:29.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:29.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:29.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:48:29.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:48:29.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:29.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:48:29.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:48:29.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:29.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:48:29.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:48:29.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:48:29.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:48:29.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:29.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:48:29.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:48:29.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:29.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:48:29.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:48:29.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:29.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:29.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:48:29.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:29.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:48:29.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:48:29.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:29.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:48:29.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:48:29.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:29.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:48:29.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:48:29.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:29.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:48:29.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:48:29.679 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.679 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:29.680 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.680 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:29.680 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:29.680 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.465661721, 2024-09-12T22:48:29.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:48:29.680 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:29.680 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:29.680 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:29.680 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:29.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:29.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:29.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:29.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:29.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:29.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:48:29.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:48:29.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:29.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:48:29.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:48:29.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:29.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:48:29.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:48:29.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:48:29.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:48:29.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:29.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:48:29.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:48:29.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:29.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:48:29.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:48:29.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:29.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:29.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:48:29.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:29.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:48:29.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:48:29.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:29.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:48:29.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:48:29.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:29.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:48:29.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:48:29.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:29.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:48:29.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:48:29.685 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.685 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:29.685 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.686 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:29.686 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:29.686 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.465637483999998, 2024-09-12T22:48:29.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:48:29.686 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:29.686 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:29.686 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:29.686 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:29.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:29.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:29.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:29.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:29.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:29.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:29.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:48:29.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:29.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:48:29.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:48:29.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:29.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:48:29.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:48:29.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:48:29.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:48:29.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:29.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:48:29.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:48:29.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:29.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:48:29.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:48:29.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:29.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:48:29.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:48:29.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:29.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:48:29.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:48:29.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:29.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:48:29.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:48:29.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:29.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:48:29.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:48:29.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:29.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:48:29.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:48:29.691 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.691 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:29.691 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.691 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:29.691 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:29.692 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.465609567000001, 2024-09-12T22:48:29.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:48:29.692 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:29.692 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:29.692 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:29.692 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:29.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:29.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:29.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:29.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:29.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:29.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:29.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:48:29.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:29.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:48:29.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:48:29.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:29.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:48:29.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:48:29.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:48:29.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:48:29.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:29.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:48:29.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:48:29.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:29.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:48:29.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:48:29.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:29.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:48:29.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:48:29.695 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.695 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:29.695 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.696 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:29.696 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:29.696 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.465535072000002, 2024-09-12T22:48:29.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:48:29.696 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:29.696 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:29.696 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:29.696 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:29.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:29.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:29.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:29.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:29.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:29.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:48:29.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:48:29.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:29.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:48:29.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:48:29.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:29.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:48:29.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:48:29.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:48:29.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:48:29.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:29.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:48:29.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:48:29.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:29.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:48:29.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:48:29.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:29.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:48:29.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:48:29.701 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.701 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:29.701 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.701 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:29.701 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:29.701 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.465489044000002, 2024-09-12T22:48:29.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:48:29.702 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:29.702 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:29.702 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:29.702 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:29.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:29.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:29.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:29.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:29.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:29.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:48:29.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:48:29.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:29.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:48:29.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:48:29.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:29.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:48:29.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:48:29.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:48:29.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:48:29.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:29.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:48:29.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:48:29.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:29.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:48:29.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:48:29.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:29.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:48:29.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:48:29.705 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.705 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:29.705 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.706 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:29.706 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:29.706 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.46331816, 2024-09-12T22:48:29.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:48:29.706 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:29.706 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:29.706 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:29.706 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:29.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:29.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:29.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:29.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:29.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:29.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:29.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:48:29.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:29.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:48:29.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:48:29.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:29.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:48:29.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:48:29.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:29.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:48:29.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:29.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:48:29.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:48:29.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:29.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:29.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:48:29.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:29.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:48:29.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:48:29.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:29.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:48:29.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:48:29.710 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.710 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:29.710 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.710 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:29.710 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:29.710 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.46326771, 2024-09-12T22:48:29.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:48:29.710 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:29.711 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:29.711 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:29.711 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:29.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:29.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:29.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:29.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:29.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:29.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:48:29.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:48:29.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:29.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:48:29.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:48:29.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:29.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:48:29.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:48:29.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:48:29.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:48:29.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:29.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:48:29.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:48:29.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:29.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:48:29.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:48:29.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:29.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:48:29.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:48:29.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:29.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:48:29.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:48:29.714 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.715 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:29.715 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.715 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:29.715 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:29.715 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.463214271999998, 2024-09-12T22:48:29.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:48:29.715 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:29.715 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:29.715 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:29.715 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:29.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:29.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:29.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:29.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:29.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:29.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:29.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:48:29.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:29.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:48:29.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:48:29.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:29.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:29.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:48:29.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:48:29.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:48:29.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:29.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:48:29.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:48:29.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:29.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:48:29.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:48:29.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:29.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:48:29.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:48:29.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:29.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:48:29.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:48:29.719 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.719 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:29.719 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.719 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:48:29.720 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:29.720 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.459229918999998, 2024-09-12T22:48:29.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:48:29.720 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:29.720 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:29.720 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:29.720 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:29.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:29.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:29.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:29.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:29.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:29.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:48:29.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:48:29.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:29.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:48:29.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:48:29.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:29.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:48:29.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:48:29.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:48:29.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:48:29.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:29.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:48:29.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:48:29.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:29.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:48:29.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:48:29.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:29.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:48:29.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:48:29.723 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.723 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:29.723 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.724 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-09-12T22:48:29.724 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177704+0000", 2024-09-12T22:48:29.724 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.458669231999998, 2024-09-12T22:48:29.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010266369999999999, 2024-09-12T22:48:29.724 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:29.724 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:29.724 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:48:29.724 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:29.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:29.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177704+0000", 2024-09-12T22:48:29.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:29.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177704+0000", 2024-09-12T22:48:29.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:29.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177704+0000", 2024-09-12T22:48:29.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7099999999999998e-07 2024-09-12T22:48:29.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:29.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177706+0000", 2024-09-12T22:48:29.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8479999999999999e-06 2024-09-12T22:48:29.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:29.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177729+0000", 2024-09-12T22:48:29.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3229000000000001e-05 2024-09-12T22:48:29.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177734+0000", 2024-09-12T22:48:29.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-06 2024-09-12T22:48:29.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:29.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178650+0000", 2024-09-12T22:48:29.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0009167 2024-09-12T22:48:29.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:29.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178731+0000", 2024-09-12T22:48:29.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0006000000000006e-05 2024-09-12T22:48:29.727 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.727 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:29.727 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.728 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:48:29.728 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:29.728 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.474077380000001, 2024-09-12T22:48:29.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:48:29.728 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:29.728 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:29.728 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:29.728 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:29.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:29.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:29.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:29.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:29.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:29.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:48:29.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:48:29.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:29.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:48:29.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:48:29.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:29.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:48:29.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:48:29.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:48:29.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:48:29.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:29.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:48:29.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:48:29.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:29.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:48:29.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:48:29.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:29.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:48:29.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:48:29.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:29.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:48:29.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:48:29.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:29.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:48:29.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:48:29.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:29.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:48:29.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:48:29.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:29.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:48:29.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:48:29.733 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.733 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:29.733 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.733 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:48:29.734 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:29.734 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.4721611350000003, 2024-09-12T22:48:29.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:48:29.734 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:29.734 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:29.734 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:29.734 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:29.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:29.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:29.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:29.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:29.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:29.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:29.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:48:29.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:48:29.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:29.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:48:29.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:48:29.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:29.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:48:29.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:48:29.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:29.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:48:29.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:48:29.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:29.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:48:29.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:48:29.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:29.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:48:29.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:48:29.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:29.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:48:29.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:48:29.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:29.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:48:29.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:48:29.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:29.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:48:29.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:48:29.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:29.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:48:29.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:48:29.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:29.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:29.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:29.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:48:29.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:48:29.739 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.739 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:29.739 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.739 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:29.739 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:29.739 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:29.741 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:29.739+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:29.741 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:29.841 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:29.841+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:29.849 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:29.849 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:48:29.849 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:48:29.849 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:29.858 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:29.943 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:29.942+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:29.981 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-12T22:48:30.001 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:30.002 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:48:30.002 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:48:30.002 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:48:30.002 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:30.010 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:30.054 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:30.053+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:30.093 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is off 2024-09-12T22:48:30.093 INFO:teuthology.orchestra.console.smithi117:Power off completed 2024-09-12T22:48:30.114 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:30.114 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:48:30.114 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:48:30.115 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:48:30.115 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.115 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:48:30.115 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:30.115 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 33.728298955, 2024-09-12T22:48:30.116 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:48:30.116 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:30.116 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:30.116 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:30.116 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:30.117 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.117 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:30.117 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:30.117 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.117 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.117 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.117 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:30.117 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:30.117 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.117 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.118 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:30.118 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:30.118 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:48:30.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.118 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:30.118 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:48:30.118 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:48:30.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.118 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:30.118 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:48:30.118 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:48:30.119 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.119 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.119 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.119 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:48:30.119 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:48:30.119 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.119 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.119 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:30.119 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:48:30.119 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:48:30.119 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.119 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.120 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:30.120 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:48:30.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:48:30.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.120 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.120 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:30.120 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:48:30.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:48:30.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.120 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.120 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:30.120 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:48:30.121 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:48:30.121 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.121 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:30.121 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.121 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.121 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.121 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:48:30.121 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:30.121 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 33.727856371999998, 2024-09-12T22:48:30.121 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:48:30.121 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:30.121 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:30.122 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:30.122 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:30.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:30.122 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:30.122 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:30.122 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:30.122 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.123 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:30.123 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:48:30.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:48:30.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.123 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:30.123 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:48:30.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:48:30.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.123 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:30.123 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:48:30.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:48:30.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:48:30.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:48:30.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:30.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:48:30.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:48:30.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.125 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:30.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:48:30.125 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:48:30.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.125 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:30.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:48:30.125 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:48:30.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.125 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:30.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:48:30.125 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:48:30.126 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.126 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:30.126 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.126 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.126 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.126 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:48:30.126 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:30.126 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 33.727490215000003, 2024-09-12T22:48:30.126 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:48:30.126 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:30.126 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:30.126 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:30.127 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:30.127 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.127 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:30.127 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:30.127 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.127 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.127 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:30.127 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:30.127 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.127 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:30.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:48:30.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:48:30.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:30.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:48:30.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:48:30.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:30.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:48:30.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:48:30.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.129 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.129 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:48:30.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:48:30.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.129 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:30.129 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:48:30.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:48:30.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:30.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:48:30.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:48:30.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:30.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:48:30.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:48:30.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:30.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:48:30.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:48:30.130 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.131 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:30.131 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.131 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.131 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.131 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:48:30.131 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:30.131 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 33.727077903000001, 2024-09-12T22:48:30.131 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:48:30.131 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:30.131 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:30.131 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:30.131 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:30.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.132 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:30.132 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:30.132 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.132 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:30.132 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:30.132 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.132 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:30.132 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:30.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:48:30.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:30.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:48:30.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:48:30.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:30.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:48:30.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:48:30.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.134 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.134 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:48:30.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:48:30.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.134 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:30.134 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:48:30.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:48:30.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.134 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:30.134 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:48:30.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:48:30.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:30.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:48:30.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:48:30.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:30.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:48:30.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:48:30.135 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.135 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:30.135 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.136 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:48:30.136 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:30.136 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 33.593227808999998, 2024-09-12T22:48:30.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:48:30.136 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:30.136 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:30.136 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:30.136 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:30.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.136 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:30.136 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:30.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:30.137 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:30.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:30.137 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:30.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:48:30.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:30.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:48:30.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:48:30.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:30.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:48:30.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:48:30.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:48:30.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:48:30.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:30.139 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:48:30.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:48:30.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:30.139 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:48:30.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:48:30.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:30.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:48:30.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:48:30.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.140 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:30.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:48:30.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:48:30.140 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.140 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:30.140 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.140 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:30.141 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:30.141 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 24.947992254999999, 2024-09-12T22:48:30.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:48:30.141 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:30.141 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:30.141 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:30.141 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:30.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:30.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:30.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:30.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:30.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:30.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:48:30.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:48:30.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:30.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:48:30.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:48:30.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:30.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:48:30.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:48:30.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:48:30.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:48:30.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:30.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:48:30.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:48:30.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:30.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:48:30.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:48:30.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:30.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:48:30.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:48:30.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:30.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:48:30.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:48:30.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:30.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:48:30.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:48:30.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:30.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:48:30.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:48:30.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:30.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:48:30.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:48:30.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:30.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:48:30.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:48:30.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:30.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:48:30.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:48:30.147 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.147 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:30.147 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.147 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:30.147 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:30.147 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 24.947892738, 2024-09-12T22:48:30.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:48:30.147 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:30.147 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:30.148 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:30.148 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:30.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:30.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:30.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:30.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:30.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:30.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:48:30.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:48:30.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:30.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:48:30.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:48:30.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:30.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:48:30.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:48:30.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:48:30.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:48:30.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:30.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:48:30.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:48:30.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:30.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:48:30.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:48:30.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:30.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:48:30.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:48:30.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:30.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:48:30.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:48:30.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.152 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:30.152 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:48:30.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:48:30.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.152 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:30.152 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:48:30.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:48:30.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.152 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:30.152 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:48:30.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:48:30.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.153 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:30.153 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:48:30.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:48:30.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.153 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:30.153 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:48:30.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:48:30.153 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.154 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:30.154 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.154 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:30.154 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:30.154 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 24.947847999, 2024-09-12T22:48:30.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:48:30.154 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:30.154 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:30.154 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:30.154 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:30.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:30.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:30.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:30.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:30.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:30.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:48:30.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:48:30.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:30.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:48:30.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:48:30.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:30.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:48:30.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:48:30.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:48:30.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:48:30.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:30.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:48:30.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:48:30.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:30.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:48:30.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:48:30.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:30.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:48:30.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:48:30.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:30.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:48:30.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:48:30.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:30.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:48:30.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:48:30.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:30.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:48:30.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:48:30.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:30.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:48:30.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:48:30.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:30.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:48:30.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:48:30.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.160 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:30.160 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:48:30.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:48:30.160 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.160 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:30.160 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.160 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:30.160 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:30.161 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 24.947620298, 2024-09-12T22:48:30.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:48:30.161 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:30.161 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:30.161 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:30.161 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:30.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:30.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:30.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:30.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:30.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:30.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:48:30.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:48:30.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:30.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:48:30.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:48:30.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.163 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:30.163 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:48:30.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:48:30.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.163 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.163 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:48:30.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:48:30.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.163 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:30.163 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:48:30.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:48:30.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:30.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:48:30.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:48:30.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:30.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:48:30.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:48:30.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:30.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:48:30.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:48:30.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:30.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:48:30.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:48:30.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:30.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:48:30.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:48:30.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:30.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:48:30.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:48:30.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.167 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:30.167 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:48:30.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:48:30.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.167 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:30.167 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:48:30.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:48:30.167 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.167 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:30.167 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.168 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:30.168 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:30.168 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 24.947455189999999, 2024-09-12T22:48:30.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:48:30.168 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:30.168 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:30.168 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:30.168 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:30.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:30.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:30.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:30.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:30.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:30.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:48:30.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:48:30.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:30.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:48:30.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:48:30.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:30.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:48:30.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:48:30.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:48:30.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:48:30.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:30.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:48:30.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:48:30.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:30.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:48:30.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:48:30.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:30.172 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:48:30.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:48:30.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:30.172 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:48:30.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:48:30.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:30.172 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:48:30.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:48:30.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.173 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:30.173 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:48:30.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:48:30.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.173 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:30.173 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:48:30.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:48:30.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.173 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:30.173 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:48:30.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:48:30.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:30.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:48:30.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:48:30.174 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.174 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:30.174 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.174 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:30.174 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:30.174 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 24.947393904999998, 2024-09-12T22:48:30.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:48:30.175 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:30.175 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:30.175 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:30.175 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:30.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:30.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:30.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:30.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:30.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:30.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:30.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:48:30.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:30.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:48:30.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:48:30.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.177 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:30.177 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:48:30.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:48:30.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.177 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.177 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.177 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:48:30.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:48:30.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.177 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.177 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:30.177 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:48:30.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:48:30.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.178 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:30.178 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:48:30.178 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:48:30.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.178 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:30.178 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:48:30.178 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:48:30.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.178 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:30.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:48:30.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:48:30.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:30.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:48:30.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:48:30.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:30.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:48:30.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:48:30.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:30.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:48:30.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:48:30.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:30.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:48:30.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:48:30.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.181 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:30.181 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:48:30.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:48:30.181 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.181 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:30.181 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.181 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:30.181 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:30.181 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 24.947313797, 2024-09-12T22:48:30.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:48:30.182 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:30.182 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:30.182 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:30.182 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:30.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.182 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:30.182 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:30.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.182 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:30.182 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:30.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.183 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:30.183 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:48:30.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:48:30.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.183 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:30.183 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:48:30.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:48:30.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.183 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:30.183 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:48:30.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:48:30.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:48:30.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:48:30.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:30.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:48:30.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:48:30.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:30.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:48:30.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:48:30.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:30.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:48:30.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:48:30.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:30.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:48:30.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:48:30.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:30.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:48:30.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:48:30.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:30.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:48:30.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:48:30.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:30.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:48:30.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:48:30.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:30.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:48:30.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:48:30.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:30.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:48:30.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:48:30.187 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.188 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:30.188 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.188 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:30.188 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:30.188 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 24.947264843999999, 2024-09-12T22:48:30.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:48:30.188 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:30.188 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:30.188 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:48:30.188 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:30.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:30.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:30.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:30.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:30.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:30.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:30.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:48:30.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:30.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:48:30.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:48:30.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:30.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:48:30.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:48:30.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:48:30.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:48:30.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:30.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:48:30.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:48:30.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:30.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:48:30.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:48:30.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:30.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:48:30.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:48:30.192 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.192 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:30.192 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.192 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:30.192 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:30.192 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 24.947215744000001, 2024-09-12T22:48:30.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:48:30.193 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:30.193 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:30.193 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:48:30.193 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:30.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.193 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:30.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:30.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.193 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:30.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:30.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.194 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.194 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:30.194 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:48:30.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:48:30.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.194 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.194 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:30.194 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:48:30.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:48:30.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:30.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:48:30.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:48:30.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:48:30.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:48:30.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:30.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:48:30.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:48:30.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:30.196 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:48:30.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:48:30.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:30.196 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:48:30.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:48:30.196 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.197 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:30.197 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.197 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:30.197 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:30.197 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 24.940275293999999, 2024-09-12T22:48:30.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:48:30.197 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:30.197 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:30.197 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:30.197 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:30.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:30.198 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:30.198 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:30.198 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:30.198 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:30.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:48:30.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:48:30.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:30.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:48:30.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:48:30.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:30.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:48:30.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:48:30.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:48:30.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:48:30.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:30.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:48:30.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:48:30.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:30.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:48:30.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:48:30.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:30.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:48:30.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:48:30.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:30.202 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:48:30.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:48:30.202 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.202 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:30.202 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.202 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:30.202 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:30.202 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 24.939186454000001, 2024-09-12T22:48:30.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:48:30.202 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:30.203 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:30.203 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:30.203 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:30.203 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.203 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:30.203 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:30.203 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.203 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.203 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.203 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:30.203 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:30.203 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.204 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.204 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:30.204 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:48:30.204 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:48:30.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.204 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.204 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:30.204 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:48:30.204 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:48:30.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:30.205 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:48:30.205 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:48:30.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.205 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:48:30.205 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:48:30.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:30.206 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:48:30.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:48:30.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.206 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:30.206 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:48:30.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:48:30.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.206 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:30.206 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:48:30.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:48:30.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.207 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.207 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:30.207 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:48:30.207 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:48:30.207 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.207 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:30.207 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.207 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.207 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:30.207 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:30.207 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 24.939136843, 2024-09-12T22:48:30.207 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:48:30.208 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:30.208 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:30.208 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:30.208 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:30.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.208 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:30.208 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:30.208 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.208 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:30.208 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:30.208 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.209 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.209 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:30.209 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:30.209 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:48:30.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.209 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.209 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:30.209 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:30.209 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:48:30.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.209 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.210 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:30.210 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:48:30.210 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:48:30.210 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.210 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.210 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.210 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:48:30.210 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:48:30.210 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.210 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.210 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:30.210 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:48:30.210 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:48:30.210 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.211 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.211 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:30.211 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:48:30.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:48:30.211 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.211 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.211 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:30.211 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:48:30.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:48:30.211 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.211 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.211 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:30.211 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:48:30.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:48:30.212 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.212 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:30.212 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.212 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.212 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:30.212 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:30.212 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 24.939069534000001, 2024-09-12T22:48:30.212 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:48:30.212 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:30.212 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:30.212 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:30.212 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:30.213 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.213 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:30.213 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:30.213 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.213 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.213 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.213 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:30.213 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:30.213 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.213 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.213 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.213 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:30.213 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:30.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:48:30.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.214 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:30.214 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:48:30.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:48:30.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.214 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:30.214 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:48:30.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:48:30.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.214 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:48:30.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:48:30.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.215 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:30.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:48:30.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:48:30.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.215 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:30.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:48:30.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:48:30.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:30.216 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:48:30.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:48:30.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:30.216 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:48:30.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:48:30.216 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.216 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:30.216 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.217 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.217 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:30.217 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:30.217 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 24.938501615, 2024-09-12T22:48:30.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:48:30.217 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:30.217 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:30.217 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:30.217 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:30.217 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.217 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:30.217 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:30.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.217 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:30.218 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:30.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:30.218 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:30.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:48:30.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:30.218 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:48:30.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:48:30.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:30.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:48:30.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:48:30.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:48:30.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:48:30.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:30.220 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:48:30.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:48:30.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.220 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:30.220 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:48:30.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:48:30.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.220 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:30.220 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:48:30.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:48:30.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.221 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:30.221 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:48:30.221 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:48:30.221 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.221 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:30.221 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.221 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:48:30.221 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:30.221 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 24.938124010999999, 2024-09-12T22:48:30.221 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:48:30.221 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:30.222 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:30.222 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:30.222 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:30.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.222 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:30.222 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:30.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.222 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:30.222 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:30.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:30.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:30.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:48:30.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:48:30.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:30.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:48:30.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:48:30.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:30.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:48:30.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:48:30.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:48:30.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:48:30.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:30.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:48:30.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:48:30.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:30.225 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:48:30.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:48:30.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.225 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.225 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:30.225 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:48:30.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:48:30.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:30.225 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:30.225 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:30.225 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:48:30.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:48:30.225 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.225 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:30.226 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.226 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:30.226 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:30.226 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:30.228 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:30.228 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:30.226+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:30.328 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:30.327+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:30.334 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:30.334 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:48:30.334 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:48:30.334 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:30.340 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:48:30.342 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:30.428 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:30.426+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:30.446 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:30.446 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:48:30.446 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:48:30.446 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:48:30.446 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:30.454 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:30.530 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:30.529+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:30.540 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:48:30.599 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:30.599 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:48:30.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:48:30.599 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:48:30.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.599 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:48:30.599 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:30.599 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.550900619, 2024-09-12T22:48:30.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:48:30.599 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:30.599 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:30.600 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:30.600 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:30.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:30.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:30.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:30.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:30.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:30.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:30.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:48:30.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:30.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:48:30.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:48:30.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:30.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:48:30.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:48:30.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:48:30.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:48:30.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:30.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:48:30.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:48:30.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:30.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:48:30.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:48:30.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:30.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:48:30.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:48:30.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:30.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:48:30.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:48:30.604 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.604 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:30.604 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.604 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:48:30.604 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:30.604 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.550519892000001, 2024-09-12T22:48:30.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:48:30.604 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:30.604 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:30.604 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:30.604 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:30.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:30.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:30.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:30.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:30.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:30.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:48:30.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:48:30.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:30.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:48:30.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:48:30.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:30.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:48:30.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:48:30.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:48:30.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:48:30.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:30.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:48:30.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:48:30.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:30.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:48:30.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:48:30.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:30.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:48:30.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:48:30.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:30.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:48:30.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:48:30.608 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.609 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:30.609 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.609 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:48:30.609 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:30.609 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.429923081999998, 2024-09-12T22:48:30.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:48:30.609 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:30.609 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:30.609 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:48:30.609 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:30.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:30.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:30.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:30.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:30.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:30.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:30.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:48:30.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:30.611 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:48:30.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:48:30.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:30.611 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:48:30.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:48:30.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:48:30.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:48:30.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:30.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:48:30.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:48:30.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:30.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:48:30.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:48:30.614 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.614 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:30.614 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.614 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:30.614 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:30.614 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.427314901999999, 2024-09-12T22:48:30.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:48:30.614 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:30.614 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:30.614 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:30.614 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:30.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:30.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:30.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:30.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:30.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:30.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:48:30.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:48:30.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:30.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:48:30.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:48:30.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:30.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:48:30.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:48:30.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:48:30.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:48:30.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:30.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:48:30.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:48:30.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:30.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:48:30.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:48:30.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:30.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:48:30.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:48:30.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:30.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:48:30.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:48:30.618 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.618 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:30.618 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.619 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:30.619 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:30.619 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.426421679000001, 2024-09-12T22:48:30.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:48:30.619 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:30.619 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:30.619 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:30.619 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:30.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.619 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:30.619 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:30.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:30.620 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:30.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:30.620 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:48:30.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:48:30.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.621 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:30.621 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:48:30.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:48:30.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.621 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:30.621 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:48:30.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:48:30.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.621 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.621 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:48:30.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:48:30.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:30.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:48:30.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:48:30.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:30.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:48:30.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:48:30.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:30.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:48:30.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:48:30.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:30.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:48:30.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:48:30.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:30.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:48:30.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:48:30.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:30.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:48:30.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:48:30.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:30.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:48:30.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:48:30.624 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.624 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:30.624 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.624 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:30.625 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:30.625 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.426350021000001, 2024-09-12T22:48:30.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:48:30.625 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:30.625 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:30.625 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:30.625 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:30.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:30.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:30.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:30.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:30.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:30.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:48:30.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:48:30.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:30.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:48:30.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:48:30.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:30.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:48:30.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:48:30.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:48:30.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:48:30.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:30.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:48:30.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:48:30.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:30.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:48:30.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:48:30.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:30.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:48:30.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:48:30.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:30.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:48:30.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:48:30.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:30.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:48:30.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:48:30.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:30.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:48:30.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:48:30.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:30.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:48:30.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:48:30.630 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.630 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:30.630 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.631 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:30.631 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:30.631 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.426307303000002, 2024-09-12T22:48:30.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:48:30.631 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:30.631 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:30.631 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:30.631 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:30.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:30.632 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:30.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.632 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.632 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.632 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:30.632 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:30.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.632 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.632 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.632 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:30.632 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:48:30.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:48:30.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:30.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:48:30.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:48:30.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:30.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:48:30.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:48:30.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:48:30.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:48:30.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:30.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:48:30.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:48:30.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:30.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:48:30.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:48:30.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:30.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:48:30.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:48:30.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:30.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:48:30.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:48:30.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:30.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:48:30.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:48:30.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:30.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:48:30.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:48:30.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:30.637 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:48:30.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:48:30.637 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.637 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:30.637 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.637 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:30.637 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:30.637 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.426269386000001, 2024-09-12T22:48:30.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:48:30.637 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:30.637 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:30.638 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:30.638 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:30.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:30.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:30.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:30.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:30.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:30.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:48:30.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:48:30.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:30.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:48:30.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:48:30.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:30.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:48:30.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:48:30.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:48:30.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:48:30.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:30.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:48:30.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:48:30.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:30.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:48:30.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:48:30.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:30.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:30.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:48:30.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:30.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:48:30.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:48:30.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:30.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:48:30.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:48:30.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:30.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:48:30.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:48:30.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:30.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:48:30.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:48:30.643 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.643 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:30.643 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.644 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:30.644 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:30.644 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.426245935000001, 2024-09-12T22:48:30.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:48:30.644 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:30.644 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:30.644 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:30.644 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:30.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:30.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:30.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:30.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:30.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:30.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:48:30.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:48:30.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:30.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:48:30.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:48:30.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:30.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:48:30.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:48:30.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:48:30.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:48:30.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:30.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:48:30.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:48:30.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:30.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:48:30.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:48:30.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:30.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:30.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:48:30.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:30.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:48:30.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:48:30.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:30.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:48:30.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:48:30.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:30.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:48:30.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:48:30.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:30.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:48:30.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:48:30.649 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.650 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:30.650 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.650 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:30.650 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:30.650 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.426221697999999, 2024-09-12T22:48:30.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:48:30.650 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:30.650 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:30.650 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:30.650 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:30.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:30.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:30.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:30.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:30.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:30.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:30.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:48:30.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:30.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:48:30.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:48:30.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:30.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:48:30.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:48:30.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:48:30.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:48:30.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:30.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:48:30.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:48:30.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:30.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:48:30.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:48:30.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:30.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:48:30.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:48:30.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:30.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:48:30.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:48:30.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:30.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:48:30.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:48:30.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:30.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:48:30.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:48:30.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:30.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:48:30.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:48:30.655 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.655 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:30.656 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.656 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:30.656 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:30.656 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.426193780999998, 2024-09-12T22:48:30.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:48:30.656 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:30.656 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:30.656 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:30.656 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:30.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:30.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:30.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:30.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:30.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:30.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:30.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:48:30.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:30.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:48:30.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:48:30.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:30.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:48:30.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:48:30.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:48:30.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:48:30.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:30.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:48:30.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:48:30.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:30.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:48:30.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:48:30.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:30.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:48:30.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:48:30.660 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.660 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:30.660 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.660 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:30.660 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:30.661 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.426119285999999, 2024-09-12T22:48:30.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:48:30.661 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:30.661 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:30.661 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:30.661 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:30.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:30.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:30.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:30.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:30.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:30.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:48:30.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:48:30.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:30.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:48:30.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:48:30.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:30.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:48:30.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:48:30.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:48:30.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:48:30.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:30.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:48:30.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:48:30.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:30.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:48:30.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:48:30.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:30.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:48:30.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:48:30.664 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.664 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:30.664 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.665 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:30.665 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:30.665 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.426073257999999, 2024-09-12T22:48:30.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:48:30.665 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:30.665 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:30.665 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:30.665 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:30.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:30.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:30.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:30.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:30.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:30.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:48:30.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:48:30.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:30.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:48:30.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:48:30.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:30.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:48:30.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:48:30.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:48:30.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:48:30.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:30.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:48:30.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:48:30.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:30.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:48:30.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:48:30.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:30.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:48:30.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:48:30.669 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.669 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:30.669 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.669 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:30.669 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:30.669 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.423902374000001, 2024-09-12T22:48:30.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:48:30.669 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:30.669 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:30.670 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:30.670 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:30.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:30.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:30.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:30.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:30.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:30.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:30.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:48:30.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:30.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:48:30.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:48:30.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:30.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:48:30.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:48:30.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:30.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:48:30.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:30.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:48:30.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:48:30.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:30.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:30.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:48:30.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:30.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:48:30.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:48:30.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:30.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:48:30.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:48:30.673 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.673 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:30.674 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.674 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:30.674 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:30.674 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.423851924000001, 2024-09-12T22:48:30.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:48:30.674 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:30.674 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:30.674 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:30.674 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:30.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:30.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:30.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:30.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:30.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:30.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:48:30.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:48:30.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:30.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:48:30.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:48:30.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:30.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:48:30.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:48:30.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:48:30.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:48:30.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:30.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:48:30.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:48:30.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:30.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:48:30.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:48:30.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:30.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:48:30.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:48:30.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:30.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:48:30.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:48:30.678 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.678 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:30.678 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.678 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:30.678 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:30.679 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.423798485999999, 2024-09-12T22:48:30.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:48:30.679 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:30.679 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:30.679 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:30.679 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:30.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:30.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:30.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:30.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:30.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:30.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:30.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:48:30.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:30.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:48:30.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:48:30.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:30.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:30.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:48:30.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:48:30.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:48:30.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:30.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:48:30.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:48:30.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:30.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:48:30.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:48:30.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:30.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:48:30.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:48:30.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:30.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:48:30.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:48:30.683 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.683 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:30.683 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.683 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:48:30.683 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:30.683 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.419814132999999, 2024-09-12T22:48:30.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:48:30.683 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:30.683 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:30.684 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:30.684 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:30.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:30.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:30.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:30.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:30.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:30.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:48:30.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:48:30.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:30.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:48:30.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:48:30.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:30.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:48:30.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:48:30.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:48:30.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:48:30.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:30.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:48:30.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:48:30.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:30.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:48:30.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:48:30.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:30.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:48:30.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:48:30.687 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.687 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:30.687 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.687 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:48:30.687 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:30.687 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 23.434661594000001, 2024-09-12T22:48:30.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:48:30.688 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:30.688 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:30.688 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:30.688 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:30.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:30.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:30.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:30.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:30.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:30.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:48:30.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:48:30.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:30.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:48:30.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:48:30.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:30.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:48:30.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:48:30.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:48:30.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:48:30.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:30.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:48:30.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:48:30.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:30.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:48:30.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:48:30.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:30.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:48:30.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:48:30.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:30.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:48:30.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:48:30.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:30.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:48:30.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:48:30.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:30.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:48:30.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:48:30.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:30.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:48:30.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:48:30.693 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.693 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:30.693 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.693 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:48:30.693 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:30.693 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.4327453490000002, 2024-09-12T22:48:30.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:48:30.694 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:30.694 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:30.694 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:30.694 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:30.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:30.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:30.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:30.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:30.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:30.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:48:30.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:48:30.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:30.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:48:30.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:48:30.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:30.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:48:30.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:48:30.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:48:30.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:48:30.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:30.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:48:30.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:48:30.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:30.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:48:30.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:48:30.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:30.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:48:30.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:48:30.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:30.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:48:30.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:48:30.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:30.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:48:30.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:48:30.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:30.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:48:30.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:48:30.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:30.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:48:30.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:48:30.699 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.699 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:30.699 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.699 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:48:30.699 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:30.699 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.431991974, 2024-09-12T22:48:30.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012160610000000001, 2024-09-12T22:48:30.699 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:30.699 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:30.700 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:30.700 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:30.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:30.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:30.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:30.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:30.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:30.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:30.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164967+0000", 2024-09-12T22:48:30.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:48:30.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:30.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164974+0000", 2024-09-12T22:48:30.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:48:30.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:30.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164987+0000", 2024-09-12T22:48:30.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3689000000000001e-05 2024-09-12T22:48:30.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:30.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164995+0000", 2024-09-12T22:48:30.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2959999999999999e-06 2024-09-12T22:48:30.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:30.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165068+0000", 2024-09-12T22:48:30.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2449999999999999e-05 2024-09-12T22:48:30.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:30.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165212+0000", 2024-09-12T22:48:30.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144117 2024-09-12T22:48:30.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:30.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166066+0000", 2024-09-12T22:48:30.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085441100000000002 2024-09-12T22:48:30.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:30.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166107+0000", 2024-09-12T22:48:30.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0450000000000001e-05 2024-09-12T22:48:30.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:30.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:30.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:30.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166181+0000", 2024-09-12T22:48:30.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-12T22:48:30.704 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.704 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:30.704 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.704 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:30.704 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:30.704 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:30.705 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:48:30.706 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:48:30.706 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:48:30.707 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:30.704+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:30.707 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:30.708 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:48:30.708 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:48:30.708 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:48:30.708 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:48:30.807 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:30.806+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:30.815 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:30.815 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:30.825 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:30.908 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:30.907+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:30.967 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:30.968 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:30.976 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:31.020 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:31.019+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:31.078 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:31.078 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:31.086 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:31.130 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:31.129+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:31.190 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:31.190 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:31.199 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:31.210 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:31.209+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:31.311 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:31.310+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:31.340 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:31.341 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:31.349 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:31.375 INFO:teuthology.orchestra.run.smithi066.stderr:nodeep-scrub is unset 2024-09-12T22:48:31.412 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:31.412+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:31.491 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:31.491 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:31.500 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:31.544 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:31.543+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:31.605 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:31.605 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:31.613 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:31.612+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:31.615 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:31.686 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-12T22:48:31.714 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:31.713+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:31.758 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:31.758 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:31.767 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:31.814 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:31.813+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:31.869 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:31.869 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:31.877 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:31.922 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:31.921+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:31.984 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:31.984 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:31.992 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:32.016 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:32.015+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:32.117 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:32.116+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:32.134 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:32.134 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:32.142 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:32.227 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:32.226+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:32.286 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:32.286 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:32.296 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:32.339 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:32.338+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:32.401 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:32.402 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:32.410 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:32.451 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:32.450+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:32.522 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:32.521+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:32.553 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:32.553 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:32.562 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:32.623 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:32.622+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:32.704 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:32.705 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:32.709 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:48:32.713 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:32.723 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:32.722+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:32.819 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:32.819 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:32.824 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:32.823+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:32.827 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:32.848 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:48:32.875 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:48:32.876 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:48:32.877 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:48:32.878 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:48:32.878 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:48:32.879 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:48:32.928 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:32.927+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:32.985 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:32.985 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:48:32.986 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:48:32.986 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:48:32.986 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:32.991 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:33.044 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:33.042+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:33.132 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:33.131+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:33.148 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:33.148 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:48:33.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:48:33.148 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:48:33.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.148 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:48:33.149 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:33.149 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.100556318999999, 2024-09-12T22:48:33.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:48:33.149 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:33.149 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:33.149 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:33.149 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:33.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:33.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:33.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:33.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:33.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:33.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:33.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:48:33.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:33.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:48:33.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:48:33.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:33.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:48:33.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:48:33.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:48:33.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:48:33.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:33.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:48:33.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:48:33.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:33.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:48:33.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:48:33.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:33.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:48:33.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:48:33.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:33.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:48:33.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:48:33.154 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.154 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:33.154 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.154 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:48:33.154 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:33.154 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 31.100175591999999, 2024-09-12T22:48:33.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:48:33.154 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:33.154 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:33.154 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:33.154 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:33.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:33.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:33.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:33.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:33.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:33.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:48:33.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:48:33.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:33.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:48:33.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:48:33.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:33.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:48:33.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:48:33.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:48:33.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:48:33.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:33.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:48:33.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:48:33.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:33.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:48:33.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:48:33.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:33.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:48:33.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:48:33.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:33.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:48:33.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:48:33.158 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.158 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:33.158 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.159 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:48:33.159 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:33.159 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 27.979578782000001, 2024-09-12T22:48:33.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:48:33.159 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:33.159 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:33.159 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:48:33.159 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:33.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:33.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:33.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:33.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:33.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:33.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:33.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:48:33.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:33.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:48:33.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:48:33.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.161 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:33.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:48:33.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:48:33.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.161 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:48:33.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:48:33.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.161 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:33.162 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:48:33.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:48:33.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.162 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:33.162 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:48:33.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:48:33.162 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.162 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:33.162 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.162 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:33.162 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:33.163 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 27.976970602000002, 2024-09-12T22:48:33.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:48:33.163 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:33.163 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:33.163 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:33.163 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:33.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:33.163 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:33.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:33.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:33.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:33.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:48:33.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:48:33.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:33.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:48:33.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:48:33.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:33.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:48:33.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:48:33.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:48:33.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:48:33.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:33.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:48:33.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:48:33.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:33.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:48:33.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:48:33.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:33.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:48:33.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:48:33.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:33.167 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:48:33.167 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:48:33.167 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.167 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:33.167 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.167 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:33.167 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:33.167 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 27.976077378999999, 2024-09-12T22:48:33.167 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:48:33.167 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:33.167 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:33.167 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:33.168 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:33.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.168 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:33.168 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:33.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.168 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:33.168 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:33.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.168 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:33.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:48:33.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:48:33.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:33.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:48:33.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:48:33.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:33.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:48:33.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:48:33.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.170 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:48:33.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:48:33.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:33.170 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:48:33.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:48:33.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:33.170 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:48:33.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:48:33.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:33.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:48:33.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:48:33.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:33.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:48:33.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:48:33.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:33.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:48:33.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:48:33.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:33.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:48:33.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:48:33.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:33.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:48:33.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:48:33.172 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.172 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:33.173 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.173 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:33.173 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:33.173 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 27.976005721, 2024-09-12T22:48:33.173 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:48:33.173 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:33.173 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:33.173 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:33.173 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:33.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.173 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:33.174 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:33.174 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.174 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:33.174 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:33.174 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.174 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:33.174 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:48:33.174 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:48:33.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:33.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:48:33.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:48:33.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:33.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:48:33.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:48:33.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:48:33.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:48:33.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:33.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:48:33.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:48:33.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:33.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:48:33.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:48:33.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:33.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:48:33.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:48:33.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:33.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:48:33.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:48:33.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:33.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:48:33.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:48:33.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.178 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:33.178 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:48:33.179 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:48:33.179 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.179 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.179 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:33.179 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:48:33.179 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:48:33.180 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.180 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:33.180 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.180 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.180 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:33.180 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:33.180 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 27.975963003, 2024-09-12T22:48:33.180 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:48:33.180 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:33.180 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:33.180 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:33.180 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:33.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.181 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:33.181 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:33.181 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.181 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:33.181 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:33.181 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.181 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:33.181 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:48:33.181 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:48:33.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:33.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:48:33.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:48:33.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:33.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:48:33.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:48:33.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:48:33.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:48:33.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.183 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:33.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:48:33.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:48:33.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.183 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:33.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:48:33.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:48:33.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.183 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:33.184 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:48:33.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:48:33.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.184 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:33.184 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:48:33.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:48:33.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.184 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:33.184 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:48:33.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:48:33.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.185 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:33.185 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:48:33.185 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:48:33.185 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.185 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.185 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:33.185 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:48:33.185 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:48:33.185 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.185 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:33.185 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.185 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.185 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.186 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:33.186 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:33.186 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 27.975925086, 2024-09-12T22:48:33.186 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:48:33.186 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:33.186 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:33.186 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:33.186 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:33.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.186 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:33.186 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:33.186 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:33.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:33.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:33.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:48:33.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:48:33.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:33.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:48:33.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:48:33.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.188 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:33.188 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:48:33.188 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:48:33.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.188 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.188 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:48:33.188 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:48:33.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.188 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:33.188 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:48:33.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:48:33.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:33.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:48:33.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:48:33.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:33.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:33.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:48:33.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:33.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:48:33.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:48:33.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:33.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:48:33.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:48:33.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:33.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:48:33.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:48:33.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.191 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:33.191 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:48:33.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:48:33.191 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.191 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:33.191 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.191 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:33.191 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:33.191 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 27.975901635, 2024-09-12T22:48:33.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:48:33.191 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:33.191 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:33.192 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:33.192 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:33.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:33.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:33.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:33.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:33.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:33.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:48:33.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:48:33.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:33.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:48:33.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:48:33.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:33.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:48:33.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:48:33.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:48:33.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:48:33.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:33.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:48:33.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:48:33.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:33.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:48:33.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:48:33.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:33.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:33.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:48:33.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:33.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:48:33.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:48:33.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:33.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:48:33.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:48:33.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:33.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:48:33.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:48:33.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:33.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:48:33.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:48:33.196 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.196 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:33.196 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.197 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:33.197 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:33.197 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 27.975877398000002, 2024-09-12T22:48:33.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:48:33.197 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:33.197 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:33.197 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:33.197 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:33.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:33.197 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:33.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:33.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:33.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:33.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:33.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:48:33.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:33.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:48:33.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:48:33.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:33.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:48:33.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:48:33.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:48:33.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:48:33.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:33.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:48:33.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:48:33.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:33.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:48:33.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:48:33.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:33.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:48:33.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:48:33.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:33.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:48:33.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:48:33.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:33.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:48:33.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:48:33.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:33.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:48:33.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:48:33.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:33.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:48:33.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:48:33.202 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.202 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:33.202 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.202 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:33.202 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:33.202 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 27.975849481000001, 2024-09-12T22:48:33.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:48:33.203 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:33.203 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:33.203 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:33.203 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:33.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.203 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:33.203 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:33.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.203 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:33.203 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:33.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:33.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:33.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:48:33.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:33.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:48:33.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:48:33.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:33.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:48:33.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:48:33.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:48:33.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:48:33.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:33.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:48:33.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:48:33.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:33.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:48:33.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:48:33.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:33.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:48:33.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:48:33.206 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.206 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:33.206 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.206 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:33.206 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:33.207 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 27.975774986000001, 2024-09-12T22:48:33.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:48:33.207 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:33.207 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:33.207 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:33.207 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:33.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:33.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:33.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:33.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:33.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:33.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:48:33.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:48:33.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:33.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:48:33.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:48:33.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.209 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:33.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:48:33.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:48:33.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.209 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:48:33.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:48:33.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.209 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:33.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:48:33.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:48:33.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:33.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:48:33.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:48:33.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:33.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:48:33.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:48:33.210 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.210 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:33.210 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.211 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:33.211 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:33.211 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 27.975728958000001, 2024-09-12T22:48:33.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:48:33.211 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:33.211 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:33.211 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:33.211 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:33.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:33.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:33.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:33.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:33.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:33.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:48:33.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:48:33.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:33.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:48:33.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:48:33.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:33.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:48:33.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:48:33.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:48:33.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:48:33.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:33.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:48:33.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:48:33.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:33.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:48:33.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:48:33.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:33.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:48:33.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:48:33.214 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.214 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:33.214 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.215 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:33.215 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:33.215 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 27.973558074, 2024-09-12T22:48:33.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:48:33.215 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:33.215 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:33.215 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:33.215 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:33.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.215 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:33.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:33.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:33.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:33.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:33.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:33.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:48:33.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:33.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:48:33.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:48:33.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:33.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:48:33.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:48:33.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:33.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:48:33.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:33.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:48:33.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:48:33.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:33.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:33.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:48:33.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:33.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:48:33.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:48:33.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:33.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:48:33.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:48:33.219 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.219 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:33.219 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.219 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:33.219 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:33.219 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 27.973507624, 2024-09-12T22:48:33.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:48:33.219 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:33.220 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:33.220 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:33.220 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:33.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:33.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:33.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:33.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:33.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.221 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:33.221 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:48:33.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:48:33.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.221 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:33.221 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:48:33.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:48:33.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.221 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:33.221 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:48:33.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:48:33.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:48:33.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:48:33.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:33.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:48:33.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:48:33.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:33.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:48:33.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:48:33.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:33.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:48:33.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:48:33.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:33.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:48:33.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:48:33.223 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.223 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:33.223 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.224 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:33.224 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:33.224 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 27.973454186000001, 2024-09-12T22:48:33.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:48:33.224 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:33.224 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:33.224 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:33.224 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:33.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:33.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:33.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:33.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:33.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:33.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:33.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:48:33.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:33.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:48:33.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:48:33.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:33.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:33.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:48:33.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:48:33.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:48:33.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:33.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:48:33.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:48:33.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.227 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:33.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:48:33.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:48:33.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.227 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:33.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:48:33.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:48:33.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:33.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:48:33.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:48:33.228 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.228 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:33.228 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.228 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:48:33.228 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:33.228 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 27.969469833000002, 2024-09-12T22:48:33.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:48:33.228 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:33.229 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:33.229 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:33.229 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:33.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:33.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:33.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:33.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:33.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:33.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:48:33.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:48:33.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:33.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:48:33.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:48:33.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:33.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:48:33.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:48:33.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:48:33.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:48:33.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:33.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:48:33.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:48:33.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:33.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:48:33.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:48:33.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:33.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:48:33.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:48:33.232 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.232 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:33.232 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.232 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:48:33.232 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:33.232 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.984317294, 2024-09-12T22:48:33.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:48:33.233 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:33.233 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:33.233 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:33.233 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:33.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.233 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:33.233 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:33.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.233 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:33.233 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:33.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:33.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:48:33.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:48:33.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:33.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:48:33.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:48:33.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:33.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:48:33.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:48:33.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:48:33.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:48:33.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:33.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:48:33.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:48:33.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:33.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:48:33.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:48:33.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:33.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:48:33.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:48:33.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:33.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:48:33.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:48:33.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:33.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:48:33.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:48:33.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:33.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:48:33.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:48:33.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:33.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:48:33.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:48:33.238 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.238 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:33.238 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.238 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:48:33.238 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:33.238 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 7.9824010489999999, 2024-09-12T22:48:33.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:48:33.238 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:33.238 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:33.238 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:33.238 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:33.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:33.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:33.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:33.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:33.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:33.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:48:33.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:48:33.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:33.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:48:33.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:48:33.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:33.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:48:33.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:48:33.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:48:33.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:48:33.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:33.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:48:33.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:48:33.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:33.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:48:33.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:48:33.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:33.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:48:33.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:48:33.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:33.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:48:33.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:48:33.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:33.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:48:33.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:48:33.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:33.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:48:33.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:48:33.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:33.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:48:33.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:48:33.243 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.243 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:33.243 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.244 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:48:33.244 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:33.244 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 2.981647674, 2024-09-12T22:48:33.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012160610000000001, 2024-09-12T22:48:33.244 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:33.244 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:33.244 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:33.244 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:33.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:33.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:33.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:33.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:33.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:33.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:33.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164967+0000", 2024-09-12T22:48:33.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:48:33.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:33.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164974+0000", 2024-09-12T22:48:33.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:48:33.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:33.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164987+0000", 2024-09-12T22:48:33.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3689000000000001e-05 2024-09-12T22:48:33.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164995+0000", 2024-09-12T22:48:33.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2959999999999999e-06 2024-09-12T22:48:33.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:33.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165068+0000", 2024-09-12T22:48:33.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2449999999999999e-05 2024-09-12T22:48:33.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:33.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165212+0000", 2024-09-12T22:48:33.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144117 2024-09-12T22:48:33.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:33.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166066+0000", 2024-09-12T22:48:33.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085441100000000002 2024-09-12T22:48:33.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:33.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166107+0000", 2024-09-12T22:48:33.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0450000000000001e-05 2024-09-12T22:48:33.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:33.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:33.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:33.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166181+0000", 2024-09-12T22:48:33.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-12T22:48:33.248 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.248 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:33.248 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.248 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:33.248 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:33.248 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:33.249 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:33.254 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:33.254+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:33.351 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:33.350+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:33.363 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:33.363 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:48:33.363 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:48:33.363 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:33.373 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:33.394 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:48:33.453 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:33.451+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:33.476 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:33.476 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:48:33.476 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:48:33.476 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:48:33.476 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:33.484 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:33.553 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:33.552+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:33.630 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:33.630 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:48:33.631 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:48:33.631 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:48:33.631 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.631 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:48:33.631 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:33.631 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 37.244621993000003, 2024-09-12T22:48:33.631 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:48:33.631 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:33.631 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:33.631 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:33.631 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:33.631 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.632 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:33.632 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:33.632 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.632 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.632 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.632 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:33.632 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:33.632 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.632 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.632 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.632 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:33.632 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:33.632 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:48:33.633 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.633 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.633 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:33.633 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:48:33.633 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:48:33.633 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.633 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.633 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:33.633 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:48:33.633 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:48:33.633 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.633 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.633 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.633 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:48:33.634 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:48:33.634 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.634 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.634 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:33.634 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:48:33.634 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:48:33.634 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.634 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.634 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:33.634 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:48:33.634 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:48:33.634 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.634 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.635 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:33.635 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:48:33.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:48:33.635 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.635 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:33.635 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:48:33.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:48:33.635 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.635 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:33.635 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.635 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.635 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:48:33.636 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:33.636 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 37.244179410000001, 2024-09-12T22:48:33.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:48:33.636 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:33.636 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:33.636 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:33.636 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:33.636 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.636 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:33.636 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:33.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.637 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:33.637 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:33.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.637 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:33.637 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:48:33.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:48:33.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.637 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:33.637 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:48:33.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:48:33.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:33.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:48:33.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:48:33.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:48:33.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:48:33.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.639 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:33.639 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:48:33.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:48:33.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.639 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:33.639 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:48:33.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:48:33.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:33.640 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:48:33.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:48:33.640 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:33.640 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:48:33.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:48:33.640 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.640 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:33.641 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.641 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.641 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:48:33.641 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:33.641 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 37.243813252999999, 2024-09-12T22:48:33.641 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:48:33.641 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:33.641 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:33.642 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:33.642 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:33.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:33.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:33.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:33.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:33.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:33.643 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:48:33.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:48:33.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.643 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:33.643 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:48:33.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:48:33.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.643 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:33.643 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:48:33.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:48:33.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.644 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.644 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:48:33.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:48:33.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.644 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:33.644 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:48:33.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:48:33.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.644 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:33.644 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:48:33.645 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:48:33.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.645 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.645 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:33.645 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:48:33.645 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:48:33.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.645 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.645 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:33.645 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:48:33.645 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:48:33.645 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.645 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:33.646 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.646 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.646 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.646 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:48:33.646 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:33.646 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 37.243400940999997, 2024-09-12T22:48:33.646 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:48:33.646 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:33.646 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:33.646 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:33.646 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:33.646 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.646 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:33.647 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:33.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.647 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.647 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.647 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:33.647 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:33.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.647 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.647 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.647 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:33.647 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:33.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:48:33.647 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.648 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.648 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:33.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:48:33.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:48:33.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.648 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.648 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:33.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:48:33.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:48:33.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.648 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.648 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:48:33.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:48:33.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:33.649 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:48:33.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:48:33.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:33.649 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:48:33.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:48:33.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:33.650 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:48:33.650 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:48:33.650 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.650 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.650 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:33.650 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:48:33.650 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:48:33.650 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.650 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:33.650 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.650 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.650 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.650 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:48:33.651 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:33.651 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 37.109550847000001, 2024-09-12T22:48:33.651 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:48:33.651 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:33.651 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:33.651 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:33.651 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:33.651 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.651 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:33.651 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:33.651 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.651 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.651 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.651 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:33.652 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:33.652 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.652 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.652 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.652 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:33.652 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:33.652 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:48:33.652 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.652 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.652 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:33.652 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:48:33.652 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:48:33.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.653 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:33.653 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:48:33.653 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:48:33.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.653 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.653 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:48:33.653 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:48:33.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.653 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:33.653 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:48:33.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:48:33.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.654 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:33.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:48:33.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:48:33.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.654 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:33.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:48:33.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:48:33.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.655 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:33.655 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:48:33.655 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:48:33.655 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.655 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:33.655 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.655 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.655 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.655 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:33.655 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:33.655 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 28.464315292999999, 2024-09-12T22:48:33.655 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:48:33.655 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:33.656 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:33.656 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:33.656 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:33.656 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.656 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:33.656 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:33.656 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.656 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.656 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.656 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:33.656 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:33.656 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.656 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.656 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.657 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:33.657 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:48:33.657 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:48:33.657 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.657 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.657 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:33.657 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:48:33.657 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:48:33.657 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.657 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.657 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:33.657 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:48:33.657 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:48:33.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.658 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.658 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.658 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:48:33.658 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:48:33.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.658 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.658 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:33.658 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:48:33.658 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:48:33.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.658 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.658 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:33.658 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:48:33.659 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:48:33.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.659 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:33.659 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:48:33.659 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:48:33.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.659 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:33.659 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:48:33.659 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:48:33.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.659 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:33.660 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:48:33.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:48:33.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.661 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:33.661 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:48:33.661 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:48:33.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.661 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:33.661 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:48:33.661 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:48:33.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.661 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:33.662 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:48:33.662 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:48:33.662 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.662 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.662 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:33.662 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:48:33.662 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:48:33.662 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.662 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:33.662 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.662 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.662 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.662 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:33.663 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:33.663 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 28.464215776, 2024-09-12T22:48:33.663 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:48:33.663 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:33.663 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:33.663 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:33.663 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:33.663 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.663 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:33.663 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:33.663 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.663 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.664 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.664 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:33.664 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:33.664 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.664 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.664 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.664 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:33.664 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:48:33.664 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:48:33.664 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.664 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.664 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:33.664 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:48:33.665 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:48:33.665 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.665 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.665 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:33.665 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:48:33.665 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:48:33.665 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.665 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.665 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.665 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:48:33.665 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:48:33.665 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.665 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.666 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:33.666 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:48:33.666 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:48:33.666 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.666 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.666 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:33.666 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:48:33.666 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:48:33.666 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.666 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.666 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:33.666 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:48:33.666 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:48:33.667 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.667 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.667 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:33.667 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:48:33.667 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:48:33.667 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.667 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.667 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:33.667 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:48:33.667 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:48:33.667 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:33.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:48:33.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:48:33.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:33.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:48:33.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:48:33.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:33.669 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:48:33.669 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:48:33.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.669 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.669 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:33.669 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:48:33.669 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:48:33.669 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.669 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:33.669 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.669 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.669 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:33.670 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:33.670 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 28.464171037, 2024-09-12T22:48:33.670 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:48:33.670 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:33.670 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:33.670 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:33.670 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:33.671 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.671 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:33.671 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:33.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.671 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.671 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:33.671 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:33.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.672 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:33.672 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:48:33.672 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:48:33.672 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.672 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:33.672 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:48:33.672 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:48:33.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.673 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:33.673 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:48:33.673 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:48:33.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.673 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.673 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:48:33.673 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:48:33.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.673 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:33.674 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:48:33.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:48:33.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.674 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:33.674 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:48:33.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:48:33.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.674 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:33.674 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:48:33.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:48:33.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:33.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:48:33.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:48:33.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:33.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:48:33.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:48:33.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:33.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:48:33.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:48:33.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:33.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:48:33.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:48:33.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:33.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:48:33.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:48:33.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.677 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:33.677 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:48:33.677 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:48:33.677 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.677 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:33.677 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.677 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:33.677 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:33.677 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 28.463943336, 2024-09-12T22:48:33.678 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:48:33.678 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:33.678 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:33.678 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:33.678 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:33.678 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.678 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:33.678 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:33.678 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.678 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.678 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:33.678 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:33.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:33.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:48:33.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:48:33.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:33.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:48:33.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:48:33.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:33.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:48:33.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:48:33.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:48:33.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:48:33.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:33.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:48:33.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:48:33.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:33.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:48:33.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:48:33.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:33.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:48:33.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:48:33.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:33.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:48:33.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:48:33.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:33.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:48:33.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:48:33.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:33.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:48:33.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:48:33.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:33.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:48:33.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:48:33.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:33.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:48:33.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:48:33.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:33.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:48:33.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:48:33.684 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.684 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:33.684 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.684 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:33.684 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:33.684 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 28.463778227999999, 2024-09-12T22:48:33.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:48:33.684 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:33.684 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:33.685 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:33.685 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:33.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:33.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:33.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:33.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:33.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.686 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:33.686 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:48:33.686 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:48:33.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.686 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:33.686 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:48:33.686 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:48:33.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.686 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:33.686 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:48:33.686 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:48:33.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.687 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:48:33.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:48:33.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.687 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:33.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:48:33.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:48:33.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.687 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:33.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:48:33.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:48:33.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:33.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:48:33.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:48:33.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:33.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:48:33.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:48:33.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:33.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:48:33.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:48:33.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:33.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:48:33.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:48:33.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:33.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:48:33.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:48:33.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.690 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:33.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:48:33.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:48:33.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.690 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:33.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:48:33.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:48:33.690 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.690 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:33.690 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.691 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:33.691 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:33.691 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 28.463716943000001, 2024-09-12T22:48:33.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:48:33.691 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:33.691 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:33.691 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:33.691 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:33.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.691 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:33.691 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:33.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:33.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:33.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:33.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:33.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:48:33.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:33.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:48:33.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:48:33.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:33.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:48:33.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:48:33.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:48:33.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:48:33.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:33.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:48:33.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:48:33.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:33.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:48:33.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:48:33.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:33.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:48:33.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:48:33.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.695 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:33.695 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:48:33.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:48:33.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.695 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:33.695 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:48:33.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:48:33.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.696 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:33.696 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:48:33.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:48:33.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.696 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:33.696 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:48:33.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:48:33.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.696 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:33.696 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:48:33.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:48:33.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.697 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:33.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:48:33.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:48:33.697 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.697 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:33.697 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.697 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:33.697 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:33.697 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 28.463636834999999, 2024-09-12T22:48:33.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:48:33.698 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:33.698 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:33.698 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:33.698 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:33.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.698 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:33.698 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:33.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.698 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:33.698 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:33.699 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.699 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:33.699 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:48:33.699 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:48:33.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.699 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:33.699 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:48:33.699 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:48:33.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.700 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:33.700 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:48:33.700 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:48:33.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.700 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.700 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.700 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:48:33.700 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:48:33.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.700 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.700 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:33.700 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:48:33.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:48:33.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:33.701 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:48:33.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:48:33.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:33.701 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:48:33.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:48:33.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.702 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:33.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:48:33.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:48:33.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.702 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:33.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:48:33.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:48:33.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.702 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:33.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:48:33.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:48:33.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:33.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:48:33.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:48:33.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:33.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:48:33.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:48:33.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:33.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:48:33.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:48:33.704 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.704 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:33.704 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.704 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.704 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:33.704 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:33.704 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 28.463587881999999, 2024-09-12T22:48:33.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:48:33.704 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:33.704 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:33.704 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:48:33.705 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:33.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.705 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:33.705 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:33.705 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.705 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.705 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:33.705 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:33.705 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.705 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.705 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:33.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:33.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:48:33.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:33.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:48:33.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:48:33.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:33.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:48:33.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:48:33.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:48:33.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:48:33.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:33.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:48:33.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:48:33.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:33.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:48:33.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:48:33.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.708 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:33.708 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:48:33.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:48:33.708 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.708 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:33.708 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.708 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:33.708 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:33.709 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 28.463538782000001, 2024-09-12T22:48:33.709 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:48:33.709 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:33.709 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:33.709 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:48:33.709 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:33.709 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.709 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:33.709 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:33.709 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:33.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:33.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:33.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:48:33.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:48:33.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:33.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:48:33.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:48:33.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:33.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:48:33.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:48:33.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:48:33.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:48:33.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:33.712 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:48:33.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:48:33.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:33.712 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:48:33.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:48:33.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:33.712 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:48:33.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:48:33.713 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.713 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:33.713 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.713 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:33.713 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:33.713 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 28.456598331999999, 2024-09-12T22:48:33.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:48:33.714 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:33.714 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:33.714 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:33.714 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:33.714 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.714 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:33.714 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:33.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.714 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.714 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.714 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:33.714 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:33.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.715 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.715 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:33.715 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:48:33.715 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:48:33.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.715 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.715 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:33.715 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:48:33.715 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:48:33.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.715 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:33.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:48:33.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:48:33.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:48:33.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:48:33.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:33.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:48:33.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:48:33.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:33.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:48:33.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:48:33.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:33.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:48:33.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:48:33.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:33.718 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:48:33.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:48:33.718 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.718 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:33.718 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.718 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:33.718 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:33.718 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 28.455509492000001, 2024-09-12T22:48:33.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:48:33.718 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:33.718 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:33.719 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:33.719 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:33.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:33.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:33.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:33.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:33.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.720 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:33.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:48:33.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:48:33.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.720 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:33.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:48:33.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:48:33.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:33.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:48:33.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:48:33.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:48:33.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:48:33.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:33.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:48:33.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:48:33.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:33.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:48:33.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:48:33.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.723 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:33.723 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:48:33.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:48:33.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.723 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:33.723 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:48:33.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:48:33.723 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.723 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:33.723 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.724 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:33.724 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:33.724 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 28.455459880999999, 2024-09-12T22:48:33.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:48:33.724 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:33.724 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:33.724 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:33.724 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:33.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.724 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:33.724 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:33.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:33.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:33.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:33.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:33.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:48:33.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.726 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:33.726 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:33.726 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:48:33.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.726 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:33.726 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:48:33.726 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:48:33.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.726 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.726 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:48:33.726 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:48:33.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:33.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:48:33.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:48:33.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:33.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:48:33.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:48:33.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:33.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:48:33.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:48:33.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:33.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:48:33.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:48:33.728 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.728 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:33.728 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.728 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:33.729 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:33.729 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 28.455392572000001, 2024-09-12T22:48:33.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:48:33.729 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:33.729 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:33.729 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:33.729 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:33.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:33.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:33.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:33.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:33.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:33.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:33.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:48:33.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:33.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:48:33.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:48:33.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:33.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:48:33.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:48:33.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:48:33.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:48:33.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:33.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:48:33.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:48:33.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.732 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:33.732 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:48:33.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:48:33.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.732 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:33.732 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:48:33.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:48:33.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:33.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:48:33.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:48:33.733 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.733 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:33.733 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.733 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:33.733 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:33.733 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 28.454824652999999, 2024-09-12T22:48:33.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:48:33.733 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:33.734 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:33.734 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:33.734 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:33.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:33.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:33.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:33.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:33.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:33.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:33.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:48:33.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:33.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:48:33.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:48:33.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:33.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:48:33.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:48:33.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:48:33.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:48:33.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:33.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:48:33.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:48:33.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:33.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:48:33.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:48:33.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:33.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:48:33.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:48:33.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:33.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:48:33.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:48:33.737 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.738 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:33.738 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.738 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.738 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:48:33.738 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:33.738 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 28.454447048999999, 2024-09-12T22:48:33.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:48:33.738 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:33.739 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:33.739 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:33.739 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:33.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.739 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:33.739 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:33.739 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.739 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:33.739 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:33.739 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:33.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:33.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:48:33.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:48:33.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:33.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:48:33.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:48:33.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:33.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:48:33.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:48:33.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:33.742 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:48:33.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:48:33.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.742 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:33.742 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:48:33.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:48:33.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.742 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:33.742 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:48:33.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:48:33.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.743 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:33.743 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:48:33.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:48:33.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:33.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:33.743 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:33.743 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:48:33.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:48:33.743 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.743 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:33.743 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.743 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:33.743 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:33.744 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:33.745 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:33.746 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:33.744+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:33.846 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:33.845+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:33.853 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:33.853 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:48:33.853 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:48:33.853 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:33.862 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:33.947 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:33.946+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:34.005 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:34.006 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:48:34.006 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:48:34.006 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:48:34.006 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:34.014 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:34.048 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:34.047+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:34.149 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:34.148+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:34.159 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:34.159 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:48:34.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:48:34.159 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:48:34.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.160 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:48:34.160 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:34.160 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.111690895000002, 2024-09-12T22:48:34.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:48:34.160 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:34.160 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:34.160 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:34.160 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:34.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:34.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:34.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.161 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:34.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:34.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.161 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:34.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:34.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:48:34.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.162 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:34.162 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:48:34.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:48:34.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.162 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:34.162 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:48:34.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:48:34.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.163 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:48:34.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:48:34.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:34.163 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:48:34.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:48:34.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:34.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:48:34.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:48:34.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:34.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:48:34.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:48:34.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:34.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:48:34.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:48:34.164 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.165 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:34.165 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.165 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:48:34.165 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:34.165 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 32.111310168000003, 2024-09-12T22:48:34.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:48:34.165 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:34.165 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:34.165 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:34.165 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:34.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:34.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:34.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:34.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:34.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:34.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:48:34.167 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:48:34.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.167 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:34.167 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:48:34.167 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:48:34.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.167 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:34.167 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:48:34.167 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:48:34.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.168 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.168 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:48:34.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:48:34.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.168 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:34.168 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:48:34.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:48:34.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.168 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:34.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:48:34.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:48:34.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:34.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:48:34.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:48:34.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:34.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:48:34.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:48:34.169 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.170 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:34.170 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.170 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:48:34.170 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:34.170 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.990713358000001, 2024-09-12T22:48:34.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:48:34.170 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:34.170 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:34.170 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:48:34.170 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:34.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:34.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:34.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:34.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:34.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:34.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:34.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:48:34.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:34.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:48:34.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:48:34.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:34.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:48:34.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:48:34.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.173 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.173 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:48:34.173 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:48:34.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.173 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:34.173 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:48:34.173 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:48:34.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.173 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:34.173 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:48:34.173 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:48:34.174 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.174 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:34.174 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.174 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:34.174 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:34.174 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.988105178000001, 2024-09-12T22:48:34.174 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:48:34.174 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:34.174 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:34.174 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:34.174 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:34.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:34.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:34.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:34.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:34.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:34.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:48:34.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:48:34.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:34.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:48:34.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:48:34.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:34.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:48:34.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:48:34.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:48:34.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:48:34.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:34.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:48:34.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:48:34.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:34.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:48:34.178 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:48:34.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.178 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:34.178 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:48:34.178 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:48:34.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.178 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:34.178 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:48:34.178 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:48:34.178 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.178 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:34.179 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.179 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.179 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.179 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:34.179 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:34.179 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.987211954999999, 2024-09-12T22:48:34.179 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:48:34.179 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:34.179 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:34.179 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:34.179 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:34.179 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.179 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:34.180 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:34.180 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.180 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.180 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:34.180 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:34.180 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.180 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.180 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:34.180 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:48:34.180 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:48:34.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.181 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:34.181 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:48:34.181 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:48:34.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.181 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:34.181 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:48:34.181 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:48:34.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.181 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.181 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:48:34.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:48:34.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:34.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:48:34.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:48:34.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:34.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:48:34.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:48:34.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.183 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:34.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:48:34.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:48:34.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.183 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:34.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:48:34.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:48:34.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.183 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:34.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:48:34.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:48:34.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.184 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:34.184 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:48:34.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:48:34.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.184 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:34.184 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:48:34.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:48:34.184 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.184 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:34.185 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.185 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.185 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.185 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:34.185 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:34.185 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.987140297, 2024-09-12T22:48:34.185 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:48:34.185 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:34.185 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:34.185 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:34.185 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:34.185 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.185 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:34.186 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:34.186 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.186 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:34.186 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:34.186 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.186 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:34.186 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:48:34.186 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:48:34.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:34.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:48:34.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:48:34.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:34.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:48:34.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:48:34.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:48:34.188 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:48:34.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.188 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:34.188 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:48:34.188 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:48:34.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.188 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:34.188 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:48:34.188 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:48:34.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:34.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:48:34.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:48:34.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:34.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:48:34.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:48:34.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:34.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:48:34.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:48:34.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:34.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:48:34.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:48:34.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:34.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:48:34.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:48:34.190 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.190 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:34.190 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.191 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:34.191 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:34.191 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.987097579, 2024-09-12T22:48:34.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:48:34.191 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:34.191 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:34.191 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:34.191 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:34.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.191 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:34.191 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:34.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:34.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:34.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:34.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:48:34.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:48:34.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:34.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:48:34.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:48:34.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:34.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:48:34.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:48:34.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:48:34.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:48:34.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:34.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:48:34.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:48:34.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:34.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:48:34.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:48:34.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:34.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:48:34.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:48:34.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:34.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:48:34.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:48:34.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:34.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:48:34.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:48:34.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:34.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:48:34.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:48:34.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:34.197 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:48:34.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:48:34.197 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.197 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:34.197 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.197 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:34.197 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:34.197 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.987059662, 2024-09-12T22:48:34.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:48:34.197 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:34.198 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:34.198 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:34.198 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:34.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:34.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:34.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:34.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:34.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:34.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:48:34.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:48:34.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:34.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:48:34.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:48:34.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:34.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:48:34.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:48:34.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:48:34.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:48:34.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:34.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:48:34.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:48:34.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:34.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:48:34.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:48:34.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:34.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:34.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:48:34.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:34.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:48:34.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:48:34.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:34.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:48:34.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:48:34.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:34.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:48:34.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:48:34.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:34.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:48:34.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:48:34.203 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.203 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:34.203 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.203 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:34.203 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:34.203 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.987036210999999, 2024-09-12T22:48:34.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:48:34.203 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:34.203 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:34.203 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:34.204 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:34.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:34.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:34.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:34.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:34.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:34.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:48:34.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:48:34.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:34.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:48:34.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:48:34.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:34.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:48:34.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:48:34.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:48:34.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:48:34.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:34.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:48:34.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:48:34.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:34.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:48:34.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:48:34.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:34.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:34.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:48:34.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:34.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:48:34.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:48:34.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:34.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:48:34.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:48:34.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:34.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:48:34.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:48:34.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:34.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:48:34.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:48:34.209 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.209 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:34.209 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.209 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:34.209 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:34.209 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.987011974000001, 2024-09-12T22:48:34.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:48:34.209 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:34.209 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:34.209 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:34.209 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:34.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:34.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:34.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:34.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:34.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:34.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:34.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:48:34.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:34.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:48:34.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:48:34.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:34.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:48:34.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:48:34.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:48:34.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:48:34.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:34.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:48:34.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:48:34.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:34.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:48:34.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:48:34.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:34.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:48:34.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:48:34.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:34.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:48:34.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:48:34.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:34.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:48:34.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:48:34.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:34.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:48:34.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:48:34.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:34.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:48:34.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:48:34.214 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.215 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:34.215 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.215 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:34.215 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:34.215 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.986984057000001, 2024-09-12T22:48:34.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:48:34.215 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:34.215 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:34.215 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:34.215 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:34.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:34.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:34.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:34.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:34.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:34.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:34.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:48:34.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:34.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:48:34.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:48:34.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:34.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:48:34.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:48:34.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:48:34.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:48:34.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:34.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:48:34.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:48:34.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:34.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:48:34.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:48:34.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:34.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:48:34.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:48:34.219 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.219 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:34.219 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.219 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:34.219 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:34.219 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.986909562000001, 2024-09-12T22:48:34.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:48:34.219 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:34.220 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:34.220 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:34.220 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:34.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:34.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:34.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:34.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:34.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.221 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:34.221 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:48:34.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:48:34.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.221 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:34.221 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:48:34.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:48:34.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.221 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:34.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:48:34.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:48:34.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:48:34.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:48:34.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:34.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:48:34.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:48:34.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:34.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:48:34.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:48:34.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:34.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:48:34.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:48:34.223 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.223 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:34.224 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.224 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:34.224 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:34.224 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.986863534000001, 2024-09-12T22:48:34.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:48:34.224 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:34.224 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:34.224 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:34.224 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:34.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:34.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:34.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:34.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:34.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:34.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:48:34.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:48:34.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:34.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:48:34.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:48:34.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:34.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:48:34.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:48:34.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:48:34.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:48:34.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.227 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:34.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:48:34.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:48:34.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.227 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:34.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:48:34.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:48:34.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:34.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:48:34.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:48:34.228 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.228 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:34.228 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.228 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:34.228 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:34.228 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.98469265, 2024-09-12T22:48:34.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:48:34.229 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:34.229 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:34.229 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:34.229 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:34.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:34.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:34.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:34.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:34.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:34.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:34.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:48:34.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:34.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:48:34.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:48:34.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:34.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:48:34.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:48:34.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:34.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:48:34.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:34.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:48:34.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:48:34.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:34.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:34.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:48:34.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:34.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:48:34.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:48:34.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:34.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:48:34.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:48:34.233 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.233 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:34.233 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.233 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:34.233 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:34.233 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.9846422, 2024-09-12T22:48:34.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:48:34.233 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:34.233 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:34.233 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:34.233 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:34.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:34.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:34.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:34.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:34.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:34.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:48:34.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:48:34.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:34.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:48:34.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:48:34.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:34.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:48:34.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:48:34.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:48:34.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:48:34.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:34.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:48:34.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:48:34.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:34.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:48:34.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:48:34.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:34.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:48:34.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:48:34.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:34.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:48:34.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:48:34.237 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.237 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:34.237 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.238 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:34.238 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:34.238 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.984588762000001, 2024-09-12T22:48:34.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:48:34.238 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:34.238 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:34.238 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:34.238 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:34.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:34.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:34.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:34.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:34.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:34.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:34.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:48:34.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:34.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:48:34.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:48:34.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:34.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:34.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:48:34.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:48:34.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:48:34.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:34.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:48:34.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:48:34.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:34.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:48:34.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:48:34.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:34.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:48:34.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:48:34.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:34.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:48:34.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:48:34.242 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.242 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:34.242 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.243 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:48:34.243 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:34.243 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.980604409000001, 2024-09-12T22:48:34.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:48:34.243 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:34.243 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:34.243 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:34.243 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:34.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:34.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:34.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:34.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:34.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:34.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:48:34.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:48:34.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:34.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:48:34.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:48:34.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:34.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:48:34.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:48:34.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:48:34.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:48:34.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:34.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:48:34.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:48:34.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:34.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:48:34.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:48:34.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:34.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:48:34.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:48:34.247 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.247 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:34.247 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.247 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:48:34.247 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:34.247 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.99545187, 2024-09-12T22:48:34.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:48:34.247 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:34.248 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:34.248 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:34.248 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:34.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:34.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:34.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:34.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:34.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:34.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:48:34.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:48:34.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:34.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:48:34.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:48:34.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:34.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:48:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:48:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:48:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:48:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:48:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:48:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:34.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:48:34.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:48:34.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:34.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:48:34.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:48:34.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:34.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:48:34.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:48:34.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:34.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:48:34.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:48:34.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:34.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:48:34.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:48:34.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:34.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:48:34.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:48:34.253 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.253 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:34.253 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.253 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:48:34.253 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:34.254 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.9935356249999998, 2024-09-12T22:48:34.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:48:34.254 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:34.254 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:34.254 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:34.254 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:34.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:34.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:34.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:34.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:34.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:34.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:48:34.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:48:34.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:34.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:48:34.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:48:34.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:34.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:48:34.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:48:34.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:48:34.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:48:34.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:34.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:48:34.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:48:34.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:34.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:48:34.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:48:34.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:34.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:48:34.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:48:34.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:34.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:48:34.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:48:34.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:34.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:48:34.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:48:34.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:34.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:48:34.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:48:34.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:34.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:48:34.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:48:34.260 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.260 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:34.260 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.260 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:48:34.261 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:34.261 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.9927822499999999, 2024-09-12T22:48:34.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012160610000000001, 2024-09-12T22:48:34.261 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:34.261 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:34.261 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:34.261 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:34.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:34.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:34.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:34.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:34.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:34.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:34.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164967+0000", 2024-09-12T22:48:34.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:48:34.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:34.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164974+0000", 2024-09-12T22:48:34.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:48:34.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:34.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164987+0000", 2024-09-12T22:48:34.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3689000000000001e-05 2024-09-12T22:48:34.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164995+0000", 2024-09-12T22:48:34.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2959999999999999e-06 2024-09-12T22:48:34.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:34.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165068+0000", 2024-09-12T22:48:34.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2449999999999999e-05 2024-09-12T22:48:34.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:34.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165212+0000", 2024-09-12T22:48:34.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144117 2024-09-12T22:48:34.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:34.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166066+0000", 2024-09-12T22:48:34.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085441100000000002 2024-09-12T22:48:34.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:34.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166107+0000", 2024-09-12T22:48:34.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0450000000000001e-05 2024-09-12T22:48:34.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:34.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:34.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:34.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166181+0000", 2024-09-12T22:48:34.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-12T22:48:34.265 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.265 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:34.265 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.265 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:34.266 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:34.266 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:34.267 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:34.268 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:34.266+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:34.368 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:34.367+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:34.376 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:34.376 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:48:34.376 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:48:34.376 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:34.384 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:34.396 INFO:teuthology.orchestra.run.smithi066.stderr:noscrub is set 2024-09-12T22:48:34.469 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:34.468+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:34.489 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:34.489 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:48:34.489 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:48:34.489 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:48:34.489 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:34.499 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:34.570 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:34.569+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:34.604 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:34.604 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:48:34.604 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:48:34.604 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:48:34.604 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.604 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:48:34.604 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:34.604 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 38.218276412000002, 2024-09-12T22:48:34.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:48:34.605 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:34.605 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:34.605 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:34.605 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:34.605 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.605 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:34.605 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:34.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.605 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.605 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.605 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:34.605 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:34.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.606 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.606 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:34.606 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:34.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:48:34.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.607 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.608 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:34.608 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:48:34.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:48:34.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.608 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:34.608 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:48:34.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:48:34.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.608 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.608 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:48:34.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:48:34.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:34.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:48:34.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:48:34.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:34.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:48:34.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:48:34.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.610 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.610 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:34.610 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:48:34.610 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:48:34.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.610 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.610 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:34.610 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:48:34.610 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:48:34.610 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.610 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:34.610 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.611 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.611 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:48:34.611 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:34.611 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 38.217833829, 2024-09-12T22:48:34.611 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:48:34.611 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:34.611 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:34.611 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:34.611 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:34.612 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.612 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:34.612 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:34.612 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.612 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.612 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:34.612 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:34.612 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.612 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.612 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:34.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:48:34.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:48:34.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:34.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:48:34.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:48:34.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:34.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:48:34.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:48:34.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.614 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.614 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.614 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:48:34.614 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:48:34.614 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.614 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.614 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:34.614 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:48:34.614 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:48:34.614 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.614 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.614 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:34.615 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:48:34.615 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:48:34.615 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.615 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.615 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:34.615 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:48:34.615 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:48:34.615 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.615 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.615 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:34.615 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:48:34.615 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:48:34.615 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.616 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:34.616 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.616 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:48:34.616 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:34.616 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 38.217467671999998, 2024-09-12T22:48:34.616 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:48:34.616 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:34.616 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:34.616 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:34.616 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:34.617 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.617 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:34.617 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:34.617 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.617 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.617 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.617 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:34.617 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:34.617 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.617 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.617 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.617 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:34.617 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:48:34.618 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:48:34.618 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.618 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.618 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:34.618 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:48:34.618 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:48:34.618 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.618 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.618 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:34.618 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:48:34.618 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:48:34.618 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.618 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.618 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.619 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:48:34.619 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:48:34.619 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.619 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.619 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:34.619 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:48:34.619 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:48:34.619 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.619 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.619 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:34.619 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:48:34.619 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:48:34.619 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.620 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.620 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:34.620 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:48:34.620 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:48:34.620 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.620 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.620 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:34.620 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:48:34.620 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:48:34.620 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.620 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:34.620 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.620 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.621 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.621 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:48:34.621 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:34.621 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 38.217055360000003, 2024-09-12T22:48:34.621 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:48:34.621 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:34.621 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:34.621 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:34.621 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:34.621 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.621 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:34.621 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:34.621 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.622 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.622 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.622 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:34.622 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:34.622 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.622 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.622 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.622 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:34.622 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:34.622 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:48:34.622 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.622 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.622 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:34.623 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:48:34.623 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:48:34.623 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.623 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.623 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:34.623 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:48:34.623 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:48:34.623 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.623 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.623 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.623 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:48:34.623 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:48:34.623 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.624 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.624 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:34.624 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:48:34.624 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:48:34.624 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.624 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.624 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:34.624 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:48:34.624 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:48:34.624 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.624 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.624 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:34.624 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:48:34.625 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:48:34.625 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.625 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.625 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:34.625 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:48:34.625 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:48:34.625 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.625 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:34.625 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.625 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.625 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.625 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:48:34.625 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:34.626 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 38.083205266, 2024-09-12T22:48:34.626 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:48:34.626 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:34.626 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:34.626 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:34.626 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:34.626 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.626 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:34.626 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:34.626 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.626 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.626 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.626 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:34.627 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:34.627 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.627 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.627 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.627 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:34.627 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:34.627 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:48:34.627 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.627 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.627 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:34.627 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:48:34.627 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:48:34.627 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.627 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.628 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:34.628 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:48:34.628 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:48:34.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.628 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.628 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.628 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:48:34.628 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:48:34.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.628 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.628 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:34.628 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:48:34.628 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:48:34.629 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.629 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.629 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:34.629 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:48:34.629 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:48:34.629 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.629 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.629 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:34.629 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:48:34.629 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:48:34.629 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.629 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.629 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:34.630 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:48:34.630 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:48:34.630 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.630 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:34.630 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.630 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.630 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.630 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:34.630 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:34.630 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 29.437969712000001, 2024-09-12T22:48:34.630 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:48:34.630 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:34.630 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:34.630 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:34.631 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:34.631 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.631 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:34.631 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:34.631 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.631 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.631 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.631 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:34.631 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:34.631 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.631 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.631 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.631 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:34.632 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:48:34.632 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:48:34.632 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.632 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.632 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:34.632 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:48:34.632 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:48:34.632 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.632 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.632 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:34.632 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:48:34.632 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:48:34.632 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.633 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.633 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.633 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:48:34.633 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:48:34.633 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.633 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.633 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:34.633 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:48:34.633 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:48:34.633 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.633 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.633 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:34.633 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:48:34.633 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:48:34.634 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.634 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.634 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:34.634 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:48:34.634 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:48:34.634 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.634 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.634 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:34.634 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:48:34.634 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:48:34.634 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.634 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.634 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:34.634 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:48:34.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:48:34.635 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.635 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:34.635 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:48:34.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:48:34.635 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.635 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:34.635 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:48:34.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:48:34.635 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.635 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:34.636 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:48:34.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:48:34.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.636 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.636 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:34.636 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:48:34.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:48:34.636 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.636 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:34.636 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.636 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.637 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:34.637 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:34.637 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 29.437870194999999, 2024-09-12T22:48:34.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:48:34.637 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:34.637 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:34.637 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:34.637 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:34.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.637 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:34.637 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:34.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:34.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:34.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:34.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:48:34.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:48:34.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:34.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:48:34.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:48:34.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.639 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:34.639 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:48:34.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:48:34.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.639 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.639 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:48:34.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:48:34.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:34.640 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:48:34.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:48:34.640 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:34.640 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:48:34.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:48:34.640 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:34.640 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:48:34.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:48:34.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.641 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.641 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:34.641 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:48:34.641 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:48:34.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.641 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.641 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:34.641 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:48:34.641 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:48:34.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.641 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.641 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:34.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:48:34.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:48:34.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:34.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:48:34.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:48:34.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:34.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:48:34.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:48:34.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.643 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:34.643 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:48:34.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:48:34.643 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.644 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:34.644 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.644 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:34.644 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:34.644 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 29.437825455999999, 2024-09-12T22:48:34.645 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:48:34.645 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:34.645 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:34.645 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:34.645 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:34.645 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.645 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:34.645 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:34.645 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.646 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.646 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:34.646 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:34.646 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.646 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.646 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.646 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:34.646 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:48:34.646 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:48:34.646 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.646 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.646 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:34.646 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:48:34.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:48:34.647 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.647 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.647 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:34.647 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:48:34.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:48:34.647 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.647 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.647 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.647 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:48:34.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:48:34.647 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.647 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.648 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:34.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:48:34.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:48:34.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.648 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.648 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:34.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:48:34.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:48:34.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.648 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.648 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:34.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:48:34.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:48:34.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:34.649 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:48:34.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:48:34.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:34.649 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:48:34.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:48:34.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:34.650 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:48:34.650 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:48:34.650 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.650 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.650 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:34.650 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:48:34.650 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:48:34.650 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.650 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.650 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:34.650 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:48:34.650 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:48:34.650 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.650 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.651 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:34.651 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:48:34.651 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:48:34.651 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.651 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:34.651 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.651 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.651 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.651 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:34.651 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:34.651 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 29.437597754999999, 2024-09-12T22:48:34.651 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:48:34.652 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:34.652 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:34.652 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:34.652 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:34.652 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.652 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:34.652 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:34.652 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.652 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.652 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.652 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:34.652 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:34.652 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.653 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:34.653 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:48:34.653 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:48:34.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.653 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:34.653 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:48:34.653 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:48:34.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.653 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:34.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:48:34.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:48:34.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.654 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:48:34.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:48:34.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.654 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:34.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:48:34.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:48:34.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.655 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.655 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:34.655 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:48:34.655 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:48:34.655 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.655 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.655 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:34.655 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:48:34.655 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:48:34.655 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.655 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.655 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:34.655 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:48:34.656 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:48:34.656 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.656 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.656 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:34.656 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:48:34.656 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:48:34.656 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.656 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.656 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:34.656 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:48:34.656 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:48:34.656 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.657 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.657 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:34.657 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:48:34.657 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:48:34.657 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.657 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.657 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:34.657 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:48:34.657 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:48:34.657 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.657 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.657 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:34.658 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:48:34.658 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:48:34.658 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.658 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:34.658 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.658 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.658 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:34.658 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:34.658 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 29.437432647000001, 2024-09-12T22:48:34.658 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:48:34.658 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:34.658 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:34.659 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:34.659 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:34.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.659 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:34.659 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:34.659 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.659 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:34.659 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:34.659 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.659 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:34.660 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:48:34.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:48:34.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.660 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.660 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:34.660 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:48:34.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:48:34.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.660 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.660 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:34.660 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:48:34.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:48:34.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.661 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.661 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:48:34.661 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:48:34.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.661 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:34.661 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:48:34.661 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:48:34.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.661 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:34.661 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:48:34.662 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:48:34.662 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.662 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.662 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:34.662 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:48:34.662 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:48:34.662 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.662 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.662 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:34.662 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:48:34.662 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:48:34.662 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.662 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.662 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:34.663 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:48:34.663 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:48:34.663 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.663 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.663 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:34.663 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:48:34.663 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:48:34.663 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.663 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.663 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:34.663 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:48:34.663 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:48:34.663 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.663 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.664 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:34.664 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:48:34.664 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:48:34.664 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.664 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.664 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:34.664 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:48:34.664 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:48:34.664 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.664 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:34.664 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.664 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.664 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.665 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:34.665 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:34.665 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 29.437371362, 2024-09-12T22:48:34.665 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:48:34.665 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:34.665 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:34.665 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:34.665 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:34.665 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.665 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:34.665 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:34.665 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.665 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.665 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.666 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:34.666 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:34.666 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.666 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.666 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.666 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:34.666 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:34.666 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:48:34.666 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.666 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.666 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:34.666 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:48:34.666 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:48:34.667 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.667 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.667 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:34.667 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:48:34.667 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:48:34.667 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.667 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.667 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.667 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:48:34.667 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:48:34.667 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.667 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.667 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:34.667 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:48:34.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:48:34.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:34.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:48:34.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:48:34.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:34.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:48:34.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:48:34.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.669 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:34.669 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:48:34.669 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:48:34.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.669 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.669 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:34.669 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:48:34.669 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:48:34.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.669 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.669 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:34.669 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:48:34.669 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:48:34.670 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.670 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.670 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:34.670 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:48:34.670 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:48:34.670 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.670 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.670 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:34.670 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:48:34.670 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:48:34.670 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.670 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.670 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:34.670 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:48:34.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:48:34.671 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.671 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:34.671 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.671 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.671 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:34.671 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:34.671 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 29.437291254000002, 2024-09-12T22:48:34.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:48:34.671 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:34.671 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:34.671 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:34.672 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:34.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.672 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:34.672 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:34.672 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.672 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.672 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:34.672 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:34.672 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.672 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.672 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:34.673 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:48:34.673 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:48:34.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.673 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:34.673 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:48:34.673 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:48:34.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.673 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:34.673 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:48:34.673 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:48:34.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.674 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.674 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:48:34.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:48:34.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.674 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:34.674 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:48:34.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:48:34.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.674 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:34.674 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:48:34.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:48:34.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:34.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:48:34.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:48:34.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:34.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:48:34.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:48:34.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:34.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:48:34.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:48:34.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:34.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:48:34.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:48:34.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:34.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:48:34.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:48:34.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.677 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:34.677 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:48:34.677 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:48:34.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.677 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:34.677 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:48:34.677 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:48:34.677 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.677 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:34.677 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.677 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:34.678 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:34.678 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 29.437242301000001, 2024-09-12T22:48:34.678 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:48:34.678 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:34.678 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:34.678 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:48:34.678 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:34.678 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.678 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:34.678 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:34.678 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.678 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.678 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:34.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:34.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:34.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:34.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:48:34.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:34.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:48:34.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:48:34.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:34.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:48:34.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:48:34.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:48:34.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:48:34.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:34.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:48:34.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:48:34.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:34.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:48:34.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:48:34.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:34.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:48:34.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:48:34.681 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.682 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:34.682 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.682 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:34.682 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:34.682 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 29.437193200999999, 2024-09-12T22:48:34.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:48:34.682 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:34.682 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:34.682 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:48:34.682 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:34.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:34.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:34.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:34.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:34.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:34.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:48:34.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:48:34.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:34.684 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:48:34.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:48:34.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:34.684 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:48:34.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:48:34.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:48:34.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:48:34.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:34.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:48:34.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:48:34.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:34.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:48:34.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:48:34.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.686 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:34.686 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:48:34.686 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:48:34.686 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.686 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:34.686 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.686 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:34.686 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:34.686 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 29.430252751000001, 2024-09-12T22:48:34.686 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:48:34.687 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:34.687 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:34.687 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:34.687 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:34.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.687 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:34.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:34.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.687 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:34.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:34.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:34.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:48:34.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:48:34.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:34.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:48:34.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:48:34.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:34.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:48:34.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:48:34.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:48:34.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:48:34.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:34.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:48:34.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:48:34.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.690 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:34.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:48:34.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:48:34.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.690 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:34.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:48:34.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:48:34.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.690 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:34.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:48:34.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:48:34.691 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.691 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:34.691 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.691 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:34.691 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:34.691 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 29.429163911, 2024-09-12T22:48:34.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:48:34.691 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:34.691 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:34.691 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:34.691 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:34.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:34.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:34.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:34.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:34.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:34.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:48:34.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:48:34.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:34.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:48:34.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:48:34.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:34.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:48:34.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:48:34.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:48:34.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:48:34.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:34.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:48:34.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:48:34.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:34.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:48:34.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:48:34.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:34.695 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:48:34.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:48:34.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.695 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:34.695 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:48:34.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:48:34.695 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.695 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:34.695 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.696 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:34.696 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:34.696 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 29.429114299999998, 2024-09-12T22:48:34.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:48:34.696 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:34.696 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:34.696 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:34.696 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:34.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.696 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:34.696 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:34.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.697 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:34.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:34.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.697 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:34.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:34.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:48:34.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.697 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:34.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:34.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:48:34.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.698 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:34.698 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:48:34.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:48:34.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.698 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.698 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:48:34.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:48:34.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.699 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:34.699 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:48:34.699 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:48:34.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.699 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:34.699 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:48:34.699 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:48:34.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.699 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:34.699 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:48:34.699 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:48:34.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.700 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.700 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:34.700 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:48:34.700 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:48:34.700 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.700 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:34.700 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.700 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.700 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:34.700 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:34.700 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 29.429046991, 2024-09-12T22:48:34.700 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:48:34.701 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:34.701 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:34.701 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:34.701 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:34.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:34.701 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:34.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:34.701 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:34.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.702 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:34.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:34.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:48:34.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.702 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:34.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:48:34.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:48:34.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.702 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:34.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:48:34.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:48:34.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:48:34.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:48:34.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:34.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:48:34.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:48:34.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.704 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:34.704 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:48:34.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:48:34.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.704 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.704 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:34.704 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:48:34.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:48:34.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.704 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.704 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:34.704 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:48:34.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:48:34.705 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.705 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:34.705 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.705 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.705 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:34.705 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:34.705 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 29.428479072000002, 2024-09-12T22:48:34.705 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:48:34.705 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:34.705 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:34.705 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:34.705 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:34.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:34.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:34.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:34.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:34.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:34.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:34.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:48:34.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:34.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:48:34.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:48:34.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:34.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:48:34.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:48:34.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:48:34.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:48:34.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.708 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:34.708 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:48:34.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:48:34.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.708 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:34.708 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:48:34.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:48:34.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.709 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:34.709 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:48:34.709 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:48:34.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.709 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.709 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:34.709 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:48:34.709 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:48:34.709 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.709 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:34.709 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.709 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.710 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:48:34.710 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:34.710 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 29.428101468000001, 2024-09-12T22:48:34.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:48:34.710 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:34.710 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:34.710 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:34.710 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:34.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:34.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:34.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:34.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:34.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:34.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:34.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:48:34.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:48:34.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:34.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:48:34.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:48:34.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:34.712 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:48:34.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:48:34.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:34.712 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:48:34.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:48:34.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:34.712 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:48:34.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:48:34.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.713 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:34.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:48:34.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:48:34.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.713 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:34.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:48:34.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:48:34.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:34.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:34.713 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:34.714 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:48:34.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:48:34.714 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.714 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:34.714 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.714 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:34.714 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:34.714 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:34.716 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:34.716 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:34.714+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:34.816 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:34.815+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:34.831 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:34.832 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:48:34.832 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:48:34.832 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:34.841 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:34.880 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:48:34.925 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:34.924+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:34.985 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:34.986 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:48:34.986 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:48:34.986 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:48:34.986 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:34.994 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:35.017 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:35.016+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:35.019 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:48:35.019 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:48:35.037 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:48:35.038 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:48:35.038 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:48:35.041 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:48:35.041 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:48:35.119 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:35.118+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:35.136 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:35.137 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:35.146 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:35.220 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:35.219+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:35.227 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-09-12T22:48:35.227 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T22:48:35.227 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-12T22:48:35.227 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T22:48:35.256 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:35.257 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:35.265 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:35.321 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:35.320+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:35.408 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:35.408 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:35.417 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:35.422 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:35.421+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:35.520 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:35.521 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:35.521 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:48:35.521 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T22:48:35.521 INFO:teuthology.orchestra.run.smithi066.stdout: "epoch": 27, 2024-09-12T22:48:35.522 INFO:teuthology.orchestra.run.smithi066.stdout: "fsid": "5714c6a5-034c-4330-a57b-d22492ad8e43", 2024-09-12T22:48:35.522 INFO:teuthology.orchestra.run.smithi066.stdout: "created": "2024-09-12T22:47:43.881551+0000", 2024-09-12T22:48:35.522 INFO:teuthology.orchestra.run.smithi066.stdout: "modified": "2024-09-12T22:48:34.388571+0000", 2024-09-12T22:48:35.522 INFO:teuthology.orchestra.run.smithi066.stdout: "last_up_change": "2024-09-12T22:48:26.303379+0000", 2024-09-12T22:48:35.522 INFO:teuthology.orchestra.run.smithi066.stdout: "last_in_change": "2024-09-12T22:47:44.690260+0000", 2024-09-12T22:48:35.522 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T22:48:35.522 INFO:teuthology.orchestra.run.smithi066.stdout: "flags_num": 5801984, 2024-09-12T22:48:35.522 INFO:teuthology.orchestra.run.smithi066.stdout: "flags_set": [ 2024-09-12T22:48:35.522 INFO:teuthology.orchestra.run.smithi066.stdout: "noscrub", 2024-09-12T22:48:35.522 INFO:teuthology.orchestra.run.smithi066.stdout: "pglog_hardlimit", 2024-09-12T22:48:35.522 INFO:teuthology.orchestra.run.smithi066.stdout: "purged_snapdirs", 2024-09-12T22:48:35.523 INFO:teuthology.orchestra.run.smithi066.stdout: "recovery_deletes", 2024-09-12T22:48:35.523 INFO:teuthology.orchestra.run.smithi066.stdout: "sortbitwise" 2024-09-12T22:48:35.523 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-12T22:48:35.523 INFO:teuthology.orchestra.run.smithi066.stdout: "crush_version": 4, 2024-09-12T22:48:35.523 INFO:teuthology.orchestra.run.smithi066.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T22:48:35.523 INFO:teuthology.orchestra.run.smithi066.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T22:48:35.523 INFO:teuthology.orchestra.run.smithi066.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T22:48:35.523 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_snapshot": "", 2024-09-12T22:48:35.523 INFO:teuthology.orchestra.run.smithi066.stdout: "pool_max": 4, 2024-09-12T22:48:35.523 INFO:teuthology.orchestra.run.smithi066.stdout: "max_osd": 3, 2024-09-12T22:48:35.523 INFO:teuthology.orchestra.run.smithi066.stdout: "require_min_compat_client": "luminous", 2024-09-12T22:48:35.523 INFO:teuthology.orchestra.run.smithi066.stdout: "min_compat_client": "jewel", 2024-09-12T22:48:35.524 INFO:teuthology.orchestra.run.smithi066.stdout: "require_osd_release": "squid", 2024-09-12T22:48:35.524 INFO:teuthology.orchestra.run.smithi066.stdout: "allow_crimson": false, 2024-09-12T22:48:35.524 INFO:teuthology.orchestra.run.smithi066.stdout: "pools": [ 2024-09-12T22:48:35.524 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-12T22:48:35.524 INFO:teuthology.orchestra.run.smithi066.stdout: "pool": 1, 2024-09-12T22:48:35.524 INFO:teuthology.orchestra.run.smithi066.stdout: "pool_name": ".mgr", 2024-09-12T22:48:35.524 INFO:teuthology.orchestra.run.smithi066.stdout: "create_time": "2024-09-12T22:47:54.168813+0000", 2024-09-12T22:48:35.524 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-12T22:48:35.524 INFO:teuthology.orchestra.run.smithi066.stdout: "flags_names": "hashpspool", 2024-09-12T22:48:35.524 INFO:teuthology.orchestra.run.smithi066.stdout: "type": 1, 2024-09-12T22:48:35.524 INFO:teuthology.orchestra.run.smithi066.stdout: "size": 2, 2024-09-12T22:48:35.525 INFO:teuthology.orchestra.run.smithi066.stdout: "min_size": 1, 2024-09-12T22:48:35.525 INFO:teuthology.orchestra.run.smithi066.stdout: "crush_rule": 0, 2024-09-12T22:48:35.525 INFO:teuthology.orchestra.run.smithi066.stdout: "peering_crush_bucket_count": 0, 2024-09-12T22:48:35.525 INFO:teuthology.orchestra.run.smithi066.stdout: "peering_crush_bucket_target": 0, 2024-09-12T22:48:35.525 INFO:teuthology.orchestra.run.smithi066.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T22:48:35.525 INFO:teuthology.orchestra.run.smithi066.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T22:48:35.525 INFO:teuthology.orchestra.run.smithi066.stdout: "is_stretch_pool": false, 2024-09-12T22:48:35.525 INFO:teuthology.orchestra.run.smithi066.stdout: "object_hash": 2, 2024-09-12T22:48:35.525 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_autoscale_mode": "off", 2024-09-12T22:48:35.525 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_num": 1, 2024-09-12T22:48:35.525 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_placement_num": 1, 2024-09-12T22:48:35.526 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_placement_num_target": 1, 2024-09-12T22:48:35.526 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_num_target": 1, 2024-09-12T22:48:35.526 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_num_pending": 1, 2024-09-12T22:48:35.526 INFO:teuthology.orchestra.run.smithi066.stdout: "last_pg_merge_meta": { 2024-09-12T22:48:35.526 INFO:teuthology.orchestra.run.smithi066.stdout: "source_pgid": "0.0", 2024-09-12T22:48:35.526 INFO:teuthology.orchestra.run.smithi066.stdout: "ready_epoch": 0, 2024-09-12T22:48:35.526 INFO:teuthology.orchestra.run.smithi066.stdout: "last_epoch_started": 0, 2024-09-12T22:48:35.526 INFO:teuthology.orchestra.run.smithi066.stdout: "last_epoch_clean": 0, 2024-09-12T22:48:35.526 INFO:teuthology.orchestra.run.smithi066.stdout: "source_version": "0'0", 2024-09-12T22:48:35.526 INFO:teuthology.orchestra.run.smithi066.stdout: "target_version": "0'0" 2024-09-12T22:48:35.526 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.526 INFO:teuthology.orchestra.run.smithi066.stdout: "last_change": "11", 2024-09-12T22:48:35.527 INFO:teuthology.orchestra.run.smithi066.stdout: "last_force_op_resend": "0", 2024-09-12T22:48:35.527 INFO:teuthology.orchestra.run.smithi066.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T22:48:35.527 INFO:teuthology.orchestra.run.smithi066.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T22:48:35.527 INFO:teuthology.orchestra.run.smithi066.stdout: "auid": 0, 2024-09-12T22:48:35.527 INFO:teuthology.orchestra.run.smithi066.stdout: "snap_mode": "selfmanaged", 2024-09-12T22:48:35.527 INFO:teuthology.orchestra.run.smithi066.stdout: "snap_seq": 0, 2024-09-12T22:48:35.527 INFO:teuthology.orchestra.run.smithi066.stdout: "snap_epoch": 0, 2024-09-12T22:48:35.527 INFO:teuthology.orchestra.run.smithi066.stdout: "pool_snaps": [], 2024-09-12T22:48:35.527 INFO:teuthology.orchestra.run.smithi066.stdout: "removed_snaps": "[]", 2024-09-12T22:48:35.527 INFO:teuthology.orchestra.run.smithi066.stdout: "quota_max_bytes": 0, 2024-09-12T22:48:35.527 INFO:teuthology.orchestra.run.smithi066.stdout: "quota_max_objects": 0, 2024-09-12T22:48:35.527 INFO:teuthology.orchestra.run.smithi066.stdout: "tiers": [], 2024-09-12T22:48:35.528 INFO:teuthology.orchestra.run.smithi066.stdout: "tier_of": -1, 2024-09-12T22:48:35.528 INFO:teuthology.orchestra.run.smithi066.stdout: "read_tier": -1, 2024-09-12T22:48:35.528 INFO:teuthology.orchestra.run.smithi066.stdout: "write_tier": -1, 2024-09-12T22:48:35.528 INFO:teuthology.orchestra.run.smithi066.stdout: "cache_mode": "none", 2024-09-12T22:48:35.528 INFO:teuthology.orchestra.run.smithi066.stdout: "target_max_bytes": 0, 2024-09-12T22:48:35.528 INFO:teuthology.orchestra.run.smithi066.stdout: "target_max_objects": 0, 2024-09-12T22:48:35.528 INFO:teuthology.orchestra.run.smithi066.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T22:48:35.528 INFO:teuthology.orchestra.run.smithi066.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T22:48:35.528 INFO:teuthology.orchestra.run.smithi066.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T22:48:35.528 INFO:teuthology.orchestra.run.smithi066.stdout: "cache_min_flush_age": 0, 2024-09-12T22:48:35.528 INFO:teuthology.orchestra.run.smithi066.stdout: "cache_min_evict_age": 0, 2024-09-12T22:48:35.529 INFO:teuthology.orchestra.run.smithi066.stdout: "erasure_code_profile": "", 2024-09-12T22:48:35.529 INFO:teuthology.orchestra.run.smithi066.stdout: "hit_set_params": { 2024-09-12T22:48:35.529 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "none" 2024-09-12T22:48:35.529 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.529 INFO:teuthology.orchestra.run.smithi066.stdout: "hit_set_period": 0, 2024-09-12T22:48:35.529 INFO:teuthology.orchestra.run.smithi066.stdout: "hit_set_count": 0, 2024-09-12T22:48:35.529 INFO:teuthology.orchestra.run.smithi066.stdout: "use_gmt_hitset": true, 2024-09-12T22:48:35.529 INFO:teuthology.orchestra.run.smithi066.stdout: "min_read_recency_for_promote": 0, 2024-09-12T22:48:35.530 INFO:teuthology.orchestra.run.smithi066.stdout: "min_write_recency_for_promote": 0, 2024-09-12T22:48:35.530 INFO:teuthology.orchestra.run.smithi066.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T22:48:35.530 INFO:teuthology.orchestra.run.smithi066.stdout: "hit_set_search_last_n": 0, 2024-09-12T22:48:35.530 INFO:teuthology.orchestra.run.smithi066.stdout: "grade_table": [], 2024-09-12T22:48:35.530 INFO:teuthology.orchestra.run.smithi066.stdout: "stripe_width": 0, 2024-09-12T22:48:35.530 INFO:teuthology.orchestra.run.smithi066.stdout: "expected_num_objects": 0, 2024-09-12T22:48:35.530 INFO:teuthology.orchestra.run.smithi066.stdout: "fast_read": false, 2024-09-12T22:48:35.530 INFO:teuthology.orchestra.run.smithi066.stdout: "options": { 2024-09-12T22:48:35.530 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_num_max": 32, 2024-09-12T22:48:35.530 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_num_min": 1 2024-09-12T22:48:35.530 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.531 INFO:teuthology.orchestra.run.smithi066.stdout: "application_metadata": { 2024-09-12T22:48:35.531 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": {} 2024-09-12T22:48:35.531 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.531 INFO:teuthology.orchestra.run.smithi066.stdout: "read_balance": { 2024-09-12T22:48:35.531 INFO:teuthology.orchestra.run.smithi066.stdout: "score_type": "Fair distribution", 2024-09-12T22:48:35.531 INFO:teuthology.orchestra.run.smithi066.stdout: "score_acting": 3.0299999713897705, 2024-09-12T22:48:35.531 INFO:teuthology.orchestra.run.smithi066.stdout: "score_stable": 3.0299999713897705, 2024-09-12T22:48:35.531 INFO:teuthology.orchestra.run.smithi066.stdout: "optimal_score": 0.33000001311302185, 2024-09-12T22:48:35.531 INFO:teuthology.orchestra.run.smithi066.stdout: "raw_score_acting": 1, 2024-09-12T22:48:35.531 INFO:teuthology.orchestra.run.smithi066.stdout: "raw_score_stable": 1, 2024-09-12T22:48:35.531 INFO:teuthology.orchestra.run.smithi066.stdout: "primary_affinity_weighted": 1, 2024-09-12T22:48:35.531 INFO:teuthology.orchestra.run.smithi066.stdout: "average_primary_affinity": 1, 2024-09-12T22:48:35.532 INFO:teuthology.orchestra.run.smithi066.stdout: "average_primary_affinity_weighted": 1 2024-09-12T22:48:35.532 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T22:48:35.532 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.532 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-12T22:48:35.532 INFO:teuthology.orchestra.run.smithi066.stdout: "pool": 2, 2024-09-12T22:48:35.532 INFO:teuthology.orchestra.run.smithi066.stdout: "pool_name": "rbd", 2024-09-12T22:48:35.532 INFO:teuthology.orchestra.run.smithi066.stdout: "create_time": "2024-09-12T22:47:58.920007+0000", 2024-09-12T22:48:35.532 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 8193, 2024-09-12T22:48:35.532 INFO:teuthology.orchestra.run.smithi066.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T22:48:35.532 INFO:teuthology.orchestra.run.smithi066.stdout: "type": 1, 2024-09-12T22:48:35.532 INFO:teuthology.orchestra.run.smithi066.stdout: "size": 2, 2024-09-12T22:48:35.533 INFO:teuthology.orchestra.run.smithi066.stdout: "min_size": 1, 2024-09-12T22:48:35.533 INFO:teuthology.orchestra.run.smithi066.stdout: "crush_rule": 0, 2024-09-12T22:48:35.533 INFO:teuthology.orchestra.run.smithi066.stdout: "peering_crush_bucket_count": 0, 2024-09-12T22:48:35.533 INFO:teuthology.orchestra.run.smithi066.stdout: "peering_crush_bucket_target": 0, 2024-09-12T22:48:35.533 INFO:teuthology.orchestra.run.smithi066.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T22:48:35.533 INFO:teuthology.orchestra.run.smithi066.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T22:48:35.533 INFO:teuthology.orchestra.run.smithi066.stdout: "is_stretch_pool": false, 2024-09-12T22:48:35.533 INFO:teuthology.orchestra.run.smithi066.stdout: "object_hash": 2, 2024-09-12T22:48:35.533 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_autoscale_mode": "off", 2024-09-12T22:48:35.533 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_num": 8, 2024-09-12T22:48:35.533 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_placement_num": 8, 2024-09-12T22:48:35.533 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_placement_num_target": 8, 2024-09-12T22:48:35.534 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_num_target": 8, 2024-09-12T22:48:35.534 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_num_pending": 8, 2024-09-12T22:48:35.534 INFO:teuthology.orchestra.run.smithi066.stdout: "last_pg_merge_meta": { 2024-09-12T22:48:35.534 INFO:teuthology.orchestra.run.smithi066.stdout: "source_pgid": "0.0", 2024-09-12T22:48:35.534 INFO:teuthology.orchestra.run.smithi066.stdout: "ready_epoch": 0, 2024-09-12T22:48:35.534 INFO:teuthology.orchestra.run.smithi066.stdout: "last_epoch_started": 0, 2024-09-12T22:48:35.534 INFO:teuthology.orchestra.run.smithi066.stdout: "last_epoch_clean": 0, 2024-09-12T22:48:35.534 INFO:teuthology.orchestra.run.smithi066.stdout: "source_version": "0'0", 2024-09-12T22:48:35.534 INFO:teuthology.orchestra.run.smithi066.stdout: "target_version": "0'0" 2024-09-12T22:48:35.534 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.534 INFO:teuthology.orchestra.run.smithi066.stdout: "last_change": "15", 2024-09-12T22:48:35.535 INFO:teuthology.orchestra.run.smithi066.stdout: "last_force_op_resend": "0", 2024-09-12T22:48:35.535 INFO:teuthology.orchestra.run.smithi066.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T22:48:35.535 INFO:teuthology.orchestra.run.smithi066.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T22:48:35.535 INFO:teuthology.orchestra.run.smithi066.stdout: "auid": 0, 2024-09-12T22:48:35.535 INFO:teuthology.orchestra.run.smithi066.stdout: "snap_mode": "selfmanaged", 2024-09-12T22:48:35.535 INFO:teuthology.orchestra.run.smithi066.stdout: "snap_seq": 2, 2024-09-12T22:48:35.535 INFO:teuthology.orchestra.run.smithi066.stdout: "snap_epoch": 15, 2024-09-12T22:48:35.535 INFO:teuthology.orchestra.run.smithi066.stdout: "pool_snaps": [], 2024-09-12T22:48:35.535 INFO:teuthology.orchestra.run.smithi066.stdout: "removed_snaps": "[]", 2024-09-12T22:48:35.535 INFO:teuthology.orchestra.run.smithi066.stdout: "quota_max_bytes": 0, 2024-09-12T22:48:35.535 INFO:teuthology.orchestra.run.smithi066.stdout: "quota_max_objects": 0, 2024-09-12T22:48:35.536 INFO:teuthology.orchestra.run.smithi066.stdout: "tiers": [], 2024-09-12T22:48:35.536 INFO:teuthology.orchestra.run.smithi066.stdout: "tier_of": -1, 2024-09-12T22:48:35.536 INFO:teuthology.orchestra.run.smithi066.stdout: "read_tier": -1, 2024-09-12T22:48:35.536 INFO:teuthology.orchestra.run.smithi066.stdout: "write_tier": -1, 2024-09-12T22:48:35.536 INFO:teuthology.orchestra.run.smithi066.stdout: "cache_mode": "none", 2024-09-12T22:48:35.536 INFO:teuthology.orchestra.run.smithi066.stdout: "target_max_bytes": 0, 2024-09-12T22:48:35.536 INFO:teuthology.orchestra.run.smithi066.stdout: "target_max_objects": 0, 2024-09-12T22:48:35.536 INFO:teuthology.orchestra.run.smithi066.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T22:48:35.536 INFO:teuthology.orchestra.run.smithi066.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T22:48:35.536 INFO:teuthology.orchestra.run.smithi066.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T22:48:35.536 INFO:teuthology.orchestra.run.smithi066.stdout: "cache_min_flush_age": 0, 2024-09-12T22:48:35.537 INFO:teuthology.orchestra.run.smithi066.stdout: "cache_min_evict_age": 0, 2024-09-12T22:48:35.537 INFO:teuthology.orchestra.run.smithi066.stdout: "erasure_code_profile": "", 2024-09-12T22:48:35.537 INFO:teuthology.orchestra.run.smithi066.stdout: "hit_set_params": { 2024-09-12T22:48:35.537 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "none" 2024-09-12T22:48:35.537 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.537 INFO:teuthology.orchestra.run.smithi066.stdout: "hit_set_period": 0, 2024-09-12T22:48:35.537 INFO:teuthology.orchestra.run.smithi066.stdout: "hit_set_count": 0, 2024-09-12T22:48:35.537 INFO:teuthology.orchestra.run.smithi066.stdout: "use_gmt_hitset": true, 2024-09-12T22:48:35.537 INFO:teuthology.orchestra.run.smithi066.stdout: "min_read_recency_for_promote": 0, 2024-09-12T22:48:35.537 INFO:teuthology.orchestra.run.smithi066.stdout: "min_write_recency_for_promote": 0, 2024-09-12T22:48:35.537 INFO:teuthology.orchestra.run.smithi066.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T22:48:35.537 INFO:teuthology.orchestra.run.smithi066.stdout: "hit_set_search_last_n": 0, 2024-09-12T22:48:35.538 INFO:teuthology.orchestra.run.smithi066.stdout: "grade_table": [], 2024-09-12T22:48:35.538 INFO:teuthology.orchestra.run.smithi066.stdout: "stripe_width": 0, 2024-09-12T22:48:35.538 INFO:teuthology.orchestra.run.smithi066.stdout: "expected_num_objects": 0, 2024-09-12T22:48:35.538 INFO:teuthology.orchestra.run.smithi066.stdout: "fast_read": false, 2024-09-12T22:48:35.538 INFO:teuthology.orchestra.run.smithi066.stdout: "options": {}, 2024-09-12T22:48:35.538 INFO:teuthology.orchestra.run.smithi066.stdout: "application_metadata": { 2024-09-12T22:48:35.538 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd": {} 2024-09-12T22:48:35.538 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.538 INFO:teuthology.orchestra.run.smithi066.stdout: "read_balance": { 2024-09-12T22:48:35.538 INFO:teuthology.orchestra.run.smithi066.stdout: "score_type": "Fair distribution", 2024-09-12T22:48:35.538 INFO:teuthology.orchestra.run.smithi066.stdout: "score_acting": 1.8700000047683716, 2024-09-12T22:48:35.538 INFO:teuthology.orchestra.run.smithi066.stdout: "score_stable": 1.8700000047683716, 2024-09-12T22:48:35.539 INFO:teuthology.orchestra.run.smithi066.stdout: "optimal_score": 0.67000001668930054, 2024-09-12T22:48:35.539 INFO:teuthology.orchestra.run.smithi066.stdout: "raw_score_acting": 1.25, 2024-09-12T22:48:35.539 INFO:teuthology.orchestra.run.smithi066.stdout: "raw_score_stable": 1.25, 2024-09-12T22:48:35.539 INFO:teuthology.orchestra.run.smithi066.stdout: "primary_affinity_weighted": 1, 2024-09-12T22:48:35.539 INFO:teuthology.orchestra.run.smithi066.stdout: "average_primary_affinity": 1, 2024-09-12T22:48:35.539 INFO:teuthology.orchestra.run.smithi066.stdout: "average_primary_affinity_weighted": 1 2024-09-12T22:48:35.539 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T22:48:35.539 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.539 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-12T22:48:35.539 INFO:teuthology.orchestra.run.smithi066.stdout: "pool": 3, 2024-09-12T22:48:35.539 INFO:teuthology.orchestra.run.smithi066.stdout: "pool_name": "cephfs_metadata", 2024-09-12T22:48:35.540 INFO:teuthology.orchestra.run.smithi066.stdout: "create_time": "2024-09-12T22:48:03.033410+0000", 2024-09-12T22:48:35.540 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-12T22:48:35.540 INFO:teuthology.orchestra.run.smithi066.stdout: "flags_names": "hashpspool", 2024-09-12T22:48:35.540 INFO:teuthology.orchestra.run.smithi066.stdout: "type": 1, 2024-09-12T22:48:35.540 INFO:teuthology.orchestra.run.smithi066.stdout: "size": 2, 2024-09-12T22:48:35.540 INFO:teuthology.orchestra.run.smithi066.stdout: "min_size": 1, 2024-09-12T22:48:35.540 INFO:teuthology.orchestra.run.smithi066.stdout: "crush_rule": 0, 2024-09-12T22:48:35.540 INFO:teuthology.orchestra.run.smithi066.stdout: "peering_crush_bucket_count": 0, 2024-09-12T22:48:35.540 INFO:teuthology.orchestra.run.smithi066.stdout: "peering_crush_bucket_target": 0, 2024-09-12T22:48:35.540 INFO:teuthology.orchestra.run.smithi066.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T22:48:35.540 INFO:teuthology.orchestra.run.smithi066.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T22:48:35.541 INFO:teuthology.orchestra.run.smithi066.stdout: "is_stretch_pool": false, 2024-09-12T22:48:35.541 INFO:teuthology.orchestra.run.smithi066.stdout: "object_hash": 2, 2024-09-12T22:48:35.541 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_autoscale_mode": "off", 2024-09-12T22:48:35.541 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_num": 32, 2024-09-12T22:48:35.541 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_placement_num": 32, 2024-09-12T22:48:35.541 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_placement_num_target": 32, 2024-09-12T22:48:35.541 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_num_target": 32, 2024-09-12T22:48:35.541 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_num_pending": 32, 2024-09-12T22:48:35.541 INFO:teuthology.orchestra.run.smithi066.stdout: "last_pg_merge_meta": { 2024-09-12T22:48:35.542 INFO:teuthology.orchestra.run.smithi066.stdout: "source_pgid": "0.0", 2024-09-12T22:48:35.542 INFO:teuthology.orchestra.run.smithi066.stdout: "ready_epoch": 0, 2024-09-12T22:48:35.542 INFO:teuthology.orchestra.run.smithi066.stdout: "last_epoch_started": 0, 2024-09-12T22:48:35.542 INFO:teuthology.orchestra.run.smithi066.stdout: "last_epoch_clean": 0, 2024-09-12T22:48:35.542 INFO:teuthology.orchestra.run.smithi066.stdout: "source_version": "0'0", 2024-09-12T22:48:35.542 INFO:teuthology.orchestra.run.smithi066.stdout: "target_version": "0'0" 2024-09-12T22:48:35.542 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.542 INFO:teuthology.orchestra.run.smithi066.stdout: "last_change": "18", 2024-09-12T22:48:35.542 INFO:teuthology.orchestra.run.smithi066.stdout: "last_force_op_resend": "0", 2024-09-12T22:48:35.542 INFO:teuthology.orchestra.run.smithi066.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T22:48:35.542 INFO:teuthology.orchestra.run.smithi066.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T22:48:35.543 INFO:teuthology.orchestra.run.smithi066.stdout: "auid": 0, 2024-09-12T22:48:35.543 INFO:teuthology.orchestra.run.smithi066.stdout: "snap_mode": "selfmanaged", 2024-09-12T22:48:35.543 INFO:teuthology.orchestra.run.smithi066.stdout: "snap_seq": 0, 2024-09-12T22:48:35.543 INFO:teuthology.orchestra.run.smithi066.stdout: "snap_epoch": 0, 2024-09-12T22:48:35.543 INFO:teuthology.orchestra.run.smithi066.stdout: "pool_snaps": [], 2024-09-12T22:48:35.543 INFO:teuthology.orchestra.run.smithi066.stdout: "removed_snaps": "[]", 2024-09-12T22:48:35.543 INFO:teuthology.orchestra.run.smithi066.stdout: "quota_max_bytes": 0, 2024-09-12T22:48:35.543 INFO:teuthology.orchestra.run.smithi066.stdout: "quota_max_objects": 0, 2024-09-12T22:48:35.543 INFO:teuthology.orchestra.run.smithi066.stdout: "tiers": [], 2024-09-12T22:48:35.543 INFO:teuthology.orchestra.run.smithi066.stdout: "tier_of": -1, 2024-09-12T22:48:35.543 INFO:teuthology.orchestra.run.smithi066.stdout: "read_tier": -1, 2024-09-12T22:48:35.543 INFO:teuthology.orchestra.run.smithi066.stdout: "write_tier": -1, 2024-09-12T22:48:35.544 INFO:teuthology.orchestra.run.smithi066.stdout: "cache_mode": "none", 2024-09-12T22:48:35.544 INFO:teuthology.orchestra.run.smithi066.stdout: "target_max_bytes": 0, 2024-09-12T22:48:35.544 INFO:teuthology.orchestra.run.smithi066.stdout: "target_max_objects": 0, 2024-09-12T22:48:35.544 INFO:teuthology.orchestra.run.smithi066.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T22:48:35.544 INFO:teuthology.orchestra.run.smithi066.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T22:48:35.544 INFO:teuthology.orchestra.run.smithi066.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T22:48:35.544 INFO:teuthology.orchestra.run.smithi066.stdout: "cache_min_flush_age": 0, 2024-09-12T22:48:35.544 INFO:teuthology.orchestra.run.smithi066.stdout: "cache_min_evict_age": 0, 2024-09-12T22:48:35.544 INFO:teuthology.orchestra.run.smithi066.stdout: "erasure_code_profile": "", 2024-09-12T22:48:35.544 INFO:teuthology.orchestra.run.smithi066.stdout: "hit_set_params": { 2024-09-12T22:48:35.544 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "none" 2024-09-12T22:48:35.545 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.545 INFO:teuthology.orchestra.run.smithi066.stdout: "hit_set_period": 0, 2024-09-12T22:48:35.545 INFO:teuthology.orchestra.run.smithi066.stdout: "hit_set_count": 0, 2024-09-12T22:48:35.545 INFO:teuthology.orchestra.run.smithi066.stdout: "use_gmt_hitset": true, 2024-09-12T22:48:35.545 INFO:teuthology.orchestra.run.smithi066.stdout: "min_read_recency_for_promote": 0, 2024-09-12T22:48:35.545 INFO:teuthology.orchestra.run.smithi066.stdout: "min_write_recency_for_promote": 0, 2024-09-12T22:48:35.545 INFO:teuthology.orchestra.run.smithi066.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T22:48:35.545 INFO:teuthology.orchestra.run.smithi066.stdout: "hit_set_search_last_n": 0, 2024-09-12T22:48:35.545 INFO:teuthology.orchestra.run.smithi066.stdout: "grade_table": [], 2024-09-12T22:48:35.545 INFO:teuthology.orchestra.run.smithi066.stdout: "stripe_width": 0, 2024-09-12T22:48:35.545 INFO:teuthology.orchestra.run.smithi066.stdout: "expected_num_objects": 0, 2024-09-12T22:48:35.546 INFO:teuthology.orchestra.run.smithi066.stdout: "fast_read": false, 2024-09-12T22:48:35.546 INFO:teuthology.orchestra.run.smithi066.stdout: "options": { 2024-09-12T22:48:35.546 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_autoscale_bias": 4, 2024-09-12T22:48:35.546 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_num_min": 16, 2024-09-12T22:48:35.546 INFO:teuthology.orchestra.run.smithi066.stdout: "recovery_priority": 5 2024-09-12T22:48:35.546 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.546 INFO:teuthology.orchestra.run.smithi066.stdout: "application_metadata": { 2024-09-12T22:48:35.546 INFO:teuthology.orchestra.run.smithi066.stdout: "cephfs": { 2024-09-12T22:48:35.546 INFO:teuthology.orchestra.run.smithi066.stdout: "metadata": "cephfs" 2024-09-12T22:48:35.547 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T22:48:35.547 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.547 INFO:teuthology.orchestra.run.smithi066.stdout: "read_balance": { 2024-09-12T22:48:35.547 INFO:teuthology.orchestra.run.smithi066.stdout: "score_type": "Fair distribution", 2024-09-12T22:48:35.547 INFO:teuthology.orchestra.run.smithi066.stdout: "score_acting": 1.7799999713897705, 2024-09-12T22:48:35.547 INFO:teuthology.orchestra.run.smithi066.stdout: "score_stable": 1.7799999713897705, 2024-09-12T22:48:35.548 INFO:teuthology.orchestra.run.smithi066.stdout: "optimal_score": 0.67000001668930054, 2024-09-12T22:48:35.548 INFO:teuthology.orchestra.run.smithi066.stdout: "raw_score_acting": 1.190000057220459, 2024-09-12T22:48:35.548 INFO:teuthology.orchestra.run.smithi066.stdout: "raw_score_stable": 1.190000057220459, 2024-09-12T22:48:35.548 INFO:teuthology.orchestra.run.smithi066.stdout: "primary_affinity_weighted": 1, 2024-09-12T22:48:35.548 INFO:teuthology.orchestra.run.smithi066.stdout: "average_primary_affinity": 1, 2024-09-12T22:48:35.548 INFO:teuthology.orchestra.run.smithi066.stdout: "average_primary_affinity_weighted": 1 2024-09-12T22:48:35.548 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T22:48:35.548 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.548 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-12T22:48:35.548 INFO:teuthology.orchestra.run.smithi066.stdout: "pool": 4, 2024-09-12T22:48:35.548 INFO:teuthology.orchestra.run.smithi066.stdout: "pool_name": "cephfs_data", 2024-09-12T22:48:35.549 INFO:teuthology.orchestra.run.smithi066.stdout: "create_time": "2024-09-12T22:48:03.489928+0000", 2024-09-12T22:48:35.549 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-12T22:48:35.549 INFO:teuthology.orchestra.run.smithi066.stdout: "flags_names": "hashpspool", 2024-09-12T22:48:35.549 INFO:teuthology.orchestra.run.smithi066.stdout: "type": 1, 2024-09-12T22:48:35.549 INFO:teuthology.orchestra.run.smithi066.stdout: "size": 2, 2024-09-12T22:48:35.549 INFO:teuthology.orchestra.run.smithi066.stdout: "min_size": 1, 2024-09-12T22:48:35.549 INFO:teuthology.orchestra.run.smithi066.stdout: "crush_rule": 0, 2024-09-12T22:48:35.549 INFO:teuthology.orchestra.run.smithi066.stdout: "peering_crush_bucket_count": 0, 2024-09-12T22:48:35.549 INFO:teuthology.orchestra.run.smithi066.stdout: "peering_crush_bucket_target": 0, 2024-09-12T22:48:35.549 INFO:teuthology.orchestra.run.smithi066.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T22:48:35.549 INFO:teuthology.orchestra.run.smithi066.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T22:48:35.549 INFO:teuthology.orchestra.run.smithi066.stdout: "is_stretch_pool": false, 2024-09-12T22:48:35.550 INFO:teuthology.orchestra.run.smithi066.stdout: "object_hash": 2, 2024-09-12T22:48:35.550 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_autoscale_mode": "off", 2024-09-12T22:48:35.550 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_num": 64, 2024-09-12T22:48:35.550 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_placement_num": 64, 2024-09-12T22:48:35.550 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_placement_num_target": 64, 2024-09-12T22:48:35.550 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_num_target": 64, 2024-09-12T22:48:35.550 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_num_pending": 64, 2024-09-12T22:48:35.550 INFO:teuthology.orchestra.run.smithi066.stdout: "last_pg_merge_meta": { 2024-09-12T22:48:35.550 INFO:teuthology.orchestra.run.smithi066.stdout: "source_pgid": "0.0", 2024-09-12T22:48:35.550 INFO:teuthology.orchestra.run.smithi066.stdout: "ready_epoch": 0, 2024-09-12T22:48:35.550 INFO:teuthology.orchestra.run.smithi066.stdout: "last_epoch_started": 0, 2024-09-12T22:48:35.550 INFO:teuthology.orchestra.run.smithi066.stdout: "last_epoch_clean": 0, 2024-09-12T22:48:35.551 INFO:teuthology.orchestra.run.smithi066.stdout: "source_version": "0'0", 2024-09-12T22:48:35.551 INFO:teuthology.orchestra.run.smithi066.stdout: "target_version": "0'0" 2024-09-12T22:48:35.551 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.551 INFO:teuthology.orchestra.run.smithi066.stdout: "last_change": "19", 2024-09-12T22:48:35.551 INFO:teuthology.orchestra.run.smithi066.stdout: "last_force_op_resend": "0", 2024-09-12T22:48:35.551 INFO:teuthology.orchestra.run.smithi066.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T22:48:35.551 INFO:teuthology.orchestra.run.smithi066.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T22:48:35.551 INFO:teuthology.orchestra.run.smithi066.stdout: "auid": 0, 2024-09-12T22:48:35.551 INFO:teuthology.orchestra.run.smithi066.stdout: "snap_mode": "selfmanaged", 2024-09-12T22:48:35.551 INFO:teuthology.orchestra.run.smithi066.stdout: "snap_seq": 0, 2024-09-12T22:48:35.551 INFO:teuthology.orchestra.run.smithi066.stdout: "snap_epoch": 0, 2024-09-12T22:48:35.552 INFO:teuthology.orchestra.run.smithi066.stdout: "pool_snaps": [], 2024-09-12T22:48:35.552 INFO:teuthology.orchestra.run.smithi066.stdout: "removed_snaps": "[]", 2024-09-12T22:48:35.552 INFO:teuthology.orchestra.run.smithi066.stdout: "quota_max_bytes": 0, 2024-09-12T22:48:35.552 INFO:teuthology.orchestra.run.smithi066.stdout: "quota_max_objects": 0, 2024-09-12T22:48:35.552 INFO:teuthology.orchestra.run.smithi066.stdout: "tiers": [], 2024-09-12T22:48:35.552 INFO:teuthology.orchestra.run.smithi066.stdout: "tier_of": -1, 2024-09-12T22:48:35.552 INFO:teuthology.orchestra.run.smithi066.stdout: "read_tier": -1, 2024-09-12T22:48:35.552 INFO:teuthology.orchestra.run.smithi066.stdout: "write_tier": -1, 2024-09-12T22:48:35.552 INFO:teuthology.orchestra.run.smithi066.stdout: "cache_mode": "none", 2024-09-12T22:48:35.552 INFO:teuthology.orchestra.run.smithi066.stdout: "target_max_bytes": 0, 2024-09-12T22:48:35.553 INFO:teuthology.orchestra.run.smithi066.stdout: "target_max_objects": 0, 2024-09-12T22:48:35.553 INFO:teuthology.orchestra.run.smithi066.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T22:48:35.553 INFO:teuthology.orchestra.run.smithi066.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T22:48:35.553 INFO:teuthology.orchestra.run.smithi066.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T22:48:35.553 INFO:teuthology.orchestra.run.smithi066.stdout: "cache_min_flush_age": 0, 2024-09-12T22:48:35.553 INFO:teuthology.orchestra.run.smithi066.stdout: "cache_min_evict_age": 0, 2024-09-12T22:48:35.553 INFO:teuthology.orchestra.run.smithi066.stdout: "erasure_code_profile": "", 2024-09-12T22:48:35.553 INFO:teuthology.orchestra.run.smithi066.stdout: "hit_set_params": { 2024-09-12T22:48:35.553 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "none" 2024-09-12T22:48:35.553 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.553 INFO:teuthology.orchestra.run.smithi066.stdout: "hit_set_period": 0, 2024-09-12T22:48:35.553 INFO:teuthology.orchestra.run.smithi066.stdout: "hit_set_count": 0, 2024-09-12T22:48:35.554 INFO:teuthology.orchestra.run.smithi066.stdout: "use_gmt_hitset": true, 2024-09-12T22:48:35.554 INFO:teuthology.orchestra.run.smithi066.stdout: "min_read_recency_for_promote": 0, 2024-09-12T22:48:35.554 INFO:teuthology.orchestra.run.smithi066.stdout: "min_write_recency_for_promote": 0, 2024-09-12T22:48:35.554 INFO:teuthology.orchestra.run.smithi066.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T22:48:35.554 INFO:teuthology.orchestra.run.smithi066.stdout: "hit_set_search_last_n": 0, 2024-09-12T22:48:35.554 INFO:teuthology.orchestra.run.smithi066.stdout: "grade_table": [], 2024-09-12T22:48:35.554 INFO:teuthology.orchestra.run.smithi066.stdout: "stripe_width": 0, 2024-09-12T22:48:35.554 INFO:teuthology.orchestra.run.smithi066.stdout: "expected_num_objects": 0, 2024-09-12T22:48:35.554 INFO:teuthology.orchestra.run.smithi066.stdout: "fast_read": false, 2024-09-12T22:48:35.554 INFO:teuthology.orchestra.run.smithi066.stdout: "options": { 2024-09-12T22:48:35.554 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_num_min": 64, 2024-09-12T22:48:35.555 INFO:teuthology.orchestra.run.smithi066.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T22:48:35.555 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.555 INFO:teuthology.orchestra.run.smithi066.stdout: "application_metadata": { 2024-09-12T22:48:35.555 INFO:teuthology.orchestra.run.smithi066.stdout: "cephfs": { 2024-09-12T22:48:35.555 INFO:teuthology.orchestra.run.smithi066.stdout: "data": "cephfs" 2024-09-12T22:48:35.555 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T22:48:35.555 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.555 INFO:teuthology.orchestra.run.smithi066.stdout: "read_balance": { 2024-09-12T22:48:35.555 INFO:teuthology.orchestra.run.smithi066.stdout: "score_type": "Fair distribution", 2024-09-12T22:48:35.555 INFO:teuthology.orchestra.run.smithi066.stdout: "score_acting": 1.4900000095367432, 2024-09-12T22:48:35.555 INFO:teuthology.orchestra.run.smithi066.stdout: "score_stable": 1.4900000095367432, 2024-09-12T22:48:35.555 INFO:teuthology.orchestra.run.smithi066.stdout: "optimal_score": 0.67000001668930054, 2024-09-12T22:48:35.556 INFO:teuthology.orchestra.run.smithi066.stdout: "raw_score_acting": 1, 2024-09-12T22:48:35.556 INFO:teuthology.orchestra.run.smithi066.stdout: "raw_score_stable": 1, 2024-09-12T22:48:35.556 INFO:teuthology.orchestra.run.smithi066.stdout: "primary_affinity_weighted": 1, 2024-09-12T22:48:35.556 INFO:teuthology.orchestra.run.smithi066.stdout: "average_primary_affinity": 1, 2024-09-12T22:48:35.556 INFO:teuthology.orchestra.run.smithi066.stdout: "average_primary_affinity_weighted": 1 2024-09-12T22:48:35.556 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T22:48:35.556 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T22:48:35.556 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-12T22:48:35.556 INFO:teuthology.orchestra.run.smithi066.stdout: "osds": [ 2024-09-12T22:48:35.556 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-12T22:48:35.556 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": 0, 2024-09-12T22:48:35.557 INFO:teuthology.orchestra.run.smithi066.stdout: "uuid": "9ed48fb2-48c2-4ecb-9306-372a05b08cee", 2024-09-12T22:48:35.557 INFO:teuthology.orchestra.run.smithi066.stdout: "up": 1, 2024-09-12T22:48:35.557 INFO:teuthology.orchestra.run.smithi066.stdout: "in": 1, 2024-09-12T22:48:35.557 INFO:teuthology.orchestra.run.smithi066.stdout: "weight": 1, 2024-09-12T22:48:35.557 INFO:teuthology.orchestra.run.smithi066.stdout: "primary_affinity": 1, 2024-09-12T22:48:35.557 INFO:teuthology.orchestra.run.smithi066.stdout: "last_clean_begin": 0, 2024-09-12T22:48:35.557 INFO:teuthology.orchestra.run.smithi066.stdout: "last_clean_end": 0, 2024-09-12T22:48:35.557 INFO:teuthology.orchestra.run.smithi066.stdout: "up_from": 8, 2024-09-12T22:48:35.557 INFO:teuthology.orchestra.run.smithi066.stdout: "up_thru": 23, 2024-09-12T22:48:35.557 INFO:teuthology.orchestra.run.smithi066.stdout: "down_at": 0, 2024-09-12T22:48:35.557 INFO:teuthology.orchestra.run.smithi066.stdout: "lost_at": 0, 2024-09-12T22:48:35.558 INFO:teuthology.orchestra.run.smithi066.stdout: "public_addrs": { 2024-09-12T22:48:35.558 INFO:teuthology.orchestra.run.smithi066.stdout: "addrvec": [ 2024-09-12T22:48:35.558 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-12T22:48:35.558 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v2", 2024-09-12T22:48:35.558 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "172.21.15.87:6800", 2024-09-12T22:48:35.558 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 1747255146 2024-09-12T22:48:35.558 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.558 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-12T22:48:35.558 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v1", 2024-09-12T22:48:35.558 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "172.21.15.87:6801", 2024-09-12T22:48:35.558 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 1747255146 2024-09-12T22:48:35.558 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T22:48:35.559 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-09-12T22:48:35.559 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.559 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_addrs": { 2024-09-12T22:48:35.559 INFO:teuthology.orchestra.run.smithi066.stdout: "addrvec": [ 2024-09-12T22:48:35.559 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-12T22:48:35.559 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v2", 2024-09-12T22:48:35.559 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "172.21.15.87:6802", 2024-09-12T22:48:35.559 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 1747255146 2024-09-12T22:48:35.559 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.559 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-12T22:48:35.559 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v1", 2024-09-12T22:48:35.559 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "172.21.15.87:6803", 2024-09-12T22:48:35.560 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 1747255146 2024-09-12T22:48:35.560 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T22:48:35.560 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-09-12T22:48:35.560 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.560 INFO:teuthology.orchestra.run.smithi066.stdout: "heartbeat_back_addrs": { 2024-09-12T22:48:35.560 INFO:teuthology.orchestra.run.smithi066.stdout: "addrvec": [ 2024-09-12T22:48:35.560 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-12T22:48:35.560 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v2", 2024-09-12T22:48:35.560 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "172.21.15.87:6806", 2024-09-12T22:48:35.560 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 1747255146 2024-09-12T22:48:35.560 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.561 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-12T22:48:35.561 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v1", 2024-09-12T22:48:35.561 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "172.21.15.87:6807", 2024-09-12T22:48:35.561 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 1747255146 2024-09-12T22:48:35.561 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T22:48:35.561 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-09-12T22:48:35.561 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.561 INFO:teuthology.orchestra.run.smithi066.stdout: "heartbeat_front_addrs": { 2024-09-12T22:48:35.561 INFO:teuthology.orchestra.run.smithi066.stdout: "addrvec": [ 2024-09-12T22:48:35.561 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-12T22:48:35.561 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v2", 2024-09-12T22:48:35.561 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "172.21.15.87:6804", 2024-09-12T22:48:35.562 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 1747255146 2024-09-12T22:48:35.562 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.562 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-12T22:48:35.562 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v1", 2024-09-12T22:48:35.562 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "172.21.15.87:6805", 2024-09-12T22:48:35.562 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 1747255146 2024-09-12T22:48:35.562 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T22:48:35.562 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-09-12T22:48:35.562 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.562 INFO:teuthology.orchestra.run.smithi066.stdout: "public_addr": "172.21.15.87:6801/1747255146", 2024-09-12T22:48:35.562 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_addr": "172.21.15.87:6803/1747255146", 2024-09-12T22:48:35.563 INFO:teuthology.orchestra.run.smithi066.stdout: "heartbeat_back_addr": "172.21.15.87:6807/1747255146", 2024-09-12T22:48:35.563 INFO:teuthology.orchestra.run.smithi066.stdout: "heartbeat_front_addr": "172.21.15.87:6805/1747255146", 2024-09-12T22:48:35.563 INFO:teuthology.orchestra.run.smithi066.stdout: "state": [ 2024-09-12T22:48:35.563 INFO:teuthology.orchestra.run.smithi066.stdout: "exists", 2024-09-12T22:48:35.563 INFO:teuthology.orchestra.run.smithi066.stdout: "up" 2024-09-12T22:48:35.563 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-09-12T22:48:35.563 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.563 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-12T22:48:35.563 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": 1, 2024-09-12T22:48:35.563 INFO:teuthology.orchestra.run.smithi066.stdout: "uuid": "af934313-a6b4-4e15-9818-6fc3fb71b949", 2024-09-12T22:48:35.563 INFO:teuthology.orchestra.run.smithi066.stdout: "up": 1, 2024-09-12T22:48:35.563 INFO:teuthology.orchestra.run.smithi066.stdout: "in": 1, 2024-09-12T22:48:35.564 INFO:teuthology.orchestra.run.smithi066.stdout: "weight": 1, 2024-09-12T22:48:35.564 INFO:teuthology.orchestra.run.smithi066.stdout: "primary_affinity": 1, 2024-09-12T22:48:35.564 INFO:teuthology.orchestra.run.smithi066.stdout: "last_clean_begin": 0, 2024-09-12T22:48:35.564 INFO:teuthology.orchestra.run.smithi066.stdout: "last_clean_end": 0, 2024-09-12T22:48:35.564 INFO:teuthology.orchestra.run.smithi066.stdout: "up_from": 8, 2024-09-12T22:48:35.564 INFO:teuthology.orchestra.run.smithi066.stdout: "up_thru": 23, 2024-09-12T22:48:35.564 INFO:teuthology.orchestra.run.smithi066.stdout: "down_at": 0, 2024-09-12T22:48:35.564 INFO:teuthology.orchestra.run.smithi066.stdout: "lost_at": 0, 2024-09-12T22:48:35.564 INFO:teuthology.orchestra.run.smithi066.stdout: "public_addrs": { 2024-09-12T22:48:35.564 INFO:teuthology.orchestra.run.smithi066.stdout: "addrvec": [ 2024-09-12T22:48:35.565 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-12T22:48:35.565 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v2", 2024-09-12T22:48:35.565 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "172.21.15.99:6800", 2024-09-12T22:48:35.565 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 1159429503 2024-09-12T22:48:35.565 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.565 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-12T22:48:35.565 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v1", 2024-09-12T22:48:35.565 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "172.21.15.99:6801", 2024-09-12T22:48:35.565 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 1159429503 2024-09-12T22:48:35.565 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T22:48:35.565 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-09-12T22:48:35.566 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.566 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_addrs": { 2024-09-12T22:48:35.566 INFO:teuthology.orchestra.run.smithi066.stdout: "addrvec": [ 2024-09-12T22:48:35.566 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-12T22:48:35.566 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v2", 2024-09-12T22:48:35.566 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "172.21.15.99:6802", 2024-09-12T22:48:35.566 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 1159429503 2024-09-12T22:48:35.566 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.566 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-12T22:48:35.566 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v1", 2024-09-12T22:48:35.566 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "172.21.15.99:6803", 2024-09-12T22:48:35.567 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 1159429503 2024-09-12T22:48:35.567 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T22:48:35.567 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-09-12T22:48:35.567 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.567 INFO:teuthology.orchestra.run.smithi066.stdout: "heartbeat_back_addrs": { 2024-09-12T22:48:35.567 INFO:teuthology.orchestra.run.smithi066.stdout: "addrvec": [ 2024-09-12T22:48:35.567 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-12T22:48:35.567 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v2", 2024-09-12T22:48:35.567 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "172.21.15.99:6806", 2024-09-12T22:48:35.567 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 1159429503 2024-09-12T22:48:35.567 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.568 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-12T22:48:35.568 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v1", 2024-09-12T22:48:35.568 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "172.21.15.99:6807", 2024-09-12T22:48:35.568 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 1159429503 2024-09-12T22:48:35.568 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T22:48:35.568 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-09-12T22:48:35.568 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.568 INFO:teuthology.orchestra.run.smithi066.stdout: "heartbeat_front_addrs": { 2024-09-12T22:48:35.568 INFO:teuthology.orchestra.run.smithi066.stdout: "addrvec": [ 2024-09-12T22:48:35.568 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-12T22:48:35.569 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v2", 2024-09-12T22:48:35.569 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "172.21.15.99:6804", 2024-09-12T22:48:35.569 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 1159429503 2024-09-12T22:48:35.569 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.569 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-12T22:48:35.569 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v1", 2024-09-12T22:48:35.569 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "172.21.15.99:6805", 2024-09-12T22:48:35.569 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 1159429503 2024-09-12T22:48:35.569 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T22:48:35.569 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-09-12T22:48:35.569 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.570 INFO:teuthology.orchestra.run.smithi066.stdout: "public_addr": "172.21.15.99:6801/1159429503", 2024-09-12T22:48:35.570 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_addr": "172.21.15.99:6803/1159429503", 2024-09-12T22:48:35.570 INFO:teuthology.orchestra.run.smithi066.stdout: "heartbeat_back_addr": "172.21.15.99:6807/1159429503", 2024-09-12T22:48:35.570 INFO:teuthology.orchestra.run.smithi066.stdout: "heartbeat_front_addr": "172.21.15.99:6805/1159429503", 2024-09-12T22:48:35.570 INFO:teuthology.orchestra.run.smithi066.stdout: "state": [ 2024-09-12T22:48:35.570 INFO:teuthology.orchestra.run.smithi066.stdout: "exists", 2024-09-12T22:48:35.570 INFO:teuthology.orchestra.run.smithi066.stdout: "up" 2024-09-12T22:48:35.570 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-09-12T22:48:35.570 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.570 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-12T22:48:35.570 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": 2, 2024-09-12T22:48:35.571 INFO:teuthology.orchestra.run.smithi066.stdout: "uuid": "185ee2bd-8c37-4de1-b6ef-2988144d1470", 2024-09-12T22:48:35.571 INFO:teuthology.orchestra.run.smithi066.stdout: "up": 0, 2024-09-12T22:48:35.571 INFO:teuthology.orchestra.run.smithi066.stdout: "in": 1, 2024-09-12T22:48:35.571 INFO:teuthology.orchestra.run.smithi066.stdout: "weight": 1, 2024-09-12T22:48:35.571 INFO:teuthology.orchestra.run.smithi066.stdout: "primary_affinity": 1, 2024-09-12T22:48:35.571 INFO:teuthology.orchestra.run.smithi066.stdout: "last_clean_begin": 0, 2024-09-12T22:48:35.571 INFO:teuthology.orchestra.run.smithi066.stdout: "last_clean_end": 0, 2024-09-12T22:48:35.571 INFO:teuthology.orchestra.run.smithi066.stdout: "up_from": 8, 2024-09-12T22:48:35.571 INFO:teuthology.orchestra.run.smithi066.stdout: "up_thru": 17, 2024-09-12T22:48:35.571 INFO:teuthology.orchestra.run.smithi066.stdout: "down_at": 23, 2024-09-12T22:48:35.571 INFO:teuthology.orchestra.run.smithi066.stdout: "lost_at": 0, 2024-09-12T22:48:35.571 INFO:teuthology.orchestra.run.smithi066.stdout: "public_addrs": { 2024-09-12T22:48:35.572 INFO:teuthology.orchestra.run.smithi066.stdout: "addrvec": [ 2024-09-12T22:48:35.572 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-12T22:48:35.572 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v2", 2024-09-12T22:48:35.572 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "172.21.15.117:6800", 2024-09-12T22:48:35.572 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 2828388397 2024-09-12T22:48:35.572 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.572 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-12T22:48:35.572 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v1", 2024-09-12T22:48:35.572 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "172.21.15.117:6801", 2024-09-12T22:48:35.572 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 2828388397 2024-09-12T22:48:35.572 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T22:48:35.573 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-09-12T22:48:35.573 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.573 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_addrs": { 2024-09-12T22:48:35.573 INFO:teuthology.orchestra.run.smithi066.stdout: "addrvec": [ 2024-09-12T22:48:35.573 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-12T22:48:35.573 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v2", 2024-09-12T22:48:35.573 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "172.21.15.117:6802", 2024-09-12T22:48:35.573 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 2828388397 2024-09-12T22:48:35.573 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.573 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-12T22:48:35.573 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v1", 2024-09-12T22:48:35.574 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "172.21.15.117:6803", 2024-09-12T22:48:35.574 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 2828388397 2024-09-12T22:48:35.574 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T22:48:35.574 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-09-12T22:48:35.574 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.574 INFO:teuthology.orchestra.run.smithi066.stdout: "heartbeat_back_addrs": { 2024-09-12T22:48:35.574 INFO:teuthology.orchestra.run.smithi066.stdout: "addrvec": [ 2024-09-12T22:48:35.574 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-12T22:48:35.574 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v2", 2024-09-12T22:48:35.574 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "172.21.15.117:6806", 2024-09-12T22:48:35.574 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 2828388397 2024-09-12T22:48:35.574 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.575 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-12T22:48:35.575 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v1", 2024-09-12T22:48:35.575 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "172.21.15.117:6807", 2024-09-12T22:48:35.575 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 2828388397 2024-09-12T22:48:35.575 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T22:48:35.575 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-09-12T22:48:35.575 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.575 INFO:teuthology.orchestra.run.smithi066.stdout: "heartbeat_front_addrs": { 2024-09-12T22:48:35.576 INFO:teuthology.orchestra.run.smithi066.stdout: "addrvec": [ 2024-09-12T22:48:35.576 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-12T22:48:35.576 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v2", 2024-09-12T22:48:35.576 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "172.21.15.117:6804", 2024-09-12T22:48:35.576 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 2828388397 2024-09-12T22:48:35.576 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.576 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-12T22:48:35.576 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v1", 2024-09-12T22:48:35.576 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "172.21.15.117:6805", 2024-09-12T22:48:35.576 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 2828388397 2024-09-12T22:48:35.576 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T22:48:35.577 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-09-12T22:48:35.577 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.577 INFO:teuthology.orchestra.run.smithi066.stdout: "public_addr": "172.21.15.117:6801/2828388397", 2024-09-12T22:48:35.577 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_addr": "172.21.15.117:6803/2828388397", 2024-09-12T22:48:35.577 INFO:teuthology.orchestra.run.smithi066.stdout: "heartbeat_back_addr": "172.21.15.117:6807/2828388397", 2024-09-12T22:48:35.577 INFO:teuthology.orchestra.run.smithi066.stdout: "heartbeat_front_addr": "172.21.15.117:6805/2828388397", 2024-09-12T22:48:35.577 INFO:teuthology.orchestra.run.smithi066.stdout: "state": [ 2024-09-12T22:48:35.577 INFO:teuthology.orchestra.run.smithi066.stdout: "exists" 2024-09-12T22:48:35.577 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-09-12T22:48:35.577 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T22:48:35.578 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-12T22:48:35.578 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_xinfo": [ 2024-09-12T22:48:35.578 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-12T22:48:35.578 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": 0, 2024-09-12T22:48:35.578 INFO:teuthology.orchestra.run.smithi066.stdout: "down_stamp": "0.000000", 2024-09-12T22:48:35.578 INFO:teuthology.orchestra.run.smithi066.stdout: "laggy_probability": 0, 2024-09-12T22:48:35.578 INFO:teuthology.orchestra.run.smithi066.stdout: "laggy_interval": 0, 2024-09-12T22:48:35.578 INFO:teuthology.orchestra.run.smithi066.stdout: "features": 4540701547738038271, 2024-09-12T22:48:35.578 INFO:teuthology.orchestra.run.smithi066.stdout: "old_weight": 0, 2024-09-12T22:48:35.578 INFO:teuthology.orchestra.run.smithi066.stdout: "last_purged_snaps_scrub": "2024-09-12T22:47:51.816709+0000", 2024-09-12T22:48:35.578 INFO:teuthology.orchestra.run.smithi066.stdout: "dead_epoch": 0 2024-09-12T22:48:35.578 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.579 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-12T22:48:35.579 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": 1, 2024-09-12T22:48:35.579 INFO:teuthology.orchestra.run.smithi066.stdout: "down_stamp": "0.000000", 2024-09-12T22:48:35.579 INFO:teuthology.orchestra.run.smithi066.stdout: "laggy_probability": 0, 2024-09-12T22:48:35.579 INFO:teuthology.orchestra.run.smithi066.stdout: "laggy_interval": 0, 2024-09-12T22:48:35.579 INFO:teuthology.orchestra.run.smithi066.stdout: "features": 4540701547738038271, 2024-09-12T22:48:35.579 INFO:teuthology.orchestra.run.smithi066.stdout: "old_weight": 0, 2024-09-12T22:48:35.579 INFO:teuthology.orchestra.run.smithi066.stdout: "last_purged_snaps_scrub": "2024-09-12T22:47:51.376989+0000", 2024-09-12T22:48:35.579 INFO:teuthology.orchestra.run.smithi066.stdout: "dead_epoch": 0 2024-09-12T22:48:35.579 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.579 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-12T22:48:35.580 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": 2, 2024-09-12T22:48:35.580 INFO:teuthology.orchestra.run.smithi066.stdout: "down_stamp": "0.000000", 2024-09-12T22:48:35.580 INFO:teuthology.orchestra.run.smithi066.stdout: "laggy_probability": 0, 2024-09-12T22:48:35.580 INFO:teuthology.orchestra.run.smithi066.stdout: "laggy_interval": 0, 2024-09-12T22:48:35.580 INFO:teuthology.orchestra.run.smithi066.stdout: "features": 4540701547738038271, 2024-09-12T22:48:35.580 INFO:teuthology.orchestra.run.smithi066.stdout: "old_weight": 0, 2024-09-12T22:48:35.580 INFO:teuthology.orchestra.run.smithi066.stdout: "last_purged_snaps_scrub": "2024-09-12T22:47:51.833489+0000", 2024-09-12T22:48:35.580 INFO:teuthology.orchestra.run.smithi066.stdout: "dead_epoch": 22 2024-09-12T22:48:35.580 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T22:48:35.580 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-12T22:48:35.580 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_upmap": [], 2024-09-12T22:48:35.581 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_upmap_items": [], 2024-09-12T22:48:35.581 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_upmap_primaries": [], 2024-09-12T22:48:35.581 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_temp": [], 2024-09-12T22:48:35.581 INFO:teuthology.orchestra.run.smithi066.stdout: "primary_temp": [], 2024-09-12T22:48:35.581 INFO:teuthology.orchestra.run.smithi066.stdout: "blocklist": {}, 2024-09-12T22:48:35.581 INFO:teuthology.orchestra.run.smithi066.stdout: "range_blocklist": {}, 2024-09-12T22:48:35.581 INFO:teuthology.orchestra.run.smithi066.stdout: "erasure_code_profiles": { 2024-09-12T22:48:35.581 INFO:teuthology.orchestra.run.smithi066.stdout: "default": { 2024-09-12T22:48:35.581 INFO:teuthology.orchestra.run.smithi066.stdout: "crush-failure-domain": "osd", 2024-09-12T22:48:35.581 INFO:teuthology.orchestra.run.smithi066.stdout: "k": "2", 2024-09-12T22:48:35.581 INFO:teuthology.orchestra.run.smithi066.stdout: "m": "1", 2024-09-12T22:48:35.582 INFO:teuthology.orchestra.run.smithi066.stdout: "plugin": "jerasure", 2024-09-12T22:48:35.582 INFO:teuthology.orchestra.run.smithi066.stdout: "technique": "reed_sol_van" 2024-09-12T22:48:35.582 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T22:48:35.582 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T22:48:35.582 INFO:teuthology.orchestra.run.smithi066.stdout: "removed_snaps_queue": [], 2024-09-12T22:48:35.582 INFO:teuthology.orchestra.run.smithi066.stdout: "new_removed_snaps": [], 2024-09-12T22:48:35.582 INFO:teuthology.orchestra.run.smithi066.stdout: "new_purged_snaps": [], 2024-09-12T22:48:35.582 INFO:teuthology.orchestra.run.smithi066.stdout: "crush_node_flags": {}, 2024-09-12T22:48:35.582 INFO:teuthology.orchestra.run.smithi066.stdout: "device_class_flags": {}, 2024-09-12T22:48:35.582 INFO:teuthology.orchestra.run.smithi066.stdout: "stretch_mode": { 2024-09-12T22:48:35.582 INFO:teuthology.orchestra.run.smithi066.stdout: "stretch_mode_enabled": false, 2024-09-12T22:48:35.582 INFO:teuthology.orchestra.run.smithi066.stdout: "stretch_bucket_count": 0, 2024-09-12T22:48:35.583 INFO:teuthology.orchestra.run.smithi066.stdout: "degraded_stretch_mode": 0, 2024-09-12T22:48:35.583 INFO:teuthology.orchestra.run.smithi066.stdout: "recovering_stretch_mode": 0, 2024-09-12T22:48:35.583 INFO:teuthology.orchestra.run.smithi066.stdout: "stretch_mode_bucket": 0 2024-09-12T22:48:35.583 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T22:48:35.583 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T22:48:35.585 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:35.586 INFO:tasks.thrashosds.thrasher:j is {'epoch': 27, 'fsid': '5714c6a5-034c-4330-a57b-d22492ad8e43', 'created': '2024-09-12T22:47:43.881551+0000', 'modified': '2024-09-12T22:48:34.388571+0000', 'last_up_change': '2024-09-12T22:48:26.303379+0000', 'last_in_change': '2024-09-12T22:47:44.690260+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T22:47:54.168813+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 3.0299999713897705, 'score_stable': 3.0299999713897705, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T22:47:58.920007+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 15, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8700000047683716, 'score_stable': 1.8700000047683716, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T22:48:03.033410+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.7799999713897705, 'score_stable': 1.7799999713897705, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.190000057220459, 'raw_score_stable': 1.190000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T22:48:03.489928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '9ed48fb2-48c2-4ecb-9306-372a05b08cee', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6800', 'nonce': 1747255146}, {'type': 'v1', 'addr': '172.21.15.87:6801', 'nonce': 1747255146}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6802', 'nonce': 1747255146}, {'type': 'v1', 'addr': '172.21.15.87:6803', 'nonce': 1747255146}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6806', 'nonce': 1747255146}, {'type': 'v1', 'addr': '172.21.15.87:6807', 'nonce': 1747255146}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6804', 'nonce': 1747255146}, {'type': 'v1', 'addr': '172.21.15.87:6805', 'nonce': 1747255146}]}, 'public_addr': '172.21.15.87:6801/1747255146', 'cluster_addr': '172.21.15.87:6803/1747255146', 'heartbeat_back_addr': '172.21.15.87:6807/1747255146', 'heartbeat_front_addr': '172.21.15.87:6805/1747255146', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'af934313-a6b4-4e15-9818-6fc3fb71b949', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6800', 'nonce': 1159429503}, {'type': 'v1', 'addr': '172.21.15.99:6801', 'nonce': 1159429503}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6802', 'nonce': 1159429503}, {'type': 'v1', 'addr': '172.21.15.99:6803', 'nonce': 1159429503}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6806', 'nonce': 1159429503}, {'type': 'v1', 'addr': '172.21.15.99:6807', 'nonce': 1159429503}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6804', 'nonce': 1159429503}, {'type': 'v1', 'addr': '172.21.15.99:6805', 'nonce': 1159429503}]}, 'public_addr': '172.21.15.99:6801/1159429503', 'cluster_addr': '172.21.15.99:6803/1159429503', 'heartbeat_back_addr': '172.21.15.99:6807/1159429503', 'heartbeat_front_addr': '172.21.15.99:6805/1159429503', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '185ee2bd-8c37-4de1-b6ef-2988144d1470', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 23, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6800', 'nonce': 2828388397}, {'type': 'v1', 'addr': '172.21.15.117:6801', 'nonce': 2828388397}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6802', 'nonce': 2828388397}, {'type': 'v1', 'addr': '172.21.15.117:6803', 'nonce': 2828388397}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6806', 'nonce': 2828388397}, {'type': 'v1', 'addr': '172.21.15.117:6807', 'nonce': 2828388397}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6804', 'nonce': 2828388397}, {'type': 'v1', 'addr': '172.21.15.117:6805', 'nonce': 2828388397}]}, 'public_addr': '172.21.15.117:6801/2828388397', 'cluster_addr': '172.21.15.117:6803/2828388397', 'heartbeat_back_addr': '172.21.15.117:6807/2828388397', 'heartbeat_front_addr': '172.21.15.117:6805/2828388397', 'state': ['exists']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T22:47:51.816709+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T22:47:51.376989+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T22:47:51.833489+0000', 'dead_epoch': 22}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T22:48:35.586 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:48:35.587 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:35.583+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:35.685 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:35.684+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:35.692 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:35.692 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:35.701 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:35.786 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:35.785+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:35.844 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:35.844 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:35.853 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:35.883 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:48:35.885 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-09-12T22:48:35.887 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:35.886+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:35.894 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2024-09-12T22:48:34.397537+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597740,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":25,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":258,"num_write_kb":3485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":139,"acting":139,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":87088,"kb_used_data":1844,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283028432,"statfs":{"total":289910292480,"available":289821114368,"internally_reserved":0,"allocated":1888256,"data_stored":1438688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4500,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":25,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.265900"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T22:48:31.381317+0000","last_change":"2024-09-12T22:48:05.174190+0000","last_active":"2024-09-12T22:48:31.381317+0000","last_peered":"2024-09-12T22:48:31.381317+0000","last_clean":"2024-09-12T22:48:31.381317+0000","last_became_active":"2024-09-12T22:48:05.172964+0000","last_became_peered":"2024-09-12T22:48:05.172964+0000","last_unstale":"2024-09-12T22:48:31.381317+0000","last_undegraded":"2024-09-12T22:48:31.381317+0000","last_fullsized":"2024-09-12T22:48:31.381317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:49.868891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T22:48:31.381281+0000","last_change":"2024-09-12T22:48:05.173045+0000","last_active":"2024-09-12T22:48:31.381281+0000","last_peered":"2024-09-12T22:48:31.381281+0000","last_clean":"2024-09-12T22:48:31.381281+0000","last_became_active":"2024-09-12T22:48:05.172684+0000","last_became_peered":"2024-09-12T22:48:05.172684+0000","last_unstale":"2024-09-12T22:48:31.381281+0000","last_undegraded":"2024-09-12T22:48:31.381281+0000","last_fullsized":"2024-09-12T22:48:31.381281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:51.360504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.381250+0000","last_change":"2024-09-12T22:48:27.318904+0000","last_active":"2024-09-12T22:48:31.381250+0000","last_peered":"2024-09-12T22:48:31.381250+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"2024-09-12T22:48:27.318904+0000","last_became_peered":"2024-09-12T22:48:27.318904+0000","last_unstale":"2024-09-12T22:48:31.381250+0000","last_undegraded":"2024-09-12T22:48:31.381250+0000","last_fullsized":"2024-09-12T22:48:27.315555+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:37.456937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380521+0000","last_change":"2024-09-12T22:48:27.318836+0000","last_active":"2024-09-12T22:48:31.380521+0000","last_peered":"2024-09-12T22:48:31.380521+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"2024-09-12T22:48:27.318836+0000","last_became_peered":"2024-09-12T22:48:27.318836+0000","last_unstale":"2024-09-12T22:48:31.380521+0000","last_undegraded":"2024-09-12T22:48:31.380521+0000","last_fullsized":"2024-09-12T22:48:27.315504+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:37:23.933972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T22:48:31.381090+0000","last_change":"2024-09-12T22:48:05.170306+0000","last_active":"2024-09-12T22:48:31.381090+0000","last_peered":"2024-09-12T22:48:31.381090+0000","last_clean":"2024-09-12T22:48:31.381090+0000","last_became_active":"2024-09-12T22:48:05.169940+0000","last_became_peered":"2024-09-12T22:48:05.169940+0000","last_unstale":"2024-09-12T22:48:31.381090+0000","last_undegraded":"2024-09-12T22:48:31.381090+0000","last_fullsized":"2024-09-12T22:48:31.381090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:52.341512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380169+0000","last_change":"2024-09-12T22:48:27.317246+0000","last_active":"2024-09-12T22:48:31.380169+0000","last_peered":"2024-09-12T22:48:31.380169+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"2024-09-12T22:48:27.317246+0000","last_became_peered":"2024-09-12T22:48:27.317246+0000","last_unstale":"2024-09-12T22:48:31.380169+0000","last_undegraded":"2024-09-12T22:48:31.380169+0000","last_fullsized":"2024-09-12T22:48:27.314521+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:59.525401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380108+0000","last_change":"2024-09-12T22:48:27.316631+0000","last_active":"2024-09-12T22:48:31.380108+0000","last_peered":"2024-09-12T22:48:31.380108+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"2024-09-12T22:48:27.316631+0000","last_became_peered":"2024-09-12T22:48:27.316631+0000","last_unstale":"2024-09-12T22:48:31.380108+0000","last_undegraded":"2024-09-12T22:48:31.380108+0000","last_fullsized":"2024-09-12T22:48:27.314442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:06:31.953025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380304+0000","last_change":"2024-09-12T22:48:27.318112+0000","last_active":"2024-09-12T22:48:31.380304+0000","last_peered":"2024-09-12T22:48:31.380304+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"2024-09-12T22:48:27.318112+0000","last_became_peered":"2024-09-12T22:48:27.318112+0000","last_unstale":"2024-09-12T22:48:31.380304+0000","last_undegraded":"2024-09-12T22:48:31.380304+0000","last_fullsized":"2024-09-12T22:48:27.315405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:48.267446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T22:48:31.381242+0000","last_change":"2024-09-12T22:48:05.178445+0000","last_active":"2024-09-12T22:48:31.381242+0000","last_peered":"2024-09-12T22:48:31.381242+0000","last_clean":"2024-09-12T22:48:31.381242+0000","last_became_active":"2024-09-12T22:48:05.177284+0000","last_became_peered":"2024-09-12T22:48:05.177284+0000","last_unstale":"2024-09-12T22:48:31.381242+0000","last_undegraded":"2024-09-12T22:48:31.381242+0000","last_fullsized":"2024-09-12T22:48:31.381242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:45.140060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T22:48:31.381402+0000","last_change":"2024-09-12T22:48:05.172480+0000","last_active":"2024-09-12T22:48:31.381402+0000","last_peered":"2024-09-12T22:48:31.381402+0000","last_clean":"2024-09-12T22:48:31.381402+0000","last_became_active":"2024-09-12T22:48:05.171686+0000","last_became_peered":"2024-09-12T22:48:05.171686+0000","last_unstale":"2024-09-12T22:48:31.381402+0000","last_undegraded":"2024-09-12T22:48:31.381402+0000","last_fullsized":"2024-09-12T22:48:31.381402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:56.158813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380761+0000","last_change":"2024-09-12T22:48:27.317312+0000","last_active":"2024-09-12T22:48:31.380761+0000","last_peered":"2024-09-12T22:48:31.380761+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"2024-09-12T22:48:27.317312+0000","last_became_peered":"2024-09-12T22:48:27.317312+0000","last_unstale":"2024-09-12T22:48:31.380761+0000","last_undegraded":"2024-09-12T22:48:31.380761+0000","last_fullsized":"2024-09-12T22:48:27.314730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:52.042003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380693+0000","last_change":"2024-09-12T22:48:27.317494+0000","last_active":"2024-09-12T22:48:31.380693+0000","last_peered":"2024-09-12T22:48:31.380693+0000","last_clean":"2024-09-12T22:48:25.308630+0000","last_became_active":"2024-09-12T22:48:27.317494+0000","last_became_peered":"2024-09-12T22:48:27.317494+0000","last_unstale":"2024-09-12T22:48:31.380693+0000","last_undegraded":"2024-09-12T22:48:31.380693+0000","last_fullsized":"2024-09-12T22:48:27.315301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:34:09.259483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T22:48:31.380808+0000","last_change":"2024-09-12T22:48:05.171356+0000","last_active":"2024-09-12T22:48:31.380808+0000","last_peered":"2024-09-12T22:48:31.380808+0000","last_clean":"2024-09-12T22:48:31.380808+0000","last_became_active":"2024-09-12T22:48:05.170794+0000","last_became_peered":"2024-09-12T22:48:05.170794+0000","last_unstale":"2024-09-12T22:48:31.380808+0000","last_undegraded":"2024-09-12T22:48:31.380808+0000","last_fullsized":"2024-09-12T22:48:31.380808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:42:56.969660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380413+0000","last_change":"2024-09-12T22:48:27.317517+0000","last_active":"2024-09-12T22:48:31.380413+0000","last_peered":"2024-09-12T22:48:31.380413+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"2024-09-12T22:48:27.317517+0000","last_became_peered":"2024-09-12T22:48:27.317517+0000","last_unstale":"2024-09-12T22:48:31.380413+0000","last_undegraded":"2024-09-12T22:48:31.380413+0000","last_fullsized":"2024-09-12T22:48:27.314693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:41.586806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380345+0000","last_change":"2024-09-12T22:48:27.316721+0000","last_active":"2024-09-12T22:48:31.380345+0000","last_peered":"2024-09-12T22:48:31.380345+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"2024-09-12T22:48:27.316721+0000","last_became_peered":"2024-09-12T22:48:27.316721+0000","last_unstale":"2024-09-12T22:48:31.380345+0000","last_undegraded":"2024-09-12T22:48:31.380345+0000","last_fullsized":"2024-09-12T22:48:27.314637+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:19.398289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380299+0000","last_change":"2024-09-12T22:48:27.317339+0000","last_active":"2024-09-12T22:48:31.380299+0000","last_peered":"2024-09-12T22:48:31.380299+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"2024-09-12T22:48:27.317339+0000","last_became_peered":"2024-09-12T22:48:27.317339+0000","last_unstale":"2024-09-12T22:48:31.380299+0000","last_undegraded":"2024-09-12T22:48:31.380299+0000","last_fullsized":"2024-09-12T22:48:27.314672+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:08.534010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T22:48:31.382196+0000","last_change":"2024-09-12T22:48:05.178721+0000","last_active":"2024-09-12T22:48:31.382196+0000","last_peered":"2024-09-12T22:48:31.382196+0000","last_clean":"2024-09-12T22:48:31.382196+0000","last_became_active":"2024-09-12T22:48:05.177965+0000","last_became_peered":"2024-09-12T22:48:05.177965+0000","last_unstale":"2024-09-12T22:48:31.382196+0000","last_undegraded":"2024-09-12T22:48:31.382196+0000","last_fullsized":"2024-09-12T22:48:31.382196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:32.288419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T22:48:31.381508+0000","last_change":"2024-09-12T22:48:05.171053+0000","last_active":"2024-09-12T22:48:31.381508+0000","last_peered":"2024-09-12T22:48:31.381508+0000","last_clean":"2024-09-12T22:48:31.381508+0000","last_became_active":"2024-09-12T22:48:05.170578+0000","last_became_peered":"2024-09-12T22:48:05.170578+0000","last_unstale":"2024-09-12T22:48:31.381508+0000","last_undegraded":"2024-09-12T22:48:31.381508+0000","last_fullsized":"2024-09-12T22:48:31.381508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:58.991752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T22:48:31.381082+0000","last_change":"2024-09-12T22:48:05.177369+0000","last_active":"2024-09-12T22:48:31.381082+0000","last_peered":"2024-09-12T22:48:31.381082+0000","last_clean":"2024-09-12T22:48:31.381082+0000","last_became_active":"2024-09-12T22:48:05.176680+0000","last_became_peered":"2024-09-12T22:48:05.176680+0000","last_unstale":"2024-09-12T22:48:31.381082+0000","last_undegraded":"2024-09-12T22:48:31.381082+0000","last_fullsized":"2024-09-12T22:48:31.381082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:25.143572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380678+0000","last_change":"2024-09-12T22:48:27.319102+0000","last_active":"2024-09-12T22:48:31.380678+0000","last_peered":"2024-09-12T22:48:31.380678+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"2024-09-12T22:48:27.319102+0000","last_became_peered":"2024-09-12T22:48:27.319102+0000","last_unstale":"2024-09-12T22:48:31.380678+0000","last_undegraded":"2024-09-12T22:48:31.380678+0000","last_fullsized":"2024-09-12T22:48:27.315758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:48.902128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380857+0000","last_change":"2024-09-12T22:48:27.318914+0000","last_active":"2024-09-12T22:48:31.380857+0000","last_peered":"2024-09-12T22:48:31.380857+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"2024-09-12T22:48:27.318914+0000","last_became_peered":"2024-09-12T22:48:27.318914+0000","last_unstale":"2024-09-12T22:48:31.380857+0000","last_undegraded":"2024-09-12T22:48:31.380857+0000","last_fullsized":"2024-09-12T22:48:27.315489+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:14:09.270444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380485+0000","last_change":"2024-09-12T22:48:27.317759+0000","last_active":"2024-09-12T22:48:31.380485+0000","last_peered":"2024-09-12T22:48:31.380485+0000","last_clean":"2024-09-12T22:48:25.308424+0000","last_became_active":"2024-09-12T22:48:27.317759+0000","last_became_peered":"2024-09-12T22:48:27.317759+0000","last_unstale":"2024-09-12T22:48:31.380485+0000","last_undegraded":"2024-09-12T22:48:31.380485+0000","last_fullsized":"2024-09-12T22:48:27.314799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:15:52.274215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380109+0000","last_change":"2024-09-12T22:48:27.317253+0000","last_active":"2024-09-12T22:48:31.380109+0000","last_peered":"2024-09-12T22:48:31.380109+0000","last_clean":"2024-09-12T22:48:25.307798+0000","last_became_active":"2024-09-12T22:48:27.317253+0000","last_became_peered":"2024-09-12T22:48:27.317253+0000","last_unstale":"2024-09-12T22:48:31.380109+0000","last_undegraded":"2024-09-12T22:48:31.380109+0000","last_fullsized":"2024-09-12T22:48:27.314444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:56:34.490182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T22:48:31.380344+0000","last_change":"2024-09-12T22:48:05.172794+0000","last_active":"2024-09-12T22:48:31.380344+0000","last_peered":"2024-09-12T22:48:31.380344+0000","last_clean":"2024-09-12T22:48:31.380344+0000","last_became_active":"2024-09-12T22:48:05.172437+0000","last_became_peered":"2024-09-12T22:48:05.172437+0000","last_unstale":"2024-09-12T22:48:31.380344+0000","last_undegraded":"2024-09-12T22:48:31.380344+0000","last_fullsized":"2024-09-12T22:48:31.380344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:54:44.278646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.381364+0000","last_change":"2024-09-12T22:48:27.318780+0000","last_active":"2024-09-12T22:48:31.381364+0000","last_peered":"2024-09-12T22:48:31.381364+0000","last_clean":"2024-09-12T22:48:25.309223+0000","last_became_active":"2024-09-12T22:48:27.318780+0000","last_became_peered":"2024-09-12T22:48:27.318780+0000","last_unstale":"2024-09-12T22:48:31.381364+0000","last_undegraded":"2024-09-12T22:48:31.381364+0000","last_fullsized":"2024-09-12T22:48:27.316175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:12.247327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.381005+0000","last_change":"2024-09-12T22:48:27.318923+0000","last_active":"2024-09-12T22:48:31.381005+0000","last_peered":"2024-09-12T22:48:31.381005+0000","last_clean":"2024-09-12T22:48:25.308470+0000","last_became_active":"2024-09-12T22:48:27.318923+0000","last_became_peered":"2024-09-12T22:48:27.318923+0000","last_unstale":"2024-09-12T22:48:31.381005+0000","last_undegraded":"2024-09-12T22:48:31.381005+0000","last_fullsized":"2024-09-12T22:48:27.316373+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:45.338635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.382228+0000","last_change":"2024-09-12T22:48:27.320973+0000","last_active":"2024-09-12T22:48:31.382228+0000","last_peered":"2024-09-12T22:48:31.382228+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"2024-09-12T22:48:27.320973+0000","last_became_peered":"2024-09-12T22:48:27.320973+0000","last_unstale":"2024-09-12T22:48:31.382228+0000","last_undegraded":"2024-09-12T22:48:31.382228+0000","last_fullsized":"2024-09-12T22:48:27.318638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:17.137937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.381094+0000","last_change":"2024-09-12T22:48:27.318057+0000","last_active":"2024-09-12T22:48:31.381094+0000","last_peered":"2024-09-12T22:48:31.381094+0000","last_clean":"2024-09-12T22:48:25.308918+0000","last_became_active":"2024-09-12T22:48:27.318057+0000","last_became_peered":"2024-09-12T22:48:27.318057+0000","last_unstale":"2024-09-12T22:48:31.381094+0000","last_undegraded":"2024-09-12T22:48:31.381094+0000","last_fullsized":"2024-09-12T22:48:27.315611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:48.267446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T22:48:31.380695+0000","last_change":"2024-09-12T22:48:05.177176+0000","last_active":"2024-09-12T22:48:31.380695+0000","last_peered":"2024-09-12T22:48:31.380695+0000","last_clean":"2024-09-12T22:48:31.380695+0000","last_became_active":"2024-09-12T22:48:05.176735+0000","last_became_peered":"2024-09-12T22:48:05.176735+0000","last_unstale":"2024-09-12T22:48:31.380695+0000","last_undegraded":"2024-09-12T22:48:31.380695+0000","last_fullsized":"2024-09-12T22:48:31.380695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:51.360504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380741+0000","last_change":"2024-09-12T22:48:27.317728+0000","last_active":"2024-09-12T22:48:31.380741+0000","last_peered":"2024-09-12T22:48:31.380741+0000","last_clean":"2024-09-12T22:48:25.308669+0000","last_became_active":"2024-09-12T22:48:27.317728+0000","last_became_peered":"2024-09-12T22:48:27.317728+0000","last_unstale":"2024-09-12T22:48:31.380741+0000","last_undegraded":"2024-09-12T22:48:31.380741+0000","last_fullsized":"2024-09-12T22:48:27.315363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:16.164241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T22:48:31.380293+0000","last_change":"2024-09-12T22:48:05.176878+0000","last_active":"2024-09-12T22:48:31.380293+0000","last_peered":"2024-09-12T22:48:31.380293+0000","last_clean":"2024-09-12T22:48:31.380293+0000","last_became_active":"2024-09-12T22:48:05.176327+0000","last_became_peered":"2024-09-12T22:48:05.176327+0000","last_unstale":"2024-09-12T22:48:31.380293+0000","last_undegraded":"2024-09-12T22:48:31.380293+0000","last_fullsized":"2024-09-12T22:48:31.380293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:11.781766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380040+0000","last_change":"2024-09-12T22:48:27.316363+0000","last_active":"2024-09-12T22:48:31.380040+0000","last_peered":"2024-09-12T22:48:31.380040+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"2024-09-12T22:48:27.316363+0000","last_became_peered":"2024-09-12T22:48:27.316363+0000","last_unstale":"2024-09-12T22:48:31.380040+0000","last_undegraded":"2024-09-12T22:48:31.380040+0000","last_fullsized":"2024-09-12T22:48:27.314382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:22.753741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T22:48:31.380944+0000","last_change":"2024-09-12T22:48:05.171573+0000","last_active":"2024-09-12T22:48:31.380944+0000","last_peered":"2024-09-12T22:48:31.380944+0000","last_clean":"2024-09-12T22:48:31.380944+0000","last_became_active":"2024-09-12T22:48:05.171036+0000","last_became_peered":"2024-09-12T22:48:05.171036+0000","last_unstale":"2024-09-12T22:48:31.380944+0000","last_undegraded":"2024-09-12T22:48:31.380944+0000","last_fullsized":"2024-09-12T22:48:31.380944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:27:07.558853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":23,"reported_epoch":26,"state":"active+undersized+degraded","last_fresh":"2024-09-12T22:48:31.380389+0000","last_change":"2024-09-12T22:48:27.317447+0000","last_active":"2024-09-12T22:48:31.380389+0000","last_peered":"2024-09-12T22:48:31.380389+0000","last_clean":"2024-09-12T22:48:05.164554+0000","last_became_active":"2024-09-12T22:48:27.317447+0000","last_became_peered":"2024-09-12T22:48:27.317447+0000","last_unstale":"2024-09-12T22:48:31.380389+0000","last_undegraded":"2024-09-12T22:48:27.314833+0000","last_fullsized":"2024-09-12T22:48:27.314738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:40.585186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":2}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T22:48:31.381581+0000","last_change":"2024-09-12T22:48:05.173585+0000","last_active":"2024-09-12T22:48:31.381581+0000","last_peered":"2024-09-12T22:48:31.381581+0000","last_clean":"2024-09-12T22:48:31.381581+0000","last_became_active":"2024-09-12T22:48:05.172801+0000","last_became_peered":"2024-09-12T22:48:05.172801+0000","last_unstale":"2024-09-12T22:48:31.381581+0000","last_undegraded":"2024-09-12T22:48:31.381581+0000","last_fullsized":"2024-09-12T22:48:31.381581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:45.140060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380575+0000","last_change":"2024-09-12T22:48:27.320003+0000","last_active":"2024-09-12T22:48:31.380575+0000","last_peered":"2024-09-12T22:48:31.380575+0000","last_clean":"2024-09-12T22:48:25.308051+0000","last_became_active":"2024-09-12T22:48:27.320003+0000","last_became_peered":"2024-09-12T22:48:27.320003+0000","last_unstale":"2024-09-12T22:48:31.380575+0000","last_undegraded":"2024-09-12T22:48:31.380575+0000","last_fullsized":"2024-09-12T22:48:27.314942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:36.070293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.381525+0000","last_change":"2024-09-12T22:48:27.319981+0000","last_active":"2024-09-12T22:48:31.381525+0000","last_peered":"2024-09-12T22:48:31.381525+0000","last_clean":"2024-09-12T22:48:25.308560+0000","last_became_active":"2024-09-12T22:48:27.319981+0000","last_became_peered":"2024-09-12T22:48:27.319981+0000","last_unstale":"2024-09-12T22:48:31.381525+0000","last_undegraded":"2024-09-12T22:48:31.381525+0000","last_fullsized":"2024-09-12T22:48:27.317022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:17.137937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380545+0000","last_change":"2024-09-12T22:48:27.319588+0000","last_active":"2024-09-12T22:48:31.380545+0000","last_peered":"2024-09-12T22:48:31.380545+0000","last_clean":"2024-09-12T22:48:25.308508+0000","last_became_active":"2024-09-12T22:48:27.319588+0000","last_became_peered":"2024-09-12T22:48:27.319588+0000","last_unstale":"2024-09-12T22:48:31.380545+0000","last_undegraded":"2024-09-12T22:48:31.380545+0000","last_fullsized":"2024-09-12T22:48:27.314962+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:46:16.037391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.382148+0000","last_change":"2024-09-12T22:48:27.318230+0000","last_active":"2024-09-12T22:48:31.382148+0000","last_peered":"2024-09-12T22:48:31.382148+0000","last_clean":"2024-09-12T22:48:25.308473+0000","last_became_active":"2024-09-12T22:48:27.318230+0000","last_became_peered":"2024-09-12T22:48:27.318230+0000","last_unstale":"2024-09-12T22:48:31.382148+0000","last_undegraded":"2024-09-12T22:48:31.382148+0000","last_fullsized":"2024-09-12T22:48:27.315151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:37.802059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":23,"reported_epoch":26,"state":"active+undersized+degraded","last_fresh":"2024-09-12T22:48:31.380283+0000","last_change":"2024-09-12T22:48:27.316703+0000","last_active":"2024-09-12T22:48:31.380283+0000","last_peered":"2024-09-12T22:48:31.380283+0000","last_clean":"2024-09-12T22:48:05.163238+0000","last_became_active":"2024-09-12T22:48:27.316703+0000","last_became_peered":"2024-09-12T22:48:27.316703+0000","last_unstale":"2024-09-12T22:48:31.380283+0000","last_undegraded":"2024-09-12T22:48:27.314668+0000","last_fullsized":"2024-09-12T22:48:27.314574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:06:30.951404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":4}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":23,"reported_epoch":26,"state":"active+undersized+degraded","last_fresh":"2024-09-12T22:48:31.381035+0000","last_change":"2024-09-12T22:48:27.319104+0000","last_active":"2024-09-12T22:48:31.381035+0000","last_peered":"2024-09-12T22:48:31.381035+0000","last_clean":"2024-09-12T22:48:05.163723+0000","last_became_active":"2024-09-12T22:48:27.319104+0000","last_became_peered":"2024-09-12T22:48:27.319104+0000","last_unstale":"2024-09-12T22:48:31.381035+0000","last_undegraded":"2024-09-12T22:48:27.315989+0000","last_fullsized":"2024-09-12T22:48:27.315892+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:14.109028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380451+0000","last_change":"2024-09-12T22:48:27.316812+0000","last_active":"2024-09-12T22:48:31.380451+0000","last_peered":"2024-09-12T22:48:31.380451+0000","last_clean":"2024-09-12T22:48:25.308279+0000","last_became_active":"2024-09-12T22:48:27.316812+0000","last_became_peered":"2024-09-12T22:48:27.316812+0000","last_unstale":"2024-09-12T22:48:31.380451+0000","last_undegraded":"2024-09-12T22:48:31.380451+0000","last_fullsized":"2024-09-12T22:48:27.314722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:22.753741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":32,"reported_epoch":26,"state":"active+undersized+degraded","last_fresh":"2024-09-12T22:48:31.381627+0000","last_change":"2024-09-12T22:48:27.319521+0000","last_active":"2024-09-12T22:48:31.381627+0000","last_peered":"2024-09-12T22:48:31.381627+0000","last_clean":"2024-09-12T22:48:25.309183+0000","last_became_active":"2024-09-12T22:48:27.319521+0000","last_became_peered":"2024-09-12T22:48:27.319521+0000","last_unstale":"2024-09-12T22:48:31.381627+0000","last_undegraded":"2024-09-12T22:48:27.316257+0000","last_fullsized":"2024-09-12T22:48:27.316183+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:31.295513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T22:48:31.380382+0000","last_change":"2024-09-12T22:48:05.171143+0000","last_active":"2024-09-12T22:48:31.380382+0000","last_peered":"2024-09-12T22:48:31.380382+0000","last_clean":"2024-09-12T22:48:31.380382+0000","last_became_active":"2024-09-12T22:48:05.170374+0000","last_became_peered":"2024-09-12T22:48:05.170374+0000","last_unstale":"2024-09-12T22:48:31.380382+0000","last_undegraded":"2024-09-12T22:48:31.380382+0000","last_fullsized":"2024-09-12T22:48:31.380382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:15.887977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":23,"reported_epoch":26,"state":"active+undersized+degraded","last_fresh":"2024-09-12T22:48:31.381078+0000","last_change":"2024-09-12T22:48:27.320723+0000","last_active":"2024-09-12T22:48:31.381078+0000","last_peered":"2024-09-12T22:48:31.381078+0000","last_clean":"2024-09-12T22:48:05.165582+0000","last_became_active":"2024-09-12T22:48:27.320723+0000","last_became_peered":"2024-09-12T22:48:27.320723+0000","last_unstale":"2024-09-12T22:48:31.381078+0000","last_undegraded":"2024-09-12T22:48:27.317971+0000","last_fullsized":"2024-09-12T22:48:27.315806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:14:08.268823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380886+0000","last_change":"2024-09-12T22:48:27.320112+0000","last_active":"2024-09-12T22:48:31.380886+0000","last_peered":"2024-09-12T22:48:31.380886+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"2024-09-12T22:48:27.320112+0000","last_became_peered":"2024-09-12T22:48:27.320112+0000","last_unstale":"2024-09-12T22:48:31.380886+0000","last_undegraded":"2024-09-12T22:48:31.380886+0000","last_fullsized":"2024-09-12T22:48:27.315226+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:47.476565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380896+0000","last_change":"2024-09-12T22:48:27.319335+0000","last_active":"2024-09-12T22:48:31.380896+0000","last_peered":"2024-09-12T22:48:31.380896+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"2024-09-12T22:48:27.319335+0000","last_became_peered":"2024-09-12T22:48:27.319335+0000","last_unstale":"2024-09-12T22:48:31.380896+0000","last_undegraded":"2024-09-12T22:48:31.380896+0000","last_fullsized":"2024-09-12T22:48:27.316106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:50.030783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380761+0000","last_change":"2024-09-12T22:48:27.318321+0000","last_active":"2024-09-12T22:48:31.380761+0000","last_peered":"2024-09-12T22:48:31.380761+0000","last_clean":"2024-09-12T22:48:25.308355+0000","last_became_active":"2024-09-12T22:48:27.318321+0000","last_became_peered":"2024-09-12T22:48:27.318321+0000","last_unstale":"2024-09-12T22:48:31.380761+0000","last_undegraded":"2024-09-12T22:48:31.380761+0000","last_fullsized":"2024-09-12T22:48:27.315247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:20:51.652121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":32,"reported_epoch":26,"state":"active+undersized+degraded","last_fresh":"2024-09-12T22:48:31.381104+0000","last_change":"2024-09-12T22:48:27.319929+0000","last_active":"2024-09-12T22:48:31.381104+0000","last_peered":"2024-09-12T22:48:31.381104+0000","last_clean":"2024-09-12T22:48:25.308426+0000","last_became_active":"2024-09-12T22:48:27.319929+0000","last_became_peered":"2024-09-12T22:48:27.319929+0000","last_unstale":"2024-09-12T22:48:31.381104+0000","last_undegraded":"2024-09-12T22:48:27.315902+0000","last_fullsized":"2024-09-12T22:48:27.315759+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:05.277538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380444+0000","last_change":"2024-09-12T22:48:27.318123+0000","last_active":"2024-09-12T22:48:31.380444+0000","last_peered":"2024-09-12T22:48:31.380444+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"2024-09-12T22:48:27.318123+0000","last_became_peered":"2024-09-12T22:48:27.318123+0000","last_unstale":"2024-09-12T22:48:31.380444+0000","last_undegraded":"2024-09-12T22:48:31.380444+0000","last_fullsized":"2024-09-12T22:48:27.314924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:13.080578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380262+0000","last_change":"2024-09-12T22:48:27.317677+0000","last_active":"2024-09-12T22:48:31.380262+0000","last_peered":"2024-09-12T22:48:31.380262+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"2024-09-12T22:48:27.317677+0000","last_became_peered":"2024-09-12T22:48:27.317677+0000","last_unstale":"2024-09-12T22:48:31.380262+0000","last_undegraded":"2024-09-12T22:48:31.380262+0000","last_fullsized":"2024-09-12T22:48:27.314592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:01:55.466811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.381668+0000","last_change":"2024-09-12T22:48:27.320462+0000","last_active":"2024-09-12T22:48:31.381668+0000","last_peered":"2024-09-12T22:48:31.381668+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"2024-09-12T22:48:27.320462+0000","last_became_peered":"2024-09-12T22:48:27.320462+0000","last_unstale":"2024-09-12T22:48:31.381668+0000","last_undegraded":"2024-09-12T22:48:31.381668+0000","last_fullsized":"2024-09-12T22:48:27.316765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:58.535712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380658+0000","last_change":"2024-09-12T22:48:27.318466+0000","last_active":"2024-09-12T22:48:31.380658+0000","last_peered":"2024-09-12T22:48:31.380658+0000","last_clean":"2024-09-12T22:48:25.308612+0000","last_became_active":"2024-09-12T22:48:27.318466+0000","last_became_peered":"2024-09-12T22:48:27.318466+0000","last_unstale":"2024-09-12T22:48:31.380658+0000","last_undegraded":"2024-09-12T22:48:31.380658+0000","last_fullsized":"2024-09-12T22:48:27.315054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:20:50.650500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.381244+0000","last_change":"2024-09-12T22:48:27.317667+0000","last_active":"2024-09-12T22:48:31.381244+0000","last_peered":"2024-09-12T22:48:31.381244+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"2024-09-12T22:48:27.317667+0000","last_became_peered":"2024-09-12T22:48:27.317667+0000","last_unstale":"2024-09-12T22:48:31.381244+0000","last_undegraded":"2024-09-12T22:48:31.381244+0000","last_fullsized":"2024-09-12T22:48:27.315710+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:52.042003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T22:48:31.380495+0000","last_change":"2024-09-12T22:48:04.174281+0000","last_active":"2024-09-12T22:48:31.380495+0000","last_peered":"2024-09-12T22:48:31.380495+0000","last_clean":"2024-09-12T22:48:31.380495+0000","last_became_active":"2024-09-12T22:48:04.173942+0000","last_became_peered":"2024-09-12T22:48:04.173942+0000","last_unstale":"2024-09-12T22:48:31.380495+0000","last_undegraded":"2024-09-12T22:48:31.380495+0000","last_fullsized":"2024-09-12T22:48:31.380495+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:19:38.546747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T22:48:31.381346+0000","last_change":"2024-09-12T22:48:05.178246+0000","last_active":"2024-09-12T22:48:31.381346+0000","last_peered":"2024-09-12T22:48:31.381346+0000","last_clean":"2024-09-12T22:48:31.381346+0000","last_became_active":"2024-09-12T22:48:05.176813+0000","last_became_peered":"2024-09-12T22:48:05.176813+0000","last_unstale":"2024-09-12T22:48:31.381346+0000","last_undegraded":"2024-09-12T22:48:31.381346+0000","last_fullsized":"2024-09-12T22:48:31.381346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:58.991752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":214,"reported_epoch":26,"state":"active+undersized+degraded","last_fresh":"2024-09-12T22:48:31.381254+0000","last_change":"2024-09-12T22:48:27.318105+0000","last_active":"2024-09-12T22:48:31.381254+0000","last_peered":"2024-09-12T22:48:31.381254+0000","last_clean":"2024-09-12T22:47:56.894172+0000","last_became_active":"2024-09-12T22:48:27.318105+0000","last_became_peered":"2024-09-12T22:48:27.318105+0000","last_unstale":"2024-09-12T22:48:31.381254+0000","last_undegraded":"2024-09-12T22:48:27.315375+0000","last_fullsized":"2024-09-12T22:48:27.315292+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:55.016634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:55.016634+0000","last_clean_scrub_stamp":"2024-09-12T22:47:55.016634+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:01:47.333531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":17,"reported_epoch":26,"state":"active+undersized+degraded","last_fresh":"2024-09-12T22:48:31.381290+0000","last_change":"2024-09-12T22:48:27.319214+0000","last_active":"2024-09-12T22:48:31.381290+0000","last_peered":"2024-09-12T22:48:31.381290+0000","last_clean":"2024-09-12T22:47:59.028872+0000","last_became_active":"2024-09-12T22:48:27.319214+0000","last_became_peered":"2024-09-12T22:48:27.319214+0000","last_unstale":"2024-09-12T22:48:31.381290+0000","last_undegraded":"2024-09-12T22:48:27.316123+0000","last_fullsized":"2024-09-12T22:48:27.316052+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:09.987985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T22:48:31.381052+0000","last_change":"2024-09-12T22:48:04.169704+0000","last_active":"2024-09-12T22:48:31.381052+0000","last_peered":"2024-09-12T22:48:31.381052+0000","last_clean":"2024-09-12T22:48:31.381052+0000","last_became_active":"2024-09-12T22:48:04.169474+0000","last_became_peered":"2024-09-12T22:48:04.169474+0000","last_unstale":"2024-09-12T22:48:31.381052+0000","last_undegraded":"2024-09-12T22:48:31.381052+0000","last_fullsized":"2024-09-12T22:48:31.381052+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:00.271198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380845+0000","last_change":"2024-09-12T22:48:27.319464+0000","last_active":"2024-09-12T22:48:31.380845+0000","last_peered":"2024-09-12T22:48:31.380845+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"2024-09-12T22:48:27.319464+0000","last_became_peered":"2024-09-12T22:48:27.319464+0000","last_unstale":"2024-09-12T22:48:31.380845+0000","last_undegraded":"2024-09-12T22:48:31.380845+0000","last_fullsized":"2024-09-12T22:48:27.315748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:57.964683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380821+0000","last_change":"2024-09-12T22:48:27.317885+0000","last_active":"2024-09-12T22:48:31.380821+0000","last_peered":"2024-09-12T22:48:31.380821+0000","last_clean":"2024-09-12T22:47:59.028872+0000","last_became_active":"2024-09-12T22:48:27.317885+0000","last_became_peered":"2024-09-12T22:48:27.317885+0000","last_unstale":"2024-09-12T22:48:31.380821+0000","last_undegraded":"2024-09-12T22:48:31.380821+0000","last_fullsized":"2024-09-12T22:48:27.315045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:57:54.522180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380610+0000","last_change":"2024-09-12T22:48:27.318840+0000","last_active":"2024-09-12T22:48:31.380610+0000","last_peered":"2024-09-12T22:48:31.380610+0000","last_clean":"2024-09-12T22:48:25.308177+0000","last_became_active":"2024-09-12T22:48:27.318840+0000","last_became_peered":"2024-09-12T22:48:27.318840+0000","last_unstale":"2024-09-12T22:48:31.380610+0000","last_undegraded":"2024-09-12T22:48:31.380610+0000","last_fullsized":"2024-09-12T22:48:27.316050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:36.455316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T22:48:31.381449+0000","last_change":"2024-09-12T22:48:05.171819+0000","last_active":"2024-09-12T22:48:31.381449+0000","last_peered":"2024-09-12T22:48:31.381449+0000","last_clean":"2024-09-12T22:48:31.381449+0000","last_became_active":"2024-09-12T22:48:05.171293+0000","last_became_peered":"2024-09-12T22:48:05.171293+0000","last_unstale":"2024-09-12T22:48:31.381449+0000","last_undegraded":"2024-09-12T22:48:31.381449+0000","last_fullsized":"2024-09-12T22:48:31.381449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:01.401542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T22:48:31.380672+0000","last_change":"2024-09-12T22:48:02.045209+0000","last_active":"2024-09-12T22:48:31.380672+0000","last_peered":"2024-09-12T22:48:31.380672+0000","last_clean":"2024-09-12T22:48:31.380672+0000","last_became_active":"2024-09-12T22:48:00.042007+0000","last_became_peered":"2024-09-12T22:48:00.042007+0000","last_unstale":"2024-09-12T22:48:31.380672+0000","last_undegraded":"2024-09-12T22:48:31.380672+0000","last_fullsized":"2024-09-12T22:48:31.380672+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:13.536542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036893100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380856+0000","last_change":"2024-09-12T22:48:27.317669+0000","last_active":"2024-09-12T22:48:31.380856+0000","last_peered":"2024-09-12T22:48:31.380856+0000","last_clean":"2024-09-12T22:48:25.308423+0000","last_became_active":"2024-09-12T22:48:27.317669+0000","last_became_peered":"2024-09-12T22:48:27.317669+0000","last_unstale":"2024-09-12T22:48:31.380856+0000","last_undegraded":"2024-09-12T22:48:31.380856+0000","last_fullsized":"2024-09-12T22:48:27.314990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:36.800438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T22:48:31.381449+0000","last_change":"2024-09-12T22:48:05.178865+0000","last_active":"2024-09-12T22:48:31.381449+0000","last_peered":"2024-09-12T22:48:31.381449+0000","last_clean":"2024-09-12T22:48:31.381449+0000","last_became_active":"2024-09-12T22:48:05.178010+0000","last_became_peered":"2024-09-12T22:48:05.178010+0000","last_unstale":"2024-09-12T22:48:31.381449+0000","last_undegraded":"2024-09-12T22:48:31.381449+0000","last_fullsized":"2024-09-12T22:48:31.381449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:30.120804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":31,"reported_epoch":26,"state":"active+undersized+degraded","last_fresh":"2024-09-12T22:48:31.381145+0000","last_change":"2024-09-12T22:48:27.320716+0000","last_active":"2024-09-12T22:48:31.381145+0000","last_peered":"2024-09-12T22:48:31.381145+0000","last_clean":"2024-09-12T22:48:02.045684+0000","last_became_active":"2024-09-12T22:48:27.320716+0000","last_became_peered":"2024-09-12T22:48:27.320716+0000","last_unstale":"2024-09-12T22:48:31.381145+0000","last_undegraded":"2024-09-12T22:48:27.315484+0000","last_fullsized":"2024-09-12T22:48:27.315374+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:00.912815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052714799999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380607+0000","last_change":"2024-09-12T22:48:27.318909+0000","last_active":"2024-09-12T22:48:31.380607+0000","last_peered":"2024-09-12T22:48:31.380607+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"2024-09-12T22:48:27.318909+0000","last_became_peered":"2024-09-12T22:48:27.318909+0000","last_unstale":"2024-09-12T22:48:31.380607+0000","last_undegraded":"2024-09-12T22:48:31.380607+0000","last_fullsized":"2024-09-12T22:48:27.315089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:31.295513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T22:48:31.381192+0000","last_change":"2024-09-12T22:48:05.177561+0000","last_active":"2024-09-12T22:48:31.381192+0000","last_peered":"2024-09-12T22:48:31.381192+0000","last_clean":"2024-09-12T22:48:31.381192+0000","last_became_active":"2024-09-12T22:48:05.177164+0000","last_became_peered":"2024-09-12T22:48:05.177164+0000","last_unstale":"2024-09-12T22:48:31.381192+0000","last_undegraded":"2024-09-12T22:48:31.381192+0000","last_fullsized":"2024-09-12T22:48:31.381192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:24.124647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380916+0000","last_change":"2024-09-12T22:48:27.318041+0000","last_active":"2024-09-12T22:48:31.380916+0000","last_peered":"2024-09-12T22:48:31.380916+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"2024-09-12T22:48:27.318041+0000","last_became_peered":"2024-09-12T22:48:27.318041+0000","last_unstale":"2024-09-12T22:48:31.380916+0000","last_undegraded":"2024-09-12T22:48:31.380916+0000","last_fullsized":"2024-09-12T22:48:27.315221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:15.162620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T22:48:31.381483+0000","last_change":"2024-09-12T22:48:02.045324+0000","last_active":"2024-09-12T22:48:31.381483+0000","last_peered":"2024-09-12T22:48:31.381483+0000","last_clean":"2024-09-12T22:48:31.381483+0000","last_became_active":"2024-09-12T22:48:00.042132+0000","last_became_peered":"2024-09-12T22:48:00.042132+0000","last_unstale":"2024-09-12T22:48:31.381483+0000","last_undegraded":"2024-09-12T22:48:31.381483+0000","last_fullsized":"2024-09-12T22:48:31.381483+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:24.673019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047590600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380607+0000","last_change":"2024-09-12T22:48:27.317529+0000","last_active":"2024-09-12T22:48:31.380607+0000","last_peered":"2024-09-12T22:48:31.380607+0000","last_clean":"2024-09-12T22:48:25.308443+0000","last_became_active":"2024-09-12T22:48:27.317529+0000","last_became_peered":"2024-09-12T22:48:27.317529+0000","last_unstale":"2024-09-12T22:48:31.380607+0000","last_undegraded":"2024-09-12T22:48:31.380607+0000","last_fullsized":"2024-09-12T22:48:27.315057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:19:44.860148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T22:48:31.381416+0000","last_change":"2024-09-12T22:48:04.169109+0000","last_active":"2024-09-12T22:48:31.381416+0000","last_peered":"2024-09-12T22:48:31.381416+0000","last_clean":"2024-09-12T22:48:31.381416+0000","last_became_active":"2024-09-12T22:48:04.168655+0000","last_became_peered":"2024-09-12T22:48:04.168655+0000","last_unstale":"2024-09-12T22:48:31.381416+0000","last_undegraded":"2024-09-12T22:48:31.381416+0000","last_fullsized":"2024-09-12T22:48:31.381416+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:02.879935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T22:48:31.382311+0000","last_change":"2024-09-12T22:48:02.045390+0000","last_active":"2024-09-12T22:48:31.382311+0000","last_peered":"2024-09-12T22:48:31.382311+0000","last_clean":"2024-09-12T22:48:31.382311+0000","last_became_active":"2024-09-12T22:48:00.045356+0000","last_became_peered":"2024-09-12T22:48:00.045356+0000","last_unstale":"2024-09-12T22:48:31.382311+0000","last_undegraded":"2024-09-12T22:48:31.382311+0000","last_fullsized":"2024-09-12T22:48:31.382311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:32.072080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040621599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380911+0000","last_change":"2024-09-12T22:48:27.316994+0000","last_active":"2024-09-12T22:48:31.380911+0000","last_peered":"2024-09-12T22:48:31.380911+0000","last_clean":"2024-09-12T22:48:25.308553+0000","last_became_active":"2024-09-12T22:48:27.316994+0000","last_became_peered":"2024-09-12T22:48:27.316994+0000","last_unstale":"2024-09-12T22:48:31.380911+0000","last_undegraded":"2024-09-12T22:48:31.380911+0000","last_fullsized":"2024-09-12T22:48:27.315254+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:15:04.354238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T22:48:31.382253+0000","last_change":"2024-09-12T22:48:04.168635+0000","last_active":"2024-09-12T22:48:31.382253+0000","last_peered":"2024-09-12T22:48:31.382253+0000","last_clean":"2024-09-12T22:48:31.382253+0000","last_became_active":"2024-09-12T22:48:04.168244+0000","last_became_peered":"2024-09-12T22:48:04.168244+0000","last_unstale":"2024-09-12T22:48:31.382253+0000","last_undegraded":"2024-09-12T22:48:31.382253+0000","last_fullsized":"2024-09-12T22:48:31.382253+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:56.929490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T22:48:31.381747+0000","last_change":"2024-09-12T22:48:02.045428+0000","last_active":"2024-09-12T22:48:31.381747+0000","last_peered":"2024-09-12T22:48:31.381747+0000","last_clean":"2024-09-12T22:48:31.381747+0000","last_became_active":"2024-09-12T22:48:00.040536+0000","last_became_peered":"2024-09-12T22:48:00.040536+0000","last_unstale":"2024-09-12T22:48:31.381747+0000","last_undegraded":"2024-09-12T22:48:31.381747+0000","last_fullsized":"2024-09-12T22:48:31.381747+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:33.150497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057699499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380776+0000","last_change":"2024-09-12T22:48:27.318971+0000","last_active":"2024-09-12T22:48:31.380776+0000","last_peered":"2024-09-12T22:48:31.380776+0000","last_clean":"2024-09-12T22:48:25.307906+0000","last_became_active":"2024-09-12T22:48:27.318971+0000","last_became_peered":"2024-09-12T22:48:27.318971+0000","last_unstale":"2024-09-12T22:48:31.380776+0000","last_undegraded":"2024-09-12T22:48:31.380776+0000","last_fullsized":"2024-09-12T22:48:27.315607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:57:59.644844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"25'3","reported_seq":33,"reported_epoch":26,"state":"active+undersized+degraded","last_fresh":"2024-09-12T22:48:31.381568+0000","last_change":"2024-09-12T22:48:27.320647+0000","last_active":"2024-09-12T22:48:31.381568+0000","last_peered":"2024-09-12T22:48:31.381568+0000","last_clean":"2024-09-12T22:48:25.308621+0000","last_became_active":"2024-09-12T22:48:27.320647+0000","last_became_peered":"2024-09-12T22:48:27.320647+0000","last_unstale":"2024-09-12T22:48:31.381568+0000","last_undegraded":"2024-09-12T22:48:27.317198+0000","last_fullsized":"2024-09-12T22:48:27.317137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:23.960781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.382139+0000","last_change":"2024-09-12T22:48:27.319942+0000","last_active":"2024-09-12T22:48:31.382139+0000","last_peered":"2024-09-12T22:48:31.382139+0000","last_clean":"2024-09-12T22:47:59.028872+0000","last_became_active":"2024-09-12T22:48:27.319942+0000","last_became_peered":"2024-09-12T22:48:27.319942+0000","last_unstale":"2024-09-12T22:48:31.382139+0000","last_undegraded":"2024-09-12T22:48:31.382139+0000","last_fullsized":"2024-09-12T22:48:27.316586+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:40.215971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380488+0000","last_change":"2024-09-12T22:48:27.317581+0000","last_active":"2024-09-12T22:48:31.380488+0000","last_peered":"2024-09-12T22:48:31.380488+0000","last_clean":"2024-09-12T22:48:25.308398+0000","last_became_active":"2024-09-12T22:48:27.317581+0000","last_became_peered":"2024-09-12T22:48:27.317581+0000","last_unstale":"2024-09-12T22:48:31.380488+0000","last_undegraded":"2024-09-12T22:48:31.380488+0000","last_fullsized":"2024-09-12T22:48:27.314779+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:56:34.490182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380631+0000","last_change":"2024-09-12T22:48:27.316730+0000","last_active":"2024-09-12T22:48:31.380631+0000","last_peered":"2024-09-12T22:48:31.380631+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"2024-09-12T22:48:27.316730+0000","last_became_peered":"2024-09-12T22:48:27.316730+0000","last_unstale":"2024-09-12T22:48:31.380631+0000","last_undegraded":"2024-09-12T22:48:31.380631+0000","last_fullsized":"2024-09-12T22:48:27.315014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:59.525401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"26'10","reported_seq":38,"reported_epoch":26,"state":"active+undersized+degraded","last_fresh":"2024-09-12T22:48:31.381027+0000","last_change":"2024-09-12T22:48:27.316855+0000","last_active":"2024-09-12T22:48:31.381027+0000","last_peered":"2024-09-12T22:48:31.381027+0000","last_clean":"2024-09-12T22:48:23.690764+0000","last_became_active":"2024-09-12T22:48:27.316855+0000","last_became_peered":"2024-09-12T22:48:27.316855+0000","last_unstale":"2024-09-12T22:48:31.381027+0000","last_undegraded":"2024-09-12T22:48:27.315099+0000","last_fullsized":"2024-09-12T22:48:27.315024+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:07.532389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6555,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":4}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T22:48:31.380478+0000","last_change":"2024-09-12T22:48:05.176779+0000","last_active":"2024-09-12T22:48:31.380478+0000","last_peered":"2024-09-12T22:48:31.380478+0000","last_clean":"2024-09-12T22:48:31.380478+0000","last_became_active":"2024-09-12T22:48:05.176344+0000","last_became_peered":"2024-09-12T22:48:05.176344+0000","last_unstale":"2024-09-12T22:48:31.380478+0000","last_undegraded":"2024-09-12T22:48:31.380478+0000","last_fullsized":"2024-09-12T22:48:31.380478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:35.645286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":33,"reported_epoch":26,"state":"active+undersized+degraded","last_fresh":"2024-09-12T22:48:31.382174+0000","last_change":"2024-09-12T22:48:27.320813+0000","last_active":"2024-09-12T22:48:31.382174+0000","last_peered":"2024-09-12T22:48:31.382174+0000","last_clean":"2024-09-12T22:48:25.309261+0000","last_became_active":"2024-09-12T22:48:27.320813+0000","last_became_peered":"2024-09-12T22:48:27.320813+0000","last_unstale":"2024-09-12T22:48:31.382174+0000","last_undegraded":"2024-09-12T22:48:27.318417+0000","last_fullsized":"2024-09-12T22:48:27.317028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:05.277538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.381040+0000","last_change":"2024-09-12T22:48:27.318250+0000","last_active":"2024-09-12T22:48:31.381040+0000","last_peered":"2024-09-12T22:48:31.381040+0000","last_clean":"2024-09-12T22:48:03.149914+0000","last_became_active":"2024-09-12T22:48:27.318250+0000","last_became_peered":"2024-09-12T22:48:27.318250+0000","last_unstale":"2024-09-12T22:48:31.381040+0000","last_undegraded":"2024-09-12T22:48:31.381040+0000","last_fullsized":"2024-09-12T22:48:27.315851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:34:08.257862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380321+0000","last_change":"2024-09-12T22:48:27.318837+0000","last_active":"2024-09-12T22:48:31.380321+0000","last_peered":"2024-09-12T22:48:31.380321+0000","last_clean":"2024-09-12T22:48:25.308080+0000","last_became_active":"2024-09-12T22:48:27.318837+0000","last_became_peered":"2024-09-12T22:48:27.318837+0000","last_unstale":"2024-09-12T22:48:31.380321+0000","last_undegraded":"2024-09-12T22:48:31.380321+0000","last_fullsized":"2024-09-12T22:48:27.314844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:15:52.274215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.381751+0000","last_change":"2024-09-12T22:48:27.318914+0000","last_active":"2024-09-12T22:48:31.381751+0000","last_peered":"2024-09-12T22:48:31.381751+0000","last_clean":"2024-09-12T22:48:25.308707+0000","last_became_active":"2024-09-12T22:48:27.318914+0000","last_became_peered":"2024-09-12T22:48:27.318914+0000","last_unstale":"2024-09-12T22:48:31.381751+0000","last_undegraded":"2024-09-12T22:48:31.381751+0000","last_fullsized":"2024-09-12T22:48:27.315659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:46:16.037391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T22:48:31.380651+0000","last_change":"2024-09-12T22:48:05.169648+0000","last_active":"2024-09-12T22:48:31.380651+0000","last_peered":"2024-09-12T22:48:31.380651+0000","last_clean":"2024-09-12T22:48:31.380651+0000","last_became_active":"2024-09-12T22:48:05.168356+0000","last_became_peered":"2024-09-12T22:48:05.168356+0000","last_unstale":"2024-09-12T22:48:31.380651+0000","last_undegraded":"2024-09-12T22:48:31.380651+0000","last_fullsized":"2024-09-12T22:48:31.380651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:52.341512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.381418+0000","last_change":"2024-09-12T22:48:27.319503+0000","last_active":"2024-09-12T22:48:31.381418+0000","last_peered":"2024-09-12T22:48:31.381418+0000","last_clean":"2024-09-12T22:48:25.309211+0000","last_became_active":"2024-09-12T22:48:27.319503+0000","last_became_peered":"2024-09-12T22:48:27.319503+0000","last_unstale":"2024-09-12T22:48:31.381418+0000","last_undegraded":"2024-09-12T22:48:31.381418+0000","last_fullsized":"2024-09-12T22:48:27.316214+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:48.902128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T22:48:31.380823+0000","last_change":"2024-09-12T22:48:04.169111+0000","last_active":"2024-09-12T22:48:31.380823+0000","last_peered":"2024-09-12T22:48:31.380823+0000","last_clean":"2024-09-12T22:48:31.380823+0000","last_became_active":"2024-09-12T22:48:04.168743+0000","last_became_peered":"2024-09-12T22:48:04.168743+0000","last_unstale":"2024-09-12T22:48:31.380823+0000","last_undegraded":"2024-09-12T22:48:31.380823+0000","last_fullsized":"2024-09-12T22:48:31.380823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:43.709660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.381223+0000","last_change":"2024-09-12T22:48:27.319250+0000","last_active":"2024-09-12T22:48:31.381223+0000","last_peered":"2024-09-12T22:48:31.381223+0000","last_clean":"2024-09-12T22:48:25.308504+0000","last_became_active":"2024-09-12T22:48:27.319250+0000","last_became_peered":"2024-09-12T22:48:27.319250+0000","last_unstale":"2024-09-12T22:48:31.381223+0000","last_undegraded":"2024-09-12T22:48:31.381223+0000","last_fullsized":"2024-09-12T22:48:27.316460+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:12.247327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380455+0000","last_change":"2024-09-12T22:48:27.319353+0000","last_active":"2024-09-12T22:48:31.380455+0000","last_peered":"2024-09-12T22:48:31.380455+0000","last_clean":"2024-09-12T22:48:25.308072+0000","last_became_active":"2024-09-12T22:48:27.319353+0000","last_became_peered":"2024-09-12T22:48:27.319353+0000","last_unstale":"2024-09-12T22:48:31.380455+0000","last_undegraded":"2024-09-12T22:48:31.380455+0000","last_fullsized":"2024-09-12T22:48:27.315821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:57.534091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.381307+0000","last_change":"2024-09-12T22:48:27.319600+0000","last_active":"2024-09-12T22:48:31.381307+0000","last_peered":"2024-09-12T22:48:31.381307+0000","last_clean":"2024-09-12T22:48:25.309145+0000","last_became_active":"2024-09-12T22:48:27.319600+0000","last_became_peered":"2024-09-12T22:48:27.319600+0000","last_unstale":"2024-09-12T22:48:31.381307+0000","last_undegraded":"2024-09-12T22:48:31.381307+0000","last_fullsized":"2024-09-12T22:48:27.316011+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:37:23.933972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T22:48:31.380903+0000","last_change":"2024-09-12T22:48:04.174205+0000","last_active":"2024-09-12T22:48:31.380903+0000","last_peered":"2024-09-12T22:48:31.380903+0000","last_clean":"2024-09-12T22:48:31.380903+0000","last_became_active":"2024-09-12T22:48:04.173902+0000","last_became_peered":"2024-09-12T22:48:04.173902+0000","last_unstale":"2024-09-12T22:48:31.380903+0000","last_undegraded":"2024-09-12T22:48:31.380903+0000","last_fullsized":"2024-09-12T22:48:31.380903+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:43:39.709214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T22:48:31.380846+0000","last_change":"2024-09-12T22:48:05.172917+0000","last_active":"2024-09-12T22:48:31.380846+0000","last_peered":"2024-09-12T22:48:31.380846+0000","last_clean":"2024-09-12T22:48:31.380846+0000","last_became_active":"2024-09-12T22:48:05.172493+0000","last_became_peered":"2024-09-12T22:48:05.172493+0000","last_unstale":"2024-09-12T22:48:31.380846+0000","last_undegraded":"2024-09-12T22:48:31.380846+0000","last_fullsized":"2024-09-12T22:48:31.380846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:35.645286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":31,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.381122+0000","last_change":"2024-09-12T22:48:27.317606+0000","last_active":"2024-09-12T22:48:31.381122+0000","last_peered":"2024-09-12T22:48:31.381122+0000","last_clean":"2024-09-12T22:48:25.308730+0000","last_became_active":"2024-09-12T22:48:27.317606+0000","last_became_peered":"2024-09-12T22:48:27.317606+0000","last_unstale":"2024-09-12T22:48:31.381122+0000","last_undegraded":"2024-09-12T22:48:31.381122+0000","last_fullsized":"2024-09-12T22:48:27.315648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:12.078957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380371+0000","last_change":"2024-09-12T22:48:27.317451+0000","last_active":"2024-09-12T22:48:31.380371+0000","last_peered":"2024-09-12T22:48:31.380371+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"2024-09-12T22:48:27.317451+0000","last_became_peered":"2024-09-12T22:48:27.317451+0000","last_unstale":"2024-09-12T22:48:31.380371+0000","last_undegraded":"2024-09-12T22:48:31.380371+0000","last_fullsized":"2024-09-12T22:48:27.314839+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:19:44.860148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":23,"reported_epoch":26,"state":"active+undersized+degraded","last_fresh":"2024-09-12T22:48:31.381210+0000","last_change":"2024-09-12T22:48:27.320663+0000","last_active":"2024-09-12T22:48:31.381210+0000","last_peered":"2024-09-12T22:48:31.381210+0000","last_clean":"2024-09-12T22:48:05.163662+0000","last_became_active":"2024-09-12T22:48:27.320663+0000","last_became_peered":"2024-09-12T22:48:27.320663+0000","last_unstale":"2024-09-12T22:48:31.381210+0000","last_undegraded":"2024-09-12T22:48:27.316247+0000","last_fullsized":"2024-09-12T22:48:27.316168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:00.651383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380551+0000","last_change":"2024-09-12T22:48:27.317974+0000","last_active":"2024-09-12T22:48:31.380551+0000","last_peered":"2024-09-12T22:48:31.380551+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"2024-09-12T22:48:27.317974+0000","last_became_peered":"2024-09-12T22:48:27.317974+0000","last_unstale":"2024-09-12T22:48:31.380551+0000","last_undegraded":"2024-09-12T22:48:31.380551+0000","last_fullsized":"2024-09-12T22:48:27.314950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:15:04.354238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":32,"reported_epoch":26,"state":"active+undersized+degraded","last_fresh":"2024-09-12T22:48:31.381553+0000","last_change":"2024-09-12T22:48:27.319936+0000","last_active":"2024-09-12T22:48:31.381553+0000","last_peered":"2024-09-12T22:48:31.381553+0000","last_clean":"2024-09-12T22:48:25.309161+0000","last_became_active":"2024-09-12T22:48:27.319936+0000","last_became_peered":"2024-09-12T22:48:27.319936+0000","last_unstale":"2024-09-12T22:48:31.381553+0000","last_undegraded":"2024-09-12T22:48:27.316565+0000","last_fullsized":"2024-09-12T22:48:27.316494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:50.030783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T22:48:31.380789+0000","last_change":"2024-09-12T22:48:05.171815+0000","last_active":"2024-09-12T22:48:31.380789+0000","last_peered":"2024-09-12T22:48:31.380789+0000","last_clean":"2024-09-12T22:48:31.380789+0000","last_became_active":"2024-09-12T22:48:05.171361+0000","last_became_peered":"2024-09-12T22:48:05.171361+0000","last_unstale":"2024-09-12T22:48:31.380789+0000","last_undegraded":"2024-09-12T22:48:31.380789+0000","last_fullsized":"2024-09-12T22:48:31.380789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:28.873036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T22:48:31.381456+0000","last_change":"2024-09-12T22:48:04.169500+0000","last_active":"2024-09-12T22:48:31.381456+0000","last_peered":"2024-09-12T22:48:31.381456+0000","last_clean":"2024-09-12T22:48:31.381456+0000","last_became_active":"2024-09-12T22:48:04.169087+0000","last_became_peered":"2024-09-12T22:48:04.169087+0000","last_unstale":"2024-09-12T22:48:31.381456+0000","last_undegraded":"2024-09-12T22:48:31.381456+0000","last_fullsized":"2024-09-12T22:48:31.381456+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:56.377664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+undersized","last_fresh":"2024-09-12T22:48:31.380040+0000","last_change":"2024-09-12T22:48:27.316274+0000","last_active":"2024-09-12T22:48:31.380040+0000","last_peered":"2024-09-12T22:48:31.380040+0000","last_clean":"2024-09-12T22:48:04.151535+0000","last_became_active":"2024-09-12T22:48:27.316274+0000","last_became_peered":"2024-09-12T22:48:27.316274+0000","last_unstale":"2024-09-12T22:48:31.380040+0000","last_undegraded":"2024-09-12T22:48:31.380040+0000","last_fullsized":"2024-09-12T22:48:27.314382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:19.398289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":34,"reported_epoch":26,"state":"active+undersized+degraded","last_fresh":"2024-09-12T22:48:31.381568+0000","last_change":"2024-09-12T22:48:27.319304+0000","last_active":"2024-09-12T22:48:31.381568+0000","last_peered":"2024-09-12T22:48:31.381568+0000","last_clean":"2024-09-12T22:48:25.308664+0000","last_became_active":"2024-09-12T22:48:27.319304+0000","last_became_peered":"2024-09-12T22:48:27.319304+0000","last_unstale":"2024-09-12T22:48:31.381568+0000","last_undegraded":"2024-09-12T22:48:27.315537+0000","last_fullsized":"2024-09-12T22:48:27.315441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:56.963062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":2}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":87,"acting":87,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7353,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":21,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":10206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":39,"acting":39,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":1,"acting":1,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738378,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":811008,"data_stored":660726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738378,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":90746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738380,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":843776,"data_stored":687216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:48:35.899 INFO:tasks.thrashosds.thrasher:Setting 3.1e to [0, 2] 2024-09-12T22:48:35.899 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.1e', '0', '2'] 2024-09-12T22:48:35.899 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.1e 0 2 2024-09-12T22:48:35.955 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:35.956 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:35.964 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:35.988 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:35.987+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:36.070 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:36.070 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:36.079 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:36.089 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:36.088+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:36.181 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:36.181 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:36.190 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:36.191 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:36.189+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:36.291 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:36.290+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:36.293 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:36.293 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:36.302 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:36.392 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:36.391+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:36.400 INFO:teuthology.orchestra.run.smithi066.stderr:set 3.1e pg_upmap mapping to [0,2] 2024-09-12T22:48:36.408 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:36.408 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:36.414 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:48:36.418 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:36.492 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:36.491+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:36.521 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:36.521 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:36.529 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:36.593 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:36.592+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:36.672 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:36.673 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:36.681 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:36.694 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:36.693+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:36.785 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:36.786 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:36.794 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:36.795 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:36.794+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:36.896 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:36.895+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:36.898 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:36.898 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:36.907 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:36.997 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:36.996+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:37.011 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:37.011 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:37.019 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:37.043 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:48:37.098 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:37.097+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:37.125 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:37.125 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:37.134 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:37.169 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:48:37.169 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:48:37.186 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:48:37.187 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:48:37.187 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:48:37.190 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:48:37.190 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:48:37.218 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:37.217+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:37.276 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:37.277 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:48:37.277 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:48:37.277 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:48:37.277 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:37.286 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:37.327 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:37.326+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:37.400 INFO:teuthology.orchestra.run.smithi066.stderr:nodeep-scrub is set 2024-09-12T22:48:37.401 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:37.399+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:37.432 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:37.432 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:48:37.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:48:37.432 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:48:37.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.432 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:48:37.433 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:37.433 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.384461072999997, 2024-09-12T22:48:37.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:48:37.433 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:37.433 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:37.433 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:37.433 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:37.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:37.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:37.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:37.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:37.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:37.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:37.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:48:37.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:37.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:48:37.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:48:37.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:37.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:48:37.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:48:37.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:37.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:48:37.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:48:37.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:37.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:48:37.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:48:37.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:37.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:48:37.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:48:37.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:37.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:48:37.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:48:37.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:37.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:48:37.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:48:37.437 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.437 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:37.437 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.437 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:48:37.437 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:37.437 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.384080345999998, 2024-09-12T22:48:37.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:48:37.438 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:37.438 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:37.438 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:37.438 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:37.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:37.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:37.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:37.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:37.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:37.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:48:37.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:48:37.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:37.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:48:37.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:48:37.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:37.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:48:37.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:48:37.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:37.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:48:37.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:48:37.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:37.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:48:37.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:48:37.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:37.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:48:37.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:48:37.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:37.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:48:37.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:48:37.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:37.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:48:37.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:48:37.442 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.442 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:37.442 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.442 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:48:37.442 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:37.442 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 32.263483536000003, 2024-09-12T22:48:37.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:48:37.442 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:37.442 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:37.442 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:48:37.443 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:37.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:37.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:37.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:37.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:37.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:37.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:37.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:48:37.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:37.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:48:37.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:48:37.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:37.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:48:37.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:48:37.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:37.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:48:37.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:48:37.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:37.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:48:37.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:48:37.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:37.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:48:37.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:48:37.446 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.446 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:37.446 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.447 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:37.447 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:37.447 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 32.260875356, 2024-09-12T22:48:37.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:48:37.447 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:37.447 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:37.447 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:37.447 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:37.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:37.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:37.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:37.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:37.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:37.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:48:37.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:48:37.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:37.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:48:37.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:48:37.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:37.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:48:37.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:48:37.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:37.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:48:37.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:48:37.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:37.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:48:37.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:48:37.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:37.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:48:37.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:48:37.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:37.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:48:37.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:48:37.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:37.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:48:37.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:48:37.453 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.453 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:37.453 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.453 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:37.454 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:37.454 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 32.259982133000001, 2024-09-12T22:48:37.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:48:37.454 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:37.454 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:37.454 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:37.455 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:37.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:37.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:37.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:37.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:37.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:37.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:48:37.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:48:37.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:37.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:48:37.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:48:37.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:37.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:48:37.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:48:37.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:37.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:48:37.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:48:37.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:37.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:48:37.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:48:37.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:37.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:48:37.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:48:37.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:37.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:48:37.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:48:37.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:37.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:48:37.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:48:37.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:37.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:48:37.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:48:37.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:37.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:48:37.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:48:37.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:37.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:48:37.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:48:37.461 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.461 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:37.461 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.461 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:37.461 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:37.461 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 32.259910474999998, 2024-09-12T22:48:37.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:48:37.461 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:37.461 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:37.462 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:37.462 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:37.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:37.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:37.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:37.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:37.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:37.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:48:37.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:48:37.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:37.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:48:37.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:48:37.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:37.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:48:37.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:48:37.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:37.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:48:37.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:48:37.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:37.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:48:37.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:48:37.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:37.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:48:37.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:48:37.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:37.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:48:37.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:48:37.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:37.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:48:37.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:48:37.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:37.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:48:37.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:48:37.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:37.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:48:37.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:48:37.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:37.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:48:37.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:48:37.467 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.467 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:37.467 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.468 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:37.468 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:37.468 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 32.259867757000002, 2024-09-12T22:48:37.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:48:37.468 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:37.468 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:37.468 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:37.468 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:37.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:37.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:37.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:37.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:37.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:37.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:48:37.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:48:37.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:37.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:48:37.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:48:37.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:37.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:48:37.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:48:37.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:37.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:48:37.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:48:37.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:37.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:48:37.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:48:37.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:37.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:48:37.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:48:37.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:37.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:48:37.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:48:37.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:37.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:48:37.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:48:37.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:37.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:48:37.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:48:37.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:37.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:48:37.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:48:37.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:37.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:48:37.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:48:37.474 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.474 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:37.474 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.474 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:37.474 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:37.476 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 32.259829840000002, 2024-09-12T22:48:37.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:48:37.476 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:37.476 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:37.476 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:37.476 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:37.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:37.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:37.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:37.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:37.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:37.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:48:37.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:48:37.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:37.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:48:37.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:48:37.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:37.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:48:37.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:48:37.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:37.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:48:37.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:48:37.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:37.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:48:37.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:48:37.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:37.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:48:37.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:48:37.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:37.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:37.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:48:37.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:37.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:48:37.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:48:37.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:37.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:48:37.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:48:37.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:37.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:48:37.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:48:37.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:37.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:48:37.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:48:37.482 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.482 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:37.482 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.482 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:37.482 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:37.482 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 32.259806388999998, 2024-09-12T22:48:37.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:48:37.483 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:37.483 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:37.483 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:37.483 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:37.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:37.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:37.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:37.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:37.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:37.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:48:37.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:48:37.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:37.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:48:37.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:48:37.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:37.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:48:37.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:48:37.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:37.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:48:37.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:48:37.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:37.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:48:37.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:48:37.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:37.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:48:37.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:48:37.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:37.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:37.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:48:37.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:37.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:48:37.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:48:37.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:37.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:48:37.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:48:37.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:37.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:48:37.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:48:37.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:37.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:48:37.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:48:37.489 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.489 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:37.489 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.489 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:37.489 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:37.489 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 32.259782152, 2024-09-12T22:48:37.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:48:37.489 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:37.489 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:37.490 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:37.490 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:37.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:37.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:37.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:37.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:37.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:37.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:37.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:48:37.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:37.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:48:37.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:48:37.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:37.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:48:37.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:48:37.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:37.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:48:37.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:48:37.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:37.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:48:37.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:48:37.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:37.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:48:37.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:48:37.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:37.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:48:37.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:48:37.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:37.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:48:37.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:48:37.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:37.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:48:37.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:48:37.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:37.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:48:37.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:48:37.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:37.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:48:37.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:48:37.495 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.495 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:37.495 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.495 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:37.495 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:37.495 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 32.259754235000003, 2024-09-12T22:48:37.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:48:37.496 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:37.496 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:37.496 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:37.496 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:37.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:37.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:37.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:37.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:37.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:37.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:37.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:48:37.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:37.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:48:37.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:48:37.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:37.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:48:37.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:48:37.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:37.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:48:37.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:48:37.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:37.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:48:37.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:48:37.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:37.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:48:37.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:48:37.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:37.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:48:37.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:48:37.500 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.500 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:37.500 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.501 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:37.501 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:37.501 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 32.259679740000003, 2024-09-12T22:48:37.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:48:37.501 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:37.501 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:37.501 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:37.501 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:37.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:37.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:37.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:37.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:37.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:37.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:48:37.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:48:37.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:37.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:48:37.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:48:37.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:37.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:48:37.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:48:37.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:37.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:48:37.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:48:37.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:37.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:48:37.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:48:37.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:37.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:48:37.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:48:37.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:37.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:48:37.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:48:37.505 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.505 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:37.505 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.506 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:37.506 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:37.506 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 32.259633712000003, 2024-09-12T22:48:37.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:48:37.506 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:37.506 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:37.506 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:37.506 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:37.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:37.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:37.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:37.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:37.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:37.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:48:37.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:48:37.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:37.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:48:37.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:48:37.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:37.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:48:37.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:48:37.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:37.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:48:37.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:48:37.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:37.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:48:37.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:48:37.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:37.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:48:37.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:48:37.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:37.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:48:37.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:48:37.510 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.510 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:37.510 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.510 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:37.511 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:37.511 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 32.257462828000001, 2024-09-12T22:48:37.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:48:37.511 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:37.511 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:37.511 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:37.511 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:37.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:37.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:37.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:37.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:37.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:37.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:37.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:48:37.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:37.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:48:37.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:48:37.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:37.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:48:37.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:48:37.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:37.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:37.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:48:37.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:37.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:48:37.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:48:37.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:37.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:37.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:48:37.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:37.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:48:37.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:48:37.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:37.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:48:37.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:48:37.515 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.515 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:37.515 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.515 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:37.515 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:37.515 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 32.257412377999998, 2024-09-12T22:48:37.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:48:37.516 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:37.516 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:37.516 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:37.516 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:37.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:37.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:37.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:37.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:37.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:37.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:48:37.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:48:37.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:37.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:48:37.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:48:37.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:37.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:48:37.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:48:37.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:37.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:48:37.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:48:37.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:37.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:48:37.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:48:37.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:37.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:48:37.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:48:37.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:37.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:48:37.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:48:37.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:37.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:48:37.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:48:37.520 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.520 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:37.520 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.521 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:37.521 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:37.521 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 32.257358940000003, 2024-09-12T22:48:37.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:48:37.521 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:37.521 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:37.521 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:37.521 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:37.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:37.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:37.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:37.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:37.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:37.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:37.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:48:37.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:37.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:48:37.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:48:37.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:37.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:37.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:48:37.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:37.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:48:37.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:48:37.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:37.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:48:37.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:48:37.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:37.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:48:37.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:48:37.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:37.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:48:37.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:48:37.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:37.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:48:37.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:48:37.525 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.525 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:37.525 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.525 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:48:37.525 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:37.526 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 32.253374587000003, 2024-09-12T22:48:37.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:48:37.526 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:37.526 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:37.526 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:37.526 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:37.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:37.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:37.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:37.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:37.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:37.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:48:37.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:48:37.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:37.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:48:37.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:48:37.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:37.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:48:37.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:48:37.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:37.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:48:37.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:48:37.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:37.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:48:37.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:48:37.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:37.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:48:37.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:48:37.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:37.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:48:37.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:48:37.534 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.534 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:37.534 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.535 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:48:37.535 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:37.535 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.268222047999998, 2024-09-12T22:48:37.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:48:37.536 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:37.536 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:37.536 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:37.536 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:37.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:37.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:37.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:37.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:37.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:37.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:48:37.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:48:37.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:37.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:48:37.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:48:37.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:37.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:48:37.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:48:37.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:37.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:48:37.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:48:37.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:37.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:48:37.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:48:37.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:37.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:48:37.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:48:37.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:37.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:48:37.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:48:37.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:37.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:48:37.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:48:37.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:37.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:48:37.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:48:37.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:37.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:48:37.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:48:37.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:37.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:48:37.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:48:37.548 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.548 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:37.548 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.549 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:48:37.549 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:37.549 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.266305803, 2024-09-12T22:48:37.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:48:37.549 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:37.550 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:37.550 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:37.550 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:37.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:37.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:37.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:37.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:37.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.552 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:37.552 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:48:37.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:48:37.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:37.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:48:37.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:48:37.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:37.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:48:37.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:48:37.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:37.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:48:37.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:48:37.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:37.556 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:48:37.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:48:37.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.557 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:37.557 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:48:37.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:48:37.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.558 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:37.558 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:48:37.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:48:37.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:37.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:48:37.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:48:37.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:37.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:48:37.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:48:37.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:37.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:48:37.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:48:37.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:37.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:48:37.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:48:37.562 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.562 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:37.562 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.563 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:48:37.563 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:37.563 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 7.2655524280000003, 2024-09-12T22:48:37.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012160610000000001, 2024-09-12T22:48:37.563 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:37.564 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:37.564 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:37.564 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:37.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:37.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:37.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:37.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:37.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:37.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:37.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164967+0000", 2024-09-12T22:48:37.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:48:37.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:37.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164974+0000", 2024-09-12T22:48:37.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:48:37.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:37.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164987+0000", 2024-09-12T22:48:37.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3689000000000001e-05 2024-09-12T22:48:37.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:37.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164995+0000", 2024-09-12T22:48:37.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2959999999999999e-06 2024-09-12T22:48:37.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.570 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:37.570 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165068+0000", 2024-09-12T22:48:37.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2449999999999999e-05 2024-09-12T22:48:37.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.570 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:37.570 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165212+0000", 2024-09-12T22:48:37.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144117 2024-09-12T22:48:37.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.570 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:37.570 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166066+0000", 2024-09-12T22:48:37.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085441100000000002 2024-09-12T22:48:37.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:37.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166107+0000", 2024-09-12T22:48:37.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0450000000000001e-05 2024-09-12T22:48:37.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:37.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:37.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:37.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166181+0000", 2024-09-12T22:48:37.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-12T22:48:37.571 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.572 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:37.572 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.572 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:37.572 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:37.572 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:37.572 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~6s 2024-09-12T22:48:37.573 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:37.572+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:37.574 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:37.674 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:37.673+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:37.680 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:37.681 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:48:37.681 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:48:37.681 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:37.688 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:37.775 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:37.774+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:37.791 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:37.791 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:48:37.791 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:48:37.791 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:48:37.791 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:37.801 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:37.885 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:37.884+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:37.945 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:37.946 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:48:37.946 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:48:37.946 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:48:37.946 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.946 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:48:37.946 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:37.946 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 41.559925038000003, 2024-09-12T22:48:37.946 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:48:37.946 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:37.946 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:37.946 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:37.947 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:37.947 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.947 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:37.947 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:37.947 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:37.947 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.947 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.947 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:37.947 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:37.947 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:37.947 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.947 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.947 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:37.947 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:37.948 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:48:37.948 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.948 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.948 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:37.948 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:48:37.948 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:48:37.948 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.948 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.948 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:37.948 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:48:37.948 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:48:37.948 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.948 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.949 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:37.949 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:48:37.949 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:48:37.949 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.949 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.949 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:37.949 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:48:37.949 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:48:37.949 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.949 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.949 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:37.949 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:48:37.949 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:48:37.949 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.950 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.950 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:37.950 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:48:37.950 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:48:37.950 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.950 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.950 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:37.950 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:48:37.950 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:48:37.950 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:37.950 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:37.950 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:37.950 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.950 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.951 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:48:37.951 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:37.951 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 41.559482455000001, 2024-09-12T22:48:37.951 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:48:37.951 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:37.951 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:37.951 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:37.951 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:37.952 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.952 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:37.952 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:37.952 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:37.952 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.952 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.952 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:37.952 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:37.952 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:37.952 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.952 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.952 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:37.952 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:48:37.952 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:48:37.953 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.953 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.953 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:37.953 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:48:37.953 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:48:37.953 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.953 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.953 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:37.953 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:48:37.953 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:48:37.954 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.954 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.954 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:37.954 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:48:37.954 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:48:37.954 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.954 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.954 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:37.954 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:48:37.954 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:48:37.954 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.954 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.954 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:37.954 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:48:37.955 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:48:37.955 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.955 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.955 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:37.955 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:48:37.955 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:48:37.955 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.955 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.955 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:37.956 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:48:37.956 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:48:37.956 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:37.956 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:37.956 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:37.957 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.957 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.957 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:48:37.957 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:37.957 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 41.559116297999999, 2024-09-12T22:48:37.957 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:48:37.957 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:37.957 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:37.957 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:37.957 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:37.958 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.958 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:37.958 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:37.958 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:37.958 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.958 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.958 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:37.958 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:37.958 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:37.958 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.958 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.958 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:37.958 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:48:37.959 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:48:37.959 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.959 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.959 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:37.959 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:48:37.959 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:48:37.959 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.959 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.959 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:37.959 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:48:37.959 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:48:37.959 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.959 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.960 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:37.960 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:48:37.960 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:48:37.960 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.960 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.960 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:37.960 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:48:37.960 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:48:37.960 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.960 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.960 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:37.960 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:48:37.961 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:48:37.961 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.961 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.961 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:37.961 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:48:37.961 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:48:37.961 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.961 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.961 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:37.961 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:48:37.961 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:48:37.961 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:37.962 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:37.962 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:37.962 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.962 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.962 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:48:37.962 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:37.962 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 41.558703985999998, 2024-09-12T22:48:37.962 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:48:37.962 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:37.962 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:37.962 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:37.963 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:37.963 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.963 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:37.963 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:37.963 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:37.963 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.963 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.963 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:37.963 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:37.963 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:37.963 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.963 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.963 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:37.964 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:37.964 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:48:37.964 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.964 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.964 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:37.964 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:48:37.964 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:48:37.964 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.964 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.964 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:37.964 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:48:37.964 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:48:37.964 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.965 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.965 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:37.965 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:48:37.965 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:48:37.965 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.965 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.965 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:37.965 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:48:37.966 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:48:37.966 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.966 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.966 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:37.966 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:48:37.966 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:48:37.966 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.966 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.966 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:37.966 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:48:37.966 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:48:37.966 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.966 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.967 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:37.967 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:48:37.967 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:48:37.967 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:37.967 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:37.967 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:37.967 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.967 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.967 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:48:37.967 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:37.967 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 41.424853892000002, 2024-09-12T22:48:37.967 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:48:37.967 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:37.968 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:37.968 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:37.968 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:37.968 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.968 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:37.968 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:37.968 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:37.968 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.968 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.968 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:37.968 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:37.968 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:37.968 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.969 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.969 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:37.969 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:37.969 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:48:37.969 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.969 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.969 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:37.969 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:48:37.969 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:48:37.969 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.969 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.969 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:37.969 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:48:37.970 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:48:37.970 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.970 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.970 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:37.970 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:48:37.970 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:48:37.970 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.970 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.970 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:37.970 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:48:37.970 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:48:37.970 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.970 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.970 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:37.971 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:48:37.971 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:48:37.971 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.971 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.971 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:37.971 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:48:37.971 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:48:37.971 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.971 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.971 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:37.971 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:48:37.971 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:48:37.971 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:37.972 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:37.972 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:37.972 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.972 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.972 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:37.972 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:37.972 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.779618337999999, 2024-09-12T22:48:37.972 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:48:37.972 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:37.973 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:37.973 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:37.973 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:37.973 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.973 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:37.973 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:37.973 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:37.973 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.973 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.973 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:37.973 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:37.973 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:37.973 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.973 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.974 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:37.974 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:48:37.974 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:48:37.974 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.974 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.974 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:37.974 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:48:37.974 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:48:37.974 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.975 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.975 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:37.975 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:48:37.975 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:48:37.975 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.975 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.975 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:37.975 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:48:37.975 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:48:37.975 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.975 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.975 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:37.975 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:48:37.975 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:48:37.976 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.976 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.976 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:37.976 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:48:37.976 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:48:37.976 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.976 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.976 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:37.976 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:48:37.976 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:48:37.976 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.976 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.976 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:37.977 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:48:37.977 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:48:37.977 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.977 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.977 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:37.977 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:48:37.977 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:48:37.977 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.977 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.977 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:37.977 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:48:37.977 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:48:37.977 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.977 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.978 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:37.978 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:48:37.978 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:48:37.978 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.978 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.978 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:37.978 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:48:37.978 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:48:37.978 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.978 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.978 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:37.978 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:48:37.978 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:48:37.979 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:37.979 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:37.979 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:37.979 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.979 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.979 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:37.979 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:37.979 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.779518821000003, 2024-09-12T22:48:37.979 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:48:37.979 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:37.979 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:37.979 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:37.979 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:37.980 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.980 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:37.980 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:37.980 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:37.980 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.980 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.980 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:37.980 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:37.980 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:37.980 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.980 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.980 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:37.980 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:48:37.981 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:48:37.981 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.981 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.981 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:37.981 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:48:37.981 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:48:37.981 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.981 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.981 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:37.981 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:48:37.981 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:48:37.981 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.981 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.982 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:37.982 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:48:37.982 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:48:37.982 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.982 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.982 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:37.982 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:48:37.982 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:48:37.982 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.982 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.982 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:37.982 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:48:37.982 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:48:37.982 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.983 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.983 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:37.983 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:48:37.983 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:48:37.983 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.983 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.983 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:37.983 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:48:37.983 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:48:37.983 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.983 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.983 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:37.983 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:48:37.984 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:48:37.984 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.984 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.984 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:37.984 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:48:37.984 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:48:37.984 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.984 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.984 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:37.984 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:48:37.984 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:48:37.984 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.984 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.985 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:37.985 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:48:37.985 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:48:37.985 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.985 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.985 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:37.985 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:48:37.985 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:48:37.985 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:37.985 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:37.985 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:37.985 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.985 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.985 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:37.986 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:37.986 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.779474082, 2024-09-12T22:48:37.986 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:48:37.986 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:37.986 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:37.986 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:37.986 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:37.986 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.986 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:37.986 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:37.986 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:37.986 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.986 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.987 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:37.987 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:37.987 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:37.987 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.987 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.987 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:37.987 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:48:37.987 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:48:37.987 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.987 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.987 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:37.987 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:48:37.987 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:48:37.987 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.988 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.988 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:37.988 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:48:37.988 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:48:37.988 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.988 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.988 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:37.988 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:48:37.988 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:48:37.988 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.988 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.988 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:37.988 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:48:37.989 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:48:37.989 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.989 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.989 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:37.989 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:48:37.989 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:48:37.989 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.989 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.989 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:37.989 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:48:37.989 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:48:37.989 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.989 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.990 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:37.990 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:48:37.990 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:48:37.990 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.990 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.990 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:37.990 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:48:37.990 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:48:37.990 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.990 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.990 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:37.990 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:48:37.990 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:48:37.990 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.991 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.991 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:37.991 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:48:37.991 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:48:37.991 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.991 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.991 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:37.991 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:48:37.991 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:48:37.991 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.991 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.991 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:37.991 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:48:37.992 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:48:37.992 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:37.992 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:37.992 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:37.992 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.992 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.992 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:37.992 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:37.992 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.779246381, 2024-09-12T22:48:37.992 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:48:37.992 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:37.992 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:37.992 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:37.993 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:37.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.993 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:37.993 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:37.993 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:37.993 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.993 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:37.993 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:37.993 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:37.993 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.993 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:37.993 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:48:37.994 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:48:37.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.994 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.994 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:37.994 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:48:37.994 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:48:37.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.994 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.994 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:37.994 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:48:37.994 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:48:37.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.994 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.995 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:37.995 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:48:37.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:48:37.995 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.995 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.995 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:37.995 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:48:37.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:48:37.995 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.995 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.995 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:37.995 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:48:37.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:48:37.995 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.996 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.996 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:37.996 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:48:37.996 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:48:37.996 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.996 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.996 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:37.996 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:48:37.996 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:48:37.996 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.996 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.996 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:37.996 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:48:37.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:48:37.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:37.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:48:37.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:48:37.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:37.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:48:37.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:48:37.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.998 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:37.998 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:48:37.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:48:37.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.998 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.998 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:37.998 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:48:37.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:48:37.998 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:37.998 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:37.998 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:37.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:37.998 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.999 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:37.999 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:37.999 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.779081273000003, 2024-09-12T22:48:37.999 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:48:37.999 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:37.999 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:37.999 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:37.999 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:37.999 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:37.999 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:37.999 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:37.999 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:37.999 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:38.000 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:38.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.000 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:38.000 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:48:38.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:48:38.000 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:38.000 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:48:38.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:48:38.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.001 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:38.001 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:48:38.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:48:38.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.001 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.001 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:48:38.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:48:38.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.001 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:48:38.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:48:38.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.002 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:38.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:48:38.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:48:38.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.002 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:48:38.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:48:38.003 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.003 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.003 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:38.003 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:48:38.003 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:48:38.003 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.003 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.003 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:38.003 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:48:38.003 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:48:38.003 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.003 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.003 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:38.003 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:48:38.004 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:48:38.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.004 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:38.004 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:48:38.004 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:48:38.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.004 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:38.004 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:48:38.004 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:48:38.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.005 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:38.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:48:38.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:48:38.005 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.005 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:38.005 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.005 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:38.005 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:38.005 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.779019988000002, 2024-09-12T22:48:38.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:48:38.005 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:38.005 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:38.006 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.006 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:38.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.006 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:38.006 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:38.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.006 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.006 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:38.006 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:38.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.006 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.007 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:38.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:38.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:48:38.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.007 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:38.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:48:38.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:48:38.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.007 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:38.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:48:38.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:48:38.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.008 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.008 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:48:38.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:48:38.008 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.008 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.008 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:48:38.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:48:38.008 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.008 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:38.008 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:48:38.009 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:48:38.009 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.009 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.009 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:48:38.009 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:48:38.009 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.009 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:38.009 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:48:38.009 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:48:38.009 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.009 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:38.010 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:48:38.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:48:38.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.010 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:38.010 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:48:38.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:48:38.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.010 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:38.010 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:48:38.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:48:38.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.011 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:38.011 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:48:38.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:48:38.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.011 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:38.011 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:48:38.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:48:38.011 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.011 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:38.011 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.012 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:38.012 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:38.012 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.778939880000003, 2024-09-12T22:48:38.012 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:48:38.012 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:38.012 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:38.012 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.012 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:38.012 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.012 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:38.012 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:38.013 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.013 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:38.013 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:38.013 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.013 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:38.013 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:48:38.013 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:48:38.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:38.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:48:38.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:48:38.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:38.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:48:38.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:48:38.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:48:38.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:48:38.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:48:38.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:48:38.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:38.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:48:38.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:48:38.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:48:38.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:48:38.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:38.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:48:38.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:48:38.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:38.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:48:38.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:48:38.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:38.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:48:38.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:48:38.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:38.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:48:38.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:48:38.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:38.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:48:38.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:48:38.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.018 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:38.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:48:38.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:48:38.018 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.018 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:38.018 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.018 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:38.018 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:38.018 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.778890926999999, 2024-09-12T22:48:38.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:48:38.018 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:38.019 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:38.019 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:48:38.019 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:38.019 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.019 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:38.019 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:38.019 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.019 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.019 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.019 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:38.019 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:38.019 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.019 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.019 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.020 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:38.020 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:38.020 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:48:38.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.020 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:38.020 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:48:38.020 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:48:38.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.020 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:38.020 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:48:38.020 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:48:38.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.021 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.021 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.021 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:48:38.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:48:38.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.021 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.021 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.021 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:48:38.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:48:38.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.021 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.021 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:38.022 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:48:38.022 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:48:38.022 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:38.022 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:48:38.022 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:48:38.022 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.022 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:38.022 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.022 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.022 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:38.022 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:38.023 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.778841827000001, 2024-09-12T22:48:38.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:48:38.023 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:38.023 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:38.023 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:48:38.023 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:38.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.023 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:38.023 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:38.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.023 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:38.023 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:38.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.024 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:38.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:48:38.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:48:38.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.024 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:38.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:48:38.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:48:38.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.025 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:38.025 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:48:38.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:48:38.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.025 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.025 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.025 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:48:38.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:48:38.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.025 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.025 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.025 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:48:38.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:48:38.026 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.026 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:38.026 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:48:38.026 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:48:38.026 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.026 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:38.026 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:48:38.026 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:48:38.026 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.026 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:38.026 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.026 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.027 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.027 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:38.027 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:38.027 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.771901376999999, 2024-09-12T22:48:38.027 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:48:38.027 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:38.027 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:38.027 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.027 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:38.027 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.027 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:38.027 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:38.027 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.028 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.028 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:38.028 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:38.028 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.028 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.028 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:38.028 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:48:38.028 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:48:38.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.028 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.028 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:38.029 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:48:38.029 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:48:38.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.029 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:38.029 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:48:38.029 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:48:38.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.029 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.029 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:48:38.029 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:48:38.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.030 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.030 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:48:38.030 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:48:38.030 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.030 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.030 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:38.030 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:48:38.030 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:48:38.030 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.030 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.030 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:38.030 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:48:38.030 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:48:38.031 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.031 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.031 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:38.031 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:48:38.031 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:48:38.031 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.031 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:38.031 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.031 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.031 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.031 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:38.031 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:38.031 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.770812536999998, 2024-09-12T22:48:38.031 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:48:38.032 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:38.032 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:38.032 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.032 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:38.032 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.032 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:38.032 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:38.032 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.032 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.032 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.032 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:38.032 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:38.032 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.033 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:38.033 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:48:38.033 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:48:38.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.033 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:38.033 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:48:38.033 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:48:38.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.034 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:38.034 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:48:38.034 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:48:38.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.034 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.034 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.034 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:48:38.034 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:48:38.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.034 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.034 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.034 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:48:38.034 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:48:38.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.035 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.035 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:38.035 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:48:38.035 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:48:38.035 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.035 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.035 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:38.035 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:48:38.035 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:48:38.035 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.035 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.035 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:38.035 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:48:38.036 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:48:38.036 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.036 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:38.036 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.036 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.036 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.036 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:38.036 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:38.036 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.770762926000003, 2024-09-12T22:48:38.036 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:48:38.036 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:38.036 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:38.036 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.036 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:38.037 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.037 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:38.037 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:38.037 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.037 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.037 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.037 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:38.037 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:38.037 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.037 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.037 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.037 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:38.037 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:38.038 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:48:38.038 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.038 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.038 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:38.038 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:38.038 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:48:38.038 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.038 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.038 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:38.038 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:48:38.038 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:48:38.038 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.038 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.038 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.039 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:48:38.039 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:48:38.039 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.039 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.039 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.039 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:48:38.039 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:48:38.039 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.039 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.039 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:38.039 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:48:38.039 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:48:38.039 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.039 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.040 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:38.040 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:48:38.040 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:48:38.040 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.040 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.040 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:38.040 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:48:38.040 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:48:38.040 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.040 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:38.040 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.040 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.040 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.041 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:38.041 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:38.041 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.770695617000001, 2024-09-12T22:48:38.041 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:48:38.041 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:38.041 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:38.041 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.041 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:38.041 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.041 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:38.041 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:38.041 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.041 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.042 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.042 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:38.042 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:38.042 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.042 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.042 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.042 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:38.042 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:38.042 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:48:38.042 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.042 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.042 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:38.042 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:48:38.042 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:48:38.043 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.043 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.043 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:38.043 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:48:38.043 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:48:38.043 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.043 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.043 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.043 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:48:38.043 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:48:38.043 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.043 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.043 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.044 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:48:38.044 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:48:38.044 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.044 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.044 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:38.044 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:48:38.044 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:48:38.044 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.044 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.044 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:38.045 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:48:38.045 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:48:38.045 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.045 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.045 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:38.045 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:48:38.045 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:48:38.045 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.045 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:38.045 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.045 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.045 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.045 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:38.045 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:38.046 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.770127698000003, 2024-09-12T22:48:38.046 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:48:38.046 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:38.046 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:38.046 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.046 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:38.046 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.046 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:38.046 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:38.046 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.046 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.046 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.046 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:38.047 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:38.047 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.047 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.047 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.047 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:38.047 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:38.047 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:48:38.047 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.047 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.047 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:38.047 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:48:38.047 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:48:38.047 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.047 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.048 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:38.048 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:48:38.048 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:48:38.048 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.048 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.048 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.048 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:48:38.048 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:48:38.048 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.048 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.048 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.048 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:48:38.048 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:48:38.049 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.049 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.049 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:38.049 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:48:38.049 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:48:38.049 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.049 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.049 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:38.049 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:48:38.049 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:48:38.049 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.049 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.049 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:38.049 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:48:38.050 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:48:38.050 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.050 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:38.050 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.050 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.050 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.050 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:48:38.050 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:38.050 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.769750094000003, 2024-09-12T22:48:38.050 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:48:38.050 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:38.050 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:38.050 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.050 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:38.051 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.051 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:38.051 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:38.051 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.051 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.051 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.051 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:38.051 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:38.051 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.051 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.051 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.052 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:38.052 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:48:38.052 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:48:38.052 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.052 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.052 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:38.052 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:48:38.052 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:48:38.052 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.052 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.052 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:38.052 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:48:38.053 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:48:38.053 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.053 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.053 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.053 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:48:38.053 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:48:38.053 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.053 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.053 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.053 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:48:38.053 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:48:38.053 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.053 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.053 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:38.054 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:48:38.054 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:48:38.054 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.054 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.054 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:38.054 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:48:38.054 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:48:38.054 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.054 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.054 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:38.055 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:48:38.055 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:48:38.055 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.055 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:38.055 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.055 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.055 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:38.055 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:38.057 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:38.057 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:38.056+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:38.157 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:38.157+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:38.166 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:38.166 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:48:38.166 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:48:38.166 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:38.175 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:38.258 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:38.257+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:38.276 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:38.276 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:48:38.277 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:48:38.277 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:48:38.277 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:38.285 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:38.359 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:38.359+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:38.393 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:38.393 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:48:38.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:48:38.393 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:48:38.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.393 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:48:38.393 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:38.393 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.344815435000001, 2024-09-12T22:48:38.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:48:38.393 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:38.393 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:38.394 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.394 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:38.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:38.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:38.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:38.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:38.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:38.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:38.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:48:38.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:38.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:48:38.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:48:38.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:38.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:48:38.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:48:38.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:48:38.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:48:38.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:38.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:48:38.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:48:38.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:38.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:48:38.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:48:38.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:38.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:48:38.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:48:38.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:38.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:48:38.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:48:38.397 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.397 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:38.397 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.398 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:48:38.398 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:38.398 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.344434708000001, 2024-09-12T22:48:38.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:48:38.398 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:38.398 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:38.398 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.398 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:38.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:38.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:38.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:38.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:38.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:38.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:48:38.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:48:38.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:38.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:48:38.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:48:38.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:38.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:48:38.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:48:38.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:48:38.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:48:38.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:38.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:48:38.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:48:38.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:38.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:48:38.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:48:38.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:38.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:48:38.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:48:38.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:38.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:48:38.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:48:38.402 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.402 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:38.402 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.402 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:48:38.402 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:38.402 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.223837897999999, 2024-09-12T22:48:38.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:48:38.403 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:38.403 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:38.403 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:48:38.403 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:38.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:38.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:38.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:38.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:38.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:38.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:38.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:48:38.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:38.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:48:38.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:48:38.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:38.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:48:38.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:48:38.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:48:38.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:48:38.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:38.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:48:38.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:48:38.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:38.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:48:38.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:48:38.406 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.406 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:38.406 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.406 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:38.406 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:38.406 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.221229717999996, 2024-09-12T22:48:38.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:48:38.406 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:38.406 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:38.407 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.407 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:38.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:38.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:38.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:38.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:38.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:38.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:48:38.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:48:38.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:38.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:48:38.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:48:38.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:38.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:48:38.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:48:38.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:48:38.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:48:38.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:38.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:48:38.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:48:38.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:38.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:48:38.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:48:38.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:38.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:48:38.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:48:38.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:38.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:48:38.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:48:38.410 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.410 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:38.410 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.411 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:38.411 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:38.411 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.220336494999998, 2024-09-12T22:48:38.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:48:38.411 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:38.411 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:38.411 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.411 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:38.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:38.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:38.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:38.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:38.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:38.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:48:38.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:48:38.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:38.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:48:38.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:48:38.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:38.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:48:38.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:48:38.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:48:38.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:48:38.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:38.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:48:38.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:48:38.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:38.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:48:38.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:48:38.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:38.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:48:38.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:48:38.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:38.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:48:38.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:48:38.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:38.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:48:38.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:48:38.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:38.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:48:38.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:48:38.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:38.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:48:38.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:48:38.416 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.416 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:38.416 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.416 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:38.416 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:38.416 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.220264837000002, 2024-09-12T22:48:38.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:48:38.417 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:38.417 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:38.417 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.417 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:38.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:38.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:38.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:38.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:38.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:38.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:48:38.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:48:38.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:38.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:48:38.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:48:38.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:38.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:48:38.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:48:38.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:48:38.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:48:38.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:38.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:48:38.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:48:38.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:38.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:48:38.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:48:38.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:38.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:48:38.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:48:38.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:38.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:48:38.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:48:38.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:38.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:48:38.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:48:38.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:38.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:48:38.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:48:38.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:38.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:48:38.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:48:38.422 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.422 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:38.422 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.422 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:38.422 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:38.422 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.220222118999999, 2024-09-12T22:48:38.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:48:38.422 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:38.422 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:38.422 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.422 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:38.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:38.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:38.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:38.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:38.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:38.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:48:38.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:48:38.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:38.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:48:38.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:48:38.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:38.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:48:38.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:48:38.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:48:38.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:48:38.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:38.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:48:38.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:48:38.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:38.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:48:38.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:48:38.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:38.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:48:38.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:48:38.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:38.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:48:38.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:48:38.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:38.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:48:38.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:48:38.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:38.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:48:38.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:48:38.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:38.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:48:38.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:48:38.427 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.427 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:38.427 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.428 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:38.428 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:38.428 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.220184201999999, 2024-09-12T22:48:38.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:48:38.428 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:38.428 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:38.428 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.428 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:38.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:38.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:38.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:38.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:38.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:38.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:48:38.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:48:38.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:38.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:48:38.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:48:38.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:38.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:48:38.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:48:38.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:48:38.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:48:38.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:38.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:48:38.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:48:38.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:38.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:48:38.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:48:38.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:38.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:38.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:48:38.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:38.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:48:38.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:48:38.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:38.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:48:38.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:48:38.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:38.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:48:38.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:48:38.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:38.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:48:38.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:48:38.433 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.433 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:38.433 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.433 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:38.433 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:38.433 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.220160751000002, 2024-09-12T22:48:38.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:48:38.434 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:38.434 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:38.434 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.434 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:38.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:38.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:38.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:38.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:38.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:38.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:48:38.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:48:38.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:38.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:48:38.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:48:38.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:38.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:48:38.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:48:38.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:48:38.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:48:38.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:38.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:48:38.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:48:38.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:38.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:48:38.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:48:38.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:38.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:38.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:48:38.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:38.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:48:38.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:48:38.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:38.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:48:38.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:48:38.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:38.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:48:38.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:48:38.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:38.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:48:38.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:48:38.438 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.439 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:38.439 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.439 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:38.439 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:38.439 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.220136514000004, 2024-09-12T22:48:38.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:48:38.439 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:38.439 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:38.439 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.439 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:38.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:38.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:38.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:38.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:38.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:38.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:38.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:48:38.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:38.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:48:38.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:48:38.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:38.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:48:38.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:48:38.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:48:38.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:48:38.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:38.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:48:38.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:48:38.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:38.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:48:38.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:48:38.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:38.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:48:38.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:48:38.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:38.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:48:38.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:48:38.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:38.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:48:38.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:48:38.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:38.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:48:38.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:48:38.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:38.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:48:38.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:48:38.444 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.444 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:38.444 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.444 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:38.445 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:38.445 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.220108596999999, 2024-09-12T22:48:38.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:48:38.445 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:38.445 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:38.445 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:38.445 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:38.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:38.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:38.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:38.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:38.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:38.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:38.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:48:38.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:38.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:48:38.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:48:38.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:38.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:48:38.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:48:38.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:48:38.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:48:38.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:38.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:48:38.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:48:38.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:38.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:48:38.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:48:38.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:38.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:48:38.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:48:38.448 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.448 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:38.448 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.449 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:38.449 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:38.449 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.220034102, 2024-09-12T22:48:38.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:48:38.449 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:38.449 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:38.449 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:38.449 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:38.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:38.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:38.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:38.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:38.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:38.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:48:38.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:48:38.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:38.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:48:38.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:48:38.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:38.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:48:38.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:48:38.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:48:38.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:48:38.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:38.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:48:38.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:48:38.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:38.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:48:38.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:48:38.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:38.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:48:38.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:48:38.453 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.453 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:38.453 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.453 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:38.453 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:38.453 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.219988074, 2024-09-12T22:48:38.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:48:38.453 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:38.453 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:38.454 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:38.454 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:38.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:38.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:38.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:38.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:38.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:38.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:48:38.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:48:38.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:38.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:48:38.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:48:38.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:38.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:48:38.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:48:38.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:48:38.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:48:38.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:38.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:48:38.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:48:38.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:38.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:48:38.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:48:38.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:38.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:48:38.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:48:38.457 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.457 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:38.457 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.458 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:38.458 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:38.458 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.217817189999998, 2024-09-12T22:48:38.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:48:38.458 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:38.458 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:38.458 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.458 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:38.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:38.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:38.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:38.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:38.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:38.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:38.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:48:38.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:38.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:48:38.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:48:38.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:38.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:48:38.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:48:38.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:38.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:48:38.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:38.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:48:38.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:48:38.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:38.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:38.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:48:38.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:38.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:48:38.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:48:38.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:38.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:48:38.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:48:38.462 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.462 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:38.462 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.462 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:38.462 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:38.463 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.217766740000002, 2024-09-12T22:48:38.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:48:38.463 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:38.463 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:38.463 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.463 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:38.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:38.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:38.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:38.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:38.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:38.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:48:38.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:48:38.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:38.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:48:38.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:48:38.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:38.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:48:38.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:48:38.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:48:38.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:48:38.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:38.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:48:38.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:48:38.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:38.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:48:38.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:48:38.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:38.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:48:38.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:48:38.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:38.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:48:38.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:48:38.467 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.467 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:38.467 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.467 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:38.467 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:38.467 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.217713302, 2024-09-12T22:48:38.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:48:38.467 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:38.467 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:38.467 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.468 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:38.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:38.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:38.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:38.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:38.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:38.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:38.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:48:38.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:38.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:48:38.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:48:38.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:38.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:38.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:48:38.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:48:38.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:48:38.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:38.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:48:38.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:48:38.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:38.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:48:38.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:48:38.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:38.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:48:38.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:48:38.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:38.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:48:38.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:48:38.471 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.471 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:38.471 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.472 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:48:38.472 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:38.472 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.213728949, 2024-09-12T22:48:38.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:48:38.472 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:38.472 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:38.472 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:38.472 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:38.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:38.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:38.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:38.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:38.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:38.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:48:38.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:48:38.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:38.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:48:38.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:48:38.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:38.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:48:38.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:48:38.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:48:38.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:48:38.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:38.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:48:38.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:48:38.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:38.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:48:38.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:48:38.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:38.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:48:38.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:48:38.475 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.476 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:38.476 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.476 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:48:38.476 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:38.476 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 31.228576409999999, 2024-09-12T22:48:38.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:48:38.476 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:38.476 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:38.476 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.476 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:38.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:38.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:38.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:38.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:38.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:38.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:48:38.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:48:38.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:38.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:48:38.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:48:38.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:38.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:48:38.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:48:38.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:48:38.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:48:38.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:38.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:48:38.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:48:38.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:38.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:48:38.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:48:38.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:38.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:48:38.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:48:38.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:38.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:48:38.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:48:38.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:38.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:48:38.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:48:38.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:38.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:48:38.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:48:38.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:38.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:48:38.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:48:38.481 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.481 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:38.481 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.481 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:48:38.482 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:38.482 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.226660165, 2024-09-12T22:48:38.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:48:38.482 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:38.482 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:38.482 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.482 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:38.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:38.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:38.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:38.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:38.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:38.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:48:38.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:48:38.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:38.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:48:38.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:48:38.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:38.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:48:38.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:48:38.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:48:38.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:48:38.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:38.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:48:38.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:48:38.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:38.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:48:38.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:48:38.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:38.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:48:38.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:48:38.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:38.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:48:38.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:48:38.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:38.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:48:38.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:48:38.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:38.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:48:38.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:48:38.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:38.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:48:38.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:48:38.487 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.487 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:38.487 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.487 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:48:38.487 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:38.487 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.2259067899999998, 2024-09-12T22:48:38.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012160610000000001, 2024-09-12T22:48:38.487 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:38.487 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:38.488 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.488 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:38.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:38.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:38.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:38.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:38.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:38.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:38.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164967+0000", 2024-09-12T22:48:38.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:48:38.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:38.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164974+0000", 2024-09-12T22:48:38.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:48:38.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:38.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164987+0000", 2024-09-12T22:48:38.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3689000000000001e-05 2024-09-12T22:48:38.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164995+0000", 2024-09-12T22:48:38.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2959999999999999e-06 2024-09-12T22:48:38.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:38.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165068+0000", 2024-09-12T22:48:38.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2449999999999999e-05 2024-09-12T22:48:38.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:38.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165212+0000", 2024-09-12T22:48:38.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144117 2024-09-12T22:48:38.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:38.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166066+0000", 2024-09-12T22:48:38.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085441100000000002 2024-09-12T22:48:38.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:38.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166107+0000", 2024-09-12T22:48:38.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0450000000000001e-05 2024-09-12T22:48:38.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:38.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:38.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:38.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166181+0000", 2024-09-12T22:48:38.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-12T22:48:38.492 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.492 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:38.492 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.492 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:38.492 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:38.492 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:38.496 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:38.492+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:38.497 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:38.594 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:38.593+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:38.600 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:38.600 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:48:38.601 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:48:38.601 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:38.609 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:38.695 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:38.694+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:38.711 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:38.711 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:48:38.711 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:48:38.712 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:48:38.712 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:38.720 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:38.797 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:38.796+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:38.864 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:38.864 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:48:38.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:48:38.864 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:48:38.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.864 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:48:38.865 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:38.865 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 42.478482415000002, 2024-09-12T22:48:38.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:48:38.865 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:38.865 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:38.865 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.865 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:38.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:38.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:38.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:38.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:38.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:38.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:38.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:48:38.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:38.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:48:38.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:48:38.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:38.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:48:38.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:48:38.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:48:38.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:48:38.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:48:38.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:48:38.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:38.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:48:38.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:48:38.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:38.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:48:38.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:48:38.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:38.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:48:38.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:48:38.869 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.869 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:38.869 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.869 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:48:38.869 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:38.870 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 42.478039832, 2024-09-12T22:48:38.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:48:38.870 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:38.870 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:38.870 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.870 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:38.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:38.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:38.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:38.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:38.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:38.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:48:38.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:48:38.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:38.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:48:38.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:48:38.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:38.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:48:38.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:48:38.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:48:38.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:48:38.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:48:38.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:48:38.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:38.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:48:38.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:48:38.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:38.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:48:38.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:48:38.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:38.874 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:48:38.874 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:48:38.874 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.874 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:38.874 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.874 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.874 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.874 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:48:38.874 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:38.874 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 42.477673674999998, 2024-09-12T22:48:38.874 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:48:38.874 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:38.874 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:38.875 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.875 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:38.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.875 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:38.875 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:38.875 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.875 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.875 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:38.875 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:38.875 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.875 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.875 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:38.876 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:48:38.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:48:38.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.876 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:38.876 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:48:38.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:48:38.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.876 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:38.876 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:48:38.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:48:38.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:48:38.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:48:38.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.877 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:48:38.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:48:38.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.877 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:38.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:48:38.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:48:38.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.878 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:38.878 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:48:38.878 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:48:38.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.878 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:38.878 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:48:38.878 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:48:38.878 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.878 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:38.878 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.879 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:48:38.879 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:38.879 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 42.477261362999997, 2024-09-12T22:48:38.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:48:38.879 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:38.879 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:38.879 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.879 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:38.879 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.879 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:38.879 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:38.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.880 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:38.880 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:38.880 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.880 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.880 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:38.880 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:38.880 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:48:38.880 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.880 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:38.880 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:48:38.881 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:48:38.881 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.881 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.881 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:38.881 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:48:38.881 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:48:38.881 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.882 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.882 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:48:38.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:48:38.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.882 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.882 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:48:38.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:48:38.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.883 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:38.883 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:48:38.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:48:38.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:38.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:48:38.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:48:38.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:38.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:48:38.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:48:38.885 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.885 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:38.885 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.885 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:48:38.885 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:38.885 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 42.343411269000001, 2024-09-12T22:48:38.885 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:48:38.886 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:38.886 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:38.886 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.886 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:38.886 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.886 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:38.886 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:38.886 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.886 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.886 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.886 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:38.886 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:38.887 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.887 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.887 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.887 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:38.887 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:38.887 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:48:38.887 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.887 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.887 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:38.887 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:48:38.887 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:48:38.887 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.888 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.888 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:38.888 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:48:38.888 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:48:38.888 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.888 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.888 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.888 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:48:38.888 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:48:38.888 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.888 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.889 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.889 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:48:38.889 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:48:38.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.889 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.889 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:38.889 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:48:38.889 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:48:38.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.889 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.889 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:38.889 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:48:38.890 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:48:38.890 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.890 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:38.890 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:48:38.890 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:48:38.890 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.890 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:38.890 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.890 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.891 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:38.891 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:38.891 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 33.698175714999998, 2024-09-12T22:48:38.891 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:48:38.891 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:38.891 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:38.891 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.891 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:38.891 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.891 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:38.891 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:38.892 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.892 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.892 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.892 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:38.892 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:38.892 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.892 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.892 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.892 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:38.892 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:48:38.892 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:48:38.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.893 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:38.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:48:38.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:48:38.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.893 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:38.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:48:38.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:48:38.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.894 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.894 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:48:38.894 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:48:38.894 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.894 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.894 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.894 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:48:38.894 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:48:38.894 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.894 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.894 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:38.895 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:48:38.895 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:48:38.895 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.895 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.895 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.895 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:48:38.895 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:48:38.895 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.895 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.895 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:38.895 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:48:38.895 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:48:38.895 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.896 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.896 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:38.896 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:48:38.896 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:48:38.896 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.896 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.896 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:38.896 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:48:38.896 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:48:38.896 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.896 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.896 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:38.897 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:48:38.897 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:48:38.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.897 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:38.897 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:48:38.897 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:48:38.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.897 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:38.898 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:48:38.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:48:38.898 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.898 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:38.898 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.898 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.898 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.898 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:38.898 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:38.898 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 33.698076198000003, 2024-09-12T22:48:38.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:48:38.899 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:38.899 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:38.899 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.899 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:38.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.899 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:38.899 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:38.899 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.899 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.899 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:38.899 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:38.899 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.900 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.900 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.900 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:38.900 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:48:38.900 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:48:38.900 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.900 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.900 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:38.900 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:48:38.900 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:48:38.900 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.901 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.901 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:38.901 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:48:38.901 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:48:38.901 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.901 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.901 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.901 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:48:38.901 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:48:38.901 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.901 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.901 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.902 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:48:38.902 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:48:38.902 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.902 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.902 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:38.902 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:48:38.902 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:48:38.902 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.902 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.902 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.902 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:48:38.903 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:48:38.903 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.903 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.903 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:38.903 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:48:38.903 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:48:38.903 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.903 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.903 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:38.903 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:48:38.904 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:48:38.904 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.904 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.904 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:38.904 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:48:38.904 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:48:38.904 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.904 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.904 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:38.904 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:48:38.904 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:48:38.904 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.905 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.905 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:38.905 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:48:38.905 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:48:38.905 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.905 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.905 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:38.905 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:48:38.905 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:48:38.905 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.905 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:38.905 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.906 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.906 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.906 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:38.906 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:38.906 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 33.698031458999999, 2024-09-12T22:48:38.906 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:48:38.906 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:38.906 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:38.906 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.906 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:38.906 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.907 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:38.907 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:38.907 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.907 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.907 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.907 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:38.907 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:38.907 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.907 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.907 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.907 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:38.907 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:48:38.908 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:48:38.908 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.908 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.908 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:38.908 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:48:38.908 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:48:38.908 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.908 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.908 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:38.908 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:48:38.908 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:48:38.908 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.909 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.909 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.909 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:48:38.909 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:48:38.909 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.909 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.909 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.909 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:48:38.909 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:48:38.909 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.909 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.909 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:38.910 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:48:38.910 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:48:38.910 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.910 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.910 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:48:38.910 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:48:38.910 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.910 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:38.910 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:48:38.910 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:48:38.910 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.911 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:38.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:48:38.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:48:38.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.911 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:38.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:48:38.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:48:38.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.911 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:38.912 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:48:38.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:48:38.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.912 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.912 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:38.912 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:48:38.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:48:38.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.912 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.912 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:38.913 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:48:38.913 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:48:38.913 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.913 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:38.913 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.913 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.913 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.913 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:38.913 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:38.913 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 33.697803757999999, 2024-09-12T22:48:38.914 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:48:38.914 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:38.914 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:38.914 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.914 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:38.914 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.914 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:38.914 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:38.914 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.914 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.914 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.914 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:38.915 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:38.915 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.915 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.915 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.915 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:38.915 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:48:38.915 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:48:38.915 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.915 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.915 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:38.915 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:48:38.915 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:48:38.916 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.916 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.916 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:38.916 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:48:38.916 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:48:38.916 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.916 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.916 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.916 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:48:38.916 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:48:38.916 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.916 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.917 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.917 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:48:38.917 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:48:38.917 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.917 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.917 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:38.917 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:48:38.917 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:48:38.917 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.917 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.917 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.918 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:48:38.918 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:48:38.918 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.918 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.918 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:38.918 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:48:38.918 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:48:38.918 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.918 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.918 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:38.918 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:48:38.918 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:48:38.919 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.919 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.919 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:38.919 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:48:38.919 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:48:38.919 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.919 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.919 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:38.919 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:48:38.919 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:48:38.919 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.919 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.920 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:38.920 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:48:38.920 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:48:38.920 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.920 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.920 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:38.920 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:48:38.920 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:48:38.920 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.920 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:38.920 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.921 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.921 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.921 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:38.921 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:38.921 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 33.697638650000002, 2024-09-12T22:48:38.921 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:48:38.921 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:38.921 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:38.921 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.921 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:38.921 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.921 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:38.922 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:38.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.922 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.922 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:38.922 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:38.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.922 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.922 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:38.922 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:48:38.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:48:38.923 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.923 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.923 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:38.923 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:48:38.923 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:48:38.923 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.923 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.923 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:38.923 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:48:38.923 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:48:38.923 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.923 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.924 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.924 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:48:38.924 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:48:38.924 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.924 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.924 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.924 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:48:38.924 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:48:38.924 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.924 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.924 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:38.925 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:48:38.925 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:48:38.925 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.925 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.925 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.925 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:48:38.925 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:48:38.925 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.925 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.925 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:38.925 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:48:38.926 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:48:38.926 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.926 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.926 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:38.926 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:48:38.926 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:48:38.926 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.926 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.926 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:38.926 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:48:38.926 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:48:38.927 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.927 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.927 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:38.927 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:48:38.927 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:48:38.927 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.927 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.927 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:38.927 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:48:38.927 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:48:38.927 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.927 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.928 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:38.928 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:48:38.928 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:48:38.928 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.928 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:38.928 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.928 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.928 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.928 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:38.928 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:38.928 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 33.697577365000001, 2024-09-12T22:48:38.929 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:48:38.929 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:38.929 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:38.929 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.929 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:38.929 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.929 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:38.929 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:38.929 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.929 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.929 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.929 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:38.930 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:38.930 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.930 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.930 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.930 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:38.930 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:38.930 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:48:38.930 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.930 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.930 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:38.930 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:48:38.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:48:38.931 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.931 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.931 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:38.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:48:38.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:48:38.932 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.932 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.932 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.932 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:48:38.932 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:48:38.932 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.932 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.932 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.932 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:48:38.932 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:48:38.933 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.933 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.933 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:38.933 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:48:38.933 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:48:38.933 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.933 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.933 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.933 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:48:38.933 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:48:38.933 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.933 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.934 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:38.934 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:48:38.934 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:48:38.934 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.934 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.934 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:38.934 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:48:38.934 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:48:38.934 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.934 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.934 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:38.935 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:48:38.935 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:48:38.935 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.935 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.935 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:38.935 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:48:38.935 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:48:38.935 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.935 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.935 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:38.935 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:48:38.935 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:48:38.936 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.936 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.936 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:38.936 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:48:38.936 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:48:38.936 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.936 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:38.936 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.936 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.936 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.936 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:38.937 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:38.937 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 33.697497257000002, 2024-09-12T22:48:38.937 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:48:38.937 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:38.937 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:38.937 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.937 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:38.937 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.937 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:38.937 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:38.937 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.937 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.937 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.938 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:38.938 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:38.938 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.938 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.938 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.938 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:38.938 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:48:38.938 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:48:38.938 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.938 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.938 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:38.938 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:48:38.939 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:48:38.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.939 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.939 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:38.939 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:48:38.939 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:48:38.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.939 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.939 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.939 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:48:38.939 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:48:38.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.939 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.940 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.940 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:48:38.940 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:48:38.940 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.940 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.940 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:38.940 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:48:38.940 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:48:38.940 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.940 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.940 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.940 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:48:38.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:48:38.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.941 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.941 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:38.941 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:48:38.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:48:38.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.941 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.941 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:38.941 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:48:38.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:48:38.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.942 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.942 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:38.942 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:48:38.942 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:48:38.942 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.942 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.942 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:38.942 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:48:38.942 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:48:38.942 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.942 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.942 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:38.942 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:48:38.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:48:38.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.943 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:38.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:48:38.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:48:38.943 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.943 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:38.943 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.943 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:38.943 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:38.944 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 33.697448303999998, 2024-09-12T22:48:38.944 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:48:38.944 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:38.944 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:38.944 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:48:38.944 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:38.944 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.944 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:38.944 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:38.944 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.944 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.945 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.945 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:38.945 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:38.945 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.945 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.945 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.945 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:38.945 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:38.945 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:48:38.945 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.945 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.945 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:38.946 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:48:38.946 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:48:38.946 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.946 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.946 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:38.946 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:48:38.946 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:48:38.946 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.946 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.946 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.946 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:48:38.946 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:48:38.946 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.947 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.947 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.947 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:48:38.947 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:48:38.947 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.947 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.947 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:38.947 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:48:38.947 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:48:38.947 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.947 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.947 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:38.947 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:48:38.947 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:48:38.948 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.948 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:38.948 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.948 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.948 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.948 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:38.948 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:38.948 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 33.697399204, 2024-09-12T22:48:38.948 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:48:38.948 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:38.948 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:38.948 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:48:38.948 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:38.949 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.949 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:38.949 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:38.949 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.949 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.949 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.949 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:38.949 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:38.949 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.949 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.949 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.949 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:38.949 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:48:38.950 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:48:38.950 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.950 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.950 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:38.950 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:48:38.950 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:48:38.950 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.950 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.950 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:38.950 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:48:38.950 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:48:38.950 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.950 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.950 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.951 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:48:38.951 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:48:38.951 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.951 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.951 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.951 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:48:38.951 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:48:38.951 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.951 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.951 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:38.951 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:48:38.951 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:48:38.951 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.951 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.952 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:38.952 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:48:38.952 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:48:38.952 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.952 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:38.952 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.952 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.952 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.952 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:38.952 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:38.952 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 33.690458753999998, 2024-09-12T22:48:38.952 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:48:38.952 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:38.952 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:38.953 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.953 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:38.953 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.953 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:38.953 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:38.953 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.953 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.953 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.953 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:38.953 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:38.953 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.953 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.953 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.953 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:38.954 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:48:38.954 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:48:38.954 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.954 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.954 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:38.954 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:48:38.954 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:48:38.954 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.954 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.954 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:38.954 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:48:38.954 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:48:38.954 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.954 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.955 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.955 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:48:38.955 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:48:38.955 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.955 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.955 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.955 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:48:38.955 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:48:38.955 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.955 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.955 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:38.956 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:48:38.956 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:48:38.956 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.956 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.956 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:38.956 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:48:38.956 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:48:38.957 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.957 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.957 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:38.957 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:48:38.957 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:48:38.957 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.957 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:38.957 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.957 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.957 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.957 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:38.957 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:38.957 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 33.689369913999997, 2024-09-12T22:48:38.958 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:48:38.958 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:38.958 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:38.958 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.958 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:38.958 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.958 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:38.958 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:38.958 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.958 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.958 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.958 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:38.958 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:38.958 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.959 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.959 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.959 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:38.959 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:48:38.959 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:48:38.959 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.959 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.959 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:38.959 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:48:38.959 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:48:38.959 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.959 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.959 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:38.959 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:48:38.960 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:48:38.960 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.960 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.960 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.960 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:48:38.960 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:48:38.960 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.960 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.960 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.960 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:48:38.960 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:48:38.960 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.961 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.961 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:38.961 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:48:38.961 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:48:38.961 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.961 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.961 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:38.961 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:48:38.961 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:48:38.961 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.961 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.961 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:38.961 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:48:38.961 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:48:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 33.689320303000002, 2024-09-12T22:48:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:48:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.963 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:38.963 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:38.963 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.963 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.963 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.963 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:38.964 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:38.964 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.964 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.964 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.964 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:38.965 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:38.965 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:48:38.965 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.965 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.965 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:38.965 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:38.965 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:48:38.965 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.965 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.965 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:38.965 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:48:38.965 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:48:38.965 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:48:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:48:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:48:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:48:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:48:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:48:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:48:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:48:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:48:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:48:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 33.689252994, 2024-09-12T22:48:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:48:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:48:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:48:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:48:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:48:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:48:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:48:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:48:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:48:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:48:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:48:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:48:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:48:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:48:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:48:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:48:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 33.688685075000002, 2024-09-12T22:48:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:48:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:48:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:48:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:48:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:48:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:48:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:48:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:48:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:48:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:48:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:48:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:48:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:48:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:48:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:48:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:48:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:48:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 33.688307471000002, 2024-09-12T22:48:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:48:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:48:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:48:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:48:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:48:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:48:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:48:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:48:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:48:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:48:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:48:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:48:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:48:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:48:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:48:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:48:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:48:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:38.982 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:38.983 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:38.984 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:38.982+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:39.084 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:39.083+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:39.093 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:39.093 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:48:39.093 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:48:39.093 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:39.105 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:39.185 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:39.184+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:39.191 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:48:39.208 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:39.208 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:48:39.208 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:48:39.208 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:48:39.208 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:39.217 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:39.286 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:39.286+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:39.330 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:48:39.330 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:48:39.348 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:48:39.348 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:48:39.348 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:48:39.351 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:48:39.352 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:48:39.362 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:39.362 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:39.371 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:39.387 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:39.386+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:39.416 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:48:39.477 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:39.477 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:39.486 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:39.487 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:39.486+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:39.587 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:39.588 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:39.588 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:39.587+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:39.596 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:39.689 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:39.688+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:39.698 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:39.698 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:39.707 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:39.789 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:39.788+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:39.811 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:39.811 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:39.821 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:39.905 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:39.904+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:39.964 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:39.964 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:39.973 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:40.014 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:40.013+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:40.092 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:40.091+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:40.116 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:40.116 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:40.125 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:40.193 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:40.192+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:40.228 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:40.228 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:40.237 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:40.293 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:40.292+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:40.339 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:40.339 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:40.348 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:40.415 INFO:teuthology.orchestra.run.smithi066.stderr:noscrub is unset 2024-09-12T22:48:40.432 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:40.431+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:40.491 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:40.491 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:40.494 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:40.494+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:40.500 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:40.595 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:40.594+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:40.608 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:40.608 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:40.616 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:40.697 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:40.696+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:40.719 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:40.719 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:40.727 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:40.800 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:40.796+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:40.830 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:40.830 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:40.839 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:40.898 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:40.897+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:40.942 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:40.942 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:40.950 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:40.999 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:40.998+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:41.095 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:41.095 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:41.099 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:41.098+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:41.104 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:41.201 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:41.200+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:41.206 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:41.206 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:41.215 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:41.302 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:41.301+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:41.318 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:41.319 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:41.327 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:41.353 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:48:41.403 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:41.402+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:41.414 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-09-12T22:48:41.414 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T22:48:41.415 INFO:tasks.thrashosds.thrasher:Reviving osd 2 2024-09-12T22:48:41.415 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.2 doing powercycle of ubuntu@smithi117.front.sepia.ceph.com 2024-09-12T22:48:41.415 INFO:teuthology.orchestra.console.smithi117:Power on 2024-09-12T22:48:41.415 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-09-12T22:48:41.439 DEBUG:teuthology.orchestra.console.smithi117:power on output: Chassis Power Control: Up/On 2024-09-12T22:48:41.470 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:41.470 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:41.479 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:41.483 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:48:41.483 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:48:41.500 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:48:41.501 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:48:41.501 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:48:41.504 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:48:41.504 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:48:41.505 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:41.503+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:41.583 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:41.583 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:48:41.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:48:41.583 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:48:41.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.583 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:48:41.583 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:41.584 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.534752883000003, 2024-09-12T22:48:41.584 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:48:41.584 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:41.584 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:41.584 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:41.584 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:41.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.584 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:41.584 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:41.584 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.584 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:41.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:41.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.585 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:41.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:41.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:48:41.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.585 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:41.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:48:41.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:48:41.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:41.586 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:48:41.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:48:41.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:41.586 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:48:41.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:48:41.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:41.586 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:48:41.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:48:41.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:41.587 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:48:41.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:48:41.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:41.587 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:48:41.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:48:41.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.588 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:41.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:48:41.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:48:41.588 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.588 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:41.588 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.588 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:48:41.588 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:41.588 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.534372156000003, 2024-09-12T22:48:41.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:48:41.588 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:41.589 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:41.589 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:41.589 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:41.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.589 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:41.589 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:41.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.589 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:41.589 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:41.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:41.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:48:41.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:48:41.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:41.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:48:41.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:48:41.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:41.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:48:41.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:48:41.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:41.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:48:41.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:48:41.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:41.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:48:41.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:48:41.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.592 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:41.592 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:48:41.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:48:41.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.592 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:41.592 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:48:41.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:48:41.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.592 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:41.592 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:48:41.593 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:48:41.593 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.593 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:41.593 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.593 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:48:41.593 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:41.593 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.413775346000001, 2024-09-12T22:48:41.593 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:48:41.593 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:41.593 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:41.594 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:48:41.594 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:41.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.594 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:41.594 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:41.594 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.594 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:41.594 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:41.594 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.594 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:41.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:41.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:48:41.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:41.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:48:41.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:48:41.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:41.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:48:41.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:48:41.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:41.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:48:41.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:48:41.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:41.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:48:41.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:48:41.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:41.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:48:41.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:48:41.597 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.597 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:41.597 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.597 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:41.597 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:41.597 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.411167165999998, 2024-09-12T22:48:41.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:48:41.597 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:41.597 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:41.597 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:41.597 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:41.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.598 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:41.598 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:41.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.598 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.598 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:41.598 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:41.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.598 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.598 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:41.598 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:48:41.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:48:41.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:41.599 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:48:41.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:48:41.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:41.599 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:48:41.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:48:41.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:41.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:48:41.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:48:41.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:41.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:48:41.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:48:41.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:41.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:48:41.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:48:41.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:41.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:48:41.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:48:41.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:41.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:48:41.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:48:41.601 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.601 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:41.601 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.602 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:41.602 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:41.602 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.410273943, 2024-09-12T22:48:41.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:48:41.602 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:41.602 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:41.602 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:41.602 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:41.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:41.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:41.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:41.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:41.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:41.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:48:41.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:48:41.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.604 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:41.604 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:48:41.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:48:41.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.604 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:41.604 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:48:41.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:48:41.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.604 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:41.604 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:48:41.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:48:41.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:41.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:48:41.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:48:41.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:41.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:48:41.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:48:41.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:41.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:48:41.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:48:41.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:41.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:48:41.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:48:41.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:41.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:48:41.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:48:41.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:41.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:48:41.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:48:41.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:41.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:48:41.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:48:41.607 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.607 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:41.607 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.607 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:41.608 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:41.608 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.410202284999997, 2024-09-12T22:48:41.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:48:41.608 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:41.608 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:41.608 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:41.608 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:41.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:41.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:41.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:41.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:41.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:41.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:48:41.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:48:41.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:41.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:48:41.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:48:41.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:41.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:48:41.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:48:41.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:41.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:48:41.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:48:41.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:41.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:48:41.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:48:41.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:41.611 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:48:41.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:48:41.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:41.611 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:48:41.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:48:41.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:41.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:48:41.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:48:41.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:41.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:48:41.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:48:41.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:41.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:48:41.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:48:41.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:41.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:48:41.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:48:41.613 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.613 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:41.613 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.613 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:41.613 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:41.613 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.410159567000001, 2024-09-12T22:48:41.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:48:41.614 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:41.614 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:41.614 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:41.614 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:41.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:41.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:41.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:41.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:41.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:41.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:48:41.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:48:41.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:41.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:48:41.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:48:41.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:41.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:48:41.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:48:41.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:41.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:48:41.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:48:41.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:41.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:48:41.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:48:41.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:41.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:48:41.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:48:41.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:41.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:48:41.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:48:41.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:41.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:48:41.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:48:41.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:41.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:48:41.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:48:41.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:41.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:48:41.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:48:41.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:41.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:48:41.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:48:41.619 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.619 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:41.619 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.619 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:41.619 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:41.619 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.410121650000001, 2024-09-12T22:48:41.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:48:41.619 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:41.619 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:41.619 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:41.619 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:41.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:41.620 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:41.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:41.620 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:41.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:41.621 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:48:41.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:48:41.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.621 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:41.621 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:48:41.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:48:41.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.621 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:41.621 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:48:41.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:48:41.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:41.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:48:41.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:48:41.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:41.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:48:41.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:48:41.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:41.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:48:41.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:48:41.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:41.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:41.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:48:41.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:41.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:48:41.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:48:41.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:41.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:48:41.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:48:41.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:41.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:48:41.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:48:41.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:41.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:48:41.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:48:41.626 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.626 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:41.626 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.626 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:41.626 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:41.626 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.410098198999997, 2024-09-12T22:48:41.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:48:41.626 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:41.626 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:41.627 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:41.627 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:41.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:41.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:41.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:41.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:41.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:41.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:48:41.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:48:41.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:41.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:48:41.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:48:41.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:41.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:48:41.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:48:41.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:41.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:48:41.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:48:41.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:41.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:48:41.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:48:41.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:41.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:48:41.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:48:41.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:41.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:41.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:48:41.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:41.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:48:41.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:48:41.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:41.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:48:41.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:48:41.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:41.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:48:41.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:48:41.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:41.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:48:41.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:48:41.632 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.632 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:41.632 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.632 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.632 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.632 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:41.632 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:41.632 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.410073961999998, 2024-09-12T22:48:41.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:48:41.632 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:41.632 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:41.632 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:41.633 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:41.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:41.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:41.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:41.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:41.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:41.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:41.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:48:41.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:41.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:48:41.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:48:41.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:41.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:48:41.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:48:41.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:41.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:48:41.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:48:41.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:41.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:48:41.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:48:41.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:41.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:48:41.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:48:41.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:41.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:48:41.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:48:41.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:41.637 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:48:41.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:48:41.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.637 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:41.637 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:48:41.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:48:41.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.637 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:41.637 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:48:41.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:48:41.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:41.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:48:41.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:48:41.638 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.638 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:41.638 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.638 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:41.638 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:41.638 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.410046045000001, 2024-09-12T22:48:41.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:48:41.639 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:41.639 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:41.639 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:41.639 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:41.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:41.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:41.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:41.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:41.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:41.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:41.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:48:41.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:41.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:48:41.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:48:41.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:41.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:48:41.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:48:41.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:41.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:48:41.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:48:41.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:41.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:48:41.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:48:41.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:41.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:48:41.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:48:41.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:41.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:48:41.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:48:41.642 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.642 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:41.642 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.643 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:41.643 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:41.643 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.409971550000002, 2024-09-12T22:48:41.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:48:41.643 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:41.643 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:41.643 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:41.643 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:41.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:41.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:41.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:41.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:41.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:41.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:48:41.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:48:41.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:41.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:48:41.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:48:41.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:41.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:48:41.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:48:41.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:41.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:48:41.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:48:41.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:41.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:48:41.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:48:41.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:41.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:48:41.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:48:41.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:41.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:48:41.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:48:41.647 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.647 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:41.647 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.647 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:41.647 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:41.647 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.409925522000002, 2024-09-12T22:48:41.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:48:41.647 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:41.647 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:41.648 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:41.648 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:41.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:41.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:41.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:41.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:41.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:41.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:48:41.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:48:41.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:41.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:48:41.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:48:41.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:41.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:48:41.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:48:41.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:41.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:48:41.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:48:41.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:41.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:48:41.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:48:41.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:41.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:48:41.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:48:41.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:41.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:48:41.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:48:41.651 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.651 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:41.651 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.651 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:41.651 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:41.652 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.407754638, 2024-09-12T22:48:41.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:48:41.652 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:41.652 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:41.652 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:41.652 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:41.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:41.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:41.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:41.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:41.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:41.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:41.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:48:41.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:41.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:48:41.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:48:41.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:41.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:48:41.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:48:41.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:41.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:41.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:48:41.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:41.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:48:41.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:48:41.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:41.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:41.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:48:41.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:41.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:48:41.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:48:41.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:41.656 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:48:41.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:48:41.656 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.656 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:41.656 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.656 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:41.657 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:41.657 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.407704187999997, 2024-09-12T22:48:41.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:48:41.657 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:41.657 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:41.657 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:41.657 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:41.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:41.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:41.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:41.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:41.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:41.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:48:41.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:48:41.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:41.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:48:41.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:48:41.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:41.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:48:41.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:48:41.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:41.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:48:41.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:48:41.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:41.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:48:41.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:48:41.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:41.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:48:41.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:48:41.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:41.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:48:41.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:48:41.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:41.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:48:41.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:48:41.661 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.661 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:41.661 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.661 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:41.661 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:41.662 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.407650750000002, 2024-09-12T22:48:41.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:48:41.662 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:41.662 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:41.662 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:41.662 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:41.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:41.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:41.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:41.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:41.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:41.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:41.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:48:41.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:41.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:48:41.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:48:41.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:41.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:41.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:48:41.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:41.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:48:41.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:48:41.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:41.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:48:41.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:48:41.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:41.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:48:41.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:48:41.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:41.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:48:41.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:48:41.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:41.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:48:41.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:48:41.666 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.666 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:41.666 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.666 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:48:41.666 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:41.666 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.403666397000002, 2024-09-12T22:48:41.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:48:41.667 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:41.667 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:41.667 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:41.667 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:41.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:41.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:41.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:41.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:41.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:41.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:48:41.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:48:41.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:41.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:48:41.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:48:41.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:41.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:48:41.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:48:41.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:41.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:48:41.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:48:41.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:41.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:48:41.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:48:41.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:41.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:48:41.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:48:41.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:41.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:48:41.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:48:41.670 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.670 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:41.670 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.671 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:48:41.671 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:41.671 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.418513857999997, 2024-09-12T22:48:41.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:48:41.671 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:41.671 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:41.671 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:41.671 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:41.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:41.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:41.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:41.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:41.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:41.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:48:41.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:48:41.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:41.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:48:41.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:48:41.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:41.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:48:41.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:48:41.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:41.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:48:41.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:48:41.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:41.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:48:41.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:48:41.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:41.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:48:41.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:48:41.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:41.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:48:41.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:48:41.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:41.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:48:41.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:48:41.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:41.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:48:41.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:48:41.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:41.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:48:41.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:48:41.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:41.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:48:41.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:48:41.676 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.676 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:41.676 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.676 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:48:41.676 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:41.677 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.416597613, 2024-09-12T22:48:41.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:48:41.677 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:41.677 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:41.677 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:41.677 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:41.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:41.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:41.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:41.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:41.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:41.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:48:41.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:48:41.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:41.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:48:41.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:48:41.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:41.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:48:41.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:48:41.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:41.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:48:41.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:48:41.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:41.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:48:41.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:48:41.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:41.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:48:41.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:48:41.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:41.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:48:41.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:48:41.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:41.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:48:41.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:48:41.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:41.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:48:41.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:48:41.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:41.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:48:41.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:48:41.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:41.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:48:41.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:48:41.682 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.682 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:41.682 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.682 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:48:41.682 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:41.682 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 11.415844238, 2024-09-12T22:48:41.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012160610000000001, 2024-09-12T22:48:41.683 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:41.683 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:41.683 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:41.683 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:41.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:41.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:41.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:41.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:41.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:41.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:41.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164967+0000", 2024-09-12T22:48:41.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:48:41.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:41.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164974+0000", 2024-09-12T22:48:41.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:48:41.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:41.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164987+0000", 2024-09-12T22:48:41.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3689000000000001e-05 2024-09-12T22:48:41.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:41.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164995+0000", 2024-09-12T22:48:41.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2959999999999999e-06 2024-09-12T22:48:41.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:41.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165068+0000", 2024-09-12T22:48:41.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2449999999999999e-05 2024-09-12T22:48:41.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:41.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165212+0000", 2024-09-12T22:48:41.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144117 2024-09-12T22:48:41.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:41.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166066+0000", 2024-09-12T22:48:41.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085441100000000002 2024-09-12T22:48:41.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:41.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166107+0000", 2024-09-12T22:48:41.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0450000000000001e-05 2024-09-12T22:48:41.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:41.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:41.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:41.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166181+0000", 2024-09-12T22:48:41.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-12T22:48:41.687 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.687 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:41.687 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.687 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:41.687 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:41.687 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:41.689 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:41.689 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:41.688+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:41.790 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:41.789+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:41.793 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:41.793 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:48:41.793 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:48:41.793 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:41.804 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:41.892 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:41.890+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:41.947 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:41.947 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:48:41.947 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:48:41.947 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:48:41.948 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:41.956 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:42.000 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:41.999+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:42.061 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:42.061 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:48:42.061 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:48:42.061 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:48:42.061 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.062 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:48:42.062 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:42.062 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 45.675267056999999, 2024-09-12T22:48:42.062 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:48:42.062 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:42.062 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:42.062 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:42.062 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:42.062 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.062 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:42.062 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:42.062 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.062 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.063 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.063 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:42.063 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:42.063 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.063 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.063 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.063 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:42.064 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:42.064 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:48:42.064 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.064 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.064 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:42.064 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:48:42.064 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:48:42.064 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.064 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.064 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:42.064 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:48:42.064 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:48:42.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.065 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.065 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.065 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:48:42.065 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:48:42.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.065 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.065 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:42.065 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:48:42.065 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:48:42.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.065 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.065 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:42.066 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:48:42.066 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:48:42.066 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.066 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.066 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:42.066 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:48:42.066 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:48:42.066 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.066 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.066 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:42.066 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:48:42.066 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:48:42.066 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.067 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:42.067 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.067 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.067 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.067 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:48:42.067 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:42.067 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 45.674824473999998, 2024-09-12T22:48:42.067 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:48:42.067 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:42.067 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:42.068 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:42.068 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:42.068 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.068 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:42.068 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:42.068 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.068 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.068 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.068 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:42.068 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:42.068 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.069 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:42.069 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:48:42.069 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:48:42.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.069 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:42.069 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:48:42.069 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:48:42.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.069 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:42.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:48:42.070 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:48:42.070 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.070 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.070 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:48:42.070 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:48:42.070 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.070 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.070 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:42.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:48:42.071 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:48:42.071 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.071 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.071 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:42.071 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:48:42.071 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:48:42.071 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.071 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.071 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:42.072 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:48:42.072 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:48:42.072 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.072 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.072 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:42.072 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:48:42.072 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:48:42.072 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.072 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:42.072 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.073 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.073 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.073 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:48:42.073 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:42.073 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 45.674458317000003, 2024-09-12T22:48:42.073 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:48:42.073 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:42.073 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:42.073 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:42.073 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:42.074 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.074 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:42.074 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:42.074 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.074 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.074 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:42.074 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:42.074 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.074 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.074 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:42.074 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:48:42.075 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:48:42.075 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.075 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.075 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:42.075 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:48:42.075 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:48:42.075 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.075 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.075 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:42.075 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:48:42.076 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:48:42.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.076 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.076 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.076 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:48:42.076 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:48:42.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.076 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.076 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:42.076 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:48:42.077 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:48:42.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.077 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:42.077 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:48:42.077 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:48:42.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.077 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:42.077 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:48:42.077 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:48:42.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.078 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:42.078 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:48:42.078 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:48:42.078 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.078 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:42.078 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.078 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.078 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.078 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:48:42.079 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:42.079 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 45.674046005000001, 2024-09-12T22:48:42.079 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:48:42.079 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:42.079 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:42.079 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:42.079 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:42.079 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.079 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:42.080 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:42.080 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.080 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.080 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:42.080 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:42.080 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.081 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:42.081 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:42.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:48:42.081 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.081 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:42.081 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:48:42.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:48:42.081 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.081 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:42.082 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:48:42.082 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:48:42.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.082 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.082 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.082 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:48:42.082 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:48:42.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.082 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.082 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:42.082 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:48:42.082 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:48:42.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.083 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:42.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:48:42.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:48:42.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.083 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:42.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:48:42.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:48:42.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:42.084 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:48:42.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:48:42.084 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.084 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:42.084 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.084 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:48:42.085 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:42.085 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 45.540195910999998, 2024-09-12T22:48:42.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:48:42.085 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:42.085 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:42.085 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:42.085 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:42.085 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.085 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:42.085 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:42.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.085 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.085 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.086 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:42.086 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:42.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.086 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:42.086 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:42.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:48:42.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.086 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:42.086 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:48:42.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:48:42.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:42.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:48:42.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:48:42.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:48:42.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:48:42.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:42.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:48:42.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:48:42.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:42.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:48:42.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:48:42.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:42.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:48:42.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:48:42.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:42.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:48:42.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:48:42.089 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.090 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:42.090 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.090 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:42.090 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:42.090 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.894960357000002, 2024-09-12T22:48:42.090 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:48:42.090 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:42.090 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:42.091 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:42.091 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:42.091 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.091 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:42.091 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:42.091 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.091 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.091 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.091 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:42.091 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:42.091 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.091 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.091 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:42.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:48:42.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:48:42.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:42.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:48:42.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:48:42.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:42.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:48:42.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:48:42.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:48:42.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:48:42.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:42.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:48:42.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:48:42.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:42.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:48:42.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:48:42.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:42.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:48:42.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:48:42.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:42.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:48:42.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:48:42.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.095 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:42.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:48:42.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:48:42.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.095 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:42.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:48:42.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:48:42.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:42.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:48:42.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:48:42.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:42.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:48:42.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:48:42.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:42.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:48:42.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:48:42.097 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.097 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:42.097 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.097 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:42.097 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:42.097 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.89486084, 2024-09-12T22:48:42.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:48:42.097 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:42.097 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:42.098 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:42.098 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:42.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:42.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:42.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:42.099 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:42.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.099 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:42.099 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:48:42.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:48:42.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.099 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:42.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:48:42.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:48:42.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:42.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:48:42.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:48:42.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:48:42.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:48:42.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:42.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:48:42.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:48:42.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:42.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:48:42.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:48:42.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:42.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:48:42.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:48:42.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.102 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:42.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:48:42.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:48:42.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.102 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:42.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:48:42.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:48:42.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:42.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:48:42.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:48:42.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:42.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:48:42.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:48:42.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:42.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:48:42.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:48:42.104 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.104 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.104 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:42.104 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:48:42.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:48:42.104 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.104 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:42.104 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.104 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.104 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.104 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:42.104 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:42.105 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.894816101000004, 2024-09-12T22:48:42.105 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:48:42.105 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:42.105 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:42.105 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:42.105 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:42.105 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.105 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:42.105 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:42.106 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.106 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.106 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:42.106 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:42.106 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.106 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.106 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:42.106 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:48:42.106 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:48:42.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.107 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.107 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:42.107 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:48:42.107 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:48:42.107 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.107 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.107 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:42.107 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:48:42.107 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:48:42.107 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.107 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.108 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.108 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:48:42.108 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:48:42.108 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.108 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.108 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:42.108 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:48:42.108 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:48:42.108 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.109 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.109 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:42.109 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:48:42.109 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:48:42.109 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.109 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.109 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:42.110 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:48:42.110 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:48:42.110 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.110 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.110 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:42.110 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:48:42.110 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:48:42.110 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.110 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.111 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:42.111 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:48:42.111 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:48:42.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.111 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.111 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:42.111 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:48:42.111 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:48:42.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.111 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.111 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:42.111 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:48:42.111 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:48:42.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.112 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.112 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:42.112 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:48:42.112 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:48:42.112 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.112 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.112 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:42.112 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:48:42.112 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:48:42.112 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.112 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:42.112 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.112 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.113 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.113 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:42.113 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:42.113 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.894588400000004, 2024-09-12T22:48:42.113 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:48:42.113 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:42.113 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:42.113 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:42.113 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:42.113 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.113 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:42.114 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:42.114 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.114 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.114 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.114 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:42.114 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:42.114 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.114 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.114 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.114 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:42.114 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:48:42.114 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:48:42.114 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.114 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.115 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:42.115 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:48:42.115 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:48:42.115 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.115 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.115 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:42.115 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:48:42.115 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:48:42.115 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.115 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.115 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.115 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:48:42.115 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:48:42.116 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.116 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.116 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:42.116 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:48:42.116 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:48:42.116 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.116 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.116 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:42.116 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:48:42.116 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:48:42.116 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.116 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.117 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:42.117 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:48:42.117 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:48:42.117 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.117 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.117 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:42.117 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:48:42.117 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:48:42.117 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.117 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.117 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:42.117 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:48:42.117 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:48:42.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.118 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:42.118 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:48:42.118 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:48:42.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.118 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:42.118 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:48:42.118 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:48:42.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.118 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:42.118 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:48:42.119 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:48:42.119 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.119 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.119 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:42.119 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:48:42.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:48:42.120 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.120 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:42.120 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.120 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.121 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:42.121 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:42.121 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.894423291999999, 2024-09-12T22:48:42.121 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:48:42.121 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:42.121 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:42.121 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:42.121 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:42.121 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.121 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:42.121 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:42.122 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:42.122 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:42.122 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.123 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:42.123 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:48:42.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:48:42.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.123 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:42.123 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:48:42.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:48:42.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:42.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:48:42.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:48:42.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:48:42.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:48:42.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:42.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:48:42.125 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:48:42.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.125 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:42.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:48:42.125 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:48:42.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.125 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:42.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:48:42.125 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:48:42.126 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.126 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.126 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:42.126 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:48:42.126 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:48:42.126 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.126 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.126 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:42.126 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:48:42.126 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:48:42.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.127 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.127 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:42.127 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:48:42.127 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:48:42.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.127 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.127 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:42.127 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:48:42.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:48:42.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:42.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:48:42.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:48:42.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:42.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:48:42.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:48:42.129 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.129 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:42.129 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.129 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:42.129 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:42.129 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.894362006999998, 2024-09-12T22:48:42.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:48:42.129 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:42.129 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:42.129 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:42.129 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:42.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:42.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:42.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:42.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:42.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:42.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:42.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:48:42.131 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.131 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.131 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:42.131 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:48:42.131 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:48:42.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.132 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:42.132 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:48:42.132 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:48:42.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:48:42.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:48:42.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:42.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:48:42.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:48:42.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:42.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:48:42.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:48:42.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.134 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:42.134 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:48:42.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:48:42.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.134 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:42.134 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:48:42.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:48:42.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.134 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:42.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:48:42.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:48:42.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:42.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:48:42.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:48:42.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:42.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:48:42.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:48:42.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.136 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:42.136 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:48:42.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:48:42.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.136 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:42.136 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:48:42.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:48:42.136 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.136 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:42.137 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.137 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:42.137 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:42.137 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.894281898999999, 2024-09-12T22:48:42.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:48:42.137 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:42.137 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:42.137 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:42.137 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:42.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:42.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:42.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:42.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:42.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:42.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:48:42.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:48:42.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:42.139 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:48:42.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:48:42.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:42.139 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:48:42.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:48:42.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.139 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:48:42.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:48:42.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.140 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:42.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:48:42.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:48:42.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.140 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:42.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:48:42.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:48:42.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.140 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:42.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:48:42.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:48:42.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:42.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:48:42.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:48:42.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:42.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:48:42.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:48:42.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:42.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:48:42.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:48:42.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:42.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:48:42.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:48:42.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:42.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:48:42.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:48:42.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:42.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:48:42.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:48:42.143 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.143 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:42.143 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.143 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:42.143 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:42.143 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.894232946000002, 2024-09-12T22:48:42.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:48:42.144 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:42.144 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:42.144 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:48:42.144 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:42.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:42.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:42.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:42.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:42.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:42.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:42.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:48:42.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:42.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:48:42.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:48:42.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:42.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:48:42.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:48:42.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:48:42.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:48:42.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:42.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:48:42.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:48:42.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:42.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:48:42.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:48:42.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:42.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:48:42.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:48:42.147 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.147 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:42.147 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.147 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:42.148 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:42.148 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.894183845999997, 2024-09-12T22:48:42.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:48:42.148 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:42.148 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:42.148 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:48:42.148 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:42.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:42.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:42.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:42.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:42.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:42.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:48:42.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:48:42.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:42.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:48:42.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:48:42.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:42.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:48:42.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:48:42.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:48:42.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:48:42.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:42.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:48:42.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:48:42.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:42.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:48:42.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:48:42.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:42.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:48:42.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:48:42.152 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.152 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:42.152 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.152 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:42.152 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:42.152 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.887243396000002, 2024-09-12T22:48:42.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:48:42.152 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:42.153 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:42.153 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:42.153 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:42.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.153 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:42.153 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:42.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:42.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:42.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:42.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:48:42.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:48:42.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:42.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:48:42.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:48:42.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:42.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:48:42.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:48:42.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:48:42.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:48:42.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:42.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:48:42.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:48:42.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:42.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:48:42.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:48:42.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:42.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:48:42.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:48:42.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:42.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:48:42.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:48:42.159 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.159 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:42.159 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.160 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:42.160 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:42.160 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.886154556000001, 2024-09-12T22:48:42.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:48:42.160 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:42.160 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:42.160 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:42.160 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:42.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:42.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:42.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:42.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:42.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:42.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:48:42.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:48:42.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.163 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:42.163 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:48:42.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:48:42.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.163 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:42.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:48:42.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:48:42.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:48:42.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:48:42.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:42.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:48:42.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:48:42.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:42.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:48:42.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:48:42.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:42.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:48:42.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:48:42.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:42.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:48:42.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:48:42.167 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.167 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:42.167 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.167 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:42.167 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:42.168 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.886104945, 2024-09-12T22:48:42.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:48:42.168 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:42.168 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:42.168 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:42.168 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:42.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:42.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:42.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:42.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:42.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:42.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:42.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:48:42.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:42.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:42.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:48:42.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:42.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:48:42.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:48:42.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:48:42.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:48:42.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:42.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:48:42.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:48:42.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:42.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:48:42.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:48:42.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:42.172 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:48:42.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:48:42.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:42.172 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:48:42.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:48:42.172 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.172 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:42.172 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.173 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:42.173 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:42.173 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.886037635999998, 2024-09-12T22:48:42.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:48:42.173 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:42.173 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:42.174 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:42.174 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:42.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:42.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:42.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:42.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:42.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:42.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:42.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:48:42.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:42.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:48:42.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:48:42.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:42.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:48:42.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:48:42.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:48:42.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:48:42.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:42.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:48:42.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:48:42.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.177 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:42.177 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:48:42.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:48:42.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.177 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.177 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:42.177 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:48:42.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:48:42.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.178 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:42.178 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:48:42.178 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:48:42.181 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.182 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:42.182 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.182 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:42.182 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:42.182 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.885469716999999, 2024-09-12T22:48:42.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:48:42.182 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:42.182 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:42.183 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:42.183 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:42.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.183 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:42.183 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:42.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.183 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:42.183 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:42.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.183 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:42.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:42.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:48:42.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:42.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:48:42.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:48:42.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:42.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:48:42.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:48:42.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:48:42.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:48:42.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:42.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:48:42.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:48:42.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:42.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:48:42.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:48:42.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:42.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:48:42.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:48:42.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:42.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:48:42.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:48:42.186 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.186 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:42.187 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.187 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:48:42.187 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:42.187 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.885092112999999, 2024-09-12T22:48:42.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:48:42.187 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:42.187 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:42.187 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:42.187 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:42.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:42.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:42.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:42.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:42.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:42.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:42.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:48:42.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:48:42.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:42.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:48:42.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:48:42.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:42.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:48:42.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:48:42.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:48:42.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:48:42.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:42.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:48:42.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:48:42.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:42.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:48:42.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:48:42.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:42.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:48:42.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:48:42.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:42.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:42.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:42.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:48:42.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:48:42.191 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.191 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:42.192 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.192 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:42.192 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:42.192 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:42.193 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:42.194 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:42.192+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:42.294 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:42.293+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:42.305 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:42.305 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:48:42.305 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:48:42.305 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:42.314 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:42.398 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:42.397+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:42.430 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:48:42.457 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:42.458 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:48:42.458 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:48:42.458 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:48:42.458 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:42.466 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:42.495 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:42.495+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:42.596 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:42.595+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:42.610 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:42.610 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:48:42.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:48:42.611 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:48:42.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.611 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:48:42.611 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:42.611 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.561953136, 2024-09-12T22:48:42.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:48:42.612 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:42.612 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:42.612 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:42.612 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:42.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:42.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:42.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:42.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:42.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:42.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:42.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:48:42.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:42.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:48:42.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:48:42.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:42.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:48:42.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:48:42.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:48:42.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:48:42.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:42.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:48:42.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:48:42.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.619 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:42.619 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:48:42.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:48:42.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:42.620 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:48:42.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:48:42.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.621 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:42.621 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:48:42.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:48:42.621 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.621 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:42.621 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.622 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:48:42.622 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:42.622 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.561572409, 2024-09-12T22:48:42.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:48:42.623 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:42.623 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:42.623 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:42.623 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:42.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:42.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:42.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:42.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:42.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:42.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:48:42.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:48:42.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:42.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:48:42.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:48:42.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:42.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:48:42.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:48:42.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:48:42.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:48:42.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:42.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:48:42.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:48:42.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:42.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:48:42.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:48:42.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:42.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:48:42.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:48:42.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.632 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:42.632 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:48:42.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:48:42.632 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.632 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:42.633 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.633 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:48:42.633 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:42.633 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.440975598999998, 2024-09-12T22:48:42.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:48:42.634 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:42.634 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:42.634 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:48:42.634 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:42.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:42.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:42.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:42.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:42.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:42.637 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:42.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:48:42.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.637 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:42.637 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:48:42.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:48:42.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:42.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:48:42.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:48:42.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:48:42.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:48:42.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:42.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:48:42.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:48:42.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:42.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:48:42.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:48:42.640 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.640 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:42.640 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.641 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:42.641 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:42.641 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.438367419000002, 2024-09-12T22:48:42.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:48:42.641 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:42.641 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:42.641 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:42.641 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:42.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:42.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:42.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:42.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:42.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:42.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:48:42.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:48:42.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:42.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:48:42.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:48:42.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:42.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:48:42.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:48:42.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:48:42.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:48:42.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:42.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:48:42.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:48:42.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:42.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:48:42.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:48:42.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:42.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:48:42.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:48:42.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:42.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:48:42.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:48:42.648 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.649 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:42.649 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.649 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:42.649 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:42.650 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.437474195999997, 2024-09-12T22:48:42.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:48:42.650 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:42.650 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:42.650 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:42.650 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:42.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:42.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:42.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:42.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:42.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:42.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:48:42.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:48:42.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:42.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:48:42.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:48:42.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:42.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:48:42.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:48:42.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:48:42.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:48:42.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:42.656 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:48:42.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:48:42.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:42.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:48:42.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:48:42.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:42.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:48:42.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:48:42.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:42.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:48:42.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:48:42.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:42.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:48:42.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:48:42.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:42.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:48:42.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:48:42.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:42.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:48:42.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:48:42.661 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.661 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:42.661 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.661 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:42.661 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:42.661 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.437402538000001, 2024-09-12T22:48:42.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:48:42.661 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:42.662 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:42.662 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:42.662 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:42.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:42.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:42.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:42.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:42.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:42.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:48:42.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:48:42.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:42.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:48:42.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:48:42.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:42.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:48:42.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:48:42.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:48:42.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:48:42.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:42.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:48:42.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:48:42.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:42.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:48:42.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:48:42.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:42.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:48:42.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:48:42.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:42.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:48:42.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:48:42.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:42.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:48:42.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:48:42.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:42.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:48:42.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:48:42.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:42.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:48:42.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:48:42.667 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.667 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:42.667 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.667 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:42.667 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:42.667 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.437359819999998, 2024-09-12T22:48:42.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:48:42.667 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:42.667 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:42.667 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:42.668 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:42.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:42.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:42.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:42.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:42.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:42.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:48:42.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:48:42.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:42.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:48:42.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:48:42.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:42.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:48:42.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:48:42.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:48:42.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:48:42.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:42.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:48:42.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:48:42.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:42.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:48:42.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:48:42.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:42.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:48:42.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:48:42.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:42.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:48:42.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:48:42.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:42.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:48:42.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:48:42.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:42.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:48:42.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:48:42.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:42.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:48:42.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:48:42.672 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.672 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:42.672 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.673 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:42.673 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:42.673 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.437321902999997, 2024-09-12T22:48:42.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:48:42.673 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:42.673 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:42.673 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:42.673 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:42.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:42.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:42.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:42.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:42.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:42.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:48:42.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:48:42.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:42.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:48:42.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:48:42.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:42.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:48:42.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:48:42.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:48:42.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:48:42.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:42.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:48:42.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:48:42.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:42.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:48:42.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:48:42.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:42.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:42.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:48:42.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:42.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:48:42.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:48:42.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:42.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:48:42.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:48:42.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:42.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:48:42.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:48:42.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:42.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:48:42.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:48:42.678 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.678 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:42.678 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.678 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:42.678 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:42.678 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.437298452, 2024-09-12T22:48:42.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:48:42.679 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:42.679 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:42.679 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:42.679 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:42.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:42.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:42.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:42.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:42.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:42.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:48:42.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:48:42.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:42.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:48:42.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:48:42.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:42.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:48:42.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:48:42.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:48:42.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:48:42.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:42.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:48:42.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:48:42.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:42.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:48:42.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:48:42.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:42.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:42.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:48:42.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:42.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:48:42.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:48:42.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:42.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:48:42.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:48:42.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:42.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:48:42.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:48:42.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:42.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:48:42.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:48:42.684 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.684 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:42.684 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.684 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:42.684 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:42.684 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.437274215000002, 2024-09-12T22:48:42.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:48:42.684 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:42.684 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:42.684 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:42.684 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:42.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:42.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:42.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:42.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:42.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:42.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:42.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:48:42.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:42.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:48:42.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:48:42.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:42.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:48:42.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:48:42.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:48:42.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:48:42.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:42.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:48:42.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:48:42.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:42.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:48:42.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:48:42.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:42.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:48:42.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:48:42.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:42.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:48:42.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:48:42.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:42.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:48:42.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:48:42.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:42.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:48:42.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:48:42.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:42.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:48:42.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:48:42.689 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.689 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:42.689 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.690 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:42.690 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:42.690 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.437246297999998, 2024-09-12T22:48:42.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:48:42.690 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:42.690 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:42.690 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:42.690 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:42.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:42.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:42.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:42.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:42.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:42.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:42.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:48:42.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:42.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:48:42.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:48:42.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:42.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:48:42.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:48:42.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:48:42.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:48:42.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:42.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:48:42.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:48:42.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:42.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:48:42.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:48:42.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:42.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:48:42.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:48:42.694 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.694 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:42.694 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.694 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:42.694 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:42.694 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.437171802999998, 2024-09-12T22:48:42.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:48:42.694 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:42.694 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:42.694 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:42.694 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:42.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:42.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:42.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:42.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:42.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:42.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:48:42.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:48:42.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:42.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:48:42.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:48:42.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:42.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:48:42.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:48:42.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:48:42.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:48:42.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:42.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:48:42.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:48:42.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:42.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:48:42.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:48:42.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:42.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:48:42.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:48:42.698 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.698 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:42.698 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.698 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:42.698 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:42.698 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.437125774999998, 2024-09-12T22:48:42.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:48:42.698 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:42.698 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:42.699 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:42.699 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:42.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:42.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:42.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:42.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:42.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:42.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:48:42.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:48:42.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:42.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:48:42.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:48:42.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:42.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:48:42.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:48:42.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:48:42.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:48:42.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:42.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:48:42.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:48:42.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:42.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:48:42.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:48:42.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:42.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:48:42.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:48:42.702 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.702 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:42.702 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.702 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:42.702 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:42.703 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.434954890999997, 2024-09-12T22:48:42.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:48:42.703 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:42.703 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:42.703 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:42.703 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:42.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:42.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:42.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:42.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:42.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:42.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:42.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:48:42.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:42.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:48:42.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:48:42.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:42.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:48:42.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:48:42.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:42.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:48:42.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:42.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:48:42.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:48:42.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:42.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:42.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:48:42.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:42.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:48:42.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:48:42.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:42.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:48:42.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:48:42.707 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.707 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:42.707 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.707 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:42.707 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:42.707 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.434904441, 2024-09-12T22:48:42.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:48:42.707 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:42.707 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:42.707 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:42.707 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:42.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:42.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:42.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:42.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:42.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:42.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:48:42.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:48:42.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:42.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:48:42.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:48:42.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:42.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:48:42.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:48:42.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:48:42.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:48:42.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:42.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:48:42.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:48:42.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:42.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:48:42.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:48:42.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:42.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:48:42.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:48:42.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:42.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:48:42.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:48:42.711 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.711 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:42.711 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.712 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:42.712 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:42.712 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.434851002999999, 2024-09-12T22:48:42.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:48:42.712 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:42.712 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:42.712 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:42.712 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:42.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:42.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:42.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:42.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:42.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:42.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:42.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:48:42.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:42.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:48:42.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:48:42.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:42.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:42.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:48:42.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:48:42.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:48:42.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:42.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:48:42.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:48:42.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:42.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:48:42.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:48:42.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:42.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:48:42.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:48:42.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:42.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:48:42.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:48:42.716 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.716 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:42.716 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.716 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:48:42.716 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:42.716 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.430866649999999, 2024-09-12T22:48:42.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:48:42.716 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:42.716 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:42.717 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:42.717 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:42.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:42.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:42.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:42.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:42.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:42.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:48:42.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:48:42.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:42.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:48:42.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:48:42.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:42.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:48:42.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:48:42.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:48:42.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:48:42.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:42.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:48:42.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:48:42.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:42.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:48:42.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:48:42.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:42.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:48:42.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:48:42.720 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.720 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:42.720 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.720 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:48:42.720 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:42.720 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.445714111000001, 2024-09-12T22:48:42.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:48:42.721 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:42.721 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:42.721 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:42.721 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:42.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:42.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:42.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:42.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:42.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:42.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:48:42.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:48:42.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:42.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:48:42.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:48:42.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:42.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:48:42.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:48:42.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:48:42.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:48:42.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:42.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:48:42.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:48:42.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:42.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:48:42.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:48:42.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:42.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:48:42.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:48:42.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:42.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:48:42.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:48:42.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:42.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:48:42.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:48:42.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:42.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:48:42.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:48:42.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:42.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:48:42.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:48:42.726 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.726 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:42.726 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.726 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:48:42.726 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:42.726 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 17.443797866000001, 2024-09-12T22:48:42.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:48:42.726 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:42.726 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:42.726 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:42.726 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:42.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:42.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:42.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:42.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:42.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:42.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:48:42.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:48:42.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:42.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:48:42.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:48:42.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:42.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:48:42.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:48:42.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:48:42.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:48:42.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:42.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:48:42.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:48:42.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:42.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:48:42.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:48:42.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:42.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:48:42.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:48:42.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:42.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:48:42.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:48:42.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:42.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:48:42.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:48:42.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:42.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:48:42.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:48:42.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:42.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:48:42.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:48:42.731 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.731 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:42.731 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.732 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:48:42.732 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:42.732 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.443044491, 2024-09-12T22:48:42.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012160610000000001, 2024-09-12T22:48:42.732 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:42.732 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:42.732 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:42.732 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:42.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:42.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:42.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:42.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:42.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:42.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:42.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164967+0000", 2024-09-12T22:48:42.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:48:42.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:42.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164974+0000", 2024-09-12T22:48:42.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:48:42.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:42.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164987+0000", 2024-09-12T22:48:42.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3689000000000001e-05 2024-09-12T22:48:42.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:42.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164995+0000", 2024-09-12T22:48:42.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2959999999999999e-06 2024-09-12T22:48:42.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:42.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165068+0000", 2024-09-12T22:48:42.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2449999999999999e-05 2024-09-12T22:48:42.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:42.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165212+0000", 2024-09-12T22:48:42.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144117 2024-09-12T22:48:42.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:42.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166066+0000", 2024-09-12T22:48:42.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085441100000000002 2024-09-12T22:48:42.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:42.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166107+0000", 2024-09-12T22:48:42.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0450000000000001e-05 2024-09-12T22:48:42.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:42.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:42.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:42.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166181+0000", 2024-09-12T22:48:42.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-12T22:48:42.736 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.736 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:42.736 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.736 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:42.737 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:42.737 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:42.738 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:42.737+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:42.738 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:42.839 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:42.838+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:42.843 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:42.843 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:48:42.843 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:48:42.843 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:42.852 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:42.940 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:42.939+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:42.955 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:42.955 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:48:42.955 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:48:42.956 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:48:42.956 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:42.965 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:43.041 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:43.040+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:43.070 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:43.071 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:48:43.071 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:48:43.071 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:48:43.071 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.071 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:48:43.071 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:43.071 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 46.684500487999998, 2024-09-12T22:48:43.072 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:48:43.072 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:43.072 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:43.072 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:43.072 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:43.072 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.072 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:43.072 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:43.072 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.072 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.072 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.072 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:43.073 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:43.073 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.073 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.073 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.073 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:43.073 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:43.073 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:48:43.073 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.073 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.073 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:43.073 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:48:43.074 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:48:43.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.074 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.074 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:43.074 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:48:43.074 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:48:43.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.074 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.074 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.074 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:48:43.074 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:48:43.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.075 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.075 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:43.075 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:48:43.075 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:48:43.075 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.075 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.075 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:43.075 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:48:43.076 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:48:43.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.076 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.076 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:43.077 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:48:43.077 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:48:43.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.077 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:43.077 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:48:43.078 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:48:43.078 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.078 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:43.078 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.078 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.078 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.079 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:48:43.079 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:43.079 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 46.684057905000003, 2024-09-12T22:48:43.079 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:48:43.079 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:43.079 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:43.079 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:43.080 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:43.080 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.080 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:43.080 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:43.080 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.080 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.081 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:43.081 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:43.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.081 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.081 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:43.081 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:48:43.082 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:48:43.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.082 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.082 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:43.082 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:48:43.082 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:48:43.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.083 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:43.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:48:43.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:48:43.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.084 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:48:43.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:48:43.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.085 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:43.085 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:48:43.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:48:43.085 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.085 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.085 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:43.085 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:48:43.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:48:43.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.086 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:43.086 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:48:43.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:48:43.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.086 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:43.086 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:48:43.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:48:43.087 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.087 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:43.087 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.087 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:48:43.087 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:43.087 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 46.683691748000001, 2024-09-12T22:48:43.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:48:43.087 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:43.087 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:43.087 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:43.087 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:43.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:43.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:43.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:43.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:43.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:43.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:48:43.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:48:43.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:43.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:48:43.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:48:43.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:43.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:48:43.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:48:43.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.090 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.090 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:48:43.090 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:48:43.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.090 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:43.090 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:48:43.090 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:48:43.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.091 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.091 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:43.091 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:48:43.091 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:48:43.091 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.091 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.091 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:43.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:48:43.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:48:43.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:43.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:48:43.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:48:43.093 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.093 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:43.093 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.094 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:48:43.094 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:43.094 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 46.683279435999999, 2024-09-12T22:48:43.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:48:43.094 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:43.094 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:43.095 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:43.095 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:43.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.095 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:43.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:43.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:43.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:43.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:43.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:43.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:48:43.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:43.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:48:43.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:48:43.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:43.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:48:43.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:48:43.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.099 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.099 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:48:43.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:48:43.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:43.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:48:43.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:48:43.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:43.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:48:43.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:48:43.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:43.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:48:43.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:48:43.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:43.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:48:43.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:48:43.102 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.102 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:43.102 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.102 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:48:43.102 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:43.102 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 46.549429342000003, 2024-09-12T22:48:43.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:48:43.102 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:43.102 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:43.103 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:43.103 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:43.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:43.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:43.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:43.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:43.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:43.104 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:43.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:48:43.104 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.104 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.104 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:43.104 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:48:43.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:48:43.104 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.104 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.104 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:43.104 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:48:43.105 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:48:43.105 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.105 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.105 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.105 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:48:43.105 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:48:43.105 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.105 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.105 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:43.105 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:48:43.105 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:48:43.105 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.106 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.106 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:43.106 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:48:43.106 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:48:43.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.106 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.106 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:43.106 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:48:43.106 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:48:43.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.106 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.106 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:43.106 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:48:43.107 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:48:43.107 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.107 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:43.107 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.107 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.107 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.107 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:43.107 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:43.107 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 37.904193788000001, 2024-09-12T22:48:43.107 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:48:43.108 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:43.108 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:43.108 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:43.108 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:43.108 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.108 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:43.108 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:43.108 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.108 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.108 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.108 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:43.108 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:43.109 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.109 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.109 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.109 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:43.109 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:48:43.109 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:48:43.109 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.109 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.109 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:43.109 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:48:43.109 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:48:43.109 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.110 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.110 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:43.110 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:48:43.110 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:48:43.110 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.110 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.110 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.110 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:48:43.111 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:48:43.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.111 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.111 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:43.111 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:48:43.111 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:48:43.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.111 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.112 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:43.112 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:48:43.112 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:48:43.112 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.112 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.112 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:43.112 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:48:43.112 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:48:43.113 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.113 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.113 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:43.113 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:48:43.113 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:48:43.113 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.113 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.113 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:43.114 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:48:43.114 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:48:43.114 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.114 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.114 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:43.114 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:48:43.114 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:48:43.114 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.114 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.115 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:43.115 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:48:43.115 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:48:43.115 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.115 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.115 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:43.115 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:48:43.115 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:48:43.116 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.116 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.116 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:43.116 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:48:43.116 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:48:43.116 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.117 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:43.117 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.117 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.117 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.117 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:43.118 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:43.118 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 37.904094270999998, 2024-09-12T22:48:43.118 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:48:43.118 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:43.118 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:43.118 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:43.118 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:43.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.119 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:43.119 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:43.119 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.119 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.119 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.119 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:43.119 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:43.119 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.120 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.120 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:43.120 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:48:43.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:48:43.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.120 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.120 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:43.121 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:48:43.121 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:48:43.121 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.121 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.121 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:43.121 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:48:43.121 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:48:43.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.123 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:48:43.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:48:43.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.123 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:43.123 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:48:43.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:48:43.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:43.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:48:43.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:48:43.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:43.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:48:43.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:48:43.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:43.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:48:43.125 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:48:43.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.125 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:43.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:48:43.125 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:48:43.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.125 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:43.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:48:43.125 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:48:43.126 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.126 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.126 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:43.126 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:48:43.126 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:48:43.126 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.126 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.126 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:43.126 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:48:43.126 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:48:43.126 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.126 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.126 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:43.126 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:48:43.127 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:48:43.127 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.127 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:43.127 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.127 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.127 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:43.127 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:43.127 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 37.904049532000002, 2024-09-12T22:48:43.127 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:48:43.127 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:43.127 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:43.127 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:43.128 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:43.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:43.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:43.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:43.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:43.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.129 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:43.129 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:48:43.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:48:43.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.129 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:43.129 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:48:43.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:48:43.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.129 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:43.129 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:48:43.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:48:43.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:48:43.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:48:43.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:43.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:48:43.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:48:43.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:43.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:48:43.131 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:48:43.131 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.131 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.131 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:43.131 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:48:43.131 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:48:43.131 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.131 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.131 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:43.131 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:48:43.131 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:48:43.131 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.132 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:43.132 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:48:43.132 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:48:43.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.132 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:43.132 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:48:43.132 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:48:43.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:43.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:48:43.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:48:43.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:43.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:48:43.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:48:43.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:43.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:48:43.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:48:43.136 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.136 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:43.136 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.137 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:43.137 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:43.137 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 37.903821831000002, 2024-09-12T22:48:43.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:48:43.137 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:43.137 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:43.137 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:43.137 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:43.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:43.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:43.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:43.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:43.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:43.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:48:43.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:48:43.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:43.139 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:48:43.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:48:43.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:43.139 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:48:43.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:48:43.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.139 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:48:43.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:48:43.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.140 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:43.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:48:43.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:48:43.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.140 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:43.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:48:43.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:48:43.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:43.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:48:43.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:48:43.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:43.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:48:43.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:48:43.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:43.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:48:43.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:48:43.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:43.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:48:43.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:48:43.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:43.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:48:43.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:48:43.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:43.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:48:43.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:48:43.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:43.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:48:43.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:48:43.143 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.143 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:43.143 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.144 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:43.144 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:43.144 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 37.903656722999997, 2024-09-12T22:48:43.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:48:43.144 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:43.144 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:43.144 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:43.144 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:43.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:43.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:43.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:43.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:43.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:43.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:48:43.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:48:43.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:43.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:48:43.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:48:43.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:43.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:48:43.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:48:43.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:48:43.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:48:43.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:43.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:48:43.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:48:43.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:43.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:48:43.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:48:43.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:43.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:48:43.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:48:43.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:43.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:48:43.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:48:43.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:43.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:48:43.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:48:43.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:43.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:48:43.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:48:43.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:43.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:48:43.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:48:43.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:43.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:48:43.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:48:43.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.152 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:43.152 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:48:43.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:48:43.152 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.152 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:43.152 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.153 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:43.153 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:43.153 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 37.903595437999996, 2024-09-12T22:48:43.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:48:43.153 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:43.153 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:43.153 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:43.153 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:43.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.153 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:43.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:43.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:43.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:43.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:43.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:43.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:48:43.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:43.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:48:43.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:48:43.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:43.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:48:43.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:48:43.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:48:43.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:48:43.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:43.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:48:43.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:48:43.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:43.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:48:43.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:48:43.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:43.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:48:43.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:48:43.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:43.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:48:43.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:48:43.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:43.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:48:43.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:48:43.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:43.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:48:43.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:48:43.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:43.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:48:43.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:48:43.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:43.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:48:43.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:48:43.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:43.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:48:43.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:48:43.160 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.160 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:43.160 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.161 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:43.161 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:43.161 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 37.903515329999998, 2024-09-12T22:48:43.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:48:43.161 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:43.161 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:43.161 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:43.161 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:43.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:43.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:43.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:43.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:43.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:43.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:48:43.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:48:43.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:43.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:48:43.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:48:43.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.163 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:43.163 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:48:43.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:48:43.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.163 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.163 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:48:43.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:48:43.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:43.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:48:43.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:48:43.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:43.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:48:43.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:48:43.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:43.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:48:43.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:48:43.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:43.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:48:43.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:48:43.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:43.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:48:43.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:48:43.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:43.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:48:43.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:48:43.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:43.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:48:43.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:48:43.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.167 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:43.167 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:48:43.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:48:43.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.167 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:43.167 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:48:43.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:48:43.168 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.168 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:43.168 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.168 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:43.169 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:43.169 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 37.903466377000001, 2024-09-12T22:48:43.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:48:43.169 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:43.169 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:43.169 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:48:43.170 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:43.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:43.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:43.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:43.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:43.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:43.172 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:43.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:48:43.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:43.173 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:48:43.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:48:43.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.173 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:43.173 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:48:43.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:48:43.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:48:43.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:48:43.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:43.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:48:43.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:48:43.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:43.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:48:43.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:48:43.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.177 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.177 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:43.178 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:48:43.178 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:48:43.178 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.178 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:43.178 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.179 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:43.179 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:43.179 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 37.903417277000003, 2024-09-12T22:48:43.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:48:43.179 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:43.180 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:43.180 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:48:43.180 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:43.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:43.181 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:43.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.181 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:43.181 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:43.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.182 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:43.182 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:48:43.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:48:43.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.183 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:43.183 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:48:43.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:48:43.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:43.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:48:43.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:48:43.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:48:43.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:48:43.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:43.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:48:43.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:48:43.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:43.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:48:43.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:48:43.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:43.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:48:43.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:48:43.188 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.188 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:43.188 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.188 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:43.188 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:43.189 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 37.896476827000001, 2024-09-12T22:48:43.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:48:43.189 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:43.189 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:43.189 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:43.189 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:43.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:43.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:43.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:43.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:43.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:43.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:48:43.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:48:43.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:43.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:48:43.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:48:43.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:43.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:48:43.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:48:43.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:48:43.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:48:43.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:43.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:48:43.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:48:43.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.193 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:43.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:48:43.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:48:43.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.193 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:43.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:48:43.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:48:43.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.193 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:43.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:48:43.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:48:43.194 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.194 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:43.194 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.194 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.194 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:43.195 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:43.195 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 37.895387986999999, 2024-09-12T22:48:43.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:48:43.195 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:43.195 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:43.195 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:43.195 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:43.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:43.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:43.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:43.196 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:43.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:43.196 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:48:43.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:48:43.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.197 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:43.197 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:48:43.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:48:43.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:43.198 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:48:43.198 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:48:43.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:48:43.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:48:43.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:43.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:48:43.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:48:43.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:43.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:48:43.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:48:43.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:43.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:48:43.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:48:43.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.202 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:43.202 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:48:43.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:48:43.202 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.202 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:43.203 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.203 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.203 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.203 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:43.203 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:43.204 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 37.895338375999998, 2024-09-12T22:48:43.204 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:48:43.205 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:43.205 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:43.205 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:43.205 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:43.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:43.205 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:43.205 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.206 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:43.206 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:43.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.206 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:43.206 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:43.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:48:43.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.206 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:43.206 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:43.207 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:48:43.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.207 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.207 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:43.207 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:48:43.207 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:48:43.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.207 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.207 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.207 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:48:43.207 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:48:43.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.208 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:43.208 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:48:43.208 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:48:43.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.208 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:43.208 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:48:43.208 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:48:43.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.208 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:43.208 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:48:43.209 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:48:43.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.209 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.209 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:43.209 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:48:43.209 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:48:43.209 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.209 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:43.209 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.209 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.209 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:43.209 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:43.210 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 37.895271067000003, 2024-09-12T22:48:43.210 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:48:43.210 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:43.210 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:43.210 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:43.210 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:43.210 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.210 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:43.210 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:43.210 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.210 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.210 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.210 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:43.211 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:43.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.211 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.211 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.211 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:43.211 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:43.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:48:43.211 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.211 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.212 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:43.212 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:48:43.212 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:48:43.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.212 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.212 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:43.212 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:48:43.212 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:48:43.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.212 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.212 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.212 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:48:43.213 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:48:43.213 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.213 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.213 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:43.213 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:48:43.213 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:48:43.213 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.213 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.213 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:43.213 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:48:43.213 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:48:43.213 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.214 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:43.214 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:48:43.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:48:43.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.214 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:43.214 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:48:43.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:48:43.214 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.214 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:43.214 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.215 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:43.215 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:43.215 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 37.894703147999998, 2024-09-12T22:48:43.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:48:43.215 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:43.215 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:43.215 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:43.215 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:43.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.215 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:43.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:43.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:43.216 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:43.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:43.216 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:43.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:48:43.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.217 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:43.217 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:48:43.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:48:43.217 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.217 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.217 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:43.217 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:48:43.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:48:43.217 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.217 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.217 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.217 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:48:43.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:48:43.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:43.218 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:48:43.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:48:43.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:43.218 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:48:43.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:48:43.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:43.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:48:43.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:48:43.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:43.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:48:43.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:48:43.219 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.219 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:43.219 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.219 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:48:43.220 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:43.220 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 37.894325543999997, 2024-09-12T22:48:43.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:48:43.220 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:43.220 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:43.220 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:43.220 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:43.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.220 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:43.220 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:43.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.221 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:43.221 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:43.221 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:43.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.221 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:43.221 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:48:43.221 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:48:43.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.221 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:43.221 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:48:43.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:48:43.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.222 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:43.222 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:48:43.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:48:43.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.222 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.222 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:48:43.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:48:43.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:43.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:48:43.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:48:43.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:43.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:48:43.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:48:43.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:43.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:48:43.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:48:43.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:43.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:43.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:43.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:48:43.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:48:43.224 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.224 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:43.224 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.224 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:43.224 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:43.224 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:43.226 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:43.227 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:43.224+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:43.326 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:43.325+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:43.332 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:43.333 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:48:43.333 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:48:43.333 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:43.341 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:43.426 INFO:teuthology.orchestra.run.smithi066.stderr:nodeep-scrub is unset 2024-09-12T22:48:43.427 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:43.426+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:43.486 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:43.486 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:48:43.486 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:48:43.486 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:48:43.486 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:43.494 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:43.505 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:48:43.527 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~12s 2024-09-12T22:48:43.535 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:43.534+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:43.628 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:43.627+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:43.635 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:48:43.635 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:48:43.638 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:43.639 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:48:43.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:48:43.639 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:48:43.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.639 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:48:43.639 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:43.639 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.590645027000001, 2024-09-12T22:48:43.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:48:43.639 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:43.639 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:43.639 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:43.639 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:43.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:43.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:43.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:43.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:43.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:43.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:43.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:48:43.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:43.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:48:43.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:48:43.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:43.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:48:43.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:48:43.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:48:43.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:48:43.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:43.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:48:43.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:48:43.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:43.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:48:43.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:48:43.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:43.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:48:43.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:48:43.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:43.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:48:43.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:48:43.643 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.643 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:43.643 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.644 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:48:43.644 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:43.644 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.590264300000001, 2024-09-12T22:48:43.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:48:43.644 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:43.644 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:43.644 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:43.644 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:43.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:43.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:43.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:43.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:43.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:43.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:48:43.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:48:43.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:43.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:48:43.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:48:43.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:43.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:48:43.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:48:43.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:48:43.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:48:43.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:43.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:48:43.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:48:43.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:43.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:48:43.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:48:43.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:43.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:48:43.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:48:43.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:43.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:48:43.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:48:43.648 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.648 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:43.648 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.648 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:48:43.648 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:43.648 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.469667489999999, 2024-09-12T22:48:43.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:48:43.648 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:43.648 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:43.649 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:48:43.649 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:43.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:43.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:43.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:43.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:43.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:43.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:43.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:48:43.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:43.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:48:43.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:48:43.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:43.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:48:43.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:48:43.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:48:43.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:48:43.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:43.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:48:43.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:48:43.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:43.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:48:43.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:48:43.651 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.652 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:43.652 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.652 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:43.652 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:43.652 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.467059310000003, 2024-09-12T22:48:43.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:48:43.652 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:43.652 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:43.652 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:43.652 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:43.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:43.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:43.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:43.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:43.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:43.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:48:43.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:48:43.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:43.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:48:43.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:48:43.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:43.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:48:43.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:48:43.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:48:43.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:48:43.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:43.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:48:43.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:48:43.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:43.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:48:43.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:48:43.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:43.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:48:43.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:48:43.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:43.656 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:48:43.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:48:43.656 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.656 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:43.656 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.656 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:43.656 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:43.657 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.466166086999998, 2024-09-12T22:48:43.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:48:43.657 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:43.657 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:43.657 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:43.657 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:43.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:43.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:43.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:43.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:43.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:43.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:48:43.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:48:43.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:43.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:48:43.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:48:43.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:43.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:48:43.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:48:43.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:48:43.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:48:43.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:43.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:48:43.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:48:43.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:43.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:48:43.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:48:43.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:43.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:48:43.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:48:43.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:43.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:48:43.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:48:43.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:43.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:48:43.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:48:43.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:43.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:48:43.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:48:43.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:43.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:48:43.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:48:43.662 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.662 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:43.662 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.662 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:43.662 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:43.662 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.466094429000002, 2024-09-12T22:48:43.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:48:43.662 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:43.662 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:43.662 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:43.663 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:43.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:43.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:43.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:43.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:43.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:43.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:48:43.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:48:43.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:43.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:48:43.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:48:43.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:43.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:48:43.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:48:43.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:48:43.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:48:43.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:43.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:48:43.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:48:43.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:43.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:48:43.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:48:43.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:43.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:48:43.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:48:43.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:43.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:48:43.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:48:43.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:43.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:48:43.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:48:43.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:43.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:48:43.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:48:43.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:43.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:48:43.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:48:43.667 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.667 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:43.667 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.668 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:43.668 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:43.668 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.466051710999999, 2024-09-12T22:48:43.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:48:43.668 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:43.668 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:43.668 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:43.668 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:43.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:43.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:43.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:43.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:43.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:43.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:48:43.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:48:43.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:43.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:48:43.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:48:43.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:43.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:48:43.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:48:43.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:48:43.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:48:43.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:43.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:48:43.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:48:43.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:43.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:48:43.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:48:43.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:43.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:48:43.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:48:43.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:43.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:48:43.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:48:43.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:43.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:48:43.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:48:43.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:43.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:48:43.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:48:43.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:43.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:48:43.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:48:43.673 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.673 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:43.673 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.673 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:43.673 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:43.673 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.466013793999998, 2024-09-12T22:48:43.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:48:43.673 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:43.674 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:43.674 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:43.674 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:43.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:43.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:43.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:43.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:43.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:43.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:48:43.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:48:43.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:43.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:48:43.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:48:43.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:43.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:48:43.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:48:43.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:48:43.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:48:43.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:43.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:48:43.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:48:43.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:43.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:48:43.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:48:43.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:43.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:43.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:48:43.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:43.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:48:43.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:48:43.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:43.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:48:43.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:48:43.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:43.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:48:43.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:48:43.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:43.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:48:43.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:48:43.679 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.679 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:43.679 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.679 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:43.680 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:43.680 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.465990343000001, 2024-09-12T22:48:43.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:48:43.680 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:43.680 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:43.680 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:43.680 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:43.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:43.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:43.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:43.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:43.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:43.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:48:43.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:48:43.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:43.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:48:43.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:48:43.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:43.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:48:43.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:48:43.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:48:43.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:48:43.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:43.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:48:43.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:48:43.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:43.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:48:43.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:48:43.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:43.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:43.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:48:43.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:43.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:48:43.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:48:43.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:43.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:48:43.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:48:43.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:43.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:48:43.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:48:43.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:43.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:48:43.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:48:43.685 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.685 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:43.685 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.685 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:43.685 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:43.685 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.465966106000003, 2024-09-12T22:48:43.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:48:43.685 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:43.686 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:43.686 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:43.686 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:43.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:43.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:43.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:43.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:43.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:43.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:43.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:48:43.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:43.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:48:43.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:48:43.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:43.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:48:43.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:48:43.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:48:43.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:48:43.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:43.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:48:43.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:48:43.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:43.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:48:43.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:48:43.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:43.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:48:43.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:48:43.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:43.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:48:43.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:48:43.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:43.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:48:43.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:48:43.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:43.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:48:43.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:48:43.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:43.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:48:43.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:48:43.690 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.690 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:43.691 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.691 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:43.691 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:43.691 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.465938188999999, 2024-09-12T22:48:43.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:48:43.691 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:43.691 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:43.691 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:43.691 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:43.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:43.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:43.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:43.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:43.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:43.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:43.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:48:43.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:43.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:48:43.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:48:43.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:43.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:48:43.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:48:43.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:48:43.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:48:43.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:43.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:48:43.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:48:43.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:43.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:48:43.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:48:43.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:43.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:48:43.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:48:43.695 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.695 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:43.695 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.695 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:43.695 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:43.695 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.465863693999999, 2024-09-12T22:48:43.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:48:43.695 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:43.695 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:43.695 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:43.695 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:43.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:43.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:43.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:43.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:43.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:43.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:48:43.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:48:43.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:43.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:48:43.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:48:43.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:43.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:48:43.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:48:43.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:48:43.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:48:43.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:43.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:48:43.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:48:43.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:43.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:48:43.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:48:43.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:43.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:48:43.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:48:43.699 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.699 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:43.699 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.699 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:43.699 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:43.699 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.465817666, 2024-09-12T22:48:43.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:48:43.699 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:43.699 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:43.700 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:43.700 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:43.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:43.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:43.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:43.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:43.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:43.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:48:43.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:48:43.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:43.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:48:43.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:48:43.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:43.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:48:43.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:48:43.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:48:43.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:48:43.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:43.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:48:43.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:48:43.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:43.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:48:43.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:48:43.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:43.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:48:43.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:48:43.703 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.703 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:43.703 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.703 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:43.703 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:43.703 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.463646781999998, 2024-09-12T22:48:43.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:48:43.704 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:43.704 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:43.704 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:43.704 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:43.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:43.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:43.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:43.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:43.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:43.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:43.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:48:43.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:43.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:48:43.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:48:43.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:43.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:48:43.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:48:43.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:43.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:48:43.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:43.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:48:43.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:48:43.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:43.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:43.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:48:43.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:43.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:48:43.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:48:43.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:43.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:48:43.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:48:43.708 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.708 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:43.708 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.708 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:43.708 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:43.708 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.463596332000002, 2024-09-12T22:48:43.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:48:43.708 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:43.708 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:43.708 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:43.708 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:43.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:43.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:43.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:43.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:43.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:43.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:48:43.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:48:43.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:43.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:48:43.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:48:43.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:43.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:48:43.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:48:43.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:48:43.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:48:43.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:43.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:48:43.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:48:43.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:43.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:48:43.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:48:43.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:43.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:48:43.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:48:43.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:43.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:48:43.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:48:43.712 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.712 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:43.712 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.712 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:43.713 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:43.713 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.463542894, 2024-09-12T22:48:43.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:48:43.713 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:43.713 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:43.713 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:43.713 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:43.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:43.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:43.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:43.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:43.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:43.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:43.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:48:43.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:43.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:48:43.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:48:43.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:43.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:43.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:48:43.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:48:43.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:48:43.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:43.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:48:43.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:48:43.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:43.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:48:43.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:48:43.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:43.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:48:43.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:48:43.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:43.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:48:43.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:48:43.717 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.717 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:43.717 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.717 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:48:43.717 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:43.717 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.459558541, 2024-09-12T22:48:43.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:48:43.717 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:43.717 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:43.718 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:43.718 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:43.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:43.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:43.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:43.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:43.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:43.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:48:43.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:48:43.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:43.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:48:43.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:48:43.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:43.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:48:43.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:48:43.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:48:43.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:48:43.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:43.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:48:43.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:48:43.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:43.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:48:43.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:48:43.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:43.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:48:43.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:48:43.721 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.721 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:43.721 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.721 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:48:43.721 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:43.722 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.474406002000002, 2024-09-12T22:48:43.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:48:43.722 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:43.722 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:43.722 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:43.722 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:43.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:43.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:43.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:43.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:43.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:43.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:48:43.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:48:43.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:43.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:48:43.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:48:43.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:43.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:48:43.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:48:43.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:48:43.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:48:43.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:43.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:48:43.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:48:43.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:43.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:48:43.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:48:43.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:43.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:48:43.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:48:43.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:43.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:48:43.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:48:43.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:43.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:48:43.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:48:43.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:43.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:48:43.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:48:43.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:43.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:48:43.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:48:43.727 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.727 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:43.727 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.727 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:48:43.727 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:43.727 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.472489757000002, 2024-09-12T22:48:43.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:48:43.727 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:43.727 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:43.728 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:43.728 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:43.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:43.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:43.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:43.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:43.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:43.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:48:43.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:48:43.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:43.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:48:43.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:48:43.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:43.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:48:43.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:48:43.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:48:43.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:48:43.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:43.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:48:43.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:48:43.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:43.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:48:43.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:48:43.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:43.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:48:43.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:48:43.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:43.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:48:43.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:48:43.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:43.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:48:43.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:48:43.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:43.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:48:43.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:48:43.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:43.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:48:43.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:48:43.732 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.732 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:43.732 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.733 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:48:43.733 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:43.733 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.471736382, 2024-09-12T22:48:43.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012160610000000001, 2024-09-12T22:48:43.733 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:43.733 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:43.733 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:43.733 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:43.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:43.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:43.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:43.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:43.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:43.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:43.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164967+0000", 2024-09-12T22:48:43.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:48:43.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:43.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164974+0000", 2024-09-12T22:48:43.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:48:43.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:43.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164987+0000", 2024-09-12T22:48:43.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3689000000000001e-05 2024-09-12T22:48:43.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:43.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164995+0000", 2024-09-12T22:48:43.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2959999999999999e-06 2024-09-12T22:48:43.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:43.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165068+0000", 2024-09-12T22:48:43.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2449999999999999e-05 2024-09-12T22:48:43.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:43.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165212+0000", 2024-09-12T22:48:43.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144117 2024-09-12T22:48:43.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:43.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166066+0000", 2024-09-12T22:48:43.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085441100000000002 2024-09-12T22:48:43.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:43.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166107+0000", 2024-09-12T22:48:43.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0450000000000001e-05 2024-09-12T22:48:43.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:43.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:43.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:43.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166181+0000", 2024-09-12T22:48:43.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-12T22:48:43.737 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.738 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:43.738 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.738 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:43.738 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:43.738 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:43.739 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:48:43.740 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:48:43.740 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:43.741 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:48:43.741 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:48:43.741 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:48:43.741 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:43.738+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:43.839 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:43.838+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:43.848 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:43.848 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:43.858 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:43.941 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:43.939+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:43.961 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:43.961 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:43.971 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:44.059 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:44.057+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:44.114 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:44.114 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:44.123 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:44.164 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:44.162+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:44.229 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:44.229 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:44.238 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:44.243 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:44.242+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:44.340 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:44.340 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:44.344 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:44.343+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:44.348 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:44.445 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:44.444+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:44.491 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:44.491 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:44.500 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:44.546 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:44.544+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:44.606 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:44.606 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:44.615 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:44.656 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:44.654+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:44.749 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:44.746+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:44.757 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:44.757 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:44.766 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:44.850 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:44.848+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:44.909 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:44.909 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:44.918 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:44.959 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:44.957+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:45.023 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:45.023 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:45.031 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:45.076 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:45.075+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:45.134 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:45.134 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:45.143 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:45.184 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:45.183+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:45.254 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:45.253+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:45.285 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:45.286 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:45.294 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:45.355 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:45.354+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:45.397 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:45.398 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:45.406 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:45.440 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-12T22:48:45.449 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:48:45.456 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:45.454+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:45.508 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:45.508 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:45.519 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:45.551 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is off 2024-09-12T22:48:45.557 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:45.556+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:45.657 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:45.655+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:45.659 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:45.660 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:45.669 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:45.742 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:48:45.759 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:45.757+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:45.771 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:45.771 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:45.780 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:45.861 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:45.857+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:45.870 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:48:45.871 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:48:45.882 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:45.882 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:45.889 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:48:45.890 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:48:45.890 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:48:45.891 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:45.893 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:48:45.893 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:48:45.962 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:45.960+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:45.995 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:45.995 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:48:45.996 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:48:45.996 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:48:45.996 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:45.996 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:48:45.996 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:45.996 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 45.947441175999998, 2024-09-12T22:48:45.996 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:48:45.996 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:45.996 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:45.996 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:45.996 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:45.996 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:45.997 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:45.997 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:45.997 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:45.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:45.997 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:45.997 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:45.997 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:45.997 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:45.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:45.997 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:45.997 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:45.998 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:45.998 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:48:45.998 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:45.998 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:45.998 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:45.998 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:48:45.998 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:48:45.998 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:45.999 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:45.999 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:45.999 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:48:45.999 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:48:45.999 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:45.999 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:45.999 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:45.999 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:48:45.999 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:48:45.999 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:45.999 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:45.999 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:46.000 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:48:46.000 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:48:46.000 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.000 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.000 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:46.000 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:48:46.000 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:48:46.000 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.001 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.001 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:46.001 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:48:46.001 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:48:46.001 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.001 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.001 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:46.001 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:48:46.002 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:48:46.002 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.002 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:46.002 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.002 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.003 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:48:46.003 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:46.003 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.947060448999999, 2024-09-12T22:48:46.003 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:48:46.003 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:46.003 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:46.004 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.004 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:46.004 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.004 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:46.004 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:46.004 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.004 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.004 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.004 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:46.004 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:46.004 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.006 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.006 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:46.006 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:48:46.006 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:48:46.006 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.006 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:46.006 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:48:46.006 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:48:46.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.007 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:46.007 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:48:46.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:48:46.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.007 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.007 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:48:46.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:48:46.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.007 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:46.007 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:48:46.008 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:48:46.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.008 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:46.008 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:48:46.008 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:48:46.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.008 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:46.008 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:48:46.008 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:48:46.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.009 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.009 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:46.009 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:48:46.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:48:46.009 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.009 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:46.009 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.009 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.009 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:48:46.010 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:46.010 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.826463638999996, 2024-09-12T22:48:46.010 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:48:46.010 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:46.010 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:46.010 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:48:46.010 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:46.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.010 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:46.010 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:46.010 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.011 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:46.011 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:46.011 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.011 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.011 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:46.011 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:46.011 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:48:46.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.011 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.011 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:46.011 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:48:46.011 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:48:46.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.012 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:46.012 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:48:46.012 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:48:46.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.012 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.012 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:48:46.012 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:48:46.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.012 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:46.013 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:48:46.013 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:48:46.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.013 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:46.013 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:48:46.013 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:48:46.013 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.013 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:46.013 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.013 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:46.014 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:46.014 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.823855459000001, 2024-09-12T22:48:46.014 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:48:46.014 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:46.014 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:46.014 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.014 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:46.014 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.014 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:46.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:46.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.015 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:46.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:46.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.015 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:46.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:48:46.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:48:46.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.016 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.016 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:46.016 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:48:46.016 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:48:46.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.016 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.016 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:46.016 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:48:46.016 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:48:46.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.016 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.016 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.016 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:48:46.017 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:48:46.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.017 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:46.017 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:48:46.017 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:48:46.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.017 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:46.017 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:48:46.017 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:48:46.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.018 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:46.018 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:48:46.018 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:48:46.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.018 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:46.018 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:48:46.018 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:48:46.018 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.018 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:46.018 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.019 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:46.019 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:46.019 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.822962236000002, 2024-09-12T22:48:46.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:48:46.019 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:46.019 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:46.019 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.019 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:46.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.019 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:46.019 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:46.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.020 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.020 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:46.020 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:46.020 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.020 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.020 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:46.020 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:48:46.020 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:48:46.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.020 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.020 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:46.021 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:48:46.021 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:48:46.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:46.021 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:48:46.021 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:48:46.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.021 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:48:46.021 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:48:46.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.022 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:46.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:48:46.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:48:46.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.022 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:46.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:48:46.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:48:46.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.022 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:46.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:48:46.023 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:48:46.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.023 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:46.023 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:48:46.023 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:48:46.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.023 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:46.023 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:48:46.023 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:48:46.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.023 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:46.024 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:48:46.024 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:48:46.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.024 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:46.024 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:48:46.024 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:48:46.024 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.024 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:46.024 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.025 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:46.025 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:46.025 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.822890577999999, 2024-09-12T22:48:46.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:48:46.025 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:46.025 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:46.025 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.025 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:46.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.025 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:46.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:46.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:46.026 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:46.026 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:46.026 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:48:46.026 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:48:46.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:46.026 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:48:46.026 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:48:46.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.027 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:46.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:48:46.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:48:46.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.027 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:48:46.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:48:46.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.027 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:46.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:48:46.028 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:48:46.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.028 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:46.028 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:48:46.028 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:48:46.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.028 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:46.028 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:48:46.028 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:48:46.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.029 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:46.029 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:48:46.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:48:46.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.029 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:46.029 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:48:46.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:48:46.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.029 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:46.029 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:48:46.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:48:46.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.030 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:46.030 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:48:46.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:48:46.030 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.030 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:46.030 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.030 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:46.030 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:46.031 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.822847860000003, 2024-09-12T22:48:46.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:48:46.031 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:46.031 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:46.031 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.031 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:46.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:46.031 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:46.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:46.031 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:46.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.032 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:46.032 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:48:46.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:48:46.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.032 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:46.032 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:48:46.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:48:46.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.033 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:46.033 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:48:46.033 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:48:46.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.033 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.033 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:48:46.033 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:48:46.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.033 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:46.033 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:48:46.034 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:48:46.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.034 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:46.034 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:48:46.034 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:48:46.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.034 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:46.034 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:48:46.034 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:48:46.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.035 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:46.035 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:48:46.035 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:48:46.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.035 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:46.035 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:48:46.035 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:48:46.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.035 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:46.035 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:48:46.035 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:48:46.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.036 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:46.036 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:48:46.036 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:48:46.036 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.036 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:46.036 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.036 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:46.036 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:46.036 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.822809943000003, 2024-09-12T22:48:46.037 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:48:46.037 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:46.037 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:46.037 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.037 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:46.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.037 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:46.037 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:46.037 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.037 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.037 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:46.037 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:46.038 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.038 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:46.038 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:48:46.038 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:48:46.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.038 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:46.038 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:48:46.038 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:48:46.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.039 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:46.039 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:48:46.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:48:46.039 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.039 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.039 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:48:46.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:48:46.039 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.039 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:46.039 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:48:46.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:48:46.039 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.040 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:46.040 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:48:46.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:48:46.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.040 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:46.040 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:46.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:48:46.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.040 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:46.040 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:48:46.041 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:48:46.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.041 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:46.041 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:48:46.041 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:48:46.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.041 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:46.041 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:48:46.041 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:48:46.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.041 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:46.042 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:48:46.042 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:48:46.042 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.042 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:46.042 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.042 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.042 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:46.042 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:46.042 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.822786491999999, 2024-09-12T22:48:46.042 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:48:46.042 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:46.042 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:46.043 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.043 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:46.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.043 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:46.043 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:46.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.043 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:46.043 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:46.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.043 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:46.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:48:46.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:48:46.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:46.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:48:46.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:48:46.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:46.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:48:46.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:48:46.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:48:46.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:48:46.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:46.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:48:46.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:48:46.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:46.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:48:46.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:48:46.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:46.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:46.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:48:46.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:46.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:48:46.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:48:46.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:46.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:48:46.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:48:46.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:46.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:48:46.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:48:46.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:46.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:48:46.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:48:46.047 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.047 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:46.048 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.048 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:46.048 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:46.048 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.822762255000001, 2024-09-12T22:48:46.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:48:46.048 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:46.048 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:46.048 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.048 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:46.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:46.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:46.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:46.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:46.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:46.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:46.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:48:46.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:46.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:48:46.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:48:46.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:46.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:48:46.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:48:46.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:48:46.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:48:46.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:46.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:48:46.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:48:46.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:46.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:48:46.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:48:46.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:46.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:48:46.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:48:46.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:46.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:48:46.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:48:46.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:46.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:48:46.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:48:46.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:46.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:48:46.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:48:46.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:46.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:48:46.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:48:46.053 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.053 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:46.053 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.054 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:46.054 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:46.054 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.822734337999997, 2024-09-12T22:48:46.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:48:46.054 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:46.054 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:46.054 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:46.054 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:46.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:46.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:46.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:46.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:46.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:46.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:46.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:48:46.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:46.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:48:46.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:48:46.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:46.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:48:46.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:48:46.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:48:46.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:48:46.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:46.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:48:46.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:48:46.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:46.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:48:46.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:48:46.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:46.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:48:46.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:48:46.057 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.057 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:46.058 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.058 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:46.058 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:46.058 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.822659842999997, 2024-09-12T22:48:46.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:48:46.058 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:46.058 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:46.058 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:46.058 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:46.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:46.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:46.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:46.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:46.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:46.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:48:46.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:48:46.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:46.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:48:46.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:48:46.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:46.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:48:46.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:48:46.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:48:46.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:48:46.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:46.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:48:46.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:48:46.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:46.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:48:46.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:48:46.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:46.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:48:46.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:48:46.062 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.062 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:46.062 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.062 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:46.062 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:46.062 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.822613814999997, 2024-09-12T22:48:46.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:48:46.062 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:46.062 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:46.062 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:46.063 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:46.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:46.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:46.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:46.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:46.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:46.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:48:46.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:48:46.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:46.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:48:46.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:48:46.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:46.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:48:46.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:48:46.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:48:46.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:48:46.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:46.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:48:46.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:48:46.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:46.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:48:46.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:48:46.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:46.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:48:46.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:48:46.068 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.068 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:46.068 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.068 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:46.068 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:46.068 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.820442931000002, 2024-09-12T22:48:46.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:48:46.068 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:46.068 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:46.068 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.068 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:46.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:46.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:46.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:46.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:46.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:46.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:46.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:48:46.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:46.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:48:46.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:48:46.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:46.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:48:46.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:48:46.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:46.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:48:46.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:46.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:48:46.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:48:46.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:46.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:46.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:48:46.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:46.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:48:46.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:48:46.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:46.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:48:46.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:48:46.072 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.072 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:46.072 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.073 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:46.073 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:46.073 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.820392480999999, 2024-09-12T22:48:46.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:48:46.073 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:46.073 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:46.073 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.073 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:46.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:46.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:46.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:46.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:46.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:46.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:48:46.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:48:46.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:46.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:48:46.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:48:46.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:46.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:48:46.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:48:46.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:48:46.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:48:46.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:46.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:48:46.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:48:46.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:46.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:48:46.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:48:46.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:46.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:48:46.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:48:46.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:46.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:48:46.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:48:46.077 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.077 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:46.077 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.077 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:46.078 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:46.078 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.820339042999997, 2024-09-12T22:48:46.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:48:46.078 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:46.078 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:46.078 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.078 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:46.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:46.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:46.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:46.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:46.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:46.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:46.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:48:46.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:46.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:48:46.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:48:46.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:46.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:46.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:48:46.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:48:46.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:48:46.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:46.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:48:46.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:48:46.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:46.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:48:46.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:48:46.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:46.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:48:46.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:48:46.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:46.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:48:46.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:48:46.082 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.082 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:46.082 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.082 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:48:46.082 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:46.082 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.816354689999997, 2024-09-12T22:48:46.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:48:46.083 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:46.083 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:46.083 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:46.083 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:46.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:46.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:46.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:46.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:46.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:46.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:48:46.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:48:46.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:46.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:48:46.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:48:46.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:46.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:48:46.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:48:46.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:48:46.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:48:46.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:46.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:48:46.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:48:46.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:46.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:48:46.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:48:46.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:46.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:48:46.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:48:46.086 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.086 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:46.086 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.086 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:48:46.087 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:46.087 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.831202150999999, 2024-09-12T22:48:46.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:48:46.087 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:46.087 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:46.087 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.087 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:46.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:46.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:46.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:46.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:46.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:46.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:48:46.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:48:46.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:46.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:48:46.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:48:46.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:46.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:48:46.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:48:46.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:48:46.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:48:46.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:46.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:48:46.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:48:46.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:46.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:48:46.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:48:46.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:46.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:48:46.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:48:46.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:46.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:48:46.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:48:46.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:46.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:48:46.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:48:46.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:46.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:48:46.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:48:46.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:46.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:48:46.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:48:46.092 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.092 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:46.092 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.092 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:48:46.092 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:46.092 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 20.829285905999999, 2024-09-12T22:48:46.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:48:46.093 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:46.093 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:46.093 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.093 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:46.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:46.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:46.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:46.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:46.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:46.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:48:46.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:48:46.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:46.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:48:46.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:48:46.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:46.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:48:46.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:48:46.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:48:46.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:48:46.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:46.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:48:46.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:48:46.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:46.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:48:46.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:48:46.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:46.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:48:46.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:48:46.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:46.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:48:46.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:48:46.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:46.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:48:46.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:48:46.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:46.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:48:46.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:48:46.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:46.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:48:46.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:48:46.098 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.098 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:46.098 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.099 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:48:46.099 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:46.099 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 15.828532531, 2024-09-12T22:48:46.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012160610000000001, 2024-09-12T22:48:46.099 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:46.099 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:46.099 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.099 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:46.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:46.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:46.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:46.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:46.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:46.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164967+0000", 2024-09-12T22:48:46.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:48:46.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:46.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164974+0000", 2024-09-12T22:48:46.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:48:46.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:46.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164987+0000", 2024-09-12T22:48:46.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3689000000000001e-05 2024-09-12T22:48:46.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164995+0000", 2024-09-12T22:48:46.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2959999999999999e-06 2024-09-12T22:48:46.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:46.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165068+0000", 2024-09-12T22:48:46.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2449999999999999e-05 2024-09-12T22:48:46.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:46.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165212+0000", 2024-09-12T22:48:46.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144117 2024-09-12T22:48:46.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:46.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166066+0000", 2024-09-12T22:48:46.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085441100000000002 2024-09-12T22:48:46.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:46.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166107+0000", 2024-09-12T22:48:46.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0450000000000001e-05 2024-09-12T22:48:46.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:46.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166181+0000", 2024-09-12T22:48:46.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-12T22:48:46.103 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.103 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:46.104 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.104 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.104 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:46.104 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:46.105 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:46.104+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:46.106 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:46.206 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:46.205+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:46.210 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:46.210 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:48:46.210 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:48:46.210 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:46.219 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:46.306 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:46.305+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:46.321 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:46.322 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:48:46.322 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:48:46.322 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:48:46.322 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:46.330 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:46.408 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:46.406+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:46.434 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:46.434 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:48:46.434 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:48:46.434 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:48:46.434 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.434 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:48:46.434 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:46.434 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 50.048136132000003, 2024-09-12T22:48:46.434 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:48:46.434 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:46.435 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:46.435 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.435 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:46.435 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.435 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:46.435 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:46.435 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.435 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.435 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.435 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:46.435 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:46.435 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.435 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.435 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.436 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:46.436 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:46.436 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:48:46.436 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.436 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.436 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:46.436 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:48:46.436 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:48:46.436 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.436 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.436 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:46.436 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:48:46.436 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:48:46.437 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.437 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.437 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.437 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:48:46.437 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:48:46.437 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.437 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.437 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:46.437 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:48:46.437 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:48:46.437 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.437 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.437 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:46.437 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:48:46.438 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:48:46.438 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.438 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.438 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:46.438 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:48:46.438 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:48:46.438 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.438 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.438 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:46.438 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:48:46.438 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:48:46.438 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.438 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:46.439 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.439 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.439 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.439 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:48:46.439 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:46.439 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 50.047693549000002, 2024-09-12T22:48:46.439 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:48:46.439 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:46.439 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:46.439 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.439 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:46.439 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.439 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:46.439 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:46.440 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.440 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.440 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.440 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:46.440 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:46.440 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.440 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.440 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.440 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:46.440 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:48:46.440 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:48:46.440 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.440 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.440 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:46.441 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:48:46.441 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:48:46.441 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.441 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.441 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:46.441 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:48:46.441 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:48:46.441 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.441 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.441 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.441 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:48:46.441 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:48:46.441 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.442 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.442 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:46.442 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:48:46.442 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:48:46.442 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.442 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.442 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:46.442 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:48:46.442 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:48:46.442 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.442 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.442 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:46.442 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:48:46.442 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:48:46.443 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.443 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.443 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:46.443 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:48:46.443 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:48:46.443 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.443 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:46.443 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.443 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.443 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.443 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:48:46.443 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:46.443 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 50.047327392, 2024-09-12T22:48:46.444 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:48:46.444 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:46.444 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:46.444 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.444 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:46.444 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.444 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:46.444 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:46.444 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.444 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.444 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.444 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:46.444 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:46.444 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.445 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.445 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.445 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:46.445 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:48:46.445 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:48:46.445 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.445 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.445 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:46.445 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:48:46.445 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:48:46.445 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.445 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.445 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:46.445 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:48:46.446 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:48:46.446 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.446 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.446 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.446 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:48:46.446 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:48:46.446 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.446 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.446 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:46.446 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:48:46.446 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:48:46.446 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.446 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.446 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:46.447 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:48:46.447 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:48:46.447 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.447 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.447 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:46.447 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:48:46.447 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:48:46.447 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.447 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.447 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:46.447 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:48:46.447 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:48:46.447 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.447 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:46.448 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.448 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.448 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.448 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:48:46.448 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:46.448 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 50.046915079999998, 2024-09-12T22:48:46.448 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:48:46.448 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:46.448 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:46.448 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.448 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:46.448 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.449 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:46.449 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:46.449 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.449 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.449 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.449 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:46.449 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:46.449 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.449 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.449 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.449 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:46.449 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:46.449 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:48:46.449 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.450 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.450 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:46.450 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:48:46.450 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:48:46.450 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.450 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.450 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:46.450 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:48:46.450 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:48:46.450 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.450 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.450 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.450 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:48:46.450 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:48:46.451 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.451 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.451 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:46.451 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:48:46.451 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:48:46.451 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.451 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.451 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:46.451 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:48:46.451 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:48:46.451 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.451 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.451 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:46.452 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:48:46.452 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:48:46.452 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.452 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.452 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:46.452 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:48:46.452 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:48:46.452 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.452 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:46.452 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.452 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.452 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.452 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:48:46.453 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:46.453 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 49.913064986000002, 2024-09-12T22:48:46.453 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:48:46.453 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:46.453 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:46.453 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.453 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:46.453 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.453 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:46.453 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:46.453 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.453 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.453 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.453 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:46.454 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:46.454 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.454 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.454 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.454 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:46.454 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:46.454 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:48:46.454 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.454 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.454 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:46.454 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:48:46.454 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:48:46.454 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.454 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.455 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:46.455 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:48:46.455 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:48:46.455 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.455 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.455 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.455 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:48:46.455 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:48:46.455 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.455 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.455 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:46.455 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:48:46.455 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:48:46.455 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.456 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.456 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:46.456 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:48:46.456 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:48:46.456 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.456 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.456 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:46.456 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:48:46.456 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:48:46.456 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.456 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.456 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:46.456 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:48:46.457 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:48:46.457 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.457 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:46.457 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.457 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.457 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.457 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:46.457 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:46.457 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 41.267829431999999, 2024-09-12T22:48:46.457 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:48:46.457 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:46.457 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:46.457 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.457 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:46.458 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.458 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:46.458 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:46.458 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.458 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.458 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.458 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:46.458 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:46.458 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.458 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.458 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.458 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:46.458 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:48:46.458 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:48:46.459 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.459 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.459 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:46.459 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:48:46.459 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:48:46.459 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.459 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.459 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:46.459 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:48:46.459 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:48:46.459 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.459 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.459 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.459 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:48:46.460 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:48:46.460 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.460 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.460 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:46.460 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:48:46.460 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:48:46.460 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.460 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.460 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:46.460 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:48:46.460 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:48:46.460 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.460 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.460 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:46.461 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:48:46.461 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:48:46.461 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.461 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.461 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:46.461 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:48:46.461 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:48:46.461 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.461 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.461 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:46.461 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:48:46.461 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:48:46.461 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.462 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.462 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:46.462 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:48:46.462 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:48:46.462 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.462 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.462 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:46.462 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:48:46.462 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:48:46.462 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.462 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.462 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:46.462 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:48:46.462 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:48:46.463 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.463 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.463 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:46.463 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:48:46.463 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:48:46.463 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.463 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:46.463 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.463 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.463 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.463 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:46.463 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:46.463 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 41.267729914999997, 2024-09-12T22:48:46.464 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:48:46.464 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:46.464 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:46.464 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.464 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:46.464 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.464 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:46.464 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:46.464 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.464 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.464 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.464 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:46.464 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:46.464 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.465 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.465 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.465 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:46.465 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:48:46.465 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:48:46.465 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.465 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.465 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:46.465 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:48:46.465 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:48:46.465 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.465 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.466 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:46.466 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:48:46.466 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:48:46.466 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.466 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.466 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.466 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:48:46.466 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:48:46.466 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.466 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.466 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:46.466 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:48:46.466 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:48:46.467 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.467 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.467 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:46.467 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:48:46.467 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:48:46.467 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.467 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.467 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:46.467 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:48:46.467 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:48:46.467 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.467 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.467 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:46.468 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:48:46.468 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:48:46.468 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.468 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.468 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:46.468 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:48:46.468 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:48:46.468 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.468 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.468 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:46.468 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:48:46.468 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:48:46.468 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.469 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.469 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:46.469 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:48:46.469 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:48:46.469 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.469 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.469 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:46.469 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:48:46.469 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:48:46.469 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.469 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.469 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:46.469 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:48:46.470 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:48:46.470 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.470 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:46.470 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.470 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.470 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.470 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:46.470 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:46.470 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 41.267685176000001, 2024-09-12T22:48:46.470 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:48:46.470 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:46.470 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:46.470 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.470 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:46.471 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.471 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:46.471 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:46.471 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.471 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.471 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.471 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:46.471 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:46.471 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.471 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.471 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.471 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:46.471 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:48:46.472 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:48:46.472 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.472 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.472 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:46.472 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:48:46.472 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:48:46.472 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.472 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.472 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:46.472 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:48:46.472 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:48:46.472 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.473 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.473 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.473 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:48:46.473 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:48:46.473 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.473 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.473 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:46.473 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:48:46.473 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:48:46.473 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.473 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.474 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:46.474 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:48:46.474 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:48:46.474 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.474 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.474 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:46.474 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:48:46.474 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:48:46.474 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.474 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.474 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:46.474 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:48:46.474 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:48:46.475 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.475 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.475 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:46.475 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:48:46.475 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:48:46.475 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.475 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.475 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:46.475 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:48:46.475 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:48:46.475 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.475 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.475 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:46.475 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:48:46.476 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:48:46.476 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.476 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.476 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:46.476 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:48:46.476 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:48:46.476 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.476 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.476 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:46.476 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:48:46.476 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:48:46.476 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.476 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:46.477 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.477 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.477 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.477 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:46.477 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:46.477 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 41.267457475, 2024-09-12T22:48:46.477 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:48:46.477 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:46.477 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:46.477 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.477 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:46.477 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.478 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:46.478 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:46.478 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.478 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.478 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.478 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:46.478 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:46.478 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.478 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.478 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.478 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:46.478 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:48:46.478 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:48:46.478 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.479 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.479 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:46.479 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:48:46.479 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:48:46.479 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.479 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.479 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:46.479 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:48:46.479 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:48:46.479 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.479 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.480 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.480 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:48:46.480 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:48:46.480 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.480 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.480 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:46.480 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:48:46.480 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:48:46.480 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.480 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.480 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:46.480 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:48:46.480 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:48:46.480 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.481 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.481 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:46.481 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:48:46.481 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:48:46.481 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.481 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.481 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:46.481 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:48:46.481 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:48:46.481 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.481 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.481 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:46.481 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:48:46.482 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:48:46.482 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.482 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.482 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:46.482 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:48:46.482 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:48:46.482 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.482 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.482 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:46.482 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:48:46.482 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:48:46.482 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.482 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.482 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:46.483 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:48:46.483 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:48:46.483 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.483 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.483 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:46.483 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:48:46.483 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:48:46.483 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.483 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:46.483 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.483 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.483 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.483 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:46.483 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:46.484 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 41.267292367000003, 2024-09-12T22:48:46.484 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:48:46.484 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:46.484 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:46.484 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.484 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:46.484 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.484 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:46.484 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:46.484 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.484 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.484 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.485 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:46.485 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:46.485 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.485 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.485 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.485 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:46.485 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:48:46.485 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:48:46.485 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.485 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.485 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:46.485 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:48:46.485 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:48:46.485 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.486 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.486 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:46.486 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:48:46.486 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:48:46.486 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.486 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.486 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.486 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:48:46.486 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:48:46.486 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.486 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.486 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:46.486 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:48:46.487 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:48:46.487 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.487 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.487 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:46.487 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:48:46.487 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:48:46.487 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.487 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.487 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:46.487 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:48:46.487 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:48:46.487 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.487 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.487 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:46.488 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:48:46.488 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:48:46.488 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.488 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.488 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:46.488 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:48:46.488 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:48:46.488 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.488 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.489 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:46.489 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:48:46.489 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:48:46.489 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.489 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.489 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:46.489 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:48:46.489 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:48:46.489 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.489 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.489 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:46.489 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:48:46.489 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:48:46.489 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.490 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.490 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:46.490 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:48:46.490 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:48:46.490 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.490 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:46.490 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.490 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.490 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.490 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:46.490 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:46.490 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 41.267231082000002, 2024-09-12T22:48:46.490 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:48:46.491 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:46.491 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:46.491 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.491 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:46.491 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.491 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:46.491 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:46.491 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.491 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.491 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.491 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:46.491 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:46.491 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.491 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.492 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.492 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:46.492 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:46.492 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:48:46.492 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.492 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.492 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:46.492 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:48:46.492 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:48:46.492 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.492 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.492 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:46.492 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:48:46.492 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:48:46.493 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.493 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.493 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.493 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:48:46.493 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:48:46.493 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.493 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.493 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:46.493 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:48:46.493 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:48:46.493 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.493 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.493 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:46.494 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:48:46.494 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:48:46.494 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.494 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.494 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:46.494 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:48:46.494 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:48:46.494 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.494 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.494 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:46.494 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:48:46.494 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:48:46.494 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.494 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.495 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:46.495 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:48:46.495 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:48:46.495 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.495 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.495 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:46.495 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:48:46.495 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:48:46.495 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.495 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.495 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:46.495 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:48:46.495 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:48:46.495 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.496 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.496 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:46.496 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:48:46.496 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:48:46.496 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.496 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.496 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:46.496 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:48:46.496 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:48:46.496 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.496 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:46.496 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.496 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.497 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.497 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:46.497 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:46.497 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 41.267150974000003, 2024-09-12T22:48:46.497 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:48:46.497 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:46.497 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:46.497 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.497 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:46.497 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.497 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:46.497 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:46.498 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.498 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.498 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.498 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:46.498 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:46.498 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.498 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.498 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.498 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:46.498 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:48:46.498 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:48:46.498 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.498 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.498 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:46.499 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:48:46.499 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:48:46.499 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.499 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.499 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:46.499 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:48:46.499 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:48:46.499 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.499 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.499 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.499 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:48:46.499 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:48:46.499 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.499 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.500 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:46.500 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:48:46.500 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:48:46.500 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.500 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.500 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:46.500 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:48:46.500 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:48:46.500 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.500 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.500 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:46.500 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:48:46.500 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:48:46.501 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.501 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.501 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:46.501 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:48:46.501 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:48:46.501 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.501 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.501 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:46.501 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:48:46.501 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:48:46.501 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.501 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.501 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:46.501 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:48:46.502 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:48:46.502 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.502 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.502 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:46.502 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:48:46.502 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:48:46.502 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.502 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.502 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:46.502 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:48:46.502 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:48:46.502 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.502 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.503 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:46.503 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:48:46.503 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:48:46.503 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.503 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:46.503 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.503 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.503 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.503 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:46.503 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:46.503 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 41.267102020999999, 2024-09-12T22:48:46.503 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:48:46.503 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:46.503 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:46.504 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:48:46.504 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:46.504 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.504 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:46.504 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:46.504 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.504 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.504 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.504 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:46.504 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:46.504 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.504 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.504 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.504 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:46.505 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:46.505 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:48:46.505 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.505 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.505 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:46.505 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:48:46.505 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:48:46.505 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.505 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.505 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:46.505 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:48:46.505 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:48:46.505 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.505 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.506 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.506 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:48:46.506 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:48:46.506 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.506 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.506 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:46.506 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:48:46.506 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:48:46.506 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.506 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.506 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:46.506 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:48:46.506 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:48:46.506 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.507 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.507 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:46.507 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:48:46.507 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:48:46.507 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.507 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:46.507 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.507 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.507 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.507 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:46.507 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:46.507 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 41.267052921000001, 2024-09-12T22:48:46.507 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:48:46.507 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:46.508 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:46.508 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:48:46.508 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:46.508 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.508 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:46.508 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:46.508 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.508 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.508 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.508 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:46.508 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:46.508 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.508 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.508 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.509 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:46.509 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:48:46.509 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:48:46.509 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.509 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.509 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:46.509 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:48:46.509 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:48:46.509 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.509 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.509 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:46.509 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:48:46.509 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:48:46.509 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.510 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.510 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.510 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:48:46.510 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:48:46.510 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.510 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.510 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:46.510 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:48:46.510 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:48:46.510 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.510 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.510 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:46.510 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:48:46.511 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:48:46.511 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.511 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.511 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:46.511 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:48:46.511 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:48:46.511 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.511 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:46.511 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.511 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.511 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.511 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:46.511 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:46.511 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 41.260112470999999, 2024-09-12T22:48:46.512 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:48:46.512 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:46.512 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:46.512 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.512 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:46.512 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.512 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:46.512 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:46.512 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.512 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.512 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.512 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:46.512 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:46.513 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.513 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.513 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.513 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:46.513 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:48:46.513 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:48:46.513 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.513 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.513 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:46.513 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:48:46.513 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:48:46.513 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.513 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:48:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:48:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:48:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:48:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:48:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:48:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:48:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:48:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:48:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:48:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:48:46.516 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:48:46.516 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.516 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:46.516 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.516 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.516 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.516 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:46.516 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:46.516 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 41.259023630999998, 2024-09-12T22:48:46.516 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:48:46.516 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:46.516 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:46.516 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.517 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:46.517 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.517 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:46.517 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:46.517 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.517 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.517 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.517 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:46.517 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:46.517 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.517 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.517 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.517 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:46.518 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:48:46.518 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:48:46.518 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.518 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.518 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:46.518 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:48:46.518 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:48:46.518 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.518 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.518 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:46.518 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:48:46.518 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:48:46.518 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.518 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.519 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.519 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:48:46.519 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:48:46.519 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.519 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.519 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:46.519 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:48:46.519 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:48:46.519 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.519 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.519 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:46.519 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:48:46.519 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:48:46.519 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.520 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.520 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:46.520 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:48:46.520 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:48:46.520 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.520 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.520 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:46.520 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:48:46.520 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:48:46.520 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.520 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:46.520 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.520 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.521 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.521 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:46.521 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:46.521 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 41.258974019999997, 2024-09-12T22:48:46.521 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:48:46.521 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:46.521 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:46.521 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.521 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:46.521 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.521 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:46.521 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:46.521 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.521 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.522 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.522 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:46.522 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:46.522 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.522 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.522 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.522 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:46.522 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:46.522 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:48:46.522 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.522 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.522 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:46.522 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:46.522 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:48:46.523 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.523 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.523 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:46.523 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:48:46.523 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:48:46.523 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.523 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.523 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.523 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:48:46.523 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:48:46.523 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.523 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.523 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:46.524 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:48:46.524 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:48:46.524 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.524 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.524 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:46.524 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:48:46.524 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:48:46.524 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.524 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.524 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:46.524 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:48:46.524 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:48:46.524 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.524 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.525 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:46.525 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:48:46.525 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:48:46.525 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.525 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:46.525 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.525 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.525 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.525 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:46.525 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:46.525 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 41.258906711000002, 2024-09-12T22:48:46.525 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:48:46.525 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:46.526 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:46.526 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.526 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:46.526 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.526 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:46.526 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:46.526 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.526 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.526 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.526 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:46.526 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:46.526 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.526 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.526 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.527 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:46.527 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:46.527 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:48:46.527 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.527 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.527 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:46.527 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:48:46.527 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:48:46.527 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.527 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.527 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:46.527 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:48:46.527 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:48:46.528 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.528 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.528 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.528 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:48:46.528 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:48:46.528 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.528 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.528 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:46.528 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:48:46.528 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:48:46.528 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.528 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.528 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:46.529 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:48:46.529 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:48:46.529 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.529 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.529 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:46.529 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:48:46.529 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:48:46.529 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.529 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.529 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:46.529 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:48:46.529 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:48:46.529 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.529 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:46.530 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.530 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.530 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.530 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:46.530 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:46.530 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 41.258338792000004, 2024-09-12T22:48:46.530 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:48:46.530 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:46.530 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:46.530 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.530 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:46.530 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.530 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:46.530 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:46.531 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.531 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.531 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.531 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:46.531 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:46.531 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.531 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.531 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.531 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:46.531 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:46.531 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:48:46.531 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.531 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.531 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:46.532 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:48:46.532 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:48:46.532 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.532 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.532 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:46.532 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:48:46.532 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:48:46.532 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.532 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.532 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.532 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:48:46.532 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:48:46.532 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.532 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.533 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:46.533 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:48:46.533 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:48:46.533 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.533 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.533 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:46.533 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:48:46.533 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:48:46.533 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.533 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.533 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:46.533 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:48:46.533 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:48:46.533 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.534 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.534 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:46.534 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:48:46.534 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:48:46.534 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.534 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:46.534 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.534 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.534 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.534 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:48:46.534 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:46.534 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 41.257961188000003, 2024-09-12T22:48:46.534 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:48:46.535 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:46.535 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:46.535 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.535 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:46.535 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.535 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:46.535 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:46.535 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.535 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.535 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.535 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:46.535 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:46.535 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:46.535 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.536 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.536 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:46.536 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:48:46.536 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:48:46.536 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.536 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.536 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:46.536 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:48:46.536 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:48:46.536 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.536 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.536 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:46.536 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:48:46.537 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:48:46.537 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.537 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.537 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.537 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:48:46.537 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:48:46.537 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.537 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.537 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:46.537 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:48:46.537 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:48:46.537 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.537 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.538 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:46.538 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:48:46.538 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:48:46.538 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.538 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.538 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:46.538 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:48:46.538 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:48:46.538 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:46.538 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:46.538 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:46.538 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:48:46.538 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:48:46.538 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.539 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:46.539 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.539 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:46.539 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:46.539 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:46.541 INFO:teuthology.orchestra.run.smithi066.stderr:noscrub is set 2024-09-12T22:48:46.541 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:46.541 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:46.539+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:46.641 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:46.640+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:46.645 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:46.645 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:48:46.645 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:48:46.645 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:46.654 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:46.742 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:46.741+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:46.796 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:46.796 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:48:46.797 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:48:46.797 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:48:46.797 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:46.805 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:46.843 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:46.841+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:46.943 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:46.942+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:46.950 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:46.950 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:48:46.950 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:48:46.950 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:48:46.950 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.950 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:48:46.950 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:46.950 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.902183018999999, 2024-09-12T22:48:46.950 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:48:46.950 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:46.951 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:46.951 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.951 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:46.951 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.951 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:46.951 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:46.951 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.951 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.951 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.951 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:46.951 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:46.951 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.951 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.952 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.952 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:46.952 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:46.952 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:48:46.952 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.952 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.952 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:46.952 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:48:46.952 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:48:46.952 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.952 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.952 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:46.952 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:48:46.953 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:48:46.953 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.953 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.953 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.953 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:48:46.953 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:48:46.953 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.953 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.953 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:46.953 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:48:46.953 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:48:46.953 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.953 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.954 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:46.954 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:48:46.954 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:48:46.954 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.954 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.954 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:46.954 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:48:46.954 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:48:46.954 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.954 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.954 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:46.954 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:48:46.954 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:48:46.955 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.955 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:46.955 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.955 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.955 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.955 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:48:46.955 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:46.955 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 44.901802291999999, 2024-09-12T22:48:46.955 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:48:46.955 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:46.955 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:46.955 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.955 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:46.955 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.956 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:46.956 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:46.956 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.956 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.956 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.956 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:46.956 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:46.956 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.956 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.956 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.956 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:46.956 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:48:46.957 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:48:46.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.957 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.957 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:46.957 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:48:46.957 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:48:46.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.957 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.957 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:46.957 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:48:46.957 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:48:46.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.957 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.957 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.958 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:48:46.958 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:48:46.958 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.958 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.958 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:46.958 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:48:46.958 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:48:46.958 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.958 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.958 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:46.958 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:48:46.958 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:48:46.958 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.958 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.959 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:46.959 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:48:46.959 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:48:46.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.959 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.959 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:46.959 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:48:46.959 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:48:46.959 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.959 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:46.959 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.959 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.960 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:48:46.960 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:46.960 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.781205481999997, 2024-09-12T22:48:46.960 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:48:46.960 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:46.960 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:46.960 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:48:46.960 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:46.960 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.960 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:46.960 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:46.960 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.961 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.961 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:46.961 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:46.961 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.961 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.961 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.961 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:46.961 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:46.961 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:48:46.961 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.961 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.961 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:46.961 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:48:46.961 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:48:46.961 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.962 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.962 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:46.962 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:48:46.962 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:48:46.962 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.962 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.962 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.962 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:48:46.962 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:48:46.962 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.962 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.962 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:46.962 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:48:46.962 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:48:46.963 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.963 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.963 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:46.963 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:48:46.963 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:48:46.963 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.963 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:46.963 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.963 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.963 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.963 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:46.963 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:46.963 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.778597302000001, 2024-09-12T22:48:46.963 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:48:46.964 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:46.964 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:46.964 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.964 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:46.964 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.964 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:46.964 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:46.964 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.964 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.964 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.964 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:46.964 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:46.964 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.965 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:46.965 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:48:46.965 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:48:46.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.965 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:46.965 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:48:46.965 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:48:46.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.965 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:46.965 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:48:46.966 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:48:46.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.966 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.966 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.966 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:48:46.966 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:48:46.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.966 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.966 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:46.966 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:48:46.966 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:48:46.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.966 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.966 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:46.967 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:48:46.967 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:48:46.967 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.967 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.967 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:46.967 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:48:46.967 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:48:46.967 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.967 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.967 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:46.967 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:48:46.968 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:48:46.968 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.968 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:46.968 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.968 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.968 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.968 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:46.968 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:46.968 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.777704079000003, 2024-09-12T22:48:46.968 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:48:46.968 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:46.968 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:46.968 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.969 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:46.969 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.969 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:46.969 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:46.969 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.969 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.969 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:46.969 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:46.969 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.969 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.969 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:46.969 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:48:46.970 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:48:46.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.970 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.970 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:46.970 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:48:46.970 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:48:46.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.970 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.970 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:46.970 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:48:46.970 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:48:46.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.970 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.970 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.971 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:48:46.971 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:48:46.971 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.971 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.971 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:46.971 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:48:46.971 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:48:46.971 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.971 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.971 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:46.971 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:48:46.971 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:48:46.972 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.972 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.972 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:46.972 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:48:46.972 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:48:46.972 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.972 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.972 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:46.972 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:48:46.972 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:48:46.972 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.972 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.972 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:46.973 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:48:46.973 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:48:46.973 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.973 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.973 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:46.973 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:48:46.973 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:48:46.973 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.973 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.973 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:46.973 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:48:46.973 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:48:46.973 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.974 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:46.974 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.974 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.974 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.974 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:46.974 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:46.974 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.777632421, 2024-09-12T22:48:46.974 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:48:46.974 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:46.974 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:46.974 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.974 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:46.974 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.974 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:46.975 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:46.975 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.975 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.975 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.975 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:46.975 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:46.975 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.975 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.975 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.975 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:46.975 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:48:46.975 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:48:46.975 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.975 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.976 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:46.976 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:48:46.976 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:48:46.976 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.976 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.976 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:46.976 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:48:46.976 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:48:46.976 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.976 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.976 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.976 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:48:46.976 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:48:46.976 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.977 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.977 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:46.977 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:48:46.977 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:48:46.977 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.977 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.977 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:46.977 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:48:46.977 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:48:46.977 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.977 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.977 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:46.977 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:48:46.977 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:48:46.978 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.978 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.978 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:46.978 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:48:46.978 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:48:46.978 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.978 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.978 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:46.978 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:48:46.978 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:48:46.978 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.978 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.978 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:46.978 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:48:46.979 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:48:46.979 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.979 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.979 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:46.979 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:48:46.979 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:48:46.979 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.979 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:46.979 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.979 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.979 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.979 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:46.979 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:46.980 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.777589702999997, 2024-09-12T22:48:46.980 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:48:46.980 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:46.980 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:46.980 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.980 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:46.980 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.980 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:46.980 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:46.980 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.980 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.980 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.980 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:46.980 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:46.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.981 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.981 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.981 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:46.981 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:48:46.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:48:46.981 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.981 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.981 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:46.981 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:48:46.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:48:46.981 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.981 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.982 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:46.982 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:48:46.982 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:48:46.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.982 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.982 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.982 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:48:46.982 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:48:46.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.982 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.982 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:46.982 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:48:46.982 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:48:46.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.983 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:46.983 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:48:46.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:48:46.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.983 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:46.983 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:48:46.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:48:46.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.983 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:46.983 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:48:46.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:48:46.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.984 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:46.984 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:48:46.984 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:48:46.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.984 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:46.984 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:48:46.984 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:48:46.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.984 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:46.985 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:48:46.985 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:48:46.985 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.985 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:46.985 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.985 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.985 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.985 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:46.985 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:46.985 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.777551785999997, 2024-09-12T22:48:46.985 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:48:46.985 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:46.985 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:46.986 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.986 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:46.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.986 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:46.986 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:46.986 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.986 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:46.986 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:46.986 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.986 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:46.987 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:48:46.987 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:48:46.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.987 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:46.987 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:48:46.987 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:48:46.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.987 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:46.987 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:48:46.987 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:48:46.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.988 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.988 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:48:46.988 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:48:46.988 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.988 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.988 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:46.988 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:48:46.988 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:48:46.988 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.988 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.988 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:46.988 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:48:46.988 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:48:46.989 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.989 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.989 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:46.989 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:46.989 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:48:46.989 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.989 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.989 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:46.989 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:48:46.989 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:48:46.989 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.989 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.989 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:46.989 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:48:46.989 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:48:46.990 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.990 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.990 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:46.990 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:48:46.990 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:48:46.990 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.990 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.990 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:46.990 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:48:46.990 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:48:46.990 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.990 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:46.990 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.991 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.991 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:46.991 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:46.991 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.777528335, 2024-09-12T22:48:46.991 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:48:46.991 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:46.991 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:46.991 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.991 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:46.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.991 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:46.991 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:46.991 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.992 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.992 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:46.992 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:46.992 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.992 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.992 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:46.992 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:48:46.992 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:48:46.992 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.992 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:46.992 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:48:46.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:48:46.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.993 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.993 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:46.993 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:48:46.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:48:46.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.993 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.993 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.993 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:48:46.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:48:46.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.993 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.994 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:46.994 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:48:46.994 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:48:46.994 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.994 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.994 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:46.994 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:48:46.994 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:48:46.994 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.994 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.994 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:46.994 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:46.994 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:48:46.994 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.994 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.995 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:46.995 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:48:46.995 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:48:46.995 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.995 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.995 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:46.995 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:48:46.995 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:48:46.995 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.995 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.995 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:46.995 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:48:46.995 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:48:46.995 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.996 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.996 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:46.996 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:48:46.996 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:48:46.996 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.996 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:46.996 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:46.996 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.996 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.996 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:46.996 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:46.996 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.777504098000001, 2024-09-12T22:48:46.996 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:48:46.996 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:46.997 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:46.997 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:46.997 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:46.997 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.997 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:46.997 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:46.997 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.997 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.997 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:46.997 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:46.997 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:46.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.998 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.998 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:46.998 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:46.998 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:48:46.998 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.998 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.998 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:46.998 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:48:46.998 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:48:46.998 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.998 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.998 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:46.998 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:48:46.998 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:48:46.999 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.999 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.999 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:46.999 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:48:46.999 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:48:46.999 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.999 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.999 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:46.999 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:48:46.999 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:48:46.999 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:46.999 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:46.999 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:46.999 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:48:47.000 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:48:47.000 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.000 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.000 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:47.000 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:48:47.000 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:48:47.000 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.000 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.000 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:47.000 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:48:47.000 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:48:47.000 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.000 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.000 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:47.001 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:48:47.001 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:48:47.001 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.001 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.001 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:47.001 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:48:47.001 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:48:47.001 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.001 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.001 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:47.001 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:48:47.001 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:48:47.001 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:47.002 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:47.002 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:47.002 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.002 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.002 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:47.002 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:47.002 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.777476180999997, 2024-09-12T22:48:47.002 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:48:47.002 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:47.002 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:47.002 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:47.002 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:47.002 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.002 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:47.003 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:47.003 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:47.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.003 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:47.003 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:47.003 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:47.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.003 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:47.003 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:47.003 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:48:47.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.004 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:47.004 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:48:47.004 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:48:47.004 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.004 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.004 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:47.004 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:48:47.004 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:48:47.004 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.004 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.004 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:47.004 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:48:47.004 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:48:47.004 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.005 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.005 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:47.005 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:48:47.005 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:48:47.005 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.005 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.005 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:47.005 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:48:47.005 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:48:47.005 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.005 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.005 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:47.005 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:48:47.006 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:48:47.006 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:47.006 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:47.006 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:47.006 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.006 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:47.006 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:47.006 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.777401685999997, 2024-09-12T22:48:47.006 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:48:47.006 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:47.006 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:47.006 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:47.006 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:47.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.007 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:47.007 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:47.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:47.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.007 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:47.007 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:47.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:47.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.007 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:47.007 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:48:47.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:48:47.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.008 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:47.008 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:48:47.008 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:48:47.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.008 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:47.008 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:48:47.008 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:48:47.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.008 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:47.008 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:48:47.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:48:47.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.009 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.009 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:47.009 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:48:47.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:48:47.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.009 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.009 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:47.009 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:48:47.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:48:47.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.009 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.010 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:47.010 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:48:47.010 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:48:47.010 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:47.010 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:47.010 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:47.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.010 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:47.010 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:47.010 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.777355657999998, 2024-09-12T22:48:47.010 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:48:47.010 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:47.010 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:47.011 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:47.011 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:47.011 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.011 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:47.011 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:47.011 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:47.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.011 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.011 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:47.011 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:47.011 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:47.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.011 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.011 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:47.012 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:48:47.012 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:48:47.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.012 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:47.012 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:48:47.012 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:48:47.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.012 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:47.012 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:48:47.012 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:48:47.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.013 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:47.013 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:48:47.013 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:48:47.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.013 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:47.013 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:48:47.013 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:48:47.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.013 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:47.013 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:48:47.013 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:48:47.014 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.014 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.014 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:47.014 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:48:47.014 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:48:47.014 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:47.014 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:47.014 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:47.014 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.014 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.014 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:47.014 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:47.014 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.775184774000003, 2024-09-12T22:48:47.014 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:48:47.014 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:47.015 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:47.015 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:47.015 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:47.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.015 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:47.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:47.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:47.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.015 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:47.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:47.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:47.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.016 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:47.016 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:47.016 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:48:47.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.016 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.016 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:47.016 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:48:47.016 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:48:47.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.016 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.016 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:47.016 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:48:47.016 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:48:47.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.017 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:47.017 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:47.017 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:48:47.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.017 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:47.017 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:48:47.017 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:48:47.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.017 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:47.017 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:47.017 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:48:47.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.018 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:47.018 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:48:47.018 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:48:47.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.018 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:47.018 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:48:47.018 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:48:47.018 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:47.018 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:47.018 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:47.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.019 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:47.019 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:47.019 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.775134324, 2024-09-12T22:48:47.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:48:47.019 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:47.019 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:47.019 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:47.019 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:47.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.019 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:47.019 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:47.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:47.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.020 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.020 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:47.020 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:47.020 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:47.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.020 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.020 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:47.020 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:48:47.020 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:48:47.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.020 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.020 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:47.020 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:48:47.021 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:48:47.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:47.021 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:48:47.021 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:48:47.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:47.021 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:48:47.021 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:48:47.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:47.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:48:47.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:48:47.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.022 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:47.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:48:47.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:48:47.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.022 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:47.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:48:47.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:48:47.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.023 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:47.023 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:48:47.023 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:48:47.023 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:47.023 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:47.023 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:47.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.023 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:47.023 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:47.023 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.775080885999998, 2024-09-12T22:48:47.023 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:48:47.023 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:47.023 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:47.024 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:47.024 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:47.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.024 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:47.024 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:47.024 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:47.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.024 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:47.024 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:47.024 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:47.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.024 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:47.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:47.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:48:47.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.025 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:47.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:48:47.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:48:47.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.025 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:47.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:47.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:48:47.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:47.026 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:48:47.026 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:48:47.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:47.026 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:48:47.026 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:48:47.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:47.026 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:48:47.026 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:48:47.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.027 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:47.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:48:47.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:48:47.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.027 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:47.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:48:47.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:48:47.027 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:47.027 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:47.028 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:47.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.028 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:48:47.028 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:47.028 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.771096532999998, 2024-09-12T22:48:47.028 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:48:47.028 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:47.028 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:47.028 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:47.028 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:47.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.028 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:47.028 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:47.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:47.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.029 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:47.029 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:47.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:47.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.029 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:47.029 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:48:47.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:48:47.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.030 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:47.030 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:48:47.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:48:47.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.030 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:47.030 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:48:47.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:48:47.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.030 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:47.030 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:48:47.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:48:47.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:47.031 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:48:47.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:48:47.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:47.031 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:48:47.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:48:47.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:47.031 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:48:47.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:48:47.032 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:47.032 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:47.032 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:47.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.032 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:48:47.032 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:47.032 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.785943994, 2024-09-12T22:48:47.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:48:47.032 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:47.032 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:47.032 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:47.032 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:47.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.033 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:47.033 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:47.033 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:47.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.033 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:47.033 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:47.033 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:47.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.033 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:47.033 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:48:47.033 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:48:47.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.034 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:47.034 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:48:47.034 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:48:47.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.034 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:47.034 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:48:47.034 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:48:47.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.034 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:47.034 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:48:47.034 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:48:47.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.035 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:47.035 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:48:47.035 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:48:47.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.035 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:47.035 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:48:47.035 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:48:47.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.035 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:47.036 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:48:47.036 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:48:47.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.036 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:47.036 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:48:47.036 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:48:47.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.036 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:47.036 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:48:47.036 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:48:47.037 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.037 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:47.037 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:48:47.037 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:48:47.037 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.037 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:47.037 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:48:47.038 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:48:47.038 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:47.038 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:47.038 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:47.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.038 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:48:47.038 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:47.038 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.784027749, 2024-09-12T22:48:47.038 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:48:47.038 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:47.039 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:47.039 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:47.039 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:47.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.039 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:47.039 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:47.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:47.039 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.039 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:47.039 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:47.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:47.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.040 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:47.040 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:48:47.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:48:47.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.040 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:47.040 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:48:47.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:48:47.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.041 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:47.041 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:48:47.041 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:48:47.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.041 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:47.041 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:48:47.041 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:48:47.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.042 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:47.042 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:48:47.042 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:48:47.042 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.042 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:47.042 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:48:47.042 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:48:47.042 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.043 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:47.043 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:48:47.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:48:47.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.043 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:47.043 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:48:47.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:48:47.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.043 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:47.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:48:47.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:48:47.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:47.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:48:47.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:48:47.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:47.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:48:47.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:48:47.045 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:47.045 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:47.045 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:47.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.045 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:48:47.045 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:47.045 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.783274374000001, 2024-09-12T22:48:47.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012160610000000001, 2024-09-12T22:48:47.045 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:47.045 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:47.046 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:47.046 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:47.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:47.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:47.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:47.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:47.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:47.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:47.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:47.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164967+0000", 2024-09-12T22:48:47.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:48:47.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:47.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164974+0000", 2024-09-12T22:48:47.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:48:47.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:47.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164987+0000", 2024-09-12T22:48:47.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3689000000000001e-05 2024-09-12T22:48:47.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:47.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164995+0000", 2024-09-12T22:48:47.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2959999999999999e-06 2024-09-12T22:48:47.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:47.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165068+0000", 2024-09-12T22:48:47.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2449999999999999e-05 2024-09-12T22:48:47.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:47.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165212+0000", 2024-09-12T22:48:47.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144117 2024-09-12T22:48:47.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:47.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166066+0000", 2024-09-12T22:48:47.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085441100000000002 2024-09-12T22:48:47.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:47.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166107+0000", 2024-09-12T22:48:47.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0450000000000001e-05 2024-09-12T22:48:47.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:47.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166181+0000", 2024-09-12T22:48:47.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-12T22:48:47.051 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:47.051 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:47.051 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:47.051 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:47.051 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:47.051 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:47.053 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:47.051+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:47.053 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:47.153 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:47.151+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:47.161 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:47.161 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:48:47.161 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:48:47.161 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:47.169 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:47.254 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:47.252+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:47.312 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:47.312 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:48:47.312 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:48:47.312 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:48:47.312 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:47.321 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:47.355 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:47.354+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:47.457 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:47.456+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:47.464 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:47.465 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:48:47.465 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:48:47.465 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:48:47.465 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.465 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:48:47.465 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:47.465 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 51.078966260999998, 2024-09-12T22:48:47.465 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:48:47.465 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:47.465 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:47.465 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:47.466 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:47.466 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.466 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:47.466 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:47.466 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.466 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.466 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.466 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:47.466 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:47.466 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.466 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.466 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.466 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:47.467 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:47.467 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:48:47.467 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.467 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.467 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:47.467 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:48:47.467 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:48:47.467 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.467 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.467 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:47.467 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:48:47.467 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:48:47.467 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.468 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.468 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:47.468 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:48:47.468 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:48:47.468 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.468 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.468 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:47.468 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:48:47.468 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:48:47.468 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.468 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.469 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:47.469 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:48:47.469 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:48:47.469 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.469 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.469 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:47.469 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:48:47.469 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:48:47.469 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.469 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.469 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:47.469 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:48:47.470 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:48:47.470 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.470 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:47.470 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.470 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.470 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.470 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:48:47.470 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:47.470 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 51.078523678000003, 2024-09-12T22:48:47.470 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:48:47.470 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:47.470 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:47.470 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:47.471 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:47.471 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.471 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:47.471 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:47.471 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.471 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.471 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.471 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:47.471 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:47.471 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.471 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.471 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.471 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:47.472 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:48:47.472 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:48:47.472 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.472 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.472 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:47.472 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:48:47.472 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:48:47.472 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.472 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.472 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:47.472 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:48:47.472 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:48:47.473 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.473 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.473 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:47.473 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:48:47.473 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:48:47.473 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.473 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.473 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:47.473 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:48:47.473 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:48:47.473 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.473 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.473 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:47.473 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:48:47.474 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:48:47.474 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.474 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.474 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:47.474 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:48:47.474 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:48:47.474 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.474 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.474 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:47.474 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:48:47.474 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:48:47.474 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.474 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:47.475 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.475 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.475 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.475 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:48:47.475 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:47.475 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 51.078157521000001, 2024-09-12T22:48:47.475 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:48:47.475 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:47.475 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:47.475 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:47.476 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:47.476 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.476 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:47.476 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:47.476 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.476 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.476 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.476 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:47.476 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:47.476 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.476 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.476 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.476 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:47.476 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:48:47.477 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:48:47.477 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.477 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.477 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:47.477 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:48:47.477 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:48:47.477 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.477 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.477 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:47.477 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:48:47.477 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:48:47.477 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.477 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.478 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:47.478 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:48:47.478 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:48:47.478 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.478 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.478 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:47.478 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:48:47.478 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:48:47.478 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.478 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.478 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:47.478 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:48:47.478 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:48:47.478 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.479 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.479 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:47.479 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:48:47.479 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:48:47.479 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.479 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.479 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:47.479 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:48:47.479 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:48:47.479 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.479 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:47.479 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.479 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.480 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.480 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:48:47.480 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:47.480 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 51.077745209, 2024-09-12T22:48:47.480 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:48:47.480 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:47.480 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:47.480 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:47.480 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:47.480 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.480 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:47.480 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:47.481 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.481 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.481 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.481 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:47.481 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:47.481 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.481 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.481 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.481 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:47.481 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:47.481 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:48:47.481 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.481 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.481 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:47.482 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:48:47.482 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:48:47.482 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.482 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.482 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:47.482 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:48:47.482 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:48:47.482 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.482 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.482 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:47.482 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:48:47.482 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:48:47.482 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.483 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.483 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:47.483 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:48:47.483 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:48:47.483 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.483 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.483 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:47.483 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:48:47.483 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:48:47.483 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.483 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.483 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:47.483 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:48:47.483 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:48:47.484 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.484 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.484 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:47.484 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:48:47.484 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:48:47.484 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.484 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:47.484 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.484 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.484 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.484 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:48:47.484 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:47.484 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 50.943895114999997, 2024-09-12T22:48:47.485 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:48:47.485 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:47.485 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:47.485 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:47.485 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:47.485 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.485 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:47.485 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:47.485 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.485 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.485 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.485 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:47.485 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:47.486 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.486 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.486 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.486 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:47.486 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:47.486 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:48:47.486 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.486 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.486 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:47.486 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:48:47.486 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:48:47.487 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.487 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.487 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:47.487 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:48:47.487 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:48:47.487 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.487 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.487 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:47.487 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:48:47.487 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:48:47.487 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.487 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.487 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:47.488 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:48:47.488 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:48:47.488 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.488 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.488 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:47.488 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:48:47.488 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:48:47.488 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.488 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.488 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:47.488 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:48:47.488 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:48:47.489 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.489 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.489 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:47.489 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:48:47.489 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:48:47.489 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.489 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:47.489 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.489 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.489 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.489 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:47.489 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:47.489 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 42.298659561000001, 2024-09-12T22:48:47.490 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:48:47.490 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:47.490 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:47.490 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:47.490 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:47.490 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.490 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:47.490 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:47.490 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.490 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.490 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.490 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:47.490 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:47.491 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.491 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.491 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.491 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:47.491 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:48:47.491 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:48:47.491 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.491 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.491 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:47.491 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:48:47.491 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:48:47.491 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.491 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.491 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:47.492 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:48:47.492 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:48:47.492 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.492 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.492 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:47.492 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:48:47.492 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:48:47.492 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.492 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.492 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:47.492 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:48:47.492 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:48:47.493 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.493 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.493 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:47.496 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:48:47.496 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:48:47.496 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.496 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.497 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:47.497 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:48:47.497 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:48:47.497 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.497 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.497 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:47.497 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:48:47.497 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:48:47.497 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.497 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.497 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:47.497 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:48:47.498 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:48:47.498 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.498 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.498 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:47.498 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:48:47.498 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:48:47.498 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.498 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.498 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:47.498 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:48:47.498 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:48:47.498 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.498 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.498 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:47.499 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:48:47.499 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:48:47.499 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.499 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.499 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:47.499 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:48:47.499 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:48:47.499 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.499 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:47.499 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.499 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.499 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.500 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:47.500 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:47.500 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 42.298560043999998, 2024-09-12T22:48:47.500 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:48:47.500 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:47.500 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:47.500 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:47.500 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:47.500 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.500 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:47.500 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:47.500 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.501 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.501 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.501 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:47.501 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:47.501 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.501 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.501 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.501 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:47.501 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:48:47.501 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:48:47.501 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.501 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.501 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:47.501 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:48:47.502 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:48:47.502 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.502 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.502 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:47.502 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:48:47.502 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:48:47.502 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.502 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.502 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:47.502 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:48:47.502 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:48:47.502 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.502 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.503 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:47.503 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:48:47.503 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:48:47.503 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.503 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.503 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:47.503 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:48:47.503 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:48:47.503 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.503 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.503 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:47.503 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:48:47.503 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:48:47.504 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.504 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.504 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:47.504 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:48:47.504 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:48:47.504 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.504 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.504 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:47.504 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:48:47.504 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:48:47.504 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.504 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.504 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:47.505 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:48:47.505 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:48:47.505 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.505 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.505 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:47.505 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:48:47.505 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:48:47.505 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.505 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.505 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:47.505 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:48:47.505 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:48:47.505 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.506 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.506 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:47.506 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:48:47.506 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:48:47.506 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.506 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:47.506 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.506 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.506 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.506 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:47.506 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:47.506 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 42.298515305000002, 2024-09-12T22:48:47.506 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:48:47.506 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:47.507 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:47.507 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:47.507 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:47.507 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.507 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:47.507 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:47.507 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.507 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.507 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.507 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:47.507 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:47.507 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.507 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.508 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.508 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:47.508 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:48:47.508 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:48:47.508 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.508 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.508 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:47.508 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:48:47.508 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:48:47.508 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.508 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.508 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:47.508 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:48:47.509 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:48:47.509 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.509 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.509 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:47.509 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:48:47.509 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:48:47.509 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.509 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.509 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:47.509 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:48:47.509 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:48:47.509 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.509 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.510 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:47.510 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:48:47.510 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:48:47.510 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.510 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.510 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:47.510 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:48:47.510 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:48:47.510 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.510 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.510 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:47.510 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:48:47.510 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:48:47.510 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.511 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.511 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:47.511 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:48:47.511 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:48:47.511 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.511 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.511 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:47.511 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:48:47.511 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:48:47.511 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.511 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.511 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:47.511 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:48:47.512 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:48:47.512 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.512 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.512 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:47.512 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:48:47.512 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:48:47.512 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.512 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.512 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:47.512 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:48:47.512 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:48:47.512 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.512 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:47.513 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.513 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.513 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.513 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:47.513 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:47.513 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 42.298287604000002, 2024-09-12T22:48:47.513 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:48:47.513 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:47.513 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:47.513 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:47.513 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:47.513 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.513 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:47.514 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:47.514 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.514 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.514 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.514 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:47.514 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:47.514 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.514 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.514 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.514 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:47.514 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:48:47.514 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:48:47.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.515 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.515 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:47.515 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:48:47.515 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:48:47.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.515 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.515 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:47.515 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:48:47.515 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:48:47.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.515 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.515 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:47.516 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:48:47.516 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:48:47.516 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.516 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.516 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:47.516 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:48:47.516 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:48:47.516 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.516 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.516 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:47.516 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:48:47.516 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:48:47.516 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.517 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.517 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:47.517 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:48:47.517 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:48:47.517 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.517 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.517 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:47.517 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:48:47.517 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:48:47.517 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.517 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.517 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:47.517 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:48:47.518 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:48:47.518 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.518 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.518 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:47.518 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:48:47.518 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:48:47.518 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.518 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.518 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:47.518 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:48:47.518 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:48:47.518 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.518 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.519 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:47.519 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:48:47.519 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:48:47.519 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.519 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.519 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:47.519 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:48:47.519 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:48:47.519 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.519 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:47.519 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.519 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.519 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.520 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:47.520 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:47.520 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 42.298122495999998, 2024-09-12T22:48:47.520 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:48:47.520 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:47.520 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:47.520 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:47.520 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:47.520 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.520 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:47.520 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:47.520 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.520 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.521 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.521 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:47.521 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:47.521 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.521 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.521 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.521 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:47.521 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:48:47.521 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:48:47.521 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.521 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.521 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:47.521 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:48:47.521 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:48:47.522 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.522 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.522 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:47.522 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:48:47.522 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:48:47.522 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.522 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.522 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:47.522 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:48:47.522 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:48:47.522 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.522 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.523 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:47.523 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:48:47.523 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:48:47.523 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.523 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.523 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:47.523 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:48:47.523 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:48:47.523 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.523 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.523 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:47.523 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:48:47.523 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:48:47.523 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.524 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.524 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:47.524 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:48:47.524 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:48:47.524 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.524 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.524 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:47.524 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:48:47.524 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:48:47.524 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.524 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.524 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:47.525 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:48:47.525 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:48:47.525 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.525 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.525 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:47.525 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:48:47.525 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:48:47.525 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.525 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.525 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:47.525 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:48:47.525 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:48:47.525 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.526 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.526 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:47.526 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:48:47.526 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:48:47.526 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.526 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:47.526 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.526 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.526 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.526 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:47.526 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:47.526 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 42.298061210999997, 2024-09-12T22:48:47.526 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:48:47.527 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:47.527 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:47.527 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:47.527 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:47.527 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.527 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:47.527 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:47.527 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.527 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.527 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.527 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:47.527 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:47.527 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.528 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.528 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.528 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:47.528 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:47.528 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:48:47.528 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.528 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.528 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:47.528 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:48:47.528 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:48:47.528 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.528 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.528 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:47.529 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:48:47.529 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:48:47.529 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.529 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.529 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:47.529 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:48:47.529 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:48:47.529 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.529 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.529 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:47.529 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:48:47.529 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:48:47.529 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.530 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.530 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:47.530 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:48:47.530 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:48:47.530 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.530 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.530 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:47.530 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:48:47.530 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:48:47.530 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.530 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.530 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:47.530 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:48:47.530 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:48:47.531 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.531 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.531 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:47.531 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:48:47.531 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:48:47.531 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.531 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.531 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:47.531 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:48:47.531 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:48:47.531 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.531 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.531 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:47.532 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:48:47.532 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:48:47.532 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.532 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.532 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:47.532 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:48:47.532 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:48:47.532 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.532 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.532 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:47.533 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:48:47.533 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:48:47.533 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.533 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:47.533 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.533 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.533 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.533 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:47.533 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:47.533 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 42.297981102999998, 2024-09-12T22:48:47.533 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:48:47.533 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:47.534 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:47.534 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:47.534 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:47.534 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.534 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:47.534 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:47.534 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.534 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.534 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.534 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:47.534 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:47.534 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.534 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.534 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.535 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:47.535 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:48:47.535 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:48:47.535 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.535 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.535 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:47.535 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:48:47.535 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:48:47.535 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.535 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.535 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:47.535 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:48:47.535 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:48:47.535 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.536 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.536 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:47.536 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:48:47.536 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:48:47.536 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.536 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.536 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:47.536 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:48:47.536 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:48:47.536 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.536 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.536 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:47.536 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:48:47.537 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:48:47.537 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.537 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.537 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:47.537 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:48:47.537 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:48:47.537 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.537 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.537 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:47.537 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:48:47.537 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:48:47.537 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.537 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.538 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:47.538 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:48:47.538 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:48:47.538 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.538 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.538 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:47.538 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:48:47.538 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:48:47.538 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.538 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.538 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:47.538 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:48:47.538 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:48:47.538 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.539 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.539 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:47.539 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:48:47.539 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:48:47.539 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.539 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.539 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:47.539 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:48:47.539 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:48:47.539 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.539 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:47.539 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.539 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.540 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.540 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:47.540 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:47.540 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 42.297932150000001, 2024-09-12T22:48:47.540 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:48:47.540 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:47.540 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:47.540 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:48:47.540 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:47.540 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.540 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:47.540 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:47.540 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.541 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.541 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.541 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:47.541 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:47.541 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.541 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.541 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.541 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:47.541 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:47.541 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:48:47.541 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.541 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.541 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:47.542 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:48:47.542 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:48:47.542 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.542 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.542 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:47.542 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:48:47.542 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:48:47.542 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.542 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.542 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:47.542 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:48:47.542 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:48:47.542 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.543 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.543 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:47.543 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:48:47.543 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:48:47.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.543 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.543 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:47.543 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:48:47.543 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:48:47.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.543 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.543 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:47.543 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:48:47.543 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:48:47.544 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.544 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:47.544 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.544 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.544 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.544 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:47.544 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:47.544 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 42.297883050000003, 2024-09-12T22:48:47.544 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:48:47.544 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:47.544 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:47.544 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:48:47.544 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:47.545 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.545 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:47.545 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:47.545 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.545 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.545 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.545 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:47.545 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:47.545 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.545 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.545 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.545 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:47.545 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:48:47.546 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:48:47.546 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.546 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.546 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:47.546 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:48:47.546 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:48:47.546 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.546 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.546 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:47.546 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:48:47.546 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:48:47.546 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.546 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.546 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:47.547 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:48:47.547 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:48:47.547 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.547 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.547 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:47.547 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:48:47.547 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:48:47.547 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.547 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.547 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:47.547 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:48:47.547 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:48:47.547 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.548 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.548 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:47.548 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:48:47.548 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:48:47.548 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.548 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:47.548 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.548 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.548 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:47.548 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:47.548 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 42.290942600000001, 2024-09-12T22:48:47.549 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:48:47.549 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:47.549 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:47.549 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:47.549 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:47.549 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.549 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:47.549 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:47.550 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.550 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.550 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.550 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:47.550 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:47.550 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.550 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.550 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.550 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:47.550 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:48:47.550 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:48:47.550 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.550 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.550 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:47.551 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:48:47.551 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:48:47.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.551 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.551 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:47.551 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:48:47.551 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:48:47.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.551 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.551 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:47.551 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:48:47.551 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:48:47.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.552 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.552 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:47.552 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:48:47.552 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:48:47.552 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.552 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.552 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:47.552 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:48:47.552 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:48:47.552 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.552 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.553 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:47.553 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:48:47.553 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:48:47.553 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.553 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.553 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:47.553 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:48:47.553 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:48:47.553 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.553 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:47.553 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.553 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.553 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.554 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:47.554 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:47.554 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 42.28985376, 2024-09-12T22:48:47.554 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:48:47.554 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:47.554 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:47.554 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:47.554 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:47.554 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.554 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:47.554 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:47.554 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.555 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.555 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:47.555 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:47.555 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.555 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.555 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.555 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:47.555 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:48:47.555 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:48:47.555 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.555 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.555 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:47.556 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:48:47.556 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:48:47.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.556 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:47.556 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:48:47.556 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:48:47.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.556 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:47.556 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:48:47.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:48:47.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.557 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.557 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:47.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:48:47.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:48:47.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.557 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.557 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:47.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:48:47.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:48:47.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.557 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.558 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:47.558 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:48:47.558 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:48:47.558 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.558 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.558 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:47.558 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:48:47.558 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:48:47.558 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.558 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:47.558 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.558 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.559 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.559 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:47.559 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:47.559 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 42.289804148999998, 2024-09-12T22:48:47.559 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:48:47.559 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:47.559 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:47.559 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:47.559 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:47.559 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.559 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:47.559 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:47.559 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.559 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.560 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.560 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:47.560 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:47.560 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.560 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.560 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.560 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:47.560 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:47.560 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:48:47.560 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.560 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.560 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:47.561 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:47.561 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:48:47.561 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.561 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.561 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:47.561 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:48:47.561 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:48:47.561 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.561 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.561 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:47.561 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:48:47.561 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:48:47.561 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.562 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.562 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:47.562 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:48:47.562 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:48:47.562 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.562 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.562 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:47.562 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:48:47.562 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:48:47.562 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.562 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.562 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:47.562 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:48:47.563 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:48:47.563 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.563 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.563 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:47.563 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:48:47.563 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:48:47.563 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.563 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:47.563 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.563 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.563 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.563 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:47.563 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:47.563 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 42.289736840000003, 2024-09-12T22:48:47.564 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:48:47.564 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:47.564 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:47.564 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:47.564 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:47.564 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.564 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:47.564 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:47.564 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.564 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.564 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.564 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:47.564 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:47.565 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.565 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.565 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.565 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:47.565 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:47.565 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:48:47.565 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.565 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.565 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:47.565 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:48:47.565 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:48:47.565 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.565 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.566 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:47.566 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:48:47.566 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:48:47.566 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.566 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.566 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:47.566 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:48:47.566 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:48:47.566 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.566 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.566 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:47.566 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:48:47.566 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:48:47.566 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.567 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.567 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:47.567 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:48:47.567 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:48:47.567 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.567 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.567 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:47.567 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:48:47.567 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:48:47.567 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.567 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.567 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:47.567 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:48:47.567 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:48:47.568 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.568 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:47.568 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.568 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.568 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.568 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:47.568 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:47.568 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 42.289168920999998, 2024-09-12T22:48:47.568 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:48:47.568 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:47.568 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:47.568 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:47.569 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:47.569 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.569 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:47.569 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:47.569 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.569 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.569 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.569 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:47.569 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:47.569 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.569 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.569 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.569 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:47.570 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:47.570 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:48:47.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.570 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.570 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:47.570 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:48:47.570 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:48:47.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.570 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.570 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:47.570 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:48:47.570 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:48:47.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.570 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.571 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:47.571 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:48:47.571 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:48:47.571 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.571 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.571 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:47.571 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:48:47.571 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:48:47.571 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.571 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.571 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:47.571 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:48:47.571 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:48:47.571 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.572 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.572 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:47.572 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:48:47.572 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:48:47.572 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.572 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.572 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:47.572 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:48:47.572 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:48:47.572 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.572 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:47.572 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.572 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.573 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:48:47.573 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:47.573 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 42.288791316999998, 2024-09-12T22:48:47.573 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:48:47.573 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:47.573 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:47.573 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:47.573 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:47.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.573 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:47.573 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:47.573 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.574 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.574 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.574 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:47.574 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:47.574 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:47.574 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.574 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.574 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:47.574 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:48:47.574 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:48:47.574 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.574 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.574 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:47.574 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:48:47.575 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:48:47.575 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.575 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.575 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:47.575 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:48:47.575 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:48:47.575 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.575 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.575 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:47.575 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:48:47.575 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:48:47.575 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.575 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.575 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:47.576 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:48:47.576 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:48:47.576 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.576 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.576 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:47.576 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:48:47.576 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:48:47.576 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.576 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.576 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:47.576 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:48:47.576 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:48:47.576 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:47.577 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:47.577 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:47.577 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:48:47.577 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:48:47.577 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.577 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:47.577 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.577 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:47.577 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:47.577 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:47.579 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:47.579 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:47.578+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:47.679 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:47.678+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:47.686 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:47.686 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:48:47.687 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:48:47.687 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:47.695 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:47.781 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:47.780+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:47.838 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:47.838 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:48:47.839 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:48:47.839 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:48:47.839 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:47.847 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:47.888 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:47.887+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:47.895 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:48:47.983 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:47.982+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:47.991 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:47.991 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:48:47.992 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:48:47.992 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:48:47.992 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.992 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:48:47.992 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:47.992 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.943701496000003, 2024-09-12T22:48:47.992 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:48:47.992 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:47.992 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:47.992 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:47.992 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:47.992 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:47.993 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:47.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:47.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.993 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.993 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:47.993 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:47.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:47.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.993 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.993 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:47.993 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:47.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:48:47.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.994 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.994 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:47.994 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:48:47.994 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:48:47.994 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.994 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.994 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:47.994 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:48:47.994 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:48:47.994 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.994 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.994 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:47.994 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:48:47.994 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:48:47.995 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.995 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.995 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:47.995 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:48:47.995 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:48:47.995 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.995 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.995 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:47.995 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:48:47.995 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:48:47.995 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.995 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.995 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:47.996 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:48:47.996 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:48:47.996 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.996 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.996 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:47.996 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:48:47.996 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:48:47.996 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:47.996 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:47.996 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:47.996 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.996 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.996 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:48:47.997 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:47.997 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 45.943320769000003, 2024-09-12T22:48:47.997 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:48:47.997 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:47.997 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:47.997 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:47.997 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:47.997 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.997 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:47.997 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:47.997 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:47.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.997 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.998 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:47.998 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:47.998 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:47.998 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.998 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.998 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:47.998 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:48:47.998 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:48:47.998 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.999 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.999 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:47.999 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:48:47.999 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:48:47.999 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.999 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.999 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:47.999 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:48:47.999 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:48:47.999 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:47.999 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:47.999 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:47.999 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:48:47.999 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:48:48.000 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.000 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.000 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:48.000 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:48:48.000 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:48:48.000 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.000 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.000 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:48.000 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:48:48.000 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:48:48.000 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.000 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.000 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:48.001 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:48:48.001 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:48:48.001 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.001 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.001 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:48.001 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:48:48.001 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:48:48.001 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.001 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:48.001 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.001 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.001 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.001 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:48:48.001 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:48.002 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.822723959000001, 2024-09-12T22:48:48.002 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:48:48.002 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:48.002 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:48.002 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:48:48.002 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:48.002 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.002 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:48.002 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:48.002 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:48.002 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.002 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.002 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:48.003 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:48.003 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:48.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.003 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:48.003 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:48.003 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:48:48.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.003 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:48.003 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:48:48.003 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:48:48.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.004 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:48.004 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:48:48.004 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:48:48.004 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.004 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.004 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:48.004 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:48:48.004 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:48:48.005 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.005 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.005 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:48.005 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:48:48.005 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:48:48.005 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.005 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.005 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:48.005 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:48:48.005 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:48:48.005 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.005 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:48.005 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.005 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.006 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:48.006 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:48.006 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.820115778999998, 2024-09-12T22:48:48.006 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:48:48.006 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:48.006 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:48.006 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:48.006 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:48.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.006 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:48.006 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:48.006 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:48.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.007 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:48.007 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:48.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:48.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.007 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:48.007 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:48:48.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:48:48.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.007 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:48.008 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:48:48.008 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:48:48.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.008 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:48.008 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:48:48.008 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:48:48.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.008 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:48.008 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:48:48.008 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:48:48.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.009 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:48.009 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:48:48.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:48:48.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.009 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.009 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:48.009 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:48:48.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:48:48.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.009 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.009 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:48.009 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:48:48.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:48:48.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.010 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:48.010 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:48:48.010 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:48:48.010 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.010 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:48.010 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.010 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:48.010 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:48.010 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.819222556, 2024-09-12T22:48:48.010 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:48:48.011 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:48.011 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:48.011 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:48.011 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:48.011 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.011 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:48.011 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:48.011 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:48.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.011 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.011 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:48.011 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:48.011 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:48.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.012 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:48.012 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:48:48.012 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:48:48.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.012 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:48.012 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:48:48.012 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:48:48.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.012 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:48.012 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:48:48.013 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:48:48.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.013 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:48.013 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:48:48.013 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:48:48.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.013 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:48.013 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:48:48.013 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:48:48.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.013 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:48.014 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:48:48.014 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:48:48.014 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.014 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.014 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:48.014 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:48:48.014 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:48:48.014 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.014 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.014 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:48.014 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:48:48.014 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:48:48.014 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.015 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:48.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:48:48.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:48:48.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.015 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:48.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:48:48.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:48:48.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.015 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:48.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:48:48.016 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:48:48.016 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.016 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:48.016 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.016 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.016 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:48.016 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:48.016 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.819150897999997, 2024-09-12T22:48:48.016 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:48:48.016 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:48.016 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:48.016 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:48.017 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:48.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.017 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:48.017 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:48.017 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:48.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.017 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:48.017 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:48.017 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:48.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.017 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:48.017 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:48:48.018 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:48:48.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.018 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:48.018 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:48:48.018 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:48:48.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.018 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:48.018 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:48:48.018 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:48:48.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.019 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:48.019 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:48:48.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:48:48.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.019 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:48.019 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:48:48.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:48:48.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.019 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:48.019 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:48:48.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:48:48.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.020 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.020 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:48.020 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:48:48.020 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:48:48.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.020 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.020 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:48.020 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:48:48.020 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:48:48.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.020 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.020 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:48.020 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:48:48.020 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:48:48.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:48.021 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:48:48.021 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:48:48.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:48.021 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:48:48.021 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:48:48.021 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.021 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:48.021 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.022 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:48.022 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:48.022 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.819108180000001, 2024-09-12T22:48:48.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:48:48.022 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:48.022 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:48.022 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:48.022 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:48.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.022 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:48.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:48.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:48.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.023 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:48.023 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:48.023 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:48.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.023 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:48.023 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:48:48.023 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:48:48.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.023 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:48.024 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:48:48.024 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:48:48.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.024 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:48.024 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:48:48.024 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:48:48.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.024 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:48.024 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:48:48.024 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:48:48.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.025 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:48.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:48:48.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:48:48.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.025 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:48.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:48:48.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:48:48.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.025 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:48.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:48:48.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:48:48.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:48.026 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:48:48.026 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:48:48.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:48.026 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:48:48.026 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:48:48.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:48.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:48:48.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:48:48.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.027 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:48.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:48:48.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:48:48.027 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.027 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:48.027 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.027 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:48.027 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:48.028 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.819070263, 2024-09-12T22:48:48.028 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:48:48.028 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:48.028 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:48.028 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:48.028 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:48.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.028 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:48.028 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:48.028 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:48.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.028 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:48.029 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:48.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:48.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.029 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:48.029 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:48:48.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:48:48.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.029 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:48.029 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:48:48.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:48:48.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.030 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:48.030 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:48:48.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:48:48.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.030 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:48.030 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:48:48.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:48:48.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.030 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:48.030 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:48:48.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:48:48.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:48.031 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:48:48.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:48:48.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:48.031 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:48.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:48:48.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:48.031 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:48:48.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:48:48.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.032 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:48.032 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:48:48.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:48:48.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.032 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:48.032 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:48:48.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:48:48.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.033 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:48.033 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:48:48.033 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:48:48.033 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.033 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:48.033 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.033 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:48.033 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:48.033 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.819046812000003, 2024-09-12T22:48:48.033 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:48:48.033 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:48.034 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:48.034 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:48.034 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:48.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.034 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:48.034 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:48.034 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:48.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.034 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:48.034 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:48.034 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:48.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.035 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:48.035 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:48:48.035 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:48:48.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.035 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:48.035 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:48:48.035 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:48:48.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.035 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:48.035 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:48:48.036 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:48:48.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.036 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:48.036 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:48:48.036 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:48:48.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.036 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:48.036 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:48:48.036 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:48:48.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.037 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:48.037 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:48:48.037 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:48:48.037 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.037 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:48.037 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:48.037 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:48:48.037 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.037 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:48.037 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:48:48.038 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:48:48.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.038 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:48.038 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:48:48.038 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:48:48.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.038 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:48.038 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:48:48.038 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:48:48.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.038 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:48.039 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:48:48.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:48:48.039 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.039 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:48.039 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.039 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.039 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:48.039 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:48.039 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.819022574999998, 2024-09-12T22:48:48.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:48:48.039 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:48.039 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:48.040 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:48.040 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:48.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.040 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:48.040 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:48.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:48.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.040 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:48.040 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:48.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:48.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.041 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:48.041 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:48.041 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:48:48.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.041 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:48.041 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:48:48.041 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:48:48.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.041 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:48.041 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:48:48.041 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:48:48.042 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.042 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:48.042 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:48:48.042 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:48:48.042 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.042 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:48.042 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:48:48.042 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:48:48.042 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.042 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:48.042 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:48:48.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:48:48.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.043 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:48.043 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:48:48.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:48:48.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.043 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:48.043 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:48:48.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:48:48.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:48.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:48:48.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:48:48.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:48.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:48:48.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:48:48.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:48.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:48:48.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:48:48.044 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.045 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:48.045 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.045 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:48.045 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:48.045 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.818994658000001, 2024-09-12T22:48:48.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:48:48.045 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:48.045 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:48.045 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:48.045 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:48.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:48.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:48.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:48.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:48.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:48.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:48.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:48.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:48.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:48:48.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:48.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:48:48.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:48:48.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:48.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:48:48.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:48:48.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:48.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:48:48.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:48:48.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:48.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:48:48.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:48:48.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:48.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:48:48.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:48:48.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:48.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:48:48.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:48:48.049 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.049 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:48.049 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.049 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:48.049 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:48.049 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.818920163000001, 2024-09-12T22:48:48.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:48:48.049 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:48.049 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:48.049 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:48.050 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:48.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:48.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:48.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:48.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:48.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:48.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:48.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:48.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:48:48.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:48:48.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:48.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:48:48.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:48:48.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:48.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:48:48.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:48:48.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:48.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:48:48.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:48:48.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:48.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:48:48.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:48:48.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:48.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:48:48.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:48:48.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:48.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:48:48.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:48:48.053 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.053 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:48.053 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.053 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:48.053 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:48.054 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.818874135000002, 2024-09-12T22:48:48.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:48:48.054 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:48.054 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:48.054 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:48.054 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:48.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:48.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:48.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:48.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:48.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:48.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:48.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:48.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:48:48.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:48:48.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:48.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:48:48.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:48:48.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:48.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:48:48.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:48:48.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:48.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:48:48.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:48:48.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:48.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:48:48.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:48:48.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:48.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:48:48.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:48:48.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:48.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:48:48.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:48:48.057 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.057 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:48.057 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.058 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:48.058 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:48.058 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.816703251, 2024-09-12T22:48:48.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:48:48.058 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:48.058 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:48.058 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:48.058 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:48.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:48.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:48.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:48.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:48.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:48.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:48.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:48.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:48.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:48:48.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:48.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:48:48.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:48:48.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:48.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:48:48.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:48:48.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:48.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:48.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:48:48.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:48.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:48:48.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:48:48.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:48.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:48.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:48:48.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:48.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:48:48.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:48:48.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:48.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:48:48.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:48:48.062 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.062 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:48.062 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.062 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:48.062 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:48.062 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.816652801000004, 2024-09-12T22:48:48.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:48:48.062 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:48.063 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:48.063 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:48.063 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:48.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:48.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:48.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:48.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:48.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:48.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:48.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:48.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:48:48.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:48:48.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:48.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:48:48.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:48:48.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:48.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:48:48.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:48:48.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:48.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:48:48.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:48:48.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:48.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:48:48.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:48:48.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:48.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:48:48.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:48:48.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:48.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:48:48.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:48:48.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:48.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:48:48.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:48:48.066 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.066 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:48.067 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.067 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:48.067 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:48.067 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.816599363000002, 2024-09-12T22:48:48.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:48:48.067 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:48.067 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:48.067 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:48.067 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:48.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:48.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:48.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:48.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:48.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:48.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:48.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:48.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:48.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:48:48.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:48.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:48:48.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:48:48.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:48.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:48.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:48:48.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:48.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:48:48.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:48:48.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:48.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:48:48.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:48:48.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:48.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:48:48.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:48:48.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:48.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:48:48.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:48:48.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:48.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:48:48.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:48:48.071 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.071 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:48.071 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.071 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:48:48.071 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:48.072 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.812615010000002, 2024-09-12T22:48:48.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:48:48.072 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:48.072 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:48.072 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:48.072 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:48.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:48.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:48.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:48.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:48.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:48.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:48.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:48.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:48:48.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:48:48.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:48.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:48:48.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:48:48.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:48.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:48:48.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:48:48.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:48.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:48:48.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:48:48.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:48.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:48:48.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:48:48.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:48.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:48:48.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:48:48.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:48.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:48:48.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:48:48.075 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.075 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:48.075 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.076 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:48:48.076 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:48.076 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.827462470999997, 2024-09-12T22:48:48.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:48:48.076 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:48.076 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:48.076 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:48.076 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:48.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:48.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:48.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:48.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:48.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:48.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:48.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:48.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:48:48.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:48:48.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:48.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:48:48.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:48:48.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:48.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:48:48.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:48:48.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:48.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:48:48.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:48:48.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:48.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:48:48.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:48:48.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:48.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:48:48.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:48:48.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:48.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:48:48.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:48:48.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:48.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:48:48.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:48:48.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:48.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:48:48.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:48:48.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:48.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:48:48.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:48:48.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:48.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:48:48.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:48:48.081 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.081 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:48.081 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.081 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:48:48.081 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:48.081 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.825546226, 2024-09-12T22:48:48.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:48:48.082 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:48.082 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:48.082 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:48.082 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:48.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:48.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:48.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:48.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:48.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:48.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:48.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:48.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:48:48.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:48:48.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:48.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:48:48.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:48:48.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:48.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:48:48.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:48:48.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:48.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:48:48.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:48:48.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:48.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:48:48.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:48:48.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:48.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:48:48.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:48:48.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:48.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:48:48.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:48:48.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:48.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:48:48.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:48:48.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:48.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:48:48.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:48:48.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:48.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:48:48.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:48:48.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:48.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:48:48.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:48:48.087 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.087 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:48.087 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.087 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:48:48.087 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:48.087 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 17.824792851000002, 2024-09-12T22:48:48.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012160610000000001, 2024-09-12T22:48:48.087 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:48.087 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:48.087 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:48.087 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:48.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:48.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:48.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:48.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:48.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:48.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:48.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:48.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164967+0000", 2024-09-12T22:48:48.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:48:48.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:48.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164974+0000", 2024-09-12T22:48:48.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:48:48.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:48.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164987+0000", 2024-09-12T22:48:48.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3689000000000001e-05 2024-09-12T22:48:48.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:48.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164995+0000", 2024-09-12T22:48:48.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2959999999999999e-06 2024-09-12T22:48:48.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:48.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165068+0000", 2024-09-12T22:48:48.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2449999999999999e-05 2024-09-12T22:48:48.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:48.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165212+0000", 2024-09-12T22:48:48.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144117 2024-09-12T22:48:48.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:48.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166066+0000", 2024-09-12T22:48:48.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085441100000000002 2024-09-12T22:48:48.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:48.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166107+0000", 2024-09-12T22:48:48.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0450000000000001e-05 2024-09-12T22:48:48.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:48.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:48.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:48.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166181+0000", 2024-09-12T22:48:48.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-12T22:48:48.092 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.092 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:48.092 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.092 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:48.092 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:48.092 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:48.093 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:48:48.094 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:48.092+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:48.094 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:48:48.094 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:48:48.095 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:48.096 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:48:48.096 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:48:48.096 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:48:48.096 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:48:48.195 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:48.194+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:48.200 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:48.200 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:48.209 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:48.295 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:48.293+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:48.312 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:48.312 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:48.320 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:48.397 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:48.396+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:48.462 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:48.462 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:48.470 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:48.514 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:48.513+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:48.543 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:48:48.573 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:48.573 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:48.583 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:48.599 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:48.598+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:48.700 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:48.699+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:48.726 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:48.726 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:48.736 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:48.801 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:48.800+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:48.837 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:48.837 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:48.846 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:48.901 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:48.900+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:48.950 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:48.950 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:48.959 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:49.003 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:49.001+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:49.103 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:49.101+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:49.103 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:49.103 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:49.112 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:49.204 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:49.203+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:49.255 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:49.255 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:49.264 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:49.305 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:49.304+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:49.331 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~18s 2024-09-12T22:48:49.369 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:49.369 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:49.378 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:49.422 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:49.421+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:49.451 INFO:teuthology.orchestra.run.smithi066.stderr:nodeep-scrub is set 2024-09-12T22:48:49.483 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:49.483 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:49.491 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:49.533 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:49.532+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:49.553 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-12T22:48:49.607 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:49.606+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:49.636 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:49.636 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:49.645 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:49.665 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is on 2024-09-12T22:48:49.665 INFO:teuthology.orchestra.console.smithi117:Power on completed 2024-09-12T22:48:49.708 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:49.707+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:49.749 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:49.749 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:49.758 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:49.766 DEBUG:teuthology.orchestra.console.smithi117:Waiting for login prompt 2024-09-12T22:48:49.766 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi117 2024-09-12T22:48:49.810 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:49.809+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:49.860 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:49.860 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:49.869 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:49.913 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:49.912+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:49.971 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:49.971 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:49.981 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:50.025 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:50.024+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:50.087 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:50.087 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:50.096 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:50.097 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:48:50.112 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:50.111+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:50.213 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:50.212+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:50.234 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:48:50.234 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:48:50.238 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:50.238 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:50.247 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:50.251 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:48:50.251 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:48:50.251 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:48:50.254 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:48:50.254 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:48:50.314 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:50.313+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:50.351 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:50.351 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:48:50.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:48:50.351 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:48:50.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.351 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:48:50.351 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:50.352 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.303033569999997, 2024-09-12T22:48:50.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:48:50.352 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:50.352 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:50.352 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:50.352 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:50.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:50.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:50.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:50.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:50.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:50.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:50.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:48:50.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:50.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:48:50.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:48:50.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:50.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:48:50.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:48:50.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:48:50.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:48:50.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:50.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:48:50.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:48:50.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:50.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:48:50.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:48:50.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:50.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:48:50.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:48:50.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:50.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:48:50.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:48:50.356 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.356 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:50.357 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.357 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:48:50.357 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:50.357 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 48.302652842999997, 2024-09-12T22:48:50.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:48:50.357 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:50.357 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:50.357 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:50.357 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:50.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:50.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:50.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:50.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:50.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:50.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:48:50.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:48:50.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:50.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:48:50.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:48:50.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:50.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:48:50.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:48:50.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:48:50.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:48:50.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:50.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:48:50.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:48:50.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:50.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:48:50.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:48:50.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:50.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:48:50.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:48:50.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:50.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:48:50.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:48:50.361 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.361 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:50.361 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.362 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:48:50.362 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:50.362 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 45.182056033000002, 2024-09-12T22:48:50.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:48:50.362 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:50.362 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:50.362 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:48:50.362 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:50.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:50.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:50.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:50.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:50.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:50.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:50.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:48:50.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:50.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:48:50.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:48:50.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:50.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:48:50.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:48:50.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:48:50.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:48:50.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:50.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:48:50.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:48:50.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:50.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:48:50.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:48:50.365 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.365 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:50.366 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.366 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:50.366 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:50.366 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 45.179447852999999, 2024-09-12T22:48:50.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:48:50.366 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:50.366 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:50.366 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:50.366 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:50.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:50.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:50.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:50.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:50.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:50.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:48:50.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:48:50.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:50.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:48:50.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:48:50.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:50.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:48:50.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:48:50.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:48:50.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:48:50.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:50.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:48:50.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:48:50.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:50.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:48:50.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:48:50.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:50.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:48:50.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:48:50.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:50.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:48:50.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:48:50.370 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.370 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:50.370 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.370 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:50.371 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:50.371 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 45.178554630000001, 2024-09-12T22:48:50.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:48:50.371 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:50.371 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:50.371 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:50.371 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:50.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:50.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:50.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:50.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:50.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:50.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:48:50.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:48:50.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:50.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:48:50.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:48:50.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:50.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:48:50.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:48:50.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:48:50.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:48:50.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:50.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:48:50.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:48:50.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:50.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:48:50.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:48:50.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:50.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:48:50.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:48:50.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:50.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:48:50.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:48:50.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:50.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:48:50.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:48:50.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:50.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:48:50.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:48:50.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:50.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:48:50.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:48:50.377 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.377 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:50.377 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.377 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:50.377 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:50.377 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 45.178482971999998, 2024-09-12T22:48:50.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:48:50.377 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:50.377 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:50.378 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:50.378 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:50.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:50.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:50.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:50.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:50.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:50.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:48:50.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:48:50.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:50.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:48:50.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:48:50.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:50.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:48:50.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:48:50.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:48:50.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:48:50.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:50.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:48:50.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:48:50.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:50.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:48:50.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:48:50.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:50.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:48:50.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:48:50.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:50.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:48:50.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:48:50.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:50.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:48:50.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:48:50.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:50.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:48:50.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:48:50.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:50.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:48:50.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:48:50.383 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.383 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:50.383 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.383 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:50.383 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:50.384 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 45.178440254000002, 2024-09-12T22:48:50.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:48:50.384 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:50.384 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:50.384 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:50.384 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:50.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:50.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:50.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:50.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:50.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:50.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:48:50.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:48:50.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:50.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:48:50.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:48:50.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:50.386 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:48:50.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:48:50.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.386 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:48:50.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:48:50.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:50.386 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:48:50.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:48:50.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:50.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:48:50.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:48:50.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:50.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:48:50.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:48:50.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:50.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:48:50.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:48:50.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:50.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:48:50.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:48:50.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:50.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:48:50.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:48:50.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:50.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:48:50.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:48:50.389 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.389 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:50.389 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.389 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:50.389 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:50.389 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 45.178402337000001, 2024-09-12T22:48:50.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:48:50.390 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:50.390 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:50.390 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:50.390 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:50.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:50.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:50.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:50.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:50.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:50.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:48:50.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:48:50.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:50.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:48:50.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:48:50.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:50.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:48:50.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:48:50.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:48:50.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:48:50.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:50.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:48:50.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:48:50.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:50.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:48:50.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:48:50.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:50.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:50.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:48:50.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:50.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:48:50.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:48:50.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:50.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:48:50.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:48:50.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:50.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:48:50.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:48:50.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:50.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:48:50.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:48:50.395 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.395 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:50.395 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.395 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:50.395 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:50.395 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 45.178378885999997, 2024-09-12T22:48:50.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:48:50.395 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:50.395 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:50.395 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:50.395 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:50.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:50.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:50.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:50.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:50.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:50.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:48:50.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:48:50.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:50.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:48:50.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:48:50.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:50.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:48:50.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:48:50.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:48:50.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:48:50.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:50.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:48:50.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:48:50.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:50.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:48:50.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:48:50.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:50.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:50.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:48:50.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:50.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:48:50.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:48:50.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:50.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:48:50.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:48:50.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:50.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:48:50.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:48:50.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:50.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:48:50.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:48:50.400 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.401 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:50.401 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.401 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:50.401 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:50.401 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 45.178354648999999, 2024-09-12T22:48:50.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:48:50.401 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:50.401 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:50.401 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:50.401 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:50.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:50.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:50.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:50.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:50.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:50.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:50.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:48:50.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:50.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:48:50.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:48:50.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:50.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:48:50.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:48:50.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:48:50.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:48:50.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:50.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:48:50.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:48:50.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:50.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:48:50.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:48:50.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:50.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:48:50.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:48:50.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:50.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:48:50.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:48:50.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:50.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:48:50.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:48:50.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:50.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:48:50.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:48:50.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:50.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:48:50.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:48:50.406 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.406 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:50.406 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.407 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:50.407 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:50.407 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 45.178326732000002, 2024-09-12T22:48:50.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:48:50.407 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:50.407 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:50.407 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:50.408 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:50.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:50.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:50.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:50.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:50.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:50.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:50.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:48:50.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:50.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:48:50.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:48:50.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:50.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:48:50.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:48:50.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:48:50.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:48:50.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:50.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:48:50.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:48:50.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:50.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:48:50.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:48:50.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:50.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:48:50.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:48:50.411 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.411 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:50.411 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.411 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:50.411 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:50.412 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 45.178252237000002, 2024-09-12T22:48:50.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:48:50.412 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:50.412 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:50.412 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:50.412 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:50.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:50.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:50.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:50.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:50.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:50.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:48:50.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:48:50.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:50.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:48:50.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:48:50.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:50.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:48:50.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:48:50.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:48:50.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:48:50.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:50.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:48:50.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:48:50.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:50.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:48:50.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:48:50.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:50.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:48:50.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:48:50.415 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.415 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:50.415 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.416 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:50.416 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:50.416 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 45.178206209000003, 2024-09-12T22:48:50.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:48:50.416 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:50.416 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:50.416 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:50.416 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:50.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:50.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:50.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:50.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:50.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:50.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:48:50.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:48:50.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:50.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:48:50.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:48:50.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:50.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:48:50.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:48:50.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:48:50.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:48:50.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:50.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:48:50.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:48:50.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:50.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:48:50.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:48:50.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:50.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:48:50.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:48:50.419 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.419 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:50.419 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.420 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:50.420 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:50.420 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 45.176035325000001, 2024-09-12T22:48:50.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:48:50.420 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:50.420 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:50.420 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:50.420 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:50.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:50.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:50.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:50.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:50.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:50.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:50.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:48:50.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:50.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:48:50.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:48:50.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:50.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:48:50.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:48:50.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:50.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:48:50.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:50.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:48:50.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:48:50.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:50.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:50.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:48:50.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:50.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:48:50.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:48:50.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:50.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:48:50.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:48:50.424 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.424 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:50.424 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.424 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:50.424 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:50.424 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 45.175984874999997, 2024-09-12T22:48:50.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:48:50.425 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:50.425 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:50.425 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:50.425 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:50.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:50.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:50.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:50.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:50.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:50.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:48:50.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:48:50.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:50.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:48:50.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:48:50.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:50.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:48:50.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:48:50.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:48:50.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:48:50.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:50.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:48:50.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:48:50.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:50.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:48:50.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:48:50.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:50.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:48:50.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:48:50.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:50.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:48:50.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:48:50.428 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.428 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:50.429 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.429 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:50.429 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:50.429 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 45.175931437000003, 2024-09-12T22:48:50.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:48:50.429 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:50.429 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:50.429 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:50.429 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:50.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:50.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:50.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:50.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:50.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:50.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:50.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:48:50.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:50.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:48:50.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:48:50.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:50.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:50.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:48:50.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:48:50.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:48:50.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:50.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:48:50.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:48:50.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:50.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:48:50.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:48:50.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:50.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:48:50.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:48:50.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:50.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:48:50.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:48:50.433 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.433 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:50.433 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.434 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:48:50.434 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:50.434 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 45.171947084000003, 2024-09-12T22:48:50.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:48:50.434 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:50.434 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:50.434 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:50.434 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:50.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:50.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:50.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:50.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:50.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:50.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:48:50.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:48:50.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:50.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:48:50.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:48:50.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:50.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:48:50.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:48:50.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:48:50.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:48:50.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:50.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:48:50.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:48:50.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:50.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:48:50.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:48:50.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:50.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:48:50.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:48:50.437 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.438 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:50.438 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.438 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:48:50.438 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:50.438 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.186794544999998, 2024-09-12T22:48:50.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:48:50.438 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:50.438 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:50.438 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:50.438 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:50.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:50.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:50.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:50.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:50.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:50.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:48:50.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:48:50.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:50.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:48:50.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:48:50.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:50.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:48:50.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:48:50.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:48:50.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:48:50.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:50.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:48:50.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:48:50.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:50.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:48:50.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:48:50.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:50.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:48:50.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:48:50.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:50.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:48:50.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:48:50.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:50.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:48:50.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:48:50.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:50.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:48:50.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:48:50.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:50.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:48:50.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:48:50.443 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.443 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:50.443 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.444 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:48:50.444 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:50.444 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.184878300000001, 2024-09-12T22:48:50.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:48:50.444 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:50.444 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:50.444 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:50.444 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:50.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:50.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:50.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:50.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:50.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:50.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:48:50.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:48:50.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:50.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:48:50.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:48:50.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:50.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:48:50.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:48:50.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:48:50.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:48:50.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:50.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:48:50.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:48:50.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:50.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:48:50.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:48:50.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:50.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:48:50.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:48:50.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:50.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:48:50.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:48:50.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:50.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:48:50.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:48:50.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:50.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:48:50.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:48:50.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:50.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:48:50.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:48:50.449 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.449 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:50.449 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.449 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:48:50.449 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:50.450 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 20.184124924999999, 2024-09-12T22:48:50.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012160610000000001, 2024-09-12T22:48:50.450 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:50.450 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:50.450 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:50.450 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:50.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:50.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:50.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:50.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:50.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:50.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:50.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164967+0000", 2024-09-12T22:48:50.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:48:50.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:50.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164974+0000", 2024-09-12T22:48:50.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:48:50.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:50.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164987+0000", 2024-09-12T22:48:50.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3689000000000001e-05 2024-09-12T22:48:50.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164995+0000", 2024-09-12T22:48:50.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2959999999999999e-06 2024-09-12T22:48:50.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:50.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165068+0000", 2024-09-12T22:48:50.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2449999999999999e-05 2024-09-12T22:48:50.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:50.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165212+0000", 2024-09-12T22:48:50.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144117 2024-09-12T22:48:50.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:50.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166066+0000", 2024-09-12T22:48:50.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085441100000000002 2024-09-12T22:48:50.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:50.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166107+0000", 2024-09-12T22:48:50.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0450000000000001e-05 2024-09-12T22:48:50.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:50.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:50.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:50.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166181+0000", 2024-09-12T22:48:50.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-12T22:48:50.454 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.454 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:50.454 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.454 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:50.454 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:50.454 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:50.456 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:50.455+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:50.456 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:50.557 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:50.556+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:50.561 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:50.561 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:48:50.561 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:48:50.561 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:50.568 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:50.658 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:50.657+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:50.670 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:50.671 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:48:50.671 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:48:50.671 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:48:50.671 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:50.679 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:50.759 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:50.758+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:50.784 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:50.784 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:48:50.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:48:50.784 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:48:50.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.785 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:48:50.785 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:50.785 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.397570463999998, 2024-09-12T22:48:50.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:48:50.786 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:50.786 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:50.786 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:50.786 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:50.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:50.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:50.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:50.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:50.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:50.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:50.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:48:50.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:50.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:48:50.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:48:50.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:50.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:48:50.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:48:50.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:48:50.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:48:50.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:50.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:48:50.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:48:50.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:50.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:48:50.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:48:50.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:50.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:48:50.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:48:50.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:50.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:48:50.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:48:50.792 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.792 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:50.792 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.792 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:48:50.792 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:50.792 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.397127881000003, 2024-09-12T22:48:50.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:48:50.792 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:50.792 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:50.792 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:50.793 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:50.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:50.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:50.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:50.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:50.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:50.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:48:50.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:48:50.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:50.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:48:50.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:48:50.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:50.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:48:50.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:48:50.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:48:50.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:48:50.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:50.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:48:50.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:48:50.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:50.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:48:50.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:48:50.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:50.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:48:50.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:48:50.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:50.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:48:50.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:48:50.796 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.796 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:50.797 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.797 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:48:50.797 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:50.797 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.396761724000001, 2024-09-12T22:48:50.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:48:50.797 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:50.797 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:50.797 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:50.797 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:50.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:50.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:50.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:50.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:50.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:50.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:48:50.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:48:50.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:50.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:48:50.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:48:50.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:50.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:48:50.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:48:50.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:48:50.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:48:50.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:50.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:48:50.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:48:50.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:50.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:48:50.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:48:50.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:50.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:48:50.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:48:50.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:50.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:48:50.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:48:50.801 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.801 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:50.801 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.801 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:48:50.802 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:50.802 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.396349411999999, 2024-09-12T22:48:50.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:48:50.802 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:50.802 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:50.802 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:50.802 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:50.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:50.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:50.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:50.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:50.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:50.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:50.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:48:50.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:50.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:48:50.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:48:50.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:50.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:48:50.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:48:50.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:48:50.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:48:50.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:50.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:48:50.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:48:50.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:50.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:48:50.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:48:50.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:50.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:48:50.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:48:50.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:50.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:48:50.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:48:50.806 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.806 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:50.806 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.806 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:48:50.806 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:50.806 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.262499318000003, 2024-09-12T22:48:50.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:48:50.807 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:50.807 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:50.807 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:50.807 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:50.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:50.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:50.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:50.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:50.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:50.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:50.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:48:50.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:50.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:48:50.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:48:50.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:50.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:48:50.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:48:50.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:48:50.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:48:50.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:50.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:48:50.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:48:50.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:50.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:48:50.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:48:50.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:50.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:48:50.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:48:50.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:50.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:48:50.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:48:50.811 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.811 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:50.811 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.811 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:50.812 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:50.812 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 45.617263764, 2024-09-12T22:48:50.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:48:50.812 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:50.812 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:50.812 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:50.812 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:50.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:50.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:50.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:50.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:50.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:50.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:48:50.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:48:50.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:50.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:48:50.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:48:50.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:50.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:48:50.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:48:50.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:48:50.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:48:50.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:50.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:48:50.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:48:50.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:50.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:48:50.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:48:50.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:50.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:48:50.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:48:50.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:50.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:48:50.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:48:50.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:50.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:48:50.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:48:50.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:50.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:48:50.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:48:50.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:50.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:48:50.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:48:50.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:50.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:48:50.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:48:50.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:50.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:48:50.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:48:50.818 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.818 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:50.818 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.818 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:50.818 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:50.818 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 45.617164246999998, 2024-09-12T22:48:50.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:48:50.818 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:50.819 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:50.819 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:50.819 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:50.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:50.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:50.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:50.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:50.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:50.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:48:50.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:48:50.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:50.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:48:50.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:48:50.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:50.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:48:50.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:48:50.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:48:50.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:48:50.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:50.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:48:50.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:48:50.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:50.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:48:50.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:48:50.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:50.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:48:50.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:48:50.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:50.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:48:50.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:48:50.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:50.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:48:50.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:48:50.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:50.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:48:50.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:48:50.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:50.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:48:50.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:48:50.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:50.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:48:50.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:48:50.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:50.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:48:50.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:48:50.824 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.824 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:50.824 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.825 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:50.825 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:50.825 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 45.617119508000002, 2024-09-12T22:48:50.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:48:50.825 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:50.825 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:50.825 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:50.825 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:50.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:50.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:50.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:50.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:50.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:50.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:48:50.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:48:50.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:50.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:48:50.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:48:50.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:50.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:48:50.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:48:50.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:48:50.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:48:50.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:50.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:48:50.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:48:50.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:50.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:48:50.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:48:50.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:50.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:48:50.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:48:50.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:50.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:48:50.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:48:50.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:50.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:48:50.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:48:50.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:50.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:48:50.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:48:50.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:50.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:48:50.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:48:50.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:50.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:48:50.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:48:50.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:50.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:48:50.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:48:50.831 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.831 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:50.831 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.831 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:50.831 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:50.831 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 45.616891807000002, 2024-09-12T22:48:50.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:48:50.831 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:50.831 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:50.831 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:50.831 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:50.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:50.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:50.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:50.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:50.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:50.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:48:50.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:48:50.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:50.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:48:50.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:48:50.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:50.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:48:50.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:48:50.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:48:50.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:48:50.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:50.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:48:50.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:48:50.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:50.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:48:50.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:48:50.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:50.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:48:50.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:48:50.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:50.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:48:50.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:48:50.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:50.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:48:50.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:48:50.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:50.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:48:50.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:48:50.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:50.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:48:50.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:48:50.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:50.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:48:50.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:48:50.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:50.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:48:50.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:48:50.837 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.837 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:50.837 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.838 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:50.838 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:50.838 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 45.616726698999997, 2024-09-12T22:48:50.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:48:50.838 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:50.838 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:50.838 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:50.838 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:50.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:50.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:50.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:50.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:50.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:50.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:48:50.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:48:50.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:50.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:48:50.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:48:50.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:50.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:48:50.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:48:50.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:48:50.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:48:50.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:50.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:48:50.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:48:50.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:50.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:48:50.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:48:50.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:50.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:48:50.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:48:50.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:50.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:48:50.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:48:50.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:50.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:48:50.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:48:50.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:50.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:48:50.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:48:50.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:50.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:48:50.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:48:50.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:50.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:48:50.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:48:50.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:50.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:48:50.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:48:50.844 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.844 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:50.845 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.845 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:50.845 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:50.845 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 45.616665414000003, 2024-09-12T22:48:50.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:48:50.845 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:50.845 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:50.845 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:50.845 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:50.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:50.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:50.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:50.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:50.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:50.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:50.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:48:50.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:50.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:48:50.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:48:50.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:50.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:48:50.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:48:50.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:48:50.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:48:50.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:50.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:48:50.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:48:50.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:50.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:48:50.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:48:50.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:50.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:48:50.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:48:50.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:50.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:48:50.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:48:50.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:50.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:48:50.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:48:50.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:50.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:48:50.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:48:50.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:50.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:48:50.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:48:50.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:50.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:48:50.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:48:50.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:50.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:48:50.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:48:50.851 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.851 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:50.851 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.851 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:50.852 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:50.852 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 45.616585305999998, 2024-09-12T22:48:50.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:48:50.852 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:50.852 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:50.852 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:50.852 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:50.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:50.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:50.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:50.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:50.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:50.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:48:50.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:48:50.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:50.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:48:50.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:48:50.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:50.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:48:50.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:48:50.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:48:50.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:48:50.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:50.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:48:50.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:48:50.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:50.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:48:50.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:48:50.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:50.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:48:50.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:48:50.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:50.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:48:50.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:48:50.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:50.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:48:50.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:48:50.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:50.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:48:50.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:48:50.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:50.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:48:50.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:48:50.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:50.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:48:50.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:48:50.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:50.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:48:50.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:48:50.858 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.858 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:50.858 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.858 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:50.858 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:50.858 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 45.616536353000001, 2024-09-12T22:48:50.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:48:50.858 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:50.859 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:50.859 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:48:50.859 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:50.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:50.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:50.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:50.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:50.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:50.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:50.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:48:50.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:50.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:48:50.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:48:50.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:50.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:48:50.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:48:50.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:48:50.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:48:50.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:50.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:48:50.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:48:50.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:50.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:48:50.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:48:50.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:50.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:48:50.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:48:50.862 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.862 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:50.862 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.863 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:50.863 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:50.863 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 45.616487253000003, 2024-09-12T22:48:50.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:48:50.863 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:50.863 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:50.863 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:48:50.863 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:50.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:50.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:50.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:50.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:50.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:50.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:48:50.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:48:50.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:50.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:48:50.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:48:50.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:50.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:48:50.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:48:50.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:48:50.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:48:50.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:50.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:48:50.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:48:50.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:50.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:48:50.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:48:50.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:50.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:48:50.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:48:50.867 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.867 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:50.867 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.867 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:50.867 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:50.867 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 45.609546803000001, 2024-09-12T22:48:50.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:48:50.867 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:50.867 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:50.867 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:50.867 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:50.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:50.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:50.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:50.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:50.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:50.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:48:50.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:48:50.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:50.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:48:50.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:48:50.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:50.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:48:50.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:48:50.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:48:50.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:48:50.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:50.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:48:50.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:48:50.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:50.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:48:50.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:48:50.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:50.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:48:50.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:48:50.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:50.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:48:50.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:48:50.871 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.871 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:50.871 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.872 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:50.872 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:50.872 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 45.608457962999999, 2024-09-12T22:48:50.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:48:50.872 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:50.872 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:50.872 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:50.872 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:50.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:50.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:50.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:50.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:50.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:50.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:48:50.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:48:50.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:50.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:48:50.874 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:48:50.874 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.874 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.874 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:50.874 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:48:50.874 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:48:50.874 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.874 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.874 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.874 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:48:50.874 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:48:50.874 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.874 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.874 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:50.875 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:48:50.875 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:48:50.875 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.875 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:50.875 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:48:50.875 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:48:50.875 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.875 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:50.875 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:48:50.875 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:48:50.875 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.876 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:50.876 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:48:50.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:48:50.876 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.876 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:50.876 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.876 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:50.876 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:50.876 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 45.608408351999998, 2024-09-12T22:48:50.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:48:50.877 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:50.877 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:50.877 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:50.877 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:50.877 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:50.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:50.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.877 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:50.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:50.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.878 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:50.878 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:50.878 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:48:50.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.878 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:50.878 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:50.878 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:48:50.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.878 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:50.878 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:48:50.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:48:50.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.879 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.879 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.879 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:48:50.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:48:50.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.879 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.879 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:50.879 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:48:50.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:48:50.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.879 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.879 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:50.880 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:48:50.880 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:48:50.880 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.880 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:50.880 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:48:50.880 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:48:50.880 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.880 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:50.880 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:48:50.880 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:48:50.880 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.881 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:50.881 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.881 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.881 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.881 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:50.881 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:50.881 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 45.608341043000003, 2024-09-12T22:48:50.881 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:48:50.881 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:50.881 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:50.881 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:50.881 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:50.881 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.881 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:50.882 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:50.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.882 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:50.882 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:50.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.882 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:50.882 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:50.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:48:50.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.883 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:50.883 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:48:50.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:48:50.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.883 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:50.883 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:48:50.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:48:50.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.883 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.883 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:48:50.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:48:50.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:50.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:48:50.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:48:50.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:50.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:48:50.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:48:50.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:50.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:48:50.885 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:48:50.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:50.885 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:48:50.885 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:48:50.885 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.885 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:50.885 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.886 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.886 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:50.886 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:50.887 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 45.607773123999998, 2024-09-12T22:48:50.887 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:48:50.887 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:50.887 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:50.887 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:50.887 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:50.887 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.887 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:50.887 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:50.887 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.887 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.887 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.887 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:50.888 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:50.888 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.888 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.888 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.888 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:50.888 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:50.888 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:48:50.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.889 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.889 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:50.889 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:48:50.889 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:48:50.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.889 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.889 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:50.889 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:48:50.889 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:48:50.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.889 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.889 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.889 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:48:50.890 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:48:50.890 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.890 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:50.890 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:48:50.890 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:48:50.890 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.890 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:50.890 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:48:50.890 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:48:50.890 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.891 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:50.891 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:48:50.891 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:48:50.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.891 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.891 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:50.891 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:48:50.891 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:48:50.891 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.891 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:50.891 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.891 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.892 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:48:50.892 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:50.892 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 45.607395519999997, 2024-09-12T22:48:50.892 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:48:50.892 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:50.892 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:50.892 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:50.892 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:50.892 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.892 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:50.892 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:50.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.893 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:50.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:50.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:50.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.893 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:50.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:48:50.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:48:50.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.894 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:50.894 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:48:50.894 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:48:50.894 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.894 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.894 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:50.894 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:48:50.894 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:48:50.894 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.894 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.894 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:50.894 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:48:50.894 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:48:50.895 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.895 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.895 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:50.895 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:48:50.895 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:48:50.895 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.895 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.895 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:50.895 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:48:50.895 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:48:50.895 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.895 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.895 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:50.896 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:48:50.896 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:48:50.896 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:50.896 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:50.896 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:50.896 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:48:50.896 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:48:50.896 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.896 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:50.896 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.896 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:50.896 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:50.896 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:50.898 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:50.899 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:50.897+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:50.999 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:50.998+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:51.005 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:51.005 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:48:51.005 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:48:51.005 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:51.015 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:51.100 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:51.099+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:51.157 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:51.157 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:48:51.157 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:48:51.157 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:48:51.157 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:51.166 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:51.207 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:51.206+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:51.301 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:51.300+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:51.310 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:51.310 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:48:51.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:48:51.310 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:48:51.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.310 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:48:51.310 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:51.310 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.261866949999998, 2024-09-12T22:48:51.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:48:51.310 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:51.310 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:51.311 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:51.311 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:51.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:51.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:51.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:51.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:51.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:51.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:51.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:48:51.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:51.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:48:51.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:48:51.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:51.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:48:51.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:48:51.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:48:51.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:48:51.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:51.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:48:51.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:48:51.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:51.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:48:51.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:48:51.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:51.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:48:51.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:48:51.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:51.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:48:51.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:48:51.314 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.314 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:51.315 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.315 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:48:51.315 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:51.315 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 49.261486222999999, 2024-09-12T22:48:51.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:48:51.315 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:51.315 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:51.315 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:51.315 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:51.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:51.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:51.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:51.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:51.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:51.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:48:51.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:48:51.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:51.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:48:51.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:48:51.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:51.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:48:51.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:48:51.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:48:51.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:48:51.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:51.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:48:51.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:48:51.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:51.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:48:51.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:48:51.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:51.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:48:51.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:48:51.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:51.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:48:51.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:48:51.320 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.320 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:51.320 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.321 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:48:51.321 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:51.321 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.140889412999996, 2024-09-12T22:48:51.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:48:51.321 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:51.321 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:51.321 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:48:51.321 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:51.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:51.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:51.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:51.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:51.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:51.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:51.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:48:51.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:51.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:48:51.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:48:51.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:51.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:48:51.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:48:51.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:48:51.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:48:51.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:51.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:48:51.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:48:51.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:51.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:48:51.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:48:51.324 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.324 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:51.324 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.324 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:51.324 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:51.325 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.138281233000001, 2024-09-12T22:48:51.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:48:51.325 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:51.325 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:51.325 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:51.325 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:51.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:51.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:51.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:51.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:51.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:51.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:48:51.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:48:51.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:51.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:48:51.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:48:51.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:51.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:48:51.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:48:51.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:48:51.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:48:51.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:51.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:48:51.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:48:51.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:51.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:48:51.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:48:51.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:51.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:48:51.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:48:51.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:51.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:48:51.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:48:51.329 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.329 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:51.329 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.329 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:51.329 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:51.329 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.137388010000002, 2024-09-12T22:48:51.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:48:51.329 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:51.329 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:51.329 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:51.329 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:51.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:51.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:51.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:51.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:51.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:51.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:48:51.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:48:51.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:51.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:48:51.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:48:51.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:51.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:48:51.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:48:51.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:48:51.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:48:51.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:51.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:48:51.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:48:51.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:51.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:48:51.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:48:51.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:51.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:48:51.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:48:51.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:51.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:48:51.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:48:51.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:51.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:48:51.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:48:51.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:51.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:48:51.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:48:51.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:51.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:48:51.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:48:51.335 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.335 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:51.335 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.335 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:51.335 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:51.336 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.137316351999999, 2024-09-12T22:48:51.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:48:51.336 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:51.336 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:51.336 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:51.336 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:51.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:51.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:51.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:51.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:51.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:51.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:48:51.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:48:51.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:51.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:48:51.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:48:51.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:51.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:48:51.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:48:51.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:48:51.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:48:51.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:51.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:48:51.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:48:51.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:51.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:48:51.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:48:51.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:51.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:48:51.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:48:51.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:51.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:48:51.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:48:51.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:51.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:48:51.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:48:51.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:51.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:48:51.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:48:51.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:51.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:48:51.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:48:51.341 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.341 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:51.341 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.341 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:51.341 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:51.341 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.137273634000003, 2024-09-12T22:48:51.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:48:51.341 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:51.341 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:51.341 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:51.342 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:51.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:51.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:51.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:51.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:51.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:51.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:48:51.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:48:51.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:51.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:48:51.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:48:51.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:51.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:48:51.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:48:51.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:48:51.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:48:51.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:51.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:48:51.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:48:51.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:51.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:48:51.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:48:51.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:51.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:48:51.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:48:51.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:51.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:48:51.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:48:51.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:51.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:48:51.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:48:51.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:51.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:48:51.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:48:51.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:51.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:48:51.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:48:51.346 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.346 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:51.346 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.347 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:51.347 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:51.347 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.137235717000003, 2024-09-12T22:48:51.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:48:51.347 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:51.347 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:51.347 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:51.347 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:51.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:51.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:51.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:51.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:51.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:51.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:48:51.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:48:51.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:51.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:48:51.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:48:51.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:51.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:48:51.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:48:51.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:48:51.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:48:51.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:51.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:48:51.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:48:51.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:51.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:48:51.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:48:51.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:51.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:51.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:48:51.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:51.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:48:51.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:48:51.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:51.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:48:51.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:48:51.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:51.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:48:51.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:48:51.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:51.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:48:51.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:48:51.352 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.352 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:51.352 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.352 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:51.352 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:51.352 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.137212265999999, 2024-09-12T22:48:51.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:48:51.353 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:51.353 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:51.353 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:51.353 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:51.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:51.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:51.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:51.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:51.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:51.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:48:51.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:48:51.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:51.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:48:51.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:48:51.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:51.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:48:51.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:48:51.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:48:51.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:48:51.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:51.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:48:51.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:48:51.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:51.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:48:51.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:48:51.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:51.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:51.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:48:51.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:51.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:48:51.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:48:51.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:51.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:48:51.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:48:51.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:51.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:48:51.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:48:51.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:51.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:48:51.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:48:51.357 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.358 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:51.358 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.358 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:51.358 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:51.358 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.137188029000001, 2024-09-12T22:48:51.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:48:51.358 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:51.358 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:51.358 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:51.358 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:51.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:51.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:51.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:51.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:51.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:51.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:51.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:48:51.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:51.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:48:51.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:48:51.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:51.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:48:51.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:48:51.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:48:51.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:48:51.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:51.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:48:51.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:48:51.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:51.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:48:51.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:48:51.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:51.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:48:51.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:48:51.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:51.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:48:51.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:48:51.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:51.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:48:51.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:48:51.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:51.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:48:51.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:48:51.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:51.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:48:51.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:48:51.363 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.363 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:51.363 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.363 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:51.363 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:51.364 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.137160111999997, 2024-09-12T22:48:51.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:48:51.364 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:51.364 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:51.364 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:51.364 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:51.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:51.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:51.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:51.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:51.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:51.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:51.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:48:51.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:51.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:48:51.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:48:51.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:51.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:48:51.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:48:51.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:48:51.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:48:51.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:51.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:48:51.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:48:51.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:51.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:48:51.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:48:51.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:51.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:48:51.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:48:51.367 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.367 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:51.367 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.368 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:51.368 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:51.368 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.137085616999997, 2024-09-12T22:48:51.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:48:51.368 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:51.368 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:51.368 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:51.368 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:51.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:51.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:51.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:51.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:51.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:51.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:48:51.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:48:51.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:51.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:48:51.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:48:51.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:51.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:48:51.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:48:51.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:48:51.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:48:51.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:51.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:48:51.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:48:51.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:51.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:48:51.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:48:51.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:51.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:48:51.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:48:51.371 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.372 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:51.372 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.372 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:51.372 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:51.372 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.137039588999997, 2024-09-12T22:48:51.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:48:51.372 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:51.372 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:51.372 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:51.372 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:51.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:51.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:51.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:51.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:51.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:51.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:48:51.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:48:51.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:51.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:48:51.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:48:51.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:51.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:48:51.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:48:51.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:48:51.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:48:51.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:51.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:48:51.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:48:51.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:51.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:48:51.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:48:51.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:51.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:48:51.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:48:51.376 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.376 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:51.376 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.376 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:51.376 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:51.376 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.134868705000002, 2024-09-12T22:48:51.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:48:51.376 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:51.377 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:51.377 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:51.377 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:51.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:51.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:51.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:51.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:51.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:51.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:51.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:48:51.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:51.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:48:51.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:48:51.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:51.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:48:51.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:48:51.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:51.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:48:51.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:51.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:48:51.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:48:51.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:51.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:51.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:48:51.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:51.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:48:51.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:48:51.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:51.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:48:51.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:48:51.380 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.381 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:51.381 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.381 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:51.381 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:51.381 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.134818254999999, 2024-09-12T22:48:51.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:48:51.381 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:51.381 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:51.381 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:51.381 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:51.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:51.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:51.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:51.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:51.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:51.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:48:51.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:48:51.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:51.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:48:51.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:48:51.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:51.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:48:51.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:48:51.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.386 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:48:51.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:48:51.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:51.386 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:48:51.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:48:51.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:51.386 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:48:51.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:48:51.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:51.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:48:51.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:48:51.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:51.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:48:51.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:48:51.387 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.387 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:51.387 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.387 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:51.388 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:51.388 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.134764816999997, 2024-09-12T22:48:51.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:48:51.388 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:51.388 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:51.388 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:51.388 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:51.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:51.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:51.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:51.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:51.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:51.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:51.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:48:51.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:51.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:48:51.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:48:51.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:51.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:51.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:48:51.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:48:51.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:48:51.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:51.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:48:51.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:48:51.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:51.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:48:51.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:48:51.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:51.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:48:51.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:48:51.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:51.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:48:51.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:48:51.392 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.392 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:51.392 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.392 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:48:51.392 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:51.392 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.130780463999997, 2024-09-12T22:48:51.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:48:51.392 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:51.392 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:51.392 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:51.392 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:51.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:51.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:51.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:51.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:51.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:51.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:48:51.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:48:51.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:51.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:48:51.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:48:51.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:51.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:48:51.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:48:51.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:48:51.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:48:51.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:51.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:48:51.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:48:51.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:51.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:48:51.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:48:51.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:51.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:48:51.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:48:51.396 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.396 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:51.396 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.396 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:48:51.396 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:51.396 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 44.145627924999999, 2024-09-12T22:48:51.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:48:51.396 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:51.396 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:51.396 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:51.397 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:51.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:51.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:51.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:51.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:51.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:51.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:48:51.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:48:51.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:51.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:48:51.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:48:51.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:51.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:48:51.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:48:51.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:48:51.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:48:51.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:51.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:48:51.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:48:51.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:51.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:48:51.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:48:51.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:51.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:48:51.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:48:51.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:51.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:48:51.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:48:51.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:51.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:48:51.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:48:51.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:51.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:48:51.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:48:51.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:51.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:48:51.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:48:51.401 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.401 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:51.401 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.402 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:48:51.402 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:51.402 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.143711679999999, 2024-09-12T22:48:51.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:48:51.402 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:51.402 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:51.402 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:51.402 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:51.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:51.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:51.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:51.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:51.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:51.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:48:51.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:48:51.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:51.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:48:51.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:48:51.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:51.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:48:51.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:48:51.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:48:51.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:48:51.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:51.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:48:51.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:48:51.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:51.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:48:51.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:48:51.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:51.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:48:51.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:48:51.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:51.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:48:51.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:48:51.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:51.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:48:51.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:48:51.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:51.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:48:51.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:48:51.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:51.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:48:51.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:48:51.407 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.407 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:51.407 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.407 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:48:51.407 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:51.407 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.142958305000001, 2024-09-12T22:48:51.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012160610000000001, 2024-09-12T22:48:51.407 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:51.408 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:51.408 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:51.408 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:51.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:51.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:51.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:51.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:51.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:51.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:51.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164967+0000", 2024-09-12T22:48:51.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:48:51.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:51.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164974+0000", 2024-09-12T22:48:51.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:48:51.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:51.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164987+0000", 2024-09-12T22:48:51.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3689000000000001e-05 2024-09-12T22:48:51.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164995+0000", 2024-09-12T22:48:51.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2959999999999999e-06 2024-09-12T22:48:51.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:51.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165068+0000", 2024-09-12T22:48:51.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2449999999999999e-05 2024-09-12T22:48:51.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:51.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165212+0000", 2024-09-12T22:48:51.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144117 2024-09-12T22:48:51.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:51.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166066+0000", 2024-09-12T22:48:51.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085441100000000002 2024-09-12T22:48:51.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:51.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166107+0000", 2024-09-12T22:48:51.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0450000000000001e-05 2024-09-12T22:48:51.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:51.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:51.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:51.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166181+0000", 2024-09-12T22:48:51.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-12T22:48:51.412 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.412 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:51.412 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.412 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:51.412 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:51.412 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:51.414 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:51.412+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:51.414 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:51.465 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:48:51.515 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:51.514+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:51.518 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:51.518 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:48:51.518 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:48:51.518 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:51.527 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:51.616 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:51.615+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:51.628 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:51.628 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:48:51.628 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:48:51.629 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:48:51.629 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:51.637 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:51.722 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:51.721+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:51.782 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:51.782 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:48:51.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:48:51.782 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:48:51.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.783 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:48:51.783 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:51.783 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 55.396188643000002, 2024-09-12T22:48:51.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:48:51.783 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:51.783 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:51.783 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:51.783 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:51.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:51.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:51.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:51.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:51.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:51.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:51.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:48:51.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:51.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:48:51.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:48:51.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:51.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:48:51.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:48:51.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:48:51.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:48:51.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:51.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:48:51.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:48:51.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:51.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:48:51.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:48:51.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:51.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:48:51.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:48:51.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:51.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:48:51.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:48:51.788 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.788 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:51.788 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.789 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:48:51.789 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:51.789 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 55.39574606, 2024-09-12T22:48:51.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:48:51.789 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:51.789 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:51.789 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:51.789 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:51.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:51.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:51.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:51.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:51.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:51.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:48:51.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:48:51.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:51.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:48:51.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:48:51.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:51.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:48:51.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:48:51.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:48:51.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:48:51.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:51.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:48:51.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:48:51.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:51.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:48:51.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:48:51.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:51.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:48:51.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:48:51.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:51.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:48:51.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:48:51.796 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.796 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:51.796 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.797 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:48:51.797 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:51.797 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 55.395379902999998, 2024-09-12T22:48:51.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:48:51.797 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:51.797 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:51.797 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:51.797 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:51.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:51.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:51.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:51.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:51.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:51.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:48:51.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:48:51.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:51.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:48:51.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:48:51.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:51.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:48:51.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:48:51.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:48:51.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:48:51.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:51.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:48:51.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:48:51.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:51.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:48:51.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:48:51.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:51.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:48:51.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:48:51.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:51.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:48:51.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:48:51.801 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.801 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:51.801 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.801 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:48:51.801 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:51.802 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 55.394967590999997, 2024-09-12T22:48:51.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:48:51.802 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:51.802 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:51.802 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:51.802 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:51.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:51.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:51.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:51.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:51.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:51.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:51.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:48:51.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:51.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:48:51.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:48:51.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:51.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:48:51.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:48:51.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:48:51.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:48:51.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:51.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:48:51.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:48:51.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:51.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:48:51.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:48:51.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:51.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:48:51.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:48:51.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:51.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:48:51.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:48:51.806 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.806 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:51.806 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.807 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:48:51.807 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:51.807 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 55.261117497000001, 2024-09-12T22:48:51.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:48:51.807 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:51.807 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:51.807 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:51.807 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:51.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:51.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:51.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:51.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:51.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:51.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:51.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:48:51.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:51.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:48:51.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:48:51.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:51.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:48:51.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:48:51.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:48:51.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:48:51.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:51.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:48:51.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:48:51.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:51.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:48:51.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:48:51.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:51.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:48:51.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:48:51.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:51.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:48:51.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:48:51.812 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.813 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:51.813 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.813 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:51.813 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:51.813 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 46.615881942999998, 2024-09-12T22:48:51.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:48:51.813 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:51.813 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:51.814 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:51.814 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:51.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:51.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:51.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:51.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:51.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:51.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:48:51.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:48:51.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:51.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:48:51.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:48:51.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:51.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:48:51.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:48:51.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:48:51.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:48:51.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:51.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:48:51.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:48:51.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:51.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:48:51.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:48:51.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:51.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:48:51.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:48:51.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:51.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:48:51.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:48:51.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:51.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:48:51.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:48:51.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:51.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:48:51.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:48:51.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:51.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:48:51.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:48:51.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:51.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:48:51.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:48:51.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:51.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:48:51.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:48:51.820 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.820 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:51.820 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.820 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:51.820 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:51.820 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 46.615782426000003, 2024-09-12T22:48:51.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:48:51.820 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:51.821 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:51.821 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:51.821 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:51.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:51.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:51.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:51.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:51.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:51.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:48:51.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:48:51.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:51.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:48:51.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:48:51.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:51.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:48:51.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:48:51.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:48:51.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:48:51.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:51.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:48:51.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:48:51.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:51.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:48:51.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:48:51.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:51.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:48:51.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:48:51.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:51.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:48:51.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:48:51.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:51.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:48:51.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:48:51.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:51.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:48:51.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:48:51.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:51.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:48:51.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:48:51.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:51.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:48:51.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:48:51.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:51.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:48:51.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:48:51.827 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.827 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:51.827 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.827 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:51.827 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:51.828 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 46.615737686999999, 2024-09-12T22:48:51.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:48:51.828 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:51.828 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:51.828 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:51.828 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:51.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:51.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:51.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:51.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:51.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:51.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:48:51.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:48:51.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:51.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:48:51.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:48:51.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:51.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:48:51.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:48:51.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:48:51.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:48:51.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:51.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:48:51.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:48:51.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:51.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:48:51.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:48:51.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:51.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:48:51.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:48:51.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:51.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:48:51.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:48:51.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:51.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:48:51.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:48:51.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:51.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:48:51.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:48:51.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:51.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:48:51.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:48:51.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:51.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:48:51.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:48:51.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:51.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:48:51.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:48:51.834 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.834 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:51.834 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.834 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:51.834 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:51.834 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 46.615509985999999, 2024-09-12T22:48:51.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:48:51.834 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:51.834 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:51.835 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:51.835 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:51.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:51.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:51.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:51.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:51.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:51.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:48:51.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:48:51.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:51.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:48:51.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:48:51.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:51.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:48:51.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:48:51.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:48:51.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:48:51.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:51.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:48:51.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:48:51.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:51.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:48:51.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:48:51.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:51.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:48:51.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:48:51.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:51.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:48:51.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:48:51.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:51.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:48:51.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:48:51.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:51.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:48:51.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:48:51.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:51.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:48:51.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:48:51.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:51.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:48:51.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:48:51.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:51.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:48:51.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:48:51.840 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.840 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:51.841 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.841 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:51.841 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:51.841 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 46.615344878000002, 2024-09-12T22:48:51.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:48:51.841 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:51.841 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:51.841 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:51.841 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:51.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:51.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:51.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:51.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:51.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:51.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:48:51.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:48:51.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:51.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:48:51.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:48:51.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:51.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:48:51.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:48:51.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:48:51.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:48:51.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:51.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:48:51.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:48:51.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:51.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:48:51.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:48:51.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:51.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:48:51.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:48:51.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:51.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:48:51.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:48:51.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:51.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:48:51.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:48:51.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:51.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:48:51.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:48:51.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:51.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:48:51.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:48:51.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:51.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:48:51.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:48:51.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:51.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:48:51.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:48:51.847 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.847 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:51.848 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.848 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:51.848 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:51.848 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 46.615283593000001, 2024-09-12T22:48:51.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:48:51.848 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:51.848 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:51.848 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:51.848 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:51.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:51.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:51.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:51.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:51.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:51.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:51.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:48:51.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:51.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:48:51.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:48:51.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:51.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:48:51.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:48:51.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:48:51.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:48:51.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:51.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:48:51.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:48:51.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:51.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:48:51.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:48:51.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:51.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:48:51.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:48:51.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:51.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:48:51.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:48:51.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:51.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:48:51.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:48:51.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:51.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:48:51.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:48:51.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:51.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:48:51.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:48:51.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:51.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:48:51.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:48:51.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:51.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:48:51.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:48:51.855 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.855 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:51.855 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.856 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:51.856 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:51.856 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 46.615203485000002, 2024-09-12T22:48:51.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:48:51.856 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:51.856 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:51.856 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:51.856 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:51.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:51.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:51.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:51.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:51.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:51.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:48:51.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:48:51.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:51.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:48:51.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:48:51.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:51.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:48:51.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:48:51.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:48:51.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:48:51.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:51.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:48:51.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:48:51.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:51.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:48:51.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:48:51.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:51.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:48:51.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:48:51.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:51.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:48:51.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:48:51.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:51.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:48:51.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:48:51.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:51.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:48:51.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:48:51.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:51.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:48:51.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:48:51.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:51.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:48:51.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:48:51.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:51.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:48:51.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:48:51.862 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.862 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:51.862 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.862 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:51.862 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:51.863 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 46.615154531999998, 2024-09-12T22:48:51.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:48:51.863 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:51.863 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:51.863 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:48:51.863 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:51.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:51.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:51.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:51.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:51.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:51.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:51.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:48:51.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:51.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:48:51.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:48:51.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:51.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:48:51.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:48:51.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:48:51.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:48:51.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:51.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:48:51.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:48:51.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:51.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:48:51.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:48:51.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:51.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:48:51.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:48:51.867 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.867 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:51.867 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.867 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:51.867 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:51.867 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 46.615105432, 2024-09-12T22:48:51.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:48:51.868 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:51.868 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:51.868 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:48:51.868 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:51.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:51.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:51.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:51.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:51.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:51.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:48:51.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:48:51.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:51.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:48:51.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:48:51.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:51.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:48:51.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:48:51.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:48:51.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:48:51.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:51.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:48:51.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:48:51.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:51.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:48:51.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:48:51.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:51.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:48:51.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:48:51.871 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.871 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:51.872 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.872 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:51.872 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:51.872 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 46.608164981999998, 2024-09-12T22:48:51.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:48:51.872 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:51.872 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:51.872 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:51.872 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:51.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:51.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:51.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:51.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:51.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.874 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.874 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:51.874 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:48:51.874 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:48:51.874 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.874 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.874 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:51.875 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:48:51.875 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:48:51.875 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.875 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:51.875 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:48:51.875 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:48:51.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.876 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.876 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:48:51.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:48:51.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.876 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:51.876 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:48:51.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:48:51.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.877 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:51.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:48:51.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:48:51.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.877 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:51.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:48:51.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:48:51.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.877 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:51.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:48:51.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:48:51.878 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.878 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:51.878 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.878 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:51.878 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:51.878 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 46.607076141999997, 2024-09-12T22:48:51.878 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:48:51.878 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:51.878 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:51.878 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:51.878 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:51.879 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.879 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:51.879 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:51.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.879 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.879 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:51.879 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:51.880 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.880 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.880 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:51.880 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:48:51.880 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:48:51.880 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.881 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:51.881 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:48:51.881 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:48:51.881 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.881 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.881 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:51.881 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:48:51.881 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:48:51.881 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.881 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.881 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.881 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:48:51.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:48:51.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.882 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:51.882 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:48:51.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:48:51.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.882 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:51.882 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:48:51.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:48:51.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.883 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:51.883 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:48:51.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:48:51.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.883 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:51.883 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:48:51.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:48:51.883 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.884 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:51.884 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.884 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:51.884 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:51.884 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 46.607026531000002, 2024-09-12T22:48:51.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:48:51.884 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:51.884 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:51.884 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:51.884 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:51.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:51.885 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:51.885 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:51.885 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:51.885 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:51.886 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:51.886 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:48:51.886 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.886 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.886 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:51.886 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:51.886 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:48:51.886 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.886 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.886 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:51.886 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:48:51.886 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:48:51.887 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.887 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.887 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.887 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:48:51.887 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:48:51.887 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.887 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.887 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:51.887 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:48:51.887 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:48:51.887 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.887 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.888 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:51.888 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:48:51.888 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:48:51.888 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.888 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.888 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:51.888 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:48:51.888 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:48:51.888 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.888 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.889 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:51.889 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:48:51.889 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:48:51.889 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.889 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:51.889 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.889 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.889 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:51.889 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:51.889 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 46.606959222, 2024-09-12T22:48:51.889 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:48:51.890 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:51.890 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:51.890 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:51.890 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:51.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.890 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:51.890 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:51.890 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.890 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.890 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:51.890 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:51.890 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.891 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.891 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:51.891 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:51.891 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:48:51.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.891 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.891 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:51.891 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:48:51.891 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:48:51.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.892 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.892 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:51.892 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:48:51.892 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:48:51.892 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.892 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.892 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.892 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:48:51.892 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:48:51.892 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.892 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.892 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:51.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:48:51.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:48:51.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.893 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:51.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:48:51.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:48:51.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.893 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:51.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:48:51.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:48:51.894 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.894 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.894 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:51.894 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:48:51.894 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:48:51.894 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.894 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:51.894 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.894 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.894 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.894 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:51.895 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:51.895 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 46.606391303000002, 2024-09-12T22:48:51.895 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:48:51.895 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:51.895 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:51.895 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:51.895 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:51.895 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.895 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:51.895 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:51.895 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.895 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.895 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.896 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:51.896 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:51.896 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.896 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.896 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.896 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:51.896 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:51.896 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:48:51.896 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.896 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.896 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:51.896 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:48:51.896 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:48:51.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.897 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:51.897 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:48:51.897 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:48:51.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.897 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.897 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:48:51.897 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:48:51.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.898 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:51.898 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:48:51.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:48:51.898 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.898 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.898 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:51.898 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:48:51.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:48:51.898 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.898 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.898 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:51.898 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:48:51.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:48:51.898 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.899 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:51.899 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:48:51.899 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:48:51.899 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.899 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:51.899 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.899 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.899 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:48:51.899 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:51.899 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 46.606013699000002, 2024-09-12T22:48:51.899 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:48:51.900 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:51.900 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:51.900 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:51.900 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:51.900 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.900 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:51.900 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:51.900 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.900 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.900 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.900 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:51.900 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:51.900 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:51.901 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.901 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.901 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:51.901 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:48:51.901 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:48:51.901 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.901 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.901 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:51.901 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:48:51.901 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:48:51.901 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.901 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.902 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:51.902 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:48:51.902 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:48:51.902 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.902 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.902 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:51.902 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:48:51.902 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:48:51.902 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.902 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.902 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:51.902 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:48:51.902 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:48:51.903 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.903 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.903 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:51.903 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:48:51.903 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:48:51.903 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.903 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.903 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:51.903 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:48:51.903 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:48:51.903 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:51.903 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:51.904 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:51.904 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:48:51.904 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:48:51.904 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.904 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:51.904 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.904 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:51.904 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:51.904 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:51.906 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:51.906 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:51.904+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:52.006 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:52.005+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:52.011 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:52.011 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:48:52.011 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:48:52.011 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:52.020 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:52.108 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:52.107+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:52.162 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:52.162 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:48:52.162 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:48:52.162 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:48:52.162 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:52.170 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:52.209 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:52.208+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:52.256 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:48:52.274 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:52.274 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:48:52.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:48:52.275 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:48:52.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.275 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:48:52.275 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:52.275 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 52.226634666999999, 2024-09-12T22:48:52.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:48:52.275 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:52.275 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:52.275 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:52.275 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:52.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:52.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:52.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:52.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:52.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:52.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:52.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:48:52.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:52.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:48:52.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:48:52.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:52.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:48:52.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:48:52.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:52.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:48:52.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:48:52.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:52.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:48:52.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:48:52.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:52.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:48:52.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:48:52.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:52.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:48:52.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:48:52.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:52.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:48:52.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:48:52.279 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.279 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:52.279 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.279 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:48:52.279 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:52.279 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.226253939999999, 2024-09-12T22:48:52.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:48:52.280 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:52.280 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:52.280 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:52.280 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:52.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:52.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:52.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:52.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:52.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:52.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:48:52.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:48:52.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:52.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:48:52.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:48:52.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:52.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:48:52.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:48:52.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:52.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:48:52.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:48:52.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:52.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:48:52.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:48:52.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:52.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:48:52.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:48:52.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:52.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:48:52.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:48:52.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:52.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:48:52.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:48:52.284 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.284 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:52.284 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.285 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:48:52.285 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:52.285 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.105657129999997, 2024-09-12T22:48:52.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:48:52.285 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:52.285 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:52.285 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:48:52.285 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:52.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:52.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:52.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:52.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:52.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:52.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:52.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:48:52.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:52.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:48:52.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:48:52.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:52.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:48:52.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:48:52.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:52.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:48:52.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:48:52.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:52.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:48:52.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:48:52.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:52.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:48:52.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:48:52.288 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.288 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:52.288 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.289 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:52.289 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:52.289 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.103048950000002, 2024-09-12T22:48:52.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:48:52.289 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:52.289 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:52.289 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:52.289 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:52.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:52.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:52.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:52.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:52.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:52.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:48:52.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:48:52.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:52.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:48:52.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:48:52.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:52.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:48:52.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:48:52.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:52.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:48:52.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:48:52.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:52.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:48:52.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:48:52.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:52.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:48:52.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:48:52.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:52.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:48:52.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:48:52.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:52.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:48:52.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:48:52.293 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.293 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:52.293 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.293 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:52.293 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:52.293 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.102155727000003, 2024-09-12T22:48:52.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:48:52.294 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:52.294 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:52.294 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:52.294 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:52.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:52.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:52.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:52.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:52.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:52.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:48:52.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:48:52.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:52.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:48:52.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:48:52.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:52.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:48:52.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:48:52.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:52.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:48:52.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:48:52.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:52.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:48:52.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:48:52.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:52.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:48:52.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:48:52.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:52.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:48:52.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:48:52.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:52.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:48:52.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:48:52.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:52.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:48:52.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:48:52.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:52.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:48:52.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:48:52.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:52.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:48:52.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:48:52.298 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.299 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:52.299 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.299 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:52.299 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:52.299 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.102084069, 2024-09-12T22:48:52.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:48:52.299 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:52.299 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:52.299 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:52.299 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:52.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:52.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:52.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:52.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:52.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:52.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:48:52.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:48:52.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:52.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:48:52.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:48:52.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:52.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:48:52.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:48:52.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:52.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:48:52.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:48:52.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:52.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:48:52.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:48:52.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:52.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:48:52.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:48:52.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:52.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:48:52.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:48:52.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:52.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:48:52.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:48:52.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:52.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:48:52.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:48:52.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:52.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:48:52.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:48:52.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:52.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:48:52.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:48:52.304 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.304 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:52.304 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.305 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:52.305 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:52.305 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.102041350999997, 2024-09-12T22:48:52.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:48:52.305 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:52.305 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:52.305 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:52.305 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:52.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:52.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:52.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:52.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:52.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:52.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:48:52.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:48:52.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:52.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:48:52.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:48:52.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:52.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:48:52.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:48:52.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:52.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:48:52.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:48:52.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:52.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:48:52.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:48:52.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:52.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:48:52.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:48:52.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:52.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:48:52.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:48:52.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:52.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:48:52.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:48:52.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:52.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:48:52.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:48:52.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:52.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:48:52.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:48:52.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:52.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:48:52.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:48:52.310 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.310 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:52.310 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.310 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:52.311 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:52.311 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.102003433999997, 2024-09-12T22:48:52.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:48:52.311 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:52.311 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:52.311 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:52.311 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:52.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:52.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:52.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:52.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:52.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:52.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:48:52.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:48:52.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:52.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:48:52.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:48:52.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:52.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:48:52.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:48:52.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:52.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:48:52.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:48:52.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:52.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:48:52.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:48:52.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:52.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:48:52.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:48:52.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:52.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:52.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:48:52.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:52.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:48:52.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:48:52.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:52.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:48:52.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:48:52.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:52.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:48:52.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:48:52.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:52.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:48:52.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:48:52.316 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.317 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:52.317 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.317 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:52.317 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:52.317 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.101979983, 2024-09-12T22:48:52.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:48:52.317 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:52.317 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:52.318 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:52.318 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:52.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:52.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:52.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:52.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:52.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:52.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:48:52.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:48:52.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:52.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:48:52.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:48:52.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:52.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:48:52.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:48:52.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:52.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:48:52.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:48:52.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:52.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:48:52.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:48:52.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:52.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:48:52.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:48:52.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:52.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:52.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:48:52.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:52.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:48:52.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:48:52.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:52.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:48:52.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:48:52.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:52.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:48:52.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:48:52.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:52.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:48:52.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:48:52.323 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.323 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:52.323 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.323 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:52.323 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:52.323 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.101955746000002, 2024-09-12T22:48:52.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:48:52.323 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:52.323 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:52.324 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:52.324 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:52.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:52.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:52.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:52.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:52.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:52.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:52.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:48:52.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:52.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:48:52.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:48:52.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:52.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:48:52.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:48:52.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:52.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:48:52.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:48:52.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:52.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:48:52.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:48:52.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:52.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:48:52.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:48:52.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:52.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:48:52.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:48:52.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:52.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:48:52.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:48:52.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:52.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:48:52.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:48:52.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:52.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:48:52.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:48:52.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:52.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:48:52.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:48:52.328 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.328 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:52.328 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.329 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:52.329 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:52.329 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.101927828999997, 2024-09-12T22:48:52.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:48:52.329 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:52.329 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:52.329 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:52.329 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:52.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:52.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:52.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:52.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:52.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:52.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:52.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:48:52.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:52.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:48:52.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:48:52.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:52.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:48:52.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:48:52.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:52.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:48:52.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:48:52.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:52.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:48:52.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:48:52.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:52.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:48:52.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:48:52.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:52.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:48:52.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:48:52.333 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.333 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:52.333 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.333 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:52.333 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:52.333 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.101853333999998, 2024-09-12T22:48:52.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:48:52.333 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:52.333 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:52.333 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:52.334 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:52.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:52.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:52.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:52.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:52.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:52.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:48:52.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:48:52.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:52.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:48:52.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:48:52.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:52.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:48:52.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:48:52.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:52.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:48:52.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:48:52.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:52.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:48:52.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:48:52.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:52.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:48:52.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:48:52.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:52.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:48:52.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:48:52.337 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.337 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:52.337 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.337 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:52.338 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:52.338 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.101807305999998, 2024-09-12T22:48:52.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:48:52.338 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:52.338 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:52.338 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:52.338 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:52.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:52.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:52.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:52.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:52.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:52.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:48:52.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:48:52.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:52.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:48:52.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:48:52.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:52.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:48:52.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:48:52.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:52.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:48:52.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:48:52.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:52.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:48:52.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:48:52.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:52.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:48:52.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:48:52.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:52.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:48:52.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:48:52.341 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.341 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:52.341 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.342 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:52.342 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:52.342 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.099636422000003, 2024-09-12T22:48:52.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:48:52.342 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:52.342 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:52.342 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:52.342 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:52.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:52.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:52.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:52.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:52.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:52.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:52.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:48:52.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:52.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:48:52.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:48:52.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:52.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:48:52.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:48:52.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:52.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:52.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:48:52.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:52.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:48:52.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:48:52.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:52.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:52.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:48:52.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:52.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:48:52.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:48:52.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:52.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:48:52.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:48:52.346 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.346 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:52.346 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.347 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:52.347 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:52.347 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.099585972, 2024-09-12T22:48:52.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:48:52.347 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:52.347 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:52.347 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:52.347 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:52.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:52.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:52.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:52.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:52.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:52.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:48:52.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:48:52.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:52.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:48:52.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:48:52.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:52.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:48:52.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:48:52.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:52.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:48:52.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:48:52.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:52.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:48:52.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:48:52.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:52.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:48:52.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:48:52.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:52.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:48:52.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:48:52.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:52.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:48:52.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:48:52.351 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.351 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:52.351 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.351 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:52.351 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:52.351 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.099532533999998, 2024-09-12T22:48:52.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:48:52.352 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:52.352 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:52.352 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:52.352 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:52.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:52.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:52.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:52.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:52.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:52.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:52.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:48:52.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:52.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:48:52.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:48:52.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:52.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:52.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:48:52.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:52.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:48:52.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:48:52.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:52.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:48:52.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:48:52.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:52.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:48:52.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:48:52.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:52.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:48:52.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:48:52.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:52.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:48:52.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:48:52.356 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.356 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:52.356 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.356 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:48:52.356 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:52.356 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.095548180999998, 2024-09-12T22:48:52.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:48:52.356 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:52.356 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:52.356 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:52.356 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:52.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:52.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:52.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:52.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:52.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:52.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:48:52.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:48:52.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:52.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:48:52.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:48:52.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:52.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:48:52.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:48:52.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:52.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:48:52.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:48:52.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:52.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:48:52.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:48:52.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:52.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:48:52.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:48:52.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:52.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:48:52.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:48:52.360 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.360 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:52.360 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.360 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:48:52.360 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:52.360 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 45.110395642, 2024-09-12T22:48:52.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:48:52.360 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:52.360 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:52.360 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:52.360 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:52.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:52.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:52.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:52.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:52.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:52.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:48:52.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:48:52.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:52.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:48:52.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:48:52.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:52.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:48:52.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:48:52.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:52.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:48:52.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:48:52.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:52.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:48:52.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:48:52.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:52.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:48:52.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:48:52.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:52.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:48:52.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:48:52.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:52.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:48:52.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:48:52.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:52.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:48:52.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:48:52.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:52.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:48:52.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:48:52.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:52.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:48:52.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:48:52.366 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.366 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:52.366 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.366 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:48:52.366 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:52.366 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 27.108479397, 2024-09-12T22:48:52.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:48:52.366 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:52.366 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:52.366 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:52.367 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:52.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:52.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:52.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:52.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:52.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:52.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:48:52.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:48:52.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:52.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:48:52.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:48:52.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:52.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:48:52.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:48:52.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:52.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:48:52.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:48:52.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:52.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:48:52.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:48:52.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:52.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:48:52.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:48:52.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:52.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:48:52.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:48:52.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:52.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:48:52.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:48:52.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:52.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:48:52.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:48:52.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:52.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:48:52.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:48:52.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:52.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:48:52.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:48:52.372 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.372 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:52.372 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.372 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:48:52.372 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:52.372 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.107726022000001, 2024-09-12T22:48:52.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012160610000000001, 2024-09-12T22:48:52.373 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:52.373 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:52.373 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:52.373 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:52.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:52.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:52.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:52.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:52.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:52.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:52.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164967+0000", 2024-09-12T22:48:52.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:48:52.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:52.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164974+0000", 2024-09-12T22:48:52.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:48:52.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:52.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164987+0000", 2024-09-12T22:48:52.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3689000000000001e-05 2024-09-12T22:48:52.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:52.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164995+0000", 2024-09-12T22:48:52.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2959999999999999e-06 2024-09-12T22:48:52.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:52.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165068+0000", 2024-09-12T22:48:52.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2449999999999999e-05 2024-09-12T22:48:52.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:52.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165212+0000", 2024-09-12T22:48:52.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144117 2024-09-12T22:48:52.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:52.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166066+0000", 2024-09-12T22:48:52.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085441100000000002 2024-09-12T22:48:52.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:52.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166107+0000", 2024-09-12T22:48:52.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0450000000000001e-05 2024-09-12T22:48:52.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:52.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:52.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:52.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166181+0000", 2024-09-12T22:48:52.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-12T22:48:52.377 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.377 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:52.377 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.377 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:52.377 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:52.377 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:52.379 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:52.380 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:52.378+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:52.392 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:48:52.392 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:48:52.412 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:48:52.413 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:48:52.413 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:48:52.416 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:48:52.416 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:48:52.459 INFO:teuthology.orchestra.run.smithi066.stderr:noscrub is unset 2024-09-12T22:48:52.479 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:52.479+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:52.484 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:52.485 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:52.493 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:52.580 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:52.580+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:52.637 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:52.637 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:52.646 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:52.681 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:52.680+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:52.747 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:52.747 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:52.756 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:52.782 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:52.781+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:52.860 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:52.860 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:52.868 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:52.912 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:52.911+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:52.971 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:52.971 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:52.980 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:53.021 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:53.020+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:53.084 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:53.083+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:53.123 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:53.124 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:53.132 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:53.185 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:53.184+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:53.235 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:53.235 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:53.243 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:53.286 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:53.285+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:53.346 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:53.346 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:53.354 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:53.398 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:53.397+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:53.456 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:53.456 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:53.465 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:53.506 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:53.505+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:53.569 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:53.569 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:53.578 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:53.621 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:53.620+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:53.680 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:53.681 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:53.689 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:53.691 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:53.690+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:53.792 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:53.791+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:53.831 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:53.831 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:53.841 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:53.893 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:53.892+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:53.945 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:53.945 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:53.953 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:53.998 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:53.997+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:54.055 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:54.056 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:54.064 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:54.095 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:54.094+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:54.196 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:54.195+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:54.207 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:54.207 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:54.216 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:54.297 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:54.296+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:54.320 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:54.320 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:54.329 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:54.398 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:54.397+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:54.417 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:48:54.431 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:54.431 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:54.440 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:54.474 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:48:54.500 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:54.499+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:54.542 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:54.542 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:54.552 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:54.599 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:48:54.600 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:48:54.601 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:54.600+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:54.620 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:48:54.621 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:48:54.621 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:48:54.625 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:48:54.626 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:48:54.658 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:54.658 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:48:54.658 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:48:54.658 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:54.666 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:54.707 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:54.706+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:54.802 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:54.801+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:54.807 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:54.807 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:48:54.807 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:48:54.807 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:48:54.807 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:54.815 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:54.903 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:54.902+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:54.920 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:54.920 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:48:54.920 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:48:54.920 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:48:54.920 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.920 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:48:54.920 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:54.921 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 58.534300039000001, 2024-09-12T22:48:54.921 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:48:54.921 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:54.921 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:54.921 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:54.921 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:54.921 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.921 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:54.921 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:54.921 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:54.921 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.921 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.921 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:54.922 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:54.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:54.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.922 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.922 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:54.922 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:54.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:48:54.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.922 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.922 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:54.922 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:48:54.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:48:54.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.923 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.923 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:54.923 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:48:54.923 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:48:54.923 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.923 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.923 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:54.923 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:48:54.923 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:48:54.923 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.923 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.923 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:54.923 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:48:54.923 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:48:54.924 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.924 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.924 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:54.924 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:48:54.924 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:48:54.924 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.924 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.924 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:54.924 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:48:54.924 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:48:54.924 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.924 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.924 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:54.925 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:48:54.925 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:48:54.925 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:54.925 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:54.925 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:54.925 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.925 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.925 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:48:54.925 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:54.925 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 58.533857456, 2024-09-12T22:48:54.925 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:48:54.925 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:54.925 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:54.925 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:54.926 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:54.926 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.926 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:54.926 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:54.926 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:54.926 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.926 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.926 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:54.926 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:54.926 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:54.926 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.926 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.926 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:54.927 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:48:54.927 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:48:54.927 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.927 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.927 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:54.927 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:48:54.927 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:48:54.927 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.927 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.927 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:54.927 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:48:54.927 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:48:54.927 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.928 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.928 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:54.928 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:48:54.928 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:48:54.928 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.928 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.928 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:54.928 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:48:54.928 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:48:54.928 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.928 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.928 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:54.928 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:48:54.929 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:48:54.929 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.929 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.929 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:54.929 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:48:54.929 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:48:54.929 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.929 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.929 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:54.929 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:48:54.929 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:48:54.929 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:54.930 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:54.930 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:54.930 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.930 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.930 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:48:54.930 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:54.930 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 58.533491298999998, 2024-09-12T22:48:54.930 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:48:54.930 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:54.930 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:54.930 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:54.930 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:54.930 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.931 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:54.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:54.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:54.931 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.931 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.931 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:54.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:54.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:54.931 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.931 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.931 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:54.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:48:54.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:48:54.931 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.932 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.932 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:54.932 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:48:54.932 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:48:54.932 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.932 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.932 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:54.932 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:48:54.932 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:48:54.932 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.932 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.932 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:54.932 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:48:54.933 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:48:54.933 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.933 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.933 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:54.933 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:48:54.933 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:48:54.933 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.933 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.933 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:54.933 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:48:54.933 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:48:54.933 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.933 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.933 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:54.934 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:48:54.934 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:48:54.934 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.934 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.934 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:54.934 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:48:54.934 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:48:54.934 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:54.934 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:54.934 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:54.934 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.934 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.934 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:48:54.935 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:54.935 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 58.533078987000003, 2024-09-12T22:48:54.935 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:48:54.935 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:54.935 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:54.935 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:54.935 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:54.935 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.935 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:54.935 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:54.935 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:54.935 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.936 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.936 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:54.936 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:54.936 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:54.936 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.936 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.936 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:54.936 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:54.936 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:48:54.936 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.936 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.936 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:54.936 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:48:54.937 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:48:54.937 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.937 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.937 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:54.937 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:48:54.937 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:48:54.937 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.937 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.937 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:54.937 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:48:54.937 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:48:54.937 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.937 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.938 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:54.938 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:48:54.938 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:48:54.938 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.938 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.938 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:54.938 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:48:54.938 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:48:54.938 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.938 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.938 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:54.938 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:48:54.938 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:48:54.938 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.939 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.939 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:54.939 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:48:54.939 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:48:54.939 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:54.939 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:54.939 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:54.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.939 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.939 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:48:54.939 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:54.939 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 58.399228893, 2024-09-12T22:48:54.939 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:48:54.940 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:54.940 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:54.940 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:54.940 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:54.940 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.940 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:54.940 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:54.940 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:54.940 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.940 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.940 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:54.940 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:54.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:54.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.941 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.941 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:54.941 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:54.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:48:54.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.941 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.941 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:54.941 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:48:54.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:48:54.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.941 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.941 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:54.942 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:48:54.942 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:48:54.942 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.942 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.942 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:54.942 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:48:54.942 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:48:54.942 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.942 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.942 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:54.942 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:48:54.942 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:48:54.942 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.943 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:54.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:48:54.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:48:54.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.943 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:54.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:48:54.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:48:54.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.943 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:54.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:48:54.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:48:54.944 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:54.944 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:54.944 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:54.944 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.944 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.944 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:54.944 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:54.944 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 49.753993338999997, 2024-09-12T22:48:54.944 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:48:54.944 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:54.944 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:54.944 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:54.944 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:54.945 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.945 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:54.945 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:54.945 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:54.945 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.945 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.945 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:54.945 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:54.945 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:54.945 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.945 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.945 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:54.946 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:48:54.946 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:48:54.946 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.946 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.946 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:54.946 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:48:54.946 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:48:54.946 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.946 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.946 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:54.946 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:48:54.946 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:48:54.946 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.946 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.947 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:54.947 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:48:54.947 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:48:54.947 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.947 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.947 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:54.947 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:48:54.947 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:48:54.947 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.947 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.947 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:54.947 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:48:54.947 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:48:54.948 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.948 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.948 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:54.948 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:48:54.948 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:48:54.948 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.948 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.948 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:54.948 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:48:54.948 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:48:54.948 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.948 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.948 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:54.949 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:48:54.949 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:48:54.949 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.949 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.949 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:54.949 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:48:54.949 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:48:54.949 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.949 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.949 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:54.949 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:48:54.949 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:48:54.949 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.950 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.950 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:54.950 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:48:54.950 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:48:54.950 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.950 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.950 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:54.950 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:48:54.950 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:48:54.950 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:54.950 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:54.950 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:54.951 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.951 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.951 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:54.951 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:54.951 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 49.753893822000002, 2024-09-12T22:48:54.951 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:48:54.951 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:54.951 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:54.951 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:54.951 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:54.951 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.951 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:54.951 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:54.952 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:54.952 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.952 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.952 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:54.952 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:54.952 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:54.952 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.952 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.952 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:54.952 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:48:54.952 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:48:54.952 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.952 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.953 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:54.953 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:48:54.953 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:48:54.953 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.953 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.953 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:54.953 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:48:54.953 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:48:54.953 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.953 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.953 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:54.953 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:48:54.953 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:48:54.953 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.954 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.954 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:54.954 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:48:54.954 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:48:54.954 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.954 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.954 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:54.954 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:48:54.954 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:48:54.954 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.954 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.954 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:54.954 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:48:54.955 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:48:54.955 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.955 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.955 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:54.955 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:48:54.955 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:48:54.955 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.955 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.955 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:54.955 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:48:54.955 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:48:54.955 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.955 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.955 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:54.956 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:48:54.956 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:48:54.956 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.956 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.956 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:54.956 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:48:54.956 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:48:54.956 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.956 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.956 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:54.956 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:48:54.956 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:48:54.957 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.957 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.957 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:54.957 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:48:54.957 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:48:54.957 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:54.957 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:54.957 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:54.957 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.957 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.957 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:54.957 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:54.958 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 49.753849082999999, 2024-09-12T22:48:54.958 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:48:54.958 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:54.958 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:54.958 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:54.958 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:54.958 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.958 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:54.958 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:54.958 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:54.958 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.958 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.958 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:54.959 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:54.959 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:54.959 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.959 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.959 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:54.959 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:48:54.959 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:48:54.959 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.959 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.959 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:54.959 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:48:54.959 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:48:54.960 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.960 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.960 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:54.960 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:48:54.960 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:48:54.960 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.960 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.960 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:54.960 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:48:54.960 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:48:54.960 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.960 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.960 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:54.960 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:48:54.961 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:48:54.961 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.961 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.961 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:54.961 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:48:54.961 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:48:54.961 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.961 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.961 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:54.961 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:48:54.961 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:48:54.961 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.962 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.962 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:54.962 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:48:54.962 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:48:54.962 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.962 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.962 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:54.962 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:48:54.962 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:48:54.962 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.962 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.962 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:54.962 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:48:54.962 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:48:54.963 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.963 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.963 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:54.963 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:48:54.963 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:48:54.963 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.963 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.963 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:54.963 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:48:54.963 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:48:54.963 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.963 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.963 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:54.964 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:48:54.964 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:48:54.964 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:54.964 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:54.964 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:54.964 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.964 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.964 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:54.964 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:54.964 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 49.753621381999999, 2024-09-12T22:48:54.964 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:48:54.964 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:54.964 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:54.964 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:54.965 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:54.965 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.965 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:54.965 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:54.965 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:54.965 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.965 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.965 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:54.965 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:54.965 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:54.965 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.965 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.965 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:54.966 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:48:54.966 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:48:54.966 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.966 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.966 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:54.966 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:48:54.966 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:48:54.966 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.966 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.966 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:54.966 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:48:54.966 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:48:54.966 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.966 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.967 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:54.967 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:48:54.967 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:48:54.967 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.967 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.967 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:54.967 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:48:54.967 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:48:54.967 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.967 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.967 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:54.968 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:48:54.968 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:48:54.968 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.968 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.968 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:54.968 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:48:54.968 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:48:54.968 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.968 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.968 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:54.968 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:48:54.968 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:48:54.968 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.969 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.969 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:54.969 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:48:54.969 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:48:54.969 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.969 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.969 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:54.969 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:48:54.969 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:48:54.969 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.969 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.969 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:54.969 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:48:54.970 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:48:54.970 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.970 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.970 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:54.970 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:48:54.970 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:48:54.970 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.970 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.970 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:54.970 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:48:54.970 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:48:54.970 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:54.970 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:54.970 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:54.971 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.971 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.971 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:54.971 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:54.971 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 49.753456274000001, 2024-09-12T22:48:54.971 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:48:54.971 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:54.971 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:54.971 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:54.971 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:54.971 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.971 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:54.971 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:54.971 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:54.972 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.972 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.972 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:54.972 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:54.972 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:54.972 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.972 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.972 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:54.972 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:48:54.972 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:48:54.972 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.972 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.972 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:54.973 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:48:54.973 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:48:54.973 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.973 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.973 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:54.973 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:48:54.973 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:48:54.973 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.973 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.973 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:54.973 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:48:54.974 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:48:54.974 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.974 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.974 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:54.974 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:48:54.974 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:48:54.974 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.974 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.974 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:54.974 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:48:54.974 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:48:54.974 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.974 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.975 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:54.975 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:48:54.975 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:48:54.975 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.975 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.975 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:54.975 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:48:54.975 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:48:54.975 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.975 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.975 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:54.975 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:48:54.975 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:48:54.975 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.976 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.976 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:54.976 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:48:54.976 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:48:54.976 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.976 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.976 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:54.976 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:48:54.976 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:48:54.976 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.976 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.976 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:54.976 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:48:54.977 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:48:54.977 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.977 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.977 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:54.977 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:48:54.977 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:48:54.977 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:54.977 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:54.977 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:54.977 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.977 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.977 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:54.977 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:54.977 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 49.753394989, 2024-09-12T22:48:54.978 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:48:54.978 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:54.978 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:54.978 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:54.978 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:54.978 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.978 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:54.978 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:54.978 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:54.978 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.978 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.978 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:54.978 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:54.978 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:54.979 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.979 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.979 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:54.979 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:54.979 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:48:54.979 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.979 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.979 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:54.979 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:48:54.979 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:48:54.979 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.979 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.979 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:54.980 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:48:54.980 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:48:54.980 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.980 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.980 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:54.980 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:48:54.980 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:48:54.980 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.980 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.980 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:54.980 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:48:54.980 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:48:54.980 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.981 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.981 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:54.981 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:48:54.981 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:48:54.981 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.981 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.981 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:54.981 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:48:54.981 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:48:54.981 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.981 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.981 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:54.981 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:48:54.982 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:48:54.982 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.982 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.982 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:54.982 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:48:54.982 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:48:54.982 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.982 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.982 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:54.982 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:48:54.982 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:48:54.982 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.982 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.982 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:54.983 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:48:54.983 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:48:54.983 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.983 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.983 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:54.983 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:48:54.983 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:48:54.983 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.983 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.983 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:54.983 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:48:54.983 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:48:54.983 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:54.983 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:54.984 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:54.984 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.984 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.984 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:54.984 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:54.984 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 49.753314881000001, 2024-09-12T22:48:54.984 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:48:54.984 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:54.984 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:54.984 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:54.984 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:54.984 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.984 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:54.985 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:54.985 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:54.985 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.985 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.985 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:54.985 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:54.985 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:54.985 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.985 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.985 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:54.985 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:48:54.985 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:48:54.985 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.986 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.986 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:54.986 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:48:54.986 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:48:54.986 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.986 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.986 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:54.986 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:48:54.986 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:48:54.986 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.986 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.986 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:54.986 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:48:54.986 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:48:54.987 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.987 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.987 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:54.987 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:48:54.987 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:48:54.987 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.987 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.987 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:54.987 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:48:54.987 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:48:54.987 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.987 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.987 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:54.988 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:48:54.988 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:48:54.988 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.988 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.988 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:54.988 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:48:54.988 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:48:54.988 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.988 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.988 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:54.988 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:48:54.988 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:48:54.988 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.988 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.989 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:54.989 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:48:54.989 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:48:54.989 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.989 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.989 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:54.989 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:48:54.989 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:48:54.989 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.989 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.989 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:54.989 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:48:54.989 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:48:54.990 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.990 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.990 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:54.990 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:48:54.990 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:48:54.990 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:54.990 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:54.990 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:54.990 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.990 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.990 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:54.990 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:54.990 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 49.753265927999998, 2024-09-12T22:48:54.990 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:48:54.991 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:54.991 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:54.991 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:48:54.991 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:54.991 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.991 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:54.991 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:54.991 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:54.991 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.991 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.991 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:54.991 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:54.991 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:54.991 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.992 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.992 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:54.992 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:54.992 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:48:54.992 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.992 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.992 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:54.992 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:48:54.992 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:48:54.992 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.992 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.992 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:54.992 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:48:54.993 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:48:54.993 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.993 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:54.993 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:48:54.993 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:48:54.993 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.993 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:54.993 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:48:54.993 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:48:54.993 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.994 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.994 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:54.994 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:48:54.994 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:48:54.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.994 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.994 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:54.994 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:48:54.994 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:48:54.994 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:54.994 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:54.994 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:54.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.994 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.995 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:54.995 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:54.995 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 49.753216827999999, 2024-09-12T22:48:54.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:48:54.995 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:54.995 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:54.995 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:48:54.995 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:54.995 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.995 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:54.995 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:54.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:54.995 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.996 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.996 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:54.996 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:54.996 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:54.996 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.996 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.996 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:54.996 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:48:54.996 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:48:54.996 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.996 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.996 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:54.996 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:48:54.996 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:48:54.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:54.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:48:54.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:48:54.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:54.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:48:54.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:48:54.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:54.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:48:54.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:48:54.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.998 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.998 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:54.998 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:48:54.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:48:54.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.998 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.998 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:54.998 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:48:54.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:48:54.998 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:54.998 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:54.999 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:54.999 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:54.999 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.999 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:54.999 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:54.999 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 49.746276377999997, 2024-09-12T22:48:54.999 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:48:54.999 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:54.999 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:54.999 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:54.999 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:54.999 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:54.999 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:54.999 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:55.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.000 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:55.000 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:55.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.000 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:55.000 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:48:55.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:48:55.000 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.001 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:55.001 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:48:55.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:48:55.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.001 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:55.001 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:48:55.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:48:55.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.001 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.001 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:48:55.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:48:55.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.002 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:55.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:48:55.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:48:55.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.002 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:55.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:48:55.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:48:55.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.002 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:55.003 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:48:55.003 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:48:55.003 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.003 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.003 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:55.003 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:48:55.003 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:48:55.003 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.003 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:55.003 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.003 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.003 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.003 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:55.004 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:55.004 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 49.745187538000003, 2024-09-12T22:48:55.004 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:48:55.004 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:55.004 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:55.004 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.004 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:55.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.004 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:55.004 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:55.004 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.005 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:55.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:55.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.005 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:55.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:48:55.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:48:55.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.005 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:55.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:48:55.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:48:55.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.006 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:55.006 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:48:55.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:48:55.006 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.006 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.006 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:48:55.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:48:55.006 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.006 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:55.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:48:55.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:48:55.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.007 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:55.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:48:55.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:48:55.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.007 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:55.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:48:55.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:48:55.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.008 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:55.008 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:48:55.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:48:55.008 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.008 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:55.008 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.008 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.008 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:55.008 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:55.008 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 49.745137927000002, 2024-09-12T22:48:55.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:48:55.009 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:55.009 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:55.009 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.009 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:55.009 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:55.009 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:55.009 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.009 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.009 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:55.009 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:55.009 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.009 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.010 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:55.010 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:55.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:48:55.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.010 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:55.010 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:55.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:48:55.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.010 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:55.010 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:48:55.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:48:55.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.011 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.011 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:48:55.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:48:55.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.011 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:55.011 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:48:55.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:48:55.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.011 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:55.011 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:48:55.012 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:48:55.012 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.012 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.012 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:55.012 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:48:55.012 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:48:55.012 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.012 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.012 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:55.012 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:48:55.012 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:48:55.012 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.012 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:55.013 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.013 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:55.013 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:55.013 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 49.745070618, 2024-09-12T22:48:55.013 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:48:55.013 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:55.013 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:55.013 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.013 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:55.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.013 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:55.013 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:55.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:55.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:55.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:55.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:55.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:48:55.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:55.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:48:55.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:48:55.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:55.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:48:55.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:48:55.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:48:55.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:48:55.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:55.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:48:55.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:48:55.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:55.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:48:55.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:48:55.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:55.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:48:55.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:48:55.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:55.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:48:55.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:48:55.017 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.017 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:55.017 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.017 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:55.017 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:55.017 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 49.744502699000002, 2024-09-12T22:48:55.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:48:55.018 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:55.018 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:55.018 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.018 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:55.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.018 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:55.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:55.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.018 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:55.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:55.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.019 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.019 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.019 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:55.019 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:55.019 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:48:55.019 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.019 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.019 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:55.019 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:48:55.019 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:48:55.019 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.019 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.019 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:55.019 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:48:55.020 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:48:55.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.020 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.020 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:48:55.020 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:48:55.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.020 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:55.020 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:48:55.020 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:48:55.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.020 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:55.021 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:48:55.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:48:55.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.021 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.021 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:55.021 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:48:55.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:48:55.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.021 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.021 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:55.021 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:48:55.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:48:55.021 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.021 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:55.022 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.022 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.022 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:48:55.022 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:55.022 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 49.744125095000001, 2024-09-12T22:48:55.022 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:48:55.022 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:55.022 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:55.022 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.022 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:55.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:55.022 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:55.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.023 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:55.023 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:55.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.023 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:55.023 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:48:55.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:48:55.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.024 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:55.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:48:55.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:48:55.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.024 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:55.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:48:55.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:48:55.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.024 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:48:55.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:48:55.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.025 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.025 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:55.025 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:48:55.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:48:55.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.025 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.025 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:55.025 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:48:55.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:48:55.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.025 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.025 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:55.025 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:48:55.026 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:48:55.026 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.026 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:55.026 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:48:55.026 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:48:55.026 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.026 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:55.026 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.026 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.026 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:55.026 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:55.028 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:55.028 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:55.027+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:55.129 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:55.128+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:55.134 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:55.134 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:48:55.135 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:48:55.135 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:55.144 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:55.229 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~23s 2024-09-12T22:48:55.229 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:55.228+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:55.246 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:55.246 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:48:55.246 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:48:55.247 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:48:55.247 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:55.255 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:55.331 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:55.330+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:55.400 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:55.400 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:48:55.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:48:55.400 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:48:55.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.400 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:48:55.400 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:55.400 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.352111354999998, 2024-09-12T22:48:55.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:48:55.401 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:55.401 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:55.401 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.401 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:55.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:55.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:55.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:55.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:55.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:55.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:55.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:48:55.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:55.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:48:55.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:48:55.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:55.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:48:55.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:48:55.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:48:55.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:48:55.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:55.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:48:55.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:48:55.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:55.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:48:55.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:48:55.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:55.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:48:55.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:48:55.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:55.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:48:55.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:48:55.405 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.405 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:55.405 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.405 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:48:55.405 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:55.405 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 53.351730627999999, 2024-09-12T22:48:55.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:48:55.406 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:55.406 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:55.406 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.406 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:55.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:55.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:55.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:55.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:55.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:55.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:48:55.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:48:55.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:55.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:48:55.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:48:55.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:55.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:48:55.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:48:55.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:48:55.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:48:55.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:55.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:48:55.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:48:55.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:55.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:48:55.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:48:55.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:55.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:48:55.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:48:55.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:55.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:48:55.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:48:55.410 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.410 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:55.410 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.410 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:48:55.410 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:55.411 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.231133818000004, 2024-09-12T22:48:55.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:48:55.411 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:55.411 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:55.411 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:48:55.411 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:55.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:55.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:55.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:55.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:55.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:55.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:55.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:48:55.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:55.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:48:55.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:48:55.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:55.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:48:55.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:48:55.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:48:55.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:48:55.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:55.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:48:55.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:48:55.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:55.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:48:55.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:48:55.414 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.414 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:55.414 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.414 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:55.415 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:55.415 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.228525638000001, 2024-09-12T22:48:55.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:48:55.415 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:55.415 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:55.415 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.415 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:55.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:55.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:55.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:55.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:55.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:55.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:48:55.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:48:55.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:55.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:48:55.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:48:55.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:55.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:48:55.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:48:55.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:48:55.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:48:55.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:55.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:48:55.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:48:55.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:55.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:48:55.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:48:55.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:55.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:48:55.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:48:55.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:55.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:48:55.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:48:55.419 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.419 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:55.419 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.419 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:55.419 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:55.419 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.227632415000002, 2024-09-12T22:48:55.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:48:55.419 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:55.419 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:55.420 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.420 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:55.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:55.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:55.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:55.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:55.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:55.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:48:55.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:48:55.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:55.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:48:55.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:48:55.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:55.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:48:55.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:48:55.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:48:55.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:48:55.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:55.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:48:55.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:48:55.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:55.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:48:55.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:48:55.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:55.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:48:55.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:48:55.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:55.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:48:55.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:48:55.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:55.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:48:55.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:48:55.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:55.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:48:55.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:48:55.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:55.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:48:55.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:48:55.424 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.424 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:55.425 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.425 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:55.425 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:55.425 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.227560756999999, 2024-09-12T22:48:55.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:48:55.425 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:55.425 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:55.425 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.425 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:55.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:55.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:55.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:55.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:55.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:55.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:48:55.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:48:55.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:55.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:48:55.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:48:55.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:55.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:48:55.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:48:55.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:48:55.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:48:55.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:55.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:48:55.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:48:55.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:55.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:48:55.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:48:55.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:55.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:48:55.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:48:55.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:55.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:48:55.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:48:55.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:55.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:48:55.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:48:55.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:55.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:48:55.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:48:55.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:55.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:48:55.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:48:55.430 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.430 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:55.431 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.431 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:55.431 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:55.431 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.227518039000003, 2024-09-12T22:48:55.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:48:55.431 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:55.431 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:55.431 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.431 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:55.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:55.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:55.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:55.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:55.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:55.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:48:55.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:48:55.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:55.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:48:55.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:48:55.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:55.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:48:55.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:48:55.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:48:55.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:48:55.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:55.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:48:55.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:48:55.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:55.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:48:55.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:48:55.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:55.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:48:55.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:48:55.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:55.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:48:55.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:48:55.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:55.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:48:55.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:48:55.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:55.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:48:55.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:48:55.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:55.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:48:55.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:48:55.437 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.437 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:55.437 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.437 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:55.438 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:55.438 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.227480122000003, 2024-09-12T22:48:55.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:48:55.438 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:55.438 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:55.438 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.438 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:55.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:55.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:55.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:55.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:55.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:55.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:48:55.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:48:55.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:55.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:48:55.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:48:55.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:55.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:48:55.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:48:55.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:48:55.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:48:55.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:55.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:48:55.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:48:55.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:55.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:48:55.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:48:55.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:55.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:55.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:48:55.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:55.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:48:55.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:48:55.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:55.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:48:55.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:48:55.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:55.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:48:55.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:48:55.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:55.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:48:55.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:48:55.443 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.443 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:55.443 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.443 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:55.443 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:55.443 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.227456670999999, 2024-09-12T22:48:55.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:48:55.443 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:55.443 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:55.444 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.444 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:55.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:55.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:55.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:55.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:55.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:55.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:48:55.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:48:55.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:55.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:48:55.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:48:55.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:55.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:48:55.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:48:55.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:48:55.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:48:55.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:55.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:48:55.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:48:55.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:55.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:48:55.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:48:55.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:55.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:55.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:48:55.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:55.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:48:55.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:48:55.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:55.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:48:55.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:48:55.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:55.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:48:55.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:48:55.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:55.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:48:55.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:48:55.450 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.450 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:55.450 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.450 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:55.450 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:55.450 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.227432434000001, 2024-09-12T22:48:55.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:48:55.450 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:55.450 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:55.450 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.451 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:55.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:55.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:55.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:55.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:55.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:55.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:55.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:48:55.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:55.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:48:55.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:48:55.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:55.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:48:55.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:48:55.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:48:55.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:48:55.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:55.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:48:55.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:48:55.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:55.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:48:55.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:48:55.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:55.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:48:55.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:48:55.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:55.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:48:55.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:48:55.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:55.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:48:55.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:48:55.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:55.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:48:55.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:48:55.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:55.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:48:55.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:48:55.456 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.456 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:55.456 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.456 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:55.456 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:55.456 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.227404516999997, 2024-09-12T22:48:55.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:48:55.456 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:55.456 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:55.456 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:55.456 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:55.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:55.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:55.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:55.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:55.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:55.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:55.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:48:55.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:55.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:48:55.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:48:55.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:55.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:48:55.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:48:55.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:48:55.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:48:55.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:55.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:48:55.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:48:55.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:55.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:48:55.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:48:55.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:55.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:48:55.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:48:55.460 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.460 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:55.460 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.460 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:55.460 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:55.461 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.227330021999997, 2024-09-12T22:48:55.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:48:55.461 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:55.461 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:55.461 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:55.461 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:55.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:55.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:55.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:55.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:55.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:55.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:48:55.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:48:55.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:55.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:48:55.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:48:55.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:55.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:48:55.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:48:55.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:48:55.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:48:55.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:55.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:48:55.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:48:55.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:55.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:48:55.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:48:55.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:55.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:48:55.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:48:55.464 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.464 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:55.464 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.465 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:55.465 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:55.465 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.227283993999997, 2024-09-12T22:48:55.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:48:55.465 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:55.465 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:55.465 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:55.465 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:55.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:55.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:55.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:55.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:55.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:55.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:48:55.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:48:55.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:55.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:48:55.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:48:55.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:55.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:48:55.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:48:55.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:48:55.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:48:55.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:55.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:48:55.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:48:55.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:55.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:48:55.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:48:55.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:55.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:48:55.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:48:55.469 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.469 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:55.469 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.469 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:55.469 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:55.470 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.225113110000002, 2024-09-12T22:48:55.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:48:55.470 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:55.470 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:55.470 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.470 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:55.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:55.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:55.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:55.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:55.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:55.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:55.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:48:55.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:55.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:48:55.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:48:55.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:55.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:48:55.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:48:55.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:55.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:48:55.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:55.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:48:55.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:48:55.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:55.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:55.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:48:55.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:55.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:48:55.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:48:55.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:55.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:48:55.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:48:55.475 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.475 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:55.476 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.476 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:55.476 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:55.476 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.225062659999999, 2024-09-12T22:48:55.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:48:55.476 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:55.476 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:55.476 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.476 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:55.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:55.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:55.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:55.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:55.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:55.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:48:55.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:48:55.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:55.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:48:55.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:48:55.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:55.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:48:55.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:48:55.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:48:55.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:48:55.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:55.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:48:55.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:48:55.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:55.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:48:55.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:48:55.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:55.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:48:55.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:48:55.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:55.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:48:55.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:48:55.482 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.482 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:55.482 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.483 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:55.483 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:55.483 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.225009221999997, 2024-09-12T22:48:55.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:48:55.483 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:55.483 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:55.483 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.483 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:55.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:55.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:55.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:55.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:55.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:55.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:55.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:48:55.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:55.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:48:55.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:48:55.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:55.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:55.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:48:55.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:48:55.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:48:55.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:55.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:48:55.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:48:55.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:55.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:48:55.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:48:55.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:55.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:48:55.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:48:55.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:55.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:48:55.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:48:55.487 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.487 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:55.487 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.487 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:48:55.487 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:55.487 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.221024868999997, 2024-09-12T22:48:55.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:48:55.488 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:55.488 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:55.488 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:55.488 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:55.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:55.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:55.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:55.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:55.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:55.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:48:55.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:48:55.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:55.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:48:55.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:48:55.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:55.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:48:55.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:48:55.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:48:55.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:48:55.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:55.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:48:55.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:48:55.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:55.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:48:55.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:48:55.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:55.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:48:55.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:48:55.492 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.492 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:55.492 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.492 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:48:55.492 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:55.492 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 48.235872329999999, 2024-09-12T22:48:55.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:48:55.492 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:55.492 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:55.492 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.493 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:55.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:55.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:55.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:55.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:55.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:55.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:48:55.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:48:55.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:55.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:48:55.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:48:55.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:55.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:48:55.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:48:55.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:48:55.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:48:55.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:55.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:48:55.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:48:55.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:55.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:48:55.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:48:55.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:55.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:48:55.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:48:55.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:55.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:48:55.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:48:55.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:55.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:48:55.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:48:55.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:55.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:48:55.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:48:55.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:55.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:48:55.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:48:55.498 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.498 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:55.498 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.498 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:48:55.498 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:55.498 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.233956084999999, 2024-09-12T22:48:55.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:48:55.498 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:55.498 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:55.499 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.499 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:55.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:55.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:55.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:55.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:55.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:55.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:48:55.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:48:55.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:55.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:48:55.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:48:55.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:55.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:48:55.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:48:55.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:48:55.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:48:55.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:55.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:48:55.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:48:55.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:55.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:48:55.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:48:55.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:55.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:48:55.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:48:55.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:55.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:48:55.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:48:55.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:55.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:48:55.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:48:55.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:55.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:48:55.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:48:55.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:55.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:48:55.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:48:55.503 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.504 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:55.504 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.504 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:48:55.504 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:55.504 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.23320271, 2024-09-12T22:48:55.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012160610000000001, 2024-09-12T22:48:55.504 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:55.504 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:55.504 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.504 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:55.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:55.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:55.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:55.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:55.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:55.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:55.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164967+0000", 2024-09-12T22:48:55.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:48:55.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:55.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164974+0000", 2024-09-12T22:48:55.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:48:55.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:55.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164987+0000", 2024-09-12T22:48:55.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3689000000000001e-05 2024-09-12T22:48:55.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164995+0000", 2024-09-12T22:48:55.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2959999999999999e-06 2024-09-12T22:48:55.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:55.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165068+0000", 2024-09-12T22:48:55.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2449999999999999e-05 2024-09-12T22:48:55.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:55.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165212+0000", 2024-09-12T22:48:55.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144117 2024-09-12T22:48:55.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:55.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166066+0000", 2024-09-12T22:48:55.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085441100000000002 2024-09-12T22:48:55.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:55.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166107+0000", 2024-09-12T22:48:55.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0450000000000001e-05 2024-09-12T22:48:55.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:55.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:55.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:55.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166181+0000", 2024-09-12T22:48:55.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-12T22:48:55.508 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.509 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:55.509 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.509 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:55.509 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:55.509 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:55.511 INFO:teuthology.orchestra.run.smithi066.stderr:nodeep-scrub is unset 2024-09-12T22:48:55.511 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:55.512 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:55.509+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:55.612 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:55.610+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:55.617 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:55.618 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:48:55.618 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:48:55.618 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:55.626 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:55.712 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:55.711+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:55.768 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:55.768 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:48:55.768 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:48:55.768 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:48:55.768 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:55.777 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:55.821 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:55.820+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:55.882 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:55.882 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:48:55.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:48:55.882 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:48:55.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.882 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:48:55.882 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:55.882 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 59.496123267000002, 2024-09-12T22:48:55.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:48:55.883 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:55.883 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:55.883 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.883 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:55.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.883 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:55.883 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:55.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.883 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:55.883 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:55.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:55.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:55.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:48:55.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:55.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:48:55.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:48:55.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:55.885 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:48:55.885 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:48:55.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.888 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:48:55.888 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:48:55.888 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.888 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.888 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:55.888 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:48:55.888 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:48:55.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.889 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.889 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:55.889 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:48:55.889 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:48:55.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.889 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.889 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:55.889 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:48:55.889 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:48:55.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.889 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.889 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:55.890 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:48:55.890 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:48:55.890 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.890 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:55.890 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.890 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.890 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:48:55.890 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:55.890 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 59.495680684, 2024-09-12T22:48:55.891 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:48:55.891 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:55.891 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:55.891 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.891 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:55.891 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.891 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:55.891 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:55.891 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.891 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.891 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:55.891 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:55.892 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.892 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.892 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.892 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:55.892 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:48:55.892 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:48:55.892 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.892 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.892 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:55.892 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:48:55.892 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:48:55.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.893 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:55.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:48:55.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:48:55.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.893 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:48:55.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:48:55.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.893 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:55.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:48:55.894 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:48:55.894 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.894 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.894 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:55.894 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:48:55.894 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:48:55.894 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.894 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.894 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:55.894 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:48:55.894 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:48:55.894 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.894 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.895 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:55.895 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:48:55.895 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:48:55.895 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.895 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:55.895 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.895 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.895 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.895 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:48:55.895 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:55.895 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 59.495314526999998, 2024-09-12T22:48:55.895 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:48:55.895 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:55.896 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:55.896 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.896 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:55.896 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.896 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:55.896 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:55.896 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.896 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.896 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.896 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:55.896 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:55.896 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.896 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.897 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:55.897 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:48:55.897 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:48:55.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.897 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:55.897 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:48:55.897 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:48:55.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.897 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:55.897 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:48:55.897 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:48:55.898 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.898 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.898 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.898 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:48:55.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:48:55.898 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.898 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.898 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:55.898 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:48:55.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:48:55.898 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.898 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.898 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:55.899 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:48:55.899 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:48:55.899 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.899 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:55.899 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:48:55.899 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:48:55.899 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.899 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:55.899 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:48:55.899 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:48:55.899 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.899 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:55.900 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.900 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.900 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.900 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:48:55.900 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:55.900 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 59.494902215000003, 2024-09-12T22:48:55.900 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:48:55.900 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:55.900 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:55.900 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.900 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:55.900 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.901 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:55.901 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:55.901 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.901 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.901 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.901 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:55.901 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:55.901 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.901 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.901 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.901 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:55.901 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:55.901 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:48:55.902 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.902 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.902 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:55.902 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:48:55.902 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:48:55.902 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.902 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.902 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:55.902 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:48:55.902 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:48:55.902 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.902 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.903 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.903 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:48:55.903 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:48:55.903 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.903 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.903 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:55.903 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:48:55.903 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:48:55.903 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.903 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.903 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:55.903 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:48:55.903 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:48:55.904 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.904 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.904 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:55.904 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:48:55.904 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:48:55.904 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.904 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.904 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:55.904 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:48:55.904 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:48:55.904 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.904 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:55.904 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.905 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.905 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.905 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:48:55.905 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:55.905 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 59.361052121, 2024-09-12T22:48:55.905 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:48:55.905 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:55.905 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:55.905 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.905 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:55.905 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.905 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:55.905 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:55.906 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.906 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.906 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.906 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:55.906 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:55.906 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.906 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.906 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.906 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:55.906 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:55.906 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:48:55.906 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.906 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.907 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:55.907 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:48:55.907 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:48:55.907 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.907 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.907 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:55.907 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:48:55.907 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:48:55.907 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.907 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.907 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.907 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:48:55.907 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:48:55.908 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.908 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.908 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:55.908 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:48:55.908 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:48:55.908 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.908 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.908 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:55.908 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:48:55.908 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:48:55.908 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.908 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.908 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:55.909 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:48:55.909 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:48:55.909 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.909 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.909 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:55.909 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:48:55.909 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:48:55.909 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.909 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:55.909 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.909 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.909 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.909 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:55.909 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:55.910 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 50.715816566999997, 2024-09-12T22:48:55.910 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:48:55.910 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:55.910 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:55.910 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.910 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:55.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.910 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:55.910 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:55.910 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.910 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.910 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:55.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:55.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.911 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:55.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:48:55.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:48:55.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.911 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:55.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:48:55.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:48:55.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.912 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.912 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:55.912 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:48:55.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:48:55.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.912 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.912 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.912 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:48:55.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:48:55.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.912 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.912 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:55.912 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:48:55.913 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:48:55.913 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.913 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.913 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:55.913 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:48:55.913 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:48:55.913 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.913 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.913 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:55.913 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:48:55.913 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:48:55.913 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.913 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.913 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:55.914 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:48:55.914 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:48:55.914 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.914 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.914 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:55.914 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:48:55.914 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:48:55.914 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.914 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.914 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:55.914 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:48:55.914 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:48:55.914 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.914 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.915 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:55.915 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:48:55.915 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:48:55.915 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.915 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.915 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:55.915 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:48:55.915 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:48:55.915 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.915 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.915 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:55.915 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:48:55.915 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:48:55.916 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.916 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:55.916 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.916 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.916 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.916 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:55.916 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:55.916 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 50.715717050000002, 2024-09-12T22:48:55.916 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:48:55.916 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:55.916 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:55.916 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.916 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:55.917 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.917 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:55.917 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:55.917 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.917 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.917 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.917 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:55.917 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:55.917 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.917 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.917 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.917 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:55.917 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:48:55.917 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:48:55.918 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.918 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.918 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:55.918 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:48:55.918 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:48:55.918 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.918 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.918 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:55.918 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:48:55.918 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:48:55.918 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.918 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.918 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.919 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:48:55.919 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:48:55.919 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.919 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.919 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:55.919 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:48:55.919 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:48:55.919 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.919 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.919 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:55.919 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:48:55.919 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:48:55.920 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.920 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.920 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:55.920 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:48:55.920 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:48:55.920 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.920 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.920 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:55.920 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:48:55.920 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:48:55.920 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.920 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.921 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:55.921 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:48:55.921 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:48:55.921 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.921 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.921 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:55.921 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:48:55.921 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:48:55.921 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.921 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.921 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:55.921 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:48:55.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:48:55.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.922 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.922 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:55.922 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:48:55.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:48:55.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.922 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.922 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:55.922 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:48:55.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:48:55.922 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.923 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:55.923 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.923 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.923 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.923 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:55.923 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:55.923 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 50.715672310999999, 2024-09-12T22:48:55.923 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:48:55.923 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:55.923 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:55.923 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.923 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:55.924 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.924 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:55.924 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:55.924 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.924 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.924 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.924 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:55.924 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:55.924 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.924 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.924 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.924 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:55.925 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:48:55.925 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:48:55.925 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.925 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.925 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:55.925 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:48:55.925 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:48:55.925 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.925 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.925 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:55.925 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:48:55.925 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:48:55.926 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.926 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.926 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.926 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:48:55.926 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:48:55.926 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.926 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.926 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:55.926 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:48:55.926 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:48:55.926 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.927 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.927 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:55.927 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:48:55.927 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:48:55.927 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.927 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.927 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:55.927 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:48:55.927 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:48:55.927 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.927 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.927 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:55.928 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:48:55.928 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:48:55.928 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.928 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.928 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:55.928 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:48:55.928 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:48:55.928 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.928 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.928 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:55.928 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:48:55.928 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:48:55.929 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.929 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.929 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:55.929 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:48:55.929 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:48:55.929 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.929 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.929 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:55.929 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:48:55.929 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:48:55.929 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.929 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.929 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:55.930 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:48:55.930 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:48:55.930 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.930 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:55.930 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.930 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.930 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.930 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:55.930 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:55.930 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 50.715444609999999, 2024-09-12T22:48:55.930 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:48:55.930 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:55.930 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:55.931 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.931 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:55.931 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.931 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:55.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:55.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.931 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.931 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.931 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:55.932 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:55.932 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.932 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.932 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.932 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:55.932 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:48:55.932 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:48:55.932 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.932 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.932 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:55.932 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:48:55.932 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:48:55.932 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.932 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.933 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:55.933 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:48:55.933 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:48:55.933 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.933 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.933 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.933 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:48:55.933 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:48:55.933 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.933 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.933 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:55.933 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:48:55.933 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:48:55.934 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.934 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.934 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:55.934 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:48:55.934 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:48:55.934 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.934 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.934 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:55.934 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:48:55.934 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:48:55.934 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.934 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.934 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:55.935 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:48:55.935 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:48:55.935 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.935 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.935 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:55.935 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:48:55.935 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:48:55.935 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.935 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.935 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:55.935 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:48:55.935 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:48:55.935 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.936 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.936 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:55.936 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:48:55.936 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:48:55.936 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.936 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.936 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:55.936 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:48:55.936 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:48:55.936 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.936 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.936 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:55.936 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:48:55.937 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:48:55.937 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.937 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:55.937 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.937 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.937 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.937 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:55.937 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:55.937 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 50.715279502000001, 2024-09-12T22:48:55.937 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:48:55.937 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:55.937 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:55.937 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.937 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:55.938 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.938 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:55.938 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:55.938 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.938 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.938 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.938 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:55.938 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:55.938 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.938 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.938 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.938 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:55.939 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:48:55.939 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:48:55.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.939 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.939 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:55.939 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:48:55.939 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:48:55.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.939 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.939 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:55.939 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:48:55.939 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:48:55.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.940 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.940 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.940 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:48:55.940 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:48:55.940 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.940 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.940 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:55.940 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:48:55.940 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:48:55.940 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.940 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.940 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:55.941 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:48:55.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:48:55.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.941 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.941 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:55.941 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:48:55.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:48:55.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.941 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.941 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:55.941 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:48:55.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:48:55.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.942 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.942 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:55.942 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:48:55.942 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:48:55.942 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.942 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.942 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:55.942 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:48:55.942 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:48:55.942 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.942 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.942 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:55.942 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:48:55.942 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:48:55.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.943 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:55.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:48:55.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:48:55.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.943 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:55.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:48:55.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:48:55.943 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.943 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:55.943 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.944 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.944 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:55.944 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:55.944 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 50.715218217, 2024-09-12T22:48:55.944 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:48:55.944 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:55.944 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:55.944 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.944 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:55.944 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.944 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:55.945 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:55.945 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.945 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.945 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.945 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:55.945 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:55.945 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.945 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.945 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.945 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:55.945 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:55.945 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:48:55.945 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.946 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.946 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:55.946 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:48:55.946 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:48:55.946 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.946 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.946 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:55.946 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:48:55.946 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:48:55.946 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.946 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.946 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.946 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:48:55.946 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:48:55.947 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.947 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.947 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:55.947 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:48:55.947 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:48:55.947 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.947 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.947 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:55.947 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:48:55.947 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:48:55.947 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.947 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.948 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:55.948 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:48:55.948 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:48:55.948 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.948 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.948 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:55.948 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:48:55.948 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:48:55.948 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.948 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.948 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:55.948 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:48:55.948 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:48:55.949 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.949 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.949 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:55.949 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:48:55.949 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:48:55.949 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.949 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.949 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:55.949 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:48:55.949 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:48:55.949 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.949 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.949 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:55.950 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:48:55.950 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:48:55.950 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.950 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.950 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:55.950 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:48:55.950 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:48:55.950 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.950 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:55.950 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.950 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.950 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.950 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:55.951 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:55.951 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 50.715138109000002, 2024-09-12T22:48:55.951 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:48:55.951 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:55.951 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:55.951 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.951 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:55.951 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.951 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:55.951 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:55.951 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.951 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.951 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.951 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:55.952 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:55.952 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.952 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.952 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.952 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:55.952 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:48:55.952 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:48:55.952 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.952 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.952 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:55.952 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:48:55.952 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:48:55.952 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.953 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.953 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:55.953 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:48:55.953 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:48:55.953 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.953 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.953 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.953 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:48:55.953 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:48:55.953 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.953 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.953 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:55.953 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:48:55.954 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:48:55.954 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.954 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.954 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:55.954 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:48:55.954 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:48:55.954 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.954 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.954 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:55.954 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:48:55.954 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:48:55.954 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.954 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.955 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:55.955 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:48:55.955 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:48:55.955 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.955 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.955 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:55.955 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:48:55.955 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:48:55.955 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.955 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.955 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:55.955 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:48:55.955 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:48:55.956 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.956 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.956 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:55.956 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:48:55.956 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:48:55.956 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.956 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.956 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:55.956 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:48:55.956 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:48:55.956 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.956 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.956 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:55.956 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:48:55.957 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:48:55.957 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.957 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:55.957 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.957 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.957 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.957 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:55.957 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:55.957 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 50.715089155999998, 2024-09-12T22:48:55.957 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:48:55.957 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:55.957 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:55.957 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:48:55.957 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:55.958 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.958 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:55.958 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:55.958 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.958 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.958 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.958 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:55.958 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:55.958 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.958 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.958 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.958 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:55.958 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:55.959 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:48:55.959 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.959 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.959 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:55.959 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:48:55.959 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:48:55.959 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.959 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.959 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:55.959 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:48:55.959 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:48:55.959 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.959 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.960 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.960 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:48:55.960 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:48:55.960 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.960 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.960 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:55.960 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:48:55.960 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:48:55.960 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.960 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.960 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:55.961 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:48:55.961 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:48:55.961 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.961 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.961 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:55.961 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:48:55.961 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:48:55.961 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.961 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:55.961 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.961 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.961 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.961 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:55.962 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:55.962 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 50.715040055999999, 2024-09-12T22:48:55.962 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:48:55.962 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:55.962 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:55.962 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:48:55.962 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:55.962 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.962 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:55.962 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:55.962 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.962 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.962 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.963 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:55.963 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:55.963 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.963 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.963 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.963 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:55.963 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:48:55.963 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:48:55.963 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.963 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.963 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:55.963 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:48:55.963 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:48:55.964 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.964 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.964 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:55.964 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:48:55.964 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:48:55.964 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.964 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.964 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.964 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:48:55.964 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:48:55.964 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.964 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.964 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:55.965 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:48:55.965 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:48:55.965 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.965 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.965 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:55.965 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:48:55.965 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:48:55.965 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.965 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.965 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:55.965 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:48:55.965 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:48:55.966 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.966 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:55.966 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.966 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.966 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.966 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:55.966 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:55.966 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 50.708099605999998, 2024-09-12T22:48:55.966 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:48:55.966 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:55.966 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:55.966 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.966 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:55.967 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.967 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:55.967 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:55.967 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.967 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.967 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.967 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:55.967 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:55.967 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.967 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.967 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.967 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:55.968 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:48:55.968 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:48:55.968 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.968 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.968 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:55.968 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:48:55.968 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:48:55.968 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.968 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.968 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:55.968 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:48:55.968 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:48:55.968 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.969 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.969 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.969 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:48:55.969 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:48:55.969 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.969 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.969 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:55.969 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:48:55.969 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:48:55.969 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.969 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.969 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:55.969 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:48:55.970 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:48:55.970 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.970 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.970 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:55.970 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:48:55.970 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:48:55.970 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.970 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.970 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:55.970 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:48:55.970 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:48:55.970 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.970 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:55.971 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.971 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.971 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.971 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:55.971 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:55.971 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 50.707010766000003, 2024-09-12T22:48:55.971 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:48:55.971 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:55.971 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:55.971 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.971 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:55.971 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.971 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:55.971 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:55.972 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.972 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.972 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.972 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:55.972 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:55.972 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.972 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.972 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.972 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:55.972 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:48:55.972 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:48:55.972 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.972 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.972 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:55.973 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:48:55.973 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:48:55.973 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.973 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.973 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:55.973 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:48:55.973 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:48:55.973 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.973 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.973 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.973 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:48:55.973 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:48:55.973 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.974 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.974 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:55.974 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:48:55.974 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:48:55.974 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.974 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.974 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:55.974 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:48:55.974 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:48:55.974 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.974 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.974 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:55.974 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:48:55.975 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:48:55.975 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.975 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.975 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:55.975 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:48:55.975 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:48:55.975 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.975 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:55.975 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.975 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.975 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.975 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:55.975 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:55.976 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 50.706961155000002, 2024-09-12T22:48:55.976 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:48:55.976 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:55.976 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:55.976 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.976 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:55.976 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.976 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:55.976 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:55.976 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.976 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.976 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.977 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:55.977 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:55.977 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.977 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.977 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.977 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:55.977 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:55.977 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:48:55.977 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.977 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.977 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:55.977 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:55.978 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:48:55.978 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.978 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.978 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:55.978 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:48:55.978 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:48:55.978 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.978 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.978 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.978 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:48:55.978 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:48:55.978 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.978 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.978 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:55.979 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:48:55.979 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:48:55.979 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.979 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.979 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:55.979 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:48:55.979 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:48:55.979 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.979 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.979 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:55.979 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:48:55.979 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:48:55.979 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.980 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.980 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:55.980 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:48:55.980 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:48:55.980 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.980 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:55.980 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.980 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.980 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.980 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:55.980 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:55.980 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 50.706893846, 2024-09-12T22:48:55.980 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:48:55.981 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:55.981 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:55.981 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.981 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:55.981 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.981 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:55.981 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:55.981 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.981 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.981 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.981 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:55.981 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:55.981 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.981 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.982 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.982 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:55.982 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:55.982 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:48:55.982 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.982 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.982 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:55.982 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:48:55.982 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:48:55.982 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.982 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.982 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:55.982 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:48:55.983 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:48:55.983 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.983 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.983 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.983 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:48:55.983 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:48:55.983 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.983 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.983 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:55.983 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:48:55.983 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:48:55.983 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.983 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.984 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:55.984 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:48:55.984 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:48:55.984 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.984 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.984 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:55.984 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:48:55.984 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:48:55.984 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.984 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.984 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:55.984 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:48:55.984 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:48:55.985 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.985 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:55.985 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.985 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.985 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.985 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:55.985 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:55.985 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 50.706325927000002, 2024-09-12T22:48:55.985 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:48:55.985 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:55.985 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:55.985 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.985 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:55.985 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.986 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:55.986 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:55.986 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.986 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.986 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.986 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:55.986 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:55.986 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.986 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.986 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.986 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:55.986 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:55.986 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:48:55.987 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.987 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.987 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:55.987 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:48:55.987 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:48:55.987 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.987 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.987 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:55.987 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:48:55.987 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:48:55.987 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.987 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.987 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.987 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:48:55.988 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:48:55.988 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.988 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.988 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:55.988 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:48:55.988 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:48:55.988 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.988 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.988 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:55.988 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:48:55.988 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:48:55.988 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.989 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.989 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:55.989 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:48:55.989 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:48:55.989 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.989 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.989 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:55.989 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:48:55.989 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:48:55.989 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.989 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:55.989 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.989 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.990 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.990 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:48:55.990 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:55.990 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 50.705948323000001, 2024-09-12T22:48:55.990 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:48:55.990 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:55.990 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:55.990 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:55.990 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:55.990 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.990 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:55.990 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:55.991 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.991 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.991 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.991 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:55.991 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:55.991 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:55.991 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.991 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.991 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:55.991 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:48:55.991 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:48:55.991 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.991 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.992 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:55.992 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:48:55.992 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:48:55.992 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.992 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.992 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:55.992 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:48:55.992 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:48:55.992 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.992 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.992 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:55.992 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:48:55.992 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:48:55.993 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.993 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:55.993 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:48:55.993 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:48:55.993 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.993 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:55.993 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:48:55.993 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:48:55.993 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.993 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:55.993 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:48:55.994 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:48:55.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:55.994 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:55.994 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:55.994 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:48:55.994 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:48:55.994 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.994 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:55.994 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.994 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:55.994 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:55.994 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:55.996 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:55.997 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:55.994+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:56.097 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:56.096+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:56.100 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:56.100 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:48:56.101 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:48:56.101 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:56.109 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:56.198 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:56.197+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:56.210 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:56.210 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:48:56.210 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:48:56.210 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:48:56.210 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:56.219 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:56.299 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:56.298+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:56.322 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:56.322 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:48:56.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:48:56.322 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:48:56.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.322 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:48:56.322 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:56.322 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 56.274024349999998, 2024-09-12T22:48:56.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:48:56.322 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:56.322 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:56.322 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:56.323 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:56.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:56.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:56.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:56.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:56.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:56.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:56.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:48:56.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:56.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:48:56.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:48:56.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:56.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:48:56.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:48:56.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:48:56.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:48:56.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:56.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:48:56.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:48:56.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:56.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:48:56.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:48:56.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:56.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:48:56.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:48:56.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:56.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:48:56.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:48:56.327 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.327 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:56.327 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.327 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:48:56.327 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:56.327 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.273643622999998, 2024-09-12T22:48:56.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:48:56.327 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:56.327 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:56.327 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:56.328 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:56.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:56.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:56.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:56.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:56.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:56.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:48:56.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:48:56.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:56.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:48:56.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:48:56.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:56.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:48:56.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:48:56.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:48:56.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:48:56.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:56.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:48:56.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:48:56.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:56.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:48:56.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:48:56.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:56.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:48:56.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:48:56.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:56.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:48:56.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:48:56.331 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.331 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:56.332 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.332 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:48:56.332 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:56.332 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.153046813000003, 2024-09-12T22:48:56.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:48:56.332 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:56.332 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:56.332 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:48:56.332 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:56.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:56.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:56.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:56.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:56.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:56.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:56.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:48:56.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:56.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:48:56.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:48:56.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:56.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:48:56.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:48:56.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:48:56.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:48:56.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:56.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:48:56.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:48:56.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:56.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:48:56.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:48:56.336 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.336 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:56.336 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.336 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:56.337 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:56.337 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.150438633, 2024-09-12T22:48:56.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:48:56.337 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:56.337 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:56.337 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:56.337 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:56.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:56.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:56.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:56.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:56.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:56.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:48:56.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:48:56.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:56.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:48:56.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:48:56.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:56.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:48:56.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:48:56.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:48:56.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:48:56.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:56.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:48:56.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:48:56.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:56.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:48:56.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:48:56.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:56.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:48:56.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:48:56.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:56.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:48:56.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:48:56.341 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.341 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:56.341 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.341 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:56.341 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:56.341 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.149545410000002, 2024-09-12T22:48:56.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:48:56.342 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:56.342 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:56.342 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:56.342 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:56.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:56.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:56.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:56.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:56.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:56.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:48:56.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:48:56.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:56.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:48:56.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:48:56.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:56.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:48:56.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:48:56.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:48:56.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:48:56.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:56.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:48:56.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:48:56.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:56.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:48:56.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:48:56.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:56.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:48:56.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:48:56.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:56.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:48:56.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:48:56.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:56.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:48:56.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:48:56.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:56.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:48:56.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:48:56.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:56.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:48:56.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:48:56.347 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.347 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:56.347 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.347 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:56.347 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:56.347 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.149473751999999, 2024-09-12T22:48:56.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:48:56.347 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:56.347 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:56.347 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:56.347 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:56.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:56.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:56.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:56.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:56.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:56.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:48:56.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:48:56.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:56.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:48:56.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:48:56.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:56.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:48:56.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:48:56.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:48:56.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:48:56.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:56.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:48:56.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:48:56.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:56.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:48:56.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:48:56.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:56.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:48:56.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:48:56.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:56.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:48:56.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:48:56.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:56.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:48:56.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:48:56.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:56.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:48:56.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:48:56.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:56.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:48:56.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:48:56.352 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.352 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:56.352 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.353 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:56.353 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:56.353 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.149431034000003, 2024-09-12T22:48:56.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:48:56.353 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:56.353 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:56.353 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:56.353 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:56.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:56.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:56.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:56.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:56.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:56.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:48:56.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:48:56.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:56.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:48:56.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:48:56.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:56.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:48:56.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:48:56.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:48:56.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:48:56.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:56.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:48:56.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:48:56.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:56.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:48:56.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:48:56.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:56.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:48:56.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:48:56.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:56.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:48:56.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:48:56.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:56.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:48:56.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:48:56.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:56.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:48:56.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:48:56.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:56.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:48:56.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:48:56.358 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.358 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:56.358 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.358 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:56.359 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:56.359 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.149393117000002, 2024-09-12T22:48:56.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:48:56.359 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:56.359 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:56.359 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:56.359 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:56.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:56.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:56.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:56.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:56.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:56.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:48:56.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:48:56.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:56.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:48:56.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:48:56.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:56.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:48:56.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:48:56.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:48:56.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:48:56.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:56.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:48:56.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:48:56.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:56.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:48:56.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:48:56.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:56.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:56.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:48:56.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:56.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:48:56.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:48:56.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:56.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:48:56.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:48:56.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:56.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:48:56.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:48:56.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:56.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:48:56.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:48:56.364 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.364 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:56.364 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.365 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:56.365 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:56.365 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.149369665999998, 2024-09-12T22:48:56.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:48:56.365 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:56.365 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:56.365 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:56.365 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:56.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:56.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:56.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:56.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:56.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:56.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:48:56.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:48:56.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:56.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:48:56.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:48:56.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:56.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:48:56.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:48:56.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:48:56.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:48:56.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:56.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:48:56.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:48:56.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:56.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:48:56.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:48:56.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:56.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:56.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:48:56.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:56.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:48:56.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:48:56.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:56.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:48:56.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:48:56.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:56.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:48:56.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:48:56.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:56.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:48:56.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:48:56.370 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.370 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:56.370 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.370 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:56.370 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:56.370 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.149345429, 2024-09-12T22:48:56.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:48:56.370 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:56.370 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:56.371 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:56.371 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:56.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:56.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:56.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:56.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:56.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:56.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:56.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:48:56.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:56.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:48:56.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:48:56.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:56.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:48:56.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:48:56.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:48:56.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:48:56.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:56.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:48:56.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:48:56.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:56.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:48:56.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:48:56.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:56.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:48:56.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:48:56.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:56.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:48:56.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:48:56.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:56.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:48:56.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:48:56.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:56.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:48:56.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:48:56.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:56.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:48:56.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:48:56.376 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.376 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:56.376 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.376 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:56.376 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:56.376 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.149317512000003, 2024-09-12T22:48:56.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:48:56.377 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:56.377 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:56.377 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:56.377 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:56.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:56.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:56.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:56.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:56.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:56.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:56.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:48:56.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:56.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:48:56.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:48:56.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:56.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:48:56.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:48:56.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:48:56.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:48:56.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:56.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:48:56.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:48:56.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:56.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:48:56.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:48:56.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:56.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:48:56.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:48:56.380 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.380 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:56.380 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.380 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:56.380 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:56.380 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.149243017000003, 2024-09-12T22:48:56.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:48:56.381 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:56.381 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:56.381 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:56.381 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:56.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:56.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:56.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:56.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:56.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:56.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:48:56.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:48:56.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:56.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:48:56.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:48:56.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:56.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:48:56.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:48:56.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:48:56.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:48:56.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:56.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:48:56.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:48:56.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:56.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:48:56.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:48:56.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:56.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:48:56.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:48:56.384 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.384 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:56.384 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.385 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:56.385 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:56.385 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.149196989000004, 2024-09-12T22:48:56.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:48:56.385 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:56.385 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:56.385 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:56.385 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:56.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:56.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:56.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:56.386 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:56.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:56.386 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:48:56.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:48:56.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:56.386 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:48:56.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:48:56.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:56.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:48:56.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:48:56.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:48:56.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:48:56.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:56.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:48:56.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:48:56.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:56.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:48:56.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:48:56.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:56.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:48:56.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:48:56.389 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.389 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:56.389 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.389 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:56.389 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:56.389 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.147026105000002, 2024-09-12T22:48:56.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:48:56.389 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:56.389 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:56.390 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:56.390 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:56.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:56.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:56.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:56.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:56.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:56.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:56.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:48:56.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:56.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:48:56.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:48:56.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:56.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:48:56.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:48:56.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:56.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:48:56.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:56.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:48:56.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:48:56.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:56.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:56.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:48:56.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:56.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:48:56.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:48:56.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:56.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:48:56.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:48:56.394 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.394 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:56.394 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.394 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:56.394 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:56.394 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.146975654999999, 2024-09-12T22:48:56.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:48:56.394 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:56.394 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:56.394 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:56.394 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:56.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:56.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:56.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:56.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:56.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:56.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:48:56.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:48:56.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:56.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:48:56.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:48:56.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:56.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:48:56.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:48:56.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:48:56.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:48:56.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:56.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:48:56.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:48:56.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:56.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:48:56.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:48:56.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:56.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:48:56.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:48:56.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:56.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:48:56.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:48:56.398 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.398 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:56.398 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.399 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:56.399 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:56.399 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.146922216999997, 2024-09-12T22:48:56.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:48:56.399 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:56.399 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:56.399 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:56.399 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:56.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:56.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:56.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:56.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:56.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:56.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:56.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:48:56.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:56.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:48:56.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:48:56.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:56.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:56.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:48:56.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:48:56.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:48:56.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:56.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:48:56.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:48:56.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:56.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:48:56.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:48:56.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:56.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:48:56.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:48:56.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:56.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:48:56.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:48:56.403 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.403 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:56.403 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.403 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:48:56.403 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:56.403 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.142937863999997, 2024-09-12T22:48:56.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:48:56.403 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:56.404 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:56.404 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:56.404 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:56.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:56.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:56.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:56.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:56.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:56.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:48:56.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:48:56.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:56.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:48:56.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:48:56.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:56.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:48:56.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:48:56.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:48:56.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:48:56.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:56.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:48:56.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:48:56.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:56.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:48:56.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:48:56.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:56.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:48:56.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:48:56.407 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.407 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:56.407 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.408 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:48:56.408 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:56.408 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 49.157785324999999, 2024-09-12T22:48:56.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:48:56.408 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:56.408 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:56.408 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:56.408 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:56.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:56.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:56.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:56.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:56.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:56.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:48:56.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:48:56.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:56.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:48:56.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:48:56.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:56.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:48:56.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:48:56.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:48:56.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:48:56.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:56.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:48:56.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:48:56.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:56.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:48:56.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:48:56.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:56.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:48:56.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:48:56.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:56.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:48:56.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:48:56.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:56.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:48:56.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:48:56.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:56.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:48:56.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:48:56.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:56.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:48:56.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:48:56.413 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.413 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:56.413 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.413 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:48:56.414 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:56.414 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 31.155869079999999, 2024-09-12T22:48:56.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:48:56.414 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:56.414 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:56.414 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:56.414 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:56.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:56.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:56.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:56.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:56.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:56.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:48:56.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:48:56.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:56.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:48:56.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:48:56.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:56.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:48:56.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:48:56.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:48:56.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:48:56.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:56.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:48:56.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:48:56.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:56.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:48:56.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:48:56.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:56.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:48:56.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:48:56.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:56.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:48:56.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:48:56.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:56.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:48:56.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:48:56.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:56.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:48:56.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:48:56.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:56.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:48:56.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:48:56.419 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.419 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:56.419 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.419 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:48:56.419 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:56.419 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.155115705, 2024-09-12T22:48:56.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012160610000000001, 2024-09-12T22:48:56.420 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:56.420 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:56.420 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:56.420 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:56.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:56.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:56.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:56.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:56.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:56.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:56.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164967+0000", 2024-09-12T22:48:56.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:48:56.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:56.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164974+0000", 2024-09-12T22:48:56.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:48:56.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:56.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164987+0000", 2024-09-12T22:48:56.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3689000000000001e-05 2024-09-12T22:48:56.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164995+0000", 2024-09-12T22:48:56.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2959999999999999e-06 2024-09-12T22:48:56.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:56.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165068+0000", 2024-09-12T22:48:56.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2449999999999999e-05 2024-09-12T22:48:56.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:56.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165212+0000", 2024-09-12T22:48:56.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144117 2024-09-12T22:48:56.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:56.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166066+0000", 2024-09-12T22:48:56.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085441100000000002 2024-09-12T22:48:56.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:56.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166107+0000", 2024-09-12T22:48:56.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0450000000000001e-05 2024-09-12T22:48:56.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:56.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:56.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:56.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166181+0000", 2024-09-12T22:48:56.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-12T22:48:56.424 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.424 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:56.424 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.424 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:56.424 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:56.424 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:56.426 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:56.427 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:56.425+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:56.527 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:56.526+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:56.532 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:56.532 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:48:56.532 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:48:56.532 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:56.541 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:56.626 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:48:56.628 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:56.627+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:56.642 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:56.643 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:48:56.643 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:48:56.643 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:48:56.643 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:56.651 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:56.729 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:56.727+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:56.755 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:56.755 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:48:56.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:48:56.755 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:48:56.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.755 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:48:56.755 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:56.756 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 60.369282869999999, 2024-09-12T22:48:56.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:48:56.756 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:56.756 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:56.756 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:56.756 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:56.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:56.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:56.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:56.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:56.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:56.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:56.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:48:56.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:56.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:48:56.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:48:56.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:56.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:48:56.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:48:56.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:48:56.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:48:56.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:56.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:48:56.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:48:56.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:56.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:48:56.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:48:56.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:56.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:48:56.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:48:56.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:56.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:48:56.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:48:56.760 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.760 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:56.760 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.761 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:48:56.761 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:56.761 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 60.368840286999998, 2024-09-12T22:48:56.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:48:56.761 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:56.761 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:56.761 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:56.761 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:56.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:56.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:56.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:56.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:56.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:56.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:48:56.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:48:56.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:56.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:48:56.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:48:56.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:56.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:48:56.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:48:56.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:48:56.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:48:56.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:56.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:48:56.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:48:56.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:56.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:48:56.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:48:56.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:56.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:48:56.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:48:56.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:56.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:48:56.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:48:56.765 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.765 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:56.765 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.765 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:48:56.765 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:56.765 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 60.368474130000003, 2024-09-12T22:48:56.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:48:56.766 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:56.766 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:56.766 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:56.766 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:56.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:56.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:56.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:56.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:56.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:56.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:48:56.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:48:56.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:56.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:48:56.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:48:56.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:56.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:48:56.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:48:56.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:48:56.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:48:56.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:56.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:48:56.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:48:56.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:56.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:48:56.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:48:56.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:56.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:48:56.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:48:56.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:56.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:48:56.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:48:56.770 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.770 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:56.770 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.770 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:48:56.770 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:56.770 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 60.368061818000001, 2024-09-12T22:48:56.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:48:56.770 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:56.770 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:56.770 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:56.771 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:56.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:56.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:56.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:56.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:56.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:56.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:56.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:48:56.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:56.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:48:56.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:48:56.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:56.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:48:56.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:48:56.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:48:56.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:48:56.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:56.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:48:56.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:48:56.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:56.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:48:56.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:48:56.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:56.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:48:56.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:48:56.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:56.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:48:56.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:48:56.774 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.774 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:56.775 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.775 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:48:56.775 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:56.775 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 60.234211723999998, 2024-09-12T22:48:56.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:48:56.775 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:56.775 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:56.775 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:56.775 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:56.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:56.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:56.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:56.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:56.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:48:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:48:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:48:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:48:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:48:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:48:56.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:48:56.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:56.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:48:56.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:48:56.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:48:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:48:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:48:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:48:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:48:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:48:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 51.588976170000002, 2024-09-12T22:48:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:48:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:48:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:48:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:48:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:48:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:48:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:48:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:48:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:48:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:48:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:48:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:48:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:48:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:48:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:48:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:48:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:48:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:48:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:48:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:48:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:48:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:48:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:48:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:48:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:48:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:48:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:48:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 51.588876653, 2024-09-12T22:48:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:48:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:48:56.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:48:56.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:56.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:48:56.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:48:56.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:56.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:48:56.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:48:56.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:48:56.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:48:56.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:56.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:48:56.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:48:56.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:56.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:48:56.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:48:56.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:56.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:48:56.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:48:56.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:56.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:48:56.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:48:56.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:48:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:48:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:48:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:48:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:48:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:48:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:48:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:48:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:48:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:48:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 51.588831913999996, 2024-09-12T22:48:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:48:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:48:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:48:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:48:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:48:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:48:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:48:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:48:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:48:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:48:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:48:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:48:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:48:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:48:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:48:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:48:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:48:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:48:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:48:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:48:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:48:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:48:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:48:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:48:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:48:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:48:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:48:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 51.588604212999996, 2024-09-12T22:48:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:48:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:56.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:48:56.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:48:56.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:56.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:48:56.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:48:56.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:56.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:48:56.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:48:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:48:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:48:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:48:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:48:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:48:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:48:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:48:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:48:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:48:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:48:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:48:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:48:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:48:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:48:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:48:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:48:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:48:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:48:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:48:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:48:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 51.588439104999999, 2024-09-12T22:48:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:48:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:48:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:48:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:48:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:48:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:48:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:48:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:48:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:48:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:48:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:48:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:48:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:48:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:48:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:48:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:48:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:48:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:48:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:48:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:48:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:48:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:48:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:48:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:48:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:48:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:48:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:48:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 51.588377819999998, 2024-09-12T22:48:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:48:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:48:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:48:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:48:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:48:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:48:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:48:56.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:48:56.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:56.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:48:56.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:48:56.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:56.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:48:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:48:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:48:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:48:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:48:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:48:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:48:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:48:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:48:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:48:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:48:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:48:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:48:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:48:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:48:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:48:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 51.588297711999999, 2024-09-12T22:48:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:48:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:48:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:48:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:48:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:48:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:48:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:48:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:48:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:48:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:48:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:48:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:48:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:48:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:48:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:48:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:48:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:48:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:48:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:48:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:48:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:48:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:48:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:48:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:48:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:48:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:48:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:48:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 51.588248759000003, 2024-09-12T22:48:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:48:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:48:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:48:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:48:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:48:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:48:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:48:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:48:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:48:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:48:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:48:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:48:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:48:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:48:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:48:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 51.588199658999997, 2024-09-12T22:48:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:48:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:48:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:48:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:48:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:48:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:48:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:48:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:48:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:48:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:48:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:48:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:48:56.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:56.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:48:56.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:48:56.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:48:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:48:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 51.581259209000002, 2024-09-12T22:48:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:48:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:56.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:48:56.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:48:56.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:56.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:48:56.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:48:56.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:48:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:48:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:48:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:48:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:48:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:48:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:48:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:48:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:48:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:48:56.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:56.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:48:56.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:48:56.841 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.841 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:56.841 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.842 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:56.842 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:56.842 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 51.580170369000001, 2024-09-12T22:48:56.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:48:56.842 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:56.842 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:56.842 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:56.842 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:56.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:48:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:48:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:48:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:48:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:48:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:48:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:48:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:48:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:48:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:48:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:48:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:48:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:48:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:48:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:48:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:48:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 51.580120758, 2024-09-12T22:48:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:48:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:48:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:48:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:48:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:48:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:48:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:48:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:48:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:48:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:48:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:48:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:48:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:48:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:48:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:48:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 51.580053448999998, 2024-09-12T22:48:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:48:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:48:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:48:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:48:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:48:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:48:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:48:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:48:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:48:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:48:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:48:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:48:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:48:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:48:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:48:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:48:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 51.579485529999999, 2024-09-12T22:48:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:48:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:48:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:48:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:48:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:48:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:48:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:48:56.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:48:56.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:56.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:48:56.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:48:56.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:56.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:48:56.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:48:56.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:56.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:48:56.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:48:56.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:56.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:48:56.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:48:56.860 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.860 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:56.860 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.860 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:48:56.860 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:56.861 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 51.579107925999999, 2024-09-12T22:48:56.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:48:56.861 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:56.861 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:56.861 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:56.861 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:56.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:56.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:56.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:56.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:56.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:56.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:56.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:48:56.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:48:56.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:56.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:48:56.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:48:56.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:56.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:48:56.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:48:56.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:56.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:48:56.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:48:56.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:56.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:48:56.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:48:56.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:56.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:48:56.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:48:56.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:56.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:48:56.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:48:56.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:56.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:56.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:56.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:48:56.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:48:56.865 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.865 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:56.865 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.865 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:56.865 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:56.865 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:56.866 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:48:56.867 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:48:56.867 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:48:56.868 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:56.868 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:56.865+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:56.869 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:48:56.869 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:48:56.869 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:48:56.869 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:48:56.968 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:56.967+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:56.975 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:56.975 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:56.984 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:57.068 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:57.067+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:57.086 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:57.087 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:57.095 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:57.179 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:57.178+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:57.238 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:57.238 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:57.247 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:57.295 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:57.294+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:57.353 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:57.353 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:57.362 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:57.403 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:57.402+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:57.471 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:57.470+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:57.504 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:57.505 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:57.512 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:48:57.513 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:57.572 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:57.571+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:57.615 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:57.615 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:57.624 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:57.673 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:57.672+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:57.727 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:57.727 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:57.736 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:57.774 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:57.773+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:57.838 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:57.838 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:57.847 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:57.891 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:57.890+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:57.949 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:57.949 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:57.959 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:58.004 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:58.003+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:58.063 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:58.063 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:58.071 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:58.077 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:58.076+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:58.178 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:58.178+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:58.213 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:58.213 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:58.222 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:58.279 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:58.278+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:58.325 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:58.325 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:58.334 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:58.380 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:58.379+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:58.439 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:58.439 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:58.448 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:58.468 INFO:teuthology.orchestra.run.smithi066.stderr:noscrub is set 2024-09-12T22:48:58.482 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:58.480+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:58.550 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:58.550 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:58.559 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:58.603 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:58.602+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:58.661 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:58.662 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:58.670 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:58.711 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:58.710+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:58.773 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:58.774 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:58.783 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:58.784 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:58.782+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:58.871 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:48:58.883 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:58.883+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:58.927 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:48:58.927 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:48:58.936 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:58.985 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:58.984+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:59.001 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:48:59.001 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:48:59.019 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:48:59.019 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:48:59.020 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:48:59.023 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:48:59.023 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:48:59.081 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:59.081 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:48:59.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:48:59.081 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:48:59.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.081 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:48:59.081 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:59.081 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 62.695068165000002, 2024-09-12T22:48:59.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:48:59.082 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:59.082 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:59.082 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:59.082 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:59.082 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.082 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:59.082 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:59.082 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.082 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.082 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:59.082 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:59.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.083 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:59.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:59.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:48:59.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.083 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:59.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:48:59.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:48:59.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:59.084 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:48:59.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:48:59.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.084 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:48:59.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:48:59.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:59.084 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:48:59.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:48:59.085 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.085 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.085 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:59.085 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:48:59.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:48:59.085 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.085 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.085 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:59.085 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:48:59.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:48:59.085 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.085 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.085 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:59.086 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:48:59.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:48:59.086 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.086 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:59.086 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.086 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:48:59.086 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:59.086 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 62.694625582, 2024-09-12T22:48:59.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:48:59.086 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:59.086 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:59.087 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:59.087 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:59.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:59.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:59.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:59.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:59.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:59.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:48:59.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:48:59.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:59.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:48:59.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:48:59.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:59.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:48:59.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:48:59.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:48:59.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:48:59.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:59.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:48:59.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:48:59.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:59.090 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:48:59.090 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:48:59.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.090 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:59.090 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:48:59.090 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:48:59.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.090 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:59.090 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:48:59.090 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:48:59.091 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.091 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:59.091 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.091 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.091 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.091 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:48:59.091 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:59.091 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 62.694259424999998, 2024-09-12T22:48:59.091 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:48:59.091 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:59.091 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:59.091 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:59.091 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:59.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:59.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:59.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:59.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:48:59.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:59.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:48:59.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:48:59.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:59.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:48:59.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:48:59.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:59.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:48:59.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:48:59.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:48:59.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:48:59.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:59.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:48:59.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:48:59.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:59.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:48:59.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:48:59.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.095 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:59.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:48:59.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:48:59.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.095 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:59.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:48:59.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:48:59.095 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.095 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:59.095 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.096 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:48:59.096 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:59.096 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 62.693847112999997, 2024-09-12T22:48:59.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:48:59.096 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:59.096 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:59.096 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:59.096 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:59.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:59.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:59.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:59.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:59.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:59.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:48:59.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:48:59.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:59.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:48:59.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:48:59.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:59.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:48:59.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:48:59.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:48:59.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:48:59.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.099 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:59.099 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:48:59.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:48:59.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.099 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:59.099 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:48:59.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:48:59.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.099 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:59.099 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:48:59.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:48:59.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:59.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:48:59.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:48:59.100 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.100 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:59.100 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.100 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:48:59.100 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:59.101 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 62.559997019000001, 2024-09-12T22:48:59.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:48:59.101 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:59.101 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:59.101 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:59.101 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:59.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:59.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:59.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:59.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:59.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.102 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:59.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:48:59.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:48:59.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.102 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:59.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:48:59.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:48:59.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:59.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:48:59.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:48:59.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:48:59.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:48:59.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:59.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:48:59.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:48:59.104 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.104 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.104 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:59.104 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:48:59.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:48:59.104 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.104 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.104 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:59.104 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:48:59.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:48:59.104 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.104 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.104 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:59.105 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:48:59.105 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:48:59.105 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.105 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:59.105 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.105 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.105 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.105 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:59.105 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:59.105 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 53.914761464999998, 2024-09-12T22:48:59.105 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:48:59.105 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:59.105 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:59.106 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:59.106 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:59.106 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.106 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:59.106 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:59.106 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.106 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.106 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:59.106 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:48:59.106 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.106 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.107 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:59.107 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:48:59.107 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:48:59.107 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.107 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.107 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:59.107 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:48:59.107 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:48:59.107 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.107 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.107 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:59.107 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:48:59.107 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:48:59.108 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.108 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.108 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.108 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:48:59.108 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:48:59.108 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.108 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.108 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:59.108 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:48:59.108 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:48:59.108 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.108 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.108 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:59.109 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:48:59.109 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:48:59.109 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.109 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.109 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:59.109 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:48:59.109 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:48:59.109 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.109 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.109 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:59.109 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:48:59.109 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:48:59.109 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.109 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.110 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:59.110 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:48:59.110 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:48:59.110 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.110 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.110 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:59.110 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:48:59.110 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:48:59.110 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.110 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.110 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:59.110 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:48:59.110 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:48:59.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.111 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.111 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:59.111 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:48:59.111 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:48:59.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.111 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.111 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:59.111 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:48:59.111 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:48:59.111 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.111 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:59.112 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.112 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.112 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.112 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:59.112 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:59.112 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 53.914661948000003, 2024-09-12T22:48:59.112 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:48:59.112 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:59.112 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:59.112 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:59.112 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:59.112 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.113 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:59.113 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:59.113 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.113 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.113 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.113 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:59.113 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:48:59.113 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.113 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.113 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.113 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:59.113 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:48:59.113 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:48:59.114 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.114 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.114 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:59.114 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:48:59.114 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:48:59.114 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.114 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.114 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:59.114 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:48:59.114 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:48:59.114 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.114 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.114 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.115 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:48:59.115 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:48:59.115 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.115 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.115 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:59.115 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:48:59.115 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:48:59.115 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.115 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.115 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:59.115 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:48:59.115 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:48:59.115 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.116 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.116 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:59.116 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:48:59.116 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:48:59.116 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.116 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.116 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:59.116 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:48:59.116 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:48:59.116 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.116 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.116 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:59.117 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:48:59.117 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:48:59.117 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.117 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.117 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:59.117 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:48:59.117 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:48:59.117 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.117 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.117 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:59.117 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:48:59.117 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:48:59.117 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.118 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:59.118 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:48:59.118 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:48:59.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.118 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:59.118 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:48:59.118 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:48:59.118 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.118 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:59.118 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.119 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.119 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:59.119 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:59.119 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 53.914617208999999, 2024-09-12T22:48:59.119 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:48:59.119 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:59.119 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:59.119 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:59.119 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:59.119 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.119 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:59.119 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:59.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.120 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.120 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:59.120 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:48:59.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.120 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.120 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:59.120 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:48:59.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:48:59.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.120 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.121 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:59.121 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:48:59.121 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:48:59.121 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.121 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.121 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:59.121 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:48:59.121 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:48:59.121 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.121 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.121 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.121 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:48:59.121 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:48:59.121 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:59.122 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:48:59.122 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:48:59.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:59.122 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:48:59.122 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:48:59.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:59.122 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:48:59.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:48:59.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.123 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:59.123 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:48:59.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:48:59.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.123 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:59.123 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:48:59.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:48:59.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.123 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:59.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:48:59.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:48:59.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:59.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:48:59.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:48:59.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:59.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:48:59.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:48:59.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.125 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:59.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:48:59.125 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:48:59.125 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.125 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:59.125 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.125 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:59.125 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:59.125 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 53.914389507999999, 2024-09-12T22:48:59.126 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:48:59.126 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:59.126 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:59.126 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:59.126 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:59.126 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.126 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:59.126 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:59.126 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.126 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.126 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.126 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:59.126 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:48:59.127 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.127 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.127 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:59.127 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:48:59.127 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:48:59.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.127 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.127 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:59.127 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:48:59.127 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:48:59.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.127 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:59.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:48:59.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:48:59.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:48:59.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:48:59.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:59.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:48:59.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:48:59.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.129 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:59.129 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:48:59.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:48:59.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.129 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:59.129 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:48:59.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:48:59.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.129 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:59.129 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:48:59.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:48:59.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:59.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:48:59.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:48:59.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:59.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:48:59.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:48:59.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.131 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:59.131 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:48:59.131 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:48:59.131 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.131 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.131 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:59.131 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:48:59.131 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:48:59.131 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.131 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.131 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:59.131 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:48:59.131 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:48:59.131 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.132 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:59.132 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.132 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:59.132 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:59.132 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 53.914224400000002, 2024-09-12T22:48:59.132 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:48:59.132 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:59.132 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:59.132 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:59.132 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:59.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:59.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:59.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:59.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:48:59.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:59.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:48:59.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:48:59.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.134 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:59.134 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:48:59.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:48:59.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.134 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:59.134 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:48:59.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:48:59.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.134 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.134 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:48:59.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:48:59.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:59.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:48:59.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:48:59.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:48:59.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:48:59.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:48:59.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.136 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:59.136 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:48:59.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:48:59.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.136 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:59.136 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:48:59.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:48:59.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.136 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:59.136 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:48:59.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:48:59.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:59.137 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:48:59.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:48:59.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:59.137 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:48:59.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:48:59.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:59.137 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:48:59.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:48:59.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:59.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:48:59.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:48:59.138 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.138 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:59.138 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.138 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:59.138 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:59.139 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 53.914163115000001, 2024-09-12T22:48:59.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:48:59.139 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:59.139 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:59.139 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:59.139 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:59.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:59.139 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:59.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:59.139 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:59.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.140 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:59.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:48:59.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:48:59.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.140 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:59.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:48:59.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:48:59.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:59.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:48:59.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:48:59.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:48:59.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:48:59.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:59.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:48:59.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:48:59.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:59.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:48:59.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:48:59.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:59.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:48:59.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:48:59.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:59.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:48:59.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:48:59.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:59.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:48:59.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:48:59.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:59.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:48:59.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:48:59.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:59.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:48:59.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:48:59.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:59.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:48:59.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:48:59.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:59.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:48:59.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:48:59.145 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.145 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:59.145 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.145 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:59.145 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:59.146 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 53.914083007000002, 2024-09-12T22:48:59.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:48:59.146 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:59.146 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:59.146 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:59.146 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:59.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:59.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:59.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:59.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:48:59.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:59.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:48:59.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:48:59.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:59.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:48:59.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:48:59.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:59.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:48:59.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:48:59.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:48:59.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:48:59.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:59.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:48:59.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:48:59.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:48:59.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:48:59.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:48:59.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:59.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:48:59.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:48:59.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:59.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:48:59.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:48:59.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:59.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:48:59.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:48:59.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:59.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:48:59.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:48:59.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:48:59.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:48:59.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:48:59.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:59.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:48:59.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:48:59.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:59.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:48:59.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:48:59.152 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.152 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:59.152 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.152 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:59.152 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:59.152 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 53.914034053999998, 2024-09-12T22:48:59.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:48:59.152 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:59.152 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:59.152 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:48:59.152 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:59.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.153 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:59.153 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:59.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.153 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:59.153 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:59.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:59.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:48:59.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:48:59.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:59.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:48:59.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:48:59.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:59.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:48:59.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:48:59.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:48:59.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:48:59.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:59.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:48:59.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:48:59.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:59.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:48:59.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:48:59.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:59.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:48:59.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:48:59.159 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.159 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:59.159 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.160 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:59.160 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:59.160 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 53.913984954, 2024-09-12T22:48:59.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:48:59.160 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:59.160 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:59.160 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:48:59.160 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:59.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.160 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:59.160 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:59.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:59.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:48:59.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:59.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:48:59.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:48:59.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:59.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:48:59.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:48:59.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:59.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:48:59.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:48:59.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:48:59.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:48:59.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.163 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:59.163 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:48:59.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:48:59.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.163 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:59.163 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:48:59.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:48:59.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.163 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:59.163 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:48:59.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:48:59.164 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.164 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:59.164 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.164 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:59.164 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:59.164 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 53.907044503999998, 2024-09-12T22:48:59.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:48:59.164 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:59.164 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:59.164 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:59.164 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:59.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:59.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:59.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:59.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:48:59.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:59.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:48:59.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:48:59.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:59.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:48:59.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:48:59.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:59.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:48:59.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:48:59.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.167 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:48:59.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:48:59.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.167 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:59.167 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:48:59.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:48:59.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.167 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:59.167 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:48:59.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:48:59.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:59.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:48:59.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:48:59.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:59.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:48:59.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:48:59.168 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.168 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:59.168 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.169 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:59.169 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:59.169 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 53.905955663999997, 2024-09-12T22:48:59.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:48:59.169 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:59.169 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:59.169 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:59.169 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:59.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:59.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:59.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:59.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:48:59.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:59.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:48:59.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:48:59.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:59.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:48:59.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:48:59.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:59.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:48:59.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:48:59.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:48:59.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:48:59.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:59.172 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:48:59.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:48:59.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:59.172 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:48:59.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:48:59.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:59.172 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:48:59.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:48:59.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.173 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:59.173 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:48:59.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:48:59.173 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.173 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:59.173 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.173 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:59.173 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:59.173 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 53.905906053000002, 2024-09-12T22:48:59.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:48:59.173 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:59.174 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:59.174 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:59.174 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:59.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:59.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:59.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:59.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:59.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:59.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:48:59.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:48:59.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:59.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:59.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:48:59.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:59.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:48:59.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:48:59.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:48:59.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:48:59.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:59.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:48:59.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:48:59.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.177 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:59.177 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:48:59.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:48:59.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.177 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.177 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:59.177 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:48:59.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:48:59.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.177 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.177 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:59.177 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:48:59.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:48:59.177 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.178 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:59.178 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.178 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:59.178 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:59.178 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 53.905838744, 2024-09-12T22:48:59.178 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:48:59.178 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:59.178 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:59.178 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:59.178 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:59.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:59.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:59.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:59.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:59.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:59.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:48:59.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:48:59.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:59.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:48:59.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:48:59.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:59.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:48:59.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:48:59.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:48:59.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:48:59.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.181 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:59.181 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:48:59.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:48:59.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.181 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:59.181 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:48:59.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:48:59.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.182 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:59.182 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:48:59.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:48:59.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.182 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:59.182 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:48:59.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:48:59.182 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.182 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:59.182 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.183 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:59.183 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:59.183 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 53.905270825000002, 2024-09-12T22:48:59.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:48:59.183 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:59.183 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:59.183 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:59.183 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:59.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.183 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:59.183 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:59.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:59.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:59.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:59.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:48:59.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:48:59.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:59.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:48:59.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:48:59.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:59.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:48:59.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:48:59.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:48:59.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:48:59.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:59.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:48:59.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:48:59.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:59.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:48:59.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:48:59.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:59.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:48:59.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:48:59.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:59.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:48:59.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:48:59.187 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.187 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:59.187 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.187 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:48:59.187 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:59.187 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 53.904893221000002, 2024-09-12T22:48:59.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:48:59.187 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:59.187 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:59.188 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:59.188 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:59.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:59.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:59.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:59.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:48:59.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:59.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:48:59.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:48:59.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:59.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:48:59.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:48:59.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:59.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:48:59.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:48:59.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:48:59.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:48:59.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:59.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:48:59.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:48:59.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:59.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:48:59.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:48:59.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:59.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:48:59.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:48:59.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:59.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:48:59.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:48:59.191 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.191 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:59.192 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.192 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.192 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:59.192 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:59.193 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:48:59.194 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:59.192+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:59.294 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:59.293+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:59.298 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:59.298 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:48:59.298 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:48:59.298 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:59.306 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:48:59.395 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:59.394+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:59.449 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:59.449 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:48:59.449 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:48:59.449 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:48:59.449 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:59.458 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:48:59.495 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:59.494+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:59.562 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:48:59.562 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:48:59.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:48:59.562 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:48:59.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.563 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:48:59.563 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:59.563 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.514507539, 2024-09-12T22:48:59.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:48:59.563 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:59.563 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:59.563 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:59.563 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:59.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:59.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:59.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:59.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:59.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:59.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:48:59.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:48:59.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:59.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:48:59.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:48:59.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:59.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:48:59.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:48:59.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:48:59.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:48:59.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:59.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:48:59.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:48:59.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:59.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:48:59.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:48:59.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:59.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:48:59.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:48:59.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:59.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:48:59.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:48:59.567 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.567 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:59.567 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.567 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:48:59.567 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:59.567 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 57.514126812000001, 2024-09-12T22:48:59.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:48:59.568 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:59.568 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:59.568 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:59.568 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:59.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:59.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:59.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:59.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:48:59.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:59.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:48:59.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:48:59.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:59.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:48:59.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:48:59.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:59.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:48:59.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:48:59.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.570 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.570 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:48:59.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:48:59.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.570 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:59.570 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:48:59.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:48:59.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:59.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:48:59.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:48:59.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:59.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:48:59.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:48:59.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:59.572 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:48:59.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:48:59.572 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.572 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:59.572 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.572 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:48:59.572 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:59.572 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.393530001999999, 2024-09-12T22:48:59.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:48:59.572 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:59.572 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:59.573 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:48:59.573 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:59.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:59.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:59.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:59.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:59.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:59.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:48:59.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:48:59.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:59.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:48:59.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:48:59.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:59.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:48:59.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:48:59.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.575 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.575 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:48:59.575 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:48:59.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.575 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:59.575 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:48:59.575 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:48:59.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.575 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:59.575 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:48:59.575 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:48:59.576 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.576 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:59.576 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.576 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.576 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:59.576 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:59.576 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.390921822000003, 2024-09-12T22:48:59.576 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:48:59.576 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:59.576 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:59.577 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:59.577 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:59.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.577 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:59.577 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:59.577 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.577 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:59.577 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:48:59.577 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.577 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:59.578 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:48:59.578 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:48:59.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.578 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:59.578 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:48:59.578 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:48:59.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.578 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:59.578 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:48:59.578 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:48:59.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.579 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.579 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:48:59.579 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:48:59.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.579 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:59.579 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:48:59.579 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:48:59.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.579 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:59.579 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:48:59.579 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:48:59.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.580 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:59.580 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:48:59.580 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:48:59.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.580 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:59.580 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:48:59.580 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:48:59.580 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.580 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:59.580 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.581 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:59.581 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:59.581 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.390028598999997, 2024-09-12T22:48:59.581 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:48:59.581 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:59.581 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:59.581 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:59.581 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:59.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.581 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:59.581 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:59.581 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.582 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:59.582 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:48:59.582 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.582 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.582 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:59.582 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:48:59.582 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:48:59.582 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.582 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:59.582 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:48:59.582 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:48:59.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.583 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:59.583 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:48:59.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:48:59.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.583 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.583 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:48:59.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:48:59.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.584 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:59.584 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:48:59.584 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:48:59.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.584 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:59.584 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:48:59.584 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:48:59.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.584 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:59.584 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:48:59.584 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:48:59.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.585 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:59.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:48:59.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:48:59.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.585 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:59.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:48:59.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:48:59.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.585 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:59.586 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:48:59.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:48:59.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:59.586 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:48:59.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:48:59.586 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.586 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:59.586 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.586 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:59.587 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:59.587 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.389956941000001, 2024-09-12T22:48:59.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:48:59.587 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:59.587 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:59.587 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:59.587 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:59.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:59.587 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:59.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:59.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:48:59.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.588 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:59.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:48:59.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:48:59.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.588 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:59.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:48:59.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:48:59.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.589 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:59.589 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:48:59.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:48:59.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.589 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.589 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:48:59.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:48:59.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.589 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:59.589 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:48:59.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:48:59.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:59.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:48:59.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:48:59.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:59.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:48:59.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:48:59.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:59.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:48:59.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:48:59.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:59.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:48:59.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:48:59.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:59.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:48:59.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:48:59.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:59.592 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:48:59.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:48:59.592 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.592 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:59.592 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.592 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:59.592 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:59.592 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.389914222999998, 2024-09-12T22:48:59.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:48:59.592 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:59.592 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:59.592 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:59.593 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:59.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.593 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:59.593 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:59.593 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.593 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:59.593 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:48:59.593 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.593 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:59.593 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:48:59.594 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:48:59.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.594 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:59.594 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:48:59.594 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:48:59.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.594 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:59.594 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:48:59.594 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:48:59.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:48:59.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:48:59.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:59.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:48:59.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:48:59.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:59.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:48:59.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:48:59.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:59.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:48:59.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:48:59.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:59.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:48:59.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:48:59.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:59.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:48:59.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:48:59.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:59.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:48:59.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:48:59.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:59.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:48:59.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:48:59.597 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.597 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:59.597 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.598 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:59.598 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:59.598 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.389876305999998, 2024-09-12T22:48:59.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:48:59.598 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:59.598 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:59.598 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:59.598 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:59.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.598 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:59.598 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:59.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.598 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:59.599 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:48:59.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:59.599 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:48:59.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:48:59.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:59.599 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:48:59.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:48:59.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:59.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:48:59.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:48:59.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:48:59.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:48:59.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:59.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:48:59.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:48:59.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:59.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:48:59.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:48:59.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:48:59.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:59.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:48:59.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:59.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:48:59.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:48:59.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:59.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:48:59.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:48:59.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:59.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:48:59.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:48:59.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:59.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:48:59.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:48:59.603 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.603 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:59.603 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.603 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:59.603 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:59.603 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.389852855000001, 2024-09-12T22:48:59.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:48:59.604 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:59.604 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:59.604 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:59.604 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:59.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.604 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:59.604 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:59.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.604 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:59.604 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:48:59.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:59.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:48:59.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:48:59.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:59.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:48:59.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:48:59.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:59.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:48:59.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:48:59.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:48:59.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:48:59.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:59.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:48:59.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:48:59.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:59.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:48:59.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:48:59.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:59.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:48:59.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:48:59.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:59.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:48:59.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:48:59.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:59.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:48:59.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:48:59.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:59.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:48:59.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:48:59.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:59.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:48:59.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:48:59.609 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.609 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:59.609 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.609 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:59.609 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:59.609 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.389828618000003, 2024-09-12T22:48:59.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:48:59.609 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:59.609 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:59.609 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:59.609 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:59.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:59.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:59.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:59.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:59.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:59.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:48:59.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:48:59.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:59.611 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:48:59.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:48:59.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:59.611 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:48:59.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:48:59.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:48:59.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:48:59.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:59.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:48:59.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:48:59.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:59.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:48:59.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:48:59.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:59.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:48:59.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:48:59.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:59.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:48:59.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:48:59.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:59.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:48:59.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:48:59.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:59.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:48:59.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:48:59.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:59.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:48:59.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:48:59.614 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.614 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:59.614 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.615 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:59.615 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:59.615 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.389800700999999, 2024-09-12T22:48:59.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:48:59.615 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:59.615 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:59.615 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:59.615 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:59.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:59.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:59.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:59.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:59.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:59.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:48:59.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:48:59.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:59.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:48:59.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:48:59.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:59.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:48:59.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:48:59.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:48:59.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:48:59.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:59.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:48:59.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:48:59.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:59.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:48:59.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:48:59.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:59.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:48:59.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:48:59.619 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.619 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:59.619 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.619 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:59.619 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:59.619 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.389726205999999, 2024-09-12T22:48:59.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:48:59.619 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:59.619 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:59.619 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:59.620 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:59.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:59.620 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:59.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:59.620 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:48:59.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:59.621 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:48:59.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:48:59.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.621 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:59.621 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:48:59.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:48:59.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.621 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:59.621 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:48:59.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:48:59.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:48:59.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:48:59.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:59.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:48:59.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:48:59.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:59.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:48:59.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:48:59.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:59.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:48:59.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:48:59.623 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.623 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:59.623 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.623 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:48:59.623 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:59.623 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.389680177999999, 2024-09-12T22:48:59.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:48:59.624 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:59.624 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:59.624 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:59.624 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:59.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:59.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:59.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:59.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:48:59.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:59.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:48:59.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:48:59.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:59.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:48:59.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:48:59.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:59.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:48:59.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:48:59.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:48:59.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:48:59.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:59.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:48:59.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:48:59.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:59.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:48:59.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:48:59.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:59.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:48:59.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:48:59.627 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.627 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:59.628 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.628 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:48:59.628 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:59.628 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.387509293999997, 2024-09-12T22:48:59.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:48:59.628 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:59.628 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:59.629 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:59.629 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:59.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:59.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:59.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:59.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:59.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:59.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:48:59.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:48:59.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:59.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:48:59.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:48:59.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:59.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:48:59.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:48:59.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:48:59.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:48:59.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:59.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:48:59.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:48:59.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:59.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:59.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:48:59.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.632 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.632 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:59.632 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:48:59.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:48:59.632 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.632 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.632 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:59.632 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:48:59.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:48:59.632 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.632 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:59.632 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.632 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.632 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.633 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:59.633 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:59.633 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.387458844000001, 2024-09-12T22:48:59.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:48:59.633 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:59.633 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:59.633 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:59.633 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:59.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:59.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:59.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:59.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:48:59.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:59.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:48:59.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:48:59.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:59.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:48:59.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:48:59.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:59.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:48:59.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:48:59.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:48:59.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:48:59.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:59.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:48:59.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:48:59.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:59.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:48:59.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:48:59.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:59.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:48:59.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:48:59.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.637 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:59.637 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:48:59.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:48:59.637 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.637 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:59.637 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.637 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:48:59.637 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:59.637 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.387405405999999, 2024-09-12T22:48:59.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:48:59.638 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:59.638 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:59.638 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:59.638 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:59.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:59.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:59.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:59.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:59.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:59.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:48:59.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:48:59.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:59.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:48:59.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:48:59.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:59.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:48:59.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:48:59.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:48:59.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:48:59.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:59.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:48:59.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:48:59.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:59.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:48:59.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:48:59.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:59.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:48:59.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:48:59.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:59.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:48:59.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:48:59.642 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.642 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:59.642 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.642 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:48:59.642 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:59.642 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.383421052999999, 2024-09-12T22:48:59.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:48:59.643 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:59.643 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:59.643 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:48:59.643 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:59.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:59.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:59.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:59.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:48:59.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:59.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:48:59.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:48:59.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:59.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:48:59.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:48:59.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:59.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:48:59.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:48:59.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:48:59.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:48:59.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:59.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:48:59.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:48:59.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:59.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:48:59.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:48:59.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:59.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:48:59.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:48:59.646 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.646 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:59.646 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.646 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:48:59.646 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:59.647 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 52.398268514000002, 2024-09-12T22:48:59.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:48:59.647 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:59.647 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:59.647 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:59.647 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:59.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:59.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:59.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:59.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:48:59.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:59.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:48:59.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:48:59.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:59.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:48:59.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:48:59.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:59.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:48:59.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:48:59.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:48:59.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:48:59.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:59.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:48:59.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:48:59.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:59.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:48:59.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:48:59.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:59.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:48:59.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:48:59.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:59.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:48:59.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:48:59.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:59.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:48:59.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:48:59.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:59.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:48:59.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:48:59.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:59.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:48:59.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:48:59.652 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.652 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:59.652 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.652 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:48:59.652 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:59.652 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.396352268999998, 2024-09-12T22:48:59.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:48:59.652 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:59.652 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:59.653 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:59.653 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:59.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:59.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:59.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:59.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:48:59.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:59.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:48:59.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:48:59.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:59.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:48:59.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:48:59.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:59.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:48:59.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:48:59.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:48:59.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:48:59.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:59.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:48:59.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:48:59.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:59.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:48:59.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:48:59.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:48:59.656 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:48:59.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:48:59.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:59.656 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:48:59.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:48:59.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:48:59.656 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:48:59.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:48:59.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:59.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:48:59.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:48:59.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:59.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:48:59.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:48:59.657 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.657 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:59.658 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.658 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:48:59.658 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:59.658 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.395598893999999, 2024-09-12T22:48:59.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012160610000000001, 2024-09-12T22:48:59.658 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:48:59.658 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:48:59.658 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:59.658 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:48:59.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:48:59.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:59.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:48:59.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:48:59.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:48:59.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:48:59.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164967+0000", 2024-09-12T22:48:59.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:48:59.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:48:59.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164974+0000", 2024-09-12T22:48:59.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:48:59.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:48:59.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164987+0000", 2024-09-12T22:48:59.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3689000000000001e-05 2024-09-12T22:48:59.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164995+0000", 2024-09-12T22:48:59.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2959999999999999e-06 2024-09-12T22:48:59.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:48:59.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165068+0000", 2024-09-12T22:48:59.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2449999999999999e-05 2024-09-12T22:48:59.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:48:59.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165212+0000", 2024-09-12T22:48:59.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144117 2024-09-12T22:48:59.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:48:59.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166066+0000", 2024-09-12T22:48:59.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085441100000000002 2024-09-12T22:48:59.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:48:59.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166107+0000", 2024-09-12T22:48:59.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0450000000000001e-05 2024-09-12T22:48:59.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:48:59.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:48:59.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:48:59.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166181+0000", 2024-09-12T22:48:59.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-12T22:48:59.662 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.663 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:59.663 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.663 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:48:59.663 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:48:59.663 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:48:59.664 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:59.663+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:59.665 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:48:59.765 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:59.764+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:59.767 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:59.767 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:48:59.767 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:48:59.767 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:59.775 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:48:59.866 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:48:59.866+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:48:59.878 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:59.878 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:48:59.878 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:48:59.879 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:48:59.879 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:48:59.887 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:48:59.967 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:48:59.966+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:48:59.991 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:48:59.991 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:48:59.991 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:48:59.991 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:48:59.991 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.991 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:48:59.991 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:59.991 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.605365935000002, 2024-09-12T22:48:59.992 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:48:59.992 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:59.992 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:59.992 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:59.992 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:59.992 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.992 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:59.992 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:59.992 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.992 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.992 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.992 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:59.992 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:59.992 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.993 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.993 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:59.993 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:48:59.993 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:48:59.993 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.993 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:59.993 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:48:59.993 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:48:59.993 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.994 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:59.994 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:48:59.994 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:48:59.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.994 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.994 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.994 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:48:59.994 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:48:59.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.994 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.994 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:59.994 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:48:59.994 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:48:59.995 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.995 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.995 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:59.995 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:48:59.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:48:59.995 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.995 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.995 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:48:59.995 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:48:59.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:48:59.995 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.995 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.995 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:48:59.995 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:48:59.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:48:59.996 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.996 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:48:59.996 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:48:59.996 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.996 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.996 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:48:59.996 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:59.996 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.604923352, 2024-09-12T22:48:59.996 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:48:59.996 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:48:59.996 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:48:59.996 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:48:59.996 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:48:59.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:48:59.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:59.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:48:59.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:48:59.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:48:59.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:48:59.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:48:59.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:48:59.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.998 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.998 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:48:59.998 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:48:59.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:48:59.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.998 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.998 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:48:59.998 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:48:59.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:48:59.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.999 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.999 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:48:59.999 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:48:59.999 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:48:59.999 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.999 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.999 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:48:59.999 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:48:59.999 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:48:59.999 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:48:59.999 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:48:59.999 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:48:59.999 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:49:00.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:49:00.000 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:00.000 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:49:00.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:49:00.000 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:00.000 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:49:00.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:49:00.000 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.000 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:00.000 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.001 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:49:00.001 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:00.001 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.604557194999998, 2024-09-12T22:49:00.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:49:00.001 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:00.001 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:00.001 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:00.001 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:00.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.001 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:00.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:00.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.002 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:00.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:00.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.002 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:00.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:49:00.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:49:00.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.002 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.003 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:00.003 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:49:00.003 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:49:00.003 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.003 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.003 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:00.003 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:49:00.003 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:49:00.003 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.003 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.003 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.003 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:49:00.003 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:49:00.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.004 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:00.004 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:49:00.004 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:49:00.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.004 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:00.004 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:49:00.004 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:49:00.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.004 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:00.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:49:00.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:49:00.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.005 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:00.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:49:00.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:49:00.005 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.005 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:00.005 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.005 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:49:00.006 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:00.006 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.604144883000004, 2024-09-12T22:49:00.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:49:00.006 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:00.006 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:00.006 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:00.006 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:00.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.006 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:00.006 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:00.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.007 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:00.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:00.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.007 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:00.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:00.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:49:00.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.007 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:00.008 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:49:00.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:49:00.008 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.008 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:00.008 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:49:00.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:49:00.008 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.008 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.008 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:49:00.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:49:00.008 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.009 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:00.009 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:49:00.009 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:49:00.009 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.009 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:00.009 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:49:00.009 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:49:00.009 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.009 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:00.009 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:49:00.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:49:00.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.010 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:00.010 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:49:00.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:49:00.010 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.010 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:00.010 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.010 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:49:00.010 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:00.011 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.470294789, 2024-09-12T22:49:00.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:49:00.011 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:00.011 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:00.011 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:00.011 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:00.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.011 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:00.011 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:00.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.011 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:00.012 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:00.012 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.012 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.012 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.012 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:00.012 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:00.012 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:49:00.012 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.012 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.012 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:00.012 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:49:00.012 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:49:00.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.013 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:00.013 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:49:00.013 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:49:00.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.013 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.013 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:49:00.013 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:49:00.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.013 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:00.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:49:00.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:49:00.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:00.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:49:00.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:49:00.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:00.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:49:00.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:49:00.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:00.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:49:00.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:49:00.015 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.015 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:00.015 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.015 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:00.015 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:00.015 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.825059234999998, 2024-09-12T22:49:00.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:49:00.016 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:00.016 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:00.016 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:00.016 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:00.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:00.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:00.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:00.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:00.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:00.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:49:00.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:49:00.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:00.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:49:00.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:49:00.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.018 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:00.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:49:00.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:49:00.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.018 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:49:00.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:49:00.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.019 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.019 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:00.019 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:00.019 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:49:00.019 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.019 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.019 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:00.019 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:00.019 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:49:00.019 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.019 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.019 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:00.020 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:49:00.020 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:49:00.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.020 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:00.020 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:49:00.020 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:49:00.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.020 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:00.020 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:49:00.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:49:00.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.021 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.021 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:00.021 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:49:00.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:49:00.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.021 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.021 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:00.021 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:49:00.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:49:00.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:00.022 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:49:00.022 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:49:00.022 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:00.022 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:49:00.022 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:49:00.022 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.022 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:00.022 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.022 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.023 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:00.023 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:00.023 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.824959718000002, 2024-09-12T22:49:00.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:49:00.023 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:00.023 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:00.023 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:00.023 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:00.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.023 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:00.023 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:00.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.024 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:00.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:00.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.024 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:00.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:49:00.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:49:00.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.025 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:00.025 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:49:00.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:49:00.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.025 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.025 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:00.025 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:49:00.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:49:00.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.025 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.025 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.025 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:49:00.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:49:00.026 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.026 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:00.026 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:49:00.026 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:49:00.026 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.026 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:00.026 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:49:00.026 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:49:00.026 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.027 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:00.027 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:49:00.027 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:49:00.027 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.027 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.027 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:00.027 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:49:00.027 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:49:00.027 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.027 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.027 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:00.027 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:49:00.027 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:49:00.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.028 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.028 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:00.028 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:49:00.028 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:49:00.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.028 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.028 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:00.028 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:49:00.028 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:49:00.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.028 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.028 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:00.029 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:49:00.029 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:49:00.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.029 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:00.029 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:49:00.029 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:49:00.029 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.029 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:00.029 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.030 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:00.030 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:00.030 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.824914978999999, 2024-09-12T22:49:00.030 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:49:00.030 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:00.030 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:00.030 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:00.030 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:00.030 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.030 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:00.030 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:00.030 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.030 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.031 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.031 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:00.031 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:00.031 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.031 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.031 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.031 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:00.031 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:49:00.031 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:49:00.031 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.031 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.031 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:00.031 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:00.032 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:49:00.032 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.032 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.032 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:00.032 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:00.032 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:49:00.032 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.032 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.032 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.032 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:49:00.032 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:49:00.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.033 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:00.033 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:49:00.033 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:49:00.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.033 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:00.033 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:49:00.033 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:49:00.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.034 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:00.034 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:49:00.034 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:49:00.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.034 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.034 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:00.034 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:49:00.034 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:49:00.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.034 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.034 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:00.034 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:49:00.034 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:49:00.035 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.035 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.035 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:00.035 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:49:00.035 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:49:00.035 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.035 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.035 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:00.035 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:49:00.035 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:49:00.035 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.035 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.035 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:00.036 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:49:00.036 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:49:00.036 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.036 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.036 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:00.036 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:49:00.036 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:49:00.036 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.036 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:00.036 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.036 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.036 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.037 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:00.037 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:00.037 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.824687277999999, 2024-09-12T22:49:00.037 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:49:00.037 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:00.037 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:00.037 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:00.037 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:00.037 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.037 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:00.037 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:00.037 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.037 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.038 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.038 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:00.038 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:00.038 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.038 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.038 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.038 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:00.038 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:49:00.038 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:49:00.038 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.038 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.038 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:00.039 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:49:00.039 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:49:00.039 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.039 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.039 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:00.039 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:49:00.039 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:49:00.039 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.039 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.039 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.039 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:49:00.039 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:49:00.039 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.040 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.040 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:00.040 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:49:00.040 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:49:00.040 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.040 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.040 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:00.040 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:49:00.040 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:49:00.040 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.040 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.040 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:00.040 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:49:00.041 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:49:00.041 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.041 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.041 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:00.041 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:49:00.041 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:49:00.041 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.041 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.041 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:00.041 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:49:00.041 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:49:00.041 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.041 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.042 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:00.042 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:49:00.042 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:49:00.042 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.042 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.042 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:00.042 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:49:00.042 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:49:00.042 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.042 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.042 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:00.042 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:49:00.042 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:49:00.043 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.043 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.043 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:00.043 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:49:00.043 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:49:00.043 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.043 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:00.043 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.043 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.043 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.043 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:00.043 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:00.044 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.824522170000002, 2024-09-12T22:49:00.044 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:49:00.044 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:00.044 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:00.044 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:00.044 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:00.044 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.044 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:00.044 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:00.044 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.044 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.044 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.044 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:00.045 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:00.045 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.045 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.045 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.045 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:00.045 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:49:00.045 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:49:00.045 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.045 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.045 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:00.045 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:49:00.045 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:49:00.045 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.045 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.046 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:00.046 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:49:00.046 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:49:00.046 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.046 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.046 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.046 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:49:00.046 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:49:00.046 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.047 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.047 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:00.047 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:49:00.047 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:49:00.047 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.048 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.048 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:00.048 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:49:00.048 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:49:00.048 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.048 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.048 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:00.048 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:49:00.048 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:49:00.048 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.048 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.048 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:00.048 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:49:00.049 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:49:00.049 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.049 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.049 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:00.049 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:49:00.049 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:49:00.049 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.049 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.049 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:00.049 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:49:00.050 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:49:00.050 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.050 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.050 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:00.050 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:49:00.050 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:49:00.050 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.050 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.050 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:00.050 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:49:00.050 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:49:00.051 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.051 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.051 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:00.051 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:49:00.051 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:49:00.051 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.051 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:00.051 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.051 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.051 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.051 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:00.051 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:00.051 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.824460885000001, 2024-09-12T22:49:00.052 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:49:00.052 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:00.052 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:00.052 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:00.052 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:00.052 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.052 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:00.052 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:00.052 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.052 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.052 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.052 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:00.052 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:00.053 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.053 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.053 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.053 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:00.053 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:00.053 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:49:00.053 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.053 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.054 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:00.054 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:49:00.054 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:49:00.054 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.054 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.054 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:00.054 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:49:00.054 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:49:00.054 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.054 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.054 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.054 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:49:00.054 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:49:00.055 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.055 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.055 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:00.055 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:49:00.055 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:49:00.055 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.055 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.055 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:00.055 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:49:00.055 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:49:00.055 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.055 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.055 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:00.055 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:49:00.056 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:49:00.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.056 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.056 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:00.056 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:49:00.056 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:49:00.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.056 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.056 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:00.056 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:49:00.056 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:49:00.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.056 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.057 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:00.057 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:49:00.057 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:49:00.057 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.057 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.057 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:00.057 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:49:00.057 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:49:00.057 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.057 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.057 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:00.057 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:49:00.057 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:49:00.058 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.058 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.058 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:00.058 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:49:00.058 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:49:00.058 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.058 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:00.058 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.058 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.058 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.058 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:00.058 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:00.058 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.824380777000002, 2024-09-12T22:49:00.059 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:49:00.059 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:00.059 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:00.059 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:00.059 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:00.059 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.059 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:00.059 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:00.059 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.059 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.059 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.060 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:00.060 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:00.060 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.060 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.060 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.060 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:00.060 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:49:00.061 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:49:00.061 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.061 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.061 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:00.061 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:49:00.061 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:49:00.061 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.062 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.062 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:00.062 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:49:00.062 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:49:00.062 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.062 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.062 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.062 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:49:00.063 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:49:00.063 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.063 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.063 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:00.063 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:49:00.063 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:49:00.063 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.063 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.063 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:00.063 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:49:00.063 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:49:00.063 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.064 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.064 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:00.064 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:49:00.064 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:49:00.064 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.064 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.064 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:00.064 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:49:00.064 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:49:00.064 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.064 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.065 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:00.065 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:49:00.065 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:49:00.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.065 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.065 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:00.065 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:49:00.065 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:49:00.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.065 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.065 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:00.065 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:49:00.065 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:49:00.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.066 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.066 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:00.066 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:49:00.066 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:49:00.066 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.066 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.066 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:00.066 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:49:00.066 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:49:00.066 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.066 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:00.066 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.066 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.067 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.067 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:00.067 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:00.067 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.824331823999998, 2024-09-12T22:49:00.067 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:49:00.067 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:00.067 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:00.067 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:00.067 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:00.067 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.067 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:00.067 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:00.068 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.068 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.068 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.068 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:00.068 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:00.068 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.068 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.068 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.068 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:00.068 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:00.068 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:49:00.068 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.068 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.069 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:00.069 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:49:00.069 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:49:00.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.069 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:00.069 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:49:00.069 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:49:00.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.069 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.069 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:49:00.069 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:49:00.070 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.070 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.070 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:00.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:49:00.070 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:49:00.070 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.070 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.070 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:00.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:49:00.070 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:49:00.070 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.071 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.071 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:00.071 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:49:00.071 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:49:00.071 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.071 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:00.071 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.071 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.071 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.071 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:00.071 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:00.071 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.824282724, 2024-09-12T22:49:00.071 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:49:00.072 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:00.072 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:00.072 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:00.072 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:00.072 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.072 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:00.072 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:00.072 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.072 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.072 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.072 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:00.072 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:00.072 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.073 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.073 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.073 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:00.073 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:49:00.073 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:49:00.073 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.073 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.073 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:00.073 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:49:00.073 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:49:00.073 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.073 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.073 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:00.074 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:49:00.074 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:49:00.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.074 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.074 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.074 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:49:00.074 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:49:00.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.074 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.074 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:00.074 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:49:00.074 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:49:00.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.075 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.075 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:00.075 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:49:00.075 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:49:00.075 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.075 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.075 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:00.075 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:49:00.075 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:49:00.075 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.075 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:00.075 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.075 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.076 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.076 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:00.076 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:00.076 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.817342273999998, 2024-09-12T22:49:00.076 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:49:00.076 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:00.076 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:00.076 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:00.076 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:00.076 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.076 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:00.076 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:00.076 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.077 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:00.077 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:00.077 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.077 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:00.077 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:49:00.077 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:49:00.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.077 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:00.078 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:49:00.078 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:49:00.078 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.078 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.078 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:00.078 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:49:00.078 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:49:00.078 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.078 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.078 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.078 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:49:00.078 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:49:00.078 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.079 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.079 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:00.079 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:49:00.079 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:49:00.079 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.079 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.079 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:00.079 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:49:00.079 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:49:00.079 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.079 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.079 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:00.079 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:49:00.080 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:49:00.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.080 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.080 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:00.080 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:49:00.080 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:49:00.080 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.080 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:00.080 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.080 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.080 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:00.080 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:00.080 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.816253434000004, 2024-09-12T22:49:00.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:49:00.081 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:00.081 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:00.081 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:00.081 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:00.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.081 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:00.081 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:00.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.081 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.081 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:00.082 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:00.082 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.082 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.082 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:00.082 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:49:00.082 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:49:00.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.082 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.082 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:00.082 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:49:00.082 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:49:00.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.083 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:00.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:49:00.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:49:00.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.083 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:49:00.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:49:00.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.083 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:00.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:49:00.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:49:00.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:00.084 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:49:00.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:49:00.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:00.084 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:49:00.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:49:00.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:00.085 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:49:00.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:49:00.085 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.085 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:00.085 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.085 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.085 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.085 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:00.085 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:00.085 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.816203823000002, 2024-09-12T22:49:00.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:49:00.085 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:00.085 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:00.086 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:00.086 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:00.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.086 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:00.086 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:00.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.086 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:00.086 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:00.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:00.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:00.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:49:00.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:00.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:00.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:49:00.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:00.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:49:00.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:49:00.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:49:00.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:49:00.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:00.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:49:00.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:49:00.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:00.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:49:00.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:49:00.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:00.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:49:00.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:49:00.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:00.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:49:00.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:49:00.089 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.089 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:00.090 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.090 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:00.090 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:00.090 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.816136514, 2024-09-12T22:49:00.090 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:49:00.090 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:00.090 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:00.090 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:00.090 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:00.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.090 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:00.091 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:00.091 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.091 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.091 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.091 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:00.091 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:00.091 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.091 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.091 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.091 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:00.091 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:00.091 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:49:00.091 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.091 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:00.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:49:00.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:49:00.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:00.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:49:00.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:49:00.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:49:00.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:49:00.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:00.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:49:00.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:49:00.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:00.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:49:00.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:49:00.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:00.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:49:00.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:49:00.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:00.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:49:00.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:49:00.094 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.094 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:00.094 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.095 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:00.095 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:00.095 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.815568595000002, 2024-09-12T22:49:00.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:49:00.095 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:00.095 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:00.095 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:00.095 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:00.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.095 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:00.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:00.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:00.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:00.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:00.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:00.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:49:00.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:00.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:49:00.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:49:00.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:00.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:49:00.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:49:00.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:49:00.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:49:00.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:00.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:49:00.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:49:00.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:00.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:49:00.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:49:00.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:00.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:49:00.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:49:00.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.099 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:00.099 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:49:00.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:49:00.099 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.099 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:00.099 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.099 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:49:00.100 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:00.100 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.815190991000001, 2024-09-12T22:49:00.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:49:00.100 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:00.100 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:00.100 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:00.100 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:00.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:00.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:00.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:00.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:00.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:00.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:49:00.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:49:00.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:00.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:49:00.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:49:00.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.102 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:00.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:49:00.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:49:00.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.102 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:49:00.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:49:00.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.102 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:00.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:49:00.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:49:00.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:00.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:49:00.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:49:00.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:00.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:49:00.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:49:00.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.104 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.104 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:00.104 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:49:00.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:49:00.104 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.104 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:00.104 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.104 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.104 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:00.104 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:00.106 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:00.106 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:00.105+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:00.207 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:00.206+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:00.213 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:00.214 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:00.214 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:49:00.214 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:00.223 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:00.308 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:00.307+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:00.324 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:00.324 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:00.324 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:49:00.324 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:49:00.325 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:00.333 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:00.409 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:00.408+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:00.438 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:00.438 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:49:00.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:49:00.438 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:49:00.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.438 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:49:00.438 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:00.438 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.389939179999999, 2024-09-12T22:49:00.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:49:00.438 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:00.438 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:00.439 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:00.439 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:00.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:00.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:00.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:00.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:00.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:00.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:00.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:49:00.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:00.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:49:00.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:49:00.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:00.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:49:00.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:49:00.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:49:00.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:49:00.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:00.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:49:00.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:49:00.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:00.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:49:00.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:49:00.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:00.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:49:00.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:49:00.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:00.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:49:00.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:49:00.443 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.443 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:00.443 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.443 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:49:00.443 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:00.444 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 58.389558452999999, 2024-09-12T22:49:00.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:49:00.444 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:00.444 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:00.444 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:00.444 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:00.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:00.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:00.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:00.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:00.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:00.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:49:00.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:49:00.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:00.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:49:00.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:49:00.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:00.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:49:00.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:49:00.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:49:00.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:49:00.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:00.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:49:00.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:49:00.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:00.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:49:00.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:49:00.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:00.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:49:00.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:49:00.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:00.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:49:00.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:49:00.449 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.449 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:00.449 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.449 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:49:00.450 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:00.450 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.268961642999997, 2024-09-12T22:49:00.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:49:00.450 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:00.450 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:00.450 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:49:00.450 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:00.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:00.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:00.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:00.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:00.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:00.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:00.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:49:00.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:00.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:49:00.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:49:00.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:00.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:49:00.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:49:00.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:49:00.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:49:00.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:00.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:49:00.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:49:00.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:00.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:49:00.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:49:00.453 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.453 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:00.454 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.454 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:00.454 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:00.454 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.266353463000002, 2024-09-12T22:49:00.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:49:00.454 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:00.454 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:00.454 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:00.454 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:00.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:00.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:00.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:00.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:00.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:00.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:49:00.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:49:00.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:00.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:49:00.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:49:00.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:00.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:49:00.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:49:00.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:49:00.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:49:00.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:00.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:49:00.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:49:00.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:00.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:49:00.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:49:00.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:00.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:49:00.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:49:00.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:00.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:49:00.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:49:00.459 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.459 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:00.459 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.459 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:00.460 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:00.460 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.265460240000003, 2024-09-12T22:49:00.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:49:00.460 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:00.460 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:00.460 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:00.460 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:00.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:00.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:00.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:00.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:00.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:00.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:49:00.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:49:00.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:00.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:49:00.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:49:00.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:00.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:49:00.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:49:00.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:49:00.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:49:00.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:00.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:49:00.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:49:00.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:00.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:49:00.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:49:00.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:00.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:49:00.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:49:00.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:00.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:49:00.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:49:00.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:00.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:49:00.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:49:00.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:00.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:49:00.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:49:00.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:00.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:49:00.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:49:00.466 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.466 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:00.466 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.466 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:00.466 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:00.466 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.265388582, 2024-09-12T22:49:00.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:49:00.466 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:00.466 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:00.467 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:00.467 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:00.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:00.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:00.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:00.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:00.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:00.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:49:00.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:49:00.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:00.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:49:00.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:49:00.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:00.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:49:00.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:49:00.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:49:00.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:49:00.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:00.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:49:00.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:49:00.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:00.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:49:00.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:49:00.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:00.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:49:00.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:49:00.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:00.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:49:00.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:49:00.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:00.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:49:00.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:49:00.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:00.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:49:00.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:49:00.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:00.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:49:00.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:49:00.472 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.472 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:00.472 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.472 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:00.472 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:00.473 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.265345863999997, 2024-09-12T22:49:00.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:49:00.473 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:00.473 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:00.473 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:00.473 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:00.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:00.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:00.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:00.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:00.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:00.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:49:00.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:49:00.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:00.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:49:00.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:49:00.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:00.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:49:00.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:49:00.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:49:00.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:49:00.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:00.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:49:00.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:49:00.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:00.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:49:00.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:49:00.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:00.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:49:00.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:49:00.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:00.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:49:00.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:49:00.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:00.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:49:00.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:49:00.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:00.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:49:00.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:49:00.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:00.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:49:00.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:49:00.480 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.480 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:00.480 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.480 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:00.481 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:00.481 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.265307946999997, 2024-09-12T22:49:00.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:49:00.481 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:00.481 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:00.481 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:00.481 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:00.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:00.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:00.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:00.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:00.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:00.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:49:00.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:49:00.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:00.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:49:00.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:49:00.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:00.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:49:00.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:49:00.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:49:00.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:49:00.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:00.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:49:00.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:49:00.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:00.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:49:00.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:49:00.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:00.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:00.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:49:00.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:00.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:49:00.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:49:00.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:00.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:49:00.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:49:00.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:00.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:49:00.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:49:00.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:00.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:49:00.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:49:00.487 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.487 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:00.487 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.488 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:00.488 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:00.488 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.265284496, 2024-09-12T22:49:00.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:49:00.488 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:00.488 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:00.488 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:00.488 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:00.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:00.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:00.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:00.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:00.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:00.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:49:00.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:49:00.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:00.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:49:00.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:49:00.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:00.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:49:00.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:49:00.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:49:00.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:49:00.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:00.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:49:00.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:49:00.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:00.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:49:00.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:49:00.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:00.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:00.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:49:00.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:00.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:49:00.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:49:00.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:00.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:49:00.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:49:00.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:00.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:49:00.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:49:00.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:00.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:49:00.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:49:00.496 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.496 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:00.496 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.497 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:00.497 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:00.497 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.265260259000001, 2024-09-12T22:49:00.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:49:00.497 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:00.497 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:00.497 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:00.497 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:00.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:00.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:00.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:00.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:00.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:00.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:00.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:49:00.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:00.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:49:00.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:49:00.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:00.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:49:00.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:49:00.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:49:00.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:49:00.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:00.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:49:00.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:49:00.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:00.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:49:00.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:49:00.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:00.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:49:00.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:49:00.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:00.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:49:00.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:49:00.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:00.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:49:00.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:49:00.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:00.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:49:00.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:49:00.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:00.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:49:00.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:49:00.503 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.503 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:00.504 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.504 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:00.504 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:00.504 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.265232341999997, 2024-09-12T22:49:00.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:49:00.504 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:00.504 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:00.504 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:00.505 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:00.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:00.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:00.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:00.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:00.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:00.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:00.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:49:00.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:00.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:49:00.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:49:00.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:00.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:49:00.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:49:00.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:49:00.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:49:00.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:00.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:49:00.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:49:00.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:00.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:49:00.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:49:00.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:00.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:49:00.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:49:00.509 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.509 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:00.509 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.509 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:00.509 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:00.509 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.265157846999998, 2024-09-12T22:49:00.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:49:00.509 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:00.510 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:00.510 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:00.510 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:00.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:00.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:00.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:00.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:00.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:00.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:49:00.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:49:00.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:00.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:49:00.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:49:00.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:00.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:49:00.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:49:00.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:49:00.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:49:00.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:00.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:49:00.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:49:00.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:00.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:49:00.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:49:00.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:00.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:49:00.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:49:00.513 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.513 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:00.513 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.513 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:00.513 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:00.514 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.265111818999998, 2024-09-12T22:49:00.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:49:00.514 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:00.514 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:00.514 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:00.514 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:00.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:00.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:00.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:00.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:00.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:00.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:49:00.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:49:00.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:00.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:49:00.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:49:00.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:00.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:49:00.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:49:00.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:49:00.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:49:00.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:00.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:49:00.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:49:00.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:00.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:49:00.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:49:00.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:00.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:49:00.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:49:00.518 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.518 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:00.518 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.518 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:00.518 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:00.518 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.262940935000003, 2024-09-12T22:49:00.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:49:00.518 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:00.519 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:00.519 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:00.519 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:00.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:00.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:00.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:00.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:00.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:00.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:00.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:49:00.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:00.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:49:00.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:49:00.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:00.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:49:00.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:49:00.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:00.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:49:00.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:00.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:49:00.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:49:00.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:00.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:00.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:49:00.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:00.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:49:00.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:49:00.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:00.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:49:00.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:49:00.525 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.525 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:00.525 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.526 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:00.526 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:00.526 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.262890485, 2024-09-12T22:49:00.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:49:00.526 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:00.526 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:00.527 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:00.527 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:00.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:00.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:00.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:00.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:00.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:00.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:49:00.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:49:00.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:00.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:49:00.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:49:00.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:00.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:49:00.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:49:00.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:49:00.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:49:00.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:00.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:49:00.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:49:00.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:00.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:49:00.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:49:00.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:00.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:49:00.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:49:00.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:00.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:49:00.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:49:00.531 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.531 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:00.531 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.531 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:00.531 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:00.532 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.262837046999998, 2024-09-12T22:49:00.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:49:00.532 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:00.532 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:00.532 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:00.532 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:00.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:00.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:00.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:00.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:00.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:00.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:00.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:49:00.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:00.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:49:00.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:49:00.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:00.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:00.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:49:00.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:49:00.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:49:00.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:00.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:49:00.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:49:00.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:00.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:49:00.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:49:00.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:00.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:49:00.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:49:00.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:00.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:49:00.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:49:00.541 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.541 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:00.541 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.542 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:49:00.542 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:00.542 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.258852693999998, 2024-09-12T22:49:00.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:49:00.543 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:00.543 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:00.543 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:00.543 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:00.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:00.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:00.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:00.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:00.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:00.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:49:00.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:49:00.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:00.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:49:00.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:49:00.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:00.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:49:00.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:49:00.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.548 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:49:00.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:49:00.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:00.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:49:00.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:49:00.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:00.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:49:00.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:49:00.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:00.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:49:00.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:49:00.550 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.550 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:00.550 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.550 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:49:00.550 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:00.550 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 53.273700155, 2024-09-12T22:49:00.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:49:00.551 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:00.551 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:00.551 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:00.551 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:00.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:00.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:00.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.552 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:00.552 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:00.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.552 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:00.552 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:49:00.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:49:00.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.552 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:00.552 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:49:00.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:49:00.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:00.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:49:00.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:49:00.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:49:00.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:49:00.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:00.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:49:00.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:49:00.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:00.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:49:00.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:49:00.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:00.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:49:00.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:49:00.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:00.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:49:00.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:49:00.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:00.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:49:00.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:49:00.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:00.556 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:49:00.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:49:00.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:00.556 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:49:00.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:49:00.556 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.556 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:00.556 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.557 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:49:00.557 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:00.557 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.271783910000003, 2024-09-12T22:49:00.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:49:00.557 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:00.557 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:00.557 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:00.557 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:00.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.557 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:00.557 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:00.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.558 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:00.558 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:00.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.558 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:00.558 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:49:00.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:49:00.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:00.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:49:00.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:49:00.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:00.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:49:00.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:49:00.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:49:00.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:49:00.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:00.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:49:00.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:49:00.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:00.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:49:00.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:49:00.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:00.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:49:00.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:49:00.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:00.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:49:00.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:49:00.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:00.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:49:00.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:49:00.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:00.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:49:00.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:49:00.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:00.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:49:00.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:49:00.563 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.563 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:00.563 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.563 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:49:00.563 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:00.563 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.271030535000001, 2024-09-12T22:49:00.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012160610000000001, 2024-09-12T22:49:00.564 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:00.564 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:00.564 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:00.564 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:00.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:00.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:00.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:00.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:00.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:00.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:00.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164967+0000", 2024-09-12T22:49:00.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:49:00.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:00.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164974+0000", 2024-09-12T22:49:00.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:49:00.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:00.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164987+0000", 2024-09-12T22:49:00.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3689000000000001e-05 2024-09-12T22:49:00.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164995+0000", 2024-09-12T22:49:00.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2959999999999999e-06 2024-09-12T22:49:00.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:00.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165068+0000", 2024-09-12T22:49:00.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2449999999999999e-05 2024-09-12T22:49:00.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:00.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165212+0000", 2024-09-12T22:49:00.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144117 2024-09-12T22:49:00.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:00.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166066+0000", 2024-09-12T22:49:00.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085441100000000002 2024-09-12T22:49:00.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:00.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166107+0000", 2024-09-12T22:49:00.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0450000000000001e-05 2024-09-12T22:49:00.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:00.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:00.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:00.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166181+0000", 2024-09-12T22:49:00.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-12T22:49:00.568 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.568 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:00.568 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.568 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:00.568 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:00.568 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:00.568 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:49:00.571 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:00.569+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:00.571 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:00.671 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:00.670+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:00.678 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:00.678 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:00.678 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:49:00.678 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:00.687 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:00.772 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:00.771+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:00.831 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:00.831 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:00.832 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:49:00.832 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:49:00.832 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:00.841 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:00.882 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:00.881+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:00.974 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:00.973+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:00.986 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:00.986 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:49:00.986 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:49:00.986 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:49:00.987 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.987 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:49:00.987 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:00.987 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 64.599662300000006, 2024-09-12T22:49:00.987 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:49:00.987 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:00.988 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:00.988 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:00.988 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:00.988 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.988 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:00.989 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:00.989 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.989 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.989 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.989 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:00.990 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:00.990 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.990 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.990 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.990 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:00.990 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:00.990 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:49:00.990 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.990 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.990 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:00.990 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:49:00.990 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:49:00.991 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.991 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.991 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:00.991 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:49:00.991 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:49:00.991 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.991 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.991 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.991 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:49:00.991 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:49:00.991 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.991 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.991 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:00.992 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:49:00.992 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:49:00.992 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.992 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.992 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:00.992 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:49:00.992 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:49:00.992 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.992 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.992 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:00.992 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:49:00.992 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:49:00.993 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.993 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:00.993 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:49:00.993 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:49:00.993 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.993 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:00.993 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.993 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.993 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:49:00.993 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:00.993 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 64.599219716999997, 2024-09-12T22:49:00.993 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:49:00.994 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:00.994 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:00.994 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:00.994 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:00.994 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.994 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:00.994 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:00.994 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.994 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.994 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:00.994 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:00.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.995 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.995 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.995 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:00.995 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:49:00.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:49:00.995 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.995 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.995 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:00.995 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:49:00.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:49:00.995 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.996 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.996 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:00.996 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:49:00.996 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:49:00.996 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.996 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.996 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:00.996 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:49:00.996 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:49:00.996 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.996 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.996 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:00.996 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:49:00.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:49:00.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:00.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:49:00.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:49:00.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:00.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:49:00.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:49:00.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.998 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.998 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:00.998 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:49:00.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:49:00.998 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.998 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:00.998 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:00.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:00.998 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.998 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:49:00.999 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:00.999 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 64.598853559999995, 2024-09-12T22:49:00.999 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:49:00.999 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:00.999 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:00.999 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:00.999 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:00.999 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:00.999 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:00.999 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:00.999 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:00.999 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:01.000 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:01.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:01.000 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:01.000 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:49:01.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:49:01.000 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:01.001 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:49:01.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:49:01.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.001 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:01.001 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:49:01.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:49:01.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.001 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:01.001 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:49:01.004 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:49:01.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.004 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:01.004 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:49:01.004 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:49:01.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.005 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:01.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:49:01.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:49:01.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.005 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:01.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:49:01.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:49:01.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.006 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:01.006 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:49:01.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:49:01.006 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:01.006 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:01.006 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:01.006 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.006 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:49:01.006 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:01.006 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 64.598441248, 2024-09-12T22:49:01.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:49:01.007 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:01.007 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:01.007 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:01.007 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:01.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.007 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:01.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:01.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:01.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.008 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:01.008 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:01.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:01.008 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.008 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:01.008 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:01.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:49:01.008 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:01.009 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:49:01.009 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:49:01.009 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.009 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:01.009 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:49:01.009 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:49:01.009 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.009 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:01.009 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:49:01.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:49:01.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.010 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:01.010 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:49:01.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:49:01.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.010 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:01.010 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:49:01.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:49:01.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.011 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:01.011 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:49:01.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:49:01.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.011 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:01.011 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:49:01.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:49:01.011 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:01.011 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:01.011 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:01.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.012 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.012 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:49:01.012 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:01.012 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 64.464591154000004, 2024-09-12T22:49:01.012 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:49:01.012 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:01.012 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:01.012 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:01.012 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:01.012 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.012 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:01.012 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:01.012 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:01.012 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.013 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:01.013 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:01.013 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:01.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.013 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:01.013 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:01.013 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:49:01.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.013 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:01.013 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:49:01.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:49:01.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:01.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:49:01.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:49:01.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:01.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:49:01.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:49:01.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:01.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:49:01.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:49:01.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:01.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:49:01.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:49:01.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:01.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:49:01.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:49:01.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:01.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:49:01.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:49:01.016 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:01.016 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:01.016 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:01.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.016 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:01.016 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:01.017 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 55.819355600000002, 2024-09-12T22:49:01.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:49:01.017 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:01.017 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:01.017 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:01.017 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:01.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:01.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:01.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:01.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.018 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:01.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:01.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:01.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.018 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:01.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:49:01.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:49:01.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.018 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:01.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:49:01.019 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:49:01.019 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.019 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.019 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:01.019 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:49:01.019 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:49:01.019 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.019 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.019 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:01.019 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:49:01.019 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:49:01.019 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.019 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.019 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:01.020 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:01.020 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:49:01.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.020 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:01.020 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:01.020 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:49:01.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.020 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:01.021 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:49:01.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:49:01.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.021 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.021 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:01.021 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:49:01.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:49:01.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.021 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.021 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:01.021 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:49:01.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:49:01.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:01.022 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:49:01.022 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:49:01.022 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:01.022 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:49:01.022 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:49:01.022 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:01.023 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:49:01.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:49:01.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.023 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:01.023 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:49:01.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:49:01.023 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:01.023 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:01.023 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:01.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.024 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:01.024 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:01.024 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 55.819256082999999, 2024-09-12T22:49:01.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:49:01.024 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:01.024 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:01.024 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:01.024 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:01.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.024 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:01.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:01.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:01.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.025 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.025 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:01.025 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:01.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:01.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.025 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.025 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:01.025 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:49:01.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:49:01.026 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.026 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:01.026 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:49:01.026 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:49:01.026 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.027 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:01.027 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:49:01.027 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:49:01.027 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.027 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.027 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:01.027 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:49:01.027 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:49:01.027 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.027 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.027 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:01.027 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:49:01.028 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:49:01.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.028 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.028 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:01.028 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:49:01.028 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:49:01.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.028 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.028 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:01.028 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:49:01.028 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:49:01.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.029 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:01.029 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:49:01.029 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:49:01.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.029 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:01.029 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:49:01.029 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:49:01.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.029 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:01.029 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:49:01.030 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:49:01.030 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.030 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.030 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:01.030 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:49:01.030 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:49:01.030 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.030 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.030 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:01.030 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:49:01.030 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:49:01.030 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.031 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.031 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:01.031 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:49:01.031 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:49:01.031 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:01.031 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:01.031 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:01.031 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.031 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.031 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:01.031 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:01.031 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 55.819211344000003, 2024-09-12T22:49:01.031 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:49:01.032 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:01.032 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:01.032 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:01.032 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:01.032 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.032 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:01.032 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:01.032 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:01.032 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.032 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.032 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:01.032 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:01.032 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:01.032 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.033 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:01.033 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:49:01.033 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:49:01.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.033 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:01.033 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:01.033 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:49:01.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.033 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:01.033 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:01.034 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:49:01.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.034 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.034 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:01.034 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:49:01.034 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:49:01.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.034 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.034 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:01.034 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:49:01.034 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:49:01.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.034 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.035 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:01.035 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:49:01.035 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:49:01.035 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.035 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.035 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:01.035 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:49:01.035 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:49:01.035 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.035 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.035 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:01.036 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:49:01.036 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:49:01.036 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.036 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.036 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:01.036 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:49:01.036 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:49:01.036 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.036 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.036 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:01.036 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:49:01.036 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:49:01.036 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.037 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.037 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:01.037 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:49:01.037 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:49:01.037 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.037 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.037 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:01.037 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:49:01.037 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:49:01.037 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.037 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.037 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:01.037 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:49:01.038 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:49:01.038 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:01.038 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:01.038 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:01.038 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.038 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.038 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:01.038 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:01.038 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 55.818983643000003, 2024-09-12T22:49:01.038 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:49:01.038 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:01.039 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:01.039 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:01.039 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:01.039 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.039 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:01.039 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:01.039 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:01.039 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.039 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.039 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:01.040 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:01.040 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:01.040 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.040 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.040 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:01.040 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:49:01.040 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:49:01.040 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.040 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.040 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:01.040 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:49:01.040 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:49:01.040 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.041 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.041 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:01.041 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:49:01.041 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:49:01.041 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.041 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.041 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:01.041 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:49:01.041 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:49:01.041 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.041 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.041 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:01.041 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:49:01.042 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:49:01.042 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.042 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.042 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:01.042 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:49:01.042 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:49:01.042 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.042 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.042 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:01.042 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:49:01.042 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:49:01.042 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.042 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.043 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:01.043 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:49:01.043 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:49:01.043 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.043 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.043 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:01.043 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:49:01.043 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:49:01.043 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.043 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.043 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:01.043 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:49:01.044 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:49:01.044 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.044 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.044 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:01.044 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:49:01.044 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:49:01.044 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.044 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.044 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:01.044 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:49:01.044 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:49:01.044 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.045 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.045 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:01.045 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:49:01.045 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:49:01.045 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:01.045 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:01.045 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:01.045 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.045 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.045 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:01.045 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:01.045 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 55.818818534999998, 2024-09-12T22:49:01.045 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:49:01.046 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:01.046 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:01.046 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:01.046 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:01.046 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.046 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:01.046 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:01.046 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:01.046 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.046 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.046 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:01.046 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:01.047 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:01.047 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.047 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.047 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:01.047 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:49:01.047 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:49:01.047 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.047 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.047 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:01.047 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:49:01.047 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:49:01.047 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.047 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.048 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:01.048 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:49:01.048 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:49:01.048 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.048 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.048 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:01.048 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:49:01.048 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:49:01.048 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.048 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.048 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:01.049 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:49:01.049 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:49:01.049 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.049 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.049 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:01.049 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:49:01.049 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:49:01.049 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.049 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.049 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:01.049 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:49:01.049 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:49:01.050 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.050 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.050 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:01.050 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:49:01.050 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:49:01.050 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.050 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.050 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:01.050 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:49:01.051 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:49:01.051 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.051 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.051 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:01.051 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:49:01.051 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:49:01.051 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.051 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.051 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:01.051 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:49:01.051 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:49:01.051 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.051 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.052 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:01.052 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:49:01.052 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:49:01.052 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.052 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.052 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:01.052 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:49:01.052 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:49:01.052 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:01.052 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:01.052 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:01.052 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.052 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.053 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:01.053 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:01.053 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 55.818757249999997, 2024-09-12T22:49:01.053 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:49:01.053 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:01.053 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:01.053 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:01.053 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:01.053 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.053 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:01.053 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:01.053 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:01.054 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.054 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.054 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:01.054 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:01.054 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:01.054 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.054 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.054 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:01.054 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:01.054 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:49:01.054 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.054 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.055 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:01.055 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:49:01.055 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:49:01.055 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.055 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.055 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:01.055 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:49:01.055 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:49:01.055 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.055 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.055 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:01.055 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:49:01.055 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:49:01.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.056 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.056 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:01.056 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:49:01.056 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:49:01.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.056 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.056 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:01.056 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:49:01.056 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:49:01.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.056 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.057 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:01.057 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:49:01.057 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:49:01.057 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.057 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.057 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:01.057 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:49:01.057 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:49:01.057 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.057 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.057 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:01.057 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:49:01.057 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:49:01.058 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.058 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.058 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:01.058 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:49:01.058 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:49:01.058 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.058 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.058 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:01.058 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:49:01.058 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:49:01.058 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.059 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.059 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:01.059 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:49:01.059 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:49:01.059 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.059 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.059 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:01.059 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:49:01.059 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:49:01.059 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:01.059 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:01.059 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:01.059 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.060 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.060 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:01.060 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:01.060 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 55.818677141999999, 2024-09-12T22:49:01.060 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:49:01.060 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:01.060 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:01.060 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:01.060 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:01.060 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.060 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:01.061 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:01.061 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:01.061 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.061 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.061 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:01.061 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:01.061 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:01.061 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.061 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.061 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:01.061 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:49:01.061 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:49:01.062 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.062 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.062 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:01.062 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:49:01.062 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:49:01.062 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.062 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.062 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:01.062 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:49:01.062 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:49:01.062 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.062 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.063 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:01.063 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:49:01.063 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:49:01.063 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.063 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.063 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:01.063 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:49:01.063 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:49:01.063 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.063 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.063 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:01.063 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:49:01.063 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:49:01.064 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.064 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.064 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:01.064 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:49:01.064 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:49:01.064 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.064 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.064 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:01.064 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:49:01.064 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:49:01.064 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.064 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.064 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:01.065 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:49:01.065 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:49:01.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.065 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.065 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:01.065 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:49:01.065 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:49:01.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.065 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.065 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:01.065 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:49:01.065 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:49:01.066 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.066 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.066 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:01.066 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:49:01.066 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:49:01.066 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.066 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.066 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:01.066 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:49:01.066 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:49:01.066 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:01.066 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:01.067 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:01.067 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.067 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.067 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:01.067 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:01.067 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 55.818628189000002, 2024-09-12T22:49:01.067 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:49:01.067 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:01.067 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:01.067 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:01.067 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:01.067 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.068 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:01.068 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:01.068 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:01.068 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.068 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.068 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:01.068 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:01.068 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:01.068 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.068 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.068 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:01.069 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:01.069 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:49:01.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.069 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:01.069 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:49:01.069 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:49:01.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.069 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:01.069 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:49:01.069 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:49:01.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.070 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:01.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:49:01.070 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:49:01.070 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.070 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.070 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:01.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:49:01.070 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:49:01.070 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.070 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.070 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:01.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:49:01.070 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:49:01.071 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.071 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.071 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:01.071 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:49:01.071 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:49:01.071 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:01.071 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:01.071 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:01.071 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.071 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.072 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:01.072 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:01.072 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 55.818579088999996, 2024-09-12T22:49:01.072 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:49:01.072 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:01.072 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:01.072 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:01.072 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:01.072 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.072 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:01.072 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:01.072 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:01.072 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.073 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.073 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:01.073 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:01.073 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:01.073 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.073 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.073 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:01.073 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:49:01.073 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:49:01.073 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.073 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.073 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:01.073 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:49:01.074 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:49:01.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.074 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.074 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:01.074 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:49:01.074 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:49:01.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.074 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.074 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:01.074 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:49:01.074 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:49:01.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.075 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.075 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:01.075 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:49:01.075 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:49:01.075 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.075 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.075 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:01.075 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:49:01.076 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:49:01.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.076 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.076 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:01.076 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:49:01.076 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:49:01.076 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:01.076 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:01.076 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:01.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.076 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.077 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:01.077 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:01.077 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 55.811638639000002, 2024-09-12T22:49:01.077 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:49:01.077 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:01.077 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:01.077 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:01.077 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:01.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.077 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:01.077 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:01.077 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:01.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.078 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.078 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:01.078 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:01.078 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:01.078 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.078 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.078 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:01.078 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:49:01.078 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:49:01.078 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.079 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.079 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:01.079 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:49:01.079 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:49:01.079 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.079 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.079 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:01.079 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:49:01.079 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:49:01.079 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.079 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.079 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:01.079 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:49:01.079 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:49:01.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.080 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.080 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:01.080 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:49:01.080 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:49:01.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.080 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.080 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:01.080 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:49:01.080 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:49:01.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.080 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.080 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:01.081 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:49:01.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:49:01.081 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.081 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:01.081 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:49:01.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:49:01.081 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:01.081 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:01.081 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:01.081 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.081 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:01.082 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:01.082 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 55.810549799, 2024-09-12T22:49:01.082 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:49:01.082 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:01.082 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:01.082 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:01.082 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:01.082 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.082 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:01.082 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:01.082 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:01.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.082 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.082 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:01.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:01.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:01.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.083 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:01.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:49:01.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:49:01.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.083 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:01.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:49:01.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:49:01.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:01.084 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:49:01.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:49:01.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:01.084 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:49:01.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:49:01.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:01.085 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:49:01.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:49:01.085 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.085 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.085 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:01.085 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:49:01.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:49:01.085 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.085 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.085 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:01.085 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:49:01.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:49:01.085 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.085 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.086 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:01.086 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:49:01.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:49:01.086 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:01.086 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:01.086 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:01.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.086 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:01.086 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:01.086 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 55.810500187999999, 2024-09-12T22:49:01.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:49:01.087 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:01.087 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:01.087 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:01.087 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:01.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:01.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:01.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:01.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:01.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:01.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:01.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:01.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:01.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:49:01.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:01.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:01.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:49:01.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:01.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:49:01.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:49:01.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:01.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:49:01.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:49:01.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:01.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:49:01.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:49:01.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.090 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:01.090 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:49:01.090 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:49:01.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.090 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:01.090 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:49:01.090 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:49:01.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.091 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:01.091 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:49:01.091 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:49:01.091 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:01.091 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:01.091 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:01.091 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.091 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.091 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:01.091 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:01.091 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 55.810432878999997, 2024-09-12T22:49:01.091 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:49:01.092 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:01.092 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:01.092 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:01.092 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:01.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:01.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:01.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:01.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:01.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:01.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:01.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:01.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:01.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:49:01.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:01.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:49:01.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:49:01.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:01.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:49:01.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:49:01.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:01.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:49:01.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:49:01.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:01.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:49:01.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:49:01.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.095 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:01.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:49:01.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:49:01.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.095 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:01.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:49:01.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:49:01.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:01.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:49:01.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:49:01.096 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:01.096 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:01.096 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:01.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.096 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:01.096 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:01.096 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 55.809864959999999, 2024-09-12T22:49:01.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:49:01.097 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:01.097 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:01.097 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:01.097 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:01.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:01.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:01.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:01.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:01.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:01.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:01.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:01.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:01.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:49:01.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:01.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:49:01.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:49:01.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.099 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:01.099 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:49:01.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:49:01.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.099 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:01.099 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:49:01.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:49:01.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:01.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:49:01.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:49:01.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:01.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:49:01.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:49:01.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:01.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:49:01.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:49:01.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:01.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:49:01.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:49:01.101 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:01.101 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:01.101 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:01.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.102 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:49:01.102 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:01.102 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 55.809487355999998, 2024-09-12T22:49:01.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:49:01.102 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:01.102 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:01.102 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:01.102 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:01.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.102 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:01.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:01.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:01.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:01.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:01.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:01.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:01.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:49:01.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:49:01.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:01.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:49:01.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:49:01.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.104 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.104 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:01.104 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:49:01.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:49:01.104 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.104 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.104 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:01.104 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:49:01.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:49:01.104 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.104 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.104 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:01.104 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:49:01.105 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:49:01.105 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.105 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.105 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:01.105 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:49:01.105 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:49:01.105 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.105 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.105 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:01.105 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:49:01.105 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:49:01.105 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:01.105 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:01.106 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:01.106 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:49:01.106 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:49:01.106 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:01.106 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:01.106 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:01.106 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:01.106 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:01.106 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:01.106 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:49:01.107 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~29s 2024-09-12T22:49:01.108 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:01.107+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:01.109 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:01.209 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:01.208+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:01.218 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:01.218 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:01.218 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:49:01.219 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:01.227 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:01.245 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:49:01.246 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:49:01.263 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:49:01.264 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:49:01.264 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:49:01.268 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:49:01.268 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:49:01.310 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:01.309+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:01.330 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:01.330 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:01.339 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:01.412 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:01.411+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:01.476 INFO:teuthology.orchestra.run.smithi066.stderr:nodeep-scrub is set 2024-09-12T22:49:01.484 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:01.484 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:01.493 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:01.538 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:01.537+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:01.599 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:01.599 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:01.607 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:01.613 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:01.613+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:01.715 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:01.714+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:01.749 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:01.749 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:01.758 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:01.817 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:01.816+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:01.861 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:01.862 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:01.870 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:01.918 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:01.917+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:01.973 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:01.974 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:01.983 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:02.019 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:02.018+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:02.085 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:02.085 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:02.095 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:02.139 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:02.138+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:02.198 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:02.199 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:02.207 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:02.253 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:02.252+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:02.313 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:02.313 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:02.321 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:02.320+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:02.322 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:02.421 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:02.420+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:02.465 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:02.465 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:02.474 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:02.558 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:02.557+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:02.617 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:02.617 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:02.623 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:02.623+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:02.625 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:02.724 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:02.723+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:02.728 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:02.729 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:02.738 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:02.825 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:02.824+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:02.880 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:02.880 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:02.888 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:02.929 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:02.928+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:03.028 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:03.027+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:03.030 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:03.030 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:03.039 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:03.129 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:03.128+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:03.142 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:03.142 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:03.151 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:03.230 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:03.229+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:03.254 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:03.254 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:03.264 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:03.269 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:49:03.348 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:03.347+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:03.408 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:03.408 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:03.413 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:49:03.413 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:49:03.418 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:03.445 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:49:03.445 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:49:03.445 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:49:03.449 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:49:03.449 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:49:03.461 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:03.460+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:03.496 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:49:03.520 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:03.520 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:03.520 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:49:03.521 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:03.530 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:03.532 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:03.532+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:03.633 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:03.632+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:03.634 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:03.634 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:03.634 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:49:03.634 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:49:03.634 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:03.643 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:03.734 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:03.733+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:03.788 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:03.788 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:49:03.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:49:03.788 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:49:03.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.788 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:49:03.789 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:03.789 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 63.740089218999998, 2024-09-12T22:49:03.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:49:03.789 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:03.789 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:03.789 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:03.789 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:03.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:03.789 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:03.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:03.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:03.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.790 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:03.790 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:03.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:03.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:03.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.790 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:03.790 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:03.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:49:03.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:03.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:03.791 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:49:03.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:49:03.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:03.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:03.791 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:49:03.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:49:03.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:03.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:03.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:49:03.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:49:03.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:03.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:03.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:49:03.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:49:03.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:03.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:03.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:49:03.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:49:03.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:03.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:03.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:49:03.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:49:03.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:03.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:03.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:49:03.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:49:03.793 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:03.793 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:03.794 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:03.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:03.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.794 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:49:03.794 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:03.794 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 61.739708491999998, 2024-09-12T22:49:03.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:49:03.794 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:03.794 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:03.794 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:03.794 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:03.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:03.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:03.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:03.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:03.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:03.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:03.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:03.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:03.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:03.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:49:03.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:49:03.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:03.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.796 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:03.796 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:49:03.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:49:03.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:03.796 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.796 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:03.796 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:49:03.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:49:03.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:03.796 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.796 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:03.796 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:49:03.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:49:03.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:03.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:03.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:49:03.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:49:03.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:03.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:03.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:49:03.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:49:03.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:03.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:03.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:49:03.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:49:03.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:03.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:03.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:49:03.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:49:03.798 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:03.798 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:03.798 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:03.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:03.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.798 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:49:03.798 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:03.799 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 58.619111682000003, 2024-09-12T22:49:03.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:49:03.799 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:03.799 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:03.799 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:49:03.799 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:03.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:03.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:03.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:03.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:03.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:03.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:03.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:03.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:03.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.800 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:03.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:03.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:49:03.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:03.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.800 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:03.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:49:03.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:49:03.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:03.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:03.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:49:03.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:49:03.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:03.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:03.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:49:03.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:49:03.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:03.802 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.802 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:03.802 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:49:03.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:49:03.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:03.802 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.802 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:03.802 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:49:03.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:49:03.802 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:03.803 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:03.803 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:03.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:03.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.803 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:03.803 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:03.803 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 58.616503502, 2024-09-12T22:49:03.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:49:03.803 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:03.803 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:03.803 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:03.804 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:03.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:03.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:03.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:03.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:03.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:03.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:03.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:03.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:03.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:03.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:49:03.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:49:03.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:03.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:03.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:49:03.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:49:03.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:03.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:03.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:49:03.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:49:03.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:03.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:03.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:49:03.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:49:03.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:03.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:03.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:49:03.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:49:03.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:03.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:03.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:49:03.807 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:49:03.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:03.807 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:03.807 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:03.807 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:49:03.807 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:49:03.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:03.807 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:04.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:49:04.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:49:04.062 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.062 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:04.062 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.062 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:04.063 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:04.063 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 58.615610279000002, 2024-09-12T22:49:04.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:49:04.063 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:04.063 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:04.063 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.063 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:04.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:04.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:04.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:04.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:04.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:04.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:49:04.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:49:04.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:04.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:49:04.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:49:04.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:04.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:49:04.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:49:04.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:49:04.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:49:04.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:04.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:49:04.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:49:04.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:04.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:49:04.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:49:04.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:04.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:49:04.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:49:04.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:04.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:49:04.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:49:04.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:04.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:49:04.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:49:04.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:04.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:49:04.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:49:04.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:04.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:49:04.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:49:04.071 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.072 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:04.072 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.072 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:04.072 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:04.072 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 58.615538620999999, 2024-09-12T22:49:04.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:49:04.072 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:04.076 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:04.076 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.076 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:04.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:04.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:04.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:04.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:04.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:04.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:49:04.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:49:04.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:04.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:49:04.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:49:04.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:04.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:49:04.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:49:04.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:49:04.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:49:04.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:04.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:49:04.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:49:04.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:04.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:49:04.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:49:04.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:04.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:49:04.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:49:04.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:04.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:49:04.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:49:04.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:04.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:49:04.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:49:04.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:04.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:49:04.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:49:04.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:04.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:49:04.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:49:04.082 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.082 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:04.082 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.083 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:04.083 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:04.083 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 58.615495903000003, 2024-09-12T22:49:04.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:49:04.083 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:04.083 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:04.083 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.083 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:04.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:04.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:04.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:04.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:04.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:04.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:49:04.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:49:04.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:04.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:49:04.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:49:04.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:04.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:49:04.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:49:04.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:49:04.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:49:04.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:04.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:49:04.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:49:04.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:04.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:49:04.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:49:04.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:04.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:49:04.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:49:04.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:04.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:49:04.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:49:04.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:04.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:49:04.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:49:04.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:04.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:49:04.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:49:04.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:04.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:49:04.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:49:04.089 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.089 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:04.089 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.089 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:04.089 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:04.089 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 58.615457986000003, 2024-09-12T22:49:04.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:49:04.089 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:04.089 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:04.089 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.090 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:04.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:04.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:04.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:04.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:04.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:49:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:49:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:49:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:49:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:49:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:49:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:49:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:49:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:49:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:49:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:49:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:49:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:49:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:49:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:49:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:49:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:49:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:49:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:49:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:04.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:49:04.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:49:04.095 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.095 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:04.095 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 58.615434534999999, 2024-09-12T22:49:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:49:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:04.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:04.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:04.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:49:04.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:49:04.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:04.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:49:04.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:49:04.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:04.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:49:04.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:49:04.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:49:04.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:49:04.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:04.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:49:04.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:49:04.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:04.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:49:04.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:49:04.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:04.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:04.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:49:04.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:04.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:49:04.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:49:04.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:04.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:49:04.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:49:04.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:04.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:49:04.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:49:04.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:04.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:49:04.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:49:04.104 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.104 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:04.104 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.104 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:04.104 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:04.105 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 58.615410298, 2024-09-12T22:49:04.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:49:04.105 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:04.105 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:04.105 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.105 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:04.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:04.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:04.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:04.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:04.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:04.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:04.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:49:04.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:04.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:49:04.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:49:04.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:04.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:49:04.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:49:04.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:49:04.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:49:04.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:04.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:49:04.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:49:04.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:04.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:49:04.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:49:04.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:04.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:49:04.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:49:04.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:04.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:49:04.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:49:04.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:04.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:49:04.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:49:04.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:04.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:49:04.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:49:04.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:04.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:49:04.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:49:04.114 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.114 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:04.114 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.114 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:04.114 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:04.114 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 58.615382381000003, 2024-09-12T22:49:04.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:49:04.114 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:04.115 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:04.115 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:04.115 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:04.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:04.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:04.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:04.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:04.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:04.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:04.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:49:04.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:04.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:49:04.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:49:04.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:04.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:49:04.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:49:04.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:49:04.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:49:04.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:04.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:49:04.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:49:04.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:04.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:49:04.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:49:04.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:04.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:49:04.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:49:04.118 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.118 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:04.118 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.118 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:04.118 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:04.119 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 58.615307885999997, 2024-09-12T22:49:04.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:49:04.119 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:04.119 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:04.119 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:04.119 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:04.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:04.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:04.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:04.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:04.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:04.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:49:04.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:49:04.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:04.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:49:04.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:49:04.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:04.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:49:04.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:49:04.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:49:04.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:49:04.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:04.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:49:04.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:49:04.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:04.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:49:04.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:49:04.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:04.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:49:04.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:49:04.122 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.122 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:04.122 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.123 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:04.123 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:04.123 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 58.615261857999997, 2024-09-12T22:49:04.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:49:04.123 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:04.123 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:04.123 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:04.123 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:04.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:04.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:04.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:04.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:04.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:04.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:49:04.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:49:04.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:04.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:49:04.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:49:04.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:04.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:49:04.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:49:04.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:49:04.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:49:04.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:04.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:49:04.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:49:04.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:04.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:49:04.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:49:04.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:04.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:49:04.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:49:04.127 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.127 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:04.127 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.127 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:04.127 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:04.127 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 58.613090974000002, 2024-09-12T22:49:04.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:49:04.127 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:04.127 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:04.127 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.127 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:04.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:04.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:04.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:04.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:04.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:04.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:04.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:49:04.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:04.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:49:04.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:49:04.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:04.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:49:04.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:49:04.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:04.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:49:04.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:04.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:49:04.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:49:04.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:04.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:04.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:49:04.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:04.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:49:04.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:49:04.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:04.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:49:04.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:49:04.131 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.131 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:04.131 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.132 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:04.132 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:04.132 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 58.613040523999999, 2024-09-12T22:49:04.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:49:04.132 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:04.132 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:04.132 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.132 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:04.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:04.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:04.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:04.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:04.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:04.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:49:04.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:49:04.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:04.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:49:04.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:49:04.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:04.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:49:04.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:49:04.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:49:04.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:49:04.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:04.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:49:04.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:49:04.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:04.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:49:04.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:49:04.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:04.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:49:04.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:49:04.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:04.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:49:04.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:49:04.136 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.136 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:04.136 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.136 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:04.136 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:04.136 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 58.612987085999997, 2024-09-12T22:49:04.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:49:04.137 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:04.137 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:04.137 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.137 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:04.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:04.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:04.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:04.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:04.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:04.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:04.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:49:04.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:04.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:49:04.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:49:04.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:04.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:04.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:49:04.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:49:04.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:49:04.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:04.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:49:04.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:49:04.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:04.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:49:04.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:49:04.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:04.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:49:04.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:49:04.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:04.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:49:04.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:49:04.141 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.141 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:04.141 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.141 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:49:04.141 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:04.141 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 58.609002732999997, 2024-09-12T22:49:04.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:49:04.141 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:04.141 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:04.141 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:04.141 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:04.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:04.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:04.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:04.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:04.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:04.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:49:04.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:49:04.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:04.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:49:04.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:49:04.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:04.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:49:04.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:49:04.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:49:04.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:49:04.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:04.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:49:04.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:49:04.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:04.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:49:04.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:49:04.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:04.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:49:04.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:49:04.145 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.145 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:04.145 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.145 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:49:04.145 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:04.145 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 56.623850193999999, 2024-09-12T22:49:04.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:49:04.146 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:04.146 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:04.146 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.146 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:04.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:04.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:04.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:04.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:04.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:04.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:49:04.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:49:04.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:04.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:49:04.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:49:04.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:04.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:49:04.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:49:04.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:49:04.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:49:04.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:04.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:49:04.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:49:04.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:04.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:49:04.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:49:04.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:04.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:49:04.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:49:04.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:04.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:49:04.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:49:04.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:04.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:49:04.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:49:04.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:04.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:49:04.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:49:04.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:04.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:49:04.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:49:04.151 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.151 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:04.151 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.151 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:49:04.151 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:04.151 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.621933949000002, 2024-09-12T22:49:04.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:49:04.151 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:04.151 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:04.151 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.152 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:04.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:04.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:04.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:04.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:04.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:04.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:49:04.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:49:04.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:04.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:49:04.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:49:04.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:04.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:49:04.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:49:04.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:49:04.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:49:04.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:04.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:49:04.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:49:04.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:04.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:49:04.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:49:04.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:04.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:49:04.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:49:04.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:04.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:49:04.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:49:04.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:04.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:49:04.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:49:04.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:04.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:49:04.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:49:04.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:04.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:49:04.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:49:04.156 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.157 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:04.157 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.157 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:49:04.157 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:04.157 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.621180574, 2024-09-12T22:49:04.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012160610000000001, 2024-09-12T22:49:04.157 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:04.157 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:04.157 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.157 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:04.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:04.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:04.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:04.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:04.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:04.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164967+0000", 2024-09-12T22:49:04.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:49:04.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:04.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164974+0000", 2024-09-12T22:49:04.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:49:04.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:04.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164987+0000", 2024-09-12T22:49:04.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3689000000000001e-05 2024-09-12T22:49:04.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164995+0000", 2024-09-12T22:49:04.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2959999999999999e-06 2024-09-12T22:49:04.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:04.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165068+0000", 2024-09-12T22:49:04.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2449999999999999e-05 2024-09-12T22:49:04.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:04.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165212+0000", 2024-09-12T22:49:04.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144117 2024-09-12T22:49:04.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.161 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:04.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166066+0000", 2024-09-12T22:49:04.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085441100000000002 2024-09-12T22:49:04.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.161 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:04.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166107+0000", 2024-09-12T22:49:04.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0450000000000001e-05 2024-09-12T22:49:04.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.161 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:04.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166181+0000", 2024-09-12T22:49:04.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-12T22:49:04.162 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.162 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:04.162 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.162 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.162 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:04.162 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:04.163 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:04.162+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:04.164 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:04.263 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:04.263+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:04.270 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:04.270 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:04.270 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:49:04.271 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:04.281 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:04.365 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:04.364+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:04.383 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:04.383 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:04.383 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:49:04.383 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:49:04.383 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:04.392 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:04.466 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:04.465+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:04.485 INFO:teuthology.orchestra.run.smithi066.stderr:noscrub is unset 2024-09-12T22:49:04.497 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:04.497 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:49:04.497 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:49:04.497 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:49:04.497 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.497 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:49:04.497 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:04.497 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 68.111153174999998, 2024-09-12T22:49:04.497 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:49:04.498 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:04.498 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:04.498 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.498 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:04.498 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.498 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:04.498 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:04.498 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.498 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.498 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.498 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:04.498 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:04.498 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.499 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.499 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.499 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:04.499 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:04.499 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:49:04.499 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.499 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.499 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:04.499 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:49:04.499 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:49:04.499 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.499 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.499 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:04.500 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:49:04.500 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:49:04.500 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.500 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.500 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.500 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:49:04.500 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:49:04.500 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.500 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.500 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:04.500 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:49:04.500 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:49:04.501 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.501 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.501 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:04.501 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:49:04.501 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:49:04.501 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.501 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.501 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:04.501 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:49:04.501 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:49:04.501 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.501 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.502 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:04.502 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:49:04.502 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:49:04.502 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.502 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:04.502 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.502 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.502 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.502 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:49:04.502 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:04.502 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 68.110710592000004, 2024-09-12T22:49:04.503 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:49:04.503 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:04.503 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:04.503 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.503 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:04.503 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.503 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:04.503 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:04.503 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.503 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.503 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.503 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:04.503 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:04.504 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.504 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.504 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.504 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:04.504 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:49:04.504 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:49:04.504 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.504 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.504 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:04.504 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:49:04.504 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:49:04.504 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.505 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.505 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:04.505 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:49:04.505 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:49:04.505 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.505 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.505 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.505 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:49:04.505 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:49:04.505 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.505 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.506 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:04.506 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:49:04.506 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:49:04.506 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.506 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.506 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:04.506 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:49:04.506 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:49:04.506 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.506 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.506 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:04.507 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:49:04.507 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:49:04.507 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.507 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.507 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:04.507 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:49:04.507 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:49:04.507 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.507 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:04.507 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.507 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.507 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.507 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:49:04.508 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:04.508 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 68.110344435000002, 2024-09-12T22:49:04.508 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:49:04.508 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:04.508 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:04.508 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.508 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:04.508 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.508 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:04.508 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:04.508 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.508 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.509 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.509 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:04.509 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:04.509 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.509 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.509 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.509 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:04.509 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:49:04.509 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:49:04.509 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.509 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.509 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:04.510 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:49:04.510 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:49:04.510 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.510 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.510 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:04.510 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:49:04.510 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:49:04.510 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.510 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.510 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.510 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:49:04.510 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:49:04.511 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.511 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.511 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:04.511 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:49:04.511 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:49:04.511 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.511 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.511 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:04.511 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:49:04.511 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:49:04.511 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.511 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.511 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:04.511 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:49:04.512 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:49:04.512 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.512 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.512 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:04.512 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:49:04.512 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:49:04.513 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.513 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:04.513 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.513 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.513 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.513 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:49:04.513 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:04.513 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 68.109932122999993, 2024-09-12T22:49:04.513 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:49:04.513 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:04.513 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:04.513 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.514 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:04.514 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.514 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:04.514 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:04.514 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.514 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.514 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.514 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:04.514 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:04.514 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.514 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.514 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.514 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:04.514 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:04.515 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:49:04.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.515 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.515 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:04.515 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:49:04.515 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:49:04.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.515 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.515 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:04.515 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:49:04.515 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:49:04.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.515 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.516 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.516 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:49:04.516 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:49:04.516 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.516 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.516 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:04.516 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:49:04.516 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:49:04.517 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.517 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.517 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:04.517 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:49:04.517 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:49:04.517 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.517 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.517 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:04.517 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:49:04.517 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:49:04.517 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.517 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.517 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:04.518 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:49:04.518 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:49:04.518 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.518 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:04.518 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.518 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.518 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.518 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:49:04.518 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:04.518 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 67.976082028999997, 2024-09-12T22:49:04.518 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:49:04.519 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:04.519 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:04.519 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.519 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:04.519 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.519 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:04.519 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:04.519 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.519 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.519 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.519 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:04.519 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:04.519 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.520 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.520 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.520 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:04.520 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:04.520 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:49:04.520 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.520 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.520 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:04.520 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:49:04.520 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:49:04.520 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.520 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.521 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:04.521 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:49:04.521 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:49:04.521 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.521 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.521 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.521 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:49:04.521 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:49:04.521 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.521 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.521 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:04.522 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:49:04.522 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:49:04.522 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.522 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.522 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:04.522 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:49:04.522 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:49:04.522 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.522 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.522 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:04.522 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:49:04.523 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:49:04.523 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.523 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.523 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:04.523 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:49:04.523 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:49:04.523 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.523 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:04.523 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.523 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.523 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.524 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:04.524 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:04.524 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 59.330846475000001, 2024-09-12T22:49:04.524 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:49:04.524 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:04.524 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:04.524 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.524 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:04.524 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.524 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:04.524 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:04.524 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.525 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.525 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.525 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:04.525 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:04.525 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.525 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.525 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.525 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:04.525 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:49:04.525 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:49:04.525 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.526 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.526 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:04.526 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:49:04.526 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:49:04.526 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.526 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.526 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:04.526 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:49:04.526 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:49:04.526 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.526 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.526 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.527 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:49:04.527 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:49:04.527 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.527 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.527 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:04.527 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:04.527 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:49:04.527 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.527 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.527 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:04.527 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:04.527 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:49:04.528 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.528 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.528 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:04.528 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:49:04.528 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:49:04.528 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.528 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.528 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:04.528 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:49:04.528 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:49:04.528 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.528 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.529 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:04.529 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:49:04.529 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:49:04.529 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.529 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.529 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:04.529 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:49:04.529 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:49:04.529 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.529 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.529 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:04.529 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:49:04.529 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:49:04.530 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.530 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.530 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:04.530 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:49:04.530 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:49:04.530 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.530 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.530 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:04.530 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:49:04.530 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:49:04.530 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.530 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:04.531 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.531 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.531 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.531 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:04.531 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:04.531 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 59.330746957999999, 2024-09-12T22:49:04.531 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:49:04.531 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:04.531 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:04.531 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.531 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:04.532 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.532 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:04.532 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:04.532 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.532 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.532 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.532 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:04.532 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:04.532 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.532 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.532 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.532 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:04.533 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:49:04.533 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:49:04.533 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.533 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.533 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:04.533 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:49:04.533 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:49:04.533 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.533 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.533 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:04.533 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:49:04.533 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:49:04.533 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.533 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.534 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.534 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:49:04.534 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:49:04.534 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.534 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.534 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:04.534 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:49:04.534 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:49:04.534 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.534 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.534 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:04.534 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:49:04.534 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:49:04.534 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.535 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.535 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:04.535 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:49:04.535 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:49:04.535 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.535 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.535 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:04.535 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:49:04.535 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:49:04.535 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.535 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.535 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:04.535 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:49:04.535 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:49:04.535 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.536 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.536 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:04.536 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:49:04.536 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:49:04.536 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.536 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.536 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:04.536 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:49:04.536 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:49:04.536 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.536 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.536 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:04.536 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:49:04.537 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:49:04.537 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.537 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.537 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:04.537 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:49:04.537 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:49:04.537 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.537 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:04.537 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.537 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.537 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.537 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:04.538 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:04.538 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 59.330702219000003, 2024-09-12T22:49:04.538 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:49:04.538 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:04.538 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:04.538 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.538 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:04.538 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.538 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:04.538 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:04.538 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.538 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.539 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.539 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:04.539 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:04.539 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.539 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.539 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.539 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:04.539 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:49:04.539 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:49:04.539 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.539 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.539 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:04.539 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:04.539 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:49:04.540 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.540 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.540 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:04.540 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:04.540 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:49:04.540 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.540 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.540 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.540 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:49:04.540 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:49:04.540 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.540 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.541 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:04.541 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:49:04.541 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:49:04.541 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.541 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.541 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:04.541 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:49:04.541 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:49:04.541 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.541 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.541 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:04.541 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:49:04.541 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:49:04.542 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.542 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.542 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:04.542 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:49:04.542 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:49:04.542 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.542 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.542 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:04.542 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:49:04.542 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:49:04.542 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.542 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.542 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:04.543 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:49:04.543 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:49:04.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.543 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.543 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:04.543 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:49:04.543 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:49:04.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.543 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.543 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:04.543 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:49:04.543 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:49:04.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.543 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.544 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:04.544 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:49:04.544 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:49:04.544 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.544 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:04.544 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.544 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.544 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.544 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:04.544 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:04.544 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 59.330474518000003, 2024-09-12T22:49:04.545 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:49:04.545 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:04.545 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:04.545 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.545 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:04.545 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.545 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:04.545 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:04.545 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.545 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.545 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.545 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:04.545 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:04.546 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.546 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.546 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.546 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:04.546 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:49:04.546 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:49:04.546 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.546 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.546 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:04.546 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:49:04.546 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:49:04.546 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.547 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.547 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:04.547 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:49:04.547 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:49:04.547 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.547 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.547 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.547 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:49:04.547 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:49:04.547 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.547 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.547 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:04.547 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:49:04.548 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:49:04.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.548 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.548 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:04.548 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:49:04.548 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:49:04.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.548 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.548 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:04.548 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:49:04.548 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:49:04.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.548 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.549 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:04.549 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:49:04.549 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:49:04.549 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.549 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.549 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:04.549 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:49:04.549 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:49:04.549 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.549 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.549 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:04.549 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:49:04.549 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:49:04.550 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.550 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.550 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:04.550 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:49:04.550 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:49:04.550 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.550 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.550 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:04.550 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:49:04.550 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:49:04.550 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.550 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.551 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:04.551 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:49:04.551 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:49:04.551 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.551 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:04.551 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.551 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.551 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:04.551 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:04.551 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 59.330309409999998, 2024-09-12T22:49:04.551 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:49:04.552 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:04.552 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:04.552 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.552 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:04.552 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.552 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:04.552 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:04.552 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.552 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.552 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.552 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:04.552 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:04.552 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.553 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.553 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.553 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:04.553 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:49:04.553 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:49:04.553 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.553 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.553 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:04.553 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:49:04.553 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:49:04.553 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.553 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.553 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:04.554 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:49:04.554 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:49:04.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.554 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.554 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.554 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:49:04.554 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:49:04.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.554 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.554 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:04.554 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:49:04.554 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:49:04.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.555 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.555 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:04.555 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:49:04.555 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:49:04.555 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.555 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.555 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:04.555 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:49:04.555 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:49:04.555 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.555 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.555 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:04.555 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:49:04.556 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:49:04.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.556 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:04.556 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:49:04.556 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:49:04.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.556 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:04.556 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:49:04.556 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:49:04.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.557 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:04.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:49:04.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:49:04.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.557 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.557 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:04.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:49:04.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:49:04.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.557 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.557 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:04.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:49:04.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:49:04.558 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.558 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:04.558 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.558 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.558 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.558 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:04.558 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:04.558 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 59.330248124999997, 2024-09-12T22:49:04.558 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:49:04.558 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:04.558 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:04.558 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.559 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:04.559 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.559 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:04.559 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:04.559 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.559 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.559 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.559 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:04.559 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:04.559 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.559 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.559 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.560 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:04.560 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:04.560 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:49:04.560 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.560 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.560 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:04.560 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:49:04.560 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:49:04.560 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.560 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.560 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:04.560 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:49:04.561 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:49:04.561 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.561 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.561 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.561 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:49:04.561 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:49:04.561 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.561 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.561 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:04.561 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:49:04.561 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:49:04.561 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.561 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.562 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:04.562 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:49:04.562 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:49:04.562 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.562 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.562 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:04.562 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:49:04.562 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:49:04.562 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.562 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.562 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:04.562 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:49:04.562 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:49:04.563 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.563 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.563 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:04.563 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:49:04.563 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:49:04.563 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.563 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.563 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:04.563 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:49:04.563 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:49:04.563 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.563 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.563 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:04.563 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:49:04.564 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:49:04.564 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.564 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.564 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:04.564 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:49:04.564 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:49:04.564 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.564 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.564 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:04.564 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:49:04.564 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:49:04.564 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.564 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:04.564 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.565 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.565 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.565 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:04.565 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:04.565 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 59.330168016999998, 2024-09-12T22:49:04.565 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:49:04.565 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:04.565 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:04.565 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.565 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:04.565 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.565 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:04.565 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:04.566 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.566 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.566 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.566 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:04.566 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:04.566 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.566 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.566 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.566 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:04.566 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:49:04.566 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:49:04.566 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.566 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.566 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:04.567 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:49:04.567 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:49:04.567 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.567 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.567 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:04.567 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:49:04.567 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:49:04.567 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.567 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.567 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.567 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:49:04.567 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:49:04.567 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.567 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.567 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:04.568 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:49:04.568 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:49:04.568 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.568 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.568 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:04.568 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:49:04.568 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:49:04.568 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.568 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.568 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:04.568 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:49:04.569 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:49:04.569 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.569 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.569 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:04.569 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:49:04.569 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:49:04.569 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.569 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.569 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:04.570 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:49:04.570 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:49:04.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.570 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.570 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:04.570 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:49:04.570 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:49:04.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.570 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.570 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:04.570 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:49:04.570 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:49:04.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.571 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.571 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:04.571 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:49:04.571 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:49:04.571 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.571 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.571 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:04.571 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:49:04.571 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:49:04.571 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.571 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:04.571 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.571 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.571 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.572 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:04.572 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:04.572 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 59.330119064000002, 2024-09-12T22:49:04.572 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:49:04.572 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:04.572 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:04.572 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:04.572 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:04.572 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.572 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:04.572 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:04.572 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.572 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.572 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.573 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:04.573 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:04.573 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.573 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:04.573 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:04.573 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:49:04.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.573 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:04.573 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:49:04.573 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:49:04.574 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.574 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.574 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:04.574 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:49:04.574 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:49:04.574 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.574 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.574 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.574 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:49:04.574 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:49:04.574 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.574 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.574 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:04.574 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:49:04.574 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:49:04.575 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.575 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.575 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:04.575 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:49:04.575 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:49:04.575 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.575 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.575 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:04.575 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:49:04.575 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:49:04.575 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.575 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:04.575 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.575 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.576 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.576 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:04.576 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:04.576 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 59.330069964000003, 2024-09-12T22:49:04.576 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:49:04.576 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:04.576 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:04.576 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:04.576 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:04.576 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.576 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:04.576 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:04.577 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.577 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.577 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.577 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:04.577 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:04.577 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.577 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.577 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.577 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:04.577 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:49:04.577 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:49:04.578 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.578 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.578 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:04.578 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:49:04.578 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:49:04.578 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.578 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.578 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:04.578 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:49:04.578 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:49:04.578 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.578 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.578 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.579 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:49:04.579 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:49:04.579 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.579 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.579 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:04.579 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:49:04.579 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:49:04.579 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.579 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.579 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:04.579 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:49:04.579 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:49:04.579 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.580 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.580 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:04.580 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:49:04.580 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:49:04.580 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.580 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:04.580 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.580 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.580 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.580 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:04.580 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:04.580 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 59.323129514000001, 2024-09-12T22:49:04.580 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:49:04.580 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:04.581 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:04.581 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.581 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:04.581 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.581 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:04.581 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:04.581 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.581 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.582 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.582 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:04.582 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:04.582 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.582 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.582 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.582 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:04.582 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:49:04.582 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:49:04.582 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.582 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.582 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:04.583 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:49:04.583 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:49:04.583 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.583 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.583 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:04.583 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:49:04.583 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:49:04.583 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.583 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.583 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.583 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:49:04.583 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:49:04.583 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.584 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.584 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:04.584 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:49:04.584 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:49:04.584 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.584 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.584 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:04.584 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:49:04.584 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:49:04.584 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.584 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.584 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:04.584 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:49:04.585 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:49:04.585 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.585 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.585 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:04.585 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:49:04.585 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:49:04.585 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.585 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:04.585 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.585 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.585 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.585 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:04.585 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:04.586 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 59.322040674, 2024-09-12T22:49:04.586 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:49:04.586 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:04.586 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:04.586 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.586 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:04.586 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.586 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:04.586 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:04.586 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.586 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.586 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.586 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:04.587 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:04.587 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.587 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.587 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.587 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:04.587 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:49:04.587 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:49:04.587 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.587 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.587 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:04.587 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:49:04.587 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:49:04.587 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.588 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.588 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:04.588 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:49:04.588 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:49:04.588 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.588 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.588 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.588 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:49:04.588 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:49:04.588 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.588 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.588 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:04.588 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:49:04.589 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:49:04.589 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.589 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.589 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:04.589 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:49:04.589 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:49:04.589 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.589 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.589 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:04.589 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:49:04.589 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:49:04.589 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.589 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.590 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:04.590 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:49:04.590 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:49:04.590 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.590 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:04.590 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.590 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.590 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.590 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:04.590 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:04.590 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 59.321991062999999, 2024-09-12T22:49:04.591 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:49:04.591 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:04.591 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:04.591 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.591 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:04.591 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.591 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:04.591 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:04.591 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.591 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.591 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.591 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:04.591 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:04.592 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.592 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.592 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.592 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:04.592 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:04.592 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:49:04.592 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.592 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.592 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:04.592 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:04.592 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:49:04.592 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.593 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.593 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:04.593 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:49:04.593 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:49:04.593 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.593 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.593 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.593 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:49:04.593 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:49:04.593 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.593 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.593 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:04.594 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:49:04.594 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:49:04.594 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.594 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.594 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:04.594 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:49:04.594 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:49:04.594 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.594 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.594 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:04.594 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:49:04.594 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:49:04.595 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.595 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.595 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:04.595 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:49:04.595 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:49:04.595 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.595 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:04.595 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.595 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.595 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.595 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:04.595 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:04.595 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 59.321923753999997, 2024-09-12T22:49:04.596 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:49:04.596 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:04.596 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:04.596 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.596 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:04.596 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.596 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:04.596 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:04.596 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.596 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.596 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.596 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:04.597 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:04.597 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.597 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.597 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.597 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:04.597 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:04.597 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:49:04.597 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.597 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.597 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:04.597 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:49:04.597 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:49:04.597 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.598 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.598 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:04.598 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:49:04.598 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:49:04.598 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.598 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.598 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.598 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:49:04.598 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:49:04.598 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.598 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.598 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:04.599 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:49:04.599 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:49:04.599 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.599 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.599 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:04.599 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:49:04.599 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:49:04.599 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.599 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.599 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:04.599 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:49:04.599 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:49:04.599 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.600 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.600 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:04.600 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:49:04.600 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:49:04.600 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.600 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:04.600 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.600 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.600 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.600 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:04.600 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:04.600 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 59.321355834999999, 2024-09-12T22:49:04.601 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:49:04.601 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:04.601 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:04.601 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.601 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:04.601 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.601 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:04.601 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:04.601 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.601 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.601 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.601 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:04.601 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:04.602 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.602 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:04.602 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:04.602 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:49:04.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.602 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:04.602 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:49:04.602 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:49:04.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.602 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:04.603 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:49:04.603 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:49:04.603 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.603 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.603 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.603 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:49:04.603 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:49:04.603 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.603 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.603 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:04.603 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:49:04.603 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:49:04.603 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.604 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.604 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:04.604 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:49:04.604 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:49:04.604 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.604 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.604 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:04.604 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:49:04.604 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:49:04.604 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.604 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.604 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:04.605 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:49:04.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:49:04.605 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.605 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:04.605 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.605 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.605 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.605 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:49:04.605 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:04.605 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 59.320978230999998, 2024-09-12T22:49:04.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:49:04.605 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:04.605 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:04.606 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.606 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:04.606 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.606 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:04.606 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:04.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.606 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.606 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:04.606 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:04.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:04.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.606 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.607 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:04.607 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:49:04.607 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:49:04.607 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.607 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.607 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:04.607 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:49:04.607 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:49:04.607 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.607 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.607 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:04.607 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:49:04.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:49:04.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.608 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.608 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:49:04.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:49:04.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.608 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:04.608 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:49:04.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:49:04.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:04.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:49:04.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:49:04.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:04.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:49:04.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:49:04.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:04.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:04.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:04.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:49:04.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:49:04.610 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.610 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:04.610 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.610 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:04.610 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:04.610 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:04.612 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:04.613 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:04.610+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:04.712 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:04.711+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:04.721 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:04.721 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:04.721 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:49:04.722 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:04.730 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:04.813 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:04.812+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:04.833 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:04.833 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:04.833 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:49:04.833 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:49:04.833 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:04.842 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:04.915 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:04.913+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:04.946 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:04.946 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:49:04.946 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:49:04.946 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:49:04.947 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.947 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:49:04.947 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:04.947 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.898291424000007, 2024-09-12T22:49:04.947 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:49:04.947 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:04.947 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:04.947 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.947 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:04.947 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.947 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:04.947 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:04.947 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.948 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.948 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.948 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:04.948 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:04.948 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.948 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.948 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.948 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:04.948 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:04.948 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:49:04.948 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.949 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.949 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:04.949 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:49:04.949 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:49:04.949 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.949 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.949 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:04.949 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:49:04.949 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:49:04.949 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.949 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.949 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.949 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:49:04.950 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:49:04.950 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.950 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.950 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:04.950 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:49:04.950 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:49:04.950 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.950 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.950 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:04.950 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:49:04.950 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:49:04.950 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.951 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.951 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:04.951 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:49:04.951 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:49:04.951 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.951 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.951 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:04.951 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:49:04.951 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:49:04.951 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.952 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:04.952 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.952 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.952 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.952 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:49:04.952 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:04.952 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 62.897910697, 2024-09-12T22:49:04.952 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:49:04.952 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:04.952 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:04.952 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.952 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:04.952 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.953 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:04.953 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:04.953 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.953 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.953 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.953 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:04.953 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:04.953 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.953 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.953 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.953 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:04.953 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:49:04.953 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:49:04.954 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.954 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.954 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:04.954 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:49:04.954 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:49:04.954 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.954 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.954 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:04.954 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:49:04.954 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:49:04.954 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.954 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.954 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.955 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:49:04.955 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:49:04.955 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.955 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.955 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:04.955 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:49:04.955 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:49:04.955 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.955 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.955 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:04.955 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:49:04.955 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:49:04.955 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.956 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.956 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:04.956 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:49:04.956 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:49:04.956 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.956 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.956 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:04.956 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:49:04.956 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:49:04.956 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.956 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:04.956 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.956 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.957 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.957 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:49:04.957 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:04.957 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.777313886999998, 2024-09-12T22:49:04.957 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:49:04.957 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:04.957 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:04.957 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:49:04.957 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:04.957 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.957 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:04.957 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:04.957 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.958 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.958 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:04.958 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:04.958 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.958 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.958 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.958 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:04.958 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:04.959 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:49:04.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.959 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.959 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:04.959 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:49:04.959 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:49:04.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.959 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.959 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:04.959 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:49:04.959 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:49:04.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.959 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.959 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.960 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:49:04.960 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:49:04.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.960 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.960 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:04.960 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:49:04.960 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:49:04.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.960 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.960 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:04.960 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:49:04.960 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:49:04.960 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.961 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:04.961 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.961 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.961 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.961 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:04.961 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:04.961 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.774705707000003, 2024-09-12T22:49:04.961 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:49:04.961 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:04.961 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:04.961 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.962 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:04.962 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.962 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:04.962 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:04.962 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.962 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.962 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.962 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:04.963 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:04.963 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.963 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.963 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.963 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:04.963 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:49:04.963 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:49:04.963 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.963 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.963 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:04.963 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:49:04.964 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:49:04.964 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.964 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.964 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:04.964 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:49:04.964 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:49:04.964 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.964 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.964 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.964 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:49:04.965 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:49:04.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.965 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:04.965 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:49:04.965 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:49:04.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.965 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:04.966 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:49:04.966 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:49:04.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.966 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.966 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:04.966 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:49:04.966 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:49:04.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.966 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.966 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:04.966 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:49:04.966 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:49:04.967 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.967 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:04.967 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.967 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.967 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.967 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:04.967 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:04.967 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.773812483999997, 2024-09-12T22:49:04.967 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:49:04.967 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:04.967 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:04.967 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.967 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:04.968 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.968 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:04.968 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:04.968 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.968 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.968 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.968 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:04.968 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:04.968 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.968 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.969 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.969 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:04.969 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:49:04.969 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:49:04.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.969 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.969 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:04.969 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:49:04.970 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:49:04.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.970 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.970 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:04.970 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:49:04.970 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:49:04.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.970 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.971 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.971 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:49:04.971 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:49:04.971 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.971 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.971 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:04.971 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:49:04.971 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:49:04.971 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.971 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.971 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:04.971 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:49:04.972 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:49:04.972 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.972 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.972 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:04.972 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:49:04.972 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:49:04.972 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.973 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.973 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:04.973 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:49:04.973 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:49:04.973 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.973 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.973 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:04.973 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:49:04.973 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:49:04.973 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.973 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.973 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:04.973 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:49:04.974 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:49:04.974 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.974 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.974 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:04.974 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:49:04.974 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:49:04.974 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.974 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:04.974 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.974 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.974 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.974 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:04.974 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:04.974 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.773740826000001, 2024-09-12T22:49:04.975 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:49:04.975 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:04.975 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:04.975 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.975 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:04.975 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.975 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:04.975 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:04.975 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.975 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.975 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.975 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:04.975 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:04.976 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.976 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.976 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.976 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:04.976 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:49:04.976 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:49:04.976 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.976 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.976 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:04.976 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:49:04.976 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:49:04.977 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.977 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.977 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:04.977 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:49:04.977 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:49:04.977 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.977 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.977 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.977 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:49:04.977 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:49:04.977 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.977 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.978 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:04.978 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:49:04.978 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:49:04.978 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.978 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.978 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:04.978 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:49:04.978 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:49:04.978 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.978 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.978 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:04.978 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:49:04.978 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:49:04.978 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.979 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.979 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:04.979 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:49:04.979 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:49:04.979 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.979 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.979 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:04.979 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:49:04.979 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:49:04.979 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.979 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.979 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:04.979 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:49:04.980 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:49:04.980 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.980 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.980 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:04.980 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:49:04.980 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:49:04.980 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.980 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:04.980 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.980 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.980 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.980 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:04.980 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:04.981 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.773698107999998, 2024-09-12T22:49:04.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:49:04.981 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:04.981 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:04.981 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.981 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:04.981 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.981 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:04.981 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:04.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.981 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.981 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.981 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:04.981 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:04.982 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.982 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.982 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:04.982 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:49:04.982 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:49:04.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.982 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.982 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:04.982 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:49:04.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:49:04.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.983 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:04.983 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:49:04.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:49:04.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.983 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.983 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:49:04.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:49:04.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.984 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:04.984 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:49:04.984 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:49:04.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.984 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:04.984 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:49:04.984 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:49:04.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.984 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:04.984 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:49:04.984 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:49:04.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.985 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.985 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:04.985 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:49:04.985 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:49:04.985 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.985 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.985 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:04.985 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:49:04.985 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:49:04.985 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.985 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.985 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:04.985 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:49:04.986 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:49:04.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.986 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:04.986 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:49:04.986 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:49:04.986 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.986 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:04.986 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.986 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:04.986 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:04.986 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.773660190999998, 2024-09-12T22:49:04.987 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:49:04.987 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:04.987 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:04.987 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.987 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:04.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.987 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:04.987 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:04.987 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.987 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:04.988 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:04.988 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.988 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.988 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.988 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:04.988 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:49:04.989 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:49:04.989 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.989 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.989 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:04.989 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:49:04.990 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:49:04.990 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.990 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.990 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:04.990 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:49:04.990 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:49:04.990 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.990 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.990 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:04.990 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:49:04.990 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:49:04.990 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.991 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:04.991 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:49:04.991 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:49:04.991 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.991 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:04.991 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:49:04.992 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:49:04.992 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.992 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:04.992 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:04.992 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:49:04.992 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.992 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:04.993 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:49:04.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:49:04.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.993 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.993 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:04.994 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:49:04.994 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:49:04.994 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.994 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.994 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:04.994 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:49:04.995 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:49:04.995 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.995 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.995 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:04.995 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:49:04.995 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:49:04.995 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.996 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:04.996 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:04.996 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.996 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.996 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:04.996 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:04.996 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.773636740000001, 2024-09-12T22:49:04.997 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:49:04.997 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:04.997 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:04.997 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:04.997 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:04.998 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.998 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:04.998 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:04.998 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.998 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.998 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.998 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:04.999 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:04.999 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:04.999 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:04.999 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:04.999 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:04.999 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:49:04.999 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:49:04.999 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.000 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.000 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:05.000 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:49:05.000 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:49:05.000 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.000 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.001 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:05.001 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:49:05.001 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:49:05.001 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.001 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.001 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:05.001 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:49:05.001 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:49:05.001 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.001 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.002 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:05.002 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:49:05.002 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:49:05.002 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.002 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.002 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:05.002 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:49:05.002 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:49:05.002 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.002 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.002 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:05.003 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:05.003 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:49:05.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.003 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:05.003 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:49:05.003 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:49:05.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.004 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:05.004 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:49:05.004 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:49:05.004 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.004 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.004 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:05.004 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:49:05.004 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:49:05.004 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.004 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.004 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:05.004 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:49:05.005 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:49:05.005 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:05.005 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:05.005 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:05.005 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.005 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.005 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:05.005 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:05.005 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.773612503000003, 2024-09-12T22:49:05.005 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:49:05.005 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:05.005 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:05.005 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:05.006 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:05.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.006 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:05.006 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:05.006 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:05.006 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.006 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:05.006 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:05.006 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:05.006 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.006 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:05.007 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:05.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:49:05.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.007 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:05.007 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:49:05.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:49:05.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.007 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:05.007 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:49:05.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:49:05.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.008 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:05.008 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:49:05.008 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:49:05.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.008 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:05.008 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:49:05.008 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:49:05.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.008 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:05.008 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:49:05.008 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:49:05.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.009 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.009 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:05.009 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:49:05.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:49:05.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.009 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.009 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:05.009 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:49:05.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:49:05.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.010 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:05.010 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:49:05.010 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:49:05.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.011 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:05.011 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:49:05.011 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:49:05.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.011 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.011 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:05.012 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:49:05.012 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:49:05.012 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:05.012 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:05.012 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:05.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.013 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:05.013 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:05.013 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.773584585999998, 2024-09-12T22:49:05.013 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:49:05.013 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:05.014 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:05.014 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:05.014 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:05.014 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.014 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:05.014 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:05.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:05.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.015 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:05.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:05.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:05.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.016 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.016 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:05.016 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:05.016 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:49:05.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.017 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:05.017 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:49:05.017 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:49:05.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.017 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:05.017 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:49:05.018 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:49:05.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.018 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:05.018 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:49:05.018 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:49:05.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.019 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:05.019 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:49:05.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:49:05.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.019 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:05.020 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:49:05.020 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:49:05.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.020 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.020 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:05.021 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:49:05.021 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:49:05.021 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:05.021 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:05.021 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:05.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.022 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:05.022 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:05.022 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.773510090999999, 2024-09-12T22:49:05.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:49:05.022 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:05.022 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:05.023 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:05.023 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:05.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.023 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:05.023 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:05.023 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:05.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.024 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:05.024 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:05.024 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:05.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.025 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:05.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:49:05.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:49:05.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.025 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:05.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:49:05.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:49:05.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.025 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:05.026 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:49:05.026 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:49:05.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:05.026 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:49:05.026 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:49:05.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:05.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:49:05.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:49:05.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.027 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:05.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:49:05.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:49:05.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.028 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:05.028 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:49:05.028 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:49:05.028 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:05.028 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:05.028 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:05.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.029 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:05.029 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:05.029 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.773464062999999, 2024-09-12T22:49:05.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:49:05.029 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:05.030 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:05.030 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:05.030 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:05.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.030 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:05.030 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:05.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:05.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:05.031 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:05.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:05.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.032 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:05.033 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:49:05.033 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:49:05.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.033 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:05.034 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:49:05.034 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:49:05.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.034 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:05.034 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:49:05.035 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:49:05.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.035 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:05.035 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:49:05.035 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:49:05.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.036 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:05.036 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:49:05.036 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:49:05.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.037 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:05.037 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:49:05.037 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:49:05.037 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.038 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:05.038 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:49:05.038 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:49:05.038 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:05.038 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:05.038 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:05.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.038 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:05.039 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:05.039 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.771293178999997, 2024-09-12T22:49:05.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:49:05.039 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:05.039 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:05.039 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:05.039 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:05.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.040 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:05.040 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:05.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:05.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.040 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:05.040 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:05.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:05.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.041 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:05.041 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:05.041 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:49:05.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.041 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:05.041 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:49:05.041 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:49:05.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.042 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:05.042 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:49:05.042 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:49:05.042 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.042 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:05.042 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:05.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:49:05.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.043 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:05.043 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:49:05.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:49:05.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:05.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:05.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:49:05.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:05.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:49:05.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:49:05.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:05.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:49:05.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:49:05.045 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:05.045 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:05.045 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:05.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.045 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:05.045 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:05.046 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.771242729000001, 2024-09-12T22:49:05.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:49:05.046 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:05.046 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:05.046 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:05.046 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:05.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:05.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:05.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:05.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:05.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:05.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:05.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:05.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:49:05.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:49:05.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:05.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:49:05.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:49:05.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:05.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:49:05.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:49:05.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:05.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:49:05.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:49:05.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:05.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:49:05.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:49:05.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:05.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:49:05.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:49:05.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:05.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:49:05.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:49:05.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:05.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:49:05.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:49:05.051 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:05.051 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:05.051 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:05.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.052 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:05.052 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:05.052 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.771189290999999, 2024-09-12T22:49:05.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:49:05.052 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:05.052 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:05.052 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:05.052 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:05.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:05.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:05.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:05.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:05.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:05.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:05.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:05.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:05.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:49:05.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:05.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:49:05.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:49:05.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:05.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:05.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:49:05.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:05.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:49:05.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:49:05.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:05.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:49:05.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:49:05.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:05.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:49:05.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:49:05.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:05.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:49:05.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:49:05.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:05.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:49:05.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:49:05.056 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:05.056 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:05.056 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:05.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.056 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:49:05.057 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:05.057 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.767204937999999, 2024-09-12T22:49:05.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:49:05.057 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:05.057 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:05.057 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:05.057 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:05.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:05.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:05.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:05.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:05.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:05.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:05.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:05.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:49:05.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:49:05.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:05.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:49:05.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:49:05.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:05.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:49:05.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:49:05.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:05.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:49:05.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:49:05.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:05.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:49:05.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:49:05.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:05.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:49:05.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:49:05.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:05.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:49:05.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:49:05.061 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:05.061 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:05.061 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:05.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.061 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:49:05.062 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:05.062 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 57.782052399000001, 2024-09-12T22:49:05.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:49:05.062 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:05.062 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:05.062 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:05.062 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:05.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:05.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:05.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:05.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:05.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:05.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:05.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:05.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:49:05.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:49:05.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:05.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:49:05.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:49:05.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:05.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:49:05.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:49:05.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:05.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:49:05.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:49:05.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:05.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:49:05.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:49:05.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:05.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:49:05.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:49:05.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:05.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:49:05.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:49:05.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:05.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:49:05.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:49:05.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:05.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:49:05.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:49:05.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:05.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:49:05.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:49:05.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:05.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:49:05.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:49:05.067 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:05.067 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:05.067 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:05.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.067 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:49:05.067 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:05.067 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.780136153999997, 2024-09-12T22:49:05.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:49:05.067 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:05.068 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:05.068 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:05.068 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:05.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:05.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:05.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:05.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:05.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:05.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:05.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:05.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:49:05.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:49:05.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:05.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:49:05.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:49:05.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:05.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:49:05.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:49:05.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:05.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:49:05.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:49:05.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:05.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:49:05.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:49:05.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:05.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:49:05.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:49:05.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:05.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:49:05.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:49:05.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:05.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:49:05.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:49:05.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:05.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:49:05.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:49:05.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:05.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:49:05.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:49:05.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:05.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:49:05.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:49:05.073 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:05.073 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:05.073 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:05.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.073 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:49:05.073 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:05.073 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.779382779000002, 2024-09-12T22:49:05.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012160610000000001, 2024-09-12T22:49:05.073 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:05.073 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:05.073 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:05.073 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:05.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:05.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:05.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:05.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:05.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:05.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:05.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:05.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164967+0000", 2024-09-12T22:49:05.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:49:05.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:05.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164974+0000", 2024-09-12T22:49:05.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:49:05.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:05.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164987+0000", 2024-09-12T22:49:05.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3689000000000001e-05 2024-09-12T22:49:05.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:05.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164995+0000", 2024-09-12T22:49:05.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2959999999999999e-06 2024-09-12T22:49:05.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:05.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165068+0000", 2024-09-12T22:49:05.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2449999999999999e-05 2024-09-12T22:49:05.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:05.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165212+0000", 2024-09-12T22:49:05.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144117 2024-09-12T22:49:05.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:05.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166066+0000", 2024-09-12T22:49:05.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085441100000000002 2024-09-12T22:49:05.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:05.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166107+0000", 2024-09-12T22:49:05.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0450000000000001e-05 2024-09-12T22:49:05.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:05.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:05.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:05.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166181+0000", 2024-09-12T22:49:05.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-12T22:49:05.077 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:05.078 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:05.078 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:05.078 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:05.078 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:05.078 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:05.080 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:05.079+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:05.080 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:05.181 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:05.180+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:05.186 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:05.186 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:05.186 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:49:05.186 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:05.195 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:05.282 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:05.282+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:05.338 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:05.338 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:05.338 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:49:05.339 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:49:05.339 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:05.346 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:05.390 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:05.389+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:05.450 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:49:05.452 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:05.452 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:49:05.452 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:49:05.452 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:49:05.453 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.453 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:49:05.453 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:05.453 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 69.065131980000004, 2024-09-12T22:49:05.454 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:49:05.454 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:05.454 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:05.454 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:05.454 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:05.455 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.455 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:05.455 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:05.455 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.455 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.455 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.455 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:05.455 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:05.455 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.455 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.455 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.455 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:05.455 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:05.456 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:49:05.456 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.456 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.456 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:05.456 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:49:05.456 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:49:05.456 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.456 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.456 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:05.456 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:49:05.456 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:49:05.457 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.457 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.457 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:05.457 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:49:05.457 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:49:05.457 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.457 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.457 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:05.457 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:49:05.457 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:49:05.457 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.457 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.457 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:05.458 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:49:05.458 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:49:05.458 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.458 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.458 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:05.458 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:49:05.458 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:49:05.458 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.458 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.458 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:05.458 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:49:05.458 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:49:05.458 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.459 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:05.459 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.459 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.459 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.459 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:49:05.459 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:05.459 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 69.064689396999995, 2024-09-12T22:49:05.459 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:49:05.459 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:05.459 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:05.459 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:05.459 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:05.459 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.460 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:05.460 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:05.460 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.460 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.460 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.460 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:05.460 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:05.460 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.460 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.460 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.460 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:05.460 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:49:05.461 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:49:05.461 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.461 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.461 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:05.461 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:49:05.461 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:49:05.461 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.461 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.461 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:05.461 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:49:05.461 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:49:05.461 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.461 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.462 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:05.462 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:49:05.462 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:49:05.462 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.462 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.462 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:05.462 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:49:05.462 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:49:05.462 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.462 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.462 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:05.463 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:49:05.463 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:49:05.463 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.463 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.463 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:05.464 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:49:05.464 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:49:05.464 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.464 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.464 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:05.464 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:49:05.464 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:49:05.464 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.465 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:05.465 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.465 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.465 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.465 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:49:05.465 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:05.465 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 69.064323239999993, 2024-09-12T22:49:05.465 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:49:05.465 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:05.465 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:05.465 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:05.465 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:05.466 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.466 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:05.466 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:05.466 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.466 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.466 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.466 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:05.466 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:05.466 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.466 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.466 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.466 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:05.467 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:49:05.467 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:49:05.467 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.467 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.467 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:05.467 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:49:05.467 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:49:05.467 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.467 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.467 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:05.467 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:49:05.467 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:49:05.467 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.468 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.468 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:05.468 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:49:05.468 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:49:05.468 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.468 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.468 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:05.468 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:49:05.468 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:49:05.468 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.468 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.468 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:05.469 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:49:05.469 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:49:05.469 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.469 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.469 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:05.469 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:49:05.469 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:49:05.469 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.469 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.469 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:05.469 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:49:05.469 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:49:05.469 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.470 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:05.470 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.470 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.470 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.470 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:49:05.470 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:05.470 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 69.063910927999999, 2024-09-12T22:49:05.470 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:49:05.470 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:05.470 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:05.470 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:05.470 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:05.470 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.471 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:05.471 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:05.471 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.471 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.471 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.471 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:05.471 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:05.471 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.471 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.471 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.472 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:05.472 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:05.472 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:49:05.472 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.473 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.473 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:05.473 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:49:05.473 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:49:05.473 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.473 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.473 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:05.474 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:49:05.474 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:49:05.474 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.474 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.474 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:05.474 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:49:05.474 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:49:05.474 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.475 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.475 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:05.475 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:49:05.475 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:49:05.475 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.475 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.475 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:05.475 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:49:05.476 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:49:05.476 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.476 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.476 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:05.476 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:49:05.476 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:49:05.476 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.476 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.476 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:05.476 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:49:05.477 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:49:05.477 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.477 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:05.477 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.477 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.477 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.477 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:49:05.477 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:05.477 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 68.930060834000003, 2024-09-12T22:49:05.477 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:49:05.477 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:05.477 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:05.478 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:05.478 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:05.478 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.478 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:05.478 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:05.478 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.478 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.478 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.478 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:05.478 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:05.478 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.478 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.478 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.479 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:05.479 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:05.479 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:49:05.479 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.479 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.479 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:05.479 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:49:05.479 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:49:05.479 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.479 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.479 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:05.479 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:49:05.479 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:49:05.479 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.480 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.480 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:05.480 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:49:05.480 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:49:05.480 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.480 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.480 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:05.480 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:49:05.480 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:49:05.480 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.480 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.480 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:05.481 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:49:05.481 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:49:05.481 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.481 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.481 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:05.481 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:49:05.481 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:49:05.481 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.481 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.481 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:05.481 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:49:05.481 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:49:05.481 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.482 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:05.482 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.482 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.482 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.482 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:05.482 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:05.482 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 60.28482528, 2024-09-12T22:49:05.482 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:49:05.482 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:05.482 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:05.482 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:05.482 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:05.482 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.482 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:05.483 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:05.483 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.483 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.483 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.483 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:05.483 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:05.483 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.484 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.484 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.484 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:05.484 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:49:05.484 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:49:05.484 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.484 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.484 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:05.485 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:49:05.485 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:49:05.485 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.485 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.485 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:05.485 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:49:05.485 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:49:05.485 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.485 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.485 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:05.485 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:49:05.486 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:49:05.486 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.486 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.486 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:05.486 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:05.486 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:49:05.486 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.486 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.486 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:05.486 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:05.486 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:49:05.486 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.487 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.487 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:05.487 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:49:05.487 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:49:05.487 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.487 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.487 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:05.487 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:49:05.487 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:49:05.487 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.487 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.487 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:05.487 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:49:05.488 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:49:05.488 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.488 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.488 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:05.488 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:49:05.488 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:49:05.488 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.488 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.488 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:05.488 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:49:05.489 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:49:05.489 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.489 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.489 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:05.489 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:49:05.490 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:49:05.490 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.490 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.490 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:05.490 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:49:05.490 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:49:05.490 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.490 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:05.490 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.490 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.491 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.491 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:05.491 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:05.491 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 60.284725762999997, 2024-09-12T22:49:05.491 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:49:05.491 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:05.491 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:05.491 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:05.491 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:05.491 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.491 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:05.491 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:05.492 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.492 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.492 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.492 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:05.492 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:05.492 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.492 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.492 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.492 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:05.492 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:49:05.492 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:49:05.492 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.493 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.493 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:05.493 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:49:05.493 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:49:05.493 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.493 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.493 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:05.493 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:49:05.493 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:49:05.493 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.493 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.493 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:05.494 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:49:05.494 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:49:05.494 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.494 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.494 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:05.494 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:49:05.494 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:49:05.494 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.494 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.494 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:05.494 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:49:05.495 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:49:05.495 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.495 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.495 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:05.495 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:49:05.495 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:49:05.495 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.495 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.496 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:05.496 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:49:05.496 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:49:05.496 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.496 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.496 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:05.496 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:49:05.496 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:49:05.496 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.496 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.496 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:05.496 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:49:05.497 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:49:05.497 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.497 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.497 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:05.497 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:49:05.497 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:49:05.497 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.497 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.497 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:05.497 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:49:05.497 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:49:05.498 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.498 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.498 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:05.498 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:49:05.498 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:49:05.498 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.498 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:05.498 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.498 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.498 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.498 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:05.499 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:05.499 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 60.284681024000001, 2024-09-12T22:49:05.499 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:49:05.499 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:05.499 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:05.499 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:05.499 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:05.499 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.499 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:05.499 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:05.499 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.499 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.500 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.500 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:05.500 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:05.500 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.500 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.500 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.500 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:05.500 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:49:05.500 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:49:05.500 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.500 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.500 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:05.501 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:05.501 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:49:05.501 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.501 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.501 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:05.501 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:05.501 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:49:05.501 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.501 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.501 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:05.502 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:49:05.502 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:49:05.502 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.502 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.502 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:05.502 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:49:05.502 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:49:05.502 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.502 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.502 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:05.502 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:49:05.502 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:49:05.502 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.503 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.503 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:05.503 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:49:05.503 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:49:05.503 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.503 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.503 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:05.503 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:49:05.503 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:49:05.503 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.503 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.503 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:05.504 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:49:05.504 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:49:05.504 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.504 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.504 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:05.504 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:49:05.504 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:49:05.504 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.504 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.504 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:05.504 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:49:05.505 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:49:05.505 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.510 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.510 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:05.510 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:49:05.510 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:49:05.510 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.510 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.510 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:05.511 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:49:05.511 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:49:05.511 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.511 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:05.511 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.511 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.511 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.511 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:05.511 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:05.511 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 60.284453323000001, 2024-09-12T22:49:05.511 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:49:05.512 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:05.512 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:05.512 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:05.512 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:05.512 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.512 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:05.512 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:05.512 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.512 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.512 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.512 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:05.512 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:05.513 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.513 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.513 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.513 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:05.513 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:49:05.513 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:49:05.513 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.513 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.513 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:05.513 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:49:05.513 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:49:05.513 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.513 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.514 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:05.514 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:49:05.514 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:49:05.514 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.514 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.514 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:05.514 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:49:05.514 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:49:05.514 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.514 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.514 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:05.514 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:49:05.514 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:49:05.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.515 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.515 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:05.515 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:49:05.515 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:49:05.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.515 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.515 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:05.515 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:49:05.515 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:49:05.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.515 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.516 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:05.516 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:49:05.516 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:49:05.516 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.516 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.516 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:05.516 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:49:05.516 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:49:05.516 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.516 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.516 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:05.517 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:49:05.517 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:49:05.517 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.517 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.517 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:05.517 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:49:05.517 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:49:05.517 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.517 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.517 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:05.517 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:49:05.517 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:49:05.518 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.518 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.518 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:05.518 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:49:05.518 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:49:05.518 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.518 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:05.518 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.518 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.518 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.518 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:05.518 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:05.519 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 60.284288214999997, 2024-09-12T22:49:05.519 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:49:05.519 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:05.519 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:05.519 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:05.519 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:05.519 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.519 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:05.519 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:05.519 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.519 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.519 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.520 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:05.520 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:05.520 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.520 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.520 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.520 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:05.520 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:49:05.520 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:49:05.521 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.521 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.521 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:05.521 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:49:05.521 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:49:05.521 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.521 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.521 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:05.521 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:49:05.521 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:49:05.521 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.522 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.522 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:05.522 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:49:05.522 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:49:05.522 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.522 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.522 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:05.522 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:49:05.522 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:49:05.522 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.522 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.522 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:05.522 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:49:05.523 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:49:05.523 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.523 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.523 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:05.523 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:49:05.523 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:49:05.523 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.523 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.523 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:05.523 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:49:05.523 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:49:05.523 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.523 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.523 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:05.524 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:49:05.524 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:49:05.524 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.524 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.524 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:05.524 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:49:05.524 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:49:05.524 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.524 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.524 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:05.524 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:49:05.524 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:49:05.524 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.525 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.525 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:05.525 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:49:05.525 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:49:05.525 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.525 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.525 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:05.525 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:49:05.525 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:49:05.525 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.525 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:05.525 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.525 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.525 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.526 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:05.526 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:05.526 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 60.284226930000003, 2024-09-12T22:49:05.526 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:49:05.526 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:05.526 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:05.526 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:05.526 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:05.526 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.526 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:05.526 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:05.526 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.526 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.527 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.527 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:05.527 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:05.527 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.527 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.527 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.527 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:05.527 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:05.527 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:49:05.527 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.527 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.527 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:05.528 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:49:05.528 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:49:05.528 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.528 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.528 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:05.528 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:49:05.528 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:49:05.528 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.528 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.528 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:05.528 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:49:05.528 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:49:05.529 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.529 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.529 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:05.529 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:49:05.529 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:49:05.529 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.529 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.529 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:05.529 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:49:05.529 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:49:05.529 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.529 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.530 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:05.530 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:49:05.530 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:49:05.530 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.530 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.530 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:05.530 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:49:05.530 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:49:05.530 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.530 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.530 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:05.531 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:49:05.531 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:49:05.531 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.531 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.531 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:05.531 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:49:05.531 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:49:05.531 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.532 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.532 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:05.532 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:49:05.532 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:49:05.532 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.532 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.532 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:05.532 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:49:05.532 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:49:05.532 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.533 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.533 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:05.533 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:49:05.533 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:49:05.533 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.533 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:05.533 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.533 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.533 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.534 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:05.534 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:05.534 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 60.284146821999997, 2024-09-12T22:49:05.534 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:49:05.534 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:05.534 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:05.534 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:05.534 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:05.534 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.534 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:05.534 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:05.534 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.534 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.534 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.535 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:05.535 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:05.535 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.535 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.535 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.535 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:05.535 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:49:05.535 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:49:05.535 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.535 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.535 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:05.535 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:49:05.536 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:49:05.536 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.536 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.536 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:05.536 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:49:05.536 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:49:05.536 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.536 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.536 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:05.536 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:49:05.536 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:49:05.536 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.536 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.537 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:05.537 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:49:05.537 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:49:05.537 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.537 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.537 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:05.537 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:49:05.537 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:49:05.537 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.537 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.537 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:05.537 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:49:05.537 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:49:05.538 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.538 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.538 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:05.538 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:49:05.538 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:49:05.538 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.538 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.538 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:05.538 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:49:05.538 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:49:05.538 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.538 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.538 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:05.539 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:49:05.539 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:49:05.539 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.539 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.539 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:05.539 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:49:05.539 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:49:05.539 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.539 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.539 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:05.539 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:49:05.539 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:49:05.540 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.540 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.540 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:05.540 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:49:05.540 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:49:05.540 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.540 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:05.540 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.540 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.540 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.540 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:05.540 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:05.540 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 60.284097869, 2024-09-12T22:49:05.540 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:49:05.541 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:05.541 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:05.541 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:05.541 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:05.541 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.541 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:05.541 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:05.541 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.541 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.541 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.541 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:05.542 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:05.542 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.542 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.542 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.542 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:05.542 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:05.542 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:49:05.542 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.542 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.542 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:05.543 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:49:05.543 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:49:05.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.543 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.543 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:05.543 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:49:05.543 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:49:05.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.543 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.543 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:05.543 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:49:05.543 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:49:05.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.544 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.544 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:05.544 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:49:05.544 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:49:05.544 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.544 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.544 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:05.544 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:49:05.544 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:49:05.544 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.544 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.544 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:05.544 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:49:05.545 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:49:05.545 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.545 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:05.545 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.545 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.545 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.545 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:05.545 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:05.545 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 60.284048769000002, 2024-09-12T22:49:05.545 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:49:05.545 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:05.545 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:05.545 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:05.546 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:05.546 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.546 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:05.546 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:05.546 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.546 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.546 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.546 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:05.546 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:05.546 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.546 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.546 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.546 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:05.547 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:49:05.547 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:49:05.547 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.547 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.547 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:05.547 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:49:05.547 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:49:05.547 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.547 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.547 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:05.547 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:49:05.547 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:49:05.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.548 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.548 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:05.548 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:49:05.548 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:49:05.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.548 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.548 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:05.548 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:49:05.548 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:49:05.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.548 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.548 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:05.549 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:49:05.549 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:49:05.549 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.549 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.549 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:05.549 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:49:05.549 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:49:05.549 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.549 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:05.549 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.549 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.549 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.549 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:05.550 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:05.550 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 60.277108319, 2024-09-12T22:49:05.550 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:49:05.550 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:05.550 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:05.550 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:05.550 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:05.550 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.550 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:05.550 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:05.550 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.550 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.550 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.550 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:05.551 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:05.551 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.551 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.551 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:05.551 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:49:05.551 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:49:05.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.551 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.551 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:05.551 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:49:05.551 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:49:05.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.551 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.552 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:05.552 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:49:05.552 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:49:05.552 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.552 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.552 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:05.552 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:49:05.552 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:49:05.552 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.553 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.553 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:05.553 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:49:05.553 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:49:05.553 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.553 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.553 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:05.553 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:49:05.553 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:49:05.553 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.553 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.554 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:05.554 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:49:05.554 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:49:05.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.554 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.554 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:05.554 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:49:05.554 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:49:05.554 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.554 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:05.554 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.554 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.555 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:05.555 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:05.555 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 60.276019478999999, 2024-09-12T22:49:05.555 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:49:05.555 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:05.555 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:05.555 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:05.555 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:05.555 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.555 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:05.556 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:05.556 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.556 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:05.556 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:05.556 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.556 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:05.556 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:49:05.556 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:49:05.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.557 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:05.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:49:05.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:49:05.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.557 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.557 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:05.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:49:05.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:49:05.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.557 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.557 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:05.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:49:05.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:49:05.558 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.558 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.558 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:05.558 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:49:05.558 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:49:05.558 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.558 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.558 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:05.558 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:49:05.558 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:49:05.558 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.558 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.559 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:05.559 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:49:05.559 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:49:05.559 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.559 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.559 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:05.559 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:49:05.559 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:49:05.559 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.559 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:05.560 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.560 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.560 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.560 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:05.560 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:05.560 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 60.275969867999997, 2024-09-12T22:49:05.560 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:49:05.560 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:05.560 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:05.560 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:05.561 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:05.561 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.561 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:05.561 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:05.561 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.561 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.561 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.561 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:05.561 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:05.561 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.561 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.561 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.561 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:05.561 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:05.562 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:49:05.562 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.562 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.562 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:05.562 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:05.562 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:49:05.562 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.562 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.562 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:05.562 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:49:05.562 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:49:05.562 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.562 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.563 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:05.563 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:49:05.563 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:49:05.563 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.563 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.563 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:05.563 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:49:05.563 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:49:05.564 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.564 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.564 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:05.564 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:49:05.564 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:49:05.564 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.564 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.564 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:05.564 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:49:05.564 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:49:05.564 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.564 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.565 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:05.565 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:49:05.565 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:49:05.565 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.565 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:05.565 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.565 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.565 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.565 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:05.566 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:05.566 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 60.275902559000002, 2024-09-12T22:49:05.566 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:49:05.566 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:05.566 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:05.566 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:05.566 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:05.566 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.566 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:05.566 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:05.566 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.566 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.566 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.567 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:05.567 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:05.567 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.567 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.567 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.567 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:05.567 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:05.567 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:49:05.567 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.568 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.568 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:05.568 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:49:05.568 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:49:05.568 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.568 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.568 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:05.568 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:49:05.568 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:49:05.568 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.568 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.568 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:05.568 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:49:05.569 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:49:05.569 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.569 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.569 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:05.569 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:49:05.569 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:49:05.569 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.569 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.569 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:05.569 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:49:05.569 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:49:05.569 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.569 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.569 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:05.570 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:49:05.570 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:49:05.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.570 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.570 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:05.570 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:49:05.570 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:49:05.570 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.570 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:05.570 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.570 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.570 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:05.571 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:05.571 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 60.275334639999997, 2024-09-12T22:49:05.571 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:49:05.571 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:05.571 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:05.571 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:05.571 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:05.571 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.571 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:05.571 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:05.571 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.571 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.571 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.571 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:05.572 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:05.572 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.572 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.572 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.572 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:05.572 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:05.572 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:49:05.572 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.572 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.572 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:05.572 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:49:05.572 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:49:05.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.573 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:05.573 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:49:05.573 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:49:05.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.574 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:05.574 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:49:05.574 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:49:05.574 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.574 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.574 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:05.574 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:49:05.574 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:49:05.575 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.575 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.575 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:05.575 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:49:05.575 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:49:05.575 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.575 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.575 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:05.575 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:49:05.575 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:49:05.575 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.576 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.576 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:05.576 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:49:05.576 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:49:05.576 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.576 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:05.577 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.577 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.577 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.577 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:49:05.577 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:05.577 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 60.274957036000004, 2024-09-12T22:49:05.577 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:49:05.578 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:05.578 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:05.578 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:05.578 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:05.578 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.578 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:05.578 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:05.579 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.579 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.579 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.579 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:05.579 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:05.579 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:05.579 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.579 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.579 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:05.579 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:49:05.579 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:49:05.579 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.580 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.580 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:05.580 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:49:05.580 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:49:05.580 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.580 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.580 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:05.580 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:49:05.580 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:49:05.580 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.581 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.581 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:05.581 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:49:05.581 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:49:05.581 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.581 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.581 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:05.581 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:49:05.581 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:49:05.582 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.582 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.582 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:05.582 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:49:05.582 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:49:05.582 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.582 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.582 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:05.582 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:49:05.582 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:49:05.582 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:05.582 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:05.583 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:05.583 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:49:05.583 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:49:05.583 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.583 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:05.583 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.583 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:05.583 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:05.583 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:05.586 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:05.586 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:05.584+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:05.686 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:05.685+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:05.695 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:05.695 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:05.696 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:49:05.696 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:05.704 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:05.761 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:49:05.761 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:49:05.779 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:49:05.779 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:49:05.779 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:49:05.784 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:49:05.784 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:49:05.786 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:05.785+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:05.847 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:05.847 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:05.855 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:05.887 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:05.886+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:05.957 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:05.957 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:05.966 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:05.988 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:05.987+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:06.074 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:06.075 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:06.082 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:06.126 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:06.125+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:06.185 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:06.185 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:06.190 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:06.188+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:06.193 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:06.290 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:06.289+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:06.336 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:06.336 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:06.344 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:06.392 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:06.391+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:06.448 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:06.449 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:06.457 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:06.501 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:06.500+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:06.559 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:06.560 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:06.568 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:06.609 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:06.608+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:06.613 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:49:06.695 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:06.694+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:06.712 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:06.712 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:06.721 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:06.796 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:06.795+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:06.825 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:06.825 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:06.835 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:06.896 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:06.896+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:06.914 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~35s 2024-09-12T22:49:06.936 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:06.936 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:06.945 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:06.997 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:06.997+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:07.047 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:07.047 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:07.055 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:07.098 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:07.097+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:07.160 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:07.160 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:07.169 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:07.212 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:07.211+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:07.272 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:07.272 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:07.280 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:07.300 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:07.300+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:07.402 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:07.401+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:07.423 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:07.423 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:07.432 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:07.495 INFO:teuthology.orchestra.run.smithi066.stderr:nodeep-scrub is unset 2024-09-12T22:49:07.502 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:07.501+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:07.538 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:07.538 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:07.547 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:07.603 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:07.602+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:07.650 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:07.650 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:07.658 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:07.704 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:07.703+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:07.785 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:49:07.801 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:07.801 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:07.805 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:07.804+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:07.810 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:07.906 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:07.904+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:07.914 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:07.914 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:07.922 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:07.931 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:49:07.931 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:49:07.962 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:49:07.963 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:49:07.963 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:49:07.967 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:49:07.968 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:49:08.008 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:08.006+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:08.066 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:08.066 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:08.066 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:49:08.066 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:49:08.066 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:08.076 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:08.117 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:08.115+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:08.208 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:08.207+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:08.221 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:08.221 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:49:08.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:49:08.221 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:49:08.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.221 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:49:08.222 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:08.222 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.172907019999997, 2024-09-12T22:49:08.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:49:08.222 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:08.222 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:08.222 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:08.222 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:08.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:08.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:08.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:08.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:08.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:08.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:08.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:49:08.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:08.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:49:08.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:49:08.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:08.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:49:08.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:49:08.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:49:08.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:49:08.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:08.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:49:08.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:49:08.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:08.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:49:08.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:49:08.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:08.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:49:08.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:49:08.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:08.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:49:08.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:49:08.226 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.227 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:08.227 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.227 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:49:08.227 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:08.227 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 66.172526293000004, 2024-09-12T22:49:08.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:49:08.227 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:08.227 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:08.228 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:08.228 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:08.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:08.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:08.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:08.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:08.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:08.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:49:08.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:49:08.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:08.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:49:08.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:49:08.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:08.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:49:08.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:49:08.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:49:08.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:49:08.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:08.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:49:08.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:49:08.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:08.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:49:08.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:49:08.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.233 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:08.233 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:49:08.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:49:08.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:08.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:49:08.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:49:08.235 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.235 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:08.235 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.236 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:49:08.236 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:08.236 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 63.051929483000002, 2024-09-12T22:49:08.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:49:08.236 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:08.237 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:08.237 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:49:08.237 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:08.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:08.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:08.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:08.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:08.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:08.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:08.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:49:08.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:08.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:49:08.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:49:08.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:08.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:49:08.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:49:08.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:49:08.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:49:08.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:08.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:49:08.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:49:08.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:08.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:49:08.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:49:08.245 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.245 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:08.245 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.245 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:08.246 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:08.246 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 63.049321302999999, 2024-09-12T22:49:08.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:49:08.246 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:08.246 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:08.247 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:08.247 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:08.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:08.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:08.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:08.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:08.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:08.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:49:08.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:49:08.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:08.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:49:08.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:49:08.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:08.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:49:08.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:49:08.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:49:08.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:49:08.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:08.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:49:08.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:49:08.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:08.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:49:08.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:49:08.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:08.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:49:08.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:49:08.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:08.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:49:08.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:49:08.256 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.256 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:08.256 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.257 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:08.257 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:08.257 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 63.048428080000001, 2024-09-12T22:49:08.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:49:08.258 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:08.258 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:08.258 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:08.258 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:08.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:08.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:08.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:08.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:08.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:08.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:49:08.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:49:08.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:08.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:49:08.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:49:08.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:08.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:49:08.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:49:08.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:49:08.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:49:08.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:08.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:49:08.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:49:08.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:08.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:49:08.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:49:08.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:08.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:49:08.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:49:08.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:08.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:49:08.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:49:08.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:08.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:49:08.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:49:08.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:08.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:49:08.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:49:08.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:08.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:49:08.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:49:08.270 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.270 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:08.271 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.271 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:08.271 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:08.271 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 63.048356421999998, 2024-09-12T22:49:08.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:49:08.272 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:08.272 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:08.272 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:08.272 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:08.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:08.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:08.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:08.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:08.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:08.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:49:08.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:49:08.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:08.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:49:08.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:49:08.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:08.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:49:08.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:49:08.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:49:08.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:49:08.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:08.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:49:08.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:49:08.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:08.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:49:08.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:49:08.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:08.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:49:08.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:49:08.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:08.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:49:08.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:49:08.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:08.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:49:08.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:49:08.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:08.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:49:08.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:49:08.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:08.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:49:08.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:49:08.282 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.282 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:08.282 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.282 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:08.282 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:08.282 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 63.048313704000002, 2024-09-12T22:49:08.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:49:08.282 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:08.282 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:08.282 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:08.282 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:08.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:08.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:08.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:08.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:08.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:08.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:49:08.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:49:08.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:08.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:49:08.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:49:08.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:08.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:49:08.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:49:08.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:49:08.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:49:08.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:08.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:49:08.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:49:08.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:08.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:49:08.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:49:08.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:08.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:49:08.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:49:08.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:08.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:49:08.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:49:08.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:08.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:49:08.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:49:08.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:08.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:49:08.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:49:08.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:08.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:49:08.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:49:08.288 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.288 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:08.288 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.288 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:08.288 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:08.288 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 63.048275787000001, 2024-09-12T22:49:08.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:49:08.288 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:08.288 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:08.288 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:08.288 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:08.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:08.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:08.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:08.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:08.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:08.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:49:08.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:49:08.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:08.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:49:08.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:49:08.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:08.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:49:08.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:49:08.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:49:08.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:49:08.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:08.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:49:08.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:49:08.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:08.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:49:08.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:49:08.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:08.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:08.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:49:08.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:08.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:49:08.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:49:08.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:08.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:49:08.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:49:08.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:08.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:49:08.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:49:08.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:08.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:49:08.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:49:08.293 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.293 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:08.293 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.294 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:08.294 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:08.294 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 63.048252335999997, 2024-09-12T22:49:08.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:49:08.294 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:08.294 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:08.294 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:08.294 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:08.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:08.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:08.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:08.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:08.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:08.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:49:08.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:49:08.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:08.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:49:08.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:49:08.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:08.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:49:08.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:49:08.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:49:08.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:49:08.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:08.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:49:08.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:49:08.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:08.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:49:08.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:49:08.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:08.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:08.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:49:08.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:08.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:49:08.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:49:08.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:08.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:49:08.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:49:08.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:08.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:49:08.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:49:08.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:08.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:49:08.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:49:08.299 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.299 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:08.299 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.299 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:08.299 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:08.299 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 63.048228098999999, 2024-09-12T22:49:08.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:49:08.300 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:08.300 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:08.300 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:08.300 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:08.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:08.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:08.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:08.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:08.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:08.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:08.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:49:08.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:08.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:49:08.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:49:08.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:08.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:49:08.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:49:08.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:49:08.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:49:08.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:08.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:49:08.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:49:08.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:08.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:49:08.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:49:08.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:08.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:49:08.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:49:08.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:08.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:49:08.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:49:08.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:08.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:49:08.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:49:08.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:08.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:49:08.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:49:08.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:08.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:49:08.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:49:08.305 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.305 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:08.305 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.305 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:08.305 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:08.305 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 63.048200182000002, 2024-09-12T22:49:08.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:49:08.305 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:08.305 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:08.305 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:08.305 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:08.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:08.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:08.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:08.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:08.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:08.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:08.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:49:08.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:08.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:49:08.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:49:08.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:08.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:49:08.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:49:08.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:49:08.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:49:08.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:08.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:49:08.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:49:08.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:08.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:49:08.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:49:08.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:08.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:49:08.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:49:08.309 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.309 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:08.309 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.309 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:08.309 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:08.309 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 63.048125687000002, 2024-09-12T22:49:08.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:49:08.309 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:08.309 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:08.310 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:08.310 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:08.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:08.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:08.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:08.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:08.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:08.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:49:08.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:49:08.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:08.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:49:08.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:49:08.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:08.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:49:08.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:49:08.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:49:08.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:49:08.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:08.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:49:08.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:49:08.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:08.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:49:08.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:49:08.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:08.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:49:08.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:49:08.313 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.313 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:08.313 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.313 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:08.313 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:08.313 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 63.048079659000003, 2024-09-12T22:49:08.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:49:08.314 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:08.314 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:08.314 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:08.314 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:08.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:08.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:08.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:08.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:08.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:08.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:49:08.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:49:08.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:08.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:49:08.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:49:08.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:08.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:49:08.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:49:08.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:49:08.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:49:08.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:08.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:49:08.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:49:08.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:08.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:49:08.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:49:08.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:08.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:49:08.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:49:08.317 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.317 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:08.317 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.317 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:08.318 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:08.318 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 63.045908775000001, 2024-09-12T22:49:08.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:49:08.318 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:08.318 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:08.318 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:08.318 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:08.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:08.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:08.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:08.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:08.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:08.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:08.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:49:08.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:08.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:49:08.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:49:08.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:08.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:49:08.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:49:08.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:08.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:49:08.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:08.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:49:08.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:49:08.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:08.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:08.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:49:08.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:08.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:49:08.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:49:08.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:08.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:49:08.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:49:08.322 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.322 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:08.322 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.322 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:08.322 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:08.322 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 63.045858324999998, 2024-09-12T22:49:08.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:49:08.322 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:08.322 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:08.322 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:08.322 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:08.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:08.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:08.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:08.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:08.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:08.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:49:08.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:49:08.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:08.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:49:08.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:49:08.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:08.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:49:08.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:49:08.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:49:08.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:49:08.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:08.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:49:08.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:49:08.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:08.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:49:08.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:49:08.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:08.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:49:08.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:49:08.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:08.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:49:08.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:49:08.326 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.327 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:08.327 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.327 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:08.327 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:08.327 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 63.045804887000003, 2024-09-12T22:49:08.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:49:08.327 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:08.327 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:08.327 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:08.327 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:08.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:08.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:08.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:08.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:08.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:08.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:08.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:49:08.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:08.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:49:08.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:49:08.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:08.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:08.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:49:08.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:49:08.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:49:08.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:08.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:49:08.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:49:08.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:08.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:49:08.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:49:08.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:08.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:49:08.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:49:08.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:08.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:49:08.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:49:08.331 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.331 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:08.331 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.332 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:49:08.332 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:08.332 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 63.041820534000003, 2024-09-12T22:49:08.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:49:08.332 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:08.332 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:08.332 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:08.332 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:08.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:08.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:08.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:08.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:08.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:08.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:49:08.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:49:08.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:08.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:49:08.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:49:08.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:08.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:49:08.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:49:08.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:49:08.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:49:08.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:08.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:49:08.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:49:08.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:08.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:49:08.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:49:08.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:08.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:49:08.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:49:08.335 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.336 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:08.336 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.336 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:49:08.336 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:08.336 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 61.056667994999998, 2024-09-12T22:49:08.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:49:08.336 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:08.336 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:08.336 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:08.336 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:08.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:08.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:08.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:08.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:08.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:08.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:49:08.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:49:08.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:08.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:49:08.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:49:08.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:08.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:49:08.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:49:08.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:49:08.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:49:08.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:08.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:49:08.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:49:08.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:08.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:49:08.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:49:08.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:08.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:49:08.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:49:08.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:08.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:49:08.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:49:08.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:08.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:49:08.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:49:08.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:08.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:49:08.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:49:08.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:08.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:49:08.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:49:08.342 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.342 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:08.342 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.342 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:49:08.342 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:08.342 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.054751750000001, 2024-09-12T22:49:08.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:49:08.342 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:08.342 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:08.342 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:08.342 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:08.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:08.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:08.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:08.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:08.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:08.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:49:08.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:49:08.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:08.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:49:08.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:49:08.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:08.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:49:08.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:49:08.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:49:08.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:49:08.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:08.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:49:08.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:49:08.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:08.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:49:08.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:49:08.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:08.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:49:08.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:49:08.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:08.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:49:08.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:49:08.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:08.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:49:08.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:49:08.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:08.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:49:08.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:49:08.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:08.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:49:08.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:49:08.347 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.347 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:08.347 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.348 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:49:08.348 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:08.348 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.053998374999999, 2024-09-12T22:49:08.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012160610000000001, 2024-09-12T22:49:08.348 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:08.348 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:08.348 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:08.348 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:08.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:08.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:08.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:08.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:08.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:08.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:08.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164967+0000", 2024-09-12T22:49:08.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:49:08.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:08.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164974+0000", 2024-09-12T22:49:08.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:49:08.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:08.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164987+0000", 2024-09-12T22:49:08.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3689000000000001e-05 2024-09-12T22:49:08.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164995+0000", 2024-09-12T22:49:08.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2959999999999999e-06 2024-09-12T22:49:08.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:08.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165068+0000", 2024-09-12T22:49:08.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2449999999999999e-05 2024-09-12T22:49:08.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:08.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165212+0000", 2024-09-12T22:49:08.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144117 2024-09-12T22:49:08.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:08.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166066+0000", 2024-09-12T22:49:08.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085441100000000002 2024-09-12T22:49:08.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:08.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166107+0000", 2024-09-12T22:49:08.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0450000000000001e-05 2024-09-12T22:49:08.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:08.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:08.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:08.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166181+0000", 2024-09-12T22:49:08.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-12T22:49:08.352 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.352 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:08.352 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.352 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:08.352 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:08.352 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:08.354 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:08.355 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:08.353+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:08.455 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:08.454+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:08.459 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:08.459 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:08.459 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:49:08.460 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:08.468 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:08.556 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:08.555+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:08.611 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:08.611 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:08.611 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:49:08.612 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:49:08.612 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:08.620 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:08.661 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:08.660+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:08.758 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:08.757+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:08.765 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:08.765 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:49:08.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:49:08.765 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:49:08.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.765 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:49:08.765 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:08.765 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.379233178999996, 2024-09-12T22:49:08.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:49:08.766 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:08.766 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:08.766 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:08.766 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:08.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:08.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:08.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:08.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:08.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:08.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:08.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:49:08.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:08.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:49:08.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:49:08.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:08.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:49:08.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:49:08.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:49:08.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:49:08.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:08.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:49:08.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:49:08.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:08.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:49:08.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:49:08.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:08.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:49:08.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:49:08.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:08.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:49:08.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:49:08.770 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.770 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:08.770 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.770 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:49:08.770 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:08.770 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.378790596000002, 2024-09-12T22:49:08.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:49:08.771 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:08.771 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:08.771 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:08.771 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:08.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:08.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:08.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:08.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:08.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:08.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:49:08.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:49:08.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:08.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:49:08.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:49:08.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:08.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:49:08.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:49:08.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:49:08.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:49:08.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:08.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:49:08.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:49:08.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:08.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:49:08.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:49:08.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:08.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:49:08.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:49:08.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:08.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:49:08.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:49:08.775 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.775 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:08.775 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.775 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:49:08.775 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:08.775 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.378424439, 2024-09-12T22:49:08.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:49:08.775 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:08.775 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:08.775 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:08.775 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:08.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:08.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:08.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:08.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:08.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:08.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:49:08.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:49:08.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:08.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:49:08.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:49:08.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:08.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:49:08.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:49:08.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:49:08.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:49:08.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:08.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:49:08.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:49:08.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:08.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:49:08.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:49:08.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:08.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:49:08.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:49:08.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:08.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:49:08.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:49:08.779 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.779 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:08.779 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.780 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:49:08.780 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:08.780 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.378012127000005, 2024-09-12T22:49:08.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:49:08.780 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:08.780 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:08.780 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:08.780 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:08.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:08.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:08.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:08.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:08.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:08.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:08.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:49:08.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:08.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:49:08.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:49:08.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:08.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:49:08.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:49:08.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:49:08.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:49:08.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:08.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:49:08.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:49:08.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:08.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:49:08.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:49:08.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:08.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:49:08.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:49:08.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:08.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:49:08.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:49:08.784 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.784 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:08.784 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.784 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:49:08.785 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:08.785 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.244162032999995, 2024-09-12T22:49:08.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:49:08.785 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:08.785 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:08.785 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:08.785 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:08.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:08.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:08.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:08.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:08.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:08.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:08.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:49:08.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:08.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:49:08.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:49:08.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:08.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:49:08.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:49:08.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:49:08.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:49:08.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:08.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:49:08.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:49:08.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:08.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:49:08.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:49:08.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:08.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:49:08.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:49:08.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:08.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:49:08.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:49:08.789 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.789 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:08.789 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.789 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:08.789 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:08.789 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.598926478999999, 2024-09-12T22:49:08.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:49:08.790 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:08.790 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:08.790 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:08.790 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:08.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:08.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:08.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:08.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:08.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:08.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:49:08.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:49:08.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:08.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:49:08.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:49:08.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:08.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:49:08.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:49:08.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:49:08.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:49:08.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:08.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:08.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:49:08.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:08.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:08.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:49:08.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:08.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:49:08.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:49:08.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:08.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:49:08.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:49:08.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:08.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:49:08.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:49:08.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:08.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:49:08.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:49:08.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:08.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:49:08.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:49:08.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:08.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:49:08.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:49:08.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:08.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:49:08.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:49:08.796 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.796 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:08.796 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.796 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:08.796 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:08.796 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.598826961999997, 2024-09-12T22:49:08.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:49:08.796 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:08.796 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:08.796 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:08.797 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:08.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:08.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:08.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:08.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:08.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:08.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:49:08.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:49:08.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:08.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:49:08.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:49:08.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:08.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:49:08.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:49:08.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:49:08.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:49:08.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:08.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:49:08.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:49:08.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:08.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:49:08.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:49:08.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:08.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:49:08.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:49:08.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:08.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:49:08.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:49:08.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:08.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:49:08.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:49:08.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:08.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:49:08.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:49:08.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:08.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:49:08.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:49:08.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:08.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:49:08.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:49:08.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:08.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:49:08.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:49:08.802 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.802 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:08.802 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.803 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:08.803 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:08.803 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.598782223000001, 2024-09-12T22:49:08.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:49:08.803 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:08.803 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:08.803 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:08.803 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:08.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:08.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:08.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:08.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:08.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:08.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:49:08.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:49:08.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:08.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:08.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:49:08.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:08.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:08.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:49:08.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:49:08.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:49:08.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:08.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:49:08.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:49:08.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:08.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:49:08.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:49:08.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:08.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:49:08.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:49:08.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:08.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:49:08.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:49:08.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:08.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:49:08.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:49:08.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:08.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:49:08.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:49:08.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:08.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:49:08.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:49:08.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:08.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:49:08.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:49:08.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:08.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:49:08.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:49:08.809 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.809 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:08.809 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.809 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:08.810 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:08.810 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.598554522000001, 2024-09-12T22:49:08.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:49:08.810 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:08.810 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:08.810 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:08.810 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:08.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:08.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:08.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:08.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:08.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:08.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:49:08.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:49:08.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:08.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:49:08.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:49:08.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:08.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:49:08.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:49:08.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:49:08.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:49:08.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:08.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:49:08.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:49:08.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:08.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:49:08.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:49:08.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:08.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:49:08.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:49:08.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:08.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:49:08.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:49:08.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:08.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:49:08.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:49:08.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:08.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:49:08.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:49:08.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:08.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:49:08.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:49:08.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:08.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:49:08.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:49:08.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:08.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:49:08.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:49:08.816 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.816 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:08.816 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.816 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:08.816 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:08.816 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.598389414000003, 2024-09-12T22:49:08.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:49:08.816 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:08.816 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:08.817 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:08.817 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:08.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:08.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:08.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:08.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:08.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:08.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:49:08.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:49:08.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:08.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:49:08.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:49:08.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:08.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:49:08.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:49:08.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:49:08.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:49:08.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:08.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:49:08.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:49:08.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:08.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:49:08.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:49:08.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:08.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:49:08.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:49:08.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:08.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:49:08.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:49:08.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:08.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:49:08.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:49:08.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:08.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:49:08.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:49:08.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:08.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:49:08.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:49:08.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:08.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:49:08.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:49:08.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:08.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:49:08.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:49:08.822 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.822 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:08.822 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.823 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:08.823 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:08.823 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.598328129000002, 2024-09-12T22:49:08.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:49:08.823 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:08.823 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:08.823 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:08.823 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:08.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:08.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:08.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:08.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:08.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:08.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:08.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:49:08.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:08.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:49:08.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:49:08.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:08.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:49:08.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:49:08.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:49:08.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:49:08.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:08.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:49:08.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:49:08.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:08.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:49:08.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:49:08.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:08.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:49:08.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:49:08.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:08.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:49:08.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:49:08.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:08.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:49:08.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:49:08.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:08.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:49:08.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:49:08.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:08.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:49:08.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:49:08.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:08.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:49:08.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:49:08.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:08.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:49:08.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:49:08.829 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.829 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:08.829 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.830 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:08.830 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:08.830 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.598248021000003, 2024-09-12T22:49:08.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:49:08.830 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:08.830 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:08.830 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:08.830 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:08.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:08.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:08.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:08.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:08.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:08.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:49:08.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:49:08.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:08.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:49:08.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:49:08.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:08.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:49:08.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:49:08.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:49:08.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:49:08.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:08.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:49:08.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:49:08.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:08.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:49:08.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:49:08.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:08.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:49:08.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:49:08.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:08.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:49:08.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:49:08.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:08.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:49:08.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:49:08.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:08.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:49:08.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:49:08.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:08.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:49:08.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:49:08.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:08.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:49:08.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:49:08.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:08.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:49:08.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:49:08.836 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.836 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:08.836 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.836 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:08.836 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:08.837 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.598199068, 2024-09-12T22:49:08.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:49:08.837 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:08.837 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:08.837 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:08.837 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:08.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:08.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:08.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:08.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:08.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:08.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:08.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:49:08.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:08.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:49:08.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:49:08.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:08.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:49:08.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:49:08.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:49:08.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:49:08.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:08.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:49:08.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:49:08.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:08.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:49:08.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:49:08.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:08.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:49:08.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:49:08.840 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.840 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:08.840 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.841 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:08.841 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:08.841 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.598149968000001, 2024-09-12T22:49:08.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:49:08.841 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:08.841 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:08.841 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:08.841 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:08.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:08.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:08.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:08.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:08.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:08.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:49:08.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:49:08.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:08.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:49:08.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:49:08.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:08.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:49:08.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:49:08.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:49:08.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:49:08.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:08.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:49:08.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:49:08.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:08.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:49:08.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:49:08.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:08.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:49:08.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:49:08.845 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.845 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:08.845 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.845 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:08.845 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:08.846 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.591209517999999, 2024-09-12T22:49:08.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:49:08.846 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:08.846 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:08.846 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:08.846 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:08.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:08.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:08.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:08.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:08.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:08.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:49:08.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:49:08.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:08.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:49:08.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:49:08.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:08.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:49:08.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:49:08.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:49:08.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:49:08.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:08.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:49:08.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:49:08.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:08.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:49:08.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:49:08.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:08.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:49:08.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:49:08.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:08.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:49:08.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:49:08.850 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.850 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:08.850 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.850 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:08.850 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:08.850 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.590120677999998, 2024-09-12T22:49:08.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:49:08.850 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:08.851 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:08.851 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:08.851 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:08.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:08.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:08.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:08.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:08.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:08.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:49:08.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:49:08.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:08.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:49:08.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:49:08.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:08.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:49:08.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:49:08.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:49:08.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:49:08.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:08.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:49:08.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:49:08.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:08.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:49:08.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:49:08.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:08.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:49:08.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:49:08.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:08.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:49:08.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:49:08.855 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.855 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:08.855 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.855 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:08.855 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:08.855 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.590071066999997, 2024-09-12T22:49:08.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:49:08.855 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:08.855 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:08.855 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:08.855 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:08.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:08.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:08.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:08.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:08.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:08.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:08.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:49:08.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:08.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:08.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:49:08.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:08.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:49:08.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:49:08.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:49:08.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:49:08.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:08.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:49:08.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:49:08.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:08.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:49:08.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:49:08.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:08.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:49:08.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:49:08.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:08.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:49:08.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:49:08.859 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.860 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:08.860 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.860 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:08.860 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:08.860 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.590003758000002, 2024-09-12T22:49:08.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:49:08.860 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:08.860 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:08.860 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:08.860 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:08.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:08.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:08.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:08.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:08.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:08.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:08.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:49:08.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:08.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:49:08.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:49:08.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:08.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:49:08.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:49:08.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:49:08.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:49:08.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:08.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:49:08.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:49:08.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:08.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:49:08.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:49:08.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:08.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:49:08.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:49:08.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:08.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:49:08.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:49:08.864 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.864 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:08.864 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.864 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:08.865 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:08.865 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.589435838999997, 2024-09-12T22:49:08.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:49:08.865 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:08.865 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:08.865 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:08.865 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:08.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:08.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:08.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:08.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:08.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:08.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:08.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:49:08.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:08.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:49:08.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:49:08.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:08.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:49:08.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:49:08.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:49:08.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:49:08.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:08.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:49:08.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:49:08.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:08.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:49:08.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:49:08.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:08.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:49:08.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:49:08.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:08.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:49:08.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:49:08.869 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.869 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:08.869 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.869 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:49:08.869 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:08.869 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.589058235000003, 2024-09-12T22:49:08.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:49:08.870 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:08.870 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:08.870 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:08.870 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:08.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:08.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:08.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:08.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:08.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:08.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:08.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:49:08.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:49:08.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:08.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:49:08.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:49:08.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:08.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:49:08.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:49:08.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:08.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:49:08.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:49:08.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:08.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:49:08.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:49:08.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:08.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:49:08.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:49:08.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:08.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:49:08.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:49:08.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:08.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:08.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:08.874 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:49:08.874 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:49:08.874 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.874 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:08.874 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.874 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:08.874 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:08.874 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:08.876 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:08.876 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:08.874+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:08.976 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:08.976+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:08.980 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:08.980 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:08.981 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:49:08.981 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:08.990 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:09.077 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:09.075+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:09.093 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:09.094 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:09.094 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:49:09.094 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:49:09.094 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:09.102 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:09.178 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:09.177+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:09.249 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:09.249 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:49:09.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:49:09.249 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:49:09.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.249 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:49:09.249 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:09.249 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.200889509000007, 2024-09-12T22:49:09.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:49:09.249 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:09.249 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:09.250 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:09.250 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:09.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:09.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:09.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:09.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:09.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:09.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:09.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:49:09.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:09.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:49:09.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:49:09.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:09.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:49:09.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:49:09.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:49:09.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:49:09.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:09.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:49:09.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:49:09.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:09.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:49:09.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:49:09.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:09.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:49:09.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:49:09.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:09.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:49:09.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:49:09.253 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.254 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:09.254 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.254 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:49:09.254 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:09.254 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 67.200508782, 2024-09-12T22:49:09.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:49:09.254 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:09.254 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:09.254 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:09.254 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:09.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:09.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:09.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:09.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:09.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:09.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:49:09.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:49:09.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:09.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:49:09.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:49:09.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:09.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:49:09.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:49:09.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:49:09.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:49:09.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:09.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:49:09.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:49:09.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:09.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:49:09.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:49:09.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:09.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:49:09.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:49:09.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:09.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:49:09.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:49:09.259 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.259 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:09.259 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.259 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:49:09.259 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:09.259 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.079911972000005, 2024-09-12T22:49:09.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:49:09.259 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:09.259 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:09.260 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:49:09.260 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:09.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:09.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:09.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:09.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:09.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:09.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:09.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:49:09.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:09.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:49:09.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:49:09.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:09.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:49:09.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:49:09.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:49:09.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:49:09.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:09.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:49:09.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:49:09.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:09.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:49:09.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:49:09.263 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.263 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:09.263 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.263 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:09.263 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:09.264 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.077303791999995, 2024-09-12T22:49:09.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:49:09.264 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:09.264 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:09.264 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:09.264 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:09.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:09.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:09.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:09.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:09.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:09.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:49:09.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:49:09.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:09.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:49:09.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:49:09.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:09.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:49:09.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:49:09.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:49:09.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:49:09.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:09.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:49:09.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:49:09.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:09.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:49:09.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:49:09.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:09.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:49:09.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:49:09.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:09.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:49:09.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:49:09.268 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.268 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:09.268 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.268 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:09.268 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:09.268 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.076410569000004, 2024-09-12T22:49:09.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:49:09.268 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:09.269 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:09.269 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:09.269 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:09.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:09.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:09.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:09.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:09.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:09.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:49:09.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:49:09.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:09.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:49:09.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:49:09.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:09.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:49:09.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:49:09.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:49:09.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:49:09.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:09.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:49:09.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:49:09.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:09.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:49:09.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:49:09.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:09.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:49:09.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:49:09.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:09.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:49:09.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:49:09.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:09.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:49:09.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:49:09.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:09.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:49:09.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:49:09.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:09.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:49:09.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:49:09.274 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.274 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:09.274 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.275 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:09.275 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:09.275 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.076338910999993, 2024-09-12T22:49:09.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:49:09.275 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:09.275 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:09.275 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:09.275 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:09.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:09.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:09.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:09.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:09.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:09.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:49:09.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:49:09.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:09.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:49:09.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:49:09.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:09.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:49:09.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:49:09.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:49:09.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:49:09.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:09.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:49:09.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:49:09.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:09.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:49:09.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:49:09.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:09.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:49:09.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:49:09.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:09.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:49:09.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:49:09.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:09.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:49:09.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:49:09.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:09.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:49:09.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:49:09.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:09.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:49:09.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:49:09.280 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.281 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:09.281 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.281 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:09.281 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:09.281 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.076296193000005, 2024-09-12T22:49:09.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:49:09.281 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:09.281 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:09.281 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:09.282 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:09.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:09.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:09.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:09.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:09.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:09.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:49:09.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:49:09.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:09.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:49:09.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:49:09.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:09.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:49:09.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:49:09.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:49:09.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:49:09.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:09.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:49:09.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:49:09.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:09.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:49:09.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:49:09.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:09.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:49:09.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:49:09.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:09.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:49:09.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:49:09.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:09.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:49:09.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:49:09.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:09.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:49:09.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:49:09.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:09.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:49:09.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:49:09.287 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.287 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:09.287 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.287 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:09.287 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:09.288 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.076258276000004, 2024-09-12T22:49:09.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:49:09.288 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:09.288 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:09.288 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:09.288 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:09.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:09.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:09.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:09.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:09.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:09.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:49:09.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:49:09.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:09.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:49:09.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:49:09.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:09.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:49:09.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:49:09.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:49:09.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:49:09.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:09.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:49:09.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:49:09.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:09.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:49:09.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:49:09.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:09.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:09.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:49:09.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:09.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:49:09.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:49:09.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:09.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:49:09.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:49:09.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:09.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:49:09.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:49:09.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:09.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:49:09.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:49:09.293 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.293 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:09.293 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.293 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:09.293 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:09.293 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.076234825, 2024-09-12T22:49:09.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:49:09.294 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:09.294 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:09.294 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:09.294 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:09.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:09.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:09.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:09.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:09.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:09.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:49:09.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:49:09.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:09.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:49:09.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:49:09.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:09.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:49:09.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:49:09.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:49:09.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:49:09.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:09.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:49:09.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:49:09.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:09.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:49:09.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:49:09.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:09.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:09.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:49:09.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:09.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:49:09.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:49:09.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:09.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:49:09.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:49:09.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:09.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:49:09.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:49:09.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:09.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:49:09.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:49:09.299 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.299 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:09.299 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.299 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:09.299 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:09.299 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.076210587999995, 2024-09-12T22:49:09.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:49:09.299 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:09.299 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:09.299 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:09.300 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:09.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:09.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:09.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:09.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:09.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:09.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:09.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:49:09.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:09.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:49:09.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:49:09.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:09.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:49:09.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:49:09.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:49:09.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:49:09.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:09.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:49:09.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:49:09.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:09.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:49:09.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:49:09.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:09.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:49:09.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:49:09.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:09.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:49:09.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:49:09.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:09.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:49:09.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:49:09.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:09.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:49:09.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:49:09.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:09.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:49:09.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:49:09.305 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.305 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:09.305 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.305 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:09.305 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:09.306 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.076182670999998, 2024-09-12T22:49:09.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:49:09.306 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:09.306 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:09.306 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:09.306 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:09.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:09.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:09.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:09.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:09.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:09.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:09.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:49:09.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:09.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:49:09.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:49:09.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:09.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:49:09.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:49:09.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:49:09.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:49:09.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:09.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:49:09.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:49:09.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:09.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:49:09.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:49:09.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:09.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:49:09.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:49:09.310 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.310 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:09.310 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.310 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:09.310 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:09.310 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.076108176000005, 2024-09-12T22:49:09.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:49:09.310 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:09.310 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:09.310 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:09.311 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:09.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:09.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:09.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:09.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:09.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:09.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:49:09.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:49:09.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:09.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:49:09.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:49:09.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:09.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:49:09.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:49:09.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:49:09.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:49:09.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:09.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:49:09.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:49:09.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:09.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:49:09.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:49:09.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:09.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:49:09.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:49:09.314 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.314 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:09.314 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.314 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:09.314 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:09.314 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.076062148000005, 2024-09-12T22:49:09.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:49:09.315 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:09.315 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:09.315 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:09.315 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:09.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:09.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:09.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:09.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:09.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:09.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:49:09.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:49:09.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:09.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:49:09.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:49:09.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:09.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:49:09.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:49:09.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:49:09.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:49:09.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:09.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:49:09.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:49:09.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:09.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:49:09.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:49:09.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:09.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:49:09.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:49:09.319 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.319 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:09.319 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.319 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:09.319 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:09.319 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.073891263999997, 2024-09-12T22:49:09.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:49:09.319 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:09.320 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:09.320 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:09.320 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:09.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:09.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:09.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:09.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:09.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:09.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:09.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:49:09.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:09.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:49:09.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:49:09.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:09.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:49:09.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:49:09.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:09.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:49:09.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:09.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:49:09.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:49:09.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:09.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:09.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:49:09.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:09.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:49:09.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:49:09.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:09.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:49:09.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:49:09.324 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.324 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:09.324 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.324 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:09.324 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:09.324 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.073840813999993, 2024-09-12T22:49:09.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:49:09.324 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:09.324 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:09.324 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:09.324 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:09.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:09.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:09.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:09.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:09.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:09.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:49:09.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:49:09.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:09.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:49:09.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:49:09.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:09.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:49:09.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:49:09.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:49:09.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:49:09.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:09.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:49:09.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:49:09.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:09.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:49:09.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:49:09.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:09.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:49:09.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:49:09.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:09.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:49:09.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:49:09.328 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.328 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:09.329 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.329 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:09.329 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:09.329 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.073787375999999, 2024-09-12T22:49:09.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:49:09.329 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:09.329 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:09.329 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:09.329 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:09.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:09.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:09.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:09.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:09.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:09.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:09.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:49:09.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:09.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:49:09.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:49:09.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:09.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:09.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:49:09.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:49:09.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:49:09.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:09.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:49:09.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:49:09.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:09.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:49:09.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:49:09.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:09.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:49:09.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:49:09.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:09.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:49:09.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:49:09.334 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.334 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:09.334 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.334 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:49:09.334 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:09.334 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.069803023000006, 2024-09-12T22:49:09.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:49:09.334 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:09.335 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:09.335 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:09.335 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:09.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:09.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:09.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:09.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:09.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:09.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:49:09.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:49:09.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:09.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:49:09.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:49:09.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:09.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:49:09.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:49:09.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:49:09.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:49:09.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:09.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:49:09.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:49:09.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:09.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:49:09.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:49:09.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:09.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:49:09.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:49:09.339 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.339 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:09.339 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.339 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:49:09.339 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:09.339 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 62.084650484000001, 2024-09-12T22:49:09.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:49:09.339 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:09.339 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:09.339 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:09.339 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:09.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:09.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:09.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:09.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:09.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:09.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:49:09.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:49:09.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:09.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:49:09.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:49:09.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:09.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:49:09.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:49:09.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:49:09.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:49:09.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:09.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:49:09.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:49:09.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:09.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:49:09.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:49:09.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:09.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:49:09.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:49:09.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:09.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:49:09.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:49:09.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:09.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:49:09.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:49:09.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:09.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:49:09.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:49:09.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:09.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:49:09.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:49:09.346 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.347 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:09.347 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.347 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:49:09.347 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:09.347 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 44.082734238999997, 2024-09-12T22:49:09.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:49:09.347 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:09.347 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:09.347 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:09.348 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:09.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:09.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:09.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:09.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:09.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:09.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:49:09.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:49:09.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:09.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:49:09.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:49:09.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:09.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:49:09.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:49:09.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:49:09.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:49:09.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:09.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:49:09.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:49:09.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:09.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:49:09.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:49:09.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:09.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:49:09.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:49:09.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:09.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:49:09.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:49:09.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:09.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:49:09.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:49:09.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:09.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:49:09.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:49:09.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:09.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:49:09.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:49:09.353 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.353 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:09.353 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.353 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:49:09.353 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:09.353 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.081980864000002, 2024-09-12T22:49:09.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012160610000000001, 2024-09-12T22:49:09.353 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:09.354 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:09.354 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:09.354 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:09.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:09.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:09.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:09.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:09.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:09.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:09.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164967+0000", 2024-09-12T22:49:09.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:49:09.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:09.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164974+0000", 2024-09-12T22:49:09.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:49:09.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:09.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164987+0000", 2024-09-12T22:49:09.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3689000000000001e-05 2024-09-12T22:49:09.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164995+0000", 2024-09-12T22:49:09.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2959999999999999e-06 2024-09-12T22:49:09.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:09.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165068+0000", 2024-09-12T22:49:09.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2449999999999999e-05 2024-09-12T22:49:09.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:09.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165212+0000", 2024-09-12T22:49:09.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144117 2024-09-12T22:49:09.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:09.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166066+0000", 2024-09-12T22:49:09.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085441100000000002 2024-09-12T22:49:09.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:09.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166107+0000", 2024-09-12T22:49:09.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0450000000000001e-05 2024-09-12T22:49:09.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:09.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:09.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:09.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166181+0000", 2024-09-12T22:49:09.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-12T22:49:09.358 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.358 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:09.358 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.358 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:09.358 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:09.358 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:09.360 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:09.361 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:09.359+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:09.461 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:09.459+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:09.465 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:09.465 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:09.465 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:49:09.465 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:09.474 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:09.513 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:49:09.562 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:09.561+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:09.577 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:09.577 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:09.577 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:49:09.577 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:49:09.577 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:09.585 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:09.663 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:09.661+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:09.731 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:09.731 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:49:09.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:49:09.731 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:49:09.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.731 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:49:09.731 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:09.732 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 73.345459379000005, 2024-09-12T22:49:09.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:49:09.732 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:09.732 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:09.732 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:09.732 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:09.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.732 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:09.732 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:09.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:09.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:09.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:09.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:09.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:49:09.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:09.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:49:09.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:49:09.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:09.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:49:09.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:49:09.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:49:09.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:49:09.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:09.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:49:09.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:49:09.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:09.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:49:09.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:49:09.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:09.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:49:09.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:49:09.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:09.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:49:09.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:49:09.736 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.736 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:09.736 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.737 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:49:09.737 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:09.737 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 73.345016795999996, 2024-09-12T22:49:09.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:49:09.737 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:09.737 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:09.737 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:09.737 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:09.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:09.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:09.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.738 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:09.738 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:09.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.738 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.738 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:09.738 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:49:09.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:49:09.738 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.738 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:09.738 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:49:09.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:49:09.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.739 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:09.739 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:49:09.739 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:49:09.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.739 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.739 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:49:09.739 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:49:09.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.739 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:09.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:49:09.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:49:09.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:09.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:49:09.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:49:09.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:09.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:49:09.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:49:09.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:09.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:49:09.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:49:09.741 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.741 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:09.741 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.741 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:49:09.741 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:09.741 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 73.344650638999994, 2024-09-12T22:49:09.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:49:09.742 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:09.742 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:09.742 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:09.742 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:09.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.742 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:09.742 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:09.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.742 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:09.742 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:09.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.743 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:09.743 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:49:09.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:49:09.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.743 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:09.743 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:49:09.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:49:09.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.743 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:09.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:49:09.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:49:09.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:49:09.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:49:09.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:09.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:49:09.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:49:09.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:09.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:49:09.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:49:09.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:09.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:49:09.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:49:09.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:09.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:49:09.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:49:09.746 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.746 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:09.746 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.746 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:49:09.746 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:09.747 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 73.344238326999999, 2024-09-12T22:49:09.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:49:09.747 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:09.747 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:09.747 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:09.747 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:09.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:09.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:09.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.748 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:09.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:09.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.748 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:09.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:09.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:49:09.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.748 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:09.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:49:09.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:49:09.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.749 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:09.750 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:49:09.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:49:09.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.750 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:49:09.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:49:09.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:09.750 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:49:09.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:49:09.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:09.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:49:09.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:49:09.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:09.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:49:09.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:49:09.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:09.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:49:09.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:49:09.752 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.752 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:09.752 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.752 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:49:09.752 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:09.752 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 73.210388233000003, 2024-09-12T22:49:09.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:49:09.752 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:09.753 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:09.753 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:09.753 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:09.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:09.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:09.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:09.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:09.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:09.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:09.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:49:09.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:09.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:49:09.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:49:09.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:09.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:49:09.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:49:09.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:49:09.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:49:09.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:09.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:49:09.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:49:09.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:09.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:49:09.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:49:09.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:09.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:49:09.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:49:09.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:09.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:49:09.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:49:09.756 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.757 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:09.757 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.757 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:09.757 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:09.757 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 64.565152678999993, 2024-09-12T22:49:09.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:49:09.757 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:09.757 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:09.757 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:09.757 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:09.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:09.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:09.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:09.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:09.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:09.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:49:09.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:49:09.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:09.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:49:09.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:49:09.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:09.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:49:09.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:49:09.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:49:09.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:49:09.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:09.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:09.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:49:09.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:09.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:09.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:49:09.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:09.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:49:09.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:49:09.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:09.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:49:09.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:49:09.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:09.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:49:09.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:49:09.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:09.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:49:09.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:49:09.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:09.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:49:09.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:49:09.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:09.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:49:09.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:49:09.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:09.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:49:09.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:49:09.763 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.763 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:09.763 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.764 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:09.764 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:09.764 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 64.565053161999998, 2024-09-12T22:49:09.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:49:09.764 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:09.764 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:09.764 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:09.764 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:09.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:09.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:09.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:09.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:09.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:09.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:49:09.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:49:09.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:09.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:49:09.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:49:09.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:09.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:49:09.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:49:09.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:49:09.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:49:09.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:09.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:49:09.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:49:09.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:09.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:49:09.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:49:09.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:09.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:49:09.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:49:09.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:09.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:49:09.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:49:09.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:09.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:49:09.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:49:09.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:09.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:49:09.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:49:09.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:09.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:49:09.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:49:09.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:09.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:49:09.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:49:09.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:09.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:49:09.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:49:09.770 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.770 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:09.770 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.770 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:09.770 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:09.771 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 64.565008422999995, 2024-09-12T22:49:09.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:49:09.771 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:09.771 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:09.771 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:09.771 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:09.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:09.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:09.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:09.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:09.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:09.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:49:09.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:49:09.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:09.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:09.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:49:09.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:09.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:09.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:49:09.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:49:09.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:49:09.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:09.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:49:09.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:49:09.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:09.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:49:09.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:49:09.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:09.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:49:09.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:49:09.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:09.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:49:09.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:49:09.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:09.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:49:09.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:49:09.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:09.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:49:09.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:49:09.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:09.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:49:09.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:49:09.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:09.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:49:09.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:49:09.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:09.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:49:09.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:49:09.777 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.777 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:09.777 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.777 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:09.777 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:09.777 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 64.564780721999995, 2024-09-12T22:49:09.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:49:09.777 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:09.777 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:09.777 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:09.778 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:09.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:09.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:09.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:09.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:09.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:09.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:49:09.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:49:09.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:09.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:49:09.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:49:09.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:09.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:49:09.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:49:09.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:49:09.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:49:09.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:09.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:49:09.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:49:09.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:09.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:49:09.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:49:09.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:09.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:49:09.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:49:09.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:09.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:49:09.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:49:09.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:09.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:49:09.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:49:09.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:09.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:49:09.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:49:09.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:09.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:49:09.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:49:09.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:09.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:49:09.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:49:09.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:09.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:49:09.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:49:09.783 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.783 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:09.784 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.784 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:09.784 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:09.784 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 64.564615614000004, 2024-09-12T22:49:09.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:49:09.784 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:09.784 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:09.784 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:09.784 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:09.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:09.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:09.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:09.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:09.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:09.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:49:09.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:49:09.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:09.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:49:09.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:49:09.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:09.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:49:09.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:49:09.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:49:09.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:49:09.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:09.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:49:09.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:49:09.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:09.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:49:09.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:49:09.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:09.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:49:09.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:49:09.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:09.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:49:09.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:49:09.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:09.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:49:09.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:49:09.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:09.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:49:09.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:49:09.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:09.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:49:09.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:49:09.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:09.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:49:09.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:49:09.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:09.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:49:09.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:49:09.791 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.791 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:09.791 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.792 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:09.792 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:09.792 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 64.564554329000003, 2024-09-12T22:49:09.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:49:09.792 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:09.792 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:09.792 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:09.792 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:09.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:09.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:09.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:09.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:09.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:09.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:09.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:49:09.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:09.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:49:09.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:49:09.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:09.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:49:09.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:49:09.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:49:09.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:49:09.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:09.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:49:09.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:49:09.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:09.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:49:09.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:49:09.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:09.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:49:09.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:49:09.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:09.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:49:09.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:49:09.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:09.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:49:09.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:49:09.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:09.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:49:09.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:49:09.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:09.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:49:09.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:49:09.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:09.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:49:09.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:49:09.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:09.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:49:09.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:49:09.798 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.798 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:09.798 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.799 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:09.799 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:09.799 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 64.564474220999998, 2024-09-12T22:49:09.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:49:09.799 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:09.799 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:09.799 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:09.799 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:09.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:09.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:09.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:09.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:09.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:09.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:49:09.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:49:09.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:09.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:49:09.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:49:09.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:09.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:49:09.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:49:09.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:49:09.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:49:09.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:09.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:49:09.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:49:09.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:09.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:49:09.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:49:09.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:09.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:49:09.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:49:09.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:09.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:49:09.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:49:09.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:09.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:49:09.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:49:09.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:09.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:49:09.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:49:09.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:09.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:49:09.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:49:09.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:09.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:49:09.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:49:09.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:09.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:49:09.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:49:09.805 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.805 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:09.805 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.805 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:09.805 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:09.806 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 64.564425267999994, 2024-09-12T22:49:09.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:49:09.806 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:09.806 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:09.806 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:09.806 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:09.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:09.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:09.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:09.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:09.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:09.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:09.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:49:09.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:09.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:49:09.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:49:09.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:09.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:49:09.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:49:09.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:49:09.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:49:09.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:09.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:49:09.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:49:09.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:09.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:49:09.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:49:09.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:09.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:49:09.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:49:09.809 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.810 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:09.810 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.810 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:09.810 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:09.810 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 64.564376167999995, 2024-09-12T22:49:09.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:49:09.810 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:09.810 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:09.810 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:09.810 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:09.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:09.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:09.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:09.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:09.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:09.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:49:09.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:49:09.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:09.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:49:09.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:49:09.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:09.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:49:09.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:49:09.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:49:09.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:49:09.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:09.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:49:09.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:49:09.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:09.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:49:09.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:49:09.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:09.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:49:09.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:49:09.814 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.814 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:09.814 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.814 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:09.814 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:09.814 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 64.557435717999994, 2024-09-12T22:49:09.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:49:09.814 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:09.815 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:09.815 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:09.815 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:09.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:09.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:09.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:09.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:09.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:09.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:49:09.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:49:09.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:09.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:49:09.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:49:09.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:09.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:49:09.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:49:09.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:49:09.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:49:09.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:09.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:49:09.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:49:09.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:09.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:49:09.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:49:09.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:09.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:49:09.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:49:09.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:09.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:49:09.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:49:09.818 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.818 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:09.819 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.819 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:09.819 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:09.819 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 64.556346877999999, 2024-09-12T22:49:09.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:49:09.819 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:09.819 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:09.819 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:09.819 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:09.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:09.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:09.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:09.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:09.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:09.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:49:09.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:49:09.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:09.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:49:09.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:49:09.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:09.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:49:09.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:49:09.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:49:09.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:49:09.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:09.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:49:09.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:49:09.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:09.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:49:09.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:49:09.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:09.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:49:09.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:49:09.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:09.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:49:09.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:49:09.823 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.823 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:09.824 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.824 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:09.824 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:09.824 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 64.556297267000005, 2024-09-12T22:49:09.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:49:09.824 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:09.824 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:09.824 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:09.824 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:09.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:09.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:09.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:09.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:09.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:09.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:09.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:49:09.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:09.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:09.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:49:09.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:09.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:49:09.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:49:09.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:49:09.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:49:09.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:09.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:49:09.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:49:09.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:09.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:49:09.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:49:09.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:09.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:49:09.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:49:09.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:09.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:49:09.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:49:09.828 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.828 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:09.828 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.828 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:09.828 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:09.829 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 64.556229958000003, 2024-09-12T22:49:09.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:49:09.829 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:09.829 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:09.829 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:09.829 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:09.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:09.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:09.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:09.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:09.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:09.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:09.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:49:09.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:09.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:49:09.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:49:09.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:09.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:49:09.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:49:09.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:49:09.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:49:09.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:09.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:49:09.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:49:09.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:09.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:49:09.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:49:09.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:09.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:49:09.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:49:09.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:09.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:49:09.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:49:09.833 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.833 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:09.833 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.833 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:09.833 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:09.833 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 64.555662038999998, 2024-09-12T22:49:09.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:49:09.833 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:09.833 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:09.834 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:09.834 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:09.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:09.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:09.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:09.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:09.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:09.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:09.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:49:09.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:09.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:49:09.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:49:09.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:09.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:49:09.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:49:09.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:49:09.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:49:09.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:09.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:49:09.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:49:09.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:09.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:49:09.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:49:09.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:09.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:49:09.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:49:09.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:09.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:49:09.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:49:09.837 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.837 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:09.837 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.838 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:49:09.838 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:09.838 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 64.555284435000004, 2024-09-12T22:49:09.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:49:09.838 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:09.838 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:09.838 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:09.838 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:09.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:09.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:09.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:09.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:09.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:09.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:09.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:49:09.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:49:09.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:09.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:49:09.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:49:09.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:09.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:49:09.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:49:09.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:09.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:49:09.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:49:09.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:09.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:49:09.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:49:09.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:09.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:49:09.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:49:09.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:09.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:49:09.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:49:09.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:09.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:09.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:09.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:49:09.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:49:09.842 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.842 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:09.842 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.842 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:09.842 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:09.842 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:09.844 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:09.844 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:09.842+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:09.945 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:09.944+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:09.949 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:09.949 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:09.949 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:49:09.949 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:09.957 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:09.968 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:49:10.046 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:10.044+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:10.059 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:10.059 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:10.059 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:49:10.060 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:49:10.060 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:10.068 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:10.146 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:10.144+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:10.152 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:49:10.152 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:49:10.170 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:49:10.170 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:49:10.170 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:49:10.171 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:10.171 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:10.174 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:49:10.175 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:49:10.180 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:10.247 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:10.246+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:10.284 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:10.284 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:10.294 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:10.349 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:10.347+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:10.436 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:10.436 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:10.444 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:10.449 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:10.448+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:10.512 INFO:teuthology.orchestra.run.smithi066.stderr:noscrub is set 2024-09-12T22:49:10.547 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:10.547 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:10.550 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:10.549+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:10.556 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:10.652 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:10.651+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:10.661 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:10.662 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:10.670 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:10.753 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:10.750+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:10.772 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:10.773 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:10.781 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:10.865 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:10.863+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:10.924 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:10.924 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:10.934 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:10.975 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:10.973+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:11.038 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:11.038 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:11.047 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:11.091 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:11.090+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:11.149 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:11.149 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:11.156 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:11.155+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:11.158 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:11.256 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:11.255+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:11.302 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:11.302 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:11.312 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:11.357 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:11.356+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:11.416 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:11.416 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:11.424 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:11.458 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:11.457+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:11.527 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:11.527 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:11.536 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:11.580 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:11.579+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:11.639 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:11.639 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:11.648 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:11.692 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:11.691+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:11.752 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:11.753 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:11.761 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:11.762 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:11.760+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:11.862 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:11.861+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:11.905 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:11.905 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:11.913 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:11.998 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:11.997+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:12.057 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:12.057 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:12.064 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:12.062+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:12.066 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:12.165 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:12.164+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:12.170 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:12.170 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:12.175 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:49:12.179 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:12.265 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:12.265+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:12.282 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:12.284 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:12.291 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:12.309 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:49:12.309 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:49:12.328 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:49:12.329 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:49:12.329 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:49:12.331 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:49:12.332 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:49:12.367 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:12.366+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:12.395 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:12.396 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:49:12.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:49:12.396 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:49:12.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.396 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:49:12.396 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:12.396 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 72.347608691000005, 2024-09-12T22:49:12.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:49:12.396 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:12.396 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:12.397 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:12.397 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:12.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:12.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:12.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:12.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:12.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:12.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:12.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:49:12.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:12.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:49:12.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:49:12.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:12.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:49:12.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:49:12.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:49:12.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:49:12.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:12.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:49:12.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:49:12.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:12.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:49:12.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:49:12.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:12.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:49:12.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:49:12.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:12.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:49:12.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:49:12.401 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.401 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:12.401 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.401 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:49:12.401 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:12.401 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 70.347227963999998, 2024-09-12T22:49:12.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:49:12.401 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:12.401 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:12.401 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:12.401 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:12.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:12.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:12.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:12.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:12.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:12.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:49:12.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:49:12.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:12.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:49:12.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:49:12.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:12.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:49:12.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:49:12.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:49:12.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:49:12.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:12.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:49:12.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:49:12.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:12.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:49:12.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:49:12.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:12.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:49:12.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:49:12.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:12.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:49:12.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:49:12.406 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.406 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:12.406 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.406 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:49:12.406 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:12.406 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 67.226631154000003, 2024-09-12T22:49:12.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:49:12.406 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:12.406 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:12.406 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:49:12.407 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:12.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:12.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:12.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:12.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:12.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:12.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:12.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:49:12.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:12.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:49:12.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:49:12.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:12.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:49:12.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:49:12.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:49:12.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:49:12.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:12.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:49:12.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:49:12.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:12.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:49:12.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:49:12.410 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.411 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:12.411 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.411 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:12.411 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:12.411 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 67.224022973999993, 2024-09-12T22:49:12.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:49:12.411 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:12.411 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:12.411 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:12.411 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:12.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:12.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:12.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:12.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:12.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:12.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:49:12.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:49:12.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:12.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:49:12.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:49:12.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:12.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:49:12.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:49:12.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:49:12.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:49:12.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:12.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:49:12.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:49:12.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:12.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:49:12.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:49:12.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:12.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:49:12.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:49:12.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:12.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:49:12.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:49:12.415 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.415 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:12.416 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.416 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:12.416 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:12.416 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 67.223129751000002, 2024-09-12T22:49:12.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:49:12.416 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:12.416 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:12.416 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:12.416 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:12.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:12.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:12.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:12.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:12.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:12.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:49:12.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:49:12.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:12.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:49:12.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:49:12.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:12.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:49:12.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:49:12.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:49:12.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:49:12.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:12.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:49:12.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:49:12.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:12.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:49:12.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:49:12.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:12.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:49:12.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:49:12.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:12.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:49:12.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:49:12.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:12.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:49:12.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:49:12.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:12.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:49:12.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:49:12.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:12.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:49:12.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:49:12.421 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.421 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:12.421 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.422 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:12.422 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:12.422 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 67.223058093000006, 2024-09-12T22:49:12.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:49:12.422 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:12.422 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:12.422 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:12.422 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:12.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:12.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:12.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:12.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:12.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:12.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:49:12.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:49:12.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:12.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:49:12.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:49:12.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:12.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:49:12.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:49:12.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:49:12.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:49:12.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:12.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:49:12.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:49:12.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:12.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:49:12.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:49:12.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:12.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:49:12.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:49:12.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:12.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:49:12.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:49:12.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:12.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:49:12.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:49:12.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:12.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:49:12.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:49:12.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:12.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:49:12.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:49:12.428 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.428 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:12.428 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.428 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:12.429 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:12.429 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 67.223015375000003, 2024-09-12T22:49:12.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:49:12.429 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:12.429 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:12.429 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:12.429 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:12.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:12.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:12.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:12.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:12.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:12.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:49:12.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:49:12.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:12.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:49:12.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:49:12.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:12.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:49:12.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:49:12.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:49:12.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:49:12.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:12.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:49:12.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:49:12.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:12.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:49:12.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:49:12.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:12.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:49:12.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:49:12.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:12.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:49:12.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:49:12.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:12.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:49:12.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:49:12.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:12.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:49:12.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:49:12.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:12.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:49:12.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:49:12.436 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.436 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:12.436 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.436 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:12.436 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:12.436 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 67.222977458000003, 2024-09-12T22:49:12.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:49:12.436 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:12.436 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:12.436 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:12.437 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:12.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:12.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:12.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:12.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:12.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:12.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:49:12.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:49:12.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:12.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:49:12.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:49:12.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:12.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:49:12.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:49:12.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:49:12.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:49:12.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:12.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:49:12.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:49:12.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:12.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:49:12.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:49:12.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:12.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:12.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:49:12.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:12.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:49:12.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:49:12.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:12.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:49:12.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:49:12.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:12.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:49:12.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:49:12.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:12.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:49:12.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:49:12.441 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.442 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:12.442 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.442 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:12.442 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:12.442 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 67.222954006999998, 2024-09-12T22:49:12.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:49:12.442 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:12.442 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:12.442 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:12.442 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:12.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:12.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:12.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:12.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:12.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:12.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:49:12.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:49:12.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:12.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:49:12.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:49:12.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:12.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:49:12.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:49:12.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:49:12.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:49:12.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:12.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:49:12.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:49:12.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:12.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:49:12.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:49:12.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:12.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:12.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:49:12.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:12.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:49:12.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:49:12.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:12.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:49:12.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:49:12.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:12.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:49:12.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:49:12.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:12.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:49:12.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:49:12.447 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.447 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:12.447 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.448 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:12.448 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:12.448 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 67.222929769999993, 2024-09-12T22:49:12.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:49:12.448 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:12.448 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:12.448 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:12.448 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:12.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:12.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:12.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:12.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:12.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:12.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:12.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:49:12.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:12.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:49:12.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:49:12.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:12.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:49:12.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:49:12.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:49:12.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:49:12.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:12.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:49:12.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:49:12.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:12.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:49:12.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:49:12.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:12.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:49:12.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:49:12.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:12.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:49:12.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:49:12.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:12.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:49:12.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:49:12.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:12.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:49:12.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:49:12.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:12.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:49:12.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:49:12.453 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.453 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:12.454 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.454 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:12.454 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:12.454 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 67.222901852999996, 2024-09-12T22:49:12.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:49:12.454 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:12.454 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:12.454 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:12.454 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:12.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:12.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:12.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:12.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:12.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:12.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:12.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:49:12.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:12.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:49:12.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:49:12.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:12.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:49:12.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:49:12.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:49:12.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:49:12.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:12.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:49:12.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:49:12.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:12.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:49:12.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:49:12.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:12.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:49:12.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:49:12.458 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.458 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:12.458 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.458 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:12.458 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:12.458 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 67.222827358000004, 2024-09-12T22:49:12.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:49:12.458 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:12.458 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:12.459 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:12.459 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:12.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:12.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:12.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:12.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:12.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:12.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:49:12.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:49:12.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:12.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:49:12.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:49:12.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:12.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:49:12.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:49:12.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:49:12.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:49:12.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:12.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:49:12.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:49:12.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:12.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:49:12.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:49:12.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:12.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:49:12.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:49:12.462 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.462 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:12.462 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.463 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:12.463 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:12.463 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 67.222781330000004, 2024-09-12T22:49:12.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:49:12.463 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:12.463 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:12.463 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:12.463 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:12.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:12.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:12.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:12.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:12.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:12.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:49:12.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:49:12.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:12.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:49:12.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:49:12.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:12.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:49:12.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:49:12.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:49:12.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:49:12.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:12.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:49:12.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:49:12.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:12.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:49:12.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:49:12.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:12.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:49:12.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:49:12.467 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.467 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:12.467 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.467 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:12.467 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:12.467 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 67.220610445999995, 2024-09-12T22:49:12.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:49:12.467 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:12.467 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:12.467 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:12.467 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:12.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:12.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:12.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:12.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:12.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:12.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:12.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:49:12.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:12.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:49:12.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:49:12.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:12.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:49:12.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:49:12.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:12.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:49:12.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:12.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:49:12.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:49:12.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:12.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:12.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:49:12.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:12.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:49:12.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:49:12.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:12.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:49:12.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:49:12.471 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.471 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:12.471 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.472 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:12.472 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:12.472 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 67.220559996000006, 2024-09-12T22:49:12.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:49:12.472 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:12.472 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:12.472 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:12.472 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:12.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:12.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:12.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:12.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:12.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:12.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:49:12.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:49:12.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:12.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:49:12.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:49:12.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:12.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:49:12.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:49:12.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:49:12.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:49:12.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:12.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:49:12.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:49:12.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:12.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:49:12.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:49:12.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:12.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:49:12.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:49:12.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:12.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:49:12.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:49:12.476 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.476 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:12.476 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.476 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:12.476 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:12.476 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 67.220506557999997, 2024-09-12T22:49:12.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:49:12.476 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:12.477 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:12.477 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:12.477 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:12.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:12.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:12.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:12.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:12.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:12.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:12.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:49:12.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:12.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:49:12.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:49:12.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:12.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:12.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:49:12.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:49:12.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:49:12.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:12.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:49:12.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:49:12.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:12.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:49:12.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:49:12.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:12.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:49:12.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:49:12.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:12.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:49:12.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:49:12.480 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.480 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:12.481 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.481 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:49:12.481 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:12.481 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 67.216522205000004, 2024-09-12T22:49:12.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:49:12.481 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:12.481 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:12.481 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:12.481 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:12.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:12.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:12.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:12.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:12.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:12.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:49:12.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:49:12.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:12.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:49:12.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:49:12.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:12.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:49:12.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:49:12.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:49:12.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:49:12.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:12.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:49:12.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:49:12.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:12.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:49:12.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:49:12.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:12.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:49:12.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:49:12.485 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.485 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:12.485 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.485 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:49:12.485 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:12.485 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 65.231369666000006, 2024-09-12T22:49:12.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:49:12.485 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:12.485 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:12.486 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:12.486 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:12.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:12.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:12.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:12.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:12.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:12.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:49:12.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:49:12.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:12.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:49:12.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:49:12.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:12.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:49:12.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:49:12.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:49:12.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:49:12.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:12.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:49:12.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:49:12.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:12.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:49:12.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:49:12.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:12.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:49:12.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:49:12.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:12.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:49:12.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:49:12.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:12.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:49:12.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:49:12.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:12.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:49:12.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:49:12.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:12.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:49:12.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:49:12.492 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.492 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:12.492 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.492 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:49:12.492 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:12.492 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.229453421000002, 2024-09-12T22:49:12.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:49:12.493 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:12.493 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:12.493 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:12.493 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:12.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:12.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:12.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:12.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:12.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:12.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:49:12.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:49:12.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:12.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:49:12.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:49:12.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:12.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:49:12.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:49:12.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:49:12.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:49:12.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:12.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:49:12.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:49:12.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:12.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:49:12.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:49:12.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:12.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:49:12.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:49:12.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:12.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:49:12.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:49:12.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:12.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:49:12.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:49:12.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:12.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:49:12.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:49:12.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:12.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:49:12.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:49:12.499 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.499 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:12.499 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.499 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:49:12.499 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:12.499 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.228700046, 2024-09-12T22:49:12.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012160610000000001, 2024-09-12T22:49:12.499 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:12.499 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:12.500 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:12.500 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:12.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:12.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:12.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:12.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:12.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:12.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:12.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164967+0000", 2024-09-12T22:49:12.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:49:12.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:12.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164974+0000", 2024-09-12T22:49:12.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:49:12.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:12.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164987+0000", 2024-09-12T22:49:12.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3689000000000001e-05 2024-09-12T22:49:12.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164995+0000", 2024-09-12T22:49:12.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2959999999999999e-06 2024-09-12T22:49:12.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:12.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165068+0000", 2024-09-12T22:49:12.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2449999999999999e-05 2024-09-12T22:49:12.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:12.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165212+0000", 2024-09-12T22:49:12.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144117 2024-09-12T22:49:12.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:12.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166066+0000", 2024-09-12T22:49:12.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085441100000000002 2024-09-12T22:49:12.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:12.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166107+0000", 2024-09-12T22:49:12.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0450000000000001e-05 2024-09-12T22:49:12.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:12.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:12.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:12.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166181+0000", 2024-09-12T22:49:12.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-12T22:49:12.504 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.505 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:12.505 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.505 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:12.505 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:12.505 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:12.506 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:12.505+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:12.507 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:12.528 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:49:12.607 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:12.605+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:12.609 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:12.609 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:12.609 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:49:12.610 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:12.618 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:12.708 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:12.707+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:12.721 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:12.722 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:12.722 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:49:12.723 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:49:12.723 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:12.731 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:12.808 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~41s 2024-09-12T22:49:12.809 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:12.808+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:12.836 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:12.836 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:49:12.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:49:12.836 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:49:12.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.836 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:49:12.837 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:12.837 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.450365141999995, 2024-09-12T22:49:12.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:49:12.837 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:12.837 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:12.837 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:12.837 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:12.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:12.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:12.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:12.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:12.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:12.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:12.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:49:12.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:12.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:49:12.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:49:12.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:12.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:49:12.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:49:12.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:49:12.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:49:12.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:12.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:49:12.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:49:12.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:12.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:49:12.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:49:12.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:12.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:49:12.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:49:12.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:12.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:49:12.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:49:12.841 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.841 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:12.841 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.841 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:49:12.841 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:12.841 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.449922559000001, 2024-09-12T22:49:12.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:49:12.841 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:12.842 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:12.842 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:12.842 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:12.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:12.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:12.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:12.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:12.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:12.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:49:12.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:49:12.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:12.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:49:12.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:49:12.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:12.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:49:12.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:49:12.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:49:12.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:49:12.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:12.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:49:12.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:49:12.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:12.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:49:12.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:49:12.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:12.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:49:12.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:49:12.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:12.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:49:12.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:49:12.845 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.846 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:12.846 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.846 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:49:12.846 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:12.846 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.449556401999999, 2024-09-12T22:49:12.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:49:12.846 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:12.846 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:12.846 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:12.846 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:12.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:12.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:12.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:12.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:12.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:12.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:49:12.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:49:12.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:12.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:49:12.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:49:12.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:12.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:49:12.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:49:12.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:49:12.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:49:12.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:12.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:49:12.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:49:12.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:12.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:49:12.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:49:12.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:12.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:49:12.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:49:12.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:12.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:49:12.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:49:12.850 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.850 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:12.850 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.850 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:49:12.851 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:12.851 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.449144090000004, 2024-09-12T22:49:12.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:49:12.851 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:12.851 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:12.851 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:12.851 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:12.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:12.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:12.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:12.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:12.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:12.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:12.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:49:12.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:12.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:49:12.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:49:12.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:12.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:49:12.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:49:12.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:49:12.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:49:12.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:12.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:49:12.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:49:12.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:12.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:49:12.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:49:12.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:12.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:49:12.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:49:12.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:12.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:49:12.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:49:12.855 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.855 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:12.855 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.856 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:49:12.856 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:12.856 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.315293995999994, 2024-09-12T22:49:12.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:49:12.856 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:12.856 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:12.856 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:12.856 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:12.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:12.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:12.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:12.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:12.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:12.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:12.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:49:12.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:12.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:49:12.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:49:12.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:12.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:49:12.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:49:12.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:49:12.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:49:12.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:12.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:49:12.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:49:12.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:12.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:49:12.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:49:12.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:12.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:49:12.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:49:12.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:12.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:49:12.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:49:12.860 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.860 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:12.860 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.860 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:12.861 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:12.861 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 67.670058441999998, 2024-09-12T22:49:12.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:49:12.861 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:12.861 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:12.861 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:12.861 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:12.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:12.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:12.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:12.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:12.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:12.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:49:12.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:49:12.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:12.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:49:12.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:49:12.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:12.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:49:12.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:49:12.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:49:12.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:49:12.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:12.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:12.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:49:12.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:12.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:12.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:49:12.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:12.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:49:12.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:49:12.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:12.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:49:12.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:49:12.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:12.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:49:12.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:49:12.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:12.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:49:12.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:49:12.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:12.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:49:12.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:49:12.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:12.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:49:12.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:49:12.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:12.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:49:12.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:49:12.867 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.867 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:12.867 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.867 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:12.867 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:12.867 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 67.669958925000003, 2024-09-12T22:49:12.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:49:12.867 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:12.868 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:12.868 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:12.868 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:12.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:12.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:12.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:12.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:12.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:12.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:49:12.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:49:12.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:12.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:49:12.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:49:12.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:12.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:49:12.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:49:12.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:49:12.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:49:12.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:12.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:49:12.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:49:12.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:12.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:49:12.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:49:12.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:12.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:49:12.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:49:12.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:12.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:49:12.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:49:12.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:12.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:49:12.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:49:12.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:12.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:49:12.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:49:12.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:12.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:49:12.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:49:12.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:12.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:49:12.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:49:12.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:12.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:49:12.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:49:12.874 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.874 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:12.874 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.874 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.874 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.874 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:12.874 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:12.874 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 67.669914186, 2024-09-12T22:49:12.874 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:49:12.874 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:12.874 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:12.874 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:12.874 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:12.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.875 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:12.875 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:12.875 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.875 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.875 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:12.875 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:12.875 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.875 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.875 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:12.875 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:49:12.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:49:12.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.876 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:12.876 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:12.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:49:12.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.876 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:12.876 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:12.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:49:12.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:49:12.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:49:12.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.877 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:12.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:49:12.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:49:12.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.877 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:12.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:49:12.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:49:12.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.878 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:12.878 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:49:12.878 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:49:12.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.878 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:12.878 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:49:12.878 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:49:12.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.878 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:12.879 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:49:12.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:49:12.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.879 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.879 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:12.879 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:49:12.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:49:12.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.879 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.879 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:12.879 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:49:12.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:49:12.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.880 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:12.880 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:49:12.880 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:49:12.880 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.880 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:12.880 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:49:12.880 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:49:12.880 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.880 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:12.880 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.880 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.881 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:12.881 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:12.881 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 67.669686485, 2024-09-12T22:49:12.881 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:49:12.881 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:12.881 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:12.881 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:12.881 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:12.881 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.881 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:12.881 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:12.881 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.882 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:12.882 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:12.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.882 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:12.882 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:49:12.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:49:12.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.882 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:12.883 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:49:12.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:49:12.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.883 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:12.883 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:49:12.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:49:12.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.883 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.883 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:49:12.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:49:12.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:12.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:49:12.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:49:12.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:12.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:49:12.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:49:12.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:12.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:49:12.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:49:12.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:12.885 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:49:12.885 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:49:12.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:12.885 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:49:12.885 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:49:12.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:12.886 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:49:12.886 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:49:12.886 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.886 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.886 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:12.886 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:49:12.886 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:49:12.886 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.886 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.886 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:12.886 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:49:12.886 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:49:12.886 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.887 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.887 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:12.887 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:49:12.887 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:49:12.887 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.887 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:12.887 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.887 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.887 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.887 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:12.887 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:12.887 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 67.669521376999995, 2024-09-12T22:49:12.887 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:49:12.888 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:12.888 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:12.888 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:12.888 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:12.888 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.888 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:12.888 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:12.888 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.888 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.888 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.888 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:12.888 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:12.889 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.889 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.889 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:12.889 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:49:12.889 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:49:12.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.889 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.889 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:12.889 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:49:12.889 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:49:12.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.889 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.890 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:12.890 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:49:12.890 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:49:12.890 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.890 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.890 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:49:12.890 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:49:12.890 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.890 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:12.890 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:49:12.890 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:49:12.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.891 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.891 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:12.891 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:49:12.891 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:49:12.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.891 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.891 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:12.891 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:49:12.891 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:49:12.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.891 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.891 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:12.891 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:49:12.892 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:49:12.892 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.892 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.892 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:12.892 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:49:12.892 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:49:12.892 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.892 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.892 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:12.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:49:12.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:49:12.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.893 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:12.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:49:12.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:49:12.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.893 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:12.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:49:12.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:49:12.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.894 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.894 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:12.894 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:49:12.894 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:49:12.894 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.894 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:12.894 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.894 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.894 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.894 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:12.894 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:12.896 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 67.669460091999994, 2024-09-12T22:49:12.896 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:49:12.896 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:12.896 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:12.896 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:12.896 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:12.896 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.896 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:12.896 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:12.896 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.896 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.896 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.896 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:12.897 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:12.897 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.897 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:12.897 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:12.897 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:49:12.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.897 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:12.897 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:49:12.897 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:49:12.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.898 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.898 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:12.898 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:49:12.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:49:12.898 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.898 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.898 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.898 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:49:12.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:49:12.898 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.899 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:12.899 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:49:12.899 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:49:12.899 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.899 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:12.899 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:49:12.899 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:49:12.899 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.900 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:12.900 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:49:12.900 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:49:12.900 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.900 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.900 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:12.900 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:49:12.900 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:49:12.900 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.900 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.900 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:12.901 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:49:12.901 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:49:12.901 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.901 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.901 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:12.901 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:49:12.901 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:49:12.901 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.901 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.901 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:12.901 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:49:12.901 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:49:12.901 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.901 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.902 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:12.902 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:49:12.902 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:49:12.902 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.902 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.902 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:12.902 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:49:12.902 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:49:12.902 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.902 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:12.902 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.902 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.902 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.903 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:12.903 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:12.903 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 67.669379984000003, 2024-09-12T22:49:12.903 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:49:12.903 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:12.903 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:12.903 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:12.903 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:12.903 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.903 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:12.903 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:12.903 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.903 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.904 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.904 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:12.904 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:12.904 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.904 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.904 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.904 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:12.904 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:49:12.904 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:49:12.904 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.904 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.904 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:12.904 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:49:12.905 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:49:12.905 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.905 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.905 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:12.905 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:49:12.905 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:49:12.905 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.905 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.905 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.905 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:49:12.905 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:49:12.905 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.905 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.905 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:12.906 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:49:12.906 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:49:12.906 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.906 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.906 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:12.906 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:49:12.906 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:49:12.906 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.906 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.906 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:12.906 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:49:12.906 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:49:12.906 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.907 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.907 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:12.907 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:49:12.907 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:49:12.907 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.907 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.907 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:12.907 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:49:12.907 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:49:12.907 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.907 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.907 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:12.907 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:49:12.907 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:49:12.908 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.908 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.908 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:12.908 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:49:12.908 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:49:12.908 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.908 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.908 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:12.908 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:49:12.908 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:49:12.908 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.908 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.908 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:12.909 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:49:12.909 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:49:12.909 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.909 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:12.909 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.909 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.909 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.909 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:12.909 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:12.909 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 67.669331030999999, 2024-09-12T22:49:12.909 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:49:12.909 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:12.909 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:12.909 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:12.910 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:12.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.910 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:12.910 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:12.910 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.910 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.910 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:12.910 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:12.910 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.910 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.910 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:12.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:12.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:49:12.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.911 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:12.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:49:12.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:49:12.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.911 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:12.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:49:12.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:49:12.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.912 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.912 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.912 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:49:12.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:49:12.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.912 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.912 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:12.912 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:49:12.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:49:12.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.913 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.913 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:12.913 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:49:12.913 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:49:12.913 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.913 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.913 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:12.913 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:49:12.913 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:49:12.913 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.913 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:12.913 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.913 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.913 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.914 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:12.914 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:12.914 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 67.669281931, 2024-09-12T22:49:12.914 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:49:12.914 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:12.914 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:12.914 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:12.914 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:12.914 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.914 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:12.914 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:12.914 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.914 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.915 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.915 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:12.915 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:12.915 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.915 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.915 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.915 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:12.915 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:49:12.915 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:49:12.915 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.915 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.915 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:12.915 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:49:12.916 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:49:12.916 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.916 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.916 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:12.916 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:49:12.916 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:49:12.916 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.916 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.916 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.916 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:49:12.916 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:49:12.916 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.916 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.916 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:12.917 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:49:12.917 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:49:12.917 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.917 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.917 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:12.917 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:49:12.917 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:49:12.917 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.917 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.917 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:12.917 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:49:12.917 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:49:12.918 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.918 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:12.918 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.918 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.918 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.918 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:12.918 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:12.918 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 67.662341480999999, 2024-09-12T22:49:12.918 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:49:12.918 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:12.918 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:12.918 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:12.918 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:12.919 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.919 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:12.919 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:12.919 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.919 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.919 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.919 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:12.919 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:12.919 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.919 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.919 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.919 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:12.920 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:49:12.920 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:49:12.920 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.920 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.920 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:12.920 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:49:12.920 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:49:12.920 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.920 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.920 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:12.920 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:49:12.920 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:49:12.921 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.921 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.921 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.921 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:49:12.921 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:49:12.921 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.921 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.921 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:12.921 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:49:12.921 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:49:12.921 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.921 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.921 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:12.922 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:49:12.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:49:12.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.922 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.922 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:12.922 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:49:12.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:49:12.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.922 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.922 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:12.922 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:49:12.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:49:12.922 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.923 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:12.923 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.923 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.923 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.923 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:12.923 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:12.923 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 67.661252641000004, 2024-09-12T22:49:12.923 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:49:12.923 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:12.923 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:12.923 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:12.923 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:12.923 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.924 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:12.924 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:12.924 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.924 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.924 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.924 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:12.924 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:12.924 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.924 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.924 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.924 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:12.924 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:49:12.924 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:49:12.925 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.925 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.925 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:12.925 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:49:12.925 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:49:12.925 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.925 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.925 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:12.925 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:49:12.925 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:49:12.925 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.925 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.925 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.925 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:49:12.926 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:49:12.926 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.926 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.926 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:12.926 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:49:12.926 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:49:12.926 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.926 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.926 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:12.926 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:49:12.926 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:49:12.926 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.926 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.926 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:12.927 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:49:12.927 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:49:12.927 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.927 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.927 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:12.927 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:49:12.927 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:49:12.927 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.927 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:12.927 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.927 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.927 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.927 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:12.928 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:12.928 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 67.661203029999996, 2024-09-12T22:49:12.928 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:49:12.928 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:12.928 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:12.928 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:12.928 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:12.928 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.928 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:12.928 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:12.928 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.928 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.928 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.929 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:12.929 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:12.929 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.929 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.929 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.929 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:12.929 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:12.929 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:49:12.929 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.929 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.929 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:12.929 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:12.929 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:49:12.929 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.930 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.930 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:12.930 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:49:12.930 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:49:12.930 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.930 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.930 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.930 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:49:12.930 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:49:12.930 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.930 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.930 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:12.930 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:49:12.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:49:12.931 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.931 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.931 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:12.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:49:12.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:49:12.931 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.931 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.931 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:12.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:49:12.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:49:12.931 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.931 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.931 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:12.932 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:49:12.932 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:49:12.932 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.932 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:12.932 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.932 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.932 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.932 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:12.932 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:12.932 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 67.661135720999994, 2024-09-12T22:49:12.932 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:49:12.932 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:12.932 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:12.933 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:12.933 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:12.933 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.933 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:12.933 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:12.933 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.933 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.933 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.933 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:12.933 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:12.933 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.933 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.933 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.933 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:12.934 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:12.934 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:49:12.934 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.934 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.934 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:12.934 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:49:12.934 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:49:12.934 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.934 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.934 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:12.934 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:49:12.934 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:49:12.934 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.935 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.935 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.935 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:49:12.935 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:49:12.935 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.935 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.935 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:12.935 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:49:12.935 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:49:12.935 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.935 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.935 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:12.935 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:49:12.935 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:49:12.936 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.936 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.936 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:12.936 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:49:12.936 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:49:12.936 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.936 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.936 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:12.936 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:49:12.936 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:49:12.936 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.936 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:12.936 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.937 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.937 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.937 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:12.937 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:12.937 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 67.660567802000003, 2024-09-12T22:49:12.937 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:49:12.937 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:12.937 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:12.937 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:12.937 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:12.937 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.937 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:12.937 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:12.937 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.938 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.938 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.938 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:12.938 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:12.938 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.938 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.938 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.938 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:12.938 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:12.938 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:49:12.938 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.938 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.938 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:12.939 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:49:12.939 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:49:12.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.939 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.939 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:12.939 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:49:12.939 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:49:12.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.939 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.939 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.939 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:49:12.939 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:49:12.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.939 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.940 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:12.940 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:49:12.940 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:49:12.940 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.940 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.940 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:12.940 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:49:12.940 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:49:12.940 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.940 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.940 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:12.940 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:49:12.940 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:49:12.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.941 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.941 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:12.941 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:49:12.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:49:12.941 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.941 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:12.941 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.941 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.941 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:49:12.941 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:12.941 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 67.660190197999995, 2024-09-12T22:49:12.942 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:49:12.942 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:12.942 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:12.942 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:12.942 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:12.942 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.942 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:12.942 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:12.942 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.942 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.942 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.942 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:12.942 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:12.942 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:12.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.943 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:12.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:49:12.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:49:12.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.943 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:12.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:49:12.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:49:12.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.943 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:12.944 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:49:12.944 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:49:12.944 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.944 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.944 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:12.944 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:49:12.944 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:49:12.944 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.944 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.944 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:12.944 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:49:12.944 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:49:12.944 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.945 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.945 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:12.945 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:49:12.945 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:49:12.945 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.945 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.945 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:12.945 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:49:12.945 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:49:12.945 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:12.945 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:12.945 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:12.946 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:49:12.946 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:49:12.946 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.946 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:12.946 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.946 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:12.946 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:12.946 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:12.948 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:12.948 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:12.947+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:13.048 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:13.048+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:13.053 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:13.053 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:13.053 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:49:13.053 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:13.062 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:13.150 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:13.149+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:13.165 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:13.165 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:13.165 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:49:13.165 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:49:13.165 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:13.174 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:13.258 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:13.257+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:13.318 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:13.318 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:49:13.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:49:13.318 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:49:13.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.319 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:49:13.319 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:13.319 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.270333304000005, 2024-09-12T22:49:13.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:49:13.319 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:13.319 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:13.319 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:13.319 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:13.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:13.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:13.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:13.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:13.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:13.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:13.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:49:13.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:13.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:49:13.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:49:13.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:13.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:49:13.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:49:13.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:49:13.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:49:13.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:13.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:49:13.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:49:13.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:13.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:49:13.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:49:13.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:13.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:49:13.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:49:13.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:13.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:49:13.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:49:13.323 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.323 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:13.323 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.323 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:49:13.324 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:13.324 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 71.269952576999998, 2024-09-12T22:49:13.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:49:13.324 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:13.324 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:13.324 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:13.324 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:13.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:13.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:13.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:13.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:13.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:13.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:49:13.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:49:13.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:13.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:49:13.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:49:13.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:13.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:49:13.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:49:13.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:49:13.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:49:13.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:13.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:49:13.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:49:13.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:13.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:49:13.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:49:13.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:13.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:49:13.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:49:13.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:13.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:49:13.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:49:13.328 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.328 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:13.328 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.328 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:49:13.328 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:13.328 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.149355767000003, 2024-09-12T22:49:13.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:49:13.329 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:13.329 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:13.329 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:49:13.329 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:13.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:13.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:13.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:13.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:13.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:13.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:13.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:49:13.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:13.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:49:13.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:49:13.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:13.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:49:13.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:49:13.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:49:13.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:49:13.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:13.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:49:13.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:49:13.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:13.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:49:13.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:49:13.332 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.332 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:13.332 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.332 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:13.332 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:13.332 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.146747586999993, 2024-09-12T22:49:13.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:49:13.333 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:13.333 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:13.333 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:13.333 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:13.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:13.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:13.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:13.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:13.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:13.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:49:13.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:49:13.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:13.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:49:13.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:49:13.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:13.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:49:13.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:49:13.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:49:13.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:49:13.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:13.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:49:13.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:49:13.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:13.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:49:13.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:49:13.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:13.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:49:13.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:49:13.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:13.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:49:13.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:49:13.337 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.337 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:13.337 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.337 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:13.337 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:13.337 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.145854364000002, 2024-09-12T22:49:13.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:49:13.337 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:13.338 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:13.338 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:13.338 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:13.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:13.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:13.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:13.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:13.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:13.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:49:13.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:49:13.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:13.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:49:13.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:49:13.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:13.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:49:13.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:49:13.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:49:13.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:49:13.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:13.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:49:13.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:49:13.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:13.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:49:13.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:49:13.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:13.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:49:13.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:49:13.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:13.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:49:13.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:49:13.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:13.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:49:13.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:49:13.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:13.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:49:13.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:49:13.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:13.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:49:13.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:49:13.343 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.343 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:13.343 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.343 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:13.343 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:13.343 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.145782706000006, 2024-09-12T22:49:13.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:49:13.343 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:13.343 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:13.343 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:13.344 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:13.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:13.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:13.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:13.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:13.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:13.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:49:13.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:49:13.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:13.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:49:13.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:49:13.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:13.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:49:13.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:49:13.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:49:13.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:49:13.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:13.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:49:13.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:49:13.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:13.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:49:13.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:49:13.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:13.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:49:13.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:49:13.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:13.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:49:13.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:49:13.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:13.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:49:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:49:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:49:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:49:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:49:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:49:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.145739988000003, 2024-09-12T22:49:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:49:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:49:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:49:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:49:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:49:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:49:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:49:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:49:13.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:49:13.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:13.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:49:13.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:49:13.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:13.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:49:13.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:49:13.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:13.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:49:13.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:49:13.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:13.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:49:13.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:49:13.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:13.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:49:13.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:49:13.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:13.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:49:13.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:49:13.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:13.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:49:13.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:49:13.354 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.354 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:13.355 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.355 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:13.355 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:13.355 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.145702071000002, 2024-09-12T22:49:13.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:49:13.355 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:13.355 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:13.355 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:13.355 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:13.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:13.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:13.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:13.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:13.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:13.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:49:13.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:49:13.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:13.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:49:13.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:49:13.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:13.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:49:13.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:49:13.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:49:13.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:49:13.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:13.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:49:13.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:49:13.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:13.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:49:13.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:49:13.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:13.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:13.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:49:13.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:13.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:49:13.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:49:13.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:13.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:49:13.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:49:13.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:13.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:49:13.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:49:13.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:13.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:49:13.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:49:13.361 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.361 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:13.361 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.361 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:13.361 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:13.361 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.145678619999998, 2024-09-12T22:49:13.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:49:13.361 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:13.361 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:13.361 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:13.361 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:13.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:13.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:13.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:13.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:13.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:13.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:49:13.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:49:13.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:13.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:49:13.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:49:13.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:13.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:49:13.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:49:13.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:49:13.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:49:13.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:13.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:49:13.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:49:13.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:13.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:49:13.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:49:13.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:13.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:13.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:49:13.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:13.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:49:13.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:49:13.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:13.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:49:13.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:49:13.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:13.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:49:13.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:49:13.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:13.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:49:13.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:49:13.366 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.366 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:13.366 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.367 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:13.367 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:13.367 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.145654382999993, 2024-09-12T22:49:13.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:49:13.367 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:13.367 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:13.367 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:13.367 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:13.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:13.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:13.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:13.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:13.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:13.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:13.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:49:13.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:13.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:49:13.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:49:13.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:13.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:49:13.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:49:13.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:49:13.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:49:13.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:13.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:49:13.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:49:13.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:13.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:49:13.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:49:13.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:13.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:49:13.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:49:13.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:13.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:49:13.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:49:13.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:13.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:49:13.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:49:13.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:13.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:49:13.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:49:13.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:13.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:49:13.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:49:13.372 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.372 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:13.372 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.372 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:13.373 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:13.373 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.145626465999996, 2024-09-12T22:49:13.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:49:13.373 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:13.373 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:13.373 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:13.373 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:13.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:13.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:13.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:13.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:13.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:13.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:13.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:49:13.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:13.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:49:13.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:49:13.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:13.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:49:13.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:49:13.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:49:13.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:49:13.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:13.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:49:13.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:49:13.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:13.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:49:13.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:49:13.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:13.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:49:13.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:49:13.376 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.376 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:13.376 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.377 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:13.377 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:13.377 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.145551971000003, 2024-09-12T22:49:13.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:49:13.377 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:13.377 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:13.377 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:13.377 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:13.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:13.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:13.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:13.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:13.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:13.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:49:13.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:49:13.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:13.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:49:13.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:49:13.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:13.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:49:13.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:49:13.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:49:13.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:49:13.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:13.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:49:13.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:49:13.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:13.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:49:13.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:49:13.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:13.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:49:13.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:49:13.381 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.381 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:13.381 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.381 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:13.381 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:13.381 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.145505943000003, 2024-09-12T22:49:13.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:49:13.381 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:13.381 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:13.381 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:13.381 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:13.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:13.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:13.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:13.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:13.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:13.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:49:13.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:49:13.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:13.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:49:13.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:49:13.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:13.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:49:13.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:49:13.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:49:13.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:49:13.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:13.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:49:13.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:49:13.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:13.386 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:49:13.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:49:13.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:13.386 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:49:13.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:49:13.386 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.386 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:13.386 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.387 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:13.387 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:13.387 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.143335058999995, 2024-09-12T22:49:13.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:49:13.387 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:13.387 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:13.387 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:13.387 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:13.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:13.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:13.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:13.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:13.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:13.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:13.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:49:13.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:13.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:49:13.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:49:13.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:13.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:49:13.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:49:13.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:13.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:49:13.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:13.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:49:13.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:49:13.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:13.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:13.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:49:13.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:13.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:49:13.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:49:13.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:13.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:49:13.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:49:13.392 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.392 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:13.392 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.392 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:13.392 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:13.392 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.143284609000006, 2024-09-12T22:49:13.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:49:13.393 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:13.393 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:13.393 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:13.393 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:13.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:13.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:13.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:13.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:13.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:13.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:49:13.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:49:13.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:13.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:49:13.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:49:13.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:13.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:49:13.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:49:13.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:49:13.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:49:13.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:13.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:49:13.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:49:13.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:13.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:49:13.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:49:13.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:13.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:49:13.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:49:13.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:13.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:49:13.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:49:13.398 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.398 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:13.398 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.399 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:13.399 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:13.399 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.143231170999996, 2024-09-12T22:49:13.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:49:13.399 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:13.399 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:13.399 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:13.399 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:13.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:13.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:13.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:13.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:13.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:13.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:13.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:49:13.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:13.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:49:13.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:49:13.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:13.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:13.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:49:13.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:49:13.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:49:13.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:13.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:49:13.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:49:13.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:13.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:49:13.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:49:13.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:13.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:49:13.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:49:13.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:13.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:49:13.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:49:13.404 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.404 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:13.404 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.404 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:49:13.404 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:13.404 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.139246818000004, 2024-09-12T22:49:13.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:49:13.404 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:13.404 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:13.404 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:13.405 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:13.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:13.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:13.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:13.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:13.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:13.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:49:13.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:49:13.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:13.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:49:13.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:49:13.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:13.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:49:13.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:49:13.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:49:13.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:49:13.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:13.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:49:13.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:49:13.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:13.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:49:13.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:49:13.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:13.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:49:13.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:49:13.408 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.408 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:13.408 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.408 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:49:13.408 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:13.408 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 66.154094279000006, 2024-09-12T22:49:13.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:49:13.409 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:13.409 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:13.409 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:13.409 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:13.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:13.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:13.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:13.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:13.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:13.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:49:13.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:49:13.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:13.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:49:13.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:49:13.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:13.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:49:13.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:49:13.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:49:13.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:49:13.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:13.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:49:13.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:49:13.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:13.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:49:13.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:49:13.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:13.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:49:13.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:49:13.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:13.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:49:13.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:49:13.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:13.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:49:13.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:49:13.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:13.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:49:13.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:49:13.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:13.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:49:13.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:49:13.414 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.414 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:13.414 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.414 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:49:13.414 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:13.414 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 48.152178034000002, 2024-09-12T22:49:13.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:49:13.414 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:13.414 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:49:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:49:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:49:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:49:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:49:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:49:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:49:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:49:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:49:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:49:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:13.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:49:13.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:49:13.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:13.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:49:13.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:49:13.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:13.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:49:13.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:49:13.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:13.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:49:13.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:49:13.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:13.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:49:13.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:49:13.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:13.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:49:13.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:49:13.420 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.420 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:13.420 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.420 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:49:13.420 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:13.420 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.151424659, 2024-09-12T22:49:13.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012160610000000001, 2024-09-12T22:49:13.420 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:13.420 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:13.420 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:13.420 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:13.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:13.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:13.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:13.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:13.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:13.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:13.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164967+0000", 2024-09-12T22:49:13.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:49:13.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:13.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164974+0000", 2024-09-12T22:49:13.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:49:13.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:13.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164987+0000", 2024-09-12T22:49:13.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3689000000000001e-05 2024-09-12T22:49:13.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164995+0000", 2024-09-12T22:49:13.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2959999999999999e-06 2024-09-12T22:49:13.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:13.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165068+0000", 2024-09-12T22:49:13.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2449999999999999e-05 2024-09-12T22:49:13.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:13.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165212+0000", 2024-09-12T22:49:13.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144117 2024-09-12T22:49:13.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:13.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166066+0000", 2024-09-12T22:49:13.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085441100000000002 2024-09-12T22:49:13.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:13.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166107+0000", 2024-09-12T22:49:13.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0450000000000001e-05 2024-09-12T22:49:13.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:13.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:13.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:13.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166181+0000", 2024-09-12T22:49:13.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-12T22:49:13.425 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.425 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:13.425 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.425 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:13.425 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:13.425 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:13.427 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:13.427 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:13.426+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:13.516 INFO:teuthology.orchestra.run.smithi066.stderr:nodeep-scrub is set 2024-09-12T22:49:13.527 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:13.526+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:13.534 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:13.534 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:13.534 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:49:13.534 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:13.543 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:13.628 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:13.627+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:13.686 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:13.687 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:13.687 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:49:13.687 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:49:13.687 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:13.695 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:13.729 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:13.728+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:13.799 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:13.799 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:49:13.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:49:13.799 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:49:13.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.799 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:49:13.799 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:13.799 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 77.413217900999996, 2024-09-12T22:49:13.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:49:13.800 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:13.800 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:13.800 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:13.800 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:13.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:13.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:13.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:13.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:49:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:49:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:49:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:13.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:49:13.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:49:13.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:49:13.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:49:13.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:13.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:49:13.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:49:13.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:13.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:49:13.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:49:13.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:13.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:49:13.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:49:13.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:13.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:49:13.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:49:13.804 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.804 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:13.805 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.805 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:49:13.805 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:13.805 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 77.412775318000001, 2024-09-12T22:49:13.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:49:13.805 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:13.805 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:13.805 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:13.805 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:13.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:49:13.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:49:13.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:13.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:49:13.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:49:13.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:13.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:49:13.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:49:13.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:49:13.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:49:13.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:13.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:49:13.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:49:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:49:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:49:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:49:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:49:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:49:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:49:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:49:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 77.412409160999999, 2024-09-12T22:49:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:49:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:49:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:49:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:49:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:49:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:49:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:49:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:49:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:49:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:49:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:49:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:49:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:49:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:49:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:49:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:49:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:49:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:49:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 77.411996849000005, 2024-09-12T22:49:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:49:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:49:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:49:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:49:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:49:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:49:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:49:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:49:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:49:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:49:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:49:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:49:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:49:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:49:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:49:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:49:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:49:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 77.278146754999995, 2024-09-12T22:49:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:49:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:49:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:49:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:49:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:49:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:49:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:49:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:49:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:49:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:49:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:49:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:49:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:49:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:49:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:49:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:49:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 68.632911200999999, 2024-09-12T22:49:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:49:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:49:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:49:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:49:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:49:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:49:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:49:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:49:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:49:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:49:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:49:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:49:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:49:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:49:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:49:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:49:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:49:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:49:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:49:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:49:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:49:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:49:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:49:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:49:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:49:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 68.632811684000004, 2024-09-12T22:49:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:49:13.832 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:13.832 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:13.832 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:13.832 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:13.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:13.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:13.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:13.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:13.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:13.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:49:13.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:49:13.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:13.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:49:13.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:49:13.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:13.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:49:13.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:49:13.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:49:13.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:49:13.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:13.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:49:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:49:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:49:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:49:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:49:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:49:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:49:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:49:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:49:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:49:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:49:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:49:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:49:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:49:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:49:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:49:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:13.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:49:13.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:49:13.838 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.838 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:13.838 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.838 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:13.838 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 68.632766945, 2024-09-12T22:49:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:49:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:49:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:49:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:49:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:49:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:49:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:49:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:49:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:49:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:49:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:49:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:49:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:49:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:49:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:49:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:49:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:49:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:49:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:49:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:49:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:49:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:49:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:49:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:49:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:49:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 68.632539244, 2024-09-12T22:49:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:49:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:49:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:49:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:49:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:49:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:49:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:49:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:49:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:49:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:49:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:49:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:49:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:49:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:49:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:49:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:49:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:49:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:49:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:49:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:49:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:49:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:49:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:49:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:49:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:49:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:49:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:49:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 68.632374135999996, 2024-09-12T22:49:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:49:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:13.853 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:13.853 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:13.853 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:13.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:13.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:13.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:13.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:13.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:13.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:49:13.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:49:13.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:13.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:49:13.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:49:13.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:13.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:49:13.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:49:13.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:49:13.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:49:13.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:13.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:49:13.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:49:13.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:13.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:49:13.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:49:13.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:13.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:49:13.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:49:13.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:49:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:49:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:49:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:49:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:49:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:49:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:49:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:49:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:49:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:49:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:49:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:49:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 68.632312850999995, 2024-09-12T22:49:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:49:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:49:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:49:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:49:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:49:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:49:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:49:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:49:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:49:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:49:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:49:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:49:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:49:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:49:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:49:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:49:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:49:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:49:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:49:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:49:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:49:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:49:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:49:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:49:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:49:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:49:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 68.632232743000003, 2024-09-12T22:49:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:49:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:49:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:49:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:49:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:49:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:49:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:49:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:49:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:49:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:49:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:49:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:49:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:49:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:49:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:49:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:49:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:49:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:49:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:49:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:49:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:49:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:49:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:49:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:49:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:49:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:49:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:49:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 68.632183789999999, 2024-09-12T22:49:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:49:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:49:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:49:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:49:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:49:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:49:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:49:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:49:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:49:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:49:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:49:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:49:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:49:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:49:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 68.632134690000001, 2024-09-12T22:49:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:49:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:49:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:49:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:49:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:49:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:49:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:49:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:49:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:49:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:49:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:49:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:49:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:49:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.882 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:13.882 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:49:13.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:49:13.882 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.882 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:13.882 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.882 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:13.882 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:13.882 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 68.625194239999999, 2024-09-12T22:49:13.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:49:13.882 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:13.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:49:13.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:49:13.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:13.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:49:13.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:49:13.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:13.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:49:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:49:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:49:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:49:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:49:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:49:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.886 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:13.886 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:49:13.886 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:49:13.886 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.886 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.886 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:13.886 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:49:13.886 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:49:13.886 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.887 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.887 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:13.887 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:49:13.887 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:49:13.887 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.887 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:13.887 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.887 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.887 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.887 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:13.887 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:13.887 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 68.624105400000005, 2024-09-12T22:49:13.887 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:49:13.888 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:13.888 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:13.888 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:13.888 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:13.888 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.888 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:13.888 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:13.888 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.888 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.888 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.888 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:13.888 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:13.888 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.889 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.889 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:13.889 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:49:13.889 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:49:13.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.889 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.889 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:13.889 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:49:13.889 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:49:13.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.889 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.890 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:13.890 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:49:13.890 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:49:13.890 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.890 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.890 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:49:13.890 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:49:13.890 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.890 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:13.890 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:49:13.890 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:49:13.890 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.891 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.891 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:13.891 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:49:13.891 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:49:13.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.891 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.891 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:13.891 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:49:13.891 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:49:13.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.891 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.891 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:13.891 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:49:13.892 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:49:13.892 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.892 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:13.892 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.892 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.892 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.892 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:13.892 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:13.892 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 68.624055788999996, 2024-09-12T22:49:13.892 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:49:13.892 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:13.892 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:13.892 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:13.893 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:13.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.893 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:13.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:13.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.893 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:13.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:13.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.893 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:13.894 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:13.894 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:49:13.894 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.894 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.894 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:13.894 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:13.894 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:49:13.894 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.894 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.894 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:13.894 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:49:13.894 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:49:13.894 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.895 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.895 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.895 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:49:13.895 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:49:13.895 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.895 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.895 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:13.895 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:49:13.895 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:49:13.895 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.895 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.895 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:13.895 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:49:13.895 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:49:13.896 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.896 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.896 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:13.896 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:49:13.896 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:49:13.896 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.896 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.896 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:13.896 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:49:13.896 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:49:13.896 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.896 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:13.897 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.897 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:13.897 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:13.897 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 68.623988479999994, 2024-09-12T22:49:13.897 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:49:13.897 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:13.897 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:13.897 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:13.897 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:13.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.897 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:13.898 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:13.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.898 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.898 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.898 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:13.898 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:13.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.898 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.898 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.898 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:13.898 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:13.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:49:13.898 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.899 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:13.899 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:49:13.899 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:49:13.899 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.899 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:13.899 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:49:13.899 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:49:13.899 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.899 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.900 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:49:13.900 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:49:13.900 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.900 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.900 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:13.900 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:49:13.900 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:49:13.900 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.900 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.900 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:13.900 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:49:13.900 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:49:13.900 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.901 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.901 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:13.901 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:49:13.901 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:49:13.901 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.901 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.901 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:13.901 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:49:13.901 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:49:13.901 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.901 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:13.901 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.901 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.902 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.902 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:13.902 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:13.902 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 68.623420561000003, 2024-09-12T22:49:13.902 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:49:13.902 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:13.902 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:13.902 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:13.902 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:13.902 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.902 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:13.902 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:13.902 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.903 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.903 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.903 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:13.903 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:13.903 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.903 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.903 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.903 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:13.903 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:13.903 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:49:13.903 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.903 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.903 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:13.904 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:49:13.904 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:49:13.904 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.904 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.904 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:13.904 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:49:13.904 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:49:13.904 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.904 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.904 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.904 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:49:13.904 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:49:13.905 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.905 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.905 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:13.905 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:49:13.905 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:49:13.905 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.905 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.905 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:13.905 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:49:13.905 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:49:13.905 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.905 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.905 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:13.906 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:49:13.906 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:49:13.906 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.906 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.906 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:13.906 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:49:13.906 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:49:13.906 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.906 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:13.906 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.906 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.906 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.906 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:49:13.907 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:13.907 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 68.623042956999996, 2024-09-12T22:49:13.907 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:49:13.907 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:13.907 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:13.907 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:13.907 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:13.907 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.907 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:13.907 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:13.908 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.908 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.908 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.908 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:13.908 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:13.908 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:13.908 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.908 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.908 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:13.908 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:49:13.908 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:49:13.908 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.909 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.909 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:13.909 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:49:13.909 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:49:13.909 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.909 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.909 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:13.909 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:49:13.909 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:49:13.909 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.909 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.909 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:13.909 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:49:13.909 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:49:13.910 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.910 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:13.910 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:49:13.910 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:49:13.910 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.910 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:13.910 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:49:13.910 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:49:13.910 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.910 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:13.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:49:13.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:49:13.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:13.911 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:13.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:13.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:49:13.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:49:13.911 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.911 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:13.911 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.911 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:13.911 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:13.911 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:13.913 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:13.913 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:13.912+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:14.014 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:14.013+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:14.020 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:14.020 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:14.020 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:49:14.020 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:14.029 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:14.115 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:14.115+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:14.131 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:14.131 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:14.131 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:49:14.131 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:49:14.131 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:14.140 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:14.216 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:14.215+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:14.245 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:14.245 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:49:14.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:49:14.245 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:49:14.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.245 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:49:14.245 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:14.245 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 74.197072516000006, 2024-09-12T22:49:14.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:49:14.246 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:14.246 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:14.246 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:14.246 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:14.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:14.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:14.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:14.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:14.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:14.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:14.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:49:14.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:14.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:49:14.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:49:14.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:14.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:49:14.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:49:14.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:14.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:49:14.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:49:14.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:14.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:49:14.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:49:14.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:14.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:49:14.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:49:14.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:14.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:49:14.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:49:14.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:14.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:49:14.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:49:14.250 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.250 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:14.250 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.250 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:49:14.250 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:14.250 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 72.196691788999999, 2024-09-12T22:49:14.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:49:14.250 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:14.250 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:14.250 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:14.251 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:14.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:14.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:14.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:14.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:14.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:14.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:49:14.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:49:14.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:14.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:49:14.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:49:14.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:14.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:49:14.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:49:14.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:14.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:49:14.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:49:14.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:14.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:49:14.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:49:14.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:14.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:49:14.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:49:14.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:14.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:49:14.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:49:14.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:14.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:49:14.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:49:14.254 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.254 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:14.254 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.255 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:49:14.255 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:14.255 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.076094979000004, 2024-09-12T22:49:14.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:49:14.255 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:14.255 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:14.255 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:49:14.255 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:14.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:14.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:14.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:14.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:14.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:14.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:14.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:49:14.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:14.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:49:14.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:49:14.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:14.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:49:14.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:49:14.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:14.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:49:14.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:49:14.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:14.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:49:14.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:49:14.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:14.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:49:14.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:49:14.258 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.258 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:14.258 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.258 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:14.259 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:14.259 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.073486798999994, 2024-09-12T22:49:14.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:49:14.259 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:14.259 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:14.259 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:14.259 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:14.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:14.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:14.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:14.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:14.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:14.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:49:14.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:49:14.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:14.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:49:14.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:49:14.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:14.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:49:14.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:49:14.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:14.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:49:14.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:49:14.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:14.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:49:14.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:49:14.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:14.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:49:14.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:49:14.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:14.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:49:14.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:49:14.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:14.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:49:14.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:49:14.263 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.263 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:14.263 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.263 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:14.263 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:14.263 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.072593576000003, 2024-09-12T22:49:14.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:49:14.263 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:14.263 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:14.264 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:14.264 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:14.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:14.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:14.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:14.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:14.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:14.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:49:14.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:49:14.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:14.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:49:14.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:49:14.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:14.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:49:14.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:49:14.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:14.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:49:14.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:49:14.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:14.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:49:14.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:49:14.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:14.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:49:14.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:49:14.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:14.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:49:14.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:49:14.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:14.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:49:14.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:49:14.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:14.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:49:14.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:49:14.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:14.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:49:14.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:49:14.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:14.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:49:14.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:49:14.268 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.269 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:14.269 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.269 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:14.269 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:14.269 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.072521918000007, 2024-09-12T22:49:14.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:49:14.269 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:14.269 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:14.269 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:14.269 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:14.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:14.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:14.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:14.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:14.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:14.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:49:14.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:49:14.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:14.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:49:14.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:49:14.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:14.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:49:14.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:49:14.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:14.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:49:14.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:49:14.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:14.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:49:14.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:49:14.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:14.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:49:14.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:49:14.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:14.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:49:14.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:49:14.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:14.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:49:14.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:49:14.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:14.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:49:14.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:49:14.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:14.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:49:14.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:49:14.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:14.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:49:14.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:49:14.274 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.274 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:14.274 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.274 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:14.275 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:14.275 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.072479200000004, 2024-09-12T22:49:14.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:49:14.275 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:14.275 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:14.275 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:14.275 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:14.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:14.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:14.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:14.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:14.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:14.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:49:14.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:49:14.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:14.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:49:14.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:49:14.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:14.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:49:14.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:49:14.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:14.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:49:14.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:49:14.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:14.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:49:14.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:49:14.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:14.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:49:14.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:49:14.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:14.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:49:14.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:49:14.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:14.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:49:14.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:49:14.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:14.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:49:14.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:49:14.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:14.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:49:14.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:49:14.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:14.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:49:14.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:49:14.280 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.280 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:14.280 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.280 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:14.280 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:14.280 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.072441283000003, 2024-09-12T22:49:14.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:49:14.280 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:14.281 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:14.281 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:14.281 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:14.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:14.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:14.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:14.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:14.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:14.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:49:14.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:49:14.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:14.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:49:14.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:49:14.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:14.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:49:14.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:49:14.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:14.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:49:14.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:49:14.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:14.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:49:14.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:49:14.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:14.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:49:14.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:49:14.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:14.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:14.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:49:14.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:14.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:49:14.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:49:14.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:14.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:49:14.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:49:14.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:14.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:49:14.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:49:14.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:14.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:49:14.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:49:14.286 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.286 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:14.286 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.286 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:14.286 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:14.287 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.072417831999999, 2024-09-12T22:49:14.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:49:14.287 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:14.287 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:14.287 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:14.287 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:14.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:14.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:14.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:14.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:14.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:14.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:49:14.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:49:14.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:14.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:49:14.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:49:14.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:14.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:49:14.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:49:14.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:14.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:49:14.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:49:14.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:14.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:49:14.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:49:14.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:14.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:49:14.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:49:14.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:14.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:14.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:49:14.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:14.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:49:14.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:49:14.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:14.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:49:14.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:49:14.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:14.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:49:14.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:49:14.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:14.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:49:14.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:49:14.292 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.292 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:14.292 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.292 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:14.292 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:14.292 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.072393594999994, 2024-09-12T22:49:14.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:49:14.293 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:14.293 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:14.293 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:14.293 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:14.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:14.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:14.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:14.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:14.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:14.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:14.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:49:14.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:14.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:49:14.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:49:14.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:14.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:49:14.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:49:14.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:14.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:49:14.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:49:14.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:14.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:49:14.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:49:14.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:14.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:49:14.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:49:14.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:14.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:49:14.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:49:14.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:14.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:49:14.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:49:14.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:14.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:49:14.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:49:14.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:14.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:49:14.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:49:14.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:14.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:49:14.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:49:14.298 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.298 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:14.298 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.298 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:14.298 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:14.298 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.072365677999997, 2024-09-12T22:49:14.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:49:14.299 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:14.299 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:14.299 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:14.299 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:14.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:14.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:14.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:14.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:14.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:14.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:14.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:49:14.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:14.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:49:14.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:49:14.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:14.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:49:14.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:49:14.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:14.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:49:14.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:49:14.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:14.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:49:14.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:49:14.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:14.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:49:14.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:49:14.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:14.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:49:14.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:49:14.302 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.302 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:14.302 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.303 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:14.303 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:14.303 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.072291183000004, 2024-09-12T22:49:14.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:49:14.304 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:14.304 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:14.304 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:14.304 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:14.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:14.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:14.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:14.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:14.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:14.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:49:14.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:49:14.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:14.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:49:14.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:49:14.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:14.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:49:14.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:49:14.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:14.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:49:14.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:49:14.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:14.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:49:14.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:49:14.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:14.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:49:14.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:49:14.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:14.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:49:14.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:49:14.308 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.308 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:14.308 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.308 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:14.308 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:14.308 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.072245155000005, 2024-09-12T22:49:14.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:49:14.308 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:14.308 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:14.308 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:14.309 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:14.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:14.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:14.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:14.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:14.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:14.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:49:14.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:49:14.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:14.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:49:14.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:49:14.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:14.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:49:14.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:49:14.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:14.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:49:14.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:49:14.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:14.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:49:14.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:49:14.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:14.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:49:14.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:49:14.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:14.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:49:14.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:49:14.313 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.313 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:14.313 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.313 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:14.313 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:14.313 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.070074270999996, 2024-09-12T22:49:14.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:49:14.313 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:14.313 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:14.313 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:14.313 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:14.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:14.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:14.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:14.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:14.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:14.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:14.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:49:14.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:14.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:49:14.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:49:14.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:14.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:49:14.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:49:14.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:14.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:14.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:49:14.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:14.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:49:14.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:49:14.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:14.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:14.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:49:14.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:14.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:49:14.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:49:14.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:14.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:49:14.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:49:14.317 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.317 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:14.317 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.317 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:14.317 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:14.318 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.070023821000007, 2024-09-12T22:49:14.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:49:14.318 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:14.318 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:14.318 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:14.318 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:14.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:14.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:14.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:14.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:14.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:14.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:49:14.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:49:14.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:14.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:49:14.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:49:14.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:14.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:49:14.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:49:14.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:14.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:49:14.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:49:14.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:14.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:49:14.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:49:14.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:14.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:49:14.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:49:14.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:14.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:49:14.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:49:14.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:14.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:49:14.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:49:14.322 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.322 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:14.322 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.322 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:14.322 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:14.322 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.069970382999998, 2024-09-12T22:49:14.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:49:14.322 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:14.322 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:14.322 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:14.322 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:14.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:14.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:14.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:14.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:14.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:14.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:14.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:49:14.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:14.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:49:14.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:49:14.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:14.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:14.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:49:14.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:14.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:49:14.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:49:14.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:14.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:49:14.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:49:14.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:14.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:49:14.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:49:14.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:14.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:49:14.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:49:14.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:14.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:49:14.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:49:14.326 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.326 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:14.326 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.326 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:49:14.326 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:14.327 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.065986030000005, 2024-09-12T22:49:14.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:49:14.327 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:14.327 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:14.327 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:14.327 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:14.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:14.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:14.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:14.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:14.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:14.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:49:14.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:49:14.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:14.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:49:14.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:49:14.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:14.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:49:14.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:49:14.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:14.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:49:14.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:49:14.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:14.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:49:14.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:49:14.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:14.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:49:14.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:49:14.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:14.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:49:14.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:49:14.330 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.330 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:14.330 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.330 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:49:14.331 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:14.331 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 67.080833491000007, 2024-09-12T22:49:14.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:49:14.331 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:14.331 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:14.331 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:14.331 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:14.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:14.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:14.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:14.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:14.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:14.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:49:14.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:49:14.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:14.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:49:14.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:49:14.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:14.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:49:14.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:49:14.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:14.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:49:14.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:49:14.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:14.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:49:14.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:49:14.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:14.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:49:14.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:49:14.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:14.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:49:14.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:49:14.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:14.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:49:14.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:49:14.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:14.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:49:14.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:49:14.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:14.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:49:14.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:49:14.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:14.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:49:14.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:49:14.336 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.336 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:14.336 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.337 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:49:14.337 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:14.337 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 49.078917246000003, 2024-09-12T22:49:14.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:49:14.337 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:14.337 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:14.337 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:14.337 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:14.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:14.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:14.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:14.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:14.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:14.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:49:14.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:49:14.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:14.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:49:14.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:49:14.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:14.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:49:14.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:49:14.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:14.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:49:14.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:49:14.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:14.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:49:14.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:49:14.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:14.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:49:14.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:49:14.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:14.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:49:14.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:49:14.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:14.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:49:14.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:49:14.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:14.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:49:14.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:49:14.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:14.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:49:14.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:49:14.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:14.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:49:14.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:49:14.343 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.343 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:14.343 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.344 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:49:14.344 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:14.344 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 44.078163871000001, 2024-09-12T22:49:14.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012160610000000001, 2024-09-12T22:49:14.344 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:14.344 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:14.344 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:14.344 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:14.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:14.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:14.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:14.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:14.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:14.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:14.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164967+0000", 2024-09-12T22:49:14.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:49:14.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:14.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164974+0000", 2024-09-12T22:49:14.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:49:14.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:14.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164987+0000", 2024-09-12T22:49:14.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3689000000000001e-05 2024-09-12T22:49:14.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:14.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164995+0000", 2024-09-12T22:49:14.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2959999999999999e-06 2024-09-12T22:49:14.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:14.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165068+0000", 2024-09-12T22:49:14.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2449999999999999e-05 2024-09-12T22:49:14.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:14.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165212+0000", 2024-09-12T22:49:14.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144117 2024-09-12T22:49:14.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:14.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166066+0000", 2024-09-12T22:49:14.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085441100000000002 2024-09-12T22:49:14.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:14.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166107+0000", 2024-09-12T22:49:14.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0450000000000001e-05 2024-09-12T22:49:14.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:14.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:14.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:14.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166181+0000", 2024-09-12T22:49:14.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-12T22:49:14.348 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.348 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:14.348 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.348 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:14.348 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:14.348 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:14.349 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:49:14.350 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:14.349+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:14.351 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:14.450 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:14.449+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:14.457 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:14.457 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:14.458 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:49:14.458 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:14.466 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:14.526 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:49:14.526 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:49:14.543 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:49:14.544 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:49:14.544 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:49:14.549 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:49:14.549 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:49:14.550 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:14.549+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:14.568 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:14.568 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:14.577 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:14.652 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:14.651+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:14.679 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:14.679 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:14.688 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:14.753 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:14.752+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:14.794 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:14.795 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:14.803 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:14.853 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:14.853+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:14.905 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:14.906 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:14.914 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:14.956 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:14.953+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:15.017 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:15.017 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:15.026 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:15.054 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:15.053+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:15.131 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:15.131 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:15.140 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:15.183 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:15.182+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:15.242 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:15.242 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:15.251 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:15.256 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:15.255+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:15.356 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:15.355+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:15.394 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:15.394 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:15.403 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:15.458 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:15.457+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:15.506 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:15.506 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:15.515 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:15.535 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:49:15.559 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:15.559+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:15.617 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:15.618 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:15.627 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:15.661 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:15.660+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:15.731 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:15.731 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:15.740 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:15.784 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:15.783+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:15.845 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:15.845 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:15.853 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:15.895 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:15.894+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:15.963 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:15.962+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:15.997 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:15.997 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:16.006 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:16.064 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:16.063+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:16.147 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:16.148 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:16.156 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:16.165 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:16.164+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:16.262 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:16.262 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:16.266 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:16.265+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:16.271 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:16.367 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:16.366+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:16.413 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:16.413 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:16.422 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:16.506 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:16.505+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:16.522 INFO:teuthology.orchestra.run.smithi066.stderr:noscrub is unset 2024-09-12T22:49:16.550 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:49:16.566 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:16.566 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:16.568 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:16.567+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:16.575 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:16.669 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:16.668+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:16.680 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:16.680 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:16.688 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:16.744 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:49:16.744 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:49:16.769 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:16.768+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:16.775 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:49:16.775 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:49:16.775 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:49:16.779 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:49:16.780 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:49:16.790 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:16.790 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:16.790 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:49:16.790 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:49:16.790 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:16.799 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:16.870 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:16.869+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:16.903 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:16.903 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:49:16.903 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:49:16.903 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:49:16.903 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.903 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:49:16.903 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:16.904 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 80.517228903000003, 2024-09-12T22:49:16.904 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:49:16.904 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:16.904 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:16.904 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:16.904 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:16.904 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.904 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:16.904 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:16.904 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:16.904 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.905 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.905 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:16.905 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:16.905 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:16.905 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.905 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.905 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:16.905 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:16.905 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:49:16.905 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.905 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.906 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:16.906 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:49:16.906 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:49:16.906 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.906 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.906 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:16.906 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:49:16.906 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:49:16.906 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.906 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.906 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:16.906 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:49:16.907 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:49:16.907 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.907 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.907 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:16.907 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:49:16.907 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:49:16.907 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.907 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.908 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:16.908 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:49:16.908 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:49:16.908 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.908 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.908 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:16.908 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:49:16.908 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:49:16.908 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.909 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.909 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:16.909 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:49:16.909 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:49:16.909 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:16.909 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:16.909 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:16.909 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.909 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.909 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:49:16.909 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:16.909 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 80.516786319999994, 2024-09-12T22:49:16.910 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:49:16.910 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:16.910 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:16.910 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:16.910 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:16.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.910 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:16.910 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:16.910 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:16.910 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:16.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:16.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:16.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.911 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:16.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:49:16.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:49:16.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.911 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:16.912 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:49:16.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:49:16.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.912 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.912 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:16.912 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:49:16.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:49:16.913 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.913 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.913 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:16.913 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:49:16.913 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:49:16.913 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.913 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.913 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:16.913 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:49:16.913 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:49:16.913 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.914 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.914 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:16.914 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:49:16.914 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:49:16.914 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.914 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.914 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:16.914 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:49:16.914 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:49:16.914 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.915 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.915 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:16.915 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:49:16.915 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:49:16.915 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:16.915 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:16.915 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:16.915 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.915 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.916 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:49:16.916 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:16.916 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 80.516420163000006, 2024-09-12T22:49:16.916 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:49:16.916 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:16.916 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:16.916 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:16.916 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:16.916 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.916 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:16.916 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:16.917 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:16.917 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.917 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.917 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:16.917 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:16.917 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:16.917 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.917 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.917 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:16.917 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:49:16.917 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:49:16.917 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.918 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.918 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:16.918 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:49:16.918 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:49:16.918 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.918 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.918 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:16.918 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:49:16.918 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:49:16.918 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.918 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.918 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:16.919 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:49:16.919 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:49:16.919 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.919 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.919 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:16.919 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:49:16.919 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:49:16.919 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.919 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.919 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:16.919 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:49:16.919 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:49:16.920 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.920 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.920 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:16.920 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:49:16.920 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:49:16.920 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.920 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.920 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:16.920 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:49:16.920 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:49:16.920 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:16.921 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:16.921 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:16.921 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.921 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.921 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:49:16.921 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:16.921 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 80.516007850999998, 2024-09-12T22:49:16.921 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:49:16.921 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:16.921 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:16.921 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:16.922 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:16.922 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.922 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:16.922 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:16.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:16.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.922 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.922 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:16.922 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:16.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:16.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.923 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.923 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:16.923 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:16.923 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:49:16.923 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.923 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.923 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:16.923 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:49:16.923 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:49:16.923 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.923 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.923 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:16.924 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:49:16.924 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:49:16.924 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.924 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.924 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:16.924 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:49:16.924 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:49:16.924 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.924 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.924 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:16.924 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:49:16.925 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:49:16.925 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.925 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.925 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:16.925 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:49:16.925 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:49:16.925 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.925 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.925 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:16.925 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:49:16.925 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:49:16.926 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.926 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.926 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:16.926 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:49:16.926 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:49:16.926 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:16.926 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:16.926 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:16.926 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.926 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.926 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:49:16.927 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:16.927 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 80.382157757000002, 2024-09-12T22:49:16.927 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:49:16.927 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:16.927 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:16.927 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:16.927 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:16.927 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.927 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:16.927 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:16.928 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:16.928 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.928 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.928 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:16.928 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:16.928 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:16.928 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.928 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.928 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:16.928 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:16.928 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:49:16.929 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.929 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.929 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:16.929 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:49:16.929 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:49:16.929 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.929 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.929 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:16.929 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:49:16.929 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:49:16.929 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.929 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.930 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:16.930 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:49:16.930 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:49:16.930 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.930 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.930 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:16.930 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:49:16.930 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:49:16.930 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.930 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.930 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:16.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:49:16.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:49:16.931 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.931 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.931 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:16.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:49:16.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:49:16.931 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.931 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.931 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:16.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:49:16.932 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:49:16.932 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:16.932 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:16.932 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:16.932 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.932 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.932 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:16.932 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:16.932 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 71.736922203000006, 2024-09-12T22:49:16.932 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:49:16.932 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:16.933 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:16.933 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:16.933 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:16.933 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.933 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:16.933 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:16.933 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:16.933 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.933 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.933 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:16.933 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:16.933 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:16.934 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.934 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.934 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:16.934 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:49:16.934 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:49:16.934 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.934 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.934 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:16.934 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:49:16.934 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:49:16.934 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.935 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.935 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:16.935 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:49:16.935 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:49:16.935 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.935 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.935 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:16.935 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:49:16.935 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:49:16.935 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.935 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.935 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:16.936 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:16.936 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:49:16.936 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.936 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.936 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:16.936 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:16.936 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:49:16.936 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.936 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.936 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:16.936 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:49:16.936 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:49:16.937 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.937 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.937 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:16.937 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:49:16.937 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:49:16.937 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.937 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.937 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:16.937 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:49:16.937 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:49:16.937 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.938 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.938 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:16.938 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:49:16.938 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:49:16.938 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.938 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.938 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:16.938 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:49:16.938 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:49:16.938 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.938 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.938 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:16.939 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:49:16.939 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:49:16.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.939 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.939 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:16.939 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:49:16.939 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:49:16.939 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:16.939 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:16.939 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:16.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.939 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.940 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:16.940 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:16.940 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 71.736822685999996, 2024-09-12T22:49:16.940 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:49:16.940 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:16.940 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:16.940 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:16.940 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:16.940 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.940 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:16.940 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:16.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:16.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.941 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.941 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:16.941 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:16.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:16.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.941 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.941 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:16.941 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:49:16.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:49:16.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.942 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.942 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:16.942 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:49:16.942 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:49:16.942 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.942 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.942 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:16.942 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:49:16.942 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:49:16.942 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.942 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.943 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:16.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:49:16.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:49:16.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.943 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:16.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:49:16.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:49:16.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.943 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:16.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:49:16.944 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:49:16.944 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.944 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.944 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:16.944 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:49:16.944 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:49:16.944 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.944 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.944 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:16.944 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:49:16.944 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:49:16.944 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.945 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.945 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:16.945 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:49:16.945 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:49:16.945 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.945 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.945 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:16.945 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:49:16.945 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:49:16.945 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.945 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.945 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:16.946 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:49:16.946 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:49:16.946 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.946 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.946 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:16.946 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:49:16.946 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:49:16.946 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.946 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.946 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:16.946 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:49:16.946 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:49:16.947 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:16.947 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:16.947 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:16.947 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.947 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.947 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:16.947 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:16.947 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 71.736777946999993, 2024-09-12T22:49:16.947 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:49:16.947 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:16.947 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:16.947 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:16.948 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:16.948 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.948 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:16.948 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:16.948 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:16.948 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.948 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.948 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:16.948 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:16.948 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:16.949 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.949 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.949 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:16.949 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:49:16.949 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:49:16.949 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.949 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.949 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:16.949 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:16.949 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:49:16.949 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.950 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.950 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:16.950 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:16.950 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:49:16.950 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.950 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.950 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:16.950 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:49:16.950 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:49:16.950 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.950 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.950 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:16.951 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:49:16.951 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:49:16.951 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.951 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.951 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:16.951 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:49:16.951 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:49:16.951 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.951 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.951 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:16.951 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:49:16.952 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:49:16.952 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.952 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.952 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:16.952 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:49:16.952 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:49:16.952 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.952 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.952 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:16.952 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:49:16.952 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:49:16.953 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.953 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.953 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:16.953 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:49:16.953 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:49:16.953 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.953 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.953 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:16.953 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:49:16.953 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:49:16.953 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.954 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.954 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:16.954 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:49:16.954 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:49:16.954 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.954 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.954 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:16.954 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:49:16.954 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:49:16.954 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:16.954 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:16.954 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:16.955 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.955 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.955 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:16.955 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:16.955 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 71.736550245999993, 2024-09-12T22:49:16.955 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:49:16.955 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:16.955 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:16.955 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:16.955 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:16.955 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.955 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:16.956 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:16.956 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:16.956 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.956 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.956 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:16.956 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:16.956 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:16.956 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.956 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.956 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:16.956 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:49:16.957 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:49:16.957 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.957 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.957 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:16.957 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:49:16.957 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:49:16.957 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.957 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.957 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:16.957 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:49:16.957 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:49:16.957 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.958 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.958 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:16.958 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:49:16.958 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:49:16.958 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.958 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.958 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:16.958 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:49:16.958 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:49:16.958 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.958 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.959 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:16.959 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:49:16.959 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:49:16.959 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.959 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.959 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:16.959 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:49:16.959 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:49:16.959 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.959 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.959 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:16.959 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:49:16.960 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:49:16.960 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.960 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.960 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:16.960 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:49:16.960 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:49:16.960 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.960 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.960 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:16.960 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:49:16.960 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:49:16.961 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.961 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.961 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:16.961 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:49:16.961 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:49:16.961 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.961 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.961 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:16.961 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:49:16.961 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:49:16.961 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.961 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.962 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:16.962 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:49:16.962 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:49:16.962 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:16.962 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:16.962 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:16.962 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.962 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.962 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:16.962 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:16.962 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 71.736385138000003, 2024-09-12T22:49:16.963 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:49:16.963 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:16.963 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:16.963 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:16.963 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:16.963 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.963 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:16.963 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:16.963 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:16.963 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.963 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.963 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:16.964 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:16.964 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:16.964 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.964 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.964 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:16.964 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:49:16.964 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:49:16.964 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.964 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.964 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:16.964 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:49:16.964 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:49:16.965 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.965 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.965 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:16.965 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:49:16.965 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:49:16.965 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.965 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.965 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:16.965 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:49:16.965 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:49:16.965 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.966 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.966 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:16.966 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:49:16.966 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:49:16.966 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.966 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.966 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:16.966 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:49:16.966 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:49:16.966 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.967 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.967 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:16.967 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:49:16.967 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:49:16.967 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.967 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.967 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:16.967 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:49:16.967 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:49:16.967 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.967 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.968 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:16.968 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:49:16.968 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:49:16.968 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.968 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.968 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:16.968 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:49:16.968 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:49:16.968 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.968 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.968 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:16.969 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:49:16.969 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:49:16.969 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.969 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.969 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:16.969 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:49:16.969 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:49:16.969 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.969 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.969 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:16.970 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:49:16.970 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:49:16.970 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:16.970 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:16.970 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:16.970 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.970 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.970 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:16.970 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:16.970 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 71.736323853000002, 2024-09-12T22:49:16.970 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:49:16.971 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:16.971 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:16.971 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:16.971 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:16.971 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.971 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:16.971 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:16.971 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:16.971 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.971 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.971 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:16.971 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:16.972 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:16.972 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.972 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.972 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:16.972 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:16.972 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:49:16.972 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.972 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.972 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:16.972 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:49:16.973 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:49:16.973 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.973 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.973 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:16.973 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:49:16.973 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:49:16.973 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.973 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.973 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:16.973 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:49:16.973 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:49:16.974 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.974 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.974 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:16.974 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:49:16.974 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:49:16.974 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.974 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.974 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:16.974 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:49:16.974 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:49:16.974 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.975 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.975 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:16.975 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:49:16.975 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:49:16.975 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.975 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.975 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:16.975 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:49:16.975 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:49:16.975 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.975 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.976 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:16.976 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:49:16.976 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:49:16.976 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.976 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.976 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:16.976 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:49:16.976 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:49:16.976 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.976 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.976 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:16.977 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:49:16.977 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:49:16.977 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.977 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.977 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:16.977 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:49:16.977 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:49:16.977 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.977 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.977 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:16.977 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:49:16.978 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:49:16.978 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:16.978 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:16.978 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:16.978 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.978 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.978 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:16.978 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:16.978 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 71.736243744999996, 2024-09-12T22:49:16.978 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:49:16.978 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:16.979 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:16.979 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:16.979 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:16.979 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.979 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:16.979 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:16.979 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:16.979 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.979 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.979 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:16.979 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:16.979 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:16.980 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.980 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.980 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:16.980 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:49:16.980 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:49:16.980 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.980 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.980 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:16.980 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:49:16.980 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:49:16.980 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.981 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.981 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:16.981 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:49:16.981 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:49:16.981 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.981 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.981 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:16.981 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:49:16.981 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:49:16.981 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.981 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.982 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:16.982 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:49:16.982 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:49:16.982 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.982 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.982 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:16.982 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:49:16.982 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:49:16.982 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.982 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.982 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:16.982 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:49:16.983 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:49:16.983 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.983 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.983 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:16.983 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:49:16.983 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:49:16.983 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.983 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.983 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:16.983 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:49:16.983 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:49:16.983 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.984 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.984 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:16.984 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:49:16.984 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:49:16.984 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.984 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.984 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:16.984 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:49:16.984 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:49:16.984 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.984 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.985 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:16.985 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:49:16.985 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:49:16.985 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.985 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.985 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:16.985 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:49:16.985 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:49:16.985 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:16.985 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:16.985 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:16.985 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.986 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.986 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:16.986 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:16.986 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 71.736194792000006, 2024-09-12T22:49:16.986 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:49:16.986 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:16.986 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:16.986 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:16.986 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:16.986 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.986 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:16.986 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:16.987 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:16.987 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.987 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.987 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:16.987 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:16.987 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:16.987 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.987 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.987 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:16.987 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:16.987 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:49:16.987 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.988 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.988 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:16.988 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:49:16.988 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:49:16.988 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.988 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.988 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:16.988 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:49:16.988 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:49:16.988 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.988 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.989 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:16.989 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:49:16.989 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:49:16.989 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.989 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.989 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:16.989 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:49:16.989 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:49:16.989 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.989 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.989 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:16.990 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:49:16.990 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:49:16.990 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.990 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.990 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:16.990 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:49:16.990 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:49:16.990 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:16.990 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:16.990 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:16.991 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.991 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.991 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:16.991 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:16.991 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 71.736145691999994, 2024-09-12T22:49:16.991 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:49:16.991 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:16.991 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:16.991 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:16.991 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:16.991 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.991 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:16.992 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:16.992 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:16.992 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.992 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.992 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:16.992 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:16.992 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:16.992 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.992 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.992 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:16.992 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:49:16.993 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:49:16.993 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.993 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:16.993 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:49:16.993 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:49:16.993 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.993 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:16.993 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:49:16.993 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:49:16.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.994 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.994 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:16.994 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:49:16.994 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:49:16.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.994 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.994 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:16.994 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:49:16.994 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:49:16.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.995 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.995 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:16.995 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:49:16.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:49:16.995 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.995 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.995 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:16.995 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:49:16.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:49:16.995 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:16.995 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:16.995 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:16.996 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.996 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.996 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:16.996 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:16.996 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 71.729205242000006, 2024-09-12T22:49:16.996 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:49:16.996 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:16.996 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:16.996 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:16.996 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:16.996 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:16.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:16.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:16.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:16.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:16.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:16.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:16.998 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:49:16.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:49:16.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.998 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.998 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:16.998 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:49:16.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:49:16.999 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.999 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.999 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:16.999 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:49:16.999 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:49:16.999 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:16.999 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:16.999 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:16.999 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:49:16.999 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:49:16.999 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:17.000 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:49:17.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:49:17.000 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:17.001 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:49:17.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:49:17.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.001 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:17.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:49:17.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:49:17.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.002 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:17.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:49:17.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:49:17.002 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.003 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:17.004 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.004 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:17.004 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:17.004 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 71.728116401999998, 2024-09-12T22:49:17.004 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:49:17.004 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:17.004 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:17.004 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.004 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:17.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.005 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:17.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:17.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.005 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:17.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:17.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.005 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:17.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:49:17.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:49:17.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.006 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:17.006 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:49:17.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:49:17.006 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.006 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:17.006 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:49:17.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:49:17.006 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.006 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.006 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:49:17.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:49:17.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.007 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:17.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:49:17.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:49:17.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.007 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:17.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:49:17.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:49:17.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.007 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:17.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:49:17.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:49:17.008 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.008 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:17.008 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:49:17.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:49:17.008 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.008 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:17.008 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.008 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.008 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:17.008 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:17.009 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 71.728066791000003, 2024-09-12T22:49:17.009 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:49:17.009 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:17.009 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:17.009 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.009 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:17.009 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:17.009 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:17.009 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.009 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.009 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:17.009 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:17.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.010 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:17.010 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:17.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:49:17.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.010 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:17.010 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:17.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:49:17.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.011 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:17.011 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:49:17.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:49:17.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.011 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.011 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:49:17.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:49:17.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.011 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:17.012 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:49:17.012 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:49:17.012 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.012 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.012 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:17.012 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:49:17.012 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:49:17.012 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.012 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.012 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:17.012 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:49:17.012 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:49:17.012 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.013 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:17.013 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:49:17.013 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:49:17.013 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.013 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:17.013 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.013 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:17.013 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:17.013 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 71.727999482000001, 2024-09-12T22:49:17.013 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:49:17.013 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:17.014 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:17.014 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.014 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:17.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:17.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:17.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:17.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:17.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:17.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:17.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:49:17.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:17.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:49:17.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:49:17.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:17.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:49:17.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:49:17.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:49:17.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:49:17.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:17.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:49:17.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:49:17.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:17.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:49:17.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:49:17.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:17.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:49:17.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:49:17.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:17.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:49:17.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:49:17.018 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.018 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:17.018 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.018 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:17.018 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:17.019 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 71.727431562999996, 2024-09-12T22:49:17.019 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:49:17.019 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:17.019 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:17.019 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.019 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:17.019 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.019 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:17.019 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:17.019 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.019 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.019 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.019 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:17.019 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:17.020 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.020 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:17.020 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:17.020 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:49:17.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.020 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:17.020 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:49:17.020 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:49:17.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.020 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:17.021 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:49:17.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:49:17.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.021 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.021 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.021 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:49:17.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:49:17.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.021 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.021 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:17.021 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:49:17.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:49:17.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:17.022 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:49:17.022 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:49:17.022 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:17.022 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:49:17.022 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:49:17.022 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:17.022 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:49:17.022 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:49:17.023 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.023 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:17.023 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.023 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:49:17.023 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:17.023 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 71.727053959000003, 2024-09-12T22:49:17.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:49:17.023 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:17.023 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:17.023 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.024 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:17.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.024 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:17.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:17.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.024 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:17.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:17.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.024 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:17.025 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:49:17.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:49:17.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.025 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.025 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:17.025 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:49:17.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:49:17.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.025 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.025 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:17.025 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:49:17.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:49:17.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.026 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.026 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:49:17.026 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:49:17.026 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.026 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:17.026 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:49:17.026 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:49:17.026 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.026 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:17.026 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:49:17.026 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:49:17.027 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.027 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.027 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:17.027 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:49:17.027 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:49:17.027 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.027 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.027 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:17.027 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:49:17.027 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:49:17.027 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.027 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:17.027 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.027 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.028 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:17.028 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:17.029 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:17.030 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:17.028+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:17.130 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:17.129+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:17.134 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:17.134 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:17.134 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:49:17.134 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:17.142 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:17.231 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:17.230+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:17.245 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:17.245 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:17.245 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:49:17.245 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:49:17.245 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:17.254 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:17.332 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:17.332+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:17.402 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:17.402 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:49:17.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:49:17.402 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:49:17.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.402 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:49:17.402 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:17.402 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.353979440000003, 2024-09-12T22:49:17.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:49:17.403 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:17.403 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:17.403 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.403 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:17.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:17.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:17.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:17.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:17.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:17.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:17.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:49:17.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:17.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:49:17.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:49:17.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:17.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:49:17.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:49:17.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:49:17.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:49:17.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:17.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:49:17.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:49:17.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:17.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:49:17.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:49:17.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:17.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:49:17.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:49:17.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:17.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:49:17.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:49:17.408 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.408 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:17.408 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.408 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:49:17.408 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:17.409 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 75.353598712999997, 2024-09-12T22:49:17.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:49:17.409 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:17.409 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:17.409 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.409 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:17.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:17.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:17.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:17.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:17.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:17.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:49:17.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:49:17.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:17.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:49:17.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:49:17.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:17.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:49:17.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:49:17.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:49:17.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:49:17.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:17.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:49:17.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:49:17.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:17.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:49:17.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:49:17.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:17.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:49:17.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:49:17.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:17.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:49:17.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:49:17.413 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.413 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:17.413 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.413 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:49:17.413 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:17.413 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 72.233001903000002, 2024-09-12T22:49:17.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:49:17.414 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:17.414 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:17.414 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:49:17.414 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:17.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:17.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:17.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:17.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:17.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:17.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:17.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:49:17.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:17.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:49:17.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:49:17.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:17.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:49:17.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:49:17.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:49:17.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:49:17.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:17.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:49:17.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:49:17.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:17.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:49:17.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:49:17.417 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.417 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:17.418 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.418 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:17.418 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:17.418 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 72.230393723000006, 2024-09-12T22:49:17.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:49:17.418 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:17.418 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:17.419 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.419 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:17.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:17.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:17.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:17.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:17.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:17.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:49:17.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:49:17.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:17.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:49:17.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:49:17.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:17.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:49:17.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:49:17.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:49:17.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:49:17.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:17.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:49:17.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:49:17.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:17.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:49:17.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:49:17.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:17.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:49:17.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:49:17.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:17.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:49:17.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:49:17.424 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.424 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:17.424 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.424 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:17.424 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:17.424 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 72.2295005, 2024-09-12T22:49:17.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:49:17.424 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:17.424 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:17.425 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.425 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:17.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:17.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:17.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:17.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:17.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:17.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:49:17.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:49:17.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:17.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:49:17.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:49:17.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:17.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:49:17.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:49:17.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:49:17.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:49:17.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:17.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:49:17.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:49:17.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:17.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:49:17.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:49:17.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:17.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:49:17.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:49:17.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:17.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:49:17.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:49:17.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:17.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:49:17.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:49:17.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:17.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:49:17.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:49:17.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:17.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:49:17.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:49:17.430 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.430 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:17.430 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.430 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:17.430 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:17.431 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 72.229428842000004, 2024-09-12T22:49:17.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:49:17.431 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:17.431 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:17.431 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.431 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:17.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:17.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:17.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:17.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:17.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:17.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:49:17.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:49:17.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:17.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:49:17.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:49:17.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:17.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:49:17.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:49:17.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:49:17.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:49:17.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:17.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:49:17.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:49:17.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:17.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:49:17.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:49:17.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:17.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:49:17.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:49:17.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:17.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:49:17.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:49:17.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:17.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:49:17.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:49:17.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:17.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:49:17.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:49:17.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:17.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:49:17.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:49:17.436 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.436 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:17.436 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.436 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:17.436 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:17.436 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 72.229386124000001, 2024-09-12T22:49:17.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:49:17.436 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:17.437 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:17.437 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.437 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:17.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:17.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:17.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:17.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:17.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:17.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:49:17.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:49:17.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:17.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:49:17.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:49:17.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:17.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:49:17.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:49:17.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:49:17.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:49:17.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:17.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:49:17.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:49:17.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:17.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:49:17.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:49:17.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:17.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:49:17.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:49:17.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:17.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:49:17.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:49:17.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:17.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:49:17.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:49:17.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:17.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:49:17.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:49:17.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:17.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:49:17.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:49:17.441 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.442 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:17.442 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.442 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:17.442 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:17.442 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 72.229348207000001, 2024-09-12T22:49:17.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:49:17.442 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:17.442 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:17.442 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.443 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:17.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:17.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:17.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:17.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:17.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:17.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:49:17.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:49:17.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:17.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:49:17.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:49:17.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:17.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:49:17.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:49:17.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:49:17.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:49:17.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:17.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:49:17.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:49:17.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:17.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:49:17.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:49:17.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:17.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:17.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:49:17.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:17.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:49:17.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:49:17.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:17.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:49:17.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:49:17.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:17.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:49:17.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:49:17.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:17.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:49:17.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:49:17.448 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.448 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:17.448 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.448 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:17.448 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:17.448 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 72.229324755999997, 2024-09-12T22:49:17.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:49:17.448 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:17.448 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:17.449 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.449 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:17.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:17.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:17.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:17.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:17.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:17.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:49:17.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:49:17.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:17.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:49:17.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:49:17.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:17.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:49:17.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:49:17.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:49:17.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:49:17.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:17.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:49:17.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:49:17.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:17.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:49:17.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:49:17.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:17.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:17.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:49:17.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:17.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:49:17.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:49:17.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:17.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:49:17.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:49:17.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:17.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:49:17.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:49:17.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:17.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:49:17.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:49:17.454 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.454 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:17.454 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.454 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:17.454 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:17.454 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 72.229300519000006, 2024-09-12T22:49:17.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:49:17.455 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:17.455 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:17.455 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.455 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:17.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:17.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:17.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:17.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:17.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:17.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:17.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:49:17.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:17.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:49:17.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:49:17.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:17.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:49:17.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:49:17.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:49:17.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:49:17.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:17.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:49:17.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:49:17.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:17.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:49:17.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:49:17.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:17.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:49:17.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:49:17.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:17.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:49:17.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:49:17.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:17.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:49:17.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:49:17.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:17.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:49:17.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:49:17.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:17.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:49:17.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:49:17.460 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.460 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:17.460 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.460 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:17.461 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:17.461 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 72.229272601999995, 2024-09-12T22:49:17.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:49:17.461 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:17.461 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:17.461 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:17.461 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:17.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:17.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:17.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:17.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:17.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:17.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:17.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:49:17.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:17.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:49:17.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:49:17.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:17.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:49:17.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:49:17.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:49:17.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:49:17.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:17.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:49:17.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:49:17.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:17.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:49:17.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:49:17.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:17.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:49:17.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:49:17.464 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.464 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:17.465 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.465 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:17.465 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:17.465 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 72.229198107000002, 2024-09-12T22:49:17.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:49:17.465 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:17.465 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:17.465 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:17.465 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:17.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:17.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:17.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:17.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:17.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:17.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:49:17.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:49:17.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:17.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:49:17.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:49:17.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:17.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:49:17.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:49:17.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:49:17.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:49:17.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:17.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:49:17.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:49:17.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:17.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:49:17.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:49:17.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:17.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:49:17.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:49:17.469 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.469 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:17.469 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.469 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:17.469 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:17.469 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 72.229152079000002, 2024-09-12T22:49:17.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:49:17.469 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:17.469 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:17.469 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:17.470 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:17.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:17.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:17.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:17.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:17.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:17.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:49:17.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:49:17.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:17.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:49:17.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:49:17.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:17.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:49:17.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:49:17.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:49:17.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:49:17.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:17.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:49:17.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:49:17.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:17.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:49:17.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:49:17.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:17.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:49:17.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:49:17.473 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.473 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:17.473 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.473 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:17.473 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:17.473 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 72.226981194999993, 2024-09-12T22:49:17.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:49:17.474 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:17.474 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:17.474 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.474 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:17.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:17.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:17.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:17.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:17.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:17.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:17.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:49:17.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:17.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:49:17.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:49:17.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:17.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:49:17.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:49:17.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:17.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:49:17.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:17.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:49:17.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:49:17.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:17.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:17.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:49:17.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:17.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:49:17.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:49:17.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:17.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:49:17.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:49:17.478 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.478 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:17.478 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.478 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:17.478 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:17.478 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 72.226930745000004, 2024-09-12T22:49:17.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:49:17.478 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:17.478 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:17.478 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.478 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:17.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:17.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:17.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:17.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:17.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:17.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:49:17.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:49:17.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:17.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:49:17.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:49:17.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:17.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:49:17.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:49:17.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:49:17.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:49:17.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:17.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:49:17.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:49:17.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:17.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:49:17.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:49:17.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:17.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:49:17.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:49:17.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:17.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:49:17.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:49:17.482 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.482 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:17.482 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.482 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:17.483 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:17.483 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 72.226877306999995, 2024-09-12T22:49:17.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:49:17.483 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:17.483 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:17.483 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.483 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:17.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:17.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:17.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:17.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:17.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:17.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:17.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:49:17.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:17.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:49:17.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:49:17.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:17.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:17.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:49:17.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:49:17.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:49:17.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:17.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:49:17.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:49:17.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:17.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:49:17.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:49:17.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:17.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:49:17.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:49:17.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:17.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:49:17.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:49:17.487 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.487 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:17.487 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.487 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:49:17.487 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:17.487 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 72.222892954000002, 2024-09-12T22:49:17.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:49:17.488 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:17.488 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:17.488 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:17.488 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:17.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:17.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:17.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:17.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:17.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:17.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:49:17.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:49:17.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:17.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:49:17.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:49:17.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:17.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:49:17.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:49:17.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:49:17.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:49:17.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:17.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:49:17.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:49:17.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:17.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:49:17.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:49:17.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:17.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:49:17.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:49:17.491 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.491 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:17.491 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.491 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:49:17.491 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:17.491 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 70.237740415000005, 2024-09-12T22:49:17.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:49:17.492 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:17.492 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:17.492 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.492 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:17.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:17.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:17.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:17.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:17.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:17.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:49:17.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:49:17.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:17.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:49:17.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:49:17.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:17.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:49:17.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:49:17.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:49:17.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:49:17.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:17.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:49:17.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:49:17.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:17.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:49:17.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:49:17.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:17.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:49:17.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:49:17.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:17.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:49:17.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:49:17.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:17.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:49:17.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:49:17.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:17.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:49:17.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:49:17.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:17.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:49:17.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:49:17.497 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.497 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:17.497 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.497 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:49:17.497 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:17.497 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 52.235824170000001, 2024-09-12T22:49:17.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:49:17.497 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:17.497 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:17.497 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.497 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:17.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:17.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:17.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:17.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:17.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:17.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:49:17.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:49:17.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:17.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:49:17.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:49:17.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:17.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:49:17.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:49:17.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:49:17.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:49:17.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:17.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:49:17.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:49:17.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:17.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:49:17.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:49:17.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:17.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:49:17.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:49:17.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:17.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:49:17.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:49:17.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:17.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:49:17.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:49:17.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:17.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:49:17.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:49:17.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:17.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:49:17.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:49:17.503 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.503 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:17.503 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.503 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:49:17.503 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:17.503 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.235070794999999, 2024-09-12T22:49:17.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012160610000000001, 2024-09-12T22:49:17.503 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:17.503 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:17.503 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.504 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:17.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:17.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:17.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:17.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:17.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:17.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:17.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164967+0000", 2024-09-12T22:49:17.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:49:17.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:17.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164974+0000", 2024-09-12T22:49:17.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:49:17.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:17.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164987+0000", 2024-09-12T22:49:17.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3689000000000001e-05 2024-09-12T22:49:17.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164995+0000", 2024-09-12T22:49:17.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2959999999999999e-06 2024-09-12T22:49:17.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:17.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165068+0000", 2024-09-12T22:49:17.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2449999999999999e-05 2024-09-12T22:49:17.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:17.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165212+0000", 2024-09-12T22:49:17.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144117 2024-09-12T22:49:17.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:17.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166066+0000", 2024-09-12T22:49:17.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085441100000000002 2024-09-12T22:49:17.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:17.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166107+0000", 2024-09-12T22:49:17.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0450000000000001e-05 2024-09-12T22:49:17.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:17.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:17.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:17.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166181+0000", 2024-09-12T22:49:17.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-12T22:49:17.508 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.508 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:17.508 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.508 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:17.508 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:17.508 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:17.510 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:17.510 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:17.509+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:17.611 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:17.610+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:17.615 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:17.615 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:17.616 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:49:17.616 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:17.625 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:17.712 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:17.710+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:17.727 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:17.728 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:17.728 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:49:17.728 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:49:17.728 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:17.736 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:17.812 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:17.811+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:17.841 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:17.841 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:49:17.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:49:17.841 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:49:17.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.841 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:49:17.841 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:17.842 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 81.455142588000001, 2024-09-12T22:49:17.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:49:17.842 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:17.842 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:17.842 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.842 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:17.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:17.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:17.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:17.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:17.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:17.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:17.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:49:17.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:17.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:49:17.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:49:17.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:17.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:49:17.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:49:17.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:49:17.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:49:17.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:17.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:49:17.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:49:17.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:17.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:49:17.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:49:17.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:17.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:49:17.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:49:17.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:17.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:49:17.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:49:17.846 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.846 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:17.846 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.846 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:49:17.846 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:17.846 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 81.454700005000007, 2024-09-12T22:49:17.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:49:17.846 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:17.847 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:17.847 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.847 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:17.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:17.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:17.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:17.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:17.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:17.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:49:17.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:49:17.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:17.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:49:17.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:49:17.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:17.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:49:17.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:49:17.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:49:17.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:49:17.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:17.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:49:17.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:49:17.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:17.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:49:17.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:49:17.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:17.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:49:17.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:49:17.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:17.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:49:17.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:49:17.852 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.852 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:17.852 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.853 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:49:17.853 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:17.853 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 81.454333848000005, 2024-09-12T22:49:17.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:49:17.853 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:17.853 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:17.853 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.853 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:17.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:17.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:17.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:17.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:17.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:17.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:49:17.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:49:17.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:17.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:49:17.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:49:17.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:17.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:49:17.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:49:17.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:49:17.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:49:17.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:17.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:49:17.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:49:17.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:17.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:49:17.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:49:17.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:17.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:49:17.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:49:17.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:17.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:49:17.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:49:17.857 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.857 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:17.857 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.857 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:49:17.857 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:17.857 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 81.453921535999996, 2024-09-12T22:49:17.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:49:17.858 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:17.858 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:17.858 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.858 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:17.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:17.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:17.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:17.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:17.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:17.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:17.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:49:17.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:17.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:49:17.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:49:17.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:17.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:49:17.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:49:17.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:49:17.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:49:17.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:17.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:49:17.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:49:17.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:17.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:49:17.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:49:17.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:17.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:49:17.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:49:17.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:17.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:49:17.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:49:17.862 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.862 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:17.862 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.862 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:49:17.862 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:17.862 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 81.320071442, 2024-09-12T22:49:17.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:49:17.862 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:17.863 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:17.863 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.863 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:17.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:17.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:17.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:17.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:17.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:17.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:17.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:49:17.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:17.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:49:17.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:49:17.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:17.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:49:17.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:49:17.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:49:17.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:49:17.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:17.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:49:17.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:49:17.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:17.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:49:17.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:49:17.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:17.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:49:17.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:49:17.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:17.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:49:17.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:49:17.867 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.867 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:17.867 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.867 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:17.867 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:17.867 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.674835888000004, 2024-09-12T22:49:17.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:49:17.867 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:17.867 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:17.868 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.868 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:17.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:17.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:17.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:17.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:17.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:17.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:49:17.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:49:17.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:17.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:49:17.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:49:17.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:17.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:49:17.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:49:17.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:49:17.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:49:17.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:17.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:17.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:49:17.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:17.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:17.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:49:17.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:17.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:49:17.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:49:17.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:17.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:49:17.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:49:17.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:17.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:49:17.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:49:17.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:17.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:49:17.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:49:17.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:17.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:49:17.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:49:17.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:17.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:49:17.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:49:17.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:17.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:49:17.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:49:17.873 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.873 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:17.874 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.874 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.874 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.874 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:17.874 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:17.874 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.674736370999995, 2024-09-12T22:49:17.874 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:49:17.874 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:17.874 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:17.874 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.874 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:17.874 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.874 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:17.874 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:17.875 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.875 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.875 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:17.875 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:17.875 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.875 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.875 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:17.875 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:49:17.875 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:49:17.875 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.875 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:17.876 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:49:17.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:49:17.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.876 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:17.876 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:49:17.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:49:17.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.876 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.876 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:49:17.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:49:17.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.877 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:17.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:49:17.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:49:17.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.877 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:17.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:49:17.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:49:17.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.877 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:17.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:49:17.878 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:49:17.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.878 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:17.878 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:49:17.878 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:49:17.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.878 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:17.878 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:49:17.878 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:49:17.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.879 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:17.879 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:49:17.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:49:17.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.879 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.879 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:17.879 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:49:17.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:49:17.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.879 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.879 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:17.879 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:49:17.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:49:17.880 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.880 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:17.880 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:49:17.880 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:49:17.880 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.880 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:17.880 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.880 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.880 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:17.880 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:17.881 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.674691632000005, 2024-09-12T22:49:17.881 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:49:17.881 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:17.881 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:17.881 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.881 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:17.881 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.881 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:17.881 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:17.881 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.881 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.881 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.881 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:17.882 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:17.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.882 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:17.882 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:49:17.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:49:17.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.882 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:17.882 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:17.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:49:17.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.883 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:17.883 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:17.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:49:17.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.883 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.883 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:49:17.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:49:17.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.883 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:17.883 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:49:17.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:49:17.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:17.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:49:17.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:49:17.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:17.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:49:17.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:49:17.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:17.885 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:49:17.885 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:49:17.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:17.885 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:49:17.885 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:49:17.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:17.885 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:49:17.886 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:49:17.886 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.886 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.886 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:17.886 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:49:17.886 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:49:17.886 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.886 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.886 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:17.886 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:49:17.886 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:49:17.886 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.886 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.887 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:17.887 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:49:17.887 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:49:17.887 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.887 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:17.887 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.887 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.887 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.887 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:17.887 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:17.887 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.674463931000005, 2024-09-12T22:49:17.888 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:49:17.888 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:17.888 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:17.888 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.888 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:17.888 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.888 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:17.888 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:17.888 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.888 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.888 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.889 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:17.889 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:17.889 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.889 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.889 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:17.889 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:49:17.889 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:49:17.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.889 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.889 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:17.889 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:49:17.890 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:49:17.890 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.890 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:17.890 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:49:17.890 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:49:17.890 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.890 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.890 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:49:17.890 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:49:17.890 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.891 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:17.891 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:49:17.891 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:49:17.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.891 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.891 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:17.891 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:49:17.891 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:49:17.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.891 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.891 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:17.891 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:49:17.891 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:49:17.892 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.892 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.892 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:17.892 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:49:17.892 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:49:17.892 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.892 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.892 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:17.892 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:49:17.892 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:49:17.892 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.892 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.892 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:17.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:49:17.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:49:17.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.893 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:17.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:49:17.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:49:17.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.893 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:17.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:49:17.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:49:17.894 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.894 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.894 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:17.894 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:49:17.894 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:49:17.894 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.894 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:17.894 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.894 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.894 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.894 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:17.894 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:17.895 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.674298823000001, 2024-09-12T22:49:17.895 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:49:17.895 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:17.895 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:17.895 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.895 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:17.895 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.895 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:17.895 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:17.895 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.895 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.895 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.896 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:17.896 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:17.896 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.896 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.896 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.896 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:17.896 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:49:17.896 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:49:17.896 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.896 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.896 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:17.896 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:49:17.897 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:49:17.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.897 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:17.897 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:49:17.897 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:49:17.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.897 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.897 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:49:17.897 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:49:17.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.897 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:17.898 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:49:17.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:49:17.898 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.898 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.898 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:17.898 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:49:17.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:49:17.898 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.898 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.898 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:17.898 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:49:17.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:49:17.898 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.899 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:17.899 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:49:17.899 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:49:17.899 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.899 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:17.899 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:49:17.899 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:49:17.899 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.899 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:17.899 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:49:17.900 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:49:17.900 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.900 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.900 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:17.900 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:49:17.900 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:49:17.900 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.900 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.900 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:17.900 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:49:17.900 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:49:17.900 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.900 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.901 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:17.901 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:49:17.901 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:49:17.901 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.901 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:17.901 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.901 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.901 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.901 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:17.901 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:17.901 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.674237538, 2024-09-12T22:49:17.901 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:49:17.901 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:17.901 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:17.902 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.902 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:17.902 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.902 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:17.902 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:17.902 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.902 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.902 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.902 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:17.902 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:17.902 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.902 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.902 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.903 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:17.903 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:17.903 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:49:17.903 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.903 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.903 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:17.903 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:49:17.903 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:49:17.903 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.903 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.903 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:17.903 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:49:17.903 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:49:17.904 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.904 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.904 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.904 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:49:17.904 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:49:17.904 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.904 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.904 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:17.904 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:49:17.904 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:49:17.904 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.904 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.904 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:17.905 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:49:17.905 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:49:17.905 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.905 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.905 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:17.905 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:49:17.905 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:49:17.905 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.905 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.905 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:17.905 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:49:17.905 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:49:17.905 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.906 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.906 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:17.906 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:49:17.906 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:49:17.906 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.906 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.906 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:17.906 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:49:17.906 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:49:17.906 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.906 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.906 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:17.906 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:49:17.906 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:49:17.907 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.907 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.907 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:17.907 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:49:17.907 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:49:17.907 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.907 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.907 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:17.907 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:49:17.907 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:49:17.907 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.907 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:17.908 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.908 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.908 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.908 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:17.908 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:17.908 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.674157429999994, 2024-09-12T22:49:17.908 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:49:17.908 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:17.908 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:17.908 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.908 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:17.908 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.908 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:17.909 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:17.909 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.909 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.909 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.909 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:17.909 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:17.909 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.909 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.909 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.909 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:17.909 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:49:17.909 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:49:17.910 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.910 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:17.910 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:49:17.910 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:49:17.910 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.910 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:17.910 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:49:17.910 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:49:17.910 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.910 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.910 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:49:17.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:49:17.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.911 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:17.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:49:17.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:49:17.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.911 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:17.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:49:17.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:49:17.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.911 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.912 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:17.912 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:49:17.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:49:17.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.912 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.912 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:17.912 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:49:17.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:49:17.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.912 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.912 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:17.912 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:49:17.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:49:17.913 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.913 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.913 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:17.913 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:49:17.913 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:49:17.913 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.913 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.913 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:17.913 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:49:17.913 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:49:17.913 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.913 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.914 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:17.914 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:49:17.914 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:49:17.914 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.914 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.914 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:17.914 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:49:17.914 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:49:17.914 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.914 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:17.914 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.914 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.914 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.915 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:17.915 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:17.915 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.674108477000004, 2024-09-12T22:49:17.915 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:49:17.915 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:17.915 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:17.915 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:17.915 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:17.915 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.915 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:17.915 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:17.915 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.915 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.916 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.916 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:17.916 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:17.916 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.916 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.916 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.916 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:17.916 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:17.916 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:49:17.916 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.916 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.916 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:17.916 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:49:17.916 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:49:17.917 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.917 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.917 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:17.917 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:49:17.917 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:49:17.917 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.917 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.917 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.917 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:49:17.917 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:49:17.917 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.917 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.917 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:17.918 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:49:17.918 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:49:17.918 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.918 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.918 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:17.918 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:49:17.918 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:49:17.918 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.918 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.918 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:17.918 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:49:17.918 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:49:17.918 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.919 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:17.919 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.919 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.919 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.919 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:17.919 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:17.919 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.674059377000006, 2024-09-12T22:49:17.919 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:49:17.919 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:17.919 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:17.919 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:17.919 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:17.919 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.920 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:17.920 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:17.920 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.920 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.920 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.920 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:17.920 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:17.920 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.920 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.920 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.920 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:17.920 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:49:17.920 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:49:17.921 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.921 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.921 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:17.921 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:49:17.921 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:49:17.921 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.921 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.921 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:17.921 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:49:17.921 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:49:17.921 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.921 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.921 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.921 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:49:17.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:49:17.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.922 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.922 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:17.922 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:49:17.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:49:17.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.922 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.922 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:17.922 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:49:17.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:49:17.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.922 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.923 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:17.923 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:49:17.923 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:49:17.923 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.923 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:17.923 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.923 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.923 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.923 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:17.923 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:17.923 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.667118927000004, 2024-09-12T22:49:17.923 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:49:17.923 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:17.923 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:17.924 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.924 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:17.924 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.924 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:17.924 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:17.924 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.924 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.924 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.924 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:17.924 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:17.924 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.924 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.925 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.925 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:17.925 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:49:17.925 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:49:17.925 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.925 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.925 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:17.925 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:49:17.925 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:49:17.925 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.925 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.925 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:17.925 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:49:17.926 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:49:17.926 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.926 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.926 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.926 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:49:17.926 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:49:17.926 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.926 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.926 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:17.926 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:49:17.926 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:49:17.926 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.926 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.927 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:17.927 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:49:17.927 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:49:17.927 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.927 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.927 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:17.927 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:49:17.927 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:49:17.927 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.927 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.927 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:17.927 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:49:17.927 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:49:17.928 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.928 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:17.928 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.928 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.928 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.928 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:17.928 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:17.928 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.666030086999996, 2024-09-12T22:49:17.928 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:49:17.928 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:17.928 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:17.928 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.928 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:17.929 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.929 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:17.929 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:17.929 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.929 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.929 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.929 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:17.929 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:17.929 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.929 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.929 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.929 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:17.929 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:49:17.930 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:49:17.930 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.930 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.930 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:17.930 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:49:17.930 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:49:17.930 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.930 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.930 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:17.930 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:49:17.930 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:49:17.930 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.930 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.930 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:49:17.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:49:17.931 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.931 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.931 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:17.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:49:17.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:49:17.931 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.931 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.931 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:17.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:49:17.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:49:17.931 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.932 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.932 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:17.932 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:49:17.932 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:49:17.932 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.932 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.932 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:17.932 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:49:17.932 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:49:17.932 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.932 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:17.932 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.933 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.933 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.933 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:17.933 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:17.933 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.665980476000001, 2024-09-12T22:49:17.933 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:49:17.933 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:17.933 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:17.933 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.933 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:17.933 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.933 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:17.933 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:17.934 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.934 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.934 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.934 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:17.934 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:17.934 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.934 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.934 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.934 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:17.934 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:17.934 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:49:17.934 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.934 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.935 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:17.935 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:17.935 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:49:17.935 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.935 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.935 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:17.935 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:49:17.935 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:49:17.935 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.935 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.935 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.935 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:49:17.935 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:49:17.936 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.936 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.936 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:17.936 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:49:17.936 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:49:17.936 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.936 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.936 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:17.936 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:49:17.936 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:49:17.936 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.936 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.937 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:17.937 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:49:17.937 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:49:17.937 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.937 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.937 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:17.937 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:49:17.937 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:49:17.937 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.937 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:17.937 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.937 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.937 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.938 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:17.938 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:17.938 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.665913166999999, 2024-09-12T22:49:17.938 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:49:17.938 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:17.938 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:17.938 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.938 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:17.938 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.938 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:17.938 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:17.938 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.938 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.939 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.939 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:17.939 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:17.939 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.939 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.939 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:17.939 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:17.939 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:49:17.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.939 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.939 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:17.939 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:49:17.939 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:49:17.940 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.940 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.940 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:17.940 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:49:17.940 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:49:17.940 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.940 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.940 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.940 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:49:17.940 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:49:17.940 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.940 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.940 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:17.941 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:49:17.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:49:17.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.941 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.941 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:17.941 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:49:17.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:49:17.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.941 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.941 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:17.941 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:49:17.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:49:17.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.941 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.942 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:17.942 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:49:17.942 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:49:17.942 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.942 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:17.942 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.942 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.942 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.942 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:17.942 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:17.942 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.665345247999994, 2024-09-12T22:49:17.942 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:49:17.943 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:17.943 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:17.943 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.943 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:17.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.943 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:17.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:17.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.943 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:17.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:17.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.944 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.944 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.944 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:17.944 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:17.944 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:49:17.944 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.944 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.944 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:17.944 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:49:17.944 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:49:17.944 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.944 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.944 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:17.945 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:49:17.945 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:49:17.945 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.945 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.945 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.945 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:49:17.945 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:49:17.945 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.945 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.945 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:17.945 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:49:17.945 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:49:17.945 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.946 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.946 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:17.946 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:49:17.946 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:49:17.946 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.946 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.946 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:17.946 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:49:17.946 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:49:17.946 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.946 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.946 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:17.946 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:49:17.947 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:49:17.947 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.947 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:17.947 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.947 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.947 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.947 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:49:17.947 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:17.947 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.664967644000001, 2024-09-12T22:49:17.947 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:49:17.947 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:17.947 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:17.947 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:17.948 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:17.948 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.948 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:17.948 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:17.948 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.948 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.948 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.948 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:17.948 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:17.948 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:17.948 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.948 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.948 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:17.949 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:49:17.949 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:49:17.949 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.949 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.949 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:17.949 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:49:17.949 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:49:17.949 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.949 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.949 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:17.949 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:49:17.949 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:49:17.949 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.950 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.950 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:17.950 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:49:17.950 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:49:17.950 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.950 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.950 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:17.950 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:49:17.950 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:49:17.950 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.950 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.950 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:17.951 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:49:17.951 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:49:17.951 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.951 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.951 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:17.951 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:49:17.951 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:49:17.951 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:17.951 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:17.951 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:17.951 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:49:17.951 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:49:17.951 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.952 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:17.952 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.952 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:17.952 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:17.952 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:17.953 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:17.952+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:17.954 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:18.055 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:18.054+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:18.061 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:18.062 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:18.062 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:49:18.062 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:18.070 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:18.156 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:18.155+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:18.172 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:18.172 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:18.172 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:49:18.172 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:49:18.172 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:18.181 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:18.265 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:18.264+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:18.326 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:18.326 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:49:18.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:49:18.326 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:49:18.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.326 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:49:18.326 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:18.326 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 78.277945115999998, 2024-09-12T22:49:18.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:49:18.326 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:18.327 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:18.327 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:18.327 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:18.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:18.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:18.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:18.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:18.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:18.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:18.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:49:18.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:18.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:49:18.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:49:18.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:18.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:49:18.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:49:18.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:49:18.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:49:18.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:18.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:49:18.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:49:18.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:18.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:49:18.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:49:18.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:18.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:49:18.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:49:18.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:18.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:49:18.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:49:18.331 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.331 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:18.331 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.331 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:49:18.331 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:18.331 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 76.277564389000005, 2024-09-12T22:49:18.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:49:18.331 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:18.331 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:18.331 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:18.332 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:18.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:18.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:18.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:18.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:18.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:18.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:49:18.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:49:18.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:18.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:49:18.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:49:18.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:18.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:49:18.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:49:18.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:49:18.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:49:18.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:18.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:49:18.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:49:18.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:18.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:49:18.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:49:18.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:18.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:49:18.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:49:18.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:18.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:49:18.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:49:18.335 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.336 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:18.336 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.336 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:49:18.336 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:18.336 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.156967578999996, 2024-09-12T22:49:18.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:49:18.336 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:18.336 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:18.336 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:49:18.336 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:18.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:18.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:18.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:18.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:18.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:18.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:18.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:49:18.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:18.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:49:18.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:49:18.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:18.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:49:18.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:49:18.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:49:18.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:49:18.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:18.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:49:18.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:49:18.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:18.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:49:18.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:49:18.339 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.340 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:18.340 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.340 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:18.340 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:18.340 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.154359399000001, 2024-09-12T22:49:18.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:49:18.340 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:18.340 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:18.340 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:18.340 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:18.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:18.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:18.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:18.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:18.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:18.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:49:18.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:49:18.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:18.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:49:18.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:49:18.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:18.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:49:18.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:49:18.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:49:18.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:49:18.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:18.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:49:18.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:49:18.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:18.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:49:18.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:49:18.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:18.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:49:18.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:49:18.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:18.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:49:18.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:49:18.345 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.345 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:18.345 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.345 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:18.345 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:18.345 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.153466175999995, 2024-09-12T22:49:18.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:49:18.345 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:18.346 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:18.346 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:18.346 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:18.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:18.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:18.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:18.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:18.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:18.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:49:18.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:49:18.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:18.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:49:18.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:49:18.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:18.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:49:18.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:49:18.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:49:18.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:49:18.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:18.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:49:18.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:49:18.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:18.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:49:18.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:49:18.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:18.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:49:18.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:49:18.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:18.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:49:18.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:49:18.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:18.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:49:18.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:49:18.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:18.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:49:18.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:49:18.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:18.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:49:18.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:49:18.351 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.351 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:18.351 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.351 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:18.351 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:18.352 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.153394517999999, 2024-09-12T22:49:18.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:49:18.352 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:18.352 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:18.352 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:18.352 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:18.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:18.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:18.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:18.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:18.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:18.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:49:18.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:49:18.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:18.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:49:18.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:49:18.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:18.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:49:18.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:49:18.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:49:18.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:49:18.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:18.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:49:18.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:49:18.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:18.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:49:18.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:49:18.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:18.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:49:18.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:49:18.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:18.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:49:18.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:49:18.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:18.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:49:18.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:49:18.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:18.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:49:18.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:49:18.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:18.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:49:18.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:49:18.357 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.357 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:18.357 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.357 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:18.357 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:18.357 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.153351799999996, 2024-09-12T22:49:18.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:49:18.358 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:18.358 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:18.358 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:18.358 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:18.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:18.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:18.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:18.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:18.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:18.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:49:18.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:49:18.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:18.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:49:18.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:49:18.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:18.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:49:18.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:49:18.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:49:18.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:49:18.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:18.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:49:18.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:49:18.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:18.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:49:18.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:49:18.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:18.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:49:18.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:49:18.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:18.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:49:18.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:49:18.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:18.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:49:18.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:49:18.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:18.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:49:18.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:49:18.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:18.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:49:18.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:49:18.363 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.363 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:18.363 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.363 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:18.363 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:18.363 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.153313882999996, 2024-09-12T22:49:18.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:49:18.363 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:18.364 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:18.364 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:18.364 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:18.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:18.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:18.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:18.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:18.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:18.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:49:18.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:49:18.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:18.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:49:18.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:49:18.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:18.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:49:18.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:49:18.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:49:18.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:49:18.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:18.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:49:18.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:49:18.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:18.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:49:18.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:49:18.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:18.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:18.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:49:18.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:18.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:49:18.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:49:18.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:18.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:49:18.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:49:18.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:18.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:49:18.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:49:18.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:18.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:49:18.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:49:18.369 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.369 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:18.369 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.369 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:18.369 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:18.369 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.153290432000006, 2024-09-12T22:49:18.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:49:18.369 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:18.369 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:18.369 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:18.370 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:18.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:18.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:18.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:18.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:18.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:18.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:49:18.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:49:18.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:18.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:49:18.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:49:18.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:18.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:49:18.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:49:18.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:49:18.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:49:18.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:18.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:49:18.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:49:18.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:18.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:49:18.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:49:18.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:18.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:18.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:49:18.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:18.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:49:18.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:49:18.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:18.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:49:18.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:49:18.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:18.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:49:18.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:49:18.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:18.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:49:18.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:49:18.375 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.375 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:18.375 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.375 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:18.375 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:18.375 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.153266195, 2024-09-12T22:49:18.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:49:18.375 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:18.375 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:18.376 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:18.376 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:18.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:18.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:18.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:18.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:18.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:18.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:18.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:49:18.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:18.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:49:18.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:49:18.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:18.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:49:18.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:49:18.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:49:18.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:49:18.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:18.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:49:18.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:49:18.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:18.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:49:18.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:49:18.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:18.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:49:18.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:49:18.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:18.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:49:18.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:49:18.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:18.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:49:18.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:49:18.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:18.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:49:18.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:49:18.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:18.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:49:18.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:49:18.381 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.381 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:18.381 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.381 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:18.381 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:18.381 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.153238278000003, 2024-09-12T22:49:18.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:49:18.381 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:18.381 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:18.381 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:18.381 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:18.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:18.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:18.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:18.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:18.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:18.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:18.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:49:18.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:18.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:49:18.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:49:18.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:18.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:49:18.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:49:18.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:49:18.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:49:18.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:18.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:49:18.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:49:18.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:18.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:49:18.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:49:18.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:18.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:49:18.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:49:18.385 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.385 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:18.385 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.385 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:18.385 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:18.386 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.153163782999997, 2024-09-12T22:49:18.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:49:18.386 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:18.386 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:18.386 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:18.386 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:18.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:18.386 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:18.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:18.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:18.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:18.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:49:18.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:49:18.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:18.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:49:18.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:49:18.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:18.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:49:18.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:49:18.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:49:18.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:49:18.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:18.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:49:18.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:49:18.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:18.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:49:18.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:49:18.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:18.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:49:18.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:49:18.390 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.390 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:18.390 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.390 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:18.390 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:18.390 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.153117754999997, 2024-09-12T22:49:18.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:49:18.390 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:18.390 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:18.391 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:18.391 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:18.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:18.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:18.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:18.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:18.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:18.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:49:18.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:49:18.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:18.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:49:18.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:49:18.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:18.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:49:18.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:49:18.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:49:18.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:49:18.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:18.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:49:18.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:49:18.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:18.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:49:18.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:49:18.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:18.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:49:18.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:49:18.394 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.394 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:18.394 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.395 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:18.395 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:18.395 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.150946871000002, 2024-09-12T22:49:18.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:49:18.395 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:18.395 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:18.395 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:18.395 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:18.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:18.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:18.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:18.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:18.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:18.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:18.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:49:18.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:18.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:49:18.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:49:18.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:18.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:49:18.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:49:18.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:18.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:49:18.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:18.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:49:18.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:49:18.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:18.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:18.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:49:18.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:18.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:49:18.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:49:18.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:18.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:49:18.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:49:18.399 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.399 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:18.399 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.399 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:18.399 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:18.399 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.150896420999999, 2024-09-12T22:49:18.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:49:18.400 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:18.400 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:18.400 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:18.400 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:18.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:18.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:18.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:18.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:18.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:18.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:49:18.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:49:18.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:18.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:49:18.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:49:18.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:18.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:49:18.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:49:18.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:49:18.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:49:18.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:18.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:49:18.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:49:18.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:18.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:49:18.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:49:18.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:18.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:49:18.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:49:18.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:18.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:49:18.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:49:18.404 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.404 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:18.404 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.404 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:18.404 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:18.404 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.150842983000004, 2024-09-12T22:49:18.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:49:18.405 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:18.405 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:18.405 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:18.405 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:18.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:18.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:18.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:18.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:18.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:18.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:18.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:49:18.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:18.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:49:18.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:49:18.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:18.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:18.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:49:18.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:49:18.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:49:18.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:18.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:49:18.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:49:18.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:18.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:49:18.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:49:18.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:18.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:49:18.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:49:18.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:18.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:49:18.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:49:18.411 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.411 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:18.411 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.411 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:49:18.411 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:18.411 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.146858629999997, 2024-09-12T22:49:18.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:49:18.412 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:18.412 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:18.412 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:18.412 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:18.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:18.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:18.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:18.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:18.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:18.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:49:18.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:49:18.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:18.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:49:18.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:49:18.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:18.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:49:18.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:49:18.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:49:18.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:49:18.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:18.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:49:18.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:49:18.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:18.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:49:18.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:49:18.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:18.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:49:18.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:49:18.417 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.417 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:18.417 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.417 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:49:18.418 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:18.418 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 71.161706090999999, 2024-09-12T22:49:18.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:49:18.419 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:18.419 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:18.419 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:18.419 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:18.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:18.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:18.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:18.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:18.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:18.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:49:18.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:49:18.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:18.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:49:18.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:49:18.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:18.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:49:18.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:49:18.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:49:18.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:49:18.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:18.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:49:18.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:49:18.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:18.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:49:18.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:49:18.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:18.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:49:18.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:49:18.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:18.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:49:18.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:49:18.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:18.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:49:18.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:49:18.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:18.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:49:18.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:49:18.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:18.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:49:18.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:49:18.427 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.427 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:18.427 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.427 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:49:18.427 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:18.427 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 53.159789846000002, 2024-09-12T22:49:18.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:49:18.427 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:18.428 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:18.428 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:18.428 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:18.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:18.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:18.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:18.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:18.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:18.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:49:18.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:49:18.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:18.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:49:18.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:49:18.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:18.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:49:18.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:49:18.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:49:18.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:49:18.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:18.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:49:18.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:49:18.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:18.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:49:18.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:49:18.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:18.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:49:18.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:49:18.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:18.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:49:18.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:49:18.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:18.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:49:18.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:49:18.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:18.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:49:18.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:49:18.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:18.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:49:18.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:49:18.433 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.433 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:18.433 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.433 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:49:18.434 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:18.434 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 48.159036471, 2024-09-12T22:49:18.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012160610000000001, 2024-09-12T22:49:18.434 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:18.434 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:18.434 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:18.434 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:18.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:18.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:18.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:18.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:18.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:18.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:18.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164967+0000", 2024-09-12T22:49:18.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:49:18.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:18.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164974+0000", 2024-09-12T22:49:18.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:49:18.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:18.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164987+0000", 2024-09-12T22:49:18.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3689000000000001e-05 2024-09-12T22:49:18.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164995+0000", 2024-09-12T22:49:18.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2959999999999999e-06 2024-09-12T22:49:18.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:18.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165068+0000", 2024-09-12T22:49:18.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2449999999999999e-05 2024-09-12T22:49:18.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:18.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165212+0000", 2024-09-12T22:49:18.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144117 2024-09-12T22:49:18.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:18.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166066+0000", 2024-09-12T22:49:18.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085441100000000002 2024-09-12T22:49:18.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:18.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166107+0000", 2024-09-12T22:49:18.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0450000000000001e-05 2024-09-12T22:49:18.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:18.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:18.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:18.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166181+0000", 2024-09-12T22:49:18.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-12T22:49:18.439 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.439 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:18.439 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.439 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:18.439 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:18.439 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:18.441 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:18.441 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:18.439+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:18.541 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:49:18.542 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:18.540+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:18.546 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:18.546 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:18.547 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:49:18.547 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:18.555 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:18.643 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:18.642+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:18.697 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:18.697 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:18.697 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:49:18.698 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:49:18.698 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:18.707 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:18.742 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~47s 2024-09-12T22:49:18.748 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:18.747+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:18.780 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:49:18.844 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:18.843+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:18.850 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:18.850 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:49:18.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:49:18.850 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:49:18.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.850 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:49:18.851 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:18.851 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 82.464539285000001, 2024-09-12T22:49:18.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:49:18.851 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:18.851 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:18.851 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:18.851 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:18.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:18.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:18.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:18.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:18.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:18.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:18.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:49:18.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:18.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:49:18.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:49:18.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:18.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:49:18.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:49:18.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:49:18.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:49:18.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:18.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:49:18.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:49:18.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:18.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:49:18.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:49:18.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:18.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:49:18.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:49:18.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:18.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:49:18.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:49:18.855 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.855 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:18.855 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.855 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:49:18.855 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:18.855 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 82.464096702000006, 2024-09-12T22:49:18.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:49:18.855 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:18.856 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:18.856 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:18.856 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:18.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:18.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:18.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:18.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:18.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:18.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:49:18.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:49:18.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:18.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:49:18.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:49:18.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:18.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:49:18.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:49:18.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:49:18.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:49:18.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:18.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:49:18.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:49:18.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:18.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:49:18.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:49:18.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:18.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:49:18.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:49:18.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:18.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:49:18.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:49:18.860 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.860 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:18.860 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.860 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:49:18.860 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:18.860 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 82.463730545000004, 2024-09-12T22:49:18.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:49:18.860 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:18.860 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:18.860 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:18.860 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:18.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:18.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:18.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:18.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:18.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:18.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:49:18.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:49:18.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:18.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:49:18.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:49:18.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:18.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:49:18.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:49:18.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:49:18.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:49:18.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:18.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:49:18.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:49:18.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:18.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:49:18.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:49:18.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:18.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:49:18.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:49:18.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:18.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:49:18.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:49:18.864 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.864 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:18.864 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.865 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:49:18.865 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:18.865 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 82.463318232999995, 2024-09-12T22:49:18.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:49:18.865 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:18.865 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:18.865 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:18.865 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:18.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:18.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:18.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:18.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:18.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:18.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:18.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:49:18.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:18.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:49:18.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:49:18.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:18.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:49:18.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:49:18.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:49:18.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:49:18.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:18.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:49:18.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:49:18.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:18.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:49:18.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:49:18.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:18.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:49:18.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:49:18.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:18.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:49:18.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:49:18.869 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.869 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:18.869 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.869 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:49:18.869 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:18.869 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 82.329468138999999, 2024-09-12T22:49:18.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:49:18.869 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:18.869 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:18.870 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:18.870 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:18.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:18.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:18.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:18.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:18.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:18.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:18.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:49:18.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:18.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:49:18.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:49:18.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:18.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:49:18.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:49:18.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:49:18.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:49:18.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:18.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:49:18.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:49:18.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:18.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:49:18.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:49:18.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:18.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:49:18.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:49:18.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:18.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:49:18.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:49:18.873 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.873 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:18.874 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.874 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.874 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.874 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:18.874 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:18.874 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 73.684232585000004, 2024-09-12T22:49:18.874 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:49:18.874 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:18.874 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:18.874 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:18.874 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:18.874 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.874 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:18.874 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:18.875 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.875 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.875 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:18.875 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:18.875 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.875 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.875 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:18.875 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:49:18.875 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:49:18.875 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.876 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:18.876 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:49:18.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:49:18.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.876 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:18.876 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:49:18.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:49:18.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.876 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.876 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:49:18.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:49:18.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.877 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:18.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:18.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:49:18.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.877 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:18.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:18.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:49:18.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.877 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:18.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:49:18.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:49:18.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.878 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:18.878 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:49:18.878 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:49:18.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.878 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:18.878 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:49:18.878 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:49:18.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.879 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:18.879 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:49:18.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:49:18.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.879 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.879 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:18.879 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:49:18.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:49:18.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.879 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.879 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:18.879 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:49:18.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:49:18.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.880 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:18.880 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:49:18.880 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:49:18.880 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.880 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:18.880 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.880 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.880 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:18.880 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:18.880 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 73.684133067999994, 2024-09-12T22:49:18.880 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:49:18.881 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:18.881 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:18.881 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:18.881 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:18.881 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.881 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:18.881 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:18.881 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.881 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.881 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.881 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:18.881 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:18.881 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.882 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:18.882 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:49:18.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:49:18.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.882 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:18.882 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:49:18.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:49:18.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.882 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:18.883 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:49:18.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:49:18.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.883 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.883 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:49:18.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:49:18.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.883 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:18.883 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:49:18.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:49:18.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:18.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:49:18.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:49:18.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:18.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:49:18.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:49:18.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:18.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:49:18.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:49:18.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:18.885 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:49:18.885 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:49:18.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:18.885 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:49:18.885 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:49:18.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:18.886 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:49:18.886 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:49:18.886 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.886 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.886 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:18.886 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:49:18.886 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:49:18.886 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.886 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.886 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:18.886 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:49:18.886 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:49:18.886 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.886 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:18.887 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.887 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.887 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.887 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:18.887 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:18.887 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 73.684088329000005, 2024-09-12T22:49:18.887 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:49:18.887 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:18.887 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:18.887 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:18.887 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:18.887 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.887 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:18.887 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:18.888 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.888 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.888 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.888 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:18.888 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:18.888 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.888 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.888 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.888 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:18.888 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:49:18.888 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:49:18.888 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.888 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.889 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:18.889 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:18.889 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:49:18.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.889 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.889 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:18.889 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:18.889 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:49:18.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.889 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.889 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.889 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:49:18.889 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:49:18.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.890 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:18.890 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:49:18.890 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:49:18.890 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.890 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:18.890 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:49:18.890 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:49:18.890 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.890 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:18.890 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:49:18.891 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:49:18.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.891 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.891 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:18.891 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:49:18.891 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:49:18.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.891 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.891 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:18.891 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:49:18.891 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:49:18.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.891 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.891 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:18.892 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:49:18.892 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:49:18.892 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.892 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.892 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:18.892 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:49:18.892 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:49:18.892 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.892 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.892 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:18.892 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:49:18.892 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:49:18.892 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.893 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:18.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:49:18.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:49:18.893 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.893 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:18.893 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.893 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:18.893 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:18.893 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 73.683860628000005, 2024-09-12T22:49:18.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:49:18.893 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:18.894 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:18.894 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:18.894 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:18.894 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.894 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:18.894 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:18.894 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.894 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.894 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.894 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:18.894 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:18.894 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.894 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.895 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.895 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:18.895 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:49:18.895 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:49:18.895 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.895 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.895 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:18.895 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:49:18.895 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:49:18.895 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.895 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.895 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:18.895 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:49:18.895 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:49:18.896 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.896 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.896 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.896 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:49:18.896 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:49:18.896 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.896 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.896 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:18.896 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:49:18.896 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:49:18.896 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.896 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.896 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:18.897 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:49:18.897 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:49:18.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.897 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:18.897 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:49:18.897 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:49:18.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.897 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:18.897 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:49:18.897 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:49:18.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.898 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.898 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:18.898 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:49:18.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:49:18.898 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.898 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.898 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:18.898 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:49:18.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:49:18.898 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.898 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.898 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:18.898 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:49:18.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:49:18.899 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.899 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:18.899 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:49:18.899 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:49:18.899 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.899 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:18.899 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:49:18.899 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:49:18.899 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.899 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:18.899 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.900 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.900 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.900 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:18.900 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:18.900 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 73.683695520000001, 2024-09-12T22:49:18.900 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:49:18.900 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:18.900 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:18.900 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:18.900 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:18.900 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.900 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:18.900 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:18.901 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.901 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.901 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.901 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:18.901 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:18.901 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.901 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.901 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.901 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:18.901 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:49:18.901 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:49:18.901 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.901 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.901 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:18.902 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:49:18.902 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:49:18.902 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.902 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.902 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:18.902 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:49:18.902 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:49:18.902 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.902 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.902 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.902 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:49:18.902 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:49:18.902 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.903 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.903 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:18.903 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:49:18.903 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:49:18.903 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.903 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.903 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:18.903 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:49:18.903 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:49:18.903 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.903 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.903 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:18.903 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:49:18.904 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:49:18.904 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.904 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.904 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:18.904 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:49:18.904 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:49:18.904 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.904 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.904 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:18.904 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:49:18.904 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:49:18.904 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.904 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.905 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:18.905 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:49:18.905 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:49:18.905 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.905 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.905 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:18.905 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:49:18.905 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:49:18.905 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.905 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.905 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:18.905 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:49:18.905 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:49:18.906 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.906 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.906 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:18.906 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:49:18.906 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:49:18.906 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.906 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:18.906 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.906 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.906 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.906 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:18.906 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:18.906 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 73.683634235, 2024-09-12T22:49:18.906 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:49:18.907 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:18.907 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:18.907 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:18.907 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:18.907 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.907 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:18.907 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:18.907 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.907 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.907 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.907 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:18.907 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:18.907 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.908 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.908 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.908 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:18.908 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:18.908 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:49:18.908 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.908 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.908 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:18.908 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:49:18.908 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:49:18.908 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.908 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.908 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:18.909 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:49:18.909 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:49:18.909 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.909 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.909 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.909 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:49:18.909 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:49:18.909 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.909 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.909 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:18.909 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:49:18.909 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:49:18.909 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.910 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:18.910 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:49:18.910 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:49:18.910 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.910 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:18.910 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:49:18.910 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:49:18.910 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.910 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:18.910 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:49:18.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:49:18.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.911 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:18.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:49:18.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:49:18.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.911 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:18.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:49:18.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:49:18.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.911 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:18.912 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:49:18.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:49:18.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.912 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.912 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:18.912 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:49:18.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:49:18.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.912 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.912 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:18.912 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:49:18.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:49:18.912 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.913 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:18.913 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.913 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.913 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.913 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:18.913 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:18.913 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 73.683554126999994, 2024-09-12T22:49:18.913 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:49:18.913 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:18.913 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:18.913 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:18.913 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:18.913 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.913 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:18.914 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:18.914 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.914 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.914 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.914 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:18.914 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:18.914 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.914 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.914 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.914 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:18.914 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:49:18.914 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:49:18.914 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.915 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.915 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:18.915 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:49:18.915 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:49:18.915 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.915 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.915 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:18.915 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:49:18.915 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:49:18.915 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.915 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.915 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.915 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:49:18.915 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:49:18.916 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.916 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.916 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:18.916 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:49:18.916 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:49:18.916 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.916 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.916 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:18.916 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:49:18.916 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:49:18.916 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.916 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.916 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:18.917 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:49:18.917 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:49:18.917 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.917 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.917 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:18.917 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:49:18.917 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:49:18.917 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.917 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.917 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:18.917 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:49:18.917 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:49:18.917 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.917 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.918 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:18.918 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:49:18.918 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:49:18.918 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.918 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.918 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:18.918 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:49:18.918 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:49:18.918 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.918 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.918 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:18.918 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:49:18.918 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:49:18.918 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.919 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.919 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:18.919 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:49:18.919 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:49:18.919 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.919 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:18.919 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.919 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.919 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.919 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:18.919 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:18.919 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 73.683505174000004, 2024-09-12T22:49:18.919 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:49:18.920 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:18.920 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:18.920 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:18.920 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:18.920 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.920 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:18.920 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:18.920 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.920 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.921 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.921 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:18.921 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:18.921 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.921 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.921 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.921 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:18.921 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:18.921 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:49:18.921 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.921 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.921 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:18.921 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:49:18.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:49:18.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.922 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.922 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:18.922 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:49:18.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:49:18.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.922 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.922 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.922 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:49:18.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:49:18.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.922 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.923 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:18.923 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:49:18.923 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:49:18.923 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.923 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.923 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:18.923 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:49:18.923 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:49:18.923 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.923 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.923 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:18.923 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:49:18.923 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:49:18.923 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.924 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:18.924 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.924 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.924 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.924 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:18.924 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:18.924 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 73.683456074000006, 2024-09-12T22:49:18.924 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:49:18.924 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:18.924 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:18.924 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:18.924 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:18.924 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.925 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:18.925 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:18.925 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.925 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.925 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.925 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:18.925 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:18.925 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.925 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.925 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.925 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:18.925 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:49:18.925 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:49:18.925 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.926 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.926 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:18.926 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:49:18.926 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:49:18.926 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.926 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.926 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:18.926 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:49:18.926 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:49:18.926 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.926 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.926 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.926 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:49:18.926 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:49:18.927 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.927 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.927 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:18.927 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:49:18.927 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:49:18.927 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.927 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.927 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:18.927 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:49:18.927 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:49:18.927 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.927 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.927 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:18.928 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:49:18.928 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:49:18.928 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.928 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:18.928 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.928 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.928 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.928 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:18.928 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:18.928 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 73.676515624000004, 2024-09-12T22:49:18.928 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:49:18.928 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:18.928 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:18.928 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:18.929 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:18.929 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.929 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:18.929 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:18.929 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.929 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.929 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.929 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:18.929 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:18.929 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.929 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.929 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.929 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:18.930 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:49:18.930 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:49:18.930 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.930 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.930 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:18.930 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:49:18.930 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:49:18.930 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.930 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.930 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:18.930 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:49:18.930 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:49:18.930 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.930 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.931 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:49:18.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:49:18.931 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.931 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.931 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:18.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:49:18.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:49:18.931 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.931 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.931 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:18.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:49:18.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:49:18.932 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.932 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.932 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:18.932 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:49:18.932 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:49:18.932 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.932 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.932 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:18.932 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:49:18.932 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:49:18.932 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.932 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:18.932 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.932 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.933 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.933 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:18.933 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:18.933 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 73.675426783999995, 2024-09-12T22:49:18.933 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:49:18.933 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:18.933 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:18.933 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:18.933 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:18.933 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.933 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:18.933 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:18.933 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.934 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.934 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.934 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:18.934 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:18.934 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.934 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.934 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.934 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:18.934 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:49:18.934 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:49:18.934 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.934 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.934 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:18.934 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:49:18.935 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:49:18.935 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.935 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.935 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:18.935 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:49:18.935 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:49:18.935 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.935 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.935 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.935 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:49:18.935 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:49:18.935 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.935 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.936 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:18.936 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:49:18.936 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:49:18.936 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.936 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.936 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:18.936 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:49:18.936 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:49:18.936 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.936 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.936 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:18.936 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:49:18.936 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:49:18.936 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.937 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.937 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:18.937 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:49:18.937 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:49:18.937 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.937 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:18.937 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.937 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.937 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.937 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:18.937 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:18.937 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 73.675377173000001, 2024-09-12T22:49:18.937 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:49:18.938 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:18.938 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:18.938 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:18.938 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:18.938 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.938 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:18.938 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:18.938 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.938 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.938 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.938 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:18.938 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:18.938 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.939 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.939 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:18.939 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:18.939 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:49:18.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.939 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.939 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:18.939 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:18.939 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:49:18.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.939 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.939 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:18.939 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:49:18.940 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:49:18.940 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.940 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.940 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.940 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:49:18.940 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:49:18.940 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.940 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.940 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:18.940 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:49:18.940 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:49:18.940 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.940 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.940 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:18.941 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:49:18.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:49:18.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.941 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.941 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:18.941 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:49:18.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:49:18.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.941 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.941 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:18.941 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:49:18.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:49:18.941 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.942 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:18.942 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.942 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.942 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.942 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:18.942 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:18.942 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 73.675309863999999, 2024-09-12T22:49:18.942 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:49:18.942 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:18.942 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:18.943 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:18.943 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:18.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.943 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:18.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:18.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.943 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:18.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:18.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.944 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:18.944 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:18.944 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:49:18.944 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.944 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.944 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:18.944 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:49:18.944 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:49:18.944 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.944 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.944 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:18.944 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:49:18.944 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:49:18.944 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.945 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.945 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.945 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:49:18.945 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:49:18.945 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.945 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.945 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:18.945 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:49:18.945 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:49:18.945 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.945 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.945 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:18.945 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:49:18.946 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:49:18.946 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.946 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.946 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:18.946 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:49:18.946 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:49:18.946 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.946 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.946 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:18.946 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:49:18.946 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:49:18.946 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.947 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:18.947 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.947 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.947 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.947 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:18.947 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:18.947 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 73.674741944999994, 2024-09-12T22:49:18.947 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:49:18.947 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:18.947 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:18.947 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:18.947 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:18.947 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.948 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:18.948 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:18.948 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.948 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.948 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.948 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:18.948 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:18.948 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.948 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.948 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.948 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:18.948 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:18.948 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:49:18.948 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.949 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.949 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:18.949 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:49:18.949 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:49:18.949 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.949 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.949 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:18.949 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:49:18.949 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:49:18.949 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.949 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.949 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.949 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:49:18.950 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:49:18.950 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.950 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.950 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:18.950 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:49:18.950 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:49:18.950 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.950 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.950 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:18.950 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:49:18.950 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:49:18.950 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.950 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.950 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:18.951 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:49:18.951 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:49:18.951 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.951 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.951 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:18.951 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:49:18.951 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:49:18.951 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.951 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:18.951 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.951 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.951 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.951 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:49:18.951 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:18.952 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 73.674364341, 2024-09-12T22:49:18.952 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:49:18.952 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:18.952 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:18.952 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:18.952 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:18.952 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.952 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:18.952 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:18.952 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.952 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.952 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.952 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:18.953 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:18.953 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:18.953 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.953 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.953 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:18.953 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:49:18.953 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:49:18.953 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.953 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.953 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:18.953 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:49:18.953 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:49:18.953 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.954 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.954 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:18.954 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:49:18.954 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:49:18.954 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.954 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.954 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:18.954 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:49:18.954 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:49:18.954 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.954 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.954 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:18.954 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:49:18.954 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:49:18.955 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.955 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.955 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:18.955 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:49:18.955 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:49:18.955 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.955 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.955 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:18.955 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:49:18.955 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:49:18.955 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:18.955 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:18.955 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:18.955 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:49:18.956 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:49:18.956 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.956 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:18.956 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.956 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:18.956 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:18.956 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:18.957 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:18.958 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:18.957+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:18.960 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:49:18.961 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:49:18.978 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:49:18.979 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:49:18.979 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:49:18.982 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:49:18.982 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:49:19.059 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:19.058+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:19.065 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:19.065 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:19.074 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:19.160 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:19.160+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:19.177 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:19.177 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:19.185 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:19.261 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:19.260+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:19.288 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:19.288 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:19.297 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:19.361 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:19.360+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:19.401 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:19.401 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:19.410 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:19.462 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:19.461+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:19.512 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:19.512 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:19.521 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:19.529 INFO:teuthology.orchestra.run.smithi066.stderr:nodeep-scrub is unset 2024-09-12T22:49:19.565 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:19.564+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:19.624 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:19.624 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:19.634 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:19.679 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:19.678+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:19.740 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:19.740 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:19.749 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:19.765 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:19.765+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:19.866 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:19.865+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:19.892 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:19.892 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:19.901 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:19.967 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:19.967+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:20.043 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:20.043 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:20.052 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:20.069 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:20.068+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:20.158 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:20.158 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:20.167 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:20.170 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:20.168+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:20.270 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:20.270 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:20.270 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:20.269+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:20.278 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:20.371 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:20.370+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:20.381 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:20.381 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:20.390 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:20.472 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:20.471+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:20.495 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:20.496 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:20.505 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:20.573 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:20.572+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:20.607 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:20.607 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:20.616 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:20.674 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:20.674+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:20.758 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:20.758 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:20.767 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:20.775 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:20.774+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:20.873 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:20.873 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:20.876 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:20.875+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:20.881 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:20.977 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:20.976+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:20.983 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:49:20.984 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:20.984 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:20.992 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:21.078 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:21.077+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:21.096 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:21.096 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:21.105 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:21.109 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:49:21.109 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:49:21.143 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:49:21.143 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:49:21.143 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:49:21.146 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:49:21.147 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:49:21.179 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:21.178+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:21.209 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:21.209 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:21.209 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:49:21.209 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:21.218 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:21.280 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:21.279+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:21.359 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:21.359 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:21.359 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:49:21.359 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:49:21.359 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:21.367 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:21.411 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:21.410+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:21.472 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:21.472 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:49:21.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:49:21.472 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:49:21.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.472 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:49:21.472 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:21.472 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 81.423906291999998, 2024-09-12T22:49:21.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:49:21.472 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:21.473 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:21.473 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:21.473 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:21.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:21.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:21.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:21.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:21.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:21.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:21.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:49:21.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:21.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:49:21.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:49:21.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:21.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:49:21.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:49:21.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:21.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:49:21.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:49:21.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:21.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:49:21.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:49:21.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:21.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:49:21.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:49:21.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:21.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:49:21.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:49:21.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:21.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:49:21.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:49:21.477 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.477 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:21.477 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.477 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:49:21.477 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:21.477 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 79.423525565000006, 2024-09-12T22:49:21.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:49:21.478 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:21.478 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:21.478 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:21.478 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:21.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:21.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:21.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:21.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:21.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:21.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:49:21.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:49:21.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:21.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:49:21.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:49:21.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:21.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:49:21.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:49:21.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:21.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:49:21.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:49:21.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:21.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:49:21.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:49:21.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:21.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:49:21.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:49:21.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:21.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:49:21.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:49:21.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:21.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:49:21.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:49:21.482 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.482 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:21.482 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.482 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:49:21.482 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:21.482 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 76.302928754999996, 2024-09-12T22:49:21.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:49:21.482 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:21.482 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:21.482 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:49:21.483 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:21.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:21.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:21.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:21.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:21.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:21.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:21.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:49:21.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:21.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:49:21.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:49:21.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:21.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:49:21.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:49:21.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:21.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:49:21.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:49:21.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:21.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:49:21.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:49:21.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:21.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:49:21.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:49:21.487 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.487 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:21.487 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.487 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:21.487 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:21.487 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 76.300320575000001, 2024-09-12T22:49:21.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:49:21.487 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:21.487 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:21.488 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:21.488 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:21.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:21.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:21.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:21.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:21.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:21.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:49:21.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:49:21.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:21.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:49:21.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:49:21.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:21.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:49:21.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:49:21.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:21.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:49:21.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:49:21.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:21.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:49:21.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:49:21.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:21.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:49:21.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:49:21.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:21.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:49:21.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:49:21.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:21.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:49:21.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:49:21.492 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.492 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:21.492 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.492 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:21.492 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:21.492 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 76.299427351999995, 2024-09-12T22:49:21.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:49:21.492 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:21.492 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:21.492 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:21.492 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:21.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:21.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:21.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:21.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:21.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:21.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:49:21.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:49:21.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:21.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:49:21.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:49:21.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:21.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:49:21.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:49:21.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:21.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:49:21.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:49:21.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:21.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:49:21.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:49:21.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:21.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:49:21.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:49:21.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:21.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:49:21.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:49:21.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:21.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:49:21.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:49:21.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:21.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:49:21.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:49:21.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:21.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:49:21.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:49:21.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:21.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:49:21.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:49:21.497 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.497 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:21.497 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.498 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:21.498 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:21.498 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 76.299355693999999, 2024-09-12T22:49:21.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:49:21.498 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:21.498 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:21.498 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:21.498 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:21.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:21.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:21.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:21.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:21.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:21.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:49:21.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:49:21.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:21.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:49:21.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:49:21.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:21.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:49:21.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:49:21.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:21.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:49:21.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:49:21.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:21.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:49:21.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:49:21.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:21.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:49:21.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:49:21.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:21.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:49:21.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:49:21.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:21.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:49:21.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:49:21.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:21.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:49:21.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:49:21.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:21.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:49:21.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:49:21.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:21.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:49:21.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:49:21.504 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.505 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:21.505 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.505 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:21.505 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:21.505 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 76.299312975999996, 2024-09-12T22:49:21.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:49:21.505 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:21.505 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:21.505 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:21.505 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:21.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:21.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:21.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:21.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:21.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:21.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:49:21.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:49:21.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:21.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:49:21.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:49:21.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:21.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:49:21.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:49:21.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:21.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:49:21.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:49:21.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:21.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:49:21.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:49:21.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:21.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:49:21.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:49:21.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:21.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:49:21.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:49:21.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:21.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:49:21.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:49:21.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:21.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:49:21.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:49:21.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:21.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:49:21.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:49:21.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:21.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:49:21.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:49:21.510 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.510 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:21.511 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.511 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:21.511 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:21.511 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 76.299275058999996, 2024-09-12T22:49:21.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:49:21.511 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:21.511 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:21.511 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:21.511 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:21.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:21.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:21.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:21.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:21.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:21.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:49:21.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:49:21.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:21.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:49:21.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:49:21.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:21.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:49:21.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:49:21.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:21.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:49:21.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:49:21.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:21.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:49:21.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:49:21.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:21.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:49:21.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:49:21.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:21.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:21.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:49:21.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:21.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:49:21.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:49:21.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:21.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:49:21.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:49:21.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:21.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:49:21.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:49:21.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:21.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:49:21.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:49:21.516 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.516 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:21.516 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.517 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:21.517 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:21.517 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 76.299251608000006, 2024-09-12T22:49:21.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:49:21.517 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:21.517 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:21.517 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:21.517 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:21.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:21.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:21.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:21.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:21.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:21.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:49:21.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:49:21.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:21.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:49:21.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:49:21.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:21.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:49:21.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:49:21.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:21.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:49:21.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:49:21.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:21.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:49:21.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:49:21.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:21.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:49:21.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:49:21.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:21.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:21.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:49:21.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:21.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:49:21.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:49:21.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:21.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:49:21.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:49:21.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:21.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:49:21.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:49:21.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:21.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:49:21.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:49:21.522 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.522 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:21.522 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.523 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:21.523 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:21.523 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 76.299227371000001, 2024-09-12T22:49:21.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:49:21.523 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:21.523 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:21.523 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:21.523 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:21.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:21.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:21.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:21.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:21.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:21.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:21.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:49:21.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:21.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:49:21.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:49:21.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:21.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:49:21.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:49:21.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:21.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:49:21.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:49:21.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:21.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:49:21.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:49:21.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:21.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:49:21.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:49:21.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:21.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:49:21.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:49:21.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:21.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:49:21.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:49:21.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:21.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:49:21.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:49:21.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:21.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:49:21.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:49:21.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:21.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:49:21.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:49:21.528 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.528 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:21.528 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.529 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:21.529 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:21.529 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 76.299199454000004, 2024-09-12T22:49:21.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:49:21.529 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:21.529 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:21.529 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:21.529 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:21.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:21.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:21.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:21.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:21.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:21.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:21.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:49:21.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:21.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:49:21.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:49:21.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:21.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:49:21.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:49:21.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:21.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:49:21.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:49:21.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:21.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:49:21.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:49:21.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:21.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:49:21.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:49:21.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:21.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:49:21.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:49:21.533 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.533 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:21.534 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.534 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:21.534 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:21.534 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 76.299124958999997, 2024-09-12T22:49:21.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:49:21.534 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:21.534 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:21.534 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:21.534 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:21.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:21.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:21.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:21.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:21.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:21.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:49:21.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:49:21.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:21.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:49:21.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:49:21.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:21.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:49:21.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:49:21.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:21.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:49:21.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:49:21.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:21.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:49:21.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:49:21.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:21.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:49:21.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:49:21.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:21.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:49:21.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:49:21.538 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.538 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:21.538 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.538 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:21.538 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:21.538 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 76.299078930999997, 2024-09-12T22:49:21.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:49:21.539 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:21.539 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:21.539 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:21.539 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:21.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:21.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:21.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:21.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:21.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:21.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:49:21.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:49:21.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:21.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:49:21.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:49:21.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:21.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:49:21.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:49:21.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:21.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:49:21.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:49:21.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:21.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:49:21.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:49:21.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:21.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:49:21.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:49:21.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:21.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:49:21.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:49:21.542 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.543 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:21.543 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.543 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:21.543 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:21.543 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 76.296908047000002, 2024-09-12T22:49:21.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:49:21.543 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:21.543 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:21.543 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:21.543 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:21.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:21.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:21.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:21.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:21.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:21.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:21.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:49:21.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:21.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:49:21.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:49:21.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:21.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:49:21.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:49:21.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:21.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:21.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:49:21.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:21.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:49:21.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:49:21.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:21.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:21.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:49:21.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:21.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:49:21.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:49:21.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:21.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:49:21.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:49:21.547 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.547 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:21.547 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.547 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:21.547 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:21.547 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 76.296857596999999, 2024-09-12T22:49:21.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:49:21.548 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:21.548 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:21.548 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:21.548 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:21.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:21.548 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:21.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:21.548 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:21.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:21.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:49:21.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:49:21.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:21.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:49:21.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:49:21.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:21.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:49:21.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:49:21.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:21.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:49:21.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:49:21.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:21.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:49:21.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:49:21.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:21.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:49:21.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:49:21.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:21.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:49:21.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:49:21.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:21.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:49:21.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:49:21.551 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.551 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:21.552 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.552 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:21.552 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:21.552 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 76.296804159000004, 2024-09-12T22:49:21.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:49:21.552 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:21.552 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:21.552 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:21.552 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:21.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.552 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:21.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:21.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:21.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:21.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:21.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:21.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:49:21.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:21.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:49:21.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:49:21.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:21.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:21.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:49:21.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:21.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:49:21.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:49:21.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:21.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:49:21.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:49:21.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:21.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:49:21.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:49:21.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:21.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:49:21.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:49:21.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:21.556 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:49:21.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:49:21.556 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.556 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:21.556 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.556 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:49:21.556 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:21.556 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 76.292819805999997, 2024-09-12T22:49:21.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:49:21.557 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:21.557 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:21.557 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:21.557 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:21.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.557 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:21.557 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:21.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.557 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:21.557 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:21.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.558 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:21.558 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:49:21.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:49:21.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.558 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:21.558 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:49:21.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:49:21.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.558 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:21.558 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:49:21.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:49:21.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:21.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:49:21.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:49:21.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:21.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:49:21.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:49:21.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:21.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:49:21.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:49:21.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:21.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:49:21.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:49:21.560 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.560 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:21.560 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.561 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:49:21.561 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:21.561 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 74.307667266999999, 2024-09-12T22:49:21.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:49:21.561 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:21.561 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:21.561 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:21.561 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:21.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:21.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:21.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:21.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:21.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:21.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:49:21.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:49:21.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:21.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:49:21.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:49:21.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:21.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:49:21.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:49:21.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:21.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:49:21.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:49:21.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:21.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:49:21.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:49:21.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:21.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:49:21.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:49:21.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:21.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:49:21.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:49:21.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:21.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:49:21.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:49:21.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:21.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:49:21.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:49:21.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:21.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:49:21.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:49:21.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:21.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:49:21.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:49:21.566 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.566 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:21.566 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.566 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:49:21.566 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:21.566 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 56.305751022000003, 2024-09-12T22:49:21.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:49:21.566 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:21.566 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:21.567 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:21.567 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:21.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:21.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:21.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:21.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:21.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:21.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:49:21.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:49:21.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:21.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:49:21.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:49:21.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:21.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:49:21.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:49:21.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:21.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:49:21.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:49:21.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:21.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:49:21.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:49:21.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:21.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:49:21.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:49:21.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.570 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:21.570 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:49:21.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:49:21.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.570 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:21.570 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:49:21.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:49:21.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.570 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:21.570 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:49:21.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:49:21.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:21.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:49:21.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:49:21.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:21.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:49:21.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:49:21.571 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.571 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:21.571 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.572 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:49:21.572 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:21.572 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.304997647, 2024-09-12T22:49:21.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012160610000000001, 2024-09-12T22:49:21.572 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:21.572 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:21.572 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:21.572 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:21.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:21.572 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:21.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:21.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:21.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:21.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:21.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164967+0000", 2024-09-12T22:49:21.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:49:21.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:21.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164974+0000", 2024-09-12T22:49:21.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:49:21.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:21.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164987+0000", 2024-09-12T22:49:21.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3689000000000001e-05 2024-09-12T22:49:21.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:21.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164995+0000", 2024-09-12T22:49:21.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2959999999999999e-06 2024-09-12T22:49:21.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:21.575 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165068+0000", 2024-09-12T22:49:21.575 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2449999999999999e-05 2024-09-12T22:49:21.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.575 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:21.575 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165212+0000", 2024-09-12T22:49:21.575 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144117 2024-09-12T22:49:21.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.575 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:21.575 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166066+0000", 2024-09-12T22:49:21.575 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085441100000000002 2024-09-12T22:49:21.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.576 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:21.576 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166107+0000", 2024-09-12T22:49:21.576 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0450000000000001e-05 2024-09-12T22:49:21.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:21.576 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:21.576 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:21.576 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166181+0000", 2024-09-12T22:49:21.576 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-12T22:49:21.576 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.576 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:21.576 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.576 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:21.576 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:21.576 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:21.577 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:49:21.579 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:21.577+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:21.579 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:21.679 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:21.678+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:21.686 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:21.687 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:21.687 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:49:21.687 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:21.695 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:21.780 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:21.779+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:21.797 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:21.798 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:21.798 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:49:21.798 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:49:21.798 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:21.806 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:21.882 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:21.881+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:21.913 INFO:tasks.workunit.client.0.smithi066.stderr:Updating files: 90% (11656/12903) Updating files: 91% (11742/12903) Updating files: 92% (11871/12903) Updating files: 93% (12000/12903) Updating files: 94% (12129/12903) Updating files: 95% (12258/12903) Updating files: 96% (12387/12903) Updating files: 97% (12516/12903) Updating files: 98% (12645/12903) Updating files: 99% (12774/12903) Updating files: 100% (12903/12903) Updating files: 100% (12903/12903), done. 2024-09-12T22:49:21.950 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:21.950 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:49:21.950 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:49:21.950 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:49:21.950 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.950 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:49:21.950 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:21.951 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 85.564424471999999, 2024-09-12T22:49:21.951 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:49:21.951 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:21.951 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:21.951 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:21.951 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:21.951 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.951 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:21.951 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:21.951 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:21.951 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.951 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.951 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:21.952 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:21.952 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:21.952 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.952 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.952 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:21.952 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:21.952 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:49:21.952 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.952 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.952 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:21.952 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:49:21.952 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:49:21.952 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.953 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.953 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:21.953 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:49:21.953 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:49:21.953 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.953 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.953 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:21.953 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:49:21.953 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:49:21.953 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.953 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.953 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:21.953 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:49:21.953 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:49:21.954 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.954 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.954 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:21.954 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:49:21.954 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:49:21.954 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.954 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.954 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:21.954 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:49:21.954 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:49:21.954 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.954 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.954 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:21.954 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:49:21.955 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:49:21.955 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:21.955 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:21.955 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:21.955 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.955 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.955 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:49:21.955 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:21.955 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 85.563981889000004, 2024-09-12T22:49:21.955 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:49:21.955 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:21.955 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:21.955 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:21.956 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:21.956 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.956 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:21.956 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:21.956 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:21.956 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.956 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.956 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:21.956 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:21.956 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:21.956 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.956 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.956 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:21.956 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:49:21.957 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:49:21.957 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.957 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.957 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:21.957 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:49:21.957 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:49:21.957 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.957 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.957 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:21.957 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:49:21.957 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:49:21.957 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.957 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.958 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:21.958 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:49:21.958 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:49:21.958 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.958 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.958 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:21.958 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:49:21.958 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:49:21.958 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.958 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.958 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:21.958 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:49:21.958 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:49:21.958 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.959 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.959 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:21.959 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:49:21.959 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:49:21.959 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.959 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.959 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:21.959 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:49:21.959 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:49:21.959 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:21.959 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:21.959 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:21.959 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.959 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.960 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:49:21.960 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:21.960 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 85.563615732000002, 2024-09-12T22:49:21.960 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:49:21.960 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:21.960 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:21.960 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:21.960 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:21.960 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.960 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:21.960 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:21.960 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:21.960 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.960 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.961 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:21.961 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:21.961 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:21.961 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.961 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.961 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:21.961 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:49:21.961 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:49:21.961 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.961 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.961 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:21.961 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:49:21.961 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:49:21.962 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.962 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.962 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:21.962 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:49:21.962 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:49:21.962 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.962 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.962 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:21.962 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:49:21.962 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:49:21.962 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.962 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.962 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:21.962 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:49:21.963 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:49:21.963 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.963 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.963 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:21.963 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:49:21.963 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:49:21.963 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.963 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.963 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:21.963 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:49:21.963 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:49:21.963 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.963 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.963 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:21.964 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:49:21.964 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:49:21.964 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:21.964 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:21.964 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:21.964 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.964 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.964 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:49:21.964 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:21.964 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 85.563203419999994, 2024-09-12T22:49:21.964 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:49:21.964 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:21.964 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:21.965 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:21.965 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:21.965 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.965 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:21.965 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:21.965 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:21.965 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.965 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.965 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:21.965 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:21.965 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:21.965 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.965 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.965 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:21.966 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:21.966 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:49:21.966 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.966 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.966 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:21.966 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:49:21.966 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:49:21.966 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.966 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.966 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:21.966 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:49:21.966 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:49:21.966 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.967 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.967 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:21.967 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:49:21.967 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:49:21.967 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.967 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.967 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:21.967 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:49:21.967 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:49:21.967 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.967 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.967 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:21.967 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:49:21.967 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:49:21.968 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.968 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.968 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:21.968 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:49:21.968 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:49:21.968 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.968 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.968 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:21.968 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:49:21.968 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:49:21.968 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:21.968 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:21.968 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:21.969 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.969 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.969 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:49:21.969 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:21.969 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 85.429353325999998, 2024-09-12T22:49:21.969 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:49:21.969 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:21.969 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:21.969 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:21.969 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:21.969 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.970 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:21.970 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:21.970 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:21.970 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.970 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.970 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:21.970 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:21.970 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:21.970 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.970 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.970 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:21.970 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:21.970 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:49:21.970 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.971 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.971 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:21.971 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:49:21.971 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:49:21.971 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.971 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.971 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:21.971 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:49:21.971 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:49:21.971 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.971 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.971 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:21.971 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:49:21.971 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:49:21.972 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.972 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.972 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:21.972 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:49:21.972 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:49:21.972 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.972 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.972 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:21.972 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:49:21.972 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:49:21.972 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.972 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.972 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:21.973 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:49:21.973 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:49:21.973 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.973 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.973 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:21.973 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:49:21.973 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:49:21.973 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:21.973 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:21.973 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:21.973 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.973 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.973 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:21.973 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:21.974 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.784117772000002, 2024-09-12T22:49:21.974 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:49:21.974 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:21.974 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:21.974 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:21.974 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:21.974 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.974 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:21.974 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:21.974 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:21.974 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.974 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.974 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:21.974 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:21.975 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:21.975 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.975 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.975 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:21.975 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:49:21.975 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:49:21.975 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.975 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.975 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:21.975 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:49:21.975 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:49:21.975 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.975 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.975 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:21.976 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:49:21.976 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:49:21.976 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.976 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.976 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:21.976 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:49:21.976 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:49:21.976 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.976 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.976 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:21.976 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:21.976 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:49:21.976 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.976 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.977 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:21.977 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:21.977 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:49:21.977 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.977 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.977 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:21.977 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:49:21.977 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:49:21.977 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.977 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.977 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:21.977 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:49:21.977 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:49:21.977 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.978 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.978 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:21.978 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:49:21.978 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:49:21.978 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.978 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.978 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:21.978 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:49:21.978 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:49:21.978 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.978 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.978 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:21.978 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:49:21.978 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:49:21.979 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.979 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.979 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:21.979 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:49:21.979 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:49:21.979 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.979 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.979 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:21.979 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:49:21.979 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:49:21.979 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:21.979 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:21.979 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:21.980 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.980 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.980 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:21.980 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:21.980 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.784018255000007, 2024-09-12T22:49:21.980 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:49:21.980 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:21.980 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:21.980 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:21.980 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:21.980 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.980 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:21.980 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:21.980 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:21.981 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.981 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.981 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:21.981 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:21.981 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:21.981 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.981 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.981 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:21.981 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:49:21.981 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:49:21.981 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.982 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.982 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:21.982 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:49:21.982 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:49:21.982 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.982 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.982 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:21.982 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:49:21.982 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:49:21.982 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.982 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.982 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:21.983 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:49:21.983 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:49:21.983 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.983 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.983 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:21.983 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:49:21.983 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:49:21.983 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.983 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.983 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:21.983 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:49:21.983 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:49:21.983 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.983 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.984 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:21.984 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:49:21.984 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:49:21.984 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.984 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.984 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:21.984 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:49:21.984 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:49:21.984 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.984 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.984 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:21.984 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:49:21.984 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:49:21.985 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.985 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.985 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:21.985 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:49:21.985 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:49:21.985 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.985 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.985 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:21.985 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:49:21.985 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:49:21.985 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.985 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.985 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:21.985 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:49:21.986 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:49:21.986 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.986 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.986 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:21.986 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:49:21.986 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:49:21.986 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:21.986 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:21.986 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:21.986 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.986 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.986 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:21.986 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:21.986 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.783973516000003, 2024-09-12T22:49:21.987 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:49:21.987 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:21.987 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:21.987 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:21.987 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:21.987 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.987 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:21.987 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:21.987 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:21.987 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.987 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.987 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:21.987 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:21.988 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:21.988 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.988 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.988 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:21.988 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:49:21.988 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:49:21.988 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.988 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.988 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:21.988 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:21.988 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:49:21.988 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.988 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.988 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:21.989 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:21.989 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:49:21.989 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.989 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.989 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:21.989 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:49:21.989 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:49:21.989 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.989 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.989 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:21.989 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:49:21.989 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:49:21.989 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.989 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.990 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:21.990 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:49:21.990 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:49:21.990 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.990 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.990 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:21.990 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:49:21.990 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:49:21.990 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.990 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.990 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:21.990 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:49:21.990 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:49:21.990 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.991 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.991 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:21.991 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:49:21.991 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:49:21.991 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.991 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.991 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:21.991 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:49:21.991 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:49:21.991 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.991 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.991 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:21.991 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:49:21.991 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:49:21.992 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.992 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.992 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:21.992 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:49:21.992 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:49:21.992 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.992 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.992 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:21.992 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:49:21.992 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:49:21.992 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:21.992 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:21.992 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:21.993 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.993 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:21.993 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:21.993 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.783745815000003, 2024-09-12T22:49:21.993 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:49:21.993 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:21.993 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:21.993 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:21.993 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:21.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.993 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:21.993 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:21.993 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:21.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.994 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.994 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:21.994 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:21.994 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:21.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.994 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.994 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:21.994 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:49:21.994 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:49:21.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.994 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.994 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:21.995 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:49:21.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:49:21.995 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.995 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.995 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:21.995 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:49:21.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:49:21.995 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.995 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.995 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:21.995 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:49:21.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:49:21.995 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.995 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.996 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:21.996 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:49:21.996 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:49:21.996 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.996 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.996 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:21.996 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:49:21.996 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:49:21.996 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.996 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.996 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:21.996 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:49:21.996 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:49:21.996 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:21.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:49:21.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:49:21.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:21.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:49:21.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:49:21.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:21.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:49:21.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:49:21.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.998 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.998 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:21.998 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:49:21.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:49:21.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.998 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.998 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:21.998 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:49:21.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:49:21.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.998 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.998 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:21.999 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:49:21.999 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:49:21.999 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:21.999 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:21.999 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:21.999 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:21.999 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:21.999 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:21.999 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:22.000 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.783580706999999, 2024-09-12T22:49:22.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:49:22.000 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:22.000 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:22.000 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:22.000 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:22.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:22.000 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:22.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.000 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:22.001 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:22.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.001 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:22.001 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:49:22.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:49:22.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.001 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:22.001 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:49:22.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:49:22.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:22.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:49:22.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:49:22.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.002 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:49:22.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:49:22.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.002 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:22.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:49:22.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:49:22.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.003 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.003 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:22.003 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:49:22.003 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:49:22.003 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.003 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.003 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:22.003 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:49:22.003 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:49:22.003 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.003 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.003 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:22.003 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:49:22.003 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:49:22.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.004 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:22.004 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:49:22.004 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:49:22.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.004 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:22.004 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:49:22.004 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:49:22.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.004 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:22.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:49:22.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:49:22.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.005 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:22.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:49:22.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:49:22.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.005 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:22.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:49:22.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:49:22.005 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.005 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:22.006 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.006 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.006 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:22.006 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:22.006 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.783519421999998, 2024-09-12T22:49:22.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:49:22.006 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:22.006 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:22.006 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:22.006 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:22.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.006 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:22.006 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:22.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.007 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:22.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:22.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.007 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:22.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:22.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:49:22.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.008 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:22.008 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:49:22.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:49:22.008 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.008 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:22.008 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:49:22.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:49:22.008 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.008 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.008 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:49:22.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:49:22.008 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.009 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:22.009 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:49:22.009 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:49:22.009 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.009 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:22.009 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:49:22.009 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:49:22.009 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.009 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:22.009 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:49:22.009 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:49:22.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.010 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:22.010 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:49:22.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:49:22.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.010 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:22.010 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:49:22.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:49:22.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.010 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:22.011 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:49:22.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:49:22.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.011 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:22.011 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:49:22.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:49:22.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.011 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:22.011 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:49:22.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:49:22.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.012 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:22.012 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:49:22.012 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:49:22.012 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.012 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:22.012 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.012 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.012 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.012 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:22.012 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:22.012 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.783439314000006, 2024-09-12T22:49:22.012 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:49:22.012 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:22.012 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:22.013 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:22.013 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:22.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.013 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:22.013 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:22.013 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.013 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:22.013 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:22.013 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:22.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:49:22.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:49:22.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:22.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:49:22.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:49:22.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:22.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:49:22.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:49:22.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:49:22.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:49:22.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:22.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:49:22.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:49:22.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:22.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:49:22.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:49:22.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:22.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:49:22.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:49:22.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:22.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:49:22.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:49:22.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:22.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:49:22.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:49:22.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:22.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:49:22.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:49:22.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:22.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:49:22.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:49:22.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.018 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:22.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:49:22.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:49:22.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.018 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:22.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:49:22.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:49:22.018 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.018 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:22.018 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.018 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:22.019 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:22.019 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.783390361000002, 2024-09-12T22:49:22.019 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:49:22.019 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:22.019 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:22.019 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:22.019 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:22.019 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.019 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:22.019 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:22.019 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.019 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.019 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.019 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:22.020 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:22.020 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.020 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:22.020 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:22.020 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:49:22.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.020 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:22.020 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:49:22.020 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:49:22.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.021 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:22.021 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:49:22.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:49:22.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.021 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.021 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.021 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:49:22.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:49:22.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.021 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.021 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:22.021 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:49:22.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:49:22.022 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:22.022 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:49:22.022 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:49:22.022 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:22.022 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:49:22.022 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:49:22.022 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.022 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:22.022 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.022 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.023 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:22.023 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:22.023 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.783341261000004, 2024-09-12T22:49:22.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:49:22.023 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:22.023 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:22.023 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:22.023 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:22.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.023 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:22.023 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:22.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.024 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:22.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:22.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.024 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:22.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:49:22.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:49:22.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.024 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:22.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:49:22.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:49:22.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.025 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.025 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:22.025 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:49:22.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:49:22.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.025 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.025 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.025 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:49:22.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:49:22.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.025 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.025 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:22.026 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:49:22.026 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:49:22.026 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.026 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:22.026 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:49:22.026 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:49:22.026 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.026 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:22.026 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:49:22.026 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:49:22.026 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.027 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:22.027 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.027 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.027 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.027 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:22.027 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:22.027 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.776400811000002, 2024-09-12T22:49:22.027 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:49:22.027 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:22.027 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:22.027 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:22.027 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:22.027 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.027 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:22.028 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:22.028 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.028 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.028 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:22.028 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:22.028 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.028 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.028 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:22.028 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:49:22.028 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:49:22.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.028 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.029 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:22.029 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:49:22.029 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:49:22.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.029 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:22.029 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:49:22.029 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:49:22.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.029 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.029 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:49:22.029 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:49:22.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.030 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.030 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:22.030 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:49:22.030 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:49:22.030 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.030 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.030 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:22.030 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:49:22.030 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:49:22.030 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.030 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.030 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:22.030 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:49:22.030 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:49:22.031 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.031 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.031 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:22.031 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:49:22.031 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:49:22.031 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.031 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:22.031 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.031 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.031 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.031 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:22.031 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:22.031 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.775311970999994, 2024-09-12T22:49:22.031 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:49:22.032 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:22.032 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:22.032 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:22.032 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:22.032 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.032 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:22.032 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:22.032 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.032 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.032 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.032 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:22.032 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:22.032 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.033 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:22.033 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:49:22.033 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:49:22.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.033 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:22.033 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:49:22.033 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:49:22.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.033 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:22.033 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:49:22.034 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:49:22.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.034 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.034 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.034 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:49:22.034 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:49:22.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.034 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.034 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:22.034 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:49:22.034 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:49:22.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.034 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.034 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:22.035 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:49:22.035 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:49:22.035 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.035 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.035 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:22.035 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:49:22.035 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:49:22.035 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.035 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.035 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:22.035 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:49:22.035 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:49:22.035 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.036 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:22.036 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.036 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.036 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.036 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:22.036 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:22.036 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.775262359999999, 2024-09-12T22:49:22.036 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:49:22.036 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:22.036 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:22.037 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:22.037 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:22.037 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.037 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:22.037 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:22.037 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.037 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.037 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.037 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:22.037 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:22.037 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.037 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.037 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.038 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:22.038 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:22.038 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:49:22.038 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.038 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.038 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:22.038 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:22.038 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:49:22.038 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.038 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.038 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:22.038 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:49:22.038 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:49:22.038 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.039 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.039 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.039 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:49:22.039 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:49:22.039 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.039 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.039 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:22.039 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:49:22.039 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:49:22.039 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.039 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.039 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:22.039 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:49:22.039 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:49:22.040 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.040 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.040 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:22.040 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:49:22.040 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:49:22.040 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.040 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.040 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:22.040 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:49:22.040 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:49:22.040 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.040 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:22.040 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.041 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.041 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.041 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:22.041 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:22.041 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.775195050999997, 2024-09-12T22:49:22.041 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:49:22.041 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:22.041 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:22.041 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:22.041 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:22.041 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.041 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:22.041 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:22.041 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.042 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.042 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.042 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:22.042 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:22.042 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.042 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.042 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.042 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:22.042 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:22.042 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:49:22.042 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.042 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.042 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:22.042 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:49:22.043 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:49:22.043 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.043 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.043 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:22.043 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:49:22.043 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:49:22.043 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.043 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.043 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.043 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:49:22.043 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:49:22.043 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.043 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.043 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:22.044 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:49:22.044 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:49:22.044 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.044 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.044 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:22.044 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:49:22.044 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:49:22.044 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.044 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.044 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:22.044 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:49:22.044 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:49:22.044 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.045 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.045 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:22.045 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:49:22.045 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:49:22.045 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.045 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:22.045 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.045 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.045 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.045 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:22.045 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:22.045 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.774627132000006, 2024-09-12T22:49:22.045 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:49:22.045 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:22.046 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:22.046 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:22.046 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:22.046 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.046 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:22.046 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:22.046 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.046 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.046 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.046 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:22.046 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:22.046 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.046 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.046 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.047 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:22.047 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:22.047 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:49:22.047 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.047 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.047 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:22.047 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:49:22.047 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:49:22.047 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.047 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.047 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:22.047 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:49:22.047 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:49:22.047 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.048 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.048 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.048 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:49:22.048 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:49:22.048 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.048 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.048 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:22.048 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:49:22.048 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:49:22.048 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.048 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.048 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:22.048 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:49:22.048 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:49:22.049 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.049 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.049 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:22.049 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:49:22.049 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:49:22.049 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.049 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.049 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:22.049 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:49:22.049 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:49:22.049 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.049 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:22.049 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.049 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.050 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.050 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:49:22.050 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:22.050 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.774249527999999, 2024-09-12T22:49:22.050 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:49:22.050 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:22.050 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:22.050 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:22.050 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:22.050 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.050 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:22.050 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:22.050 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.050 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.051 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.051 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:22.051 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:22.051 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.051 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.051 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.051 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:22.051 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:49:22.051 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:49:22.051 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.051 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.051 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:22.051 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:49:22.051 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:49:22.052 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.052 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.052 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:22.052 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:49:22.052 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:49:22.052 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.052 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.052 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.052 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:49:22.052 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:49:22.052 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.052 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.052 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:22.052 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:49:22.053 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:49:22.053 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.053 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.053 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:22.053 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:49:22.053 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:49:22.053 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.053 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.053 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:22.053 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:49:22.053 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:49:22.053 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.053 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.053 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:22.054 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:49:22.054 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:49:22.054 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.054 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:22.054 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.054 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.054 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:22.054 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:22.055 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:22.056 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:22.054+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:22.157 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:22.156+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:22.166 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:22.166 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:22.167 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:49:22.167 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:22.176 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:22.258 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:22.257+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:22.318 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:22.318 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:22.318 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:49:22.319 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:49:22.319 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:22.328 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:22.359 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:22.358+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:22.432 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:22.432 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:49:22.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:49:22.432 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:49:22.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.432 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:49:22.432 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:22.433 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 82.384091302000002, 2024-09-12T22:49:22.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:49:22.433 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:22.433 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:22.433 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:22.433 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:22.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:22.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:22.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:22.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:22.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:22.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:22.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:49:22.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:22.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:49:22.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:49:22.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:22.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:49:22.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:49:22.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:49:22.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:49:22.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:22.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:49:22.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:49:22.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:22.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:49:22.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:49:22.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:22.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:49:22.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:49:22.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:22.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:49:22.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:49:22.437 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.437 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:22.437 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.438 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:49:22.438 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:22.438 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 80.383710574999995, 2024-09-12T22:49:22.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:49:22.438 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:22.438 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:22.438 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:22.438 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:22.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:22.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:22.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:22.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:22.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:22.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:49:22.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:49:22.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:22.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:49:22.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:49:22.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:22.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:49:22.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:49:22.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:49:22.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:49:22.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:22.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:49:22.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:49:22.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:22.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:49:22.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:49:22.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:22.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:49:22.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:49:22.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:22.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:49:22.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:49:22.442 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.442 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:22.442 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.442 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:49:22.442 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:22.442 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.263113765, 2024-09-12T22:49:22.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:49:22.443 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:22.443 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:22.443 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:49:22.443 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:22.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:22.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:22.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:22.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:22.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:22.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:22.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:49:22.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:22.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:49:22.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:49:22.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:22.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:49:22.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:49:22.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:49:22.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:49:22.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:22.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:49:22.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:49:22.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:22.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:49:22.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:49:22.446 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.446 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:22.446 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.446 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:22.446 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:22.447 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.260505585000004, 2024-09-12T22:49:22.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:49:22.447 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:22.447 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:22.447 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:22.447 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:22.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:22.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:22.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:22.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:22.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:22.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:49:22.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:49:22.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:22.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:49:22.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:49:22.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:22.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:49:22.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:49:22.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:49:22.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:49:22.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:22.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:49:22.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:49:22.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:22.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:49:22.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:49:22.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:22.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:49:22.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:49:22.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:22.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:49:22.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:49:22.451 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.451 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:22.451 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.451 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:22.451 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:22.451 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.259612361999999, 2024-09-12T22:49:22.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:49:22.451 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:22.451 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:22.452 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:22.452 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:22.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:22.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:22.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:22.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:22.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:22.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:49:22.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:49:22.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:22.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:49:22.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:49:22.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:22.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:49:22.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:49:22.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:49:22.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:49:22.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:22.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:49:22.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:49:22.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:22.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:49:22.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:49:22.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:22.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:49:22.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:49:22.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:22.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:49:22.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:49:22.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:22.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:49:22.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:49:22.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:22.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:49:22.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:49:22.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:22.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:49:22.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:49:22.457 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.457 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:22.457 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.457 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:22.457 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:22.457 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.259540704000003, 2024-09-12T22:49:22.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:49:22.458 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:22.458 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:22.458 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:22.458 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:22.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:22.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:22.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:22.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:22.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:22.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:49:22.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:49:22.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:22.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:49:22.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:49:22.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:22.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:49:22.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:49:22.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:49:22.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:49:22.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:22.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:49:22.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:49:22.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:22.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:49:22.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:49:22.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:22.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:49:22.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:49:22.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:22.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:49:22.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:49:22.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:22.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:49:22.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:49:22.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:22.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:49:22.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:49:22.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:22.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:49:22.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:49:22.463 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.464 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:22.464 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.464 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:22.464 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:22.464 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.259497986, 2024-09-12T22:49:22.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:49:22.464 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:22.464 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:22.464 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:22.464 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:22.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:22.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:22.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:22.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:22.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:22.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:49:22.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:49:22.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:22.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:49:22.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:49:22.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:22.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:49:22.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:49:22.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:49:22.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:49:22.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:22.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:49:22.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:49:22.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:22.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:49:22.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:49:22.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:22.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:49:22.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:49:22.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:22.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:49:22.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:49:22.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:22.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:49:22.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:49:22.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:22.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:49:22.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:49:22.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:22.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:49:22.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:49:22.470 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.470 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:22.470 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.470 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:22.470 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:22.470 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.259460068999999, 2024-09-12T22:49:22.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:49:22.470 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:22.470 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:22.470 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:22.471 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:22.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:22.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:22.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:22.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:22.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:22.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:49:22.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:49:22.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:22.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:49:22.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:49:22.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:22.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:49:22.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:49:22.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:49:22.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:49:22.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:22.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:49:22.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:49:22.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:22.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:49:22.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:49:22.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:22.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:22.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:49:22.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:22.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:49:22.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:49:22.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:22.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:49:22.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:49:22.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:22.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:49:22.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:49:22.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:22.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:49:22.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:49:22.476 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.476 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:22.476 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.477 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:22.477 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:22.477 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.259436617999995, 2024-09-12T22:49:22.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:49:22.477 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:22.477 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:22.477 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:22.477 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:22.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:22.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:22.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:22.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:22.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:22.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:49:22.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:49:22.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:22.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:49:22.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:49:22.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:22.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:49:22.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:49:22.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:49:22.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:49:22.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:22.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:49:22.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:49:22.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:22.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:49:22.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:49:22.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:22.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:22.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:49:22.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:22.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:49:22.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:49:22.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:22.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:49:22.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:49:22.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:22.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:49:22.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:49:22.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:22.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:49:22.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:49:22.482 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.482 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:22.482 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.483 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:22.483 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:22.483 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.259412381000004, 2024-09-12T22:49:22.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:49:22.483 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:22.483 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:22.483 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:22.483 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:22.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:22.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:22.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:22.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:22.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:22.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:22.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:49:22.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:22.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:49:22.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:49:22.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:22.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:49:22.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:49:22.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:49:22.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:49:22.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:22.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:49:22.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:49:22.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:22.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:49:22.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:49:22.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:22.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:49:22.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:49:22.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:22.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:49:22.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:49:22.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:22.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:49:22.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:49:22.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:22.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:49:22.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:49:22.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:22.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:49:22.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:49:22.488 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.488 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:22.489 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.489 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:22.489 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:22.489 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.259384463999993, 2024-09-12T22:49:22.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:49:22.489 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:22.489 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:22.489 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:22.489 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:22.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:22.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:22.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:22.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:22.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:22.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:22.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:49:22.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:22.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:49:22.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:49:22.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:22.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:49:22.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:49:22.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:49:22.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:49:22.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:22.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:49:22.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:49:22.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:22.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:49:22.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:49:22.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:22.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:49:22.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:49:22.493 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.493 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:22.493 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.494 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:22.494 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:22.494 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.259309969, 2024-09-12T22:49:22.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:49:22.494 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:22.494 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:22.494 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:22.494 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:22.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:22.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:22.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:22.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:22.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:22.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:49:22.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:49:22.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:22.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:49:22.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:49:22.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:22.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:49:22.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:49:22.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:49:22.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:49:22.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:22.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:49:22.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:49:22.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:22.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:49:22.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:49:22.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:22.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:49:22.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:49:22.498 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.498 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:22.498 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.498 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:22.499 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:22.499 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.259263941, 2024-09-12T22:49:22.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:49:22.499 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:22.499 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:22.499 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:22.499 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:22.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:22.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:22.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:22.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:22.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:22.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:49:22.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:49:22.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:22.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:49:22.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:49:22.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:22.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:49:22.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:49:22.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:49:22.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:49:22.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:22.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:49:22.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:49:22.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:22.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:49:22.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:49:22.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:22.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:49:22.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:49:22.503 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.503 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:22.503 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.504 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:22.504 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:22.504 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.257093057000006, 2024-09-12T22:49:22.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:49:22.504 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:22.504 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:22.504 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:22.504 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:22.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:22.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:22.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:22.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:22.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:22.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:22.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:49:22.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:22.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:49:22.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:49:22.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:22.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:49:22.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:49:22.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:22.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:49:22.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:22.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:49:22.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:49:22.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:22.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:22.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:49:22.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:22.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:49:22.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:49:22.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:22.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:49:22.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:49:22.509 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.509 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:22.509 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.509 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:22.509 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:22.510 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.257042607000002, 2024-09-12T22:49:22.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:49:22.510 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:22.510 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:22.510 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:22.510 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:22.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:22.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:22.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:22.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:22.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:22.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:49:22.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:49:22.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:22.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:49:22.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:49:22.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:22.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:49:22.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:49:22.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:49:22.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:49:22.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:22.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:49:22.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:49:22.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:22.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:49:22.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:49:22.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:22.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:49:22.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:49:22.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:22.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:49:22.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:49:22.515 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.515 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:22.515 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.515 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:22.515 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:22.515 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.256989168999993, 2024-09-12T22:49:22.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:49:22.515 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:22.515 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:22.515 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:22.516 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:22.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:22.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:22.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:22.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:22.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:22.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:22.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:49:22.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:22.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:49:22.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:49:22.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:22.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:22.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:49:22.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:49:22.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:49:22.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:22.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:49:22.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:49:22.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:22.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:49:22.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:49:22.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:22.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:49:22.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:49:22.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:22.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:49:22.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:49:22.520 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.520 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:22.520 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.520 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:49:22.520 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:22.520 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.253004816000001, 2024-09-12T22:49:22.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:49:22.520 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:22.521 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:22.521 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:22.521 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:22.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:22.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:22.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:22.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:22.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:22.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:49:22.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:49:22.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:22.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:49:22.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:49:22.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:22.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:49:22.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:49:22.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:49:22.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:49:22.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:22.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:49:22.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:49:22.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:22.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:49:22.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:49:22.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:22.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:49:22.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:49:22.524 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.524 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:22.524 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.525 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:49:22.525 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:22.525 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 75.267852277000003, 2024-09-12T22:49:22.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:49:22.525 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:22.525 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:22.525 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:22.525 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:22.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:22.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:22.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:22.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:22.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:22.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:49:22.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:49:22.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:22.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:49:22.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:49:22.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:22.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:49:22.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:49:22.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:49:22.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:49:22.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:22.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:49:22.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:49:22.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:22.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:49:22.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:49:22.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:22.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:49:22.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:49:22.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:22.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:49:22.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:49:22.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:22.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:49:22.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:49:22.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:22.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:49:22.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:49:22.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:22.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:49:22.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:49:22.531 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.531 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:22.531 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.531 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:49:22.531 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:22.531 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 57.265936031999999, 2024-09-12T22:49:22.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:49:22.531 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:22.531 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:22.532 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:22.532 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:22.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:22.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:22.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:22.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:22.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:22.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:49:22.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:49:22.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:22.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:49:22.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:49:22.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:22.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:49:22.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:49:22.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:49:22.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:49:22.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:22.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:49:22.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:49:22.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:22.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:49:22.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:49:22.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:22.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:49:22.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:49:22.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:22.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:49:22.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:49:22.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:22.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:49:22.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:49:22.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:22.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:49:22.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:49:22.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:22.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:49:22.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:49:22.540 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.540 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:22.540 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.541 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:49:22.541 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:22.541 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 52.265182656999997, 2024-09-12T22:49:22.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012160610000000001, 2024-09-12T22:49:22.541 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:22.541 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:22.541 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:22.541 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:22.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:22.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:22.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:22.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:22.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:22.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:22.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164967+0000", 2024-09-12T22:49:22.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:49:22.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:22.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164974+0000", 2024-09-12T22:49:22.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:49:22.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:22.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164987+0000", 2024-09-12T22:49:22.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3689000000000001e-05 2024-09-12T22:49:22.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164995+0000", 2024-09-12T22:49:22.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2959999999999999e-06 2024-09-12T22:49:22.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:22.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165068+0000", 2024-09-12T22:49:22.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2449999999999999e-05 2024-09-12T22:49:22.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:22.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165212+0000", 2024-09-12T22:49:22.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144117 2024-09-12T22:49:22.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:22.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166066+0000", 2024-09-12T22:49:22.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085441100000000002 2024-09-12T22:49:22.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:22.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166107+0000", 2024-09-12T22:49:22.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0450000000000001e-05 2024-09-12T22:49:22.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:22.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:22.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:22.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166181+0000", 2024-09-12T22:49:22.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-12T22:49:22.546 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.546 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:22.546 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.547 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:22.548 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:22.548 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:22.549 INFO:teuthology.orchestra.run.smithi066.stderr:noscrub is set 2024-09-12T22:49:22.550 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:22.551 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:22.548+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:22.650 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:22.649+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:22.654 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:22.654 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:22.654 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:49:22.654 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:22.663 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:22.751 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:22.750+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:22.805 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:22.805 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:22.805 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:49:22.805 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:49:22.805 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:22.815 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:22.839 INFO:tasks.workunit.client.0.smithi066.stderr:Note: switching to '7741f7f9ee20524f89b8f61d1609b32fb3b1570a'. 2024-09-12T22:49:22.839 INFO:tasks.workunit.client.0.smithi066.stderr: 2024-09-12T22:49:22.839 INFO:tasks.workunit.client.0.smithi066.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T22:49:22.839 INFO:tasks.workunit.client.0.smithi066.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T22:49:22.839 INFO:tasks.workunit.client.0.smithi066.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T22:49:22.839 INFO:tasks.workunit.client.0.smithi066.stderr: 2024-09-12T22:49:22.840 INFO:tasks.workunit.client.0.smithi066.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T22:49:22.840 INFO:tasks.workunit.client.0.smithi066.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T22:49:22.840 INFO:tasks.workunit.client.0.smithi066.stderr: 2024-09-12T22:49:22.840 INFO:tasks.workunit.client.0.smithi066.stderr: git switch -c 2024-09-12T22:49:22.840 INFO:tasks.workunit.client.0.smithi066.stderr: 2024-09-12T22:49:22.840 INFO:tasks.workunit.client.0.smithi066.stderr:Or undo this operation with: 2024-09-12T22:49:22.840 INFO:tasks.workunit.client.0.smithi066.stderr: 2024-09-12T22:49:22.840 INFO:tasks.workunit.client.0.smithi066.stderr: git switch - 2024-09-12T22:49:22.840 INFO:tasks.workunit.client.0.smithi066.stderr: 2024-09-12T22:49:22.840 INFO:tasks.workunit.client.0.smithi066.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T22:49:22.840 INFO:tasks.workunit.client.0.smithi066.stderr: 2024-09-12T22:49:22.840 INFO:tasks.workunit.client.0.smithi066.stderr:HEAD is now at 7741f7f9ee2 Merge pull request #59718 from afreen23/wip-67994-squid 2024-09-12T22:49:22.845 DEBUG:teuthology.orchestra.run.smithi066:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T22:49:22.859 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:22.858+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:22.870 INFO:tasks.workunit.client.0.smithi066.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T22:49:22.872 INFO:tasks.workunit.client.0.smithi066.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T22:49:22.872 INFO:tasks.workunit.client.0.smithi066.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T22:49:22.918 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:22.918 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:49:22.918 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:49:22.918 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:49:22.918 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.918 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:49:22.918 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:22.919 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 86.531783118999996, 2024-09-12T22:49:22.919 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:49:22.919 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:22.919 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:22.919 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:22.919 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:22.919 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.919 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:22.919 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:22.919 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.919 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.919 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.920 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:22.920 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:22.920 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.920 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.920 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.920 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:22.920 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:22.920 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:49:22.920 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.920 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.920 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:22.921 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:49:22.921 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:49:22.921 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.921 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.921 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:22.921 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:49:22.921 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:49:22.921 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.921 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.921 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.921 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:49:22.921 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:49:22.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.922 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.922 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:22.922 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:49:22.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:49:22.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.922 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.922 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:22.922 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:49:22.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:49:22.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.922 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.923 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:22.923 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:49:22.923 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:49:22.923 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.923 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.923 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:22.923 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:49:22.923 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:49:22.923 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.923 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:22.923 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.923 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.924 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.924 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:49:22.924 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:22.924 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 86.531340536000002, 2024-09-12T22:49:22.924 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:49:22.924 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:22.924 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:22.924 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:22.924 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:22.924 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.925 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:22.925 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:22.925 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.925 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.925 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.925 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:22.925 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:22.925 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.925 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.925 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.925 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:22.925 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:49:22.926 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:49:22.926 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.926 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.926 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:22.926 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:49:22.926 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:49:22.926 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.926 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.926 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:22.926 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:49:22.926 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:49:22.927 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.927 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.927 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.927 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:49:22.927 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:49:22.927 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.927 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.927 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:22.927 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:49:22.927 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:49:22.927 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.927 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.927 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:22.928 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:49:22.928 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:49:22.928 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.928 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.928 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:22.928 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:49:22.928 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:49:22.928 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.928 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.928 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:22.928 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:49:22.928 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:49:22.929 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.929 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:22.929 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.929 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.929 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.929 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:49:22.929 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:22.929 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 86.530974379, 2024-09-12T22:49:22.929 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:49:22.929 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:22.929 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:22.929 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:22.929 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:22.930 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.930 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:22.930 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:22.930 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.930 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.930 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.930 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:22.930 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:22.930 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.930 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.930 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.930 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:22.930 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:49:22.930 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:49:22.931 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.931 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.931 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:22.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:49:22.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:49:22.931 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.931 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.931 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:22.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:49:22.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:49:22.931 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.931 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.931 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:49:22.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:49:22.932 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.932 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.932 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:22.932 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:49:22.932 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:49:22.932 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.932 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.932 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:22.932 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:49:22.932 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:49:22.932 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.932 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.932 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:22.932 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:49:22.932 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:49:22.933 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.933 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.933 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:22.933 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:49:22.933 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:49:22.933 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.933 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:22.933 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.933 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.933 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.933 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:49:22.933 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:22.933 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 86.530562067000005, 2024-09-12T22:49:22.934 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:49:22.934 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:22.934 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:22.934 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:22.934 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:22.934 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.934 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:22.934 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:22.934 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.934 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.934 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.935 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:22.935 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:22.935 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.935 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.935 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.935 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:22.935 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:22.935 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:49:22.935 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.935 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.935 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:22.936 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:49:22.936 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:49:22.936 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.936 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.936 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:22.936 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:49:22.936 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:49:22.936 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.936 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.937 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.937 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:49:22.937 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:49:22.937 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.937 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.937 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:22.937 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:49:22.937 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:49:22.937 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.937 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.937 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:22.937 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:49:22.937 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:49:22.938 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.938 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.938 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:22.938 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:49:22.938 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:49:22.938 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.938 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.938 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:22.938 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:49:22.938 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:49:22.938 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.938 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:22.939 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.939 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.939 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:49:22.939 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:22.939 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 86.396711972999995, 2024-09-12T22:49:22.939 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:49:22.939 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:22.939 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:22.940 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:22.940 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:22.940 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.940 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:22.940 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:22.940 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.940 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.940 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.940 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:22.941 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:22.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.941 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.941 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:22.941 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:22.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:49:22.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.941 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.942 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:22.942 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:49:22.942 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:49:22.942 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.942 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.942 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:22.942 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:49:22.942 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:49:22.942 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.942 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.942 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:49:22.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:49:22.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.943 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:22.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:49:22.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:49:22.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.943 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:22.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:49:22.944 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:49:22.944 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.944 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.944 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:22.944 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:49:22.944 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:49:22.944 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.944 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.944 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:22.944 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:49:22.945 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:49:22.945 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.945 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:22.945 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.945 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.945 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.945 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:22.945 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:22.945 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 77.751476418999999, 2024-09-12T22:49:22.945 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:49:22.946 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:22.946 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:22.946 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:22.946 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:22.946 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.946 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:22.946 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:22.946 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.946 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.946 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.946 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:22.947 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:22.947 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.947 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.947 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.947 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:22.947 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:49:22.947 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:49:22.947 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.947 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.947 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:22.947 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:49:22.947 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:49:22.948 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.948 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.948 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:22.948 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:49:22.948 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:49:22.948 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.948 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.948 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.948 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:49:22.948 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:49:22.948 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.948 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.949 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:22.949 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:22.949 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:49:22.949 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.949 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.949 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:22.949 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:22.949 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:49:22.949 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.949 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.949 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:22.949 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:49:22.949 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:49:22.949 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.950 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.950 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:22.950 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:49:22.950 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:49:22.950 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.950 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.950 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:22.950 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:49:22.950 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:49:22.950 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.950 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.950 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:22.950 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:49:22.950 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:49:22.951 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.951 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.951 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:22.951 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:49:22.951 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:49:22.951 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.951 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.951 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:22.951 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:49:22.951 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:49:22.951 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.951 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.951 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:22.952 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:49:22.952 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:49:22.952 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.952 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:22.952 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.952 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.952 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.952 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:22.952 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:22.952 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 77.751376902000004, 2024-09-12T22:49:22.952 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:49:22.952 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:22.953 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:22.953 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:22.953 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:22.953 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.953 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:22.953 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:22.953 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.953 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.953 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.953 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:22.953 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:22.953 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.954 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.954 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.954 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:22.954 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:49:22.954 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:49:22.954 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.954 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.954 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:22.954 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:49:22.954 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:49:22.955 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.955 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.955 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:22.955 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:49:22.955 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:49:22.955 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.955 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.955 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.955 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:49:22.955 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:49:22.955 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.955 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.956 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:22.956 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:49:22.956 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:49:22.956 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.956 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.956 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:22.956 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:49:22.956 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:49:22.956 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.956 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.956 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:22.956 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:49:22.956 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:49:22.956 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.957 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.957 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:22.957 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:49:22.957 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:49:22.957 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.957 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.957 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:22.957 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:49:22.957 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:49:22.957 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.958 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.958 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:22.958 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:49:22.958 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:49:22.958 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.958 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.958 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:22.958 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:49:22.958 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:49:22.958 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.958 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.958 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:22.959 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:49:22.959 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:49:22.959 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.959 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.959 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:22.959 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:49:22.959 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:49:22.959 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.959 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:22.959 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.959 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.959 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.959 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:22.960 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:22.960 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 77.751332163000001, 2024-09-12T22:49:22.960 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:49:22.960 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:22.960 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:22.960 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:22.960 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:22.960 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.960 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:22.960 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:22.960 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.960 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.960 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.961 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:22.961 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:22.961 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.961 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.961 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.961 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:22.961 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:49:22.961 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:49:22.961 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.961 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.961 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:22.961 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:22.962 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:49:22.962 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.962 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.962 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:22.962 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:22.962 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:49:22.962 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.962 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.962 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.962 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:49:22.962 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:49:22.962 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.963 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.963 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:22.963 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:49:22.963 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:49:22.963 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.963 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.963 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:22.963 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:49:22.963 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:49:22.963 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.963 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.963 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:22.964 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:49:22.964 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:49:22.964 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.964 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.964 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:22.964 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:49:22.964 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:49:22.964 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.964 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.964 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:22.964 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:49:22.964 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:49:22.965 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.965 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.965 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:22.965 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:49:22.965 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:49:22.965 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.965 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.965 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:22.965 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:49:22.965 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:49:22.965 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.965 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.966 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:22.966 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:49:22.966 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:49:22.966 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.966 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.966 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:22.966 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:49:22.966 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:49:22.966 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.966 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:22.966 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.966 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.966 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.967 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:22.967 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:22.967 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 77.751104462000001, 2024-09-12T22:49:22.967 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:49:22.967 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:22.967 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:22.967 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:22.967 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:22.967 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.967 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:22.968 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:22.968 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.968 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.968 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.968 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:22.968 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:22.968 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.968 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.968 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.968 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:22.968 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:49:22.968 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:49:22.968 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.969 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.969 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:22.969 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:49:22.969 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:49:22.969 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.969 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.969 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:22.969 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:49:22.969 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:49:22.969 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.969 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.969 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.969 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:49:22.969 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:49:22.970 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.970 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.970 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:22.970 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:49:22.970 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:49:22.970 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.970 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.970 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:22.970 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:49:22.970 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:49:22.970 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.970 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.970 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:22.970 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:49:22.971 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:49:22.971 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.971 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.971 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:22.971 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:49:22.971 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:49:22.971 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.971 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.971 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:22.971 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:49:22.971 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:49:22.971 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.971 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.972 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:22.972 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:49:22.972 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:49:22.972 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.972 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.972 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:22.972 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:49:22.972 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:49:22.972 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.972 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.972 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:22.972 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:49:22.972 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:49:22.973 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.973 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.973 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:22.973 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:49:22.973 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:49:22.973 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.973 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:22.973 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.973 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.973 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.973 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:22.973 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:22.973 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 77.750939353999996, 2024-09-12T22:49:22.974 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:49:22.974 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:22.974 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:22.974 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:22.974 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:22.974 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.974 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:22.974 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:22.974 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.974 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.974 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.974 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:22.974 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:22.974 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.974 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.975 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.975 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:22.975 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:49:22.975 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:49:22.975 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.975 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.975 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:22.975 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:49:22.975 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:49:22.975 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.975 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.975 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:22.975 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:49:22.976 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:49:22.976 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.976 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.976 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.976 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:49:22.976 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:49:22.976 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.976 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.976 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:22.976 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:49:22.976 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:49:22.976 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.976 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.976 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:22.977 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:49:22.977 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:49:22.977 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.977 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.977 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:22.977 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:49:22.977 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:49:22.977 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.977 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.977 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:22.977 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:49:22.977 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:49:22.977 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.978 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.978 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:22.978 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:49:22.978 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:49:22.978 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.978 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.978 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:22.978 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:49:22.978 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:49:22.978 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.978 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.978 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:22.978 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:49:22.979 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:49:22.979 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.979 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.979 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:22.979 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:49:22.979 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:49:22.979 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.979 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.979 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:22.979 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:49:22.979 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:49:22.979 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.979 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:22.979 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.980 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.980 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.980 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:22.980 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:22.980 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 77.750878068999995, 2024-09-12T22:49:22.980 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:49:22.980 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:22.980 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:22.980 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:22.980 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:22.980 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.980 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:22.980 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:22.981 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.981 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.981 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.981 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:22.981 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:22.981 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.981 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.981 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.981 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:22.981 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:22.981 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:49:22.981 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.982 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.982 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:22.982 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:49:22.982 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:49:22.982 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.982 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.982 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:22.982 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:49:22.982 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:49:22.982 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.982 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.982 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.982 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:49:22.983 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:49:22.983 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.983 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.983 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:22.983 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:49:22.983 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:49:22.983 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.983 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.983 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:22.983 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:49:22.983 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:49:22.983 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.984 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.984 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:22.984 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:49:22.984 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:49:22.984 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.984 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.984 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:22.984 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:49:22.984 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:49:22.984 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.985 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.985 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:22.985 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:49:22.985 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:49:22.985 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.985 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.985 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:22.985 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:49:22.985 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:49:22.985 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.985 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.986 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:22.986 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:49:22.986 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:49:22.986 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.986 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.986 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:22.986 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:49:22.986 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:49:22.986 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.986 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.986 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:22.987 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:49:22.987 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:49:22.987 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.987 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:22.987 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.987 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.987 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.987 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:22.987 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:22.987 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 77.750797961000004, 2024-09-12T22:49:22.987 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:49:22.987 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:22.988 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:22.988 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:22.988 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:22.988 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.988 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:22.988 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:22.988 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.988 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.988 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.988 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:22.988 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:22.988 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.989 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.989 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.989 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:22.989 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:49:22.989 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:49:22.989 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.989 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.989 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:22.989 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:49:22.989 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:49:22.989 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.989 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.990 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:22.990 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:49:22.990 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:49:22.990 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.990 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.990 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.990 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:49:22.990 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:49:22.990 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.990 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.991 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:22.991 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:49:22.991 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:49:22.991 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.991 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.991 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:22.991 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:49:22.991 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:49:22.991 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.991 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.991 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:22.991 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:49:22.991 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:49:22.991 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.992 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.992 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:22.992 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:49:22.992 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:49:22.992 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.992 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.992 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:22.992 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:49:22.992 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:49:22.992 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.993 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:22.993 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:49:22.993 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:49:22.993 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.993 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:22.993 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:49:22.993 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:49:22.993 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.993 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:22.993 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:49:22.994 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:49:22.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.994 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.994 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:22.994 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:49:22.994 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:49:22.994 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.994 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:22.994 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.994 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.994 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:22.994 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:22.995 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 77.750749008, 2024-09-12T22:49:22.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:49:22.995 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:22.995 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:22.995 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:22.995 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:22.995 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.995 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:22.995 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:22.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.995 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.995 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.995 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:22.995 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:22.996 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:22.996 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.996 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.996 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:22.996 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:22.996 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:49:22.996 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.996 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.996 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:22.996 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:49:22.996 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:49:22.996 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.996 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:22.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:49:22.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:49:22.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:22.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:49:22.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:49:22.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:22.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:49:22.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:49:22.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.998 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.998 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:22.998 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:49:22.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:49:22.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.998 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.998 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:22.998 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:49:22.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:49:22.998 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.999 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:22.999 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:22.999 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:22.999 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:22.999 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:22.999 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:22.999 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 77.750699908000001, 2024-09-12T22:49:22.999 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:49:22.999 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:22.999 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:22.999 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:22.999 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:23.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:23.000 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:23.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:23.000 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:23.000 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:23.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:23.000 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:23.000 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:49:23.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:49:23.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.001 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:23.001 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:49:23.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:49:23.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.001 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:23.001 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:49:23.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:49:23.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:23.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:49:23.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:49:23.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.002 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:23.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:49:23.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:49:23.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.002 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:23.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:49:23.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:49:23.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.003 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.003 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:23.003 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:49:23.003 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:49:23.003 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:23.003 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:23.003 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:23.003 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.003 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.003 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:23.003 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:23.003 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 77.743759458, 2024-09-12T22:49:23.003 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:49:23.004 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:23.004 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:23.004 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:23.004 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:23.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.004 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:23.004 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:23.004 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:23.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.004 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:23.004 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:23.004 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:23.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.005 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:23.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:49:23.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:49:23.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.005 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:23.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:49:23.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:49:23.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.005 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:23.006 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:49:23.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:49:23.006 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.006 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:23.006 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:49:23.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:49:23.006 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.006 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:23.006 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:49:23.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:49:23.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.007 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:23.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:49:23.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:49:23.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.007 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:23.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:49:23.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:49:23.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.008 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:23.008 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:49:23.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:49:23.008 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:23.008 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:23.008 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:23.008 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.008 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:23.008 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:23.008 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 77.742670618000005, 2024-09-12T22:49:23.009 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:49:23.009 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:23.009 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:23.009 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:23.009 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:23.009 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:23.009 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:23.009 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:23.009 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.009 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:23.010 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:23.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:23.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.010 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:23.010 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:49:23.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:49:23.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.010 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:23.010 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:49:23.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:49:23.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.011 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:23.011 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:49:23.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:49:23.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.011 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:23.011 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:49:23.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:49:23.012 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.012 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.012 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:23.012 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:49:23.012 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:49:23.012 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.012 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.012 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:23.012 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:49:23.012 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:49:23.012 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.012 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.012 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:23.013 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:49:23.013 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:49:23.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.013 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:23.013 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:49:23.013 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:49:23.013 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:23.013 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:23.013 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:23.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.013 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:23.014 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:23.014 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 77.742621006999997, 2024-09-12T22:49:23.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:49:23.014 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:23.014 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:23.014 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:23.014 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:23.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:23.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:23.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:23.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:23.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:23.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:23.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:23.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:23.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:49:23.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:23.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:23.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:49:23.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:23.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:49:23.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:49:23.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:23.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:49:23.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:49:23.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:23.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:49:23.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:49:23.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:23.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:49:23.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:49:23.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:23.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:49:23.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:49:23.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.018 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:23.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:49:23.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:49:23.018 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:23.018 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:23.018 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:23.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.019 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:23.019 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:23.019 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 77.742553697999995, 2024-09-12T22:49:23.019 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:49:23.019 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:23.019 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:23.019 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:23.019 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:23.019 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.019 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:23.019 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:23.019 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:23.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.020 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:23.020 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:23.020 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:23.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.020 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:23.020 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:23.020 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:49:23.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.021 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:23.021 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:49:23.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:49:23.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.021 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.021 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:23.021 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:49:23.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:49:23.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.021 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.021 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:23.021 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:49:23.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:49:23.022 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:23.022 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:49:23.022 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:49:23.022 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:23.022 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:49:23.022 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:49:23.022 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:23.023 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:49:23.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:49:23.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.023 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:23.023 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:49:23.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:49:23.023 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:23.023 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:23.023 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:23.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.024 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:23.024 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:23.024 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 77.741985779000004, 2024-09-12T22:49:23.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:49:23.024 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:23.024 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:23.024 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:23.024 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:23.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.024 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:23.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:23.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:23.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.025 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.025 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:23.025 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:23.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:23.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.025 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.025 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:23.025 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:23.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:49:23.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.025 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.025 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:23.026 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:49:23.026 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:49:23.026 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.026 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:23.026 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:49:23.026 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:49:23.026 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.026 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:23.026 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:49:23.026 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:49:23.027 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.027 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.027 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:23.027 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:49:23.027 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:49:23.027 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.027 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.027 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:23.027 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:49:23.027 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:49:23.027 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.027 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.028 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:23.028 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:49:23.028 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:49:23.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.028 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.028 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:23.028 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:49:23.028 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:49:23.028 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:23.028 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:23.028 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:23.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.029 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:49:23.029 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:23.029 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 77.741608174999996, 2024-09-12T22:49:23.029 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:49:23.029 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:23.029 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:23.029 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:23.029 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:23.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.030 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:23.030 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:23.030 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:23.030 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.030 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.030 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:23.030 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:23.030 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:23.030 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.030 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.030 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:23.030 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:49:23.031 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:49:23.031 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.031 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.031 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:23.031 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:49:23.031 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:49:23.031 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.031 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.031 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:23.031 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:49:23.031 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:49:23.031 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.032 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.032 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:23.032 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:49:23.032 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:49:23.032 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.032 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.032 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:23.032 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:49:23.032 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:49:23.032 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.032 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.033 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:23.033 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:49:23.033 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:49:23.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.033 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:23.033 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:49:23.033 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:49:23.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:23.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:23.033 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:23.033 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:49:23.033 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:49:23.034 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:23.034 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:23.034 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:23.034 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:23.034 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:23.034 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:23.036 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:23.036 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:23.034+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:23.136 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:23.135+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:23.142 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:23.142 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:23.142 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:49:23.142 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:23.147 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:49:23.153 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:23.237 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:23.236+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:23.256 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:23.256 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:23.257 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:49:23.257 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:49:23.257 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:23.264 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:23.278 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:49:23.279 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:49:23.295 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:49:23.295 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:49:23.295 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:49:23.298 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:49:23.299 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:49:23.348 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:23.347+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:23.406 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:23.407 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:23.415 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:23.460 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:23.458+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:23.480 INFO:tasks.workunit.client.0.smithi066.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T22:49:23.520 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:23.520 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:23.529 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:23.547 INFO:tasks.workunit.client.0.smithi066.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T22:49:23.570 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:23.569+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:23.589 INFO:tasks.workunit.client.0.smithi066.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T22:49:23.591 INFO:tasks.workunit.client.0.smithi066.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T22:49:23.591 INFO:tasks.workunit.client.0.smithi066.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T22:49:23.630 INFO:tasks.workunit.client.0.smithi066.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T22:49:23.634 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T22:49:23.634 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T22:49:23.641 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:23.640+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:23.650 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-12T22:49:23.651 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-12T22:49:23.652 DEBUG:teuthology.orchestra.run.smithi066:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7741f7f9ee20524f89b8f61d1609b32fb3b1570a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-12T22:49:23.671 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:23.671 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:23.679 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:23.714 INFO:tasks.workunit.client.0.smithi066.stderr:+ mkdir -p fsstress 2024-09-12T22:49:23.715 INFO:tasks.workunit.client.0.smithi066.stderr:+ pushd fsstress 2024-09-12T22:49:23.716 INFO:tasks.workunit.client.0.smithi066.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-12T22:49:23.716 INFO:tasks.workunit.client.0.smithi066.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-12T22:49:23.742 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:23.741+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:23.782 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:23.782 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:23.790 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:23.844 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:23.842+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:23.894 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:23.895 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:23.904 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:23.944 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:23.943+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:24.044 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:24.044+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:24.046 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:24.046 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:24.054 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:24.145 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:24.145+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:24.156 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:24.156 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:24.165 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:24.247 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:24.246+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:24.267 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:24.267 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:24.276 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:24.360 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:24.359+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:24.418 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:24.419 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:24.427 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:24.449 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:24.448+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:24.549 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~53s 2024-09-12T22:49:24.550 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:24.549+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:24.550 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:49:24.569 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:24.569 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:24.578 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:24.651 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:24.650+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:24.684 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:24.685 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:24.693 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:24.752 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:24.752+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:24.835 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:24.835 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:24.843 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:24.887 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:24.886+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:24.947 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:24.947 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:24.954 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:24.953+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:24.955 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:25.055 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:25.054+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:25.060 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:25.060 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:25.069 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:25.155 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:25.153+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:25.213 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:25.213 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:25.222 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:25.256 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:25.255+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:25.300 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:49:25.357 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:25.355+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:25.363 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:25.363 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:25.372 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:25.430 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:49:25.430 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:49:25.447 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:49:25.448 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:49:25.448 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:49:25.451 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:49:25.451 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:49:25.458 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:25.457+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:25.476 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:25.476 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:25.477 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:49:25.477 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:25.486 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:25.537 INFO:teuthology.orchestra.run.smithi066.stderr:nodeep-scrub is set 2024-09-12T22:49:25.559 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:25.558+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:25.589 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:25.590 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:25.590 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:49:25.590 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:49:25.590 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:25.598 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:25.682 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:25.681+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:25.742 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:25.742 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:49:25.742 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:49:25.742 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:49:25.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.742 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:49:25.743 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:25.743 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 85.694258527000002, 2024-09-12T22:49:25.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:49:25.743 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:25.743 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:25.743 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:25.743 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:25.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:25.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:25.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:25.744 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:25.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.744 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:25.744 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:25.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:49:25.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.744 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:25.744 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:49:25.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:49:25.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:25.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:49:25.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:49:25.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:25.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:49:25.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:49:25.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:25.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:49:25.746 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:49:25.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.746 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:25.746 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:49:25.746 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:49:25.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.746 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:25.746 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:49:25.746 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:49:25.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.747 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:25.747 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:49:25.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:49:25.747 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.747 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:25.747 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.747 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:49:25.747 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:25.748 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 83.693877799999996, 2024-09-12T22:49:25.748 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:49:25.748 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:25.748 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:25.748 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:25.748 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:25.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.748 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:25.748 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:25.748 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.749 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:25.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:25.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.749 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:25.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:49:25.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:49:25.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.749 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:25.750 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:49:25.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:49:25.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.750 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:25.750 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:49:25.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:49:25.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.750 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:25.750 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:49:25.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:49:25.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.751 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:25.751 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:49:25.751 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:49:25.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.751 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:25.751 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:49:25.751 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:49:25.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.751 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:25.751 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:49:25.751 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:49:25.752 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.752 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.752 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:25.752 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:49:25.752 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:49:25.752 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.752 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:25.752 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.752 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.752 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.752 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:49:25.752 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:25.752 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 80.573280990000001, 2024-09-12T22:49:25.753 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:49:25.753 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:25.753 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:25.753 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:49:25.753 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:25.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.753 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:25.753 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:25.753 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:25.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:25.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:25.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:25.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:49:25.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:25.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:49:25.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:49:25.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.755 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:25.755 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:49:25.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:49:25.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.755 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:25.755 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:49:25.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:49:25.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.755 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:25.755 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:49:25.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:49:25.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.756 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:25.756 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:49:25.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:49:25.756 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.756 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:25.756 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.756 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:25.756 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:25.756 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 80.570672810000005, 2024-09-12T22:49:25.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:49:25.757 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:25.757 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:25.757 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:25.757 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:25.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:25.757 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:25.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:25.757 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:25.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:25.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:49:25.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:49:25.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:25.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:49:25.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:49:25.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:25.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:49:25.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:49:25.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:25.759 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:49:25.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:49:25.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:25.759 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:49:25.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:49:25.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:25.760 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:49:25.760 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:49:25.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.760 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:25.760 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:49:25.760 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:49:25.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.760 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:25.760 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:49:25.760 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:49:25.760 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.761 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:25.761 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.761 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:25.761 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:25.761 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 80.569779586999999, 2024-09-12T22:49:25.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:49:25.761 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:25.761 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:25.761 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:25.761 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:25.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:25.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:25.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:25.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:25.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:25.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:49:25.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:49:25.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:25.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:49:25.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:49:25.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:25.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:49:25.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:49:25.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:25.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:49:25.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:49:25.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:25.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:49:25.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:49:25.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:25.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:49:25.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:49:25.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:25.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:49:25.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:49:25.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:25.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:49:25.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:49:25.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:25.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:49:25.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:49:25.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.766 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:25.766 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:49:25.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:49:25.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.766 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:25.766 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:49:25.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:49:25.766 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.766 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:25.766 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.766 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:25.767 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:25.767 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 80.569707929000003, 2024-09-12T22:49:25.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:49:25.767 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:25.767 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:25.767 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:25.767 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:25.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:25.767 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:25.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:25.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:25.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:25.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:49:25.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:49:25.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:25.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:49:25.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:49:25.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:25.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:49:25.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:49:25.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:25.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:49:25.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:49:25.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:25.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:49:25.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:49:25.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:25.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:49:25.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:49:25.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:25.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:49:25.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:49:25.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:25.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:49:25.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:49:25.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:25.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:49:25.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:49:25.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:25.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:49:25.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:49:25.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:25.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:49:25.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:49:25.772 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.772 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:25.772 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.772 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:25.772 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:25.773 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 80.569665211, 2024-09-12T22:49:25.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:49:25.773 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:25.773 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:25.773 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:25.773 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:25.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:25.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:25.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:25.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:25.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:25.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:49:25.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:49:25.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:25.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:49:25.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:49:25.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:25.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:49:25.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:49:25.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:25.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:49:25.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:49:25.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:25.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:49:25.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:49:25.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:25.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:49:25.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:49:25.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:25.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:49:25.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:49:25.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:25.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:49:25.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:49:25.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:25.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:49:25.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:49:25.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:25.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:49:25.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:49:25.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:25.778 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:49:25.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:49:25.778 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.778 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:25.778 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.778 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:25.778 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:25.778 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 80.569627294, 2024-09-12T22:49:25.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:49:25.778 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:25.778 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:25.778 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:25.779 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:25.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:25.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:25.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:25.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:25.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:25.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:49:25.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:49:25.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:25.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:49:25.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:49:25.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:25.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:49:25.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:49:25.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.781 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:25.781 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:49:25.781 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:49:25.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.781 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:25.781 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:49:25.781 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:49:25.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.781 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:25.781 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:49:25.781 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:49:25.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.782 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.782 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:25.782 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:25.782 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:49:25.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.782 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.782 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:25.782 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:49:25.782 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:49:25.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.782 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.782 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:25.782 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:49:25.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:49:25.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.783 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:25.783 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:49:25.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:49:25.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.783 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:25.783 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:49:25.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:49:25.783 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.783 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:25.783 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.784 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:25.784 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:25.784 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 80.569603842999996, 2024-09-12T22:49:25.784 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:49:25.784 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:25.784 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:25.784 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:25.784 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:25.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.784 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:25.784 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:25.784 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.785 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.785 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:25.785 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:25.785 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.785 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.785 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:25.785 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:49:25.785 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:49:25.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.785 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.785 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:25.785 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:49:25.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:49:25.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.786 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:25.786 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:49:25.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:49:25.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.786 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:25.786 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:49:25.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:49:25.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:25.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:49:25.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:49:25.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:25.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:49:25.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:49:25.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:25.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:25.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:49:25.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.788 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:25.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:49:25.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:49:25.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.788 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:25.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:49:25.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:49:25.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.788 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:25.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:49:25.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:49:25.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:25.789 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:49:25.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:49:25.789 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.789 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:25.789 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.789 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:25.789 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:25.789 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 80.569579606000005, 2024-09-12T22:49:25.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:49:25.790 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:25.790 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:25.790 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:25.790 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:25.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.790 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:25.790 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:25.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.790 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:25.790 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:25.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:25.791 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:25.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:49:25.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:25.791 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:49:25.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:49:25.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:25.791 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:49:25.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:49:25.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:25.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:49:25.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:49:25.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:25.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:49:25.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:49:25.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:25.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:49:25.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:49:25.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:25.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:49:25.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:49:25.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:25.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:49:25.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:49:25.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:25.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:49:25.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:49:25.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:25.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:49:25.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:49:25.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:25.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:49:25.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:49:25.794 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.795 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:25.795 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.795 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:25.795 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:25.795 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 80.569551688999994, 2024-09-12T22:49:25.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:49:25.795 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:25.795 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:25.795 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:25.795 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:25.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:25.796 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:25.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.796 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.796 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:25.796 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:25.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.796 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.796 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:25.796 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:25.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:49:25.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:25.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:49:25.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:49:25.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:25.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:49:25.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:49:25.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:25.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:49:25.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:49:25.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:25.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:49:25.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:49:25.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:25.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:49:25.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:49:25.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:25.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:49:25.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:49:25.799 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.799 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:25.799 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.799 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:25.799 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:25.799 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 80.569477194000001, 2024-09-12T22:49:25.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:49:25.799 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:25.799 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:25.799 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:25.799 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:25.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.800 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:25.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:25.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.800 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:25.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:25.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.800 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:25.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:49:25.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:49:25.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:25.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:49:25.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:49:25.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:25.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:49:25.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:49:25.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:25.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:49:25.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:49:25.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.802 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.802 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:25.802 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:49:25.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:49:25.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.802 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.802 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:25.802 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:49:25.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:49:25.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.802 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.802 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:25.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:49:25.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:49:25.803 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.803 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:25.803 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.803 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:25.803 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:25.803 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 80.569431166000001, 2024-09-12T22:49:25.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:49:25.803 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:25.803 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:25.803 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:25.804 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:25.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:25.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:25.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:25.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:25.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:25.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:49:25.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:49:25.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:25.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:49:25.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:49:25.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:25.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:49:25.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:49:25.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:25.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:49:25.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:49:25.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:25.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:49:25.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:49:25.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:25.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:49:25.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:49:25.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.807 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.807 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:25.807 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:49:25.807 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:49:25.807 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.807 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:25.807 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.807 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.807 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:25.807 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:25.807 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 80.567260282000007, 2024-09-12T22:49:25.807 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:49:25.807 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:25.808 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:25.808 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:25.808 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:25.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.808 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:25.808 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:25.808 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.808 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:25.808 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:25.808 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:25.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:25.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:49:25.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:25.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:49:25.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:49:25.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:25.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:49:25.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:49:25.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:49:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:49:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:49:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:49:25.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.811 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:25.811 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:49:25.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:49:25.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.811 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:25.811 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:49:25.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:49:25.811 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.811 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:25.811 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.812 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:25.812 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:25.812 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 80.567209832000003, 2024-09-12T22:49:25.812 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:49:25.812 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:25.812 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:25.812 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:25.812 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:25.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.812 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:25.812 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:25.812 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.812 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.813 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:25.813 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:25.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.813 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:25.813 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:49:25.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:49:25.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.813 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:25.813 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:49:25.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:49:25.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:25.814 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:49:25.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:49:25.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:25.814 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:49:25.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:49:25.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:25.814 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:49:25.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:49:25.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:25.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:49:25.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:49:25.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:25.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:49:25.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:49:25.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:25.816 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:49:25.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:49:25.816 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.816 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:25.816 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.816 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:25.816 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:25.816 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 80.567156393999994, 2024-09-12T22:49:25.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:49:25.816 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:25.816 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:25.816 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:25.817 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:25.817 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.817 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:25.817 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:25.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.817 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.817 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.817 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:25.817 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:25.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.817 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.817 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.817 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:25.817 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:25.818 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:49:25.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.818 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.818 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:25.818 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:49:25.818 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:49:25.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.818 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.818 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:25.818 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:25.818 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:49:25.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.818 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.818 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:25.819 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:49:25.819 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:49:25.819 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.819 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.819 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:25.819 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:49:25.819 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:49:25.819 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.819 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.819 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:25.819 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:49:25.819 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:49:25.819 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.819 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.820 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:25.820 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:49:25.820 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:49:25.820 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.820 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.820 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:25.820 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:49:25.820 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:49:25.820 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.820 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:25.820 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.820 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.820 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.821 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:49:25.821 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:25.821 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 80.563172041000001, 2024-09-12T22:49:25.821 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:49:25.821 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:25.821 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:25.821 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:25.821 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:25.821 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.821 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:25.821 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:25.821 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.821 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.822 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.822 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:25.822 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:25.822 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.822 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.822 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:25.822 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:49:25.822 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:49:25.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.822 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.822 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:25.822 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:49:25.822 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:49:25.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.823 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:25.823 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:49:25.823 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:49:25.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.823 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:25.823 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:49:25.823 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:49:25.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.823 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:25.824 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:49:25.824 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:49:25.824 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.824 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.824 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:25.824 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:49:25.824 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:49:25.824 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.824 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.824 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:25.824 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:49:25.824 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:49:25.824 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.825 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:25.825 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.825 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.825 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.825 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:49:25.825 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:25.825 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 78.578019502000004, 2024-09-12T22:49:25.825 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:49:25.825 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:25.825 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:25.825 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:25.825 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:25.825 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.826 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:25.826 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:25.826 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.826 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.826 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:25.826 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:25.826 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.826 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.826 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:25.826 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:49:25.826 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:49:25.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.827 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:25.827 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:49:25.827 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:49:25.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.827 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:25.827 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:49:25.827 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:49:25.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.827 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:25.827 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:49:25.827 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:49:25.828 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.828 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.828 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:25.828 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:49:25.828 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:49:25.828 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.828 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.828 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:25.828 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:49:25.828 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:49:25.828 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.828 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.828 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:25.829 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:49:25.829 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:49:25.829 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.829 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.829 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:25.829 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:49:25.829 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:49:25.829 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.829 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.829 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:25.829 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:49:25.829 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:49:25.829 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.829 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.830 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:25.830 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:49:25.830 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:49:25.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.830 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.830 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:25.830 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:49:25.830 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:49:25.830 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.830 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:25.830 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.830 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.830 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:49:25.831 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:25.831 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.576103257, 2024-09-12T22:49:25.831 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:49:25.831 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:25.831 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:25.831 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:25.831 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:25.831 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.831 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:25.831 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:25.831 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.831 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.831 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.832 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:25.832 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:25.832 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.832 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.832 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:25.832 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:49:25.832 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:49:25.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.832 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.832 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:25.832 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:49:25.832 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:49:25.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.833 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.833 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:25.833 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:49:25.833 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:49:25.833 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.833 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.833 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:25.833 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:49:25.833 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:49:25.833 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.833 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.833 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:25.833 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:49:25.834 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:49:25.834 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.834 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.834 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:25.834 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:49:25.834 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:49:25.834 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.834 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.834 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:25.834 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:49:25.834 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:49:25.834 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.834 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.834 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:25.835 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:49:25.835 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:49:25.835 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.835 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.835 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:25.835 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:49:25.835 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:49:25.835 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.835 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.835 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:25.835 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:49:25.835 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:49:25.835 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.836 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.836 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:25.836 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:49:25.836 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:49:25.836 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.836 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:25.836 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.836 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.836 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.836 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:49:25.836 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:25.836 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.575349881999998, 2024-09-12T22:49:25.836 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012160610000000001, 2024-09-12T22:49:25.837 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:25.837 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:25.837 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:25.837 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:25.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.837 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:25.837 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:25.837 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.837 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:25.837 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:25.837 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:25.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.838 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:25.838 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164967+0000", 2024-09-12T22:49:25.838 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:49:25.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.838 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:25.838 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164974+0000", 2024-09-12T22:49:25.838 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:49:25.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.838 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:25.838 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164987+0000", 2024-09-12T22:49:25.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3689000000000001e-05 2024-09-12T22:49:25.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.839 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:25.839 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164995+0000", 2024-09-12T22:49:25.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2959999999999999e-06 2024-09-12T22:49:25.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.839 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:25.839 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165068+0000", 2024-09-12T22:49:25.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2449999999999999e-05 2024-09-12T22:49:25.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.839 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:25.840 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165212+0000", 2024-09-12T22:49:25.840 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144117 2024-09-12T22:49:25.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.840 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.840 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:25.840 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166066+0000", 2024-09-12T22:49:25.840 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085441100000000002 2024-09-12T22:49:25.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.840 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.840 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:25.840 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166107+0000", 2024-09-12T22:49:25.840 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0450000000000001e-05 2024-09-12T22:49:25.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:25.841 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:25.841 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:25.841 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166181+0000", 2024-09-12T22:49:25.841 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-12T22:49:25.841 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.841 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:25.841 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.841 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:25.841 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:25.841 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:25.843 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:25.842+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:25.843 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:25.944 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:25.942+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:25.950 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:25.950 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:25.950 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:49:25.950 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:25.959 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:26.045 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:26.044+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:26.100 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:26.101 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:26.101 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:49:26.101 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:49:26.101 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:26.109 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:26.146 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:26.145+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:26.214 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:26.214 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:49:26.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:49:26.215 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:49:26.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.215 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:49:26.215 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:26.215 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.827981596000001, 2024-09-12T22:49:26.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:49:26.215 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:26.215 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:26.216 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:26.216 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:26.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:26.216 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:26.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.217 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.217 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:26.217 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:26.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:26.218 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:26.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:49:26.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:26.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:49:26.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:49:26.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:26.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:49:26.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:49:26.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:49:26.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:49:26.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.220 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:26.220 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:49:26.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:49:26.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.220 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:26.220 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:49:26.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:49:26.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.221 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:26.221 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:49:26.221 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:49:26.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.221 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:26.221 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:49:26.221 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:49:26.221 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.222 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:26.222 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.222 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:49:26.222 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:26.222 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.827539013000006, 2024-09-12T22:49:26.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:49:26.222 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:26.222 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:26.222 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:26.222 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:26.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:26.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:26.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:26.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:26.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:26.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:49:26.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:49:26.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:26.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:49:26.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:49:26.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:26.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:49:26.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:49:26.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.225 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:49:26.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:49:26.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.225 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.225 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:26.225 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:49:26.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:49:26.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.225 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.225 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:26.225 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:49:26.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:49:26.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.225 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.226 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:26.226 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:49:26.226 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:49:26.226 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.226 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.226 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:26.226 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:49:26.226 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:49:26.226 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.226 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:26.226 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.226 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.226 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.226 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:49:26.227 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:26.227 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.827172856000004, 2024-09-12T22:49:26.227 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:49:26.227 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:26.227 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:26.227 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:26.227 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:26.227 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.227 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:26.227 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:26.227 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.227 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.228 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.228 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:26.228 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:26.228 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.228 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.228 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.228 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:26.228 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:49:26.228 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:49:26.228 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.228 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.228 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:26.228 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:49:26.229 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:49:26.229 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.229 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.229 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:26.229 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:49:26.229 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:49:26.229 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.229 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.229 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.230 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:49:26.230 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:49:26.230 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.230 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.230 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:26.230 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:49:26.232 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:49:26.232 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.232 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.232 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:26.232 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:49:26.232 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:49:26.232 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.232 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.232 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:26.232 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:49:26.232 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:49:26.233 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.233 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.233 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:26.233 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:49:26.233 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:49:26.233 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.233 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:26.233 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.233 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.233 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.233 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:49:26.233 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:26.233 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.826760543999995, 2024-09-12T22:49:26.233 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:49:26.234 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:26.234 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:26.234 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:26.234 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:26.234 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.234 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:26.234 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:26.234 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.234 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.234 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.234 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:26.234 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:26.235 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.235 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.235 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.235 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:26.235 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:26.235 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:49:26.235 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.235 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.235 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:26.235 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:49:26.235 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:49:26.235 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.235 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.236 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:26.236 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:49:26.236 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:49:26.236 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.236 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.236 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.236 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:49:26.236 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:49:26.236 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.236 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.236 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:26.236 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:49:26.237 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:49:26.237 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.237 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.237 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:26.237 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:49:26.237 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:49:26.237 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.237 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.237 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:26.237 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:49:26.238 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:49:26.238 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.238 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.238 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:26.238 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:49:26.238 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:49:26.238 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.238 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:26.238 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.238 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.238 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.238 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:49:26.238 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:26.238 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.692910449999999, 2024-09-12T22:49:26.239 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:49:26.239 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:26.239 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:26.239 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:26.239 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:26.239 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.239 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:26.239 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:26.239 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.240 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.240 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.240 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:26.240 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:26.240 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.240 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.240 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.240 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:26.240 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:26.240 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:49:26.241 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.241 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.241 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:26.241 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:49:26.241 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:49:26.241 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.241 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.241 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:26.241 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:49:26.242 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:49:26.242 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.242 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.242 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.242 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:49:26.242 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:49:26.242 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.242 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.243 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:26.243 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:49:26.243 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:49:26.243 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.243 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.243 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:26.243 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:49:26.243 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:49:26.243 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.243 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.243 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:26.243 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:49:26.243 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:49:26.244 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.244 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.244 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:26.244 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:49:26.244 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:49:26.244 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.244 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:26.244 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.244 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.244 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.245 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:26.245 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:26.245 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 81.047674896000004, 2024-09-12T22:49:26.245 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:49:26.245 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:26.245 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:26.245 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:26.245 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:26.245 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.245 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:26.245 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:26.245 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.245 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.245 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.246 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:26.246 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:26.246 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.246 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.246 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.246 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:26.246 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:49:26.246 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:49:26.246 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.246 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.246 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:26.246 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:49:26.247 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:49:26.247 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.247 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.247 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:26.247 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:49:26.247 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:49:26.247 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.247 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.247 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.247 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:49:26.247 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:49:26.247 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.247 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.247 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:26.248 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:26.248 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:49:26.248 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.248 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.248 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:26.248 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:26.248 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:49:26.248 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.248 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.248 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:26.248 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:49:26.248 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:49:26.248 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.249 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.249 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:26.249 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:49:26.249 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:49:26.249 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.249 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.249 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:26.250 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:49:26.250 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:49:26.250 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.250 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.250 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:26.250 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:49:26.251 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:49:26.251 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.251 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.251 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:26.251 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:49:26.251 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:49:26.252 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.252 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.252 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:26.252 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:49:26.252 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:49:26.252 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.253 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.253 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:26.253 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:49:26.253 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:49:26.253 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.253 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:26.253 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.253 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.253 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.253 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:26.253 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:26.254 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 81.047575378999994, 2024-09-12T22:49:26.254 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:49:26.254 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:26.254 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:26.254 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:26.254 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:26.254 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.254 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:26.254 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:26.254 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.254 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.254 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.254 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:26.254 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:26.255 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.255 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.255 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.255 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:26.255 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:49:26.255 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:49:26.255 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.255 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.255 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:26.256 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:49:26.256 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:49:26.256 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.256 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.256 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:26.256 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:49:26.256 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:49:26.256 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.256 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.256 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.256 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:49:26.256 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:49:26.256 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.257 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.257 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:26.257 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:49:26.257 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:49:26.257 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.257 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.257 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:26.257 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:49:26.258 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:49:26.258 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.258 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.258 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:26.258 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:49:26.258 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:49:26.258 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.258 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.258 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:26.258 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:49:26.259 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:49:26.259 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.259 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.259 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:26.259 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:49:26.259 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:49:26.259 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.259 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.259 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:26.259 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:49:26.259 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:49:26.259 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.260 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.260 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:26.260 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:49:26.260 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:49:26.260 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.260 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.260 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:26.260 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:49:26.260 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:49:26.260 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.261 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.261 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:26.261 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:49:26.261 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:49:26.261 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.261 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:26.261 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.261 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.261 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.261 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:26.261 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:26.262 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 81.047530640000005, 2024-09-12T22:49:26.262 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:49:26.262 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:26.262 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:26.262 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:26.262 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:26.262 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.262 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:26.262 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:26.262 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.262 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.262 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.263 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:26.263 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:26.263 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.263 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.263 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.263 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:26.263 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:49:26.263 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:49:26.263 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.263 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.263 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:26.264 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:26.264 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:49:26.264 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.264 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.264 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:26.264 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:26.264 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:49:26.264 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.264 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.264 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.264 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:49:26.265 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:49:26.265 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.265 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.265 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:26.265 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:49:26.265 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:49:26.265 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.265 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.265 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:26.265 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:49:26.265 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:49:26.266 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.266 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.266 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:26.266 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:49:26.266 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:49:26.266 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.266 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.266 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:26.266 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:49:26.266 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:49:26.266 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.267 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.267 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:26.267 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:49:26.267 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:49:26.267 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.267 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.267 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:26.267 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:49:26.267 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:49:26.267 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.267 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.268 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:26.268 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:49:26.268 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:49:26.268 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.268 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.268 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:26.268 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:49:26.268 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:49:26.268 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.268 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.269 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:26.269 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:49:26.269 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:49:26.269 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.269 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:26.269 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.269 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.269 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.270 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:26.270 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:26.270 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 81.047302939000005, 2024-09-12T22:49:26.270 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:49:26.270 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:26.270 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:26.270 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:26.270 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:26.270 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.271 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:26.271 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:26.271 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.271 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.271 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:26.271 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:26.271 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.271 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.271 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:26.272 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:49:26.272 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:49:26.272 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.272 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.272 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:26.272 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:49:26.272 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:49:26.272 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.272 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.272 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:26.272 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:49:26.272 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:49:26.273 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.273 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.273 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.273 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:49:26.273 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:49:26.273 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.273 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.273 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:26.273 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:49:26.274 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:49:26.274 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.274 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.274 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:26.274 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:49:26.274 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:49:26.274 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.274 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.274 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:26.274 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:49:26.274 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:49:26.275 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.275 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.275 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:26.275 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:49:26.275 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:49:26.275 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.275 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.275 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:26.275 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:49:26.275 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:49:26.275 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.275 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.276 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:26.276 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:49:26.276 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:49:26.276 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.276 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.276 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:26.276 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:49:26.276 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:49:26.276 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.276 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.276 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:26.277 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:49:26.277 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:49:26.277 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.277 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.277 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:26.277 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:49:26.277 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:49:26.277 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.277 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:26.277 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.278 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.278 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.278 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:26.278 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:26.278 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 81.047137831000001, 2024-09-12T22:49:26.278 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:49:26.278 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:26.278 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:26.278 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:26.278 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:26.278 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.279 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:26.279 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:26.279 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.279 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.279 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.279 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:26.279 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:26.279 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.279 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.279 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.279 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:26.280 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:49:26.280 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:49:26.280 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.280 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.280 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:26.280 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:49:26.280 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:49:26.280 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.280 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.280 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:26.280 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:49:26.281 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:49:26.281 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.281 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.281 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.281 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:49:26.281 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:49:26.281 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.281 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.281 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:26.281 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:49:26.281 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:49:26.282 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.282 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.282 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:26.282 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:49:26.282 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:49:26.282 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.282 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.282 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:26.282 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:49:26.282 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:49:26.283 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.283 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.283 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:26.283 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:49:26.283 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:49:26.283 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.283 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.284 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:26.284 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:49:26.284 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:49:26.284 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.284 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.284 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:26.284 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:49:26.284 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:49:26.284 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.284 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.284 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:26.285 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:49:26.285 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:49:26.285 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.285 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.285 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:26.285 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:49:26.285 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:49:26.285 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.285 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.285 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:26.285 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:49:26.286 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:49:26.286 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.286 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:26.286 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.286 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.286 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.286 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:26.286 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:26.286 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 81.047076546, 2024-09-12T22:49:26.286 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:49:26.287 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:26.287 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:26.287 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:26.287 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:26.287 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.287 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:26.287 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:26.287 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.287 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.287 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.287 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:26.288 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:26.288 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.288 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.288 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.288 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:26.288 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:26.288 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:49:26.288 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.288 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.289 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:26.289 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:49:26.289 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:49:26.289 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.289 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.289 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:26.289 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:49:26.289 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:49:26.289 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.289 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.289 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.290 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:49:26.290 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:49:26.290 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.290 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.290 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:26.290 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:49:26.290 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:49:26.290 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.290 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.290 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:26.290 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:49:26.291 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:49:26.291 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.291 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.291 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:26.291 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:49:26.291 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:49:26.291 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.291 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.291 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:26.291 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:49:26.291 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:49:26.291 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.292 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.292 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:26.292 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:49:26.292 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:49:26.292 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.292 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.292 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:26.292 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:49:26.292 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:49:26.292 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.293 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.293 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:26.293 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:49:26.293 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:49:26.293 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.293 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.293 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:26.293 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:49:26.293 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:49:26.293 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.293 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.293 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:26.294 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:49:26.294 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:49:26.294 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.294 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:26.294 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.294 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.294 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.294 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:26.294 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:26.294 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 81.046996437999994, 2024-09-12T22:49:26.294 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:49:26.295 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:26.295 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:26.295 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:26.295 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:26.295 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.295 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:26.295 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:26.295 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.295 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.295 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.295 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:26.295 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:26.296 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.296 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.296 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.296 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:26.296 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:49:26.296 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:49:26.296 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.296 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.296 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:26.296 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:49:26.296 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:49:26.297 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.297 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.297 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:26.297 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:49:26.297 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:49:26.297 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.297 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.297 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.297 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:49:26.297 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:49:26.297 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.298 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.298 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:26.298 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:49:26.298 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:49:26.298 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.298 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.298 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:26.298 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:49:26.298 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:49:26.298 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.298 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.299 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:26.299 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:49:26.299 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:49:26.299 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.299 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.299 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:26.299 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:49:26.299 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:49:26.299 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.299 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.299 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:26.300 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:49:26.300 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:49:26.300 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.300 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.300 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:26.300 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:49:26.300 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:49:26.300 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.300 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.300 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:26.300 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:49:26.301 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:49:26.301 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.301 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.301 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:26.301 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:49:26.301 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:49:26.301 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.301 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.301 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:26.301 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:49:26.301 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:49:26.302 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.302 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:26.302 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.302 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.302 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.302 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:26.302 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:26.302 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 81.046947485000004, 2024-09-12T22:49:26.302 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:49:26.302 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:26.302 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:26.303 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:26.303 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:26.303 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.303 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:26.303 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:26.303 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.303 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.303 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.303 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:26.303 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:26.303 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.304 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.304 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.304 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:26.304 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:26.304 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:49:26.304 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.304 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.304 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:26.304 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:49:26.304 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:49:26.304 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.305 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.305 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:26.305 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:49:26.305 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:49:26.305 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.305 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.305 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.305 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:49:26.305 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:49:26.305 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.306 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.306 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:26.306 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:49:26.306 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:49:26.306 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.306 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.306 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:26.306 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:49:26.306 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:49:26.307 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.307 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.307 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:26.307 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:49:26.307 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:49:26.307 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.307 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:26.307 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.307 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.307 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.308 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:26.308 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:26.308 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 81.046898385000006, 2024-09-12T22:49:26.308 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:49:26.308 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:26.308 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:26.308 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:26.309 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:26.309 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.309 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:26.309 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:26.309 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.309 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.309 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.309 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:26.310 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:26.310 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.310 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.310 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.310 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:26.310 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:49:26.310 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:49:26.310 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.310 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.310 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:26.310 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:49:26.310 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:49:26.311 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.311 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.311 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:26.311 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:49:26.311 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:49:26.311 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.311 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.311 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.311 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:49:26.311 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:49:26.311 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.312 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.312 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:26.312 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:49:26.312 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:49:26.312 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.312 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.312 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:26.312 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:49:26.312 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:49:26.312 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.313 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.313 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:26.313 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:49:26.313 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:49:26.313 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.313 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:26.313 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.313 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.313 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.313 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:26.313 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:26.314 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 81.039957935000004, 2024-09-12T22:49:26.314 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:49:26.314 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:26.314 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:26.314 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:26.314 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:26.314 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.314 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:26.314 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:26.314 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.314 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.315 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.315 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:26.315 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:26.315 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.315 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.315 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.315 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:26.315 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:49:26.315 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:49:26.315 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.315 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.315 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:26.316 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:49:26.316 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:49:26.316 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.316 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.316 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:26.316 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:49:26.316 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:49:26.316 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.316 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.316 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.316 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:49:26.317 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:49:26.317 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.317 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.317 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:26.317 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:49:26.317 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:49:26.317 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.317 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.317 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:26.317 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:49:26.317 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:49:26.317 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.318 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.318 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:26.318 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:49:26.318 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:49:26.318 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.318 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.318 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:26.318 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:49:26.318 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:49:26.318 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.318 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:26.318 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.319 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.319 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.319 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:26.319 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:26.319 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 81.038869094999995, 2024-09-12T22:49:26.319 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:49:26.319 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:26.319 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:26.319 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:26.319 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:26.319 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.319 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:26.320 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:26.320 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.320 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.320 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.320 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:26.320 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:26.320 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.320 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.320 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.320 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:26.321 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:49:26.321 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:49:26.321 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.321 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.321 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:26.321 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:49:26.321 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:49:26.321 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.321 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.321 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:26.321 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:49:26.321 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:49:26.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.322 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.322 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.322 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:49:26.322 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:49:26.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.322 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.322 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:26.322 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:49:26.322 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:49:26.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.323 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.323 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:26.323 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:49:26.323 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:49:26.323 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.323 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.323 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:26.323 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:49:26.323 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:49:26.323 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.324 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.324 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:26.324 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:49:26.324 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:49:26.324 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.324 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:26.324 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.324 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.324 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.324 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:26.325 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:26.325 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 81.038819484000001, 2024-09-12T22:49:26.325 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:49:26.325 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:26.325 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:26.325 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:26.325 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:26.325 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.325 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:26.325 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:26.326 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.326 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.326 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.326 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:26.326 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:26.326 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.326 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.326 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.326 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:26.326 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:26.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:49:26.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:26.327 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:26.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:49:26.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:26.327 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:49:26.328 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:49:26.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.328 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.328 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:49:26.328 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:49:26.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.328 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:26.328 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:49:26.328 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:49:26.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.329 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:26.329 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:49:26.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:49:26.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.329 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:26.329 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:49:26.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:49:26.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.330 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.330 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:26.330 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:49:26.330 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:49:26.330 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.330 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:26.330 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.330 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.330 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.330 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:26.331 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:26.331 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 81.038752174999999, 2024-09-12T22:49:26.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:49:26.331 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:26.331 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:26.331 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:26.331 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:26.331 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.331 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:26.331 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:26.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:26.332 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:26.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:26.332 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:26.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:49:26.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.333 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:26.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:49:26.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:49:26.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.333 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:26.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:49:26.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:49:26.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.334 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.334 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:49:26.334 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:49:26.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.334 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:26.334 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:49:26.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:49:26.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.335 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:26.335 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:49:26.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:49:26.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.335 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:26.335 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:49:26.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:49:26.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.336 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:26.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:49:26.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:49:26.336 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.336 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:26.336 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.337 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:26.337 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:26.337 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 81.038184255999994, 2024-09-12T22:49:26.337 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:49:26.337 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:26.337 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:26.337 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:26.337 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:26.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.337 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:26.338 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:26.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.338 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:26.338 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:26.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.339 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.339 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:26.339 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:26.339 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:49:26.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.339 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.339 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:26.339 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:49:26.339 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:49:26.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:26.340 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:49:26.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:49:26.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.340 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:49:26.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:49:26.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.341 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:26.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:49:26.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:49:26.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.341 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:26.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:49:26.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:49:26.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.342 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:26.342 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:49:26.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:49:26.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.342 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:26.342 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:49:26.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:49:26.342 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.343 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:26.343 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.343 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.343 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.343 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:49:26.343 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:26.343 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 81.037806652, 2024-09-12T22:49:26.343 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:49:26.343 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:26.343 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:26.344 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:26.344 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:26.344 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.344 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:26.344 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:26.344 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.344 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.344 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.344 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:26.345 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:26.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:26.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.345 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.345 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:26.345 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:49:26.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:49:26.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.345 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.345 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:26.345 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:49:26.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:49:26.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.346 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:26.346 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:49:26.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:49:26.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.346 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.346 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:49:26.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:49:26.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.347 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.347 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:26.347 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:49:26.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:49:26.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.347 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.347 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:26.347 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:49:26.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:49:26.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.348 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:26.348 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:49:26.348 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:49:26.348 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:26.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:26.348 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:26.348 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:49:26.348 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:49:26.348 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.348 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:26.349 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.349 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:26.349 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:26.349 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:26.351 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:26.351 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:26.349+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:26.451 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:26.450+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:26.455 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:26.455 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:26.455 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:49:26.455 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:26.464 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:26.553 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:26.552+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:26.607 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:26.607 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:26.607 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:49:26.607 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:49:26.607 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:26.616 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:26.657 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:26.656+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:26.756 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:26.754+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:26.761 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:26.761 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:49:26.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:49:26.761 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:49:26.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.761 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:49:26.762 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:26.762 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 86.713471861000002, 2024-09-12T22:49:26.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:49:26.762 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:26.762 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:26.762 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:26.762 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:26.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:26.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:26.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:26.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:26.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:26.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:26.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:49:26.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:26.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:49:26.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:49:26.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:26.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:49:26.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:49:26.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:49:26.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:49:26.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:26.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:49:26.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:49:26.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:26.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:49:26.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:49:26.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:26.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:49:26.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:49:26.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.766 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:26.766 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:49:26.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:49:26.766 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.766 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:26.766 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.766 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:49:26.766 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:26.766 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 84.713091133999995, 2024-09-12T22:49:26.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:49:26.767 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:26.767 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:26.767 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:26.767 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:26.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:26.767 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:26.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:26.767 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:26.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:26.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:49:26.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:49:26.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:26.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:49:26.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:49:26.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:26.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:49:26.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:49:26.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:49:26.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:49:26.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:26.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:49:26.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:49:26.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:26.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:49:26.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:49:26.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:26.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:49:26.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:49:26.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:26.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:49:26.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:49:26.771 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.771 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:26.771 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.771 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:49:26.771 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:26.771 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 81.592494324, 2024-09-12T22:49:26.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:49:26.771 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:26.772 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:26.772 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:49:26.772 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:26.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:26.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:26.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:26.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:26.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:26.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:26.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:49:26.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:26.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:49:26.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:49:26.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:26.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:49:26.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:49:26.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:49:26.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:49:26.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:26.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:49:26.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:49:26.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:26.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:49:26.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:49:26.775 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.775 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:26.775 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.775 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:26.775 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:26.775 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 81.589886144000005, 2024-09-12T22:49:26.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:49:26.775 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:26.775 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:26.776 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:26.776 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:26.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:26.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:26.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:26.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:26.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:26.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:49:26.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:49:26.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:26.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:49:26.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:49:26.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:26.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:49:26.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:49:26.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.778 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.778 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:49:26.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:49:26.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.778 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:26.778 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:49:26.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:49:26.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:26.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:49:26.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:49:26.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:26.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:49:26.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:49:26.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:26.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:49:26.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:49:26.780 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.780 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:26.780 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.780 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:26.780 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:26.780 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 81.588992920999999, 2024-09-12T22:49:26.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:49:26.780 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:26.780 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:26.780 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:26.780 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:26.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.781 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:26.781 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:26.781 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.781 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:26.781 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:26.781 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.781 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:26.782 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:49:26.782 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:49:26.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.782 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.782 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:26.782 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:49:26.782 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:49:26.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.782 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.782 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:26.782 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:49:26.782 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:49:26.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.783 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.783 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:49:26.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:49:26.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.783 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:26.783 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:49:26.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:49:26.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.783 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:26.783 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:49:26.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:49:26.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.784 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:26.784 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:49:26.784 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:49:26.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.784 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:26.784 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:49:26.784 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:49:26.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.784 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:26.785 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:49:26.785 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:49:26.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.785 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.785 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:26.785 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:49:26.785 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:49:26.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.785 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.785 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:26.785 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:49:26.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:49:26.786 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.786 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:26.786 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.786 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:26.786 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:26.786 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 81.588921263000003, 2024-09-12T22:49:26.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:49:26.786 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:26.786 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:26.787 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:26.787 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:26.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:26.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:26.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:26.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:26.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.788 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:26.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:49:26.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:49:26.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.788 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:26.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:49:26.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:49:26.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.788 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:26.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:49:26.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:49:26.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.789 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:49:26.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:49:26.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:26.789 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:49:26.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:49:26.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:26.790 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:49:26.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:49:26.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.790 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:26.790 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:49:26.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:49:26.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.790 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:26.790 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:49:26.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:49:26.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:26.791 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:49:26.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:49:26.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:26.791 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:49:26.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:49:26.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:26.791 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:49:26.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:49:26.792 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.792 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:26.792 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.792 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:26.792 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:26.792 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 81.588878545, 2024-09-12T22:49:26.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:49:26.792 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:26.792 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:26.792 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:26.793 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:26.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:26.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:26.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:26.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:26.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:26.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:49:26.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:49:26.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:26.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:49:26.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:49:26.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:26.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:49:26.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:49:26.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:49:26.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:49:26.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:26.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:49:26.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:49:26.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.796 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.796 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:26.796 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:49:26.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:49:26.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.796 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.796 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:26.796 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:49:26.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:49:26.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.796 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:26.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:49:26.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:49:26.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:26.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:49:26.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:49:26.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:26.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:49:26.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:49:26.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:26.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:49:26.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:49:26.798 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.798 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:26.798 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.798 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:26.798 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:26.798 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 81.588840628, 2024-09-12T22:49:26.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:49:26.799 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:26.799 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:26.799 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:26.799 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:26.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:26.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:26.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:26.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:26.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.800 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:26.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:49:26.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:49:26.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.800 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:26.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:49:26.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:49:26.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.800 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:26.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:49:26.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:49:26.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:49:26.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:49:26.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:26.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:49:26.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:49:26.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:26.802 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:49:26.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:49:26.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.802 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.802 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:26.802 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:26.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:49:26.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.802 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.802 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:26.802 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:49:26.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:49:26.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.803 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:26.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:49:26.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:49:26.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.803 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:26.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:49:26.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:49:26.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.803 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:26.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:49:26.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:49:26.804 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.804 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:26.804 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.804 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:26.804 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:26.804 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 81.588817176999996, 2024-09-12T22:49:26.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:49:26.804 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:26.804 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:26.804 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:26.805 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:26.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:26.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:26.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:26.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:26.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:26.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:49:26.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:49:26.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:26.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:49:26.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:49:26.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:26.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:49:26.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:49:26.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.807 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.807 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:49:26.807 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:49:26.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.807 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.807 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:26.807 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:49:26.807 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:49:26.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.807 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.807 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:26.807 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:49:26.807 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:49:26.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.808 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:26.808 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:26.808 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:49:26.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.808 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:26.808 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:49:26.808 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:49:26.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.808 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:26.808 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:49:26.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:49:26.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:26.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:49:26.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:49:26.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:26.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:49:26.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:49:26.809 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.809 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:26.810 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.810 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:26.810 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:26.810 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 81.588792940000005, 2024-09-12T22:49:26.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:49:26.810 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:26.810 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:26.810 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:26.810 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:26.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.810 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:26.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:26.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.811 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:26.811 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:26.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.811 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:26.812 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:26.812 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:49:26.812 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.812 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:26.812 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:49:26.812 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:49:26.812 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.812 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:26.812 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:49:26.812 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:49:26.812 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.813 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.813 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:49:26.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:49:26.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.813 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:26.813 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:49:26.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:49:26.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.813 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:26.813 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:49:26.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:49:26.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:26.814 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:49:26.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:49:26.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:26.814 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:49:26.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:49:26.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:26.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:49:26.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:49:26.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:26.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:49:26.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:49:26.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:26.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:49:26.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:49:26.816 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.816 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:26.816 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.816 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:26.816 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:26.816 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 81.588765022999993, 2024-09-12T22:49:26.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:49:26.816 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:26.816 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:26.816 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:26.816 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:26.817 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.817 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:26.817 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:26.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.817 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.817 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.817 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:26.817 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:26.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.817 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.817 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.817 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:26.817 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:26.818 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:49:26.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.818 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.818 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:26.818 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:49:26.818 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:49:26.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.818 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.818 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:26.818 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:49:26.818 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:49:26.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.818 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.819 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.819 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:49:26.819 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:49:26.819 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.819 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.819 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:26.819 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:49:26.819 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:49:26.819 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.819 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.819 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:26.819 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:49:26.819 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:49:26.819 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.820 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.820 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:26.820 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:49:26.820 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:49:26.820 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.820 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:26.820 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.820 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.820 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.820 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:26.820 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:26.820 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 81.588690528000001, 2024-09-12T22:49:26.820 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:49:26.821 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:26.821 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:26.821 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:26.821 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:26.821 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.821 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:26.821 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:26.821 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.821 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.821 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.821 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:26.821 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:26.822 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.822 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.822 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:26.822 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:49:26.822 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:49:26.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.822 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.822 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:26.822 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:49:26.822 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:49:26.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.822 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.822 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:26.823 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:49:26.823 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:49:26.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.823 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.823 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:49:26.823 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:49:26.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.823 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:26.823 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:49:26.823 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:49:26.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.824 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.824 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:26.824 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:49:26.824 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:49:26.824 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.824 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.824 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:26.824 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:49:26.824 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:49:26.824 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.824 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:26.824 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.824 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.824 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.825 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:26.825 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:26.825 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 81.588644500000001, 2024-09-12T22:49:26.825 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:49:26.825 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:26.825 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:26.825 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:26.825 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:26.825 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.825 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:26.825 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:26.825 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.825 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.826 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.826 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:26.826 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:26.826 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.826 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.826 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:26.826 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:49:26.826 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:49:26.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.826 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.826 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:26.826 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:49:26.827 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:49:26.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.827 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:26.827 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:49:26.827 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:49:26.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.827 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.827 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:49:26.827 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:49:26.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.827 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:26.828 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:49:26.828 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:49:26.828 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.828 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.828 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:26.828 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:49:26.828 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:49:26.828 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.828 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.828 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:26.828 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:49:26.828 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:49:26.828 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.828 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:26.829 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.829 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.829 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.829 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:26.829 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:26.829 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 81.586473616000006, 2024-09-12T22:49:26.829 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:49:26.829 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:26.829 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:26.829 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:26.829 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:26.829 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.829 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:26.830 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:26.830 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.830 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.830 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:26.830 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:26.830 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.830 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.830 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:26.830 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:26.830 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:49:26.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.831 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.831 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:26.831 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:49:26.831 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:49:26.831 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.831 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.831 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:26.831 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:49:26.831 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:49:26.831 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.831 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.831 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.831 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:26.831 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:49:26.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.832 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.832 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:26.832 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:49:26.832 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:49:26.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.832 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.832 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:26.832 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:26.832 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:49:26.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.832 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.832 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:26.833 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:49:26.833 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:49:26.833 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.833 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.833 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:26.833 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:49:26.833 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:49:26.833 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.833 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:26.833 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.833 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.833 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.833 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:26.834 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:26.834 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 81.586423166000003, 2024-09-12T22:49:26.834 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:49:26.834 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:26.834 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:26.834 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:26.834 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:26.834 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.834 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:26.834 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:26.834 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.834 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.834 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.834 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:26.835 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:26.835 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.835 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.835 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.835 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:26.835 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:49:26.835 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:49:26.835 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.835 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.835 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:26.835 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:49:26.835 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:49:26.835 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.835 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.836 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:26.836 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:49:26.836 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:49:26.836 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.836 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.836 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.836 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:49:26.836 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:49:26.836 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.836 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.836 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:26.836 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:49:26.837 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:49:26.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.837 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:26.837 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:49:26.837 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:49:26.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.837 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:26.837 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:49:26.837 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:49:26.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.838 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:26.838 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:49:26.838 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:49:26.838 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.838 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:26.838 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.838 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:26.838 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:26.838 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 81.586369727999994, 2024-09-12T22:49:26.838 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:49:26.838 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:26.839 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:26.839 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:26.839 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:26.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.839 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:26.839 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:26.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.839 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:26.839 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:26.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.840 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:26.840 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:26.840 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:49:26.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.840 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.840 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:26.840 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:49:26.840 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:49:26.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.840 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.840 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:26.840 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:26.840 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:49:26.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.841 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.841 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.841 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:49:26.841 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:49:26.841 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.841 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.841 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:26.841 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:49:26.841 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:49:26.841 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.841 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.841 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:26.841 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:49:26.842 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:49:26.842 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.842 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.842 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:26.842 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:49:26.842 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:49:26.842 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.842 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.842 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:26.842 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:49:26.842 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:49:26.842 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.842 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:26.843 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.843 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:49:26.843 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:26.843 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 81.582385375000001, 2024-09-12T22:49:26.843 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:49:26.843 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:26.843 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:26.843 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:26.843 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:26.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.843 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:26.844 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:26.844 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.844 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:26.844 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:26.844 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.844 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:26.844 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:49:26.845 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:49:26.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.845 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.845 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:26.845 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:49:26.845 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:49:26.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.845 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.845 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:26.845 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:49:26.845 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:49:26.846 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.848 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.848 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.848 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:49:26.848 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:49:26.848 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.848 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.848 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:26.848 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:49:26.848 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:49:26.848 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.849 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.849 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:26.849 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:49:26.849 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:49:26.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.849 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.849 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:26.849 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:49:26.849 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:49:26.849 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.849 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:26.849 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.850 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:49:26.850 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:26.850 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 79.597232836000003, 2024-09-12T22:49:26.850 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:49:26.850 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:26.850 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:26.850 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:26.850 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:26.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.850 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:26.850 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:26.850 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.851 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:26.851 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:26.851 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.851 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:26.851 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:49:26.851 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:49:26.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.852 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.852 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:26.852 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:49:26.852 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:49:26.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.852 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.852 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:26.852 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:49:26.852 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:49:26.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.852 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.852 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.853 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:49:26.853 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:49:26.853 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.853 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.853 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:26.853 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:49:26.853 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:49:26.853 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.853 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.853 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:26.853 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:49:26.853 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:49:26.854 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.854 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.854 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:26.854 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:49:26.854 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:49:26.854 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.854 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.854 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:26.854 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:49:26.854 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:49:26.854 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.854 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.854 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:26.854 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:49:26.855 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:49:26.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.855 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:26.855 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:49:26.855 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:49:26.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.855 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:26.855 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:49:26.855 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:49:26.855 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.855 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:26.856 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.856 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:49:26.856 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:26.856 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 61.595316591, 2024-09-12T22:49:26.856 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:49:26.856 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:26.856 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:26.856 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:26.856 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:26.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.857 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:26.857 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:26.857 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.857 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:26.857 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:26.857 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.857 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:26.857 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:49:26.857 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:49:26.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.858 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:26.858 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:49:26.858 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:49:26.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.858 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:26.858 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:49:26.858 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:49:26.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.858 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.858 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:49:26.859 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:49:26.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.859 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:26.859 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:49:26.859 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:49:26.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.859 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:26.859 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:49:26.859 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:49:26.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.859 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:26.860 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:49:26.860 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:49:26.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.860 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:26.860 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:49:26.860 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:49:26.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.860 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:26.860 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:49:26.860 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:49:26.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.861 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:26.861 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:49:26.861 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:49:26.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.861 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:26.861 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:49:26.861 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:49:26.861 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.861 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:26.861 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.862 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:49:26.862 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:26.862 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 56.594563215999997, 2024-09-12T22:49:26.862 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012160610000000001, 2024-09-12T22:49:26.862 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:26.862 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:26.862 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:26.862 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:26.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.862 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:26.862 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:26.862 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:26.863 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:26.863 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:26.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:26.863 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164967+0000", 2024-09-12T22:49:26.863 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:49:26.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:26.863 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164974+0000", 2024-09-12T22:49:26.864 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:49:26.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.864 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:26.864 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164987+0000", 2024-09-12T22:49:26.864 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3689000000000001e-05 2024-09-12T22:49:26.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.864 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:26.864 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164995+0000", 2024-09-12T22:49:26.864 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2959999999999999e-06 2024-09-12T22:49:26.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.865 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:26.865 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165068+0000", 2024-09-12T22:49:26.865 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2449999999999999e-05 2024-09-12T22:49:26.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.865 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.865 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:26.865 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165212+0000", 2024-09-12T22:49:26.865 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144117 2024-09-12T22:49:26.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.865 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.865 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:26.865 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166066+0000", 2024-09-12T22:49:26.865 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085441100000000002 2024-09-12T22:49:26.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.866 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:26.866 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166107+0000", 2024-09-12T22:49:26.866 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0450000000000001e-05 2024-09-12T22:49:26.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:26.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:26.866 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:26.866 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166181+0000", 2024-09-12T22:49:26.866 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-12T22:49:26.866 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.866 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:26.866 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.866 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:26.867 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:26.867 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:26.868 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:26.869 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:26.866+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:26.969 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:26.968+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:26.976 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:26.976 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:26.977 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:49:26.977 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:26.985 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:27.070 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:27.068+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:27.087 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:27.087 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:27.087 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:49:27.088 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:49:27.088 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:27.096 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:27.181 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:27.179+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:27.241 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:27.241 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:49:27.241 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:49:27.241 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:49:27.241 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.241 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:49:27.242 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:27.242 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 90.855288270000003, 2024-09-12T22:49:27.242 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:49:27.242 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:27.242 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:27.242 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:27.242 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:27.242 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.242 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:27.242 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:27.242 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.242 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.242 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.243 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:27.243 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:27.243 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.243 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.243 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.243 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:27.243 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:27.243 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:49:27.243 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.243 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.243 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:27.243 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:49:27.243 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:49:27.244 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.244 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.244 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:27.244 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:49:27.244 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:49:27.244 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.244 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.244 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:27.244 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:49:27.244 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:49:27.244 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.244 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.245 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:27.245 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:49:27.245 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:49:27.245 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.245 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.245 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:27.245 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:49:27.245 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:49:27.245 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.245 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.245 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:27.245 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:49:27.245 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:49:27.246 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.246 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.246 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:27.246 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:49:27.246 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:49:27.246 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.246 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:27.246 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.246 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.246 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.246 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:49:27.246 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:27.246 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 90.854845686999994, 2024-09-12T22:49:27.246 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:49:27.247 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:27.247 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:27.247 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:27.247 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:27.247 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.247 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:27.247 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:27.247 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.247 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.247 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.247 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:27.247 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:27.247 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.248 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.248 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.248 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:27.248 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:49:27.248 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:49:27.248 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.248 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.248 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:27.248 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:49:27.248 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:49:27.248 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.248 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.248 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:27.249 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:49:27.249 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:49:27.249 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.249 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.249 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:27.249 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:49:27.249 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:49:27.249 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.249 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.249 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:27.249 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:49:27.249 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:49:27.249 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.249 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.250 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:27.250 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:49:27.250 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:49:27.250 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.250 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.250 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:27.250 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:49:27.250 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:49:27.250 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.250 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.250 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:27.250 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:49:27.250 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:49:27.251 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.251 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:27.251 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.251 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.251 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.251 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:49:27.251 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:27.251 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 90.854479530000006, 2024-09-12T22:49:27.251 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:49:27.251 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:27.251 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:27.251 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:27.251 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:27.252 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.252 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:27.252 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:27.252 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.252 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.252 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.252 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:27.252 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:27.252 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.252 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.252 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.252 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:27.252 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:49:27.253 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:49:27.253 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.253 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.253 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:27.253 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:49:27.253 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:49:27.253 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.253 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.253 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:27.253 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:49:27.253 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:49:27.254 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.254 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.254 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:27.254 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:49:27.254 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:49:27.254 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.254 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.254 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:27.254 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:49:27.254 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:49:27.254 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.254 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.254 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:27.255 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:49:27.255 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:49:27.255 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.255 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.255 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:27.255 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:49:27.255 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:49:27.255 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.255 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.255 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:27.255 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:49:27.255 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:49:27.255 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.255 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:27.256 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.256 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.256 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.256 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:49:27.256 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:27.256 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 90.854067217999997, 2024-09-12T22:49:27.256 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:49:27.256 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:27.256 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:27.256 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:27.256 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:27.257 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.257 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:27.257 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:27.257 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.257 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.257 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.257 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:27.257 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:27.257 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.257 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.257 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.257 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:27.258 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:27.258 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:49:27.258 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.258 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.258 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:27.258 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:49:27.258 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:49:27.258 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.258 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.258 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:27.258 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:49:27.258 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:49:27.258 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.258 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.259 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:27.259 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:49:27.259 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:49:27.259 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.259 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.259 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:27.259 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:49:27.259 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:49:27.259 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.259 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.259 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:27.259 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:49:27.259 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:49:27.260 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.260 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.260 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:27.260 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:49:27.260 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:49:27.260 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.260 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.260 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:27.260 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:49:27.260 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:49:27.261 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.261 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:27.261 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.261 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.261 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.261 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:49:27.262 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:27.262 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 90.720217124000001, 2024-09-12T22:49:27.262 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:49:27.262 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:27.262 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:27.262 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:27.263 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:27.263 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.263 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:27.263 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:27.263 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.263 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.263 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.264 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:27.264 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:27.264 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.264 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.264 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.264 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:27.264 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:27.265 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:49:27.265 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.265 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.265 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:27.265 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:49:27.265 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:49:27.265 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.265 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.266 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:27.266 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:49:27.266 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:49:27.266 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.266 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.266 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:27.267 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:49:27.267 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:49:27.267 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.267 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.267 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:27.267 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:49:27.268 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:49:27.268 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.268 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.268 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:27.268 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:49:27.268 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:49:27.269 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.269 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.269 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:27.269 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:49:27.269 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:49:27.269 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.269 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.269 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:27.269 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:49:27.270 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:49:27.270 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.270 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:27.270 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.270 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.270 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.270 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:27.270 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:27.270 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 82.074981570000006, 2024-09-12T22:49:27.270 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:49:27.270 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:27.270 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:27.270 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:27.271 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:27.271 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.271 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:27.271 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:27.271 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.271 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.271 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:27.271 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:27.272 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.272 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.272 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.272 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:27.272 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:49:27.272 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:49:27.272 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.273 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.273 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:27.273 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:49:27.273 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:49:27.273 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.273 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.273 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:27.274 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:49:27.274 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:49:27.274 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.274 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.274 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:27.274 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:49:27.275 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:49:27.275 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.275 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.275 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:27.275 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:27.275 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:49:27.275 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.276 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.276 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:27.276 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:27.276 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:49:27.276 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.276 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.276 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:27.277 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:49:27.277 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:49:27.277 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.277 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.277 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:27.277 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:49:27.277 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:49:27.278 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.278 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.278 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:27.278 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:49:27.278 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:49:27.278 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.279 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.279 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:27.279 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:49:27.279 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:49:27.279 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.279 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.279 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:27.279 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:49:27.279 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:49:27.279 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.280 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.280 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:27.280 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:49:27.280 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:49:27.280 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.280 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.280 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:27.280 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:49:27.280 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:49:27.280 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.281 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:27.281 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.281 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.281 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.281 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:27.281 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:27.281 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 82.074882052999996, 2024-09-12T22:49:27.281 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:49:27.281 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:27.281 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:27.282 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:27.282 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:27.282 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.282 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:27.282 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:27.282 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.282 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.282 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.282 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:27.283 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:27.283 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.283 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.283 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.283 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:27.283 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:49:27.283 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:49:27.283 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.283 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.283 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:27.283 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:49:27.283 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:49:27.283 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.284 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.284 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:27.284 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:49:27.284 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:49:27.284 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.284 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.284 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:27.284 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:49:27.284 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:49:27.284 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.284 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.284 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:27.284 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:49:27.285 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:49:27.285 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.285 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.285 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:27.285 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:49:27.285 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:49:27.285 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.285 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.285 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:27.285 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:49:27.285 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:49:27.285 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.286 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.286 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:27.286 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:49:27.286 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:49:27.286 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.286 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.286 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:27.286 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:49:27.286 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:49:27.286 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.286 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.287 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:27.287 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:49:27.287 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:49:27.287 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.287 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.287 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:27.287 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:49:27.287 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:49:27.287 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.287 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.288 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:27.288 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:49:27.288 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:49:27.288 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.288 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.288 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:27.288 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:49:27.289 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:49:27.289 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.289 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:27.289 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.289 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.289 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.290 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:27.290 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:27.290 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 82.074837314000007, 2024-09-12T22:49:27.290 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:49:27.290 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:27.290 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:27.291 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:27.291 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:27.291 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.291 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:27.291 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:27.291 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.291 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.292 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.292 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:27.292 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:27.292 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.292 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.292 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.292 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:27.293 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:49:27.293 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:49:27.293 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.293 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.293 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:27.293 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:27.294 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:49:27.294 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.294 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.294 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:27.294 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:27.294 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:49:27.295 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.295 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.295 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:27.295 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:49:27.295 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:49:27.295 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.296 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.296 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:27.296 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:49:27.296 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:49:27.296 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.296 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.296 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:27.296 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:49:27.297 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:49:27.297 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.297 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.297 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:27.297 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:49:27.297 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:49:27.297 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.297 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.297 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:27.298 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:49:27.298 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:49:27.298 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.298 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.298 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:27.298 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:49:27.298 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:49:27.298 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.299 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.299 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:27.299 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:49:27.299 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:49:27.299 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.299 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.299 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:27.299 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:49:27.299 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:49:27.300 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.300 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.300 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:27.300 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:49:27.300 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:49:27.300 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.300 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.300 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:27.301 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:49:27.301 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:49:27.301 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.301 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:27.301 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.301 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.301 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.301 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:27.302 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:27.302 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 82.074609613000007, 2024-09-12T22:49:27.302 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:49:27.302 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:27.302 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:27.302 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:27.302 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:27.303 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.303 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:27.303 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:27.303 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.303 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.303 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.303 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:27.303 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:27.304 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.304 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.304 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.304 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:27.304 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:49:27.304 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:49:27.304 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.304 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.305 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:27.305 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:49:27.305 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:49:27.305 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.305 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.305 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:27.305 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:49:27.305 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:49:27.306 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.306 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.306 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:27.306 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:49:27.306 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:49:27.306 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.306 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.306 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:27.307 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:49:27.307 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:49:27.307 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.307 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.307 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:27.307 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:49:27.307 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:49:27.307 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.307 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.308 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:27.308 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:49:27.308 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:49:27.308 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.308 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.308 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:27.308 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:49:27.308 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:49:27.308 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.308 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.308 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:27.308 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:49:27.308 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:49:27.309 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.309 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.309 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:27.309 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:49:27.309 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:49:27.309 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.309 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.309 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:27.309 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:49:27.309 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:49:27.309 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.309 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.310 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:27.310 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:49:27.310 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:49:27.310 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.310 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.310 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:27.310 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:49:27.310 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:49:27.310 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.310 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:27.310 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.310 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.310 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.311 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:27.311 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:27.311 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 82.074444505000002, 2024-09-12T22:49:27.311 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:49:27.311 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:27.311 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:27.311 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:27.311 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:27.311 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.311 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:27.311 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:27.311 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.312 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.312 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.312 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:27.312 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:27.312 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.312 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.312 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.312 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:27.312 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:49:27.312 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:49:27.312 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.312 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.313 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:27.313 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:49:27.313 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:49:27.313 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.313 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.313 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:27.313 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:49:27.313 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:49:27.313 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.313 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.313 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:27.313 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:49:27.313 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:49:27.314 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.314 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.314 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:27.314 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:49:27.314 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:49:27.314 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.314 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.314 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:27.314 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:49:27.314 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:49:27.314 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.315 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.315 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:27.315 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:49:27.315 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:49:27.315 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.315 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.315 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:27.315 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:49:27.315 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:49:27.315 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.315 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.316 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:27.316 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:49:27.316 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:49:27.316 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.316 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.316 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:27.316 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:49:27.316 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:49:27.316 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.316 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.316 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:27.316 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:49:27.316 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:49:27.317 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.317 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.317 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:27.317 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:49:27.317 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:49:27.317 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.317 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.317 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:27.317 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:49:27.317 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:49:27.317 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.317 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:27.317 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.317 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.318 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.318 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:27.318 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:27.318 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 82.074383220000001, 2024-09-12T22:49:27.318 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:49:27.318 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:27.318 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:27.318 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:27.318 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:27.318 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.318 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:27.318 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:27.318 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.318 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.319 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.319 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:27.319 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:27.319 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.319 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.319 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.319 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:27.319 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:27.319 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:49:27.319 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.319 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.319 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:27.319 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:49:27.320 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:49:27.320 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.320 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.320 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:27.320 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:49:27.320 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:49:27.320 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.320 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.320 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:27.320 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:49:27.320 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:49:27.320 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.320 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.321 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:27.321 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:49:27.321 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:49:27.321 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.321 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.321 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:27.321 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:49:27.321 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:49:27.321 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.321 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.321 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:27.321 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:49:27.321 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:49:27.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.322 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.322 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:27.322 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:49:27.322 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:49:27.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.322 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.322 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:27.322 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:49:27.322 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:49:27.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.322 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.322 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:27.322 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:49:27.323 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:49:27.323 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.323 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.323 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:27.323 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:49:27.323 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:49:27.323 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.323 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.323 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:27.323 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:49:27.323 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:49:27.323 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.323 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.323 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:27.324 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:49:27.324 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:49:27.324 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.324 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:27.324 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.324 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.324 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.324 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:27.324 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:27.324 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 82.074303111999996, 2024-09-12T22:49:27.324 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:49:27.324 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:27.325 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:27.325 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:27.325 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:27.325 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.325 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:27.325 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:27.325 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.325 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.325 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.325 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:27.325 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:27.325 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.325 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.325 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.326 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:27.326 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:49:27.326 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:49:27.326 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.326 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.326 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:27.326 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:49:27.326 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:49:27.326 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.326 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.326 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:27.326 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:49:27.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:49:27.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:27.327 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:49:27.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:49:27.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:27.327 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:49:27.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:49:27.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.328 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:27.328 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:49:27.328 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:49:27.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.328 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:27.328 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:49:27.328 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:49:27.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.328 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:27.329 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:49:27.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:49:27.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.329 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:27.329 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:49:27.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:49:27.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.329 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:27.329 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:49:27.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:49:27.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.330 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.330 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:27.330 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:49:27.330 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:49:27.330 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.330 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.330 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:27.330 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:49:27.330 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:49:27.330 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.330 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.330 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:27.330 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:49:27.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:49:27.331 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.331 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:27.331 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.331 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.331 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.331 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:27.331 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:27.331 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 82.074254159000006, 2024-09-12T22:49:27.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:49:27.331 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:27.331 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:27.332 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:27.332 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:27.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:27.332 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:27.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:27.332 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:27.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.333 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:27.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:27.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:49:27.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.333 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:27.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:49:27.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:49:27.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.333 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:27.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:49:27.334 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:49:27.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.334 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:27.334 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:49:27.334 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:49:27.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.334 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:27.334 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:49:27.334 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:49:27.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.335 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:27.335 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:49:27.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:49:27.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.335 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:27.335 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:49:27.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:49:27.335 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.335 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:27.335 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.336 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:27.336 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:27.336 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 82.074205058999993, 2024-09-12T22:49:27.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:49:27.336 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:27.336 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:27.336 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:27.336 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:27.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.336 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:27.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:27.337 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.337 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:27.337 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:27.337 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.337 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:27.337 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:49:27.337 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:49:27.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.338 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:27.338 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:49:27.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:49:27.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.338 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:27.338 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:49:27.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:49:27.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.338 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:27.338 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:49:27.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:49:27.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.339 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.339 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:27.339 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:49:27.339 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:49:27.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.339 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.339 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:27.339 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:49:27.339 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:49:27.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.339 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:27.340 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:49:27.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:49:27.340 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.340 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:27.340 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.340 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:27.340 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:27.340 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 82.067264609000006, 2024-09-12T22:49:27.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:49:27.340 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:27.341 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:27.341 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:27.341 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:27.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.341 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:27.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:27.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.341 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:27.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:27.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.342 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:27.342 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:49:27.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:49:27.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.342 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:27.342 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:49:27.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:49:27.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.342 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:27.342 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:49:27.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:49:27.343 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.343 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.343 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:27.343 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:49:27.343 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:49:27.343 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.343 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.343 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:27.343 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:49:27.343 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:49:27.343 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.343 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.343 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:27.343 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:49:27.344 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:49:27.344 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.344 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.344 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:27.344 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:49:27.344 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:49:27.344 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.344 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.344 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:27.344 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:49:27.344 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:49:27.344 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.344 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:27.345 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.345 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.345 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:27.345 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:27.345 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 82.066175768999997, 2024-09-12T22:49:27.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:49:27.345 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:27.345 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:27.345 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:27.345 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:27.345 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.345 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:27.345 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:27.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.346 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:27.346 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:27.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.346 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:27.346 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:49:27.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:49:27.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.347 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:27.347 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:49:27.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:49:27.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.347 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.347 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:27.347 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:49:27.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:49:27.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.347 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.347 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:27.347 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:49:27.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:49:27.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.348 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:27.348 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:49:27.348 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:49:27.348 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.348 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:27.348 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:49:27.348 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:49:27.348 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.348 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:27.348 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:49:27.349 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:49:27.349 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.349 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.349 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:27.349 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:49:27.349 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:49:27.349 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.349 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:27.349 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.349 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.349 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.349 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:27.350 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:27.350 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 82.066126158000003, 2024-09-12T22:49:27.350 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:49:27.350 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:27.350 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:27.350 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:27.350 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:27.350 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.350 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:27.350 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:27.350 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.350 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.350 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.351 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:27.351 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:27.351 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.351 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.351 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.351 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:27.351 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:27.351 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:49:27.351 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.351 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.351 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:27.351 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:27.351 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:49:27.352 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.352 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.352 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:27.352 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:49:27.352 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:49:27.352 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.352 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.352 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:27.352 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:49:27.352 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:49:27.352 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.352 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.352 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:27.353 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:49:27.353 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:49:27.353 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.353 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.353 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:27.353 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:49:27.353 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:49:27.353 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.353 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.353 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:27.354 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:49:27.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:49:27.354 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.354 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:27.354 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:49:27.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:49:27.354 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.354 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:27.354 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.354 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.354 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:27.355 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:27.355 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 82.066058849000001, 2024-09-12T22:49:27.355 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:49:27.355 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:27.355 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:27.355 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:27.355 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:27.355 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.355 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:27.355 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:27.355 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.355 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.355 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.356 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:27.356 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:27.356 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.356 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.356 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.356 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:27.356 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:27.356 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:49:27.356 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.356 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.356 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:27.356 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:49:27.356 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:49:27.357 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:27.357 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:49:27.357 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:49:27.357 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:27.357 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:49:27.357 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:49:27.357 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:27.358 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:49:27.358 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:49:27.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.358 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.358 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:27.358 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:49:27.358 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:49:27.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.358 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.358 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:27.358 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:49:27.358 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:49:27.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.359 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.359 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:27.359 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:49:27.359 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:49:27.359 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.359 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:27.359 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.359 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.359 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.359 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:27.359 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:27.359 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 82.065490929999996, 2024-09-12T22:49:27.360 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:49:27.360 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:27.360 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:27.360 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:27.360 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:27.360 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.360 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:27.360 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:27.360 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.360 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.360 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.360 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:27.361 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:27.361 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.361 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.361 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:27.361 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:27.361 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:49:27.361 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.361 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:27.361 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:49:27.362 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:49:27.362 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.362 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.362 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:27.362 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:49:27.362 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:49:27.362 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.362 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.362 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:27.362 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:49:27.362 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:49:27.362 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.363 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.363 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:27.363 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:49:27.363 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:49:27.363 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.363 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.363 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:27.363 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:49:27.363 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:49:27.363 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.363 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.363 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:27.363 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:49:27.364 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:49:27.364 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.364 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.364 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:27.364 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:49:27.364 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:49:27.364 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.364 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:27.364 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.364 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.364 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.364 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:49:27.364 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:27.364 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 82.065113326000002, 2024-09-12T22:49:27.365 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:49:27.365 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:27.365 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:27.365 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:27.365 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:27.365 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.365 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:27.365 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:27.365 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.365 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.365 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.365 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:27.365 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:27.366 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:27.366 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.366 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.366 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:27.366 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:49:27.366 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:49:27.366 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.366 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.366 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:27.366 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:49:27.366 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:49:27.366 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.366 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.367 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:27.367 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:49:27.367 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:49:27.367 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.367 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.367 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:27.367 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:49:27.367 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:49:27.367 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.367 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.367 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:27.367 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:49:27.367 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:49:27.368 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.368 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.368 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:27.368 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:49:27.368 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:49:27.368 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.368 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.368 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:27.368 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:49:27.368 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:49:27.368 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:27.369 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:27.369 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:27.369 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:49:27.369 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:49:27.369 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.369 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:27.369 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.369 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:27.369 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:27.369 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:27.371 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:27.371 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:27.368+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:27.452 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:49:27.471 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:27.469+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:27.477 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:27.477 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:27.477 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:49:27.477 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:27.486 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:27.551 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:49:27.571 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:27.570+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:27.588 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:27.589 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:27.589 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:49:27.589 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:49:27.589 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:27.592 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:49:27.592 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:49:27.597 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:27.610 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:49:27.611 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:49:27.611 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:49:27.614 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:49:27.614 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:49:27.673 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:27.671+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:27.700 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:27.700 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:27.709 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:27.773 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:27.772+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:27.813 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:27.814 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:27.822 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:27.874 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:27.872+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:27.924 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:27.925 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:27.933 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:27.975 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:27.974+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:28.076 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:28.075+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:28.076 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:28.077 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:28.085 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:28.178 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:28.176+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:28.189 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:28.190 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:28.198 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:28.283 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:28.282+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:28.341 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:28.342 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:28.350 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:28.380 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:28.378+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:28.480 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:28.479+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:28.492 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:28.493 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:28.501 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:28.556 INFO:teuthology.orchestra.run.smithi066.stderr:noscrub is unset 2024-09-12T22:49:28.581 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:28.580+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:28.605 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:28.605 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:28.615 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:28.682 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:28.680+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:28.718 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:28.718 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:28.726 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:28.811 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:28.809+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:28.868 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:28.869 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:28.877 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:28.922 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:28.921+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:28.982 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:28.982 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:28.985 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:28.984+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:28.990 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:29.086 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:29.085+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:29.132 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:29.132 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:29.142 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:29.187 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:29.186+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:29.243 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:29.244 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:29.252 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:29.296 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:29.294+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:29.357 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:29.357 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:29.366 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:29.407 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:29.406+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:29.490 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:29.488+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:29.509 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:29.509 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:29.518 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:29.602 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:29.601+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:29.615 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:49:29.661 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:29.662 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:29.670 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:29.711 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:29.710+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:29.754 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:49:29.754 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:49:29.772 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:49:29.772 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:49:29.772 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:49:29.775 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:49:29.775 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:49:29.776 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:29.776 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:29.776 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:49:29.776 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:29.784 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:29.792 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:29.791+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:29.886 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:29.886 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:29.886 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:49:29.886 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:49:29.886 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:29.893 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:29.893+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:29.894 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:29.994 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:29.993+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:30.039 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:30.039 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:49:30.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:49:30.039 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:49:30.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.039 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:49:30.040 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:30.040 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 89.991057306000002, 2024-09-12T22:49:30.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:49:30.040 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:30.040 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:30.040 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:30.040 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:30.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.041 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:30.041 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:30.041 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.042 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:30.042 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:30.042 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.042 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.042 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:30.042 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:30.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:49:30.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.043 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:30.043 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:49:30.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:49:30.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:30.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:49:30.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:49:30.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:49:30.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:49:30.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:30.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:49:30.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:49:30.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:30.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:49:30.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:49:30.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:30.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:49:30.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:49:30.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:30.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:49:30.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:49:30.048 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.048 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:30.048 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.048 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:49:30.048 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:30.048 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 87.990676578999995, 2024-09-12T22:49:30.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:49:30.049 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:30.049 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:30.049 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:30.049 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:30.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:30.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:30.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:30.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:30.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:30.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:49:30.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:49:30.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:30.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:49:30.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:49:30.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:30.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:49:30.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:49:30.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:49:30.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:49:30.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:30.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:49:30.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:49:30.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:30.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:49:30.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:49:30.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:30.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:49:30.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:49:30.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:30.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:49:30.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:49:30.052 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.052 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:30.052 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.053 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:49:30.053 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:30.053 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 84.870079769, 2024-09-12T22:49:30.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:49:30.053 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:30.053 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:30.053 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:49:30.053 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:30.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:30.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:30.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:30.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:30.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:30.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:30.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:49:30.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:30.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:49:30.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:49:30.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:30.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:49:30.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:49:30.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:49:30.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:49:30.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:30.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:49:30.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:49:30.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:30.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:49:30.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:49:30.057 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.057 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:30.057 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.057 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:30.057 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:30.057 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 84.867471589000004, 2024-09-12T22:49:30.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:49:30.057 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:30.057 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:30.058 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:30.058 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:30.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:30.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:30.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:30.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:30.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:30.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:49:30.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:49:30.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:30.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:49:30.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:49:30.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:30.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:49:30.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:49:30.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:49:30.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:49:30.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:30.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:49:30.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:49:30.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:30.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:49:30.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:49:30.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:30.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:49:30.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:49:30.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:30.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:49:30.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:49:30.061 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.061 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:30.061 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.062 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:30.062 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:30.062 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 84.866578365999999, 2024-09-12T22:49:30.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:49:30.062 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:30.062 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:30.062 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:30.062 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:30.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:30.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:30.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:30.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:30.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:30.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:49:30.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:49:30.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:30.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:49:30.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:49:30.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:30.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:49:30.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:49:30.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:49:30.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:49:30.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:30.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:49:30.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:49:30.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:30.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:49:30.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:49:30.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:30.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:49:30.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:49:30.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:30.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:49:30.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:49:30.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:30.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:49:30.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:49:30.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:30.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:49:30.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:49:30.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:30.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:49:30.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:49:30.068 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.069 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:30.069 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.069 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:30.069 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:30.069 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 84.866506708000003, 2024-09-12T22:49:30.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:49:30.069 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:30.069 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:30.069 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:30.069 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:30.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:30.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:30.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:30.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:30.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:30.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:49:30.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:49:30.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:30.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:49:30.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:49:30.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:30.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:49:30.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:49:30.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:49:30.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:49:30.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:30.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:49:30.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:49:30.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:30.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:49:30.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:49:30.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:30.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:49:30.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:49:30.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:30.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:49:30.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:49:30.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:30.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:49:30.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:49:30.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:30.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:49:30.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:49:30.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:30.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:49:30.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:49:30.075 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.075 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:30.075 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.075 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:30.075 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:30.076 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 84.86646399, 2024-09-12T22:49:30.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:49:30.076 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:30.076 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:30.076 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:30.076 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:30.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:30.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:30.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:30.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:30.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:30.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:49:30.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:49:30.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:30.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:49:30.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:49:30.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:30.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:49:30.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:49:30.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:49:30.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:49:30.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:30.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:49:30.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:49:30.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:30.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:49:30.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:49:30.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:30.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:49:30.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:49:30.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:30.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:49:30.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:49:30.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:30.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:49:30.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:49:30.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:30.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:49:30.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:49:30.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:30.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:49:30.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:49:30.081 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.082 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:30.082 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.082 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:30.082 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:30.082 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 84.866426073, 2024-09-12T22:49:30.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:49:30.082 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:30.082 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:30.083 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:30.083 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:30.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:30.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:30.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:30.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:30.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:30.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:49:30.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:49:30.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:30.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:49:30.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:49:30.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:30.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:49:30.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:49:30.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:49:30.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:49:30.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:30.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:49:30.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:49:30.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:30.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:49:30.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:49:30.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:30.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:30.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:49:30.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:30.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:49:30.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:49:30.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:30.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:49:30.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:49:30.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:30.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:49:30.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:49:30.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:30.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:49:30.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:49:30.088 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.088 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:30.088 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.088 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:30.088 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:30.088 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 84.866402621999995, 2024-09-12T22:49:30.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:49:30.089 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:30.089 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:30.089 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:30.089 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:30.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:30.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:30.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:30.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:30.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:30.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:49:30.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:49:30.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:30.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:49:30.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:49:30.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:30.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:49:30.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:49:30.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:49:30.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:49:30.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:30.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:49:30.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:49:30.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:30.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:49:30.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:49:30.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:30.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:30.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:49:30.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:30.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:49:30.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:49:30.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:30.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:49:30.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:49:30.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:30.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:49:30.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:49:30.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:30.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:49:30.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:49:30.094 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.094 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:30.094 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.094 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:30.094 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:30.094 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 84.866378385000004, 2024-09-12T22:49:30.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:49:30.094 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:30.094 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:30.095 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:30.095 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:30.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:30.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:30.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:30.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:30.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:30.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:30.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:49:30.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:30.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:49:30.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:49:30.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:30.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:49:30.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:49:30.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:49:30.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:49:30.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:30.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:49:30.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:49:30.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:30.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:49:30.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:49:30.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:30.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:49:30.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:49:30.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:30.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:49:30.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:49:30.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:30.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:49:30.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:49:30.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:30.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:49:30.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:49:30.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:30.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:49:30.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:49:30.100 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.100 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:30.100 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.100 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:30.100 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:30.101 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 84.866350467999993, 2024-09-12T22:49:30.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:49:30.101 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:30.101 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:30.101 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:30.101 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:30.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:30.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:30.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:30.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:30.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:30.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:30.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:49:30.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:30.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:49:30.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:49:30.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:30.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:49:30.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:49:30.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:49:30.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:49:30.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:30.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:49:30.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:49:30.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:30.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:49:30.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:49:30.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:30.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:49:30.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:49:30.104 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.104 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:30.104 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.105 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:30.105 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:30.105 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 84.866275973, 2024-09-12T22:49:30.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:49:30.105 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:30.105 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:30.105 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:30.105 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:30.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:30.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:30.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:30.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:30.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:30.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:49:30.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:49:30.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:30.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:49:30.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:49:30.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:30.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:49:30.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:49:30.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:49:30.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:49:30.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:30.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:49:30.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:49:30.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:30.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:49:30.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:49:30.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:30.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:49:30.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:49:30.109 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.110 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:30.110 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.110 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:30.110 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:30.110 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 84.866229945000001, 2024-09-12T22:49:30.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:49:30.111 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:30.111 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:30.111 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:30.111 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:30.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:30.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:30.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:30.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:30.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:30.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:49:30.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:49:30.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:30.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:49:30.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:49:30.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:30.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:49:30.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:49:30.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:49:30.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:49:30.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:30.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:49:30.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:49:30.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:30.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:49:30.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:49:30.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:30.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:49:30.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:49:30.116 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.116 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:30.117 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.117 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:30.117 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:30.117 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 84.864059061000006, 2024-09-12T22:49:30.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:49:30.117 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:30.118 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:30.118 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:30.118 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:30.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:30.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:30.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:30.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:30.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:30.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:30.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:49:30.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:30.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:49:30.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:49:30.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:30.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:49:30.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:49:30.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:30.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:49:30.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:30.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:49:30.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:49:30.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:30.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:30.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:49:30.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:30.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:49:30.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:49:30.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:30.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:49:30.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:49:30.123 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.123 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:30.123 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.123 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:30.124 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:30.124 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 84.864008611000003, 2024-09-12T22:49:30.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:49:30.124 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:30.124 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:30.124 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:30.124 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:30.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:30.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:30.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:30.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:30.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:30.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:49:30.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:49:30.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:30.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:49:30.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:49:30.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:30.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:49:30.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:49:30.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:49:30.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:49:30.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:30.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:49:30.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:49:30.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:30.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:49:30.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:49:30.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:30.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:49:30.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:49:30.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:30.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:49:30.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:49:30.128 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.128 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:30.128 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.128 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:30.128 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:30.128 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 84.863955172999994, 2024-09-12T22:49:30.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:49:30.128 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:30.129 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:30.129 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:30.129 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:30.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:30.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:30.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:30.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:30.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:30.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:30.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:49:30.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:30.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:49:30.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:49:30.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:30.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:30.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:49:30.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:49:30.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:49:30.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:30.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:49:30.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:49:30.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:30.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:49:30.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:49:30.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:30.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:49:30.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:49:30.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:30.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:49:30.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:49:30.135 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.135 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:30.136 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.136 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:49:30.136 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:30.136 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 84.859970820000001, 2024-09-12T22:49:30.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:49:30.136 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:30.136 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:30.136 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:30.137 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:30.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:30.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:30.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:30.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:30.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:30.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:49:30.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:49:30.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:30.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:49:30.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:49:30.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:30.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:49:30.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:49:30.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:49:30.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:49:30.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:30.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:49:30.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:49:30.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:30.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:49:30.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:49:30.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:30.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:49:30.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:49:30.140 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.140 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:30.140 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.140 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:49:30.140 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:30.140 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 82.874818281000003, 2024-09-12T22:49:30.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:49:30.141 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:30.141 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:30.141 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:30.141 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:30.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:30.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:30.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:30.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:30.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:30.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:49:30.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:49:30.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:30.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:49:30.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:49:30.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:30.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:49:30.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:49:30.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:49:30.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:49:30.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:30.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:49:30.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:49:30.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:30.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:49:30.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:49:30.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:30.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:49:30.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:49:30.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:30.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:49:30.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:49:30.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:30.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:49:30.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:49:30.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:30.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:49:30.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:49:30.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:30.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:49:30.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:49:30.145 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.145 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:30.146 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.146 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:49:30.146 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:30.146 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.872902035999999, 2024-09-12T22:49:30.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:49:30.146 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:30.146 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:30.146 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:30.146 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:30.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:30.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:30.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:30.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:30.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:30.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:49:30.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:49:30.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:30.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:49:30.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:49:30.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:30.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:49:30.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:49:30.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:49:30.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:49:30.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:30.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:49:30.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:49:30.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:30.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:49:30.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:49:30.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:30.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:49:30.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:49:30.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:30.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:49:30.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:49:30.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:30.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:49:30.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:49:30.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:30.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:49:30.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:49:30.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:30.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:49:30.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:49:30.151 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.151 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:30.151 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.152 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:49:30.152 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:30.152 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.872148660999997, 2024-09-12T22:49:30.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012160610000000001, 2024-09-12T22:49:30.152 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:30.152 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:30.152 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:30.152 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:30.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:30.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:30.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:30.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:30.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:30.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:30.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164967+0000", 2024-09-12T22:49:30.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:49:30.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:30.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164974+0000", 2024-09-12T22:49:30.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:49:30.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:30.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164987+0000", 2024-09-12T22:49:30.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3689000000000001e-05 2024-09-12T22:49:30.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164995+0000", 2024-09-12T22:49:30.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2959999999999999e-06 2024-09-12T22:49:30.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:30.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165068+0000", 2024-09-12T22:49:30.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2449999999999999e-05 2024-09-12T22:49:30.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:30.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165212+0000", 2024-09-12T22:49:30.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144117 2024-09-12T22:49:30.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:30.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166066+0000", 2024-09-12T22:49:30.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085441100000000002 2024-09-12T22:49:30.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:30.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166107+0000", 2024-09-12T22:49:30.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0450000000000001e-05 2024-09-12T22:49:30.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:30.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:30.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:30.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166181+0000", 2024-09-12T22:49:30.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-12T22:49:30.156 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.156 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:30.156 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.156 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:30.156 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:30.156 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:30.158 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:30.157+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:30.158 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:30.259 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:30.257+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:30.261 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:30.262 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:30.262 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:49:30.262 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:30.270 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:30.361 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:30.360+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:30.413 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:30.413 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:30.413 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:49:30.413 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:49:30.414 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:30.422 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:30.461 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~59s 2024-09-12T22:49:30.462 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:30.461+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:30.525 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:30.526 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:49:30.526 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:49:30.526 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:49:30.526 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.526 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:49:30.526 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:30.526 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 94.139658847999996, 2024-09-12T22:49:30.526 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:49:30.526 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:30.526 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:30.527 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:30.527 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:30.527 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.527 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:30.527 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:30.527 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.527 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.527 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.527 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:30.527 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:30.527 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.527 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.528 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.528 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:30.528 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:30.528 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:49:30.528 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.528 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.528 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:30.528 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:49:30.528 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:49:30.528 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.528 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.528 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:30.529 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:49:30.529 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:49:30.529 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.529 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.529 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.529 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:49:30.529 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:49:30.529 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.529 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.529 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:30.529 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:49:30.529 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:49:30.530 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.530 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.530 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:30.530 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:49:30.530 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:49:30.530 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.530 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.530 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:30.530 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:49:30.530 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:49:30.530 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.530 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.530 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:30.530 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:49:30.531 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:49:30.531 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.531 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:30.531 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.531 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.531 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.531 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:49:30.531 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:30.531 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 94.139216265000002, 2024-09-12T22:49:30.531 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:49:30.531 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:30.531 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:30.531 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:30.531 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:30.532 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.532 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:30.532 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:30.532 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.532 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.532 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.532 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:30.532 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:30.532 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.532 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.532 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.532 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:30.532 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:49:30.533 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:49:30.533 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.533 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.533 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:30.533 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:49:30.533 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:49:30.533 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.533 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.533 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:30.533 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:49:30.533 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:49:30.533 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.533 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.533 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.534 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:49:30.534 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:49:30.534 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.534 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.534 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:30.534 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:49:30.534 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:49:30.534 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.534 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.534 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:30.534 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:49:30.534 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:49:30.534 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.535 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.535 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:30.535 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:49:30.535 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:49:30.535 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.535 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.535 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:30.535 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:49:30.535 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:49:30.535 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.535 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:30.535 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.535 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.536 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.536 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:49:30.536 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:30.536 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 94.138850108, 2024-09-12T22:49:30.536 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:49:30.536 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:30.536 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:30.536 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:30.536 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:30.536 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.536 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:30.536 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:30.536 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.537 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.537 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.537 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:30.537 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:30.537 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.537 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.537 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.537 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:30.537 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:49:30.537 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:49:30.537 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.537 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.540 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:30.540 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:49:30.540 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:49:30.540 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.540 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.540 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:30.540 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:49:30.540 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:49:30.540 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.541 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.541 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.541 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:49:30.541 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:49:30.541 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.541 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.541 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:30.541 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:49:30.541 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:49:30.541 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.541 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.541 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:30.542 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:49:30.542 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:49:30.542 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.542 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.542 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:30.542 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:49:30.542 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:49:30.542 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.542 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.542 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:30.542 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:49:30.542 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:49:30.542 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.542 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:30.543 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.543 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.543 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:49:30.543 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:30.543 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 94.138437796000005, 2024-09-12T22:49:30.543 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:49:30.543 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:30.543 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:30.543 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:30.543 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:30.543 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.543 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:30.543 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:30.544 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.544 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.544 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.544 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:30.544 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:30.544 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.544 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.544 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.544 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:30.545 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:30.545 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:49:30.545 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.545 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.545 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:30.545 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:49:30.545 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:49:30.545 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.545 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.545 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:30.545 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:49:30.545 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:49:30.545 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.546 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.546 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.546 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:49:30.546 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:49:30.546 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.546 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.546 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:30.546 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:49:30.546 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:49:30.546 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.546 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.546 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:30.546 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:49:30.546 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:49:30.547 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.547 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.547 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:30.547 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:49:30.547 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:49:30.547 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.547 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.547 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:30.547 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:49:30.547 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:49:30.547 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.547 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:30.547 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.548 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.548 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:49:30.548 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:30.548 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 94.004587701999995, 2024-09-12T22:49:30.548 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:49:30.548 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:30.548 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:30.548 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:30.548 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:30.548 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.548 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:30.549 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:30.549 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.549 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.549 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.549 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:30.549 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:30.549 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.549 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.549 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.549 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:30.549 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:30.549 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:49:30.549 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.550 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.550 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:30.550 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:49:30.550 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:49:30.550 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.550 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.550 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:30.550 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:49:30.550 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:49:30.550 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.550 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.551 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.551 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:49:30.551 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:49:30.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.551 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.551 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:30.551 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:49:30.551 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:49:30.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.551 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.551 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:30.551 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:49:30.552 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:49:30.552 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.552 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.552 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:30.552 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:49:30.552 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:49:30.552 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.552 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.552 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:30.552 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:49:30.552 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:49:30.552 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.552 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:30.553 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.553 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.553 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.553 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:30.553 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:30.553 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 85.359352147999999, 2024-09-12T22:49:30.553 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:49:30.553 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:30.553 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:30.553 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:30.553 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:30.553 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.553 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:30.554 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:30.554 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.554 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.554 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:30.554 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:30.554 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.554 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.554 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:30.554 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:49:30.554 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:49:30.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.555 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.555 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:30.555 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:49:30.555 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:49:30.555 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.555 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.555 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:30.555 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:49:30.555 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:49:30.555 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.555 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.555 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.555 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:49:30.555 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:49:30.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.556 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:30.556 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:30.556 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:49:30.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.556 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:30.556 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:30.556 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:49:30.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.557 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.557 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:30.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:49:30.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:49:30.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.557 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.557 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:30.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:49:30.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:49:30.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.558 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.558 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:30.558 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:49:30.558 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:49:30.558 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.558 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.558 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:30.558 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:49:30.558 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:49:30.558 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.558 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.558 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:30.559 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:49:30.559 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:49:30.559 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.559 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.559 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:30.559 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:49:30.559 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:49:30.559 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.559 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.559 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:30.559 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:49:30.559 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:49:30.559 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.560 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:30.560 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.560 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.560 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.560 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:30.560 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:30.560 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 85.359252631000004, 2024-09-12T22:49:30.560 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:49:30.560 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:30.560 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:30.560 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:30.560 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:30.561 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.561 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:30.561 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:30.561 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.561 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.561 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.561 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:30.561 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:30.562 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.562 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.562 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.562 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:30.562 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:49:30.562 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:49:30.562 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.562 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.562 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:30.562 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:49:30.562 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:49:30.562 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.562 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.563 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:30.563 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:49:30.563 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:49:30.563 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.563 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.563 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.563 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:49:30.563 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:49:30.563 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.563 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.563 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:30.563 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:49:30.563 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:49:30.564 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.564 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.564 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:30.564 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:49:30.564 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:49:30.564 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.564 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.564 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:30.564 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:49:30.564 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:49:30.564 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.564 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.564 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:30.565 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:49:30.565 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:49:30.565 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.565 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.565 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:30.565 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:49:30.565 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:49:30.565 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.565 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.565 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:30.565 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:49:30.565 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:49:30.565 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.566 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.566 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:30.566 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:49:30.566 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:49:30.566 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.566 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.566 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:30.566 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:49:30.566 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:49:30.566 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.566 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.566 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:30.566 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:49:30.567 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:49:30.567 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.567 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:30.567 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.567 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.567 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.567 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:30.567 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:30.567 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 85.359207892000001, 2024-09-12T22:49:30.567 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:49:30.567 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:30.567 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:30.567 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:30.568 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:30.568 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.568 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:30.568 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:30.568 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.568 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.568 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.568 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:30.568 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:30.568 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.568 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.568 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.568 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:30.569 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:49:30.569 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:49:30.569 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.569 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.569 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:30.569 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:30.569 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:49:30.569 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.569 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.569 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:30.569 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:30.569 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:49:30.569 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.570 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.570 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.570 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:49:30.570 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:49:30.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.570 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.570 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:30.570 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:49:30.570 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:49:30.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.570 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.570 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:30.570 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:49:30.570 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:49:30.571 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.571 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.571 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:30.571 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:49:30.571 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:49:30.571 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.571 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.571 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:30.571 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:49:30.571 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:49:30.571 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.571 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.571 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:30.572 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:49:30.572 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:49:30.572 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.572 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.572 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:30.572 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:49:30.572 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:49:30.572 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.572 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.572 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:30.572 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:49:30.572 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:49:30.572 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.573 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:30.573 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:49:30.573 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:49:30.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.573 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:30.573 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:49:30.573 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:49:30.573 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.573 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:30.573 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.574 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:30.574 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:30.574 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 85.358980191000001, 2024-09-12T22:49:30.574 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:49:30.574 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:30.574 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:30.574 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:30.574 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:30.574 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.574 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:30.574 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:30.574 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.575 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.575 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.575 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:30.575 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:30.575 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.575 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.575 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.575 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:30.575 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:49:30.575 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:49:30.575 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.575 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.575 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:30.576 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:49:30.576 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:49:30.576 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.576 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.576 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:30.576 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:49:30.576 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:49:30.576 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.576 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.576 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.576 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:49:30.576 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:49:30.576 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.577 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.577 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:30.577 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:49:30.577 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:49:30.577 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.577 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.577 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:30.577 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:49:30.577 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:49:30.577 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.577 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.577 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:30.577 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:49:30.578 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:49:30.578 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.578 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.578 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:30.578 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:49:30.578 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:49:30.578 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.578 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.578 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:30.578 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:49:30.578 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:49:30.578 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.579 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.579 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:30.579 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:49:30.579 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:49:30.579 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.579 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.579 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:30.579 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:49:30.579 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:49:30.579 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.579 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.579 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:30.579 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:49:30.580 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:49:30.580 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.580 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.580 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:30.580 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:49:30.580 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:49:30.580 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.580 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:30.580 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.580 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.580 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.580 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:30.580 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:30.581 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 85.358815082999996, 2024-09-12T22:49:30.581 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:49:30.581 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:30.581 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:30.581 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:30.581 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:30.581 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.581 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:30.581 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:30.581 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.581 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.581 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.582 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:30.582 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:30.582 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.582 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.582 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.582 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:30.582 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:49:30.582 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:49:30.582 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.582 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.582 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:30.582 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:49:30.582 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:49:30.583 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.583 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.583 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:30.583 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:49:30.583 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:49:30.583 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.583 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.583 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.583 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:49:30.583 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:49:30.583 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.583 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.583 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:30.584 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:49:30.584 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:49:30.584 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.584 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.584 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:30.584 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:49:30.584 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:49:30.584 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.584 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.584 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:30.584 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:49:30.584 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:49:30.585 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.585 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.585 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:30.585 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:49:30.585 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:49:30.585 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.585 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.585 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:30.585 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:49:30.585 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:49:30.585 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.585 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.585 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:30.585 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:49:30.586 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:49:30.586 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.586 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.586 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:30.586 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:49:30.586 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:49:30.586 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.586 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.586 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:30.586 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:49:30.586 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:49:30.586 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.586 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.587 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:30.587 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:49:30.587 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:49:30.587 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.587 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:30.587 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.587 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.587 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.587 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:30.587 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:30.587 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 85.358753797999995, 2024-09-12T22:49:30.587 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:49:30.587 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:30.588 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:30.588 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:30.588 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:30.588 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.588 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:30.588 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:30.588 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.588 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.588 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.588 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:30.588 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:30.588 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.589 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.589 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.589 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:30.589 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:30.589 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:49:30.589 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.589 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.589 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:30.589 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:49:30.589 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:49:30.589 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.589 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.590 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:30.590 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:49:30.590 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:49:30.590 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.590 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.590 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.590 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:49:30.590 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:49:30.590 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.590 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.590 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:30.590 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:49:30.590 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:49:30.590 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.591 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.591 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:30.591 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:49:30.591 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:49:30.591 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.591 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.591 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:30.591 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:49:30.591 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:49:30.591 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.591 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.591 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:30.592 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:49:30.592 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:49:30.592 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.592 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.592 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:30.592 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:49:30.592 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:49:30.592 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.592 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.592 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:30.592 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:49:30.592 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:49:30.593 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.593 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.593 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:30.593 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:49:30.593 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:49:30.593 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.593 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.593 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:30.593 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:49:30.593 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:49:30.593 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.593 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.594 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:30.594 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:49:30.594 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:49:30.594 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.594 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:30.594 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.594 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.594 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.594 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:30.594 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:30.594 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 85.358673690000003, 2024-09-12T22:49:30.594 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:49:30.594 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:30.594 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:30.595 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:30.595 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:30.595 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.595 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:30.595 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:30.595 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.595 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.595 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.595 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:30.595 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:30.595 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.595 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.595 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.595 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:30.595 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:49:30.596 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:49:30.596 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.596 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.596 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:30.596 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:49:30.596 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:49:30.596 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.596 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.596 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:30.596 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:49:30.596 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:49:30.596 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.596 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.596 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.597 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:49:30.597 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:49:30.597 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.597 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.597 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:30.597 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:49:30.597 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:49:30.597 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.597 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.597 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:30.597 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:49:30.597 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:49:30.597 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.598 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.598 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:30.598 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:49:30.598 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:49:30.598 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.598 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.598 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:30.598 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:49:30.598 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:49:30.598 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.598 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.598 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:30.598 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:49:30.599 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:49:30.599 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.599 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.599 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:30.599 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:49:30.599 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:49:30.599 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.599 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.599 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:30.599 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:49:30.599 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:49:30.599 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.599 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.600 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:30.600 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:49:30.600 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:49:30.600 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.600 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.600 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:30.600 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:49:30.600 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:49:30.600 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.600 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:30.600 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.600 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.601 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.601 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:30.601 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:30.601 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 85.358624737, 2024-09-12T22:49:30.601 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:49:30.601 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:30.601 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:30.601 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:30.601 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:30.601 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.601 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:30.601 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:30.601 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.602 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:30.602 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:30.602 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.602 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:30.602 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:30.602 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:49:30.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.602 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:30.603 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:49:30.603 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:49:30.603 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.603 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.603 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:30.603 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:49:30.603 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:49:30.603 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.603 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.603 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.603 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:49:30.603 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:49:30.603 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.604 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.604 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:30.604 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:49:30.604 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:49:30.604 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.604 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.604 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:30.604 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:49:30.604 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:49:30.604 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.604 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.605 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:30.605 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:49:30.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:49:30.605 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.605 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:30.605 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.605 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.605 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.605 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:30.605 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:30.605 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 85.358575637000001, 2024-09-12T22:49:30.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:49:30.605 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:30.606 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:30.606 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:30.606 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:30.606 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.606 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:30.606 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:30.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.606 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.606 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:30.606 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:30.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.607 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.607 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:30.607 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:49:30.607 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:49:30.607 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.607 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.607 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:30.607 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:49:30.607 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:49:30.607 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.607 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.607 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:30.607 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:49:30.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:49:30.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.608 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.608 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:49:30.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:49:30.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.608 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:30.608 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:49:30.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:49:30.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:30.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:49:30.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:49:30.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:30.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:49:30.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:49:30.609 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.609 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:30.609 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.610 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:30.610 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:30.610 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 85.351635186999999, 2024-09-12T22:49:30.610 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:49:30.610 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:30.610 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:30.610 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:30.610 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:30.610 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.610 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:30.610 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:30.610 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.611 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.611 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:30.611 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:30.611 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.611 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.611 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.611 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:30.611 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:49:30.611 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:49:30.611 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.611 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.611 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:30.611 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:49:30.611 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:49:30.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.612 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.612 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:30.612 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:49:30.612 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:49:30.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.612 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.612 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.612 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:49:30.612 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:49:30.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.612 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.612 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:30.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:49:30.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:49:30.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:30.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:49:30.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:49:30.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:30.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:49:30.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:49:30.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.614 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.614 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:30.614 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:49:30.614 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:49:30.614 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.614 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:30.614 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.614 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.614 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.614 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:30.614 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:30.614 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 85.350546347000005, 2024-09-12T22:49:30.614 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:49:30.615 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:30.615 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:30.615 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:30.615 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:30.615 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.615 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:30.615 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:30.615 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.615 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.615 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.615 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:30.615 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:30.615 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.616 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:30.616 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:49:30.616 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:49:30.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.616 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:30.616 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:49:30.616 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:49:30.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.616 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:30.617 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:49:30.617 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:49:30.617 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.617 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.617 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.617 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:49:30.617 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:49:30.617 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.617 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.617 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:30.617 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:49:30.617 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:49:30.617 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.618 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.618 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:30.618 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:49:30.618 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:49:30.618 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.618 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.618 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:30.618 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:49:30.618 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:49:30.618 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.618 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.618 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:30.618 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:49:30.619 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:49:30.619 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.619 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:30.619 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.619 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.619 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.619 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:30.619 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:30.619 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 85.350496735999997, 2024-09-12T22:49:30.619 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:49:30.619 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:30.619 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:30.619 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:30.620 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:30.620 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.620 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:30.620 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:30.620 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.620 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.620 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.620 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:30.620 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:30.620 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.620 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.620 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.621 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:30.621 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:30.621 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:49:30.621 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.621 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.621 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:30.621 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:30.621 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:49:30.621 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.621 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.621 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:30.621 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:49:30.621 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:49:30.621 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.622 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.622 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.622 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:49:30.622 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:49:30.622 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.622 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.622 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:30.622 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:49:30.622 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:49:30.622 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.622 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.622 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:30.622 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:49:30.623 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:49:30.623 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.623 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.623 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:30.623 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:49:30.623 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:49:30.623 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.623 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.623 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:30.623 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:49:30.623 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:49:30.623 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.623 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:30.624 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.624 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.624 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.624 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:30.624 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:30.624 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 85.350429426999995, 2024-09-12T22:49:30.624 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:49:30.624 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:30.624 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:30.624 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:30.624 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:30.624 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.625 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:30.625 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:30.625 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.625 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.625 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.625 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:30.625 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:30.625 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.625 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.625 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.625 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:30.625 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:30.625 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:49:30.626 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.626 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.626 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:30.626 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:49:30.626 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:49:30.626 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.626 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.626 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:30.626 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:49:30.626 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:49:30.626 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.626 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.627 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.627 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:49:30.627 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:49:30.627 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.627 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.627 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:30.627 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:49:30.627 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:49:30.627 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.627 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.627 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:30.627 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:49:30.627 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:49:30.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.628 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.628 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:30.628 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:49:30.628 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:49:30.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.628 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.628 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:30.628 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:49:30.628 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:49:30.628 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.628 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:30.628 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.629 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.629 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.629 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:30.629 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:30.629 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 85.349861508000004, 2024-09-12T22:49:30.629 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:49:30.629 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:30.629 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:30.629 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:30.629 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:30.629 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.629 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:30.629 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:30.630 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.630 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.630 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.630 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:30.630 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:30.630 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.630 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.630 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.630 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:30.630 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:30.630 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:49:30.630 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.630 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.630 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:30.631 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:49:30.631 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:49:30.631 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.631 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.631 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:30.631 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:49:30.631 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:49:30.631 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.631 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.631 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.631 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:49:30.631 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:49:30.631 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.632 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.632 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:30.632 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:49:30.632 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:49:30.632 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.632 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.632 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:30.632 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:49:30.632 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:49:30.632 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.632 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.632 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:30.633 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:49:30.633 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:49:30.633 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.633 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.633 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:30.633 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:49:30.633 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:49:30.633 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.633 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:30.633 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.633 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.633 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.633 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:49:30.634 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:30.634 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 85.349483903999996, 2024-09-12T22:49:30.634 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:49:30.634 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:30.634 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:30.634 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:30.634 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:30.634 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.634 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:30.634 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:30.634 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.634 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.635 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:30.635 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:30.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:30.635 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.635 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:30.635 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:49:30.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:49:30.635 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.635 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:30.635 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:49:30.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:49:30.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.636 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.636 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:30.636 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:49:30.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:49:30.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.636 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.636 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:30.636 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:49:30.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:49:30.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.636 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.637 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:30.637 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:49:30.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:49:30.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.637 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:30.637 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:49:30.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:49:30.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.637 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:30.637 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:49:30.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:49:30.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:30.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:30.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:30.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:49:30.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:49:30.638 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.638 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:30.638 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.638 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:30.638 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:30.638 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:30.639 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:49:30.641 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:30.641 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:30.638+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:30.741 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:30.740+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:30.748 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:30.748 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:30.748 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:49:30.748 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:30.757 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:30.842 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:30.841+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:30.900 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:30.900 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:30.900 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:49:30.900 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:49:30.900 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:30.909 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:30.942 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:30.941+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:31.044 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:31.043+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:31.053 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:31.053 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:49:31.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:49:31.053 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:49:31.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.053 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:49:31.053 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:31.053 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 91.005128659999997, 2024-09-12T22:49:31.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:49:31.053 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:31.053 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:31.053 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:31.054 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:31.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:31.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:31.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:31.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:31.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:31.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:31.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:49:31.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:31.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:49:31.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:49:31.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:31.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:49:31.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:49:31.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:49:31.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:49:31.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:31.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:49:31.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:49:31.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:31.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:49:31.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:49:31.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:31.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:49:31.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:49:31.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:31.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:49:31.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:49:31.057 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.058 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:31.058 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.058 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:49:31.058 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:31.058 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 89.004747933000004, 2024-09-12T22:49:31.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:49:31.058 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:31.058 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:31.058 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:31.058 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:31.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:31.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:31.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:31.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:31.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:31.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:49:31.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:49:31.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:31.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:49:31.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:49:31.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:31.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:49:31.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:49:31.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:49:31.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:49:31.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:31.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:49:31.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:49:31.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:31.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:49:31.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:49:31.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:31.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:49:31.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:49:31.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:31.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:49:31.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:49:31.063 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.064 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:31.064 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.064 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:49:31.064 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:31.064 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 85.884151122999995, 2024-09-12T22:49:31.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:49:31.064 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:31.064 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:31.064 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:49:31.064 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:31.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:31.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:31.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:31.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:31.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:31.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:31.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:49:31.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:31.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:49:31.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:49:31.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:31.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:49:31.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:49:31.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:49:31.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:49:31.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:31.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:49:31.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:49:31.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:31.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:49:31.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:49:31.068 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.068 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:31.068 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.068 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:31.068 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:31.068 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 85.881542942999999, 2024-09-12T22:49:31.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:49:31.068 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:31.069 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:31.069 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:31.069 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:31.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:31.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:31.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:31.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:31.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:31.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:49:31.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:49:31.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:31.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:49:31.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:49:31.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:31.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:49:31.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:49:31.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:49:31.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:49:31.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:31.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:49:31.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:49:31.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:31.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:49:31.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:49:31.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:31.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:49:31.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:49:31.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:31.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:49:31.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:49:31.073 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.073 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:31.073 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.073 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:31.074 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:31.074 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 85.880649719999994, 2024-09-12T22:49:31.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:49:31.074 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:31.074 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:31.074 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:31.074 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:31.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:31.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:31.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:31.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:31.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:31.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:49:31.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:49:31.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:31.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:49:31.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:49:31.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:31.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:49:31.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:49:31.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:49:31.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:49:31.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:31.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:49:31.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:49:31.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:31.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:49:31.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:49:31.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:31.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:49:31.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:49:31.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:31.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:49:31.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:49:31.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:31.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:49:31.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:49:31.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:31.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:49:31.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:49:31.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:31.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:49:31.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:49:31.079 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.079 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:31.079 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.079 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:31.080 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:31.080 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 85.880578061999998, 2024-09-12T22:49:31.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:49:31.080 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:31.080 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:31.080 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:31.080 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:31.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:31.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:31.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:31.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:31.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:31.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:49:31.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:49:31.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:31.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:49:31.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:49:31.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:31.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:49:31.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:49:31.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:49:31.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:49:31.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:31.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:49:31.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:49:31.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:31.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:49:31.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:49:31.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:31.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:49:31.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:49:31.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:31.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:49:31.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:49:31.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:31.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:49:31.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:49:31.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:31.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:49:31.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:49:31.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:31.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:49:31.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:49:31.085 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.085 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:31.085 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.086 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:31.086 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:31.086 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 85.880535343999995, 2024-09-12T22:49:31.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:49:31.086 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:31.086 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:31.086 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:31.086 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:31.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:31.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:31.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:31.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:31.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:31.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:49:31.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:49:31.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:31.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:49:31.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:49:31.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:31.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:49:31.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:49:31.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:49:31.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:49:31.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:31.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:49:31.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:49:31.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:31.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:49:31.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:49:31.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:31.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:49:31.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:49:31.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:31.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:49:31.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:49:31.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:31.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:49:31.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:49:31.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:31.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:49:31.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:49:31.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:31.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:49:31.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:49:31.091 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.091 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:31.091 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.092 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:31.092 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:31.092 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 85.880497426999995, 2024-09-12T22:49:31.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:49:31.092 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:31.092 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:31.092 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:31.092 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:31.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:31.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:31.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:31.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:31.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:31.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:49:31.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:49:31.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:31.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:49:31.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:49:31.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:31.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:49:31.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:49:31.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:49:31.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:49:31.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:31.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:49:31.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:49:31.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:31.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:49:31.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:49:31.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:31.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:31.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:49:31.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:31.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:49:31.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:49:31.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:31.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:49:31.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:49:31.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:31.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:49:31.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:49:31.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:31.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:49:31.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:49:31.097 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.097 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:31.097 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.098 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:31.098 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:31.098 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 85.880473976000005, 2024-09-12T22:49:31.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:49:31.098 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:31.098 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:31.098 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:31.098 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:31.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:31.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:31.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:31.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:31.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:31.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:49:31.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:49:31.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:31.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:49:31.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:49:31.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:31.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:49:31.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:49:31.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:49:31.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:49:31.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:31.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:49:31.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:49:31.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:31.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:49:31.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:49:31.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:31.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:31.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:49:31.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:31.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:49:31.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:49:31.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:31.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:49:31.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:49:31.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:31.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:49:31.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:49:31.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:31.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:49:31.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:49:31.103 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.103 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:31.103 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.104 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:31.104 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:31.104 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 85.880449738999999, 2024-09-12T22:49:31.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:49:31.104 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:31.104 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:31.104 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:31.104 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:31.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:31.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:31.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:31.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:31.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:31.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:31.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:49:31.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:31.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:49:31.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:49:31.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:31.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:49:31.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:49:31.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:49:31.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:49:31.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:31.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:49:31.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:49:31.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:31.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:49:31.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:49:31.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:31.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:49:31.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:49:31.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:31.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:49:31.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:49:31.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:31.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:49:31.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:49:31.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:31.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:49:31.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:49:31.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:31.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:49:31.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:49:31.110 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.110 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:31.110 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.110 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:31.110 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:31.110 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 85.880421822000002, 2024-09-12T22:49:31.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:49:31.110 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:31.110 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:31.110 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:31.110 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:31.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:31.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:31.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:31.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:31.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:31.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:31.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:49:31.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:31.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:49:31.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:49:31.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:31.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:49:31.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:49:31.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:49:31.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:49:31.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:31.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:49:31.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:49:31.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:31.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:49:31.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:49:31.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:31.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:49:31.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:49:31.114 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.114 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:31.114 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.114 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:31.114 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:31.114 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 85.880347326999996, 2024-09-12T22:49:31.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:49:31.115 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:31.115 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:31.115 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:31.115 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:31.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:31.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:31.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:31.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:31.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:31.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:49:31.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:49:31.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:31.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:49:31.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:49:31.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:31.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:49:31.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:49:31.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:49:31.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:49:31.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:31.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:49:31.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:49:31.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:31.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:49:31.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:49:31.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:31.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:49:31.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:49:31.118 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.118 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:31.118 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.119 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:31.119 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:31.119 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 85.880301298999996, 2024-09-12T22:49:31.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:49:31.119 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:31.119 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:31.119 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:31.119 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:31.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:31.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:31.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:31.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:31.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:31.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:49:31.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:49:31.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:31.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:49:31.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:49:31.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:31.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:49:31.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:49:31.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:49:31.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:49:31.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:31.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:49:31.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:49:31.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:31.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:49:31.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:49:31.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:31.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:49:31.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:49:31.123 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.123 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:31.123 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.123 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:31.123 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:31.123 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 85.878130415000001, 2024-09-12T22:49:31.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:49:31.123 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:31.123 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:31.123 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:31.124 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:31.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:31.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:31.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:31.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:31.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:31.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:31.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:49:31.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:31.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:49:31.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:49:31.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:31.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:49:31.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:49:31.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:31.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:49:31.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:31.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:49:31.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:49:31.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:31.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:31.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:49:31.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:31.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:49:31.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:49:31.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:31.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:49:31.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:49:31.127 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.127 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:31.128 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.128 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:31.128 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:31.128 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 85.878079964999998, 2024-09-12T22:49:31.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:49:31.128 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:31.128 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:31.128 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:31.128 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:31.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:31.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:31.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:31.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:31.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:31.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:49:31.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:49:31.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:31.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:49:31.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:49:31.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:31.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:49:31.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:49:31.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:49:31.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:49:31.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:31.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:49:31.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:49:31.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:31.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:49:31.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:49:31.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:31.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:49:31.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:49:31.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:31.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:49:31.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:49:31.132 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.132 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:31.132 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.132 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:31.133 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:31.133 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 85.878026527000003, 2024-09-12T22:49:31.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:49:31.133 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:31.133 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:31.133 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:31.133 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:31.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:31.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:31.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:31.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:31.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:31.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:31.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:49:31.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:31.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:49:31.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:49:31.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:31.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:31.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:49:31.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:49:31.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:49:31.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:31.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:49:31.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:49:31.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:31.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:49:31.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:49:31.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:31.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:49:31.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:49:31.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:31.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:49:31.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:49:31.137 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.137 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:31.137 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.137 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:49:31.137 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:31.137 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 85.874042173999996, 2024-09-12T22:49:31.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:49:31.137 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:31.138 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:31.138 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:31.138 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:31.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:31.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:31.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:31.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:31.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:31.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:49:31.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:49:31.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:31.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:49:31.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:49:31.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:31.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:49:31.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:49:31.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:49:31.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:49:31.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:31.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:49:31.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:49:31.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:31.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:49:31.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:49:31.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:31.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:49:31.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:49:31.141 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.141 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:31.141 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.141 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:49:31.142 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:31.142 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 83.888889634999998, 2024-09-12T22:49:31.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:49:31.142 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:31.142 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:31.142 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:31.142 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:31.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:31.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:31.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:31.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:31.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:31.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:49:31.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:49:31.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:31.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:49:31.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:49:31.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:31.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:49:31.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:49:31.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:49:31.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:49:31.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:31.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:49:31.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:49:31.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:31.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:49:31.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:49:31.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:31.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:49:31.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:49:31.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:31.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:49:31.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:49:31.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:31.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:49:31.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:49:31.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:31.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:49:31.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:49:31.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:31.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:49:31.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:49:31.147 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.147 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:31.147 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.147 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:49:31.147 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:31.147 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 65.886973389999994, 2024-09-12T22:49:31.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:49:31.148 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:31.148 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:31.148 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:31.148 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:31.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:31.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:31.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:31.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:31.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:31.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:49:31.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:49:31.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:31.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:49:31.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:49:31.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:31.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:49:31.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:49:31.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:49:31.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:49:31.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:31.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:49:31.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:49:31.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:31.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:49:31.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:49:31.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:31.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:49:31.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:49:31.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:31.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:49:31.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:49:31.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:31.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:49:31.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:49:31.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:31.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:49:31.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:49:31.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:31.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:49:31.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:49:31.153 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.153 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:31.153 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.153 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:49:31.153 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:31.153 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.886220014999999, 2024-09-12T22:49:31.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012160610000000001, 2024-09-12T22:49:31.154 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:31.154 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:31.154 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:31.154 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:31.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:31.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:31.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:31.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:31.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:31.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:31.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164967+0000", 2024-09-12T22:49:31.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:49:31.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:31.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164974+0000", 2024-09-12T22:49:31.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:49:31.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:31.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164987+0000", 2024-09-12T22:49:31.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3689000000000001e-05 2024-09-12T22:49:31.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164995+0000", 2024-09-12T22:49:31.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2959999999999999e-06 2024-09-12T22:49:31.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:31.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165068+0000", 2024-09-12T22:49:31.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2449999999999999e-05 2024-09-12T22:49:31.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:31.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165212+0000", 2024-09-12T22:49:31.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144117 2024-09-12T22:49:31.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:31.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166066+0000", 2024-09-12T22:49:31.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085441100000000002 2024-09-12T22:49:31.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:31.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166107+0000", 2024-09-12T22:49:31.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0450000000000001e-05 2024-09-12T22:49:31.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:31.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:31.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:31.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166181+0000", 2024-09-12T22:49:31.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-12T22:49:31.158 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.158 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:31.158 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.158 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:31.158 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:31.158 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:31.160 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:31.160 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:31.159+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:31.261 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:31.260+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:31.266 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:31.267 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:31.267 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:49:31.267 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:31.276 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:31.362 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:31.361+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:31.418 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:31.418 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:31.418 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:49:31.418 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:49:31.418 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:31.426 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:31.470 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:31.469+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:31.529 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:31.530 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:49:31.530 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:49:31.530 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:49:31.530 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.530 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:49:31.530 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:31.530 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 95.143766686000006, 2024-09-12T22:49:31.530 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:49:31.530 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:31.530 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:31.531 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:31.531 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:31.531 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.531 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:31.531 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:31.531 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.531 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.531 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.531 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:31.531 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:31.531 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.531 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.532 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.532 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:31.532 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:31.532 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:49:31.532 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.532 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.532 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:31.532 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:49:31.532 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:49:31.532 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.532 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.532 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:31.533 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:49:31.533 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:49:31.533 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.533 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.533 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.533 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:49:31.533 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:49:31.533 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.533 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.533 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:31.533 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:49:31.533 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:49:31.534 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.534 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.534 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:31.534 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:49:31.534 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:49:31.534 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.534 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.534 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:31.534 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:49:31.534 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:49:31.534 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.534 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.534 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:31.535 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:49:31.535 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:49:31.535 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.535 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:31.535 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.535 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.535 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.535 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:49:31.535 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:31.535 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 95.143324102999998, 2024-09-12T22:49:31.535 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:49:31.535 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:31.535 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:31.536 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:31.536 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:31.536 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.536 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:31.536 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:31.536 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.536 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.536 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.537 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:31.537 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:31.537 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.537 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.537 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.537 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:31.537 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:49:31.537 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:49:31.537 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.537 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.537 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:31.537 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:49:31.537 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:49:31.538 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.538 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.538 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:31.538 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:49:31.538 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:49:31.538 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.538 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.538 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.538 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:49:31.538 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:49:31.538 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.538 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.538 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:31.539 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:49:31.539 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:49:31.539 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.539 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.539 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:31.539 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:49:31.539 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:49:31.539 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.539 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.539 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:31.539 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:49:31.539 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:49:31.539 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.540 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.540 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:31.540 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:49:31.540 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:49:31.540 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.540 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:31.540 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.540 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.540 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.540 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:49:31.540 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:31.540 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 95.142957945999996, 2024-09-12T22:49:31.540 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:49:31.541 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:31.541 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:31.541 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:31.541 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:31.541 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.541 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:31.541 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:31.541 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.541 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.541 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.541 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:31.541 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:31.541 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.542 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.542 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.542 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:31.542 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:49:31.542 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:49:31.542 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.542 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.542 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:31.542 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:49:31.542 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:49:31.542 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.542 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.542 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:31.542 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:49:31.543 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:49:31.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.543 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.543 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.543 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:49:31.543 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:49:31.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.543 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.543 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:31.543 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:49:31.543 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:49:31.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.544 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.544 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:31.544 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:49:31.544 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:49:31.544 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.544 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.544 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:31.544 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:49:31.544 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:49:31.544 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.544 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.544 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:31.544 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:49:31.545 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:49:31.545 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.545 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:31.545 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.545 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.545 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.545 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:49:31.545 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:31.545 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 95.142545634000001, 2024-09-12T22:49:31.545 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:49:31.545 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:31.545 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:31.546 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:31.546 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:31.546 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.546 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:31.546 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:31.546 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.546 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.546 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.546 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:31.546 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:31.546 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.546 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.547 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.547 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:31.547 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:31.547 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:49:31.547 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.547 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.547 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:31.547 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:49:31.547 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:49:31.547 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.547 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.547 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:31.547 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:49:31.548 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:49:31.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.548 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.548 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.548 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:49:31.548 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:49:31.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.548 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.548 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:31.548 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:49:31.548 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:49:31.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.548 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.549 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:31.549 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:49:31.549 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:49:31.549 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.549 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.549 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:31.549 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:49:31.549 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:49:31.549 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.549 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.549 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:31.549 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:49:31.550 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:49:31.550 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.550 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:31.550 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.550 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.550 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.550 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:49:31.550 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:31.550 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 95.008695540000005, 2024-09-12T22:49:31.550 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:49:31.550 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:31.550 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:31.550 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:31.550 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:31.551 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.551 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:31.551 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:31.551 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.551 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.551 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:31.551 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:31.551 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.551 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.551 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:31.551 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:31.552 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:49:31.552 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.552 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.552 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:31.552 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:49:31.552 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:49:31.552 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.552 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.552 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:31.552 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:49:31.552 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:49:31.552 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.552 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.553 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.553 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:49:31.553 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:49:31.553 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.553 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.553 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:31.553 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:49:31.553 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:49:31.553 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.553 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.553 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:31.553 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:49:31.553 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:49:31.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.554 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.554 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:31.554 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:49:31.554 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:49:31.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.554 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.554 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:31.554 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:49:31.554 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:49:31.554 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.554 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:31.554 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.555 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.555 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:31.555 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:31.555 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 86.363459985999995, 2024-09-12T22:49:31.555 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:49:31.555 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:31.555 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:31.555 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:31.555 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:31.555 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.555 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:31.555 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:31.555 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.556 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:31.556 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:31.556 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.556 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:31.556 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:49:31.556 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:49:31.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.556 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:31.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:49:31.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:49:31.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.557 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.557 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:31.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:49:31.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:49:31.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.557 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.557 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:49:31.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:49:31.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.557 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.558 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:31.558 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:31.558 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:49:31.558 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.558 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.558 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:31.558 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:31.558 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:49:31.558 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.558 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.558 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:31.558 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:49:31.558 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:49:31.559 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.559 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.559 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:31.559 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:49:31.559 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:49:31.559 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.559 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.559 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:31.559 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:49:31.559 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:49:31.559 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.559 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.559 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:31.559 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:49:31.560 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:49:31.560 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.560 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.560 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:31.560 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:49:31.560 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:49:31.560 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.560 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.560 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:31.560 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:49:31.560 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:49:31.561 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.561 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.561 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:31.561 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:49:31.561 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:49:31.561 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.561 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:31.561 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.561 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.561 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.561 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:31.561 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:31.561 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 86.363360469, 2024-09-12T22:49:31.562 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:49:31.562 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:31.562 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:31.562 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:31.562 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:31.562 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.562 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:31.562 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:31.562 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.562 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.562 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.562 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:31.562 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:31.562 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.563 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.563 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.563 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:31.563 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:49:31.563 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:49:31.563 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.563 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.563 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:31.563 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:49:31.563 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:49:31.563 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.563 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.564 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:31.564 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:49:31.564 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:49:31.564 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.564 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.564 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.564 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:49:31.564 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:49:31.564 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.564 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.564 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:31.564 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:49:31.564 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:49:31.565 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.565 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.565 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:31.565 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:49:31.565 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:49:31.565 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.565 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.565 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:31.565 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:49:31.565 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:49:31.565 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.565 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.565 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:31.566 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:49:31.566 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:49:31.566 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.566 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.566 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:31.566 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:49:31.566 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:49:31.566 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.566 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.566 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:31.566 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:49:31.566 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:49:31.566 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.567 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.567 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:31.567 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:49:31.567 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:49:31.567 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.567 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.567 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:31.567 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:49:31.567 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:49:31.567 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.567 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.567 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:31.567 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:49:31.568 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:49:31.568 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.568 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:31.568 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.568 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.568 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.568 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:31.568 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:31.568 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 86.363315729999997, 2024-09-12T22:49:31.568 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:49:31.568 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:31.568 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:31.569 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:31.569 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:31.569 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.569 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:31.569 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:31.569 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.569 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.569 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.569 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:31.569 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:31.569 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.569 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.569 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.570 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:31.570 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:49:31.570 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:49:31.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.570 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.570 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:31.570 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:31.570 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:49:31.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.570 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.570 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:31.570 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:31.570 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:49:31.571 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.571 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.571 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.571 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:49:31.571 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:49:31.571 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.571 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.571 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:31.571 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:49:31.571 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:49:31.571 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.571 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.571 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:31.572 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:49:31.572 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:49:31.572 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.572 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.572 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:31.572 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:49:31.572 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:49:31.572 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.572 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.572 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:31.572 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:49:31.573 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:49:31.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.573 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:31.573 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:49:31.573 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:49:31.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.573 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:31.573 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:49:31.573 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:49:31.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.574 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.574 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:31.574 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:49:31.574 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:49:31.574 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.574 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.574 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:31.574 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:49:31.574 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:49:31.574 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.574 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.574 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:31.574 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:49:31.575 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:49:31.575 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.575 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:31.575 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.575 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.575 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.575 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:31.575 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:31.575 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 86.363088028999996, 2024-09-12T22:49:31.575 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:49:31.575 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:31.575 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:31.575 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:31.576 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:31.576 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.576 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:31.576 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:31.576 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.576 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.576 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.576 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:31.576 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:31.576 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.576 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.576 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.576 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:31.576 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:49:31.577 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:49:31.577 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.577 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.577 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:31.577 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:49:31.577 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:49:31.577 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.577 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.577 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:31.577 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:49:31.577 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:49:31.578 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.578 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.578 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.578 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:49:31.578 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:49:31.578 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.578 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.578 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:31.578 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:49:31.578 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:49:31.578 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.578 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.579 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:31.579 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:49:31.579 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:49:31.579 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.579 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.579 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:31.579 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:49:31.579 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:49:31.579 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.579 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.579 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:31.579 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:49:31.579 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:49:31.580 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.580 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.580 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:31.580 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:49:31.580 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:49:31.580 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.580 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.580 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:31.580 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:49:31.580 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:49:31.580 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.580 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.580 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:31.580 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:49:31.581 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:49:31.581 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.581 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.581 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:31.581 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:49:31.581 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:49:31.581 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.581 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.581 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:31.581 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:49:31.581 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:49:31.581 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.582 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:31.582 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.582 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.582 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.582 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:31.582 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:31.582 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 86.362922921000006, 2024-09-12T22:49:31.582 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:49:31.582 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:31.582 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:31.582 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:31.582 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:31.582 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.583 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:31.583 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:31.583 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.583 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.583 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.583 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:31.583 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:31.583 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.583 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.583 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.583 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:31.583 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:49:31.583 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:49:31.584 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.584 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.584 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:31.584 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:49:31.584 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:49:31.584 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.584 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.584 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:31.584 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:49:31.584 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:49:31.584 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.584 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.584 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.584 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:49:31.585 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:49:31.585 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.585 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.585 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:31.585 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:49:31.585 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:49:31.585 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.585 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.585 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:31.585 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:49:31.585 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:49:31.585 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.585 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.586 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:31.586 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:49:31.586 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:49:31.586 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.586 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.586 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:31.586 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:49:31.586 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:49:31.586 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.586 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.586 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:31.586 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:49:31.586 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:49:31.587 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.587 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.587 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:31.587 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:49:31.587 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:49:31.587 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.587 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.587 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:31.587 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:49:31.587 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:49:31.587 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.587 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.587 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:31.588 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:49:31.588 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:49:31.588 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.588 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.588 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:31.588 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:49:31.588 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:49:31.588 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.588 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:31.588 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.588 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.589 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.589 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:31.589 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:31.589 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 86.362861636000005, 2024-09-12T22:49:31.589 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:49:31.589 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:31.589 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:31.589 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:31.589 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:31.589 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.589 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:31.589 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:31.589 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.590 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.590 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.590 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:31.590 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:31.590 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.590 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.590 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.590 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:31.590 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:31.590 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:49:31.590 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.590 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.591 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:31.591 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:49:31.591 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:49:31.591 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.591 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.591 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:31.591 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:49:31.591 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:49:31.591 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.591 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.591 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.591 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:49:31.591 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:49:31.592 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.592 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.592 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:31.592 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:49:31.592 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:49:31.592 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.592 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.592 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:31.592 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:49:31.592 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:49:31.592 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.592 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.592 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:31.593 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:49:31.593 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:49:31.593 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.593 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.593 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:31.593 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:49:31.593 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:49:31.593 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.593 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.593 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:31.593 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:49:31.593 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:49:31.594 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.594 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.594 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:31.594 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:49:31.594 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:49:31.594 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.594 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.594 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:31.594 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:49:31.594 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:49:31.594 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.594 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.595 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:31.595 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:49:31.595 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:49:31.595 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.595 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.595 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:31.595 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:49:31.595 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:49:31.595 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.595 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:31.595 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.596 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.596 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.596 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:31.596 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:31.596 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 86.362781527999999, 2024-09-12T22:49:31.596 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:49:31.596 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:31.596 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:31.596 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:31.596 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:31.596 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.596 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:31.597 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:31.597 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.597 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.597 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.597 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:31.597 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:31.597 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.597 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.597 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.597 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:31.597 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:49:31.597 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:49:31.597 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.598 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.598 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:31.598 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:49:31.598 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:49:31.598 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.598 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.598 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:31.598 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:49:31.598 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:49:31.598 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.598 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.598 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.598 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:49:31.599 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:49:31.599 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.599 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.599 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:31.599 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:49:31.599 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:49:31.599 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.599 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.599 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:31.599 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:49:31.599 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:49:31.599 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.599 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.600 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:31.600 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:49:31.600 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:49:31.600 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.600 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.600 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:31.600 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:49:31.600 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:49:31.600 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.600 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.600 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:31.600 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:49:31.600 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:49:31.601 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.601 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.601 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:31.601 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:49:31.601 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:49:31.601 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.601 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.601 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:31.601 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:49:31.601 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:49:31.601 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.601 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.601 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:31.602 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:49:31.602 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:49:31.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.602 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:31.602 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:49:31.602 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:49:31.602 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.602 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:31.602 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.602 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:31.603 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:31.603 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 86.362732574999995, 2024-09-12T22:49:31.603 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:49:31.603 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:31.603 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:31.603 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:31.603 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:31.603 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.603 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:31.603 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:31.603 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.603 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.603 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.604 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:31.604 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:31.604 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.604 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.604 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.604 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:31.604 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:31.604 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:49:31.604 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.604 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.605 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:31.605 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:49:31.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:49:31.605 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.605 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.605 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:31.605 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:49:31.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:49:31.605 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.605 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.605 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.605 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:49:31.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:49:31.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.606 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.606 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:31.606 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:49:31.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:49:31.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.606 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.606 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:31.606 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:49:31.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:49:31.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.606 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.606 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:31.607 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:49:31.607 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:49:31.607 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.607 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:31.607 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.607 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.607 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.607 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:31.607 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:31.607 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 86.362683474999997, 2024-09-12T22:49:31.607 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:49:31.607 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:31.607 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:31.608 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:31.608 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:31.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.608 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:31.608 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:31.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.608 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:31.608 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:31.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:31.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:49:31.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:49:31.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:31.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:49:31.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:49:31.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:31.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:49:31.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:49:31.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.610 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.610 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.610 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:49:31.610 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:49:31.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.610 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.610 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:31.610 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:49:31.610 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:49:31.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.610 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.610 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:31.611 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:49:31.611 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:49:31.611 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.611 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.611 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:31.611 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:49:31.611 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:49:31.611 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.611 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:31.611 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.611 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.611 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.611 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:31.612 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:31.612 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 86.355743024999995, 2024-09-12T22:49:31.612 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:49:31.612 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:31.612 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:31.612 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:31.612 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:31.612 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.612 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:31.612 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:31.612 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.612 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:31.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:31.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:31.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:49:31.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:49:31.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:31.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:49:31.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:49:31.614 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.614 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.614 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:31.614 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:49:31.614 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:49:31.614 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.614 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.614 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.614 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:49:31.614 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:49:31.614 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.614 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.614 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:31.615 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:49:31.615 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:49:31.615 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.615 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.615 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:31.615 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:49:31.615 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:49:31.615 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.615 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.615 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:31.615 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:49:31.615 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:49:31.615 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.616 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:31.616 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:49:31.616 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:49:31.616 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.616 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:31.616 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.616 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:31.616 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:31.616 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 86.354654185000001, 2024-09-12T22:49:31.617 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:49:31.617 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:31.617 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:31.617 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:31.617 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:31.617 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.617 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:31.617 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:31.617 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.617 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.617 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.617 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:31.618 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:31.618 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.618 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.618 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.618 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:31.618 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:49:31.618 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:49:31.618 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.618 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.618 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:31.618 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:49:31.618 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:49:31.618 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.619 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.619 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:31.619 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:49:31.619 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:49:31.619 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.619 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.619 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.619 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:49:31.619 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:49:31.619 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.619 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.619 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:31.619 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:49:31.620 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:49:31.620 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.620 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.620 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:31.620 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:49:31.620 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:49:31.620 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.620 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.620 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:31.620 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:49:31.620 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:49:31.621 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.621 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.621 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:31.621 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:49:31.621 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:49:31.621 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.621 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:31.621 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.621 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.621 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.621 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:31.621 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:31.622 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 86.354604574000007, 2024-09-12T22:49:31.622 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:49:31.622 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:31.622 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:31.622 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:31.622 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:31.622 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.622 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:31.622 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:31.622 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.622 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.622 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.622 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:31.623 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:31.623 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.623 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.623 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.623 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:31.623 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:31.623 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:49:31.623 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.623 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.623 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:31.623 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:31.623 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:49:31.624 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.624 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.624 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:31.624 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:49:31.624 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:49:31.624 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.624 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.624 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.624 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:49:31.624 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:49:31.624 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.624 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.625 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:31.625 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:49:31.625 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:49:31.625 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.625 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.625 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:31.625 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:49:31.625 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:49:31.625 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.625 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.625 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:31.625 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:49:31.625 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:49:31.625 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.626 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.626 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:31.626 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:49:31.626 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:49:31.626 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.626 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:31.626 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.626 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.626 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.626 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:31.626 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:31.626 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 86.354537265000005, 2024-09-12T22:49:31.626 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:49:31.627 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:31.627 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:31.627 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:31.627 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:31.627 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.627 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:31.627 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:31.627 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.627 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.627 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.627 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:31.627 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:31.627 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.628 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.628 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:31.628 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:31.628 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:49:31.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.628 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.628 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:31.628 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:49:31.628 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:49:31.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.628 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.628 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:31.629 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:49:31.629 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:49:31.629 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.629 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.629 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.629 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:49:31.629 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:49:31.629 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.629 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.629 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:31.629 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:49:31.629 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:49:31.629 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.630 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.630 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:31.630 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:49:31.630 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:49:31.630 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.630 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.630 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:31.630 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:49:31.630 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:49:31.630 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.630 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.630 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:31.631 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:49:31.631 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:49:31.631 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.631 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:31.631 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.631 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.631 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.631 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:31.631 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:31.631 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 86.353969346, 2024-09-12T22:49:31.631 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:49:31.631 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:31.631 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:31.632 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:31.632 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:31.632 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.632 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:31.632 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:31.632 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.632 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.632 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.632 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:31.632 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:31.632 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.632 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.633 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.633 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:31.633 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:31.633 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:49:31.633 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.633 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.633 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:31.633 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:49:31.633 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:49:31.633 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.633 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.633 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:31.633 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:49:31.634 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:49:31.634 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.634 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.634 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.634 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:49:31.634 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:49:31.634 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.634 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.634 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:31.634 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:49:31.634 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:49:31.634 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.634 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.635 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:31.635 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:49:31.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:49:31.635 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.635 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:31.635 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:49:31.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:49:31.635 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.635 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:31.635 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:49:31.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:49:31.636 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.636 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:31.636 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.636 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.636 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:49:31.636 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:31.636 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 86.353591742000006, 2024-09-12T22:49:31.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:49:31.636 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:31.636 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:31.636 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:31.637 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:31.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.637 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:31.637 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:31.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.637 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:31.637 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:31.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:31.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.637 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:31.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:49:31.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:49:31.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:31.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:49:31.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:49:31.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:31.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:49:31.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:49:31.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.639 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:31.639 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:49:31.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:49:31.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.639 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:31.639 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:49:31.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:49:31.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.639 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:31.639 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:49:31.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:49:31.640 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:31.640 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:49:31.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:49:31.640 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:31.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:31.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:31.640 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:49:31.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:49:31.640 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.640 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:31.640 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.641 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:31.641 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:31.641 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:31.642 INFO:teuthology.orchestra.run.smithi066.stderr:nodeep-scrub is unset 2024-09-12T22:49:31.643 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:31.643 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:31.641+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:31.742 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:31.741+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:31.748 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:31.748 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:31.748 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:49:31.748 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:31.757 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:31.777 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:49:31.844 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:31.843+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:31.859 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:31.859 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:31.859 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:49:31.860 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:49:31.860 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:31.868 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:31.906 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:49:31.907 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:49:31.925 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:49:31.926 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:49:31.926 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:49:31.929 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:49:31.929 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:49:31.944 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:31.943+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:31.972 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:31.972 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:31.981 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:32.045 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:32.044+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:32.087 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:32.087 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:32.095 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:32.180 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:32.179+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:32.237 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:32.237 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:32.246 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:32.246 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:32.245+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:32.347 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:32.346+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:32.389 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:32.389 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:32.397 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:32.448 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:32.447+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:32.501 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:32.502 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:32.511 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:32.549 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:32.547+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:32.612 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:32.613 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:32.621 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:32.665 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:32.664+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:32.724 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:32.724 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:32.733 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:32.774 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:32.773+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:32.837 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:32.837 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:32.845 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:32.852 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:32.851+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:32.947 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:32.947 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:32.952 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:32.952+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:32.956 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:33.053 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:33.052+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:33.057 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:33.057 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:33.066 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:33.154 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:33.153+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:33.170 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:33.170 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:33.178 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:33.255 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:33.254+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:33.280 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:33.280 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:33.289 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:33.356 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:33.355+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:33.431 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:33.431 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:33.440 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:33.457 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:33.456+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:33.543 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:33.543 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:33.553 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:33.557 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:33.556+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:33.644 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:49:33.655 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:33.655 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:33.658 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:33.657+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:33.664 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:33.760 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:33.759+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:33.806 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:33.807 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:33.815 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:33.860 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:33.859+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:33.918 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:33.918 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:33.927 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:33.929 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:49:33.961 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:33.960+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:34.053 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:49:34.053 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:49:34.062 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:34.060+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:34.072 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:49:34.072 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:49:34.072 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:49:34.073 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:34.073 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:34.073 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:49:34.073 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:49:34.073 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:34.075 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:49:34.076 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:49:34.081 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:34.163 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:34.162+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:34.185 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:34.185 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:49:34.185 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:49:34.185 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:49:34.185 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.185 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:49:34.185 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:34.185 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 94.136971548000005, 2024-09-12T22:49:34.186 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:49:34.186 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:34.186 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:34.186 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:34.186 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:34.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.186 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:34.186 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:34.186 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.186 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:34.186 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:34.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:34.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:34.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:49:34.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:34.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:49:34.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:49:34.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:34.188 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:49:34.188 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:49:34.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.188 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.188 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:49:34.188 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:49:34.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.188 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:34.188 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:49:34.188 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:49:34.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:34.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:49:34.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:49:34.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:34.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:49:34.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:49:34.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:34.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:49:34.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:49:34.190 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.190 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:34.190 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.190 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:49:34.190 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:34.190 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 92.136590820999999, 2024-09-12T22:49:34.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:49:34.190 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:34.191 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:34.191 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:34.191 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:34.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.191 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:34.191 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:34.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.191 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:34.191 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:34.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:34.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:49:34.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:49:34.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:34.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:49:34.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:49:34.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:34.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:49:34.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:49:34.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:49:34.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:49:34.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:34.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:49:34.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:49:34.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:34.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:49:34.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:49:34.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:34.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:49:34.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:49:34.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:34.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:49:34.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:49:34.195 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.195 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:34.195 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.195 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:49:34.195 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:34.195 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 89.015994011000004, 2024-09-12T22:49:34.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:49:34.195 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:34.196 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:34.196 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:49:34.196 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:34.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:34.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:34.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:34.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:34.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:34.197 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:34.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:49:34.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:34.197 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:49:34.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:49:34.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:34.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:49:34.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:49:34.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:49:34.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:49:34.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:34.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:49:34.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:49:34.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:34.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:49:34.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:49:34.199 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.199 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:34.199 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.199 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:34.199 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:34.200 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 89.013385830999994, 2024-09-12T22:49:34.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:49:34.200 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:34.200 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:34.200 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:34.200 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:34.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:34.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:34.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:34.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:34.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:34.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:49:34.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:49:34.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:34.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:49:34.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:49:34.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:34.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:49:34.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:49:34.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:49:34.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:49:34.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:34.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:49:34.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:49:34.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.203 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:34.203 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:49:34.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:49:34.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.203 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:34.203 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:49:34.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:49:34.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:34.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:49:34.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:49:34.204 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.204 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:34.204 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.204 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:34.204 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:34.204 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 89.012492608000002, 2024-09-12T22:49:34.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:49:34.205 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:34.205 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:34.205 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:34.205 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:34.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:34.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:34.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:34.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:34.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:34.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:49:34.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:49:34.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:34.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:49:34.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:49:34.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:34.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:49:34.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:49:34.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:49:34.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:49:34.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:34.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:49:34.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:49:34.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:34.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:49:34.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:49:34.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:34.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:49:34.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:49:34.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:34.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:49:34.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:49:34.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.209 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:34.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:49:34.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:49:34.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.209 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:34.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:49:34.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:49:34.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:34.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:49:34.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:49:34.210 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.210 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:34.210 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.210 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:34.210 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:34.211 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 89.012420950000006, 2024-09-12T22:49:34.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:49:34.211 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:34.211 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:34.211 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:34.211 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:34.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:34.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:34.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:34.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:34.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:34.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:49:34.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:49:34.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:34.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:49:34.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:49:34.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:34.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:49:34.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:49:34.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:49:34.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:49:34.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:34.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:49:34.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:49:34.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:34.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:49:34.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:49:34.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:34.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:49:34.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:49:34.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:34.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:49:34.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:49:34.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.215 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:34.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:49:34.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:49:34.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.215 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:34.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:49:34.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:49:34.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:34.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:49:34.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:49:34.216 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.216 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:34.216 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.216 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:34.217 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:34.217 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 89.012378232000003, 2024-09-12T22:49:34.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:49:34.217 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:34.217 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:34.217 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:34.217 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:34.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:34.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:34.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:34.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:34.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:34.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:49:34.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:49:34.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:34.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:49:34.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:49:34.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:34.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:49:34.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:49:34.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:49:34.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:49:34.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:34.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:49:34.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:49:34.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:34.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:49:34.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:49:34.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:34.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:49:34.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:49:34.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:34.221 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:49:34.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:49:34.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.221 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:34.221 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:49:34.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:49:34.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.221 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:34.221 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:49:34.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:49:34.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:34.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:49:34.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:49:34.222 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.222 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:34.222 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.222 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:34.222 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:34.222 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 89.012340315000003, 2024-09-12T22:49:34.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:49:34.223 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:34.223 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:34.223 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:34.223 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:34.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:34.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:34.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:34.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:34.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:34.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:49:34.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:49:34.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:34.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:49:34.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:49:34.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:34.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:49:34.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:49:34.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:49:34.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:49:34.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:34.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:49:34.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:49:34.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:34.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:49:34.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:49:34.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:34.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:34.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:49:34.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:34.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:49:34.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:49:34.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:34.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:49:34.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:49:34.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:34.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:49:34.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:49:34.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:34.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:49:34.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:49:34.230 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.230 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:34.230 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.230 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:34.230 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:34.230 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 89.012316863999999, 2024-09-12T22:49:34.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:49:34.231 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:34.231 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:34.231 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:34.231 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:34.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:34.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:34.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:34.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:34.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:34.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:49:34.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:49:34.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:34.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:49:34.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:49:34.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.233 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:34.233 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:49:34.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:49:34.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.233 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.233 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:49:34.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:49:34.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.233 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:34.233 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:49:34.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:49:34.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:34.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:49:34.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:49:34.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:34.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:34.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:49:34.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:34.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:49:34.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:49:34.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:34.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:49:34.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:49:34.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:34.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:49:34.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:49:34.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:34.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:49:34.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:49:34.236 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.236 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:34.236 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.236 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:34.236 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:34.236 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 89.012292626999994, 2024-09-12T22:49:34.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:49:34.237 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:34.237 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:34.237 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:34.237 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:34.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:34.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:34.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:34.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:34.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:34.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:34.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:49:34.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:34.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:49:34.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:49:34.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:34.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:49:34.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:49:34.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:49:34.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:49:34.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:34.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:49:34.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:49:34.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:34.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:49:34.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:49:34.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:34.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:49:34.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:49:34.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:34.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:49:34.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:49:34.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:34.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:49:34.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:49:34.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:34.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:49:34.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:49:34.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:34.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:49:34.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:49:34.242 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.242 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:34.242 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.242 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:34.242 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:34.242 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 89.012264709999997, 2024-09-12T22:49:34.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:49:34.242 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:34.243 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:34.243 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:34.243 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:34.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:34.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:34.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:34.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:34.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:34.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:34.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:49:34.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:34.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:49:34.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:49:34.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:34.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:49:34.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:49:34.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:49:34.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:49:34.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:34.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:49:34.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:49:34.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:34.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:49:34.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:49:34.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:34.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:49:34.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:49:34.246 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.246 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:34.246 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.246 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:34.246 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:34.247 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 89.012190215000004, 2024-09-12T22:49:34.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:49:34.247 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:34.247 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:34.247 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:34.247 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:34.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:34.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:34.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:34.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:34.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:34.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:49:34.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:49:34.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:34.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:49:34.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:49:34.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:34.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:49:34.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:49:34.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:49:34.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:49:34.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:34.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:49:34.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:49:34.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:49:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:49:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:49:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:49:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:34.251 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:34.251 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 89.012144187000004, 2024-09-12T22:49:34.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:49:34.251 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:34.251 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:34.251 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:34.251 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:34.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:34.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:34.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:34.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:34.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:34.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:49:34.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:49:34.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:34.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:49:34.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:49:34.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:34.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:49:34.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:49:34.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:49:34.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:49:34.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:34.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:49:34.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:49:34.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:34.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:49:34.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:49:34.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:34.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:49:34.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:49:34.254 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.254 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:34.254 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.255 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:34.255 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:34.255 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 89.009973302999995, 2024-09-12T22:49:34.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:49:34.255 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:34.255 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:34.255 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:34.255 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:34.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:34.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:34.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:34.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:34.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:34.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:34.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:49:34.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:34.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:49:34.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:49:34.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:34.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:49:34.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:49:34.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:34.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:49:34.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:34.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:49:34.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:49:34.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:34.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:34.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:49:34.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:34.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:49:34.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:49:34.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:34.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:49:34.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:49:34.259 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.259 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:34.259 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.259 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:34.259 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:34.259 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 89.009922853000006, 2024-09-12T22:49:34.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:49:34.260 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:34.260 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:34.260 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:34.260 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:34.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:34.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:34.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:34.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:34.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:34.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:49:34.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:49:34.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:34.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:49:34.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:49:34.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:34.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:49:34.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:49:34.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:49:34.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:49:34.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:34.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:49:34.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:49:34.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:34.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:49:34.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:49:34.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:34.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:49:34.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:49:34.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:34.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:49:34.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:49:34.264 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.264 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:34.264 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.264 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:34.264 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:34.265 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 89.009869414999997, 2024-09-12T22:49:34.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:49:34.265 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:34.265 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:34.265 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:34.265 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:34.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:34.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:34.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:34.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:34.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:34.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:34.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:49:34.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:34.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:49:34.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:49:34.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:34.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:34.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:49:34.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:49:34.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:49:34.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:34.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:49:34.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:49:34.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:34.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:49:34.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:49:34.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:34.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:49:34.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:49:34.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:34.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:49:34.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:49:34.269 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.269 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:34.269 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.269 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:49:34.269 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:34.269 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 89.005885062000004, 2024-09-12T22:49:34.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:49:34.270 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:34.270 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:34.270 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:34.270 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:34.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:34.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:34.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:34.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:34.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:34.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:49:34.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:49:34.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:34.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:49:34.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:49:34.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:34.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:49:34.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:49:34.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:49:34.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:49:34.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:34.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:49:34.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:49:34.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:34.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:49:34.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:49:34.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:34.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:49:34.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:49:34.273 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.273 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:34.273 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.273 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:49:34.274 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:34.274 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 87.020732523000007, 2024-09-12T22:49:34.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:49:34.274 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:34.274 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:34.274 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:34.274 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:34.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:34.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:34.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:34.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:34.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:34.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:49:34.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:49:34.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:34.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:49:34.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:49:34.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:34.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:49:34.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:49:34.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:49:34.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:49:34.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:34.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:49:34.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:49:34.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:34.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:49:34.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:49:34.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:34.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:49:34.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:49:34.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:34.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:49:34.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:49:34.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:34.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:49:34.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:49:34.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:34.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:49:34.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:49:34.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:34.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:49:34.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:49:34.279 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.279 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:34.279 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.279 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:49:34.279 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:34.280 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.018816278000003, 2024-09-12T22:49:34.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:49:34.280 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:34.280 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:34.280 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:34.280 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:34.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:34.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:34.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:34.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:34.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:34.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:49:34.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:49:34.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:34.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:49:34.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:49:34.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:34.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:49:34.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:49:34.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:49:34.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:49:34.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:34.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:49:34.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:49:34.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:34.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:49:34.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:49:34.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:34.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:49:34.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:49:34.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:34.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:49:34.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:49:34.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:34.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:49:34.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:49:34.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:34.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:49:34.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:49:34.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:34.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:49:34.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:49:34.285 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.286 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:34.286 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.286 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:49:34.286 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:34.286 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.018062903000001, 2024-09-12T22:49:34.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012160610000000001, 2024-09-12T22:49:34.286 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:34.286 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:34.286 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:34.286 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:34.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:34.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:34.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:34.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:34.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:34.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:34.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164967+0000", 2024-09-12T22:49:34.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:49:34.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:34.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164974+0000", 2024-09-12T22:49:34.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:49:34.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:34.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164987+0000", 2024-09-12T22:49:34.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3689000000000001e-05 2024-09-12T22:49:34.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164995+0000", 2024-09-12T22:49:34.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2959999999999999e-06 2024-09-12T22:49:34.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:34.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165068+0000", 2024-09-12T22:49:34.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2449999999999999e-05 2024-09-12T22:49:34.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:34.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165212+0000", 2024-09-12T22:49:34.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144117 2024-09-12T22:49:34.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:34.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166066+0000", 2024-09-12T22:49:34.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085441100000000002 2024-09-12T22:49:34.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:34.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166107+0000", 2024-09-12T22:49:34.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0450000000000001e-05 2024-09-12T22:49:34.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:34.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:34.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:34.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166181+0000", 2024-09-12T22:49:34.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-12T22:49:34.291 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.291 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:34.291 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.291 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:34.291 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:34.291 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:34.293 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:34.293 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:34.291+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:34.393 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:34.392+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:34.396 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:34.396 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:34.397 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:49:34.397 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:34.406 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:34.494 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:34.493+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:34.549 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:34.549 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:34.549 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:49:34.549 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:49:34.549 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:34.559 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:34.583 INFO:teuthology.orchestra.run.smithi066.stderr:noscrub is set 2024-09-12T22:49:34.601 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:34.600+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:34.696 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:34.695+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:34.704 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:34.704 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:49:34.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:49:34.705 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:49:34.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.705 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:49:34.705 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:34.705 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 98.318823287000001, 2024-09-12T22:49:34.705 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:49:34.705 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:34.705 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:34.705 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:34.705 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:34.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.705 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:34.705 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:34.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:34.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:34.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:34.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:34.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:49:34.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:34.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:49:34.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:49:34.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:34.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:49:34.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:49:34.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:49:34.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:49:34.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.708 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:34.708 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:49:34.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:49:34.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.708 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:34.708 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:49:34.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:49:34.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.709 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:34.709 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:49:34.709 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:49:34.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.709 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.709 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:34.709 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:49:34.709 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:49:34.709 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.709 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:34.709 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.709 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.710 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:49:34.710 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:34.710 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 98.318380704000006, 2024-09-12T22:49:34.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:49:34.710 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:34.710 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:34.710 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:34.710 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:34.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:34.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:34.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:34.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:34.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:34.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:49:34.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:49:34.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:34.712 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:49:34.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:49:34.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:34.712 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:49:34.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:49:34.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.712 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:49:34.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:49:34.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.713 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:34.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:49:34.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:49:34.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.713 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:34.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:49:34.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:49:34.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.713 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:34.714 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:49:34.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:49:34.714 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.714 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.714 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:34.714 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:49:34.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:49:34.714 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.714 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:34.714 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.714 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.714 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.715 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:49:34.715 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:34.715 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 98.318014547000004, 2024-09-12T22:49:34.715 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:49:34.715 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:34.715 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:34.715 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:34.715 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:34.715 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.715 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:34.715 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:34.715 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:34.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:34.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:34.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:49:34.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:49:34.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:34.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:49:34.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:49:34.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:34.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:49:34.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:49:34.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:49:34.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:49:34.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.718 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:34.718 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:49:34.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:49:34.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.718 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:34.718 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:49:34.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:49:34.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.718 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:34.718 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:49:34.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:49:34.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:34.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:49:34.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:49:34.719 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.719 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:34.719 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.719 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:49:34.719 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:34.719 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 98.317602234999995, 2024-09-12T22:49:34.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:49:34.720 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:34.720 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:34.720 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:34.720 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:34.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.720 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:34.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:34.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.720 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:34.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:34.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:34.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:34.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:49:34.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:34.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:49:34.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:49:34.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:34.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:49:34.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:49:34.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:49:34.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:49:34.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:34.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:49:34.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:49:34.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:34.723 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:49:34.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:49:34.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.723 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:34.723 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:49:34.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:49:34.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.723 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:34.723 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:49:34.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:49:34.723 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.723 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:34.724 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.724 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:49:34.724 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:34.724 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 98.183752140999999, 2024-09-12T22:49:34.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:49:34.724 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:34.724 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:34.725 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:34.725 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:34.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:34.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:34.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:34.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:34.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.726 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:34.726 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:34.726 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:49:34.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.726 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:34.726 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:49:34.726 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:49:34.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.726 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:34.726 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:49:34.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:49:34.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:49:34.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:49:34.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:34.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:49:34.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:49:34.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:34.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:49:34.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:49:34.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:34.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:49:34.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:49:34.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:34.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:49:34.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:49:34.729 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.729 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:34.729 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.729 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:34.729 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:34.729 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.538516587000004, 2024-09-12T22:49:34.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:49:34.729 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:34.730 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:34.730 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:34.730 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:34.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:34.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:34.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:34.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:34.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:34.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:49:34.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:49:34.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:34.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:49:34.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:49:34.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:34.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:49:34.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:49:34.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.732 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.732 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:49:34.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:49:34.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.732 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:34.732 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:34.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:49:34.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:34.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:34.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:49:34.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:34.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:49:34.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:49:34.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:34.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:49:34.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:49:34.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:34.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:49:34.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:49:34.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:34.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:49:34.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:49:34.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:34.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:49:34.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:49:34.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:34.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:49:34.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:49:34.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:34.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:49:34.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:49:34.736 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.736 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:34.736 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.736 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:34.736 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:34.736 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.538417069999994, 2024-09-12T22:49:34.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:49:34.736 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:34.736 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:34.737 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:34.737 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:34.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:34.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:34.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:34.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:34.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.738 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:34.738 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:49:34.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:49:34.738 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.738 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:34.738 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:49:34.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:49:34.738 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.738 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:34.738 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:49:34.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:49:34.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.739 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.739 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:49:34.739 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:49:34.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.739 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:34.739 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:49:34.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:49:34.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:34.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:49:34.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:49:34.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:34.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:49:34.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:49:34.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:34.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:49:34.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:49:34.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:34.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:49:34.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:49:34.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.742 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:34.742 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:49:34.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:49:34.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.742 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:34.742 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:49:34.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:49:34.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.742 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:34.742 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:49:34.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:49:34.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.743 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:34.743 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:49:34.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:49:34.743 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.743 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:34.743 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.743 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:34.743 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:34.743 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.538372331000005, 2024-09-12T22:49:34.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:49:34.744 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:34.744 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:34.744 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:34.744 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:34.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:34.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:34.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:34.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:34.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:34.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:49:34.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:49:34.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:34.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:34.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:49:34.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:34.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:34.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:49:34.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:49:34.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:49:34.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:34.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:49:34.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:49:34.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:34.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:49:34.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:49:34.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:34.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:49:34.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:49:34.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:34.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:49:34.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:49:34.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.748 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:34.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:49:34.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:49:34.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.748 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:34.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:49:34.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:49:34.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.749 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:34.749 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:49:34.749 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:49:34.749 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.749 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:34.749 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:49:34.749 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:49:34.749 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.749 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:34.749 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:49:34.749 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:49:34.750 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.750 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:34.750 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.750 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:34.750 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:34.750 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.538144630000005, 2024-09-12T22:49:34.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:49:34.750 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:34.750 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:34.750 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:34.750 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:34.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:34.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:34.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:34.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:34.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:34.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:49:34.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:49:34.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:34.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:49:34.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:49:34.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:34.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:49:34.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:49:34.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:49:34.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:49:34.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:34.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:49:34.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:49:34.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:34.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:49:34.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:49:34.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:34.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:49:34.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:49:34.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:34.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:49:34.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:49:34.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:34.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:49:34.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:49:34.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:34.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:49:34.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:49:34.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:34.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:49:34.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:49:34.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:34.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:49:34.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:49:34.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:34.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:49:34.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:49:34.756 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.756 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:34.756 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.756 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:34.757 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:34.757 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.537979522000001, 2024-09-12T22:49:34.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:49:34.757 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:34.757 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:34.757 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:34.757 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:34.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:34.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:34.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:34.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:34.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:34.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:49:34.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:49:34.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:34.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:49:34.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:49:34.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:34.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:49:34.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:49:34.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:49:34.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:49:34.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:34.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:49:34.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:49:34.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:34.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:49:34.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:49:34.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:34.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:49:34.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:49:34.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:34.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:49:34.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:49:34.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:34.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:49:34.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:49:34.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:34.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:49:34.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:49:34.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:34.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:49:34.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:49:34.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:34.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:49:34.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:49:34.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:34.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:49:34.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:49:34.763 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.763 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:34.763 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.763 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:34.763 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:34.763 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.537918237, 2024-09-12T22:49:34.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:49:34.764 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:34.764 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:34.764 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:34.764 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:34.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:34.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:34.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:34.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:34.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:34.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:34.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:49:34.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:34.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:49:34.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:49:34.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:34.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:49:34.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:49:34.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:49:34.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:49:34.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:34.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:49:34.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:49:34.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:34.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:49:34.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:49:34.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:34.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:49:34.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:49:34.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:34.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:49:34.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:49:34.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:34.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:49:34.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:49:34.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:34.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:49:34.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:49:34.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:34.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:49:34.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:49:34.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:34.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:49:34.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:49:34.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:34.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:49:34.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:49:34.770 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.770 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:34.770 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.770 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:34.770 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:34.770 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.537838128999994, 2024-09-12T22:49:34.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:49:34.770 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:34.771 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:34.771 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:34.771 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:34.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:34.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:34.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:34.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:34.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:34.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:49:34.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:49:34.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:34.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:49:34.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:49:34.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:34.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:49:34.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:49:34.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:49:34.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:49:34.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:34.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:49:34.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:49:34.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:34.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:49:34.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:49:34.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:34.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:49:34.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:49:34.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:34.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:49:34.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:49:34.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:34.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:49:34.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:49:34.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:34.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:49:34.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:49:34.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:34.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:49:34.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:49:34.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:34.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:49:34.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:49:34.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:34.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:49:34.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:49:34.776 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.776 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:34.776 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.777 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:34.777 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:34.777 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.537789176000004, 2024-09-12T22:49:34.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:49:34.777 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:34.777 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:34.777 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:34.777 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:34.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:34.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:34.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:34.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:34.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:34.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:34.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:49:34.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:34.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:49:34.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:49:34.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:34.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:49:34.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:49:34.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:49:34.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:49:34.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:34.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:49:34.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:49:34.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:34.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:49:34.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:49:34.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:34.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:49:34.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:49:34.781 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.781 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:34.781 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.781 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:34.781 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:34.781 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.537740076000006, 2024-09-12T22:49:34.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:49:34.781 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:34.782 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:34.782 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:34.782 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:34.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:34.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:34.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:34.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:34.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:34.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:49:34.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:49:34.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:34.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:49:34.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:49:34.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:34.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:49:34.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:49:34.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:49:34.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:49:34.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:34.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:49:34.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:49:34.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:34.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:49:34.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:49:34.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:34.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:49:34.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:49:34.903 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.904 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:34.904 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.904 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.904 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.904 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:34.904 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:34.904 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.530799626000004, 2024-09-12T22:49:34.904 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:49:34.904 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:34.904 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:34.904 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:34.905 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:34.905 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.905 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:34.905 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:34.905 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.905 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.905 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.905 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:34.905 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:34.905 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.905 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.905 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.905 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:34.906 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:49:34.906 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:49:34.906 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.906 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.906 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:34.906 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:49:34.906 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:49:34.906 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.906 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.906 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:34.906 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:49:34.906 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:49:34.906 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.907 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.907 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.907 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:49:34.907 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:49:34.907 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.907 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.907 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:34.907 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:49:34.907 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:49:34.907 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.907 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.907 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:34.907 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:49:34.908 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:49:34.908 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.908 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.908 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:34.908 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:49:34.908 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:49:34.908 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.908 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.908 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:34.908 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:49:34.908 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:49:34.908 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.908 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:34.909 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.909 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.909 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.909 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:34.909 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:34.909 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.529710785999995, 2024-09-12T22:49:34.909 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:49:34.909 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:34.909 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:34.909 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:34.909 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:34.909 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.910 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:34.910 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:34.910 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.910 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.910 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:34.910 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:34.910 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.910 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.910 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:34.910 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:49:34.910 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:49:34.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.911 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:34.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:49:34.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:49:34.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.911 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:34.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:49:34.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:49:34.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.911 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:49:34.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:49:34.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.912 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.912 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:34.912 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:49:34.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:49:34.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.912 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.912 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:34.912 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:49:34.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:49:34.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.912 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.913 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:34.913 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:49:34.913 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:49:34.913 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.913 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.913 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:34.913 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:49:34.913 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:49:34.913 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.913 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:34.913 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.913 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.913 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.914 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:34.914 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:34.914 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.529661175000001, 2024-09-12T22:49:34.914 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:49:34.914 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:34.914 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:34.914 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:34.914 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:34.914 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.914 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:34.914 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:34.914 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.914 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.915 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.915 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:34.915 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:34.915 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.915 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.915 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.915 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:34.915 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:34.915 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:49:34.915 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.915 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.915 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:34.915 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:34.916 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:49:34.916 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.916 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.916 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:34.916 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:49:34.916 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:49:34.916 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.916 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.916 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.916 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:49:34.916 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:49:34.916 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.917 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.917 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:34.917 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:49:34.917 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:49:34.917 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.917 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.917 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:34.917 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:49:34.917 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:49:34.917 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.917 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.917 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:34.917 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:49:34.918 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:49:34.918 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.918 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.918 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:34.918 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:49:34.918 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:49:34.918 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.918 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:34.918 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.918 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.918 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.918 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:34.918 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:34.919 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.529593865999999, 2024-09-12T22:49:34.919 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:49:34.919 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:34.919 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:34.919 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:34.919 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:34.919 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.919 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:34.919 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:34.919 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.919 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.919 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.919 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:34.919 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:34.920 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.920 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.920 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.920 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:34.920 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:34.920 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:49:34.920 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.920 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.920 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:34.920 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:49:34.920 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:49:34.921 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.921 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.921 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:34.921 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:49:34.921 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:49:34.921 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.921 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.921 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.921 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:49:34.921 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:49:34.921 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.921 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.921 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:34.922 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:49:34.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:49:34.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.922 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.922 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:34.922 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:49:34.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:49:34.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.922 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.922 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:34.922 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:49:34.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:49:34.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.923 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.923 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:34.923 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:49:34.923 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:49:34.923 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.923 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:34.923 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.923 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.923 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.923 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:34.923 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:34.923 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.529025946999994, 2024-09-12T22:49:34.923 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:49:34.923 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:34.924 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:34.924 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:34.924 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:34.924 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.924 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:34.924 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:34.924 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.924 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.924 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.924 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:34.924 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:34.924 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.924 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.925 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.925 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:34.925 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:34.925 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:49:34.925 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.925 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.925 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:34.925 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:49:34.925 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:49:34.925 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.925 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.925 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:34.925 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:49:34.925 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:49:34.926 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.926 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.926 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.926 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:49:34.926 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:49:34.926 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.926 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.926 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:34.926 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:49:34.926 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:49:34.926 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.926 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.927 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:34.927 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:49:34.927 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:49:34.927 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.927 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.927 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:34.927 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:49:34.927 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:49:34.927 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.927 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.927 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:34.927 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:49:34.927 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:49:34.928 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.928 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:34.928 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.928 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.928 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.928 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:49:34.928 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:34.928 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.528648343, 2024-09-12T22:49:34.928 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:49:34.928 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:34.928 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:34.928 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:34.928 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:34.929 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.929 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:34.929 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:34.929 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.929 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.929 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.929 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:34.929 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:34.929 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:34.929 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.929 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.929 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:34.929 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:49:34.930 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:49:34.930 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.930 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.930 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:34.930 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:49:34.930 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:49:34.930 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.930 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.930 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:34.930 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:49:34.930 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:49:34.930 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.930 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.930 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:34.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:49:34.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:49:34.931 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.931 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.931 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:34.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:49:34.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:49:34.931 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.931 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.931 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:34.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:49:34.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:49:34.931 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.931 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.932 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:34.932 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:49:34.932 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:49:34.932 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:34.932 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:34.932 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:34.932 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:49:34.932 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:49:34.932 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.932 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:34.933 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.933 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:34.933 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:34.933 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:34.934 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:34.935 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:34.933+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:35.036 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:35.034+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:35.044 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:35.044 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:35.044 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:49:35.044 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:35.053 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:35.136 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:35.135+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:35.156 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:35.156 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:35.157 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:49:35.157 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:49:35.157 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:35.165 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:35.236 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:35.236+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:35.309 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:35.309 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:49:35.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:49:35.310 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:49:35.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.310 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:49:35.310 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:35.310 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 95.261372367999996, 2024-09-12T22:49:35.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:49:35.310 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:35.310 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:35.310 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:35.310 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:35.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:35.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:35.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:35.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:35.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:35.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:35.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:49:35.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:35.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:49:35.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:49:35.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:35.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:49:35.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:49:35.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:49:35.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:49:35.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:35.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:49:35.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:49:35.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:35.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:49:35.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:49:35.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:35.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:49:35.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:49:35.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:35.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:49:35.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:49:35.315 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.315 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:35.315 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.315 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:49:35.316 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:35.316 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 93.260991641000004, 2024-09-12T22:49:35.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:49:35.316 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:35.316 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:35.316 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:35.316 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:35.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:35.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:35.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:35.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:35.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:35.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:49:35.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:49:35.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:35.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:49:35.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:49:35.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:35.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:49:35.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:49:35.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:49:35.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:49:35.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:35.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:49:35.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:49:35.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:35.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:49:35.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:49:35.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:35.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:49:35.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:49:35.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:35.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:49:35.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:49:35.320 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.320 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:35.320 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.321 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:49:35.321 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:35.321 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 90.140394830999995, 2024-09-12T22:49:35.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:49:35.321 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:35.321 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:35.321 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:49:35.321 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:35.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:35.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:35.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:35.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:35.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:35.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:35.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:49:35.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:35.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:49:35.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:49:35.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:35.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:49:35.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:49:35.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:49:35.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:49:35.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:35.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:49:35.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:49:35.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:35.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:49:35.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:49:35.324 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.324 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:35.324 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.325 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:35.325 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:35.325 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 90.137786650999999, 2024-09-12T22:49:35.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:49:35.325 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:35.326 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:35.326 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:35.326 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:35.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:35.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:35.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:35.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:35.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:35.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:49:35.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:49:35.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:35.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:49:35.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:49:35.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:35.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:49:35.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:49:35.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:49:35.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:49:35.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:35.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:49:35.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:49:35.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:35.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:49:35.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:49:35.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:35.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:49:35.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:49:35.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:35.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:49:35.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:49:35.330 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.330 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:35.330 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.330 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:35.330 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:35.330 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 90.136893427999993, 2024-09-12T22:49:35.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:49:35.331 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:35.331 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:35.331 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:35.331 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:35.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:35.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:35.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:35.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:35.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:35.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:49:35.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:49:35.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:35.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:49:35.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:49:35.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:35.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:49:35.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:49:35.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:49:35.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:49:35.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:35.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:49:35.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:49:35.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:35.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:49:35.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:49:35.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:35.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:49:35.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:49:35.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:35.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:49:35.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:49:35.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:35.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:49:35.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:49:35.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:35.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:49:35.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:49:35.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:35.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:49:35.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:49:35.336 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.336 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:35.336 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.337 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:35.337 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:35.337 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 90.136821769999997, 2024-09-12T22:49:35.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:49:35.337 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:35.337 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:35.337 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:35.338 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:35.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:35.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:35.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:35.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:35.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:35.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:49:35.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:49:35.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:35.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:49:35.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:49:35.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:35.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:49:35.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:49:35.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:49:35.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:49:35.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:35.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:49:35.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:49:35.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:35.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:49:35.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:49:35.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:35.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:49:35.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:49:35.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:35.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:49:35.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:49:35.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:35.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:49:35.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:49:35.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:35.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:49:35.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:49:35.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:35.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:49:35.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:49:35.344 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.344 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:35.344 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.344 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:35.344 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:35.345 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 90.136779051999994, 2024-09-12T22:49:35.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:49:35.345 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:35.345 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:35.345 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:35.345 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:35.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:35.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:35.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:35.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:35.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:35.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:49:35.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:49:35.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:35.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:49:35.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:49:35.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:35.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:49:35.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:49:35.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:49:35.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:49:35.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:35.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:49:35.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:49:35.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:35.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:49:35.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:49:35.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:35.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:49:35.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:49:35.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:35.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:49:35.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:49:35.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:35.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:49:35.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:49:35.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:35.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:49:35.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:49:35.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:35.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:49:35.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:49:35.350 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.351 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:35.351 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.351 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:35.351 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:35.351 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 90.136741134999994, 2024-09-12T22:49:35.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:49:35.351 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:35.351 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:35.351 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:35.351 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:35.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:35.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:35.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:35.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:35.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:35.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:49:35.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:49:35.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:35.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:49:35.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:49:35.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:35.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:49:35.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:49:35.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:49:35.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:49:35.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:35.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:49:35.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:49:35.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:35.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:49:35.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:49:35.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:35.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:35.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:49:35.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:35.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:49:35.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:49:35.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:35.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:49:35.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:49:35.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:35.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:49:35.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:49:35.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:35.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:49:35.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:49:35.357 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.357 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:35.357 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.358 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:35.358 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:35.358 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 90.136717684000004, 2024-09-12T22:49:35.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:49:35.358 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:35.358 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:35.358 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:35.358 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:35.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:35.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:35.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:35.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:35.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:35.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:49:35.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:49:35.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:35.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:49:35.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:49:35.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:35.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:49:35.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:49:35.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:49:35.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:49:35.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:35.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:49:35.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:49:35.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:35.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:49:35.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:49:35.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:35.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:35.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:49:35.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:35.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:49:35.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:49:35.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:35.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:49:35.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:49:35.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:35.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:49:35.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:49:35.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:35.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:49:35.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:49:35.363 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.363 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:35.364 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.364 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:35.364 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:35.364 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 90.136693446999999, 2024-09-12T22:49:35.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:49:35.364 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:35.364 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:35.364 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:35.364 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:35.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:35.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:35.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:35.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:35.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:35.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:35.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:49:35.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:35.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:49:35.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:49:35.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:35.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:49:35.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:49:35.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:49:35.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:49:35.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:35.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:49:35.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:49:35.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:35.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:49:35.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:49:35.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:35.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:49:35.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:49:35.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:35.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:49:35.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:49:35.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:35.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:49:35.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:49:35.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:35.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:49:35.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:49:35.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:35.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:49:35.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:49:35.370 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.370 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:35.370 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.370 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:35.370 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:35.370 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 90.136665530000002, 2024-09-12T22:49:35.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:49:35.370 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:35.371 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:35.371 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:35.371 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:35.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:35.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:35.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:35.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:35.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:35.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:35.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:49:35.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:35.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:49:35.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:49:35.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:35.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:49:35.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:49:35.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:49:35.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:49:35.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:35.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:49:35.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:49:35.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:35.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:49:35.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:49:35.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:35.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:49:35.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:49:35.375 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.375 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:35.375 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.375 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:35.375 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:35.375 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 90.136591034999995, 2024-09-12T22:49:35.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:49:35.376 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:35.376 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:35.376 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:35.376 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:35.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:35.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:35.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:35.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:35.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:35.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:49:35.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:49:35.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:35.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:49:35.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:49:35.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:35.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:49:35.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:49:35.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:49:35.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:49:35.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:35.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:49:35.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:49:35.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:35.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:49:35.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:49:35.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:35.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:49:35.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:49:35.380 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.380 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:35.380 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.380 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:35.380 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:35.380 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 90.136545006999995, 2024-09-12T22:49:35.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:49:35.381 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:35.381 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:35.381 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:35.381 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:35.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:35.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:35.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:35.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:35.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:35.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:49:35.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:49:35.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:35.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:49:35.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:49:35.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:35.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:49:35.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:49:35.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:49:35.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:49:35.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:35.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:49:35.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:49:35.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:35.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:49:35.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:49:35.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:35.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:49:35.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:49:35.385 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.386 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:35.386 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.386 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:35.386 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:35.387 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 90.134374123000001, 2024-09-12T22:49:35.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:49:35.387 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:35.387 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:35.387 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:35.387 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:35.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:35.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:35.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:35.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:35.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:35.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:35.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:49:35.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:35.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:49:35.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:49:35.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:35.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:49:35.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:49:35.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:35.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:49:35.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:35.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:49:35.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:49:35.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:35.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:35.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:49:35.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:35.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:49:35.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:49:35.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:35.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:49:35.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:49:35.392 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.392 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:35.393 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.393 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:35.393 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:35.393 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 90.134323672999997, 2024-09-12T22:49:35.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:49:35.393 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:35.393 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:35.393 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:35.393 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:35.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:35.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:35.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:35.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:35.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:35.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:49:35.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:49:35.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:35.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:49:35.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:49:35.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:35.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:49:35.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:49:35.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:49:35.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:49:35.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:35.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:49:35.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:49:35.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:35.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:49:35.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:49:35.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:35.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:49:35.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:49:35.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:35.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:49:35.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:49:35.397 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.397 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:35.398 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.398 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:35.398 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:35.398 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 90.134270235000002, 2024-09-12T22:49:35.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:49:35.398 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:35.399 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:35.399 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:35.399 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:35.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:35.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:35.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:35.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:35.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:35.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:35.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:49:35.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:35.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:49:35.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:49:35.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:35.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:35.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:49:35.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:49:35.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:49:35.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:35.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:49:35.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:49:35.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:35.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:49:35.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:49:35.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:35.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:49:35.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:49:35.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:35.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:49:35.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:49:35.403 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.403 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:35.403 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.403 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:49:35.403 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:35.403 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 90.130285881999995, 2024-09-12T22:49:35.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:49:35.404 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:35.404 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:35.404 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:35.404 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:35.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:35.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:35.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:35.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:35.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:35.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:49:35.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:49:35.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:35.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:49:35.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:49:35.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:35.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:49:35.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:49:35.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:49:35.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:49:35.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:35.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:49:35.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:49:35.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:35.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:49:35.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:49:35.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:35.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:49:35.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:49:35.407 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.407 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:35.407 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.408 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:49:35.408 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:35.408 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 88.145133342999998, 2024-09-12T22:49:35.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:49:35.408 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:35.408 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:35.408 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:35.408 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:35.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:35.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:35.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:35.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:35.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:35.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:49:35.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:49:35.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:35.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:49:35.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:49:35.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:35.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:49:35.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:49:35.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:49:35.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:49:35.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:35.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:49:35.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:49:35.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:35.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:49:35.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:49:35.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:35.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:49:35.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:49:35.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:35.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:49:35.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:49:35.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:35.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:49:35.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:49:35.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:35.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:49:35.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:49:35.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:35.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:49:35.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:49:35.413 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.413 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:35.414 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.414 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:49:35.414 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:35.414 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 70.143217097999994, 2024-09-12T22:49:35.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:49:35.414 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:35.414 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:35.414 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:35.414 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:35.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:35.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:35.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:35.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:35.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:35.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:49:35.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:49:35.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:35.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:49:35.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:49:35.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:35.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:49:35.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:49:35.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:49:35.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:49:35.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:35.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:49:35.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:49:35.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:35.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:49:35.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:49:35.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:35.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:49:35.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:49:35.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:35.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:49:35.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:49:35.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:35.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:49:35.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:49:35.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:35.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:49:35.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:49:35.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:35.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:49:35.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:49:35.420 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.420 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:35.420 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.420 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:49:35.420 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:35.421 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 65.142463723000006, 2024-09-12T22:49:35.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012160610000000001, 2024-09-12T22:49:35.421 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:35.421 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:35.421 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:35.421 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:35.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:35.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:35.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:35.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:35.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:35.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:35.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164967+0000", 2024-09-12T22:49:35.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:49:35.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:35.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164974+0000", 2024-09-12T22:49:35.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:49:35.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:35.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164987+0000", 2024-09-12T22:49:35.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3689000000000001e-05 2024-09-12T22:49:35.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164995+0000", 2024-09-12T22:49:35.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2959999999999999e-06 2024-09-12T22:49:35.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:35.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165068+0000", 2024-09-12T22:49:35.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2449999999999999e-05 2024-09-12T22:49:35.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:35.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165212+0000", 2024-09-12T22:49:35.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144117 2024-09-12T22:49:35.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:35.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166066+0000", 2024-09-12T22:49:35.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085441100000000002 2024-09-12T22:49:35.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:35.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166107+0000", 2024-09-12T22:49:35.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0450000000000001e-05 2024-09-12T22:49:35.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:35.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:35.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:35.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166181+0000", 2024-09-12T22:49:35.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-12T22:49:35.425 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.425 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:35.425 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.426 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:35.426 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:35.426 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:35.427 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:35.428 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:35.426+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:35.528 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:35.527+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:35.537 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:35.537 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:35.537 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:49:35.537 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:35.546 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:35.628 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:35.627+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:35.649 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:35.649 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:35.649 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:49:35.650 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:49:35.650 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:35.659 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:35.729 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:35.728+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:35.803 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:35.803 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:49:35.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:49:35.803 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:49:35.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.804 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:49:35.804 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:35.804 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 99.417698864000002, 2024-09-12T22:49:35.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:49:35.804 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:35.804 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:35.804 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:35.804 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:35.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:35.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:35.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:35.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:35.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:35.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:35.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:49:35.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:35.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:49:35.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:49:35.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:35.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:49:35.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:49:35.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:49:35.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:49:35.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:35.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:49:35.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:49:35.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:35.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:49:35.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:49:35.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:35.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:49:35.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:49:35.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:35.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:49:35.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:49:35.808 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.808 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:35.808 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.808 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:49:35.808 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:35.809 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 99.417256280999993, 2024-09-12T22:49:35.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:49:35.809 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:35.809 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:35.809 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:35.809 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:35.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:35.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:35.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:35.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:35.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:35.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:49:35.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:49:35.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:35.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:49:35.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:49:35.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:35.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:49:35.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:49:35.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:49:35.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:49:35.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:35.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:49:35.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:49:35.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:35.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:49:35.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:49:35.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:35.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:49:35.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:49:35.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:35.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:49:35.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:49:35.813 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.813 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:35.813 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.813 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:49:35.813 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:35.813 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 99.416890124000005, 2024-09-12T22:49:35.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:49:35.813 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:35.814 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:35.814 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:35.814 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:35.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:35.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:35.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:35.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:35.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:35.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:49:35.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:49:35.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:35.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:49:35.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:49:35.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:35.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:49:35.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:49:35.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:49:35.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:49:35.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:35.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:49:35.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:49:35.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:35.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:49:35.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:49:35.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:35.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:49:35.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:49:35.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:35.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:49:35.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:49:35.818 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.818 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:35.818 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.818 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:49:35.818 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:35.818 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 99.416477811999997, 2024-09-12T22:49:35.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:49:35.818 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:35.818 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:35.818 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:35.818 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:35.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:35.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:35.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:35.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:35.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:35.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:35.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:49:35.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:35.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:49:35.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:49:35.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:35.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:49:35.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:49:35.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:49:35.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:49:35.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:35.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:49:35.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:49:35.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:35.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:49:35.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:49:35.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:35.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:49:35.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:49:35.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:35.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:49:35.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:49:35.822 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.822 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:35.822 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.823 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:49:35.823 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:35.823 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 99.282627718000001, 2024-09-12T22:49:35.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:49:35.823 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:35.823 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:35.823 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:35.823 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:35.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:35.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:35.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:35.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:35.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:35.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:35.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:49:35.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:35.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:49:35.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:49:35.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:35.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:49:35.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:49:35.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:49:35.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:49:35.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:35.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:49:35.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:49:35.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:35.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:49:35.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:49:35.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:35.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:49:35.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:49:35.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:35.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:49:35.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:49:35.827 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.827 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:35.827 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.827 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:35.827 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:35.828 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 90.637392164000005, 2024-09-12T22:49:35.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:49:35.828 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:35.828 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:35.828 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:35.828 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:35.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:35.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:35.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:35.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:35.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:35.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:49:35.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:49:35.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:35.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:49:35.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:49:35.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:35.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:49:35.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:49:35.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:49:35.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:49:35.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:35.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:35.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:49:35.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:35.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:35.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:49:35.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:35.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:49:35.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:49:35.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:35.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:49:35.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:49:35.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:35.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:49:35.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:49:35.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:35.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:49:35.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:49:35.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:35.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:49:35.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:49:35.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:35.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:49:35.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:49:35.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:35.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:49:35.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:49:35.834 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.834 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:35.834 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.834 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:35.834 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:35.834 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 90.637292646999995, 2024-09-12T22:49:35.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:49:35.834 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:35.834 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:35.834 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:35.834 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:35.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:35.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:35.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:35.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:35.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:35.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:49:35.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:49:35.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:35.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:49:35.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:49:35.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:35.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:49:35.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:49:35.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:49:35.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:49:35.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:35.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:49:35.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:49:35.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:35.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:49:35.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:49:35.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:35.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:49:35.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:49:35.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:35.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:49:35.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:49:35.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:35.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:49:35.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:49:35.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:35.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:49:35.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:49:35.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:35.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:49:35.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:49:35.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:35.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:49:35.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:49:35.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:35.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:49:35.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:49:35.840 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.841 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:35.841 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.841 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:35.841 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:35.841 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 90.637247908000006, 2024-09-12T22:49:35.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:49:35.841 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:35.841 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:35.841 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:35.842 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:35.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:35.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:35.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:35.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:35.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:35.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:49:35.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:49:35.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:35.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:35.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:49:35.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:35.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:35.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:49:35.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:49:35.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:49:35.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:35.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:49:35.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:49:35.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:35.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:49:35.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:49:35.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:35.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:49:35.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:49:35.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:35.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:49:35.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:49:35.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:35.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:49:35.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:49:35.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:35.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:49:35.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:49:35.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:35.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:49:35.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:49:35.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:35.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:49:35.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:49:35.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:35.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:49:35.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:49:35.848 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.848 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:35.848 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.848 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:35.848 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:35.848 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 90.637020207000006, 2024-09-12T22:49:35.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:49:35.848 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:35.849 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:35.849 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:35.849 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:35.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:35.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:35.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:35.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:35.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:35.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:49:35.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:49:35.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:35.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:49:35.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:49:35.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:35.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:49:35.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:49:35.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:49:35.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:49:35.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:35.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:49:35.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:49:35.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:35.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:49:35.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:49:35.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:35.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:49:35.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:49:35.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:35.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:49:35.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:49:35.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:35.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:49:35.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:49:35.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:35.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:49:35.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:49:35.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:35.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:49:35.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:49:35.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:35.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:49:35.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:49:35.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:35.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:49:35.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:49:35.855 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.855 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:35.855 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.855 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:35.855 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:35.855 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 90.636855099000002, 2024-09-12T22:49:35.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:49:35.855 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:35.855 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:35.855 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:35.855 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:35.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:35.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:35.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:35.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:35.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:35.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:49:35.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:49:35.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:35.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:49:35.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:49:35.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:35.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:49:35.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:49:35.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:49:35.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:49:35.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:35.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:49:35.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:49:35.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:35.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:49:35.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:49:35.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:35.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:49:35.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:49:35.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:35.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:49:35.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:49:35.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:35.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:49:35.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:49:35.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:35.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:49:35.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:49:35.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:35.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:49:35.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:49:35.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:35.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:49:35.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:49:35.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:35.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:49:35.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:49:35.861 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.861 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:35.861 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.861 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:35.861 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:35.861 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 90.636793814000001, 2024-09-12T22:49:35.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:49:35.862 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:35.862 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:35.862 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:35.862 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:35.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:35.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:35.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:35.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:35.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:35.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:35.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:49:35.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:35.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:49:35.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:49:35.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:35.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:49:35.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:49:35.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:49:35.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:49:35.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:35.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:49:35.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:49:35.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:35.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:49:35.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:49:35.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:35.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:49:35.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:49:35.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:35.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:49:35.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:49:35.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:35.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:49:35.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:49:35.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:35.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:49:35.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:49:35.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:35.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:49:35.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:49:35.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:35.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:49:35.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:49:35.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:35.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:49:35.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:49:35.868 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.868 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:35.868 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.868 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:35.868 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:35.868 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 90.636713705999995, 2024-09-12T22:49:35.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:49:35.868 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:35.868 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:35.869 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:35.869 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:35.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:35.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:35.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:35.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:35.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:35.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:49:35.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:49:35.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:35.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:49:35.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:49:35.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:35.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:49:35.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:49:35.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:49:35.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:49:35.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:35.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:49:35.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:49:35.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:35.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:49:35.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:49:35.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:35.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:49:35.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:49:35.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:35.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:49:35.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:49:35.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:35.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:49:35.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:49:35.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:35.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:49:35.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:49:35.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:35.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:49:35.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:49:35.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.874 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.874 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:35.874 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:49:35.874 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:49:35.874 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.874 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.874 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:35.874 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:49:35.874 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:49:35.874 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.874 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:35.874 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.874 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.875 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:35.875 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:35.875 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 90.636664753000005, 2024-09-12T22:49:35.875 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:49:35.875 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:35.875 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:35.875 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:35.875 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:35.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.875 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:35.875 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:35.875 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.875 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.876 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:35.876 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:35.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.876 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:35.876 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:35.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:49:35.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.876 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:35.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:49:35.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:49:35.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.877 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:35.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:49:35.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:49:35.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.877 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:49:35.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:49:35.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.878 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:35.878 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:49:35.878 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:49:35.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.878 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:35.878 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:49:35.878 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:49:35.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.878 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:35.878 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:49:35.878 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:49:35.879 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.879 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:35.879 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.879 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.879 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:35.879 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:35.879 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 90.636615653000007, 2024-09-12T22:49:35.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:49:35.879 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:35.879 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:35.879 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:35.880 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:35.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.880 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:35.880 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:35.880 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.880 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.880 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:35.880 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:35.880 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.880 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.880 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:35.881 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:49:35.881 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:49:35.881 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.881 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.881 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:35.881 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:49:35.881 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:49:35.881 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.881 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.881 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:35.881 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:49:35.881 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:49:35.881 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.882 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.882 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:49:35.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:49:35.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.882 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:35.882 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:49:35.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:49:35.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.882 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:35.882 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:49:35.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:49:35.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.883 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:35.883 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:49:35.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:49:35.883 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.883 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:35.883 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.883 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:35.883 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:35.883 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 90.629675203000005, 2024-09-12T22:49:35.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:49:35.884 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:35.884 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:35.884 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:35.884 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:35.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:35.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:35.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:35.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:35.885 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:35.885 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:49:35.885 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:49:35.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:35.885 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:49:35.885 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:49:35.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.886 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:35.886 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:49:35.886 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:49:35.886 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.886 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.886 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.886 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:49:35.886 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:49:35.886 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.886 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.886 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:35.886 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:49:35.886 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:49:35.887 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.887 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.887 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:35.887 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:49:35.887 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:49:35.887 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.887 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.887 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:35.887 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:49:35.888 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:49:35.888 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.888 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.888 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:35.888 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:49:35.888 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:49:35.888 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.888 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:35.888 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.888 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.888 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.888 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:35.888 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:35.889 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 90.628586362999997, 2024-09-12T22:49:35.889 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:49:35.889 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:35.889 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:35.889 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:35.889 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:35.889 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.889 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:35.889 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:35.889 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.890 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:35.890 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:35.890 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.890 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.890 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:35.890 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:49:35.890 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:49:35.890 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.890 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:35.890 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:49:35.891 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:49:35.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.891 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.891 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:35.891 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:49:35.891 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:49:35.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.891 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.891 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.891 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:49:35.891 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:49:35.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.891 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.892 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:35.892 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:49:35.892 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:49:35.892 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.892 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.892 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:35.892 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:49:35.892 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:49:35.892 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.892 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.892 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:35.892 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:49:35.892 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:49:35.892 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.893 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:35.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:49:35.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:49:35.893 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.893 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:35.893 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.893 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:35.893 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:35.893 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 90.628536752000002, 2024-09-12T22:49:35.894 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:49:35.894 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:35.894 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:35.894 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:35.894 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:35.894 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.894 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:35.894 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:35.894 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.894 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.894 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.894 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:35.894 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:35.895 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.895 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.895 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.895 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:35.895 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:35.895 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:49:35.895 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.895 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.895 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:35.895 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:35.895 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:49:35.895 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.895 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.895 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:35.896 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:49:35.896 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:49:35.896 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.896 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.896 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.896 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:49:35.896 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:49:35.896 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.896 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.896 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:35.896 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:49:35.896 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:49:35.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.897 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:35.897 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:49:35.897 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:49:35.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.897 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:35.897 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:49:35.897 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:49:35.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.897 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:35.898 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:49:35.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:49:35.898 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.898 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:35.898 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.898 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.898 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.898 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:35.898 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:35.898 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 90.628469443, 2024-09-12T22:49:35.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:49:35.898 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:35.899 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:35.899 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:35.899 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:35.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.899 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:35.899 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:35.899 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.899 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.899 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:35.899 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:35.899 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.900 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.900 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.900 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:35.900 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:35.900 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:49:35.900 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.900 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.900 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:35.900 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:49:35.900 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:49:35.900 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.900 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.901 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:35.901 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:49:35.901 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:49:35.901 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.901 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.901 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.901 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:49:35.901 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:49:35.901 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.901 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.901 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:35.901 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:49:35.902 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:49:35.902 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.902 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.902 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:35.902 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:49:35.902 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:49:35.902 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.902 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.902 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:35.902 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:49:35.902 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:49:35.902 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.902 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.903 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:35.903 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:49:35.903 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:49:35.903 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.903 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:35.903 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.903 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.903 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.903 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:35.903 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:35.903 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 90.627901523999995, 2024-09-12T22:49:35.903 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:49:35.904 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:35.904 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:35.904 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:35.904 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:35.904 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.904 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:35.904 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:35.904 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.904 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.904 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.904 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:35.904 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:35.904 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.905 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.905 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.905 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:35.905 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:35.905 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:49:35.905 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.905 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.905 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:35.905 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:49:35.905 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:49:35.905 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.905 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.906 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:35.906 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:49:35.906 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:49:35.906 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.906 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.906 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.906 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:49:35.906 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:49:35.906 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.906 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.906 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:35.906 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:49:35.907 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:49:35.907 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.907 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.907 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:35.907 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:49:35.907 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:49:35.907 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.907 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.907 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:35.907 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:49:35.907 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:49:35.907 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.908 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.908 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:35.908 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:49:35.908 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:49:35.908 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.908 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:35.908 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.908 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.908 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.908 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:49:35.908 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:35.908 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 90.627523920000002, 2024-09-12T22:49:35.908 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:49:35.909 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:35.909 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:35.909 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:35.909 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:35.909 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.909 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:35.909 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:35.909 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.909 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.909 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.909 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:35.909 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:35.910 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:35.910 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.910 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:35.910 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:49:35.910 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:49:35.910 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.910 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:35.910 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:49:35.910 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:49:35.910 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:35.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:49:35.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:49:35.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.911 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:35.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:49:35.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:49:35.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.911 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:35.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:49:35.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:49:35.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.912 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.912 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:35.912 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:49:35.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:49:35.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.912 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.912 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:35.912 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:49:35.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:49:35.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:35.912 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:35.913 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:35.913 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:49:35.913 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:49:35.913 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.913 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:35.913 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.913 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:35.913 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:35.913 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:35.915 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:35.915 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:35.913+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:36.015 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:36.014+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:36.020 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:36.020 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:36.021 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:49:36.021 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:36.029 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:36.076 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:49:36.116 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:36.115+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:36.173 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:36.173 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:36.173 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:49:36.173 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:49:36.173 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:36.182 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:36.215 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:49:36.215 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:49:36.217 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:36.216+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:36.233 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:49:36.233 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:49:36.233 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:49:36.236 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:49:36.237 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:49:36.317 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~65s 2024-09-12T22:49:36.318 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:36.317+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:36.324 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:36.324 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:36.333 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:36.419 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:36.418+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:36.436 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:36.437 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:36.446 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:36.519 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:36.518+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:36.549 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:36.549 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:36.557 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:36.599 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:49:36.620 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:36.619+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:36.701 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:36.701 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:36.710 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:36.754 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:36.753+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:36.813 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:36.813 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:36.822 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:36.822 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:36.820+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:36.922 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:36.921+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:36.965 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:36.965 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:36.973 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:37.023 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:37.022+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:37.075 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:37.076 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:37.084 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:37.128 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:37.127+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:37.188 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:37.189 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:37.197 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:37.238 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:37.237+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:37.326 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:37.326+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:37.339 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:37.339 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:37.348 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:37.427 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:37.426+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:37.451 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:37.451 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:37.460 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:37.528 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:37.527+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:37.564 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:37.564 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:37.573 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:37.594 INFO:teuthology.orchestra.run.smithi066.stderr:nodeep-scrub is set 2024-09-12T22:49:37.628 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:37.627+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:37.676 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:37.677 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:37.685 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:37.769 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:37.768+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:37.827 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:37.827 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:37.829 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:37.828+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:37.836 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:37.931 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:37.930+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:37.940 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:37.940 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:37.948 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:38.031 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:38.030+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:38.050 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:38.050 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:38.059 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:38.143 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:38.142+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:38.202 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:38.202 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:38.211 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:38.237 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:49:38.255 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:38.254+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:38.316 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:38.317 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:38.325 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:38.334 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:38.333+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:38.376 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:49:38.376 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:49:38.393 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:49:38.394 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:49:38.394 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:49:38.397 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:49:38.397 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:49:38.435 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:38.434+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:38.468 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:38.468 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:38.469 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:49:38.469 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:49:38.469 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:38.477 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:38.535 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:38.534+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:38.621 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:38.622 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:49:38.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:49:38.622 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:49:38.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.622 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:49:38.622 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:38.622 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 98.573663569999994, 2024-09-12T22:49:38.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045271590000000002, 2024-09-12T22:49:38.622 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:38.622 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:38.622 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:38.623 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:38.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:38.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:38.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:38.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:38.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:38.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046057+0000", 2024-09-12T22:49:38.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3700000000000001e-07 2024-09-12T22:49:38.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:38.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046062+0000", 2024-09-12T22:49:38.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1780000000000002e-06 2024-09-12T22:49:38.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:38.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046078+0000", 2024-09-12T22:49:38.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.592e-05 2024-09-12T22:49:38.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:38.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046089+0000", 2024-09-12T22:49:38.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0491e-05 2024-09-12T22:49:38.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:38.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046136+0000", 2024-09-12T22:49:38.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7769999999999998e-05 2024-09-12T22:49:38.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:38.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.046159+0000", 2024-09-12T22:49:38.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2889000000000001e-05 2024-09-12T22:49:38.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:38.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050547+0000", 2024-09-12T22:49:38.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043879749999999997 2024-09-12T22:49:38.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:38.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:00.050584+0000", 2024-09-12T22:49:38.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6599e-05 2024-09-12T22:49:38.626 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.626 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:38.627 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.627 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4208.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:49:38.627 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:38.627 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 96.573282843000001, 2024-09-12T22:49:38.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055292229999999998, 2024-09-12T22:49:38.627 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:38.627 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:38.627 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:38.627 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:38.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:38.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:38.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:38.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046437+0000", 2024-09-12T22:49:38.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:38.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046438+0000", 2024-09-12T22:49:38.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:49:38.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:38.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046442+0000", 2024-09-12T22:49:38.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:49:38.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:38.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046453+0000", 2024-09-12T22:49:38.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2024-09-12T22:49:38.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:38.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046462+0000", 2024-09-12T22:49:38.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.679e-06 2024-09-12T22:49:38.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:38.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046517+0000", 2024-09-12T22:49:38.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4811000000000001e-05 2024-09-12T22:49:38.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:38.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.046540+0000", 2024-09-12T22:49:38.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2883000000000001e-05 2024-09-12T22:49:38.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:38.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051928+0000", 2024-09-12T22:49:38.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053884140000000002 2024-09-12T22:49:38.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:38.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:02.051967+0000", 2024-09-12T22:49:38.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8303000000000002e-05 2024-09-12T22:49:38.631 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.631 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:38.631 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.632 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 0 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:49:38.632 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:38.632 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 93.452686033000006, 2024-09-12T22:49:38.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033229470000000001, 2024-09-12T22:49:38.632 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:38.632 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:38.632 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:49:38.632 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:38.632 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.632 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:38.632 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:38.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:38.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:38.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:38.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167034+0000", 2024-09-12T22:49:38.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:49:38.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:38.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167044+0000", 2024-09-12T22:49:38.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5759999999999995e-06 2024-09-12T22:49:38.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:38.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167070+0000", 2024-09-12T22:49:38.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.635e-05 2024-09-12T22:49:38.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:38.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167131+0000", 2024-09-12T22:49:38.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0288000000000003e-05 2024-09-12T22:49:38.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:38.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.167405+0000", 2024-09-12T22:49:38.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027438799999999998 2024-09-12T22:49:38.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:38.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170357+0000", 2024-09-12T22:49:38.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002952119 2024-09-12T22:49:38.636 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.636 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:38.636 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.636 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:30 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:38.636 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:38.636 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 93.450077852999996, 2024-09-12T22:49:38.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025934650000000001, 2024-09-12T22:49:38.636 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:38.636 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:38.636 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:38.637 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:38.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.637 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:38.637 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:38.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.637 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:38.637 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169642+0000", 2024-09-12T22:49:38.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.637 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:38.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169643+0000", 2024-09-12T22:49:38.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5899999999999996e-07 2024-09-12T22:49:38.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:38.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169661+0000", 2024-09-12T22:49:38.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7563000000000001e-05 2024-09-12T22:49:38.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:38.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169674+0000", 2024-09-12T22:49:38.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3230999999999999e-05 2024-09-12T22:49:38.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:38.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169683+0000", 2024-09-12T22:49:38.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.594e-06 2024-09-12T22:49:38.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:38.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169737+0000", 2024-09-12T22:49:38.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3520000000000003e-05 2024-09-12T22:49:38.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:38.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.169756+0000", 2024-09-12T22:49:38.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8821000000000002e-05 2024-09-12T22:49:38.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:38.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172186+0000", 2024-09-12T22:49:38.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024306789999999998 2024-09-12T22:49:38.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:38.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172236+0000", 2024-09-12T22:49:38.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9397999999999997e-05 2024-09-12T22:49:38.640 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.641 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:38.641 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.641 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:38.641 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:38.641 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 93.449184630000005, 2024-09-12T22:49:38.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:49:38.641 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:38.641 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:38.641 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:38.641 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:38.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:38.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:38.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:38.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:38.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:38.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:49:38.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:49:38.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:38.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:49:38.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:49:38.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:38.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:49:38.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:49:38.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:38.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:49:38.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:49:38.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:38.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:49:38.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:49:38.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:38.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:49:38.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:49:38.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:38.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:49:38.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:49:38.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:38.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:49:38.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:49:38.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:38.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:49:38.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:49:38.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:38.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:49:38.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:49:38.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:38.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:49:38.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:49:38.646 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.646 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:38.646 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.647 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:38.647 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:38.647 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 93.449112971999995, 2024-09-12T22:49:38.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:49:38.647 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:38.647 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:38.647 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:38.647 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:38.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:38.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:38.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:38.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:38.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:38.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:49:38.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:49:38.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:38.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:49:38.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:49:38.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:38.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:49:38.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:49:38.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:38.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:49:38.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:49:38.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:38.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:49:38.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:49:38.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:38.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:49:38.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:49:38.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:38.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:49:38.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:49:38.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:38.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:49:38.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:49:38.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:38.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:49:38.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:49:38.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:38.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:49:38.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:49:38.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:38.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:49:38.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:49:38.652 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.652 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:38.652 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.652 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:38.653 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:38.653 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 93.449070254000006, 2024-09-12T22:49:38.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:49:38.653 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:38.653 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:38.653 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:38.653 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:38.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:38.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:38.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:38.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:38.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:38.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:49:38.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:49:38.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:38.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:49:38.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:49:38.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:38.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:49:38.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:49:38.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:38.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:49:38.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:49:38.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:38.656 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:49:38.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:49:38.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:38.656 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:49:38.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:49:38.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:38.656 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:49:38.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:49:38.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:38.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:49:38.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:49:38.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:38.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:49:38.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:49:38.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:38.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:49:38.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:49:38.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:38.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:49:38.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:49:38.658 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.658 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:38.658 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.658 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:38.658 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:38.659 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 93.449032337000006, 2024-09-12T22:49:38.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:49:38.659 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:38.659 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:38.659 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:38.659 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:38.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:38.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:38.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:38.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:38.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:38.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:49:38.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:49:38.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:38.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:49:38.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:49:38.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:38.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:49:38.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:49:38.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:38.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:49:38.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:49:38.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:38.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:49:38.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:49:38.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:38.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:49:38.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:49:38.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:38.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:38.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:49:38.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:38.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:49:38.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:49:38.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:38.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:49:38.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:49:38.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:38.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:49:38.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:49:38.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:38.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:49:38.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:49:38.664 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.664 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:38.664 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.664 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:38.664 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:38.664 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 93.449008886000001, 2024-09-12T22:49:38.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:49:38.664 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:38.665 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:38.665 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:38.665 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:38.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:38.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:38.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:38.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:38.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:38.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:49:38.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:49:38.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:38.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:49:38.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:49:38.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:38.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:49:38.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:49:38.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:38.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:49:38.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:49:38.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:38.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:49:38.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:49:38.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:38.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:49:38.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:49:38.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:38.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:38.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:49:38.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:38.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:49:38.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:49:38.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:38.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:49:38.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:49:38.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:38.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:49:38.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:49:38.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:38.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:49:38.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:49:38.670 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.670 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:38.670 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.671 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:38.671 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:38.671 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 93.448984648999996, 2024-09-12T22:49:38.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:49:38.671 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:38.671 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:38.671 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:38.671 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:38.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:38.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:38.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:38.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:38.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:38.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:38.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:49:38.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:38.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:49:38.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:49:38.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:38.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:49:38.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:49:38.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:38.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:49:38.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:49:38.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:38.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:49:38.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:49:38.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:38.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:49:38.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:49:38.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:38.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:49:38.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:49:38.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:38.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:49:38.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:49:38.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:38.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:49:38.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:49:38.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:38.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:49:38.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:49:38.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:38.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:49:38.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:49:38.676 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.676 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:38.676 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.676 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:38.676 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:38.677 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 93.448956731999999, 2024-09-12T22:49:38.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:49:38.677 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:38.677 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:38.677 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:38.677 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:38.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:38.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:38.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:38.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:38.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:38.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:38.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:49:38.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:38.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:49:38.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:49:38.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:38.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:49:38.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:49:38.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:38.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:49:38.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:49:38.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:38.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:49:38.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:49:38.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:38.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:49:38.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:49:38.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:38.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:49:38.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:49:38.680 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.681 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:38.681 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.681 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:38.681 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:38.681 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 93.448882237000007, 2024-09-12T22:49:38.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:49:38.681 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:38.681 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:38.681 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:38.681 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:38.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:38.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:38.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:38.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:38.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:38.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:49:38.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:49:38.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:38.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:49:38.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:49:38.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:38.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:49:38.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:49:38.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:38.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:49:38.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:49:38.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:38.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:49:38.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:49:38.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:38.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:49:38.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:49:38.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:38.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:49:38.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:49:38.685 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.685 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:38.685 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.685 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:38.685 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:38.685 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 93.448836209000007, 2024-09-12T22:49:38.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:49:38.685 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:38.685 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:38.686 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:38.686 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:38.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:38.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:38.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:38.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:38.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:38.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:49:38.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:49:38.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:38.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:49:38.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:49:38.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:38.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:49:38.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:49:38.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:38.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:49:38.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:49:38.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:38.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:49:38.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:49:38.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:38.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:49:38.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:49:38.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:38.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:49:38.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:49:38.689 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.689 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:38.689 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.689 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:38.689 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:38.690 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 93.446665324999998, 2024-09-12T22:49:38.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001396085, 2024-09-12T22:49:38.690 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:38.690 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:38.690 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:38.690 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:38.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:38.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:38.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:38.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:38.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:38.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173055+0000", 2024-09-12T22:49:38.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.96e-07 2024-09-12T22:49:38.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:38.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173060+0000", 2024-09-12T22:49:38.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:49:38.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:38.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173070+0000", 2024-09-12T22:49:38.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0232e-05 2024-09-12T22:49:38.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:38.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:38.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:49:38.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:38.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173139+0000", 2024-09-12T22:49:38.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0325000000000003e-05 2024-09-12T22:49:38.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:38.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:38.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1813000000000002e-05 2024-09-12T22:49:38.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:38.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174401+0000", 2024-09-12T22:49:38.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012293790000000001 2024-09-12T22:49:38.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:38.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174451+0000", 2024-09-12T22:49:38.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0513000000000002e-05 2024-09-12T22:49:38.694 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.694 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:38.694 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.694 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:38.694 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:38.695 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 93.446614874999995, 2024-09-12T22:49:38.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013545639999999999, 2024-09-12T22:49:38.695 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:38.695 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:38.695 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:38.695 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:38.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:38.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:38.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:38.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173105+0000", 2024-09-12T22:49:38.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:38.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173106+0000", 2024-09-12T22:49:38.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7399999999999999e-07 2024-09-12T22:49:38.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:38.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173117+0000", 2024-09-12T22:49:38.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1412e-05 2024-09-12T22:49:38.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:38.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173137+0000", 2024-09-12T22:49:38.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9709000000000001e-05 2024-09-12T22:49:38.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:38.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173145+0000", 2024-09-12T22:49:38.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6290000000000001e-06 2024-09-12T22:49:38.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:38.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173193+0000", 2024-09-12T22:49:38.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8498000000000002e-05 2024-09-12T22:49:38.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:38.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173210+0000", 2024-09-12T22:49:38.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7241e-05 2024-09-12T22:49:38.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:38.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174405+0000", 2024-09-12T22:49:38.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011943780000000001 2024-09-12T22:49:38.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:38.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174460+0000", 2024-09-12T22:49:38.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5322999999999999e-05 2024-09-12T22:49:38.699 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.699 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:38.699 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.700 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:38.700 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:38.700 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 93.446561437, 2024-09-12T22:49:38.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014174389999999999, 2024-09-12T22:49:38.700 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:38.700 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:38.700 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:38.700 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:38.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:38.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:38.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:38.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:38.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:38.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173159+0000", 2024-09-12T22:49:38.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7700000000000001e-07 2024-09-12T22:49:38.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:38.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173163+0000", 2024-09-12T22:49:38.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2019999999999997e-06 2024-09-12T22:49:38.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:38.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173171+0000", 2024-09-12T22:49:38.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0199999999999994e-06 2024-09-12T22:49:38.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:38.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173180+0000", 2024-09-12T22:49:38.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.602e-06 2024-09-12T22:49:38.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:38.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173399+0000", 2024-09-12T22:49:38.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021918400000000001 2024-09-12T22:49:38.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:38.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173413+0000", 2024-09-12T22:49:38.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3864e-05 2024-09-12T22:49:38.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:38.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174546+0000", 2024-09-12T22:49:38.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001132767 2024-09-12T22:49:38.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:38.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.174576+0000", 2024-09-12T22:49:38.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0522999999999999e-05 2024-09-12T22:49:38.704 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.704 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:38.704 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.704 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:49:38.704 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:38.704 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 93.442577084000007, 2024-09-12T22:49:38.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001214403, 2024-09-12T22:49:38.705 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:38.705 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:38.705 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:38.705 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:38.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:38.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:38.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:38.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177143+0000", 2024-09-12T22:49:38.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:38.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177144+0000", 2024-09-12T22:49:38.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0399999999999996e-07 2024-09-12T22:49:38.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:38.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177148+0000", 2024-09-12T22:49:38.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.792e-06 2024-09-12T22:49:38.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:38.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177158+0000", 2024-09-12T22:49:38.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3409999999999992e-06 2024-09-12T22:49:38.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:38.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177167+0000", 2024-09-12T22:49:38.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9139999999999997e-06 2024-09-12T22:49:38.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:38.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178239+0000", 2024-09-12T22:49:38.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010726799999999999 2024-09-12T22:49:38.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:38.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178247+0000", 2024-09-12T22:49:38.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.661e-06 2024-09-12T22:49:38.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:38.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178358+0000", 2024-09-12T22:49:38.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110511 2024-09-12T22:49:38.708 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.708 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:38.708 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.709 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:49:38.709 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:38.709 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 91.457424544999995, 2024-09-12T22:49:38.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001635173, 2024-09-12T22:49:38.709 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:38.709 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:38.709 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:38.709 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:38.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:38.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:38.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:38.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162296+0000", 2024-09-12T22:49:38.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:38.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162298+0000", 2024-09-12T22:49:38.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4140000000000001e-06 2024-09-12T22:49:38.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:38.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162323+0000", 2024-09-12T22:49:38.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5258000000000001e-05 2024-09-12T22:49:38.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:38.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162339+0000", 2024-09-12T22:49:38.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5903e-05 2024-09-12T22:49:38.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:38.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162366+0000", 2024-09-12T22:49:38.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6222000000000001e-05 2024-09-12T22:49:38.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:38.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162428+0000", 2024-09-12T22:49:38.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-12T22:49:38.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:38.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162534+0000", 2024-09-12T22:49:38.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106016 2024-09-12T22:49:38.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:38.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.162621+0000", 2024-09-12T22:49:38.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6997999999999996e-05 2024-09-12T22:49:38.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:38.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163358+0000", 2024-09-12T22:49:38.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073706200000000003 2024-09-12T22:49:38.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:38.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163861+0000", 2024-09-12T22:49:38.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050363899999999995 2024-09-12T22:49:38.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:38.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163900+0000", 2024-09-12T22:49:38.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8852e-05 2024-09-12T22:49:38.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:38.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:07.163931+0000", 2024-09-12T22:49:38.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0639000000000003e-05 2024-09-12T22:49:38.714 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.714 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:38.714 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.714 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T22:49:38.714 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:38.715 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.455508300000005, 2024-09-12T22:49:38.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016489009999999999, 2024-09-12T22:49:38.715 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:38.715 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:38.715 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:38.715 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:38.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:38.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:38.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:38.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164212+0000", 2024-09-12T22:49:38.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:38.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164214+0000", 2024-09-12T22:49:38.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1280000000000002e-06 2024-09-12T22:49:38.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:38.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164227+0000", 2024-09-12T22:49:38.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2542e-05 2024-09-12T22:49:38.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:38.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164247+0000", 2024-09-12T22:49:38.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0098e-05 2024-09-12T22:49:38.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:38.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164255+0000", 2024-09-12T22:49:38.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7530000000000007e-06 2024-09-12T22:49:38.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:38.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164325+0000", 2024-09-12T22:49:38.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9214000000000005e-05 2024-09-12T22:49:38.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:38.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164424+0000", 2024-09-12T22:49:38.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9634000000000002e-05 2024-09-12T22:49:38.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:38.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.164563+0000", 2024-09-12T22:49:38.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013855700000000001 2024-09-12T22:49:38.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:38.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165221+0000", 2024-09-12T22:49:38.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00065796099999999998 2024-09-12T22:49:38.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:38.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165796+0000", 2024-09-12T22:49:38.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057530700000000005 2024-09-12T22:49:38.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:38.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165831+0000", 2024-09-12T22:49:38.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4990000000000002e-05 2024-09-12T22:49:38.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:38.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:25.165861+0000", 2024-09-12T22:49:38.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9717e-05 2024-09-12T22:49:38.720 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.720 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:38.720 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.720 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:49:38.720 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:38.720 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.454754925000003, 2024-09-12T22:49:38.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012160610000000001, 2024-09-12T22:49:38.721 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:38.721 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:38.721 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:38.721 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:38.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:38.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:38.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:38.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164965+0000", 2024-09-12T22:49:38.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:38.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:38.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164967+0000", 2024-09-12T22:49:38.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:49:38.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:38.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164974+0000", 2024-09-12T22:49:38.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7399999999999998e-06 2024-09-12T22:49:38.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:38.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164987+0000", 2024-09-12T22:49:38.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3689000000000001e-05 2024-09-12T22:49:38.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:38.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.164995+0000", 2024-09-12T22:49:38.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2959999999999999e-06 2024-09-12T22:49:38.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:38.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165068+0000", 2024-09-12T22:49:38.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2449999999999999e-05 2024-09-12T22:49:38.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:38.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.165212+0000", 2024-09-12T22:49:38.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144117 2024-09-12T22:49:38.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:38.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166066+0000", 2024-09-12T22:49:38.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085441100000000002 2024-09-12T22:49:38.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:38.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166107+0000", 2024-09-12T22:49:38.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0450000000000001e-05 2024-09-12T22:49:38.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:38.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:38.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:38.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:30.166181+0000", 2024-09-12T22:49:38.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-12T22:49:38.725 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.725 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:38.725 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.725 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:38.725 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:38.725 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:38.727 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:38.726+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:38.727 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:38.827 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:38.826+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:38.833 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:38.833 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:38.834 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:49:38.834 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:38.842 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:38.928 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:38.927+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:38.985 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:38.985 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:38.985 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:49:38.985 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:49:38.985 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:38.993 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:39.035 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:39.034+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:39.129 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:39.129+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:39.141 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:39.141 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:49:39.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:49:39.141 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:49:39.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.144 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-09-12T22:49:39.144 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:39.144 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 102.75566135299999, 2024-09-12T22:49:39.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005421866, 2024-09-12T22:49:39.144 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:39.144 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:39.144 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:39.144 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:39.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:39.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:39.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:39.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:39.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:39.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383904+0000", 2024-09-12T22:49:39.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1200000000000003e-07 2024-09-12T22:49:39.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:39.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383927+0000", 2024-09-12T22:49:39.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2582000000000002e-05 2024-09-12T22:49:39.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:39.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383937+0000", 2024-09-12T22:49:39.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0009e-05 2024-09-12T22:49:39.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383941+0000", 2024-09-12T22:49:39.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-09-12T22:49:39.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:39.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383978+0000", 2024-09-12T22:49:39.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6458999999999998e-05 2024-09-12T22:49:39.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:39.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.383990+0000", 2024-09-12T22:49:39.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2598e-05 2024-09-12T22:49:39.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:39.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389289+0000", 2024-09-12T22:49:39.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052990270000000004 2024-09-12T22:49:39.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:39.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389325+0000", 2024-09-12T22:49:39.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5973000000000003e-05 2024-09-12T22:49:39.148 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.148 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:39.149 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.149 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-09-12T22:49:39.149 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:39.149 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 102.75521877, 2024-09-12T22:49:39.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049969799999999998, 2024-09-12T22:49:39.149 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:39.149 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:39.149 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:39.149 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:39.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:39.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:39.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:39.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384346+0000", 2024-09-12T22:49:39.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:39.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384347+0000", 2024-09-12T22:49:39.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:49:39.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:39.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384354+0000", 2024-09-12T22:49:39.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1509999999999998e-06 2024-09-12T22:49:39.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:39.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384363+0000", 2024-09-12T22:49:39.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5699999999999999e-06 2024-09-12T22:49:39.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384368+0000", 2024-09-12T22:49:39.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5009999999999998e-06 2024-09-12T22:49:39.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.152 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:39.152 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386139+0000", 2024-09-12T22:49:39.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001771363 2024-09-12T22:49:39.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.152 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:39.152 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386151+0000", 2024-09-12T22:49:39.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1721e-05 2024-09-12T22:49:39.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.153 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:39.153 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389328+0000", 2024-09-12T22:49:39.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031764969999999999 2024-09-12T22:49:39.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.153 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:39.153 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389343+0000", 2024-09-12T22:49:39.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-09-12T22:49:39.153 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.153 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:39.153 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.153 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:133 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'91, mlcod=10'85)", 2024-09-12T22:49:39.154 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:39.154 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 102.754852613, 2024-09-12T22:49:39.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049617730000000001, 2024-09-12T22:49:39.154 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:39.154 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:39.154 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:39.154 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:39.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:39.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:39.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:39.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384712+0000", 2024-09-12T22:49:39.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:39.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384713+0000", 2024-09-12T22:49:39.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8699999999999995e-07 2024-09-12T22:49:39.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:39.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384719+0000", 2024-09-12T22:49:39.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.088e-06 2024-09-12T22:49:39.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:39.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384729+0000", 2024-09-12T22:49:39.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6299999999999993e-06 2024-09-12T22:49:39.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.384736+0000", 2024-09-12T22:49:39.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1570000000000003e-06 2024-09-12T22:49:39.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:39.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386348+0000", 2024-09-12T22:49:39.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016125239999999999 2024-09-12T22:49:39.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:39.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386363+0000", 2024-09-12T22:49:39.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4270999999999999e-05 2024-09-12T22:49:39.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:39.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389647+0000", 2024-09-12T22:49:39.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003284875 2024-09-12T22:49:39.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:39.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389674+0000", 2024-09-12T22:49:39.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6641000000000001e-05 2024-09-12T22:49:39.159 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.160 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:39.160 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.160 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'85)", 2024-09-12T22:49:39.160 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:39.160 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 102.754440301, 2024-09-12T22:49:39.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045781440000000001, 2024-09-12T22:49:39.160 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:39.160 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:39.160 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:39.161 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:39.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:39.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:39.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:39.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:39.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:39.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385125+0000", 2024-09-12T22:49:39.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2200000000000004e-07 2024-09-12T22:49:39.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:39.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385162+0000", 2024-09-12T22:49:39.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6842999999999999e-05 2024-09-12T22:49:39.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.163 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:39.163 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385172+0000", 2024-09-12T22:49:39.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.006e-05 2024-09-12T22:49:39.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.163 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.163 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.385177+0000", 2024-09-12T22:49:39.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:49:39.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:39.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386587+0000", 2024-09-12T22:49:39.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001410054 2024-09-12T22:49:39.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:39.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.386598+0000", 2024-09-12T22:49:39.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.136e-05 2024-09-12T22:49:39.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:39.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389676+0000", 2024-09-12T22:49:39.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030777000000000001 2024-09-12T22:49:39.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:39.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.389703+0000", 2024-09-12T22:49:39.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7072000000000001e-05 2024-09-12T22:49:39.165 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.165 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:39.165 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.166 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4154.0:165 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'119, mlcod=10'116)", 2024-09-12T22:49:39.166 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:39.166 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 102.62059020700001, 2024-09-12T22:49:39.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049343920000000001, 2024-09-12T22:49:39.166 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:39.166 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:39.166 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:39.166 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:39.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:39.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:39.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.167 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:39.167 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:39.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.167 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:39.167 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518975+0000", 2024-09-12T22:49:39.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:49:39.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:39.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518978+0000", 2024-09-12T22:49:39.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0259999999999999e-06 2024-09-12T22:49:39.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:39.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518984+0000", 2024-09-12T22:49:39.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.964e-06 2024-09-12T22:49:39.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.518988+0000", 2024-09-12T22:49:39.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4819999999999996e-06 2024-09-12T22:49:39.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:39.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519020+0000", 2024-09-12T22:49:39.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1644999999999999e-05 2024-09-12T22:49:39.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:39.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.519032+0000", 2024-09-12T22:49:39.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1644999999999999e-05 2024-09-12T22:49:39.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:39.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523876+0000", 2024-09-12T22:49:39.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004844709 2024-09-12T22:49:39.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:39.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:47:56.523909+0000", 2024-09-12T22:49:39.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2591e-05 2024-09-12T22:49:39.171 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.171 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:39.171 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.171 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:39.171 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:39.171 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 93.975354652999997, 2024-09-12T22:49:39.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:49:39.171 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:39.172 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:39.172 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:39.172 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:39.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:39.172 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:39.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:39.172 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:39.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.173 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:39.173 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:49:39.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:49:39.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.173 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:39.173 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:49:39.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:49:39.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:39.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:49:39.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:49:39.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:49:39.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:49:39.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:39.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:39.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:49:39.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:39.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:39.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:49:39.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:39.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:49:39.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:49:39.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:39.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:49:39.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:49:39.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:39.177 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:49:39.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:49:39.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.177 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.177 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:39.177 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:49:39.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:49:39.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.177 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.177 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:39.177 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:49:39.178 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:49:39.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.178 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:39.178 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:49:39.178 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:49:39.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.178 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:39.178 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:49:39.178 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:49:39.179 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.179 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:39.179 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.179 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:39.179 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:39.179 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 93.975255136000001, 2024-09-12T22:49:39.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:49:39.179 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:39.179 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:39.180 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:39.180 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:39.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:39.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:39.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:39.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:39.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.181 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:39.181 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:49:39.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:49:39.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.181 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:39.181 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:49:39.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:49:39.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.182 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:39.182 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:49:39.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:49:39.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.182 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.182 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:49:39.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:49:39.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.183 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:39.183 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:49:39.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:49:39.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.183 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:39.183 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:49:39.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:49:39.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:39.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:49:39.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:49:39.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:39.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:49:39.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:49:39.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:39.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:49:39.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:49:39.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:39.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:49:39.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:49:39.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:39.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:49:39.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:49:39.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:39.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:49:39.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:49:39.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:39.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:49:39.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:49:39.187 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.187 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:39.187 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.187 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:39.187 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:39.188 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 93.975210396999998, 2024-09-12T22:49:39.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:49:39.188 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:39.188 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:39.188 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:39.188 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:39.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:39.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:39.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:39.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:39.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:39.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:49:39.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:49:39.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:39.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:39.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:49:39.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:39.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:39.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:49:39.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:49:39.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:49:39.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:39.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:49:39.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:49:39.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:39.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:49:39.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:49:39.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.194 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:39.194 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:49:39.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:49:39.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.194 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.194 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:39.194 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:49:39.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:49:39.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.194 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:39.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:49:39.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:49:39.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:39.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:49:39.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:49:39.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:39.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:49:39.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:49:39.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:39.196 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:49:39.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:49:39.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:39.197 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:49:39.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:49:39.197 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.197 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:39.197 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.197 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:39.197 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:39.197 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 93.974982695999998, 2024-09-12T22:49:39.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:49:39.198 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:39.198 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:39.198 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:39.198 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:39.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:39.198 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:39.198 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:39.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:39.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:39.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:49:39.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:49:39.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:39.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:49:39.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:49:39.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:39.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:49:39.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:49:39.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:49:39.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:49:39.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:39.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:49:39.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:49:39.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:39.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:49:39.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:49:39.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.202 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:39.202 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:49:39.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:49:39.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.202 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:39.202 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:49:39.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:49:39.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.203 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.203 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:39.203 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:49:39.203 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:49:39.203 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.203 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.203 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:39.203 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:49:39.203 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:49:39.203 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.204 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.204 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:39.204 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:49:39.204 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:49:39.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.204 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.204 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:39.204 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:49:39.204 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:49:39.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:39.205 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:49:39.205 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:49:39.205 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.205 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:39.205 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.205 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:39.205 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:39.206 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 93.974817587999993, 2024-09-12T22:49:39.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:49:39.206 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:39.206 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:39.206 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:39.206 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:39.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.206 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:39.206 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:39.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.207 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:39.207 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:39.207 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.207 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.207 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:39.207 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:49:39.207 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:49:39.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.207 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.207 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:39.208 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:49:39.208 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:49:39.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.208 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:39.208 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:49:39.208 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:49:39.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.208 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.209 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:49:39.209 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:49:39.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.209 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.209 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:39.209 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:49:39.209 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:49:39.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.209 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.209 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:39.209 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:49:39.210 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:49:39.210 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.210 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.210 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:39.210 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:49:39.210 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:49:39.210 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.210 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.210 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:39.210 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:49:39.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:49:39.211 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.211 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.211 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:39.211 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:49:39.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:49:39.211 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.211 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.211 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:39.211 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:49:39.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:49:39.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.212 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.212 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:39.212 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:49:39.212 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:49:39.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.212 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.212 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:39.212 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:49:39.212 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:49:39.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.212 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.213 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:39.213 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:49:39.213 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:49:39.213 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.213 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:39.213 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.213 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.213 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.213 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:39.213 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:39.213 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 93.974756303000007, 2024-09-12T22:49:39.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:49:39.214 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:39.214 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:39.214 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:39.214 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:39.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.214 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:39.214 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:39.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.215 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:39.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:39.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.215 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:39.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:39.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:49:39.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:39.216 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:49:39.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:49:39.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:39.216 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:49:39.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:49:39.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.216 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:49:39.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:49:39.217 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.217 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.217 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:39.217 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:49:39.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:49:39.217 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.217 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.217 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:39.217 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:49:39.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:49:39.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:39.218 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:49:39.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:49:39.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:39.218 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:49:39.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:49:39.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:39.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:49:39.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:49:39.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:39.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:49:39.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:49:39.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.220 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:39.220 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:49:39.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:49:39.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.220 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:39.220 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:49:39.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:49:39.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.221 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:39.221 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:49:39.221 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:49:39.221 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.221 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:39.221 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.221 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:39.221 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:39.222 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 93.974676195000001, 2024-09-12T22:49:39.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:49:39.222 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:39.222 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:39.222 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:39.222 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:39.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.222 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:39.222 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:39.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:39.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:39.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:39.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:49:39.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:49:39.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:39.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:49:39.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:49:39.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:39.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:49:39.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:49:39.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.225 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.225 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.225 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:49:39.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:49:39.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.225 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.225 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:39.225 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:49:39.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:49:39.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.226 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.226 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:39.226 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:49:39.226 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:49:39.226 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.226 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.226 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:39.226 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:49:39.226 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:49:39.226 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.226 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.227 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:39.227 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:49:39.227 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:49:39.227 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.227 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.227 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:39.227 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:49:39.227 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:49:39.227 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.227 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.227 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:39.228 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:49:39.228 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:49:39.228 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.228 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.228 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:39.228 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:49:39.228 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:49:39.228 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.228 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.228 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:39.229 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:49:39.229 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:49:39.229 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.229 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.229 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:39.229 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:49:39.229 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:49:39.229 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.229 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:39.229 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.229 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.230 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.230 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:39.230 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:39.230 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 93.974627241999997, 2024-09-12T22:49:39.230 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:49:39.230 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:39.230 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:39.230 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:39.230 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:39.230 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.230 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:39.231 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:39.231 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.231 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.231 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.231 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:39.231 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:39.231 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.231 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.231 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.231 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:39.231 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:39.231 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:49:39.231 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.232 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.232 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:39.232 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:49:39.232 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:49:39.232 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.232 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.232 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:39.232 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:49:39.232 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:49:39.232 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.232 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.232 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.233 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:49:39.233 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:49:39.233 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.233 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.233 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:39.233 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:49:39.233 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:49:39.233 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.233 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.233 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:39.233 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:49:39.234 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:49:39.234 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.234 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.234 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:39.234 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:49:39.234 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:49:39.234 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.234 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:39.234 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.235 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.235 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.235 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:39.235 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:39.235 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 93.974578141999999, 2024-09-12T22:49:39.235 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:49:39.235 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:39.235 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:39.235 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:39.235 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:39.235 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.236 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:39.236 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:39.236 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.236 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.236 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.236 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:39.236 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:39.236 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.236 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.237 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.237 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:39.237 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:49:39.237 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:49:39.237 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.237 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.237 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:39.237 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:49:39.237 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:49:39.237 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.238 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.238 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:39.238 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:49:39.238 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:49:39.238 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.238 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.238 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.238 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:49:39.238 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:49:39.238 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.238 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.239 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:39.239 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:49:39.239 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:49:39.239 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.239 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.239 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:39.239 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:49:39.239 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:49:39.239 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.239 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.239 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:39.240 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:49:39.240 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:49:39.240 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.240 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:39.240 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.240 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.240 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.240 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:39.240 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:39.240 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 93.967637691999997, 2024-09-12T22:49:39.240 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051113419999999996, 2024-09-12T22:49:39.241 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:39.241 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:39.241 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:39.241 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:39.241 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.241 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:39.241 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:39.241 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.241 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.241 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.241 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:39.241 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171927+0000", 2024-09-12T22:49:39.242 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.242 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.242 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.242 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:39.242 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171928+0000", 2024-09-12T22:49:39.242 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1399999999999995e-07 2024-09-12T22:49:39.242 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.242 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.242 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:39.242 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171936+0000", 2024-09-12T22:49:39.242 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6699999999999994e-06 2024-09-12T22:49:39.243 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.243 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.243 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:39.243 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171974+0000", 2024-09-12T22:49:39.243 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8288999999999999e-05 2024-09-12T22:49:39.243 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.243 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.243 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.243 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.171983+0000", 2024-09-12T22:49:39.243 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8100000000000004e-06 2024-09-12T22:49:39.243 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.243 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.244 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:39.244 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172472+0000", 2024-09-12T22:49:39.244 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048943499999999998 2024-09-12T22:49:39.244 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.244 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.244 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:39.244 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.172491+0000", 2024-09-12T22:49:39.244 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8317000000000001e-05 2024-09-12T22:49:39.244 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.244 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.244 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:39.244 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.176990+0000", 2024-09-12T22:49:39.245 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044992979999999997 2024-09-12T22:49:39.245 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.245 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.245 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:39.245 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177039+0000", 2024-09-12T22:49:39.245 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8609000000000002e-05 2024-09-12T22:49:39.245 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.245 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:39.245 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.245 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.245 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.246 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:39.246 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:39.246 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 93.966548852000003, 2024-09-12T22:49:39.246 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051163720000000001, 2024-09-12T22:49:39.246 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:39.246 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:39.246 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:39.246 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:39.246 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.246 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:39.247 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:39.247 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.247 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.247 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.247 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:39.247 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173016+0000", 2024-09-12T22:49:39.247 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.247 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.247 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.247 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:39.247 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173017+0000", 2024-09-12T22:49:39.248 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7199999999999999e-07 2024-09-12T22:49:39.248 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.248 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.248 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:39.248 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173022+0000", 2024-09-12T22:49:39.248 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6389999999999997e-06 2024-09-12T22:49:39.248 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.248 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.248 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:39.248 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173083+0000", 2024-09-12T22:49:39.249 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0863000000000003e-05 2024-09-12T22:49:39.249 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.249 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.249 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.249 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173098+0000", 2024-09-12T22:49:39.249 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.52e-05 2024-09-12T22:49:39.249 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.249 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.249 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:39.249 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174102+0000", 2024-09-12T22:49:39.250 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010035949999999999 2024-09-12T22:49:39.250 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.250 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.250 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:39.250 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174123+0000", 2024-09-12T22:49:39.250 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0747e-05 2024-09-12T22:49:39.250 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.250 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.250 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:39.250 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178089+0000", 2024-09-12T22:49:39.250 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039661369999999998 2024-09-12T22:49:39.250 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.251 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.251 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:39.251 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178132+0000", 2024-09-12T22:49:39.251 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3718999999999999e-05 2024-09-12T22:49:39.251 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.251 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:39.251 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.251 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.251 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.251 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:39.251 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:39.252 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 93.966499240999994, 2024-09-12T22:49:39.252 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048416880000000002, 2024-09-12T22:49:39.252 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:39.252 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:39.252 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:39.252 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:39.252 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.252 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:39.252 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:39.252 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.253 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.253 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.253 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:39.253 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:39.253 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.253 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.253 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.253 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:39.253 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173066+0000", 2024-09-12T22:49:39.253 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6199999999999997e-07 2024-09-12T22:49:39.254 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.254 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.254 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:39.254 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173079+0000", 2024-09-12T22:49:39.254 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-09-12T22:49:39.254 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.254 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.254 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:39.254 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173087+0000", 2024-09-12T22:49:39.254 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0760000000000003e-06 2024-09-12T22:49:39.254 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.254 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.255 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.255 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173102+0000", 2024-09-12T22:49:39.255 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5099999999999999e-05 2024-09-12T22:49:39.255 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.255 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.255 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:39.255 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173198+0000", 2024-09-12T22:49:39.255 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6176999999999998e-05 2024-09-12T22:49:39.255 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.255 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.255 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:39.255 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173243+0000", 2024-09-12T22:49:39.255 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4499999999999997e-05 2024-09-12T22:49:39.256 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.256 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.256 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:39.256 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177861+0000", 2024-09-12T22:49:39.256 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046183930000000002 2024-09-12T22:49:39.256 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.256 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.256 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:39.256 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.177907+0000", 2024-09-12T22:49:39.256 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6248999999999997e-05 2024-09-12T22:49:39.256 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.256 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:39.257 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.257 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.257 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.257 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:49:39.257 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:39.257 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 93.966431932000006, 2024-09-12T22:49:39.257 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051513599999999998, 2024-09-12T22:49:39.257 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:39.257 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:39.257 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:39.257 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:39.258 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.258 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:39.258 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:39.258 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.258 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.258 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.258 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:39.258 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:39.258 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.258 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.258 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.259 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:39.259 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173133+0000", 2024-09-12T22:49:39.259 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.37e-07 2024-09-12T22:49:39.259 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.259 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.259 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:39.259 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173156+0000", 2024-09-12T22:49:39.259 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2841e-05 2024-09-12T22:49:39.259 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.259 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.259 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:39.259 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173190+0000", 2024-09-12T22:49:39.259 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3753e-05 2024-09-12T22:49:39.260 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.260 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.260 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.260 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173635+0000", 2024-09-12T22:49:39.260 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000444492 2024-09-12T22:49:39.260 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.260 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.260 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:39.260 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174385+0000", 2024-09-12T22:49:39.260 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075088800000000001 2024-09-12T22:49:39.260 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.260 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.261 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:39.261 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174404+0000", 2024-09-12T22:49:39.261 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8664e-05 2024-09-12T22:49:39.261 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.261 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.261 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:39.261 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178250+0000", 2024-09-12T22:49:39.261 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038459869999999999 2024-09-12T22:49:39.261 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.261 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.262 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:39.262 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178284+0000", 2024-09-12T22:49:39.262 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4198e-05 2024-09-12T22:49:39.262 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.262 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:39.262 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.262 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.262 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.262 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:49:39.262 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:39.262 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 93.965864013000001, 2024-09-12T22:49:39.262 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045564389999999998, 2024-09-12T22:49:39.263 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:39.263 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:39.263 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:39.263 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:39.263 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.263 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:39.263 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:39.263 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.263 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.263 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.263 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:39.264 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:39.264 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.264 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.264 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.264 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:39.264 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173701+0000", 2024-09-12T22:49:39.264 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6800000000000002e-07 2024-09-12T22:49:39.264 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.264 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.264 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:39.265 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173706+0000", 2024-09-12T22:49:39.265 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7639999999999996e-06 2024-09-12T22:49:39.265 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.265 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.265 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:39.265 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173713+0000", 2024-09-12T22:49:39.265 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-09-12T22:49:39.265 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.265 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.265 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.265 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173718+0000", 2024-09-12T22:49:39.266 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8199999999999996e-06 2024-09-12T22:49:39.266 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.266 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.266 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:39.266 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173806+0000", 2024-09-12T22:49:39.266 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8216999999999999e-05 2024-09-12T22:49:39.266 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.266 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.266 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:39.266 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173827+0000", 2024-09-12T22:49:39.266 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0296999999999999e-05 2024-09-12T22:49:39.267 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.267 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.267 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:39.267 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178225+0000", 2024-09-12T22:49:39.267 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043981979999999999 2024-09-12T22:49:39.267 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.267 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.267 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:39.267 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178257+0000", 2024-09-12T22:49:39.267 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2536000000000002e-05 2024-09-12T22:49:39.267 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.267 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:39.268 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.268 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.268 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.268 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2024-09-12T22:49:39.268 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:39.268 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 93.965486408999993, 2024-09-12T22:49:39.268 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004766424, 2024-09-12T22:49:39.268 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:39.268 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:39.268 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:39.268 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:39.269 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.269 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:39.269 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:39.269 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.269 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.269 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.269 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:39.269 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174078+0000", 2024-09-12T22:49:39.269 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:39.269 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.269 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.270 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:39.270 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174079+0000", 2024-09-12T22:49:39.270 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2800000000000003e-07 2024-09-12T22:49:39.270 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.270 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.270 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:39.270 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174104+0000", 2024-09-12T22:49:39.270 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5378999999999999e-05 2024-09-12T22:49:39.270 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.270 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.270 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:39.270 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174112+0000", 2024-09-12T22:49:39.270 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4259999999999997e-06 2024-09-12T22:49:39.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.271 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.271 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.271 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174117+0000", 2024-09-12T22:49:39.271 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4129999999999997e-06 2024-09-12T22:49:39.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.271 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.271 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:39.271 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175461+0000", 2024-09-12T22:49:39.271 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013437290000000001 2024-09-12T22:49:39.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.271 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.271 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:39.272 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175478+0000", 2024-09-12T22:49:39.272 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7218e-05 2024-09-12T22:49:39.272 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.272 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.272 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:39.272 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178715+0000", 2024-09-12T22:49:39.272 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003236896 2024-09-12T22:49:39.272 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:39.272 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:39.272 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:39.272 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.178845+0000", 2024-09-12T22:49:39.272 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000130035 2024-09-12T22:49:39.273 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.273 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:39.273 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.273 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:39.273 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:39.273 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:39.274 INFO:tasks.workunit.client.0.smithi066.stderr:+ tar xzf ltp-full.tgz 2024-09-12T22:49:39.275 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:39.275 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:39.273+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:39.376 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:39.375+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:39.385 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:39.385 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:49:39.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.385 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:241 4.1a 4:5866ad9e:::100000002ee.00000000:head [write 0~1156 in=1156b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:39.385 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.384761+0000", 2024-09-12T22:49:39.386 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.00030619700000000002, 2024-09-12T22:49:39.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00032709200000000002, 2024-09-12T22:49:39.386 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:39.386 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:39.386 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:39.386 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:39.386 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:39.386 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:39.386 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 241 2024-09-12T22:49:39.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.386 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:39.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:39.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.384761+0000", 2024-09-12T22:49:39.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:39.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.384761+0000", 2024-09-12T22:49:39.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:39.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.384762+0000", 2024-09-12T22:49:39.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.13e-07 2024-09-12T22:49:39.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:39.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.384765+0000", 2024-09-12T22:49:39.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.393e-06 2024-09-12T22:49:39.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:39.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.384773+0000", 2024-09-12T22:49:39.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3070000000000003e-06 2024-09-12T22:49:39.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.384777+0000", 2024-09-12T22:49:39.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9439999999999998e-06 2024-09-12T22:49:39.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:39.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.384813+0000", 2024-09-12T22:49:39.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6044999999999998e-05 2024-09-12T22:49:39.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:39.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.384886+0000", 2024-09-12T22:49:39.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2849999999999995e-05 2024-09-12T22:49:39.390 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.390 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:39.390 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.390 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.390 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-12T22:49:39.390 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 1 2024-09-12T22:49:39.390 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:39.395 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:39.476 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:39.475+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:39.503 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:39.503 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:39.503 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:49:39.503 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:49:39.503 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:39.512 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:39.577 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:39.576+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:39.611 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:49:39.663 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:39.663 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:49:39.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:49:39.663 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:49:39.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.663 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:39.663 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:39.663 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 94.490506480999997, 2024-09-12T22:49:39.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:49:39.663 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:39.664 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:39.664 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:39.664 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:39.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:39.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:39.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:39.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:39.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:39.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:49:39.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:49:39.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:39.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:49:39.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:49:39.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:39.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:49:39.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:49:39.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:49:39.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:49:39.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:39.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:49:39.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:49:39.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:39.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:49:39.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:49:39.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:39.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:49:39.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:49:39.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:39.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:49:39.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:49:39.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:39.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:49:39.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:49:39.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:39.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:49:39.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:49:39.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:39.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:49:39.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:49:39.669 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.669 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:39.669 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.669 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:39.669 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:39.669 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 94.490434823000001, 2024-09-12T22:49:39.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:49:39.669 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:39.669 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:39.670 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:39.670 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:39.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:39.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:39.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:39.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:39.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:39.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:49:39.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:49:39.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:39.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:49:39.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:49:39.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:39.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:49:39.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:49:39.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:49:39.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:49:39.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:39.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:49:39.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:49:39.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:39.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:49:39.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:49:39.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:39.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:49:39.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:49:39.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:39.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:49:39.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:49:39.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:39.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:49:39.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:49:39.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:39.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:49:39.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:49:39.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:39.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:49:39.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:49:39.675 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.675 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:39.675 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.675 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:39.675 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:39.675 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 94.490392104999998, 2024-09-12T22:49:39.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:49:39.675 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:39.675 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:39.675 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:39.675 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:39.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:39.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:39.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:39.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:39.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:39.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:49:39.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:49:39.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:39.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:49:39.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:49:39.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:39.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:49:39.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:49:39.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:49:39.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:49:39.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:39.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:49:39.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:49:39.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:39.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:49:39.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:49:39.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:39.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:49:39.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:49:39.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:39.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:49:39.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:49:39.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:39.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:49:39.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:49:39.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:39.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:49:39.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:49:39.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:39.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:49:39.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:49:39.680 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.680 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:39.680 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.681 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:39.681 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:39.681 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 94.490354187999998, 2024-09-12T22:49:39.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:49:39.681 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:39.681 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:39.681 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:39.681 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:39.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:39.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:39.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:39.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:39.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:39.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:49:39.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:49:39.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:39.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:49:39.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:49:39.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:39.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:49:39.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:49:39.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:49:39.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:49:39.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:39.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:49:39.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:49:39.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:39.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:49:39.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:49:39.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:39.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:39.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:49:39.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:39.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:49:39.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:49:39.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:39.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:49:39.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:49:39.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:39.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:49:39.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:49:39.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:39.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:49:39.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:49:39.686 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.686 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:39.686 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.687 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:39.687 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:39.687 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 94.490330736999994, 2024-09-12T22:49:39.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:49:39.687 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:39.687 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:39.687 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:39.687 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:39.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:39.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:39.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:39.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:39.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:39.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:49:39.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:49:39.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:39.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:49:39.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:49:39.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:39.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:49:39.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:49:39.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:49:39.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:49:39.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:39.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:49:39.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:49:39.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:39.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:49:39.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:49:39.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:39.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:39.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:49:39.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:39.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:49:39.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:49:39.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:39.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:49:39.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:49:39.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:39.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:49:39.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:49:39.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:39.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:49:39.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:49:39.692 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.692 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:39.692 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.692 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:39.692 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:39.693 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 94.490306500000003, 2024-09-12T22:49:39.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:49:39.693 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:39.693 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:39.693 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:39.693 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:39.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:39.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:39.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:39.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:39.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:39.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:39.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:49:39.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:39.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:49:39.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:49:39.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:39.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:49:39.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:49:39.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:49:39.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:49:39.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:39.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:49:39.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:49:39.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:39.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:49:39.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:49:39.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:39.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:49:39.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:49:39.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:39.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:49:39.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:49:39.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:39.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:49:39.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:49:39.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:39.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:49:39.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:49:39.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:39.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:49:39.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:49:39.698 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.698 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:39.698 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.698 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:39.698 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:39.698 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 94.490278583000006, 2024-09-12T22:49:39.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:49:39.699 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:39.699 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:39.699 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:39.699 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:39.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:39.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:39.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:39.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:39.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:39.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:39.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:49:39.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:39.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:49:39.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:49:39.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:39.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:49:39.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:49:39.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:49:39.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:49:39.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:39.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:49:39.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:49:39.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:39.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:49:39.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:49:39.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:39.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:49:39.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:49:39.702 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.702 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:39.702 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.703 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:39.703 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:39.703 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 94.490204087999999, 2024-09-12T22:49:39.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:49:39.703 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:39.703 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:39.703 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:39.703 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:39.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:39.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:39.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:39.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:39.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:39.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:49:39.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:49:39.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:39.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:49:39.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:49:39.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:39.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:49:39.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:49:39.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:49:39.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:49:39.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:39.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:49:39.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:49:39.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:39.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:49:39.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:49:39.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:39.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:49:39.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:49:39.707 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.707 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:39.707 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.707 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:39.707 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:39.707 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 94.490158059999999, 2024-09-12T22:49:39.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:49:39.707 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:39.708 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:39.708 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:39.708 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:39.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:39.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:39.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:39.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:39.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:39.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:49:39.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:49:39.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:39.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:49:39.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:49:39.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:39.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:49:39.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:49:39.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:49:39.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:49:39.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:39.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:49:39.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:49:39.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:39.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:49:39.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:49:39.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:39.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:49:39.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:49:39.711 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.711 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:39.711 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.712 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:39.712 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.160867+0000", 2024-09-12T22:49:39.712 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.50017488799999998, 2024-09-12T22:49:39.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018225736999999999, 2024-09-12T22:49:39.712 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:39.712 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:39.712 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:39.712 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:39.712 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:39.712 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:39.712 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 5 2024-09-12T22:49:39.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.713 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:39.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:39.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.160867+0000", 2024-09-12T22:49:39.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:39.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.160867+0000", 2024-09-12T22:49:39.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:39.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.160869+0000", 2024-09-12T22:49:39.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1500000000000002e-06 2024-09-12T22:49:39.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:39.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.167303+0000", 2024-09-12T22:49:39.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0064335690000000001 2024-09-12T22:49:39.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:39.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.167320+0000", 2024-09-12T22:49:39.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7329e-05 2024-09-12T22:49:39.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.167329+0000", 2024-09-12T22:49:39.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4069999999999993e-06 2024-09-12T22:49:39.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:39.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.167402+0000", 2024-09-12T22:49:39.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3184999999999998e-05 2024-09-12T22:49:39.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:39.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.167550+0000", 2024-09-12T22:49:39.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014852499999999999 2024-09-12T22:49:39.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:39.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.167689+0000", 2024-09-12T22:49:39.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013904799999999999 2024-09-12T22:49:39.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:39.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.176328+0000", 2024-09-12T22:49:39.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0086384979999999997 2024-09-12T22:49:39.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:39.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.179037+0000", 2024-09-12T22:49:39.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027092599999999998 2024-09-12T22:49:39.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:39.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.179066+0000", 2024-09-12T22:49:39.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9132000000000002e-05 2024-09-12T22:49:39.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:39.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.179093+0000", 2024-09-12T22:49:39.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6633999999999999e-05 2024-09-12T22:49:39.717 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.718 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:39.718 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.718 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:57 4.9 e50/17 4:91e366d7:::10000000230.00000000:head v 50'1, mlcod=0'0)", 2024-09-12T22:49:39.718 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.217245+0000", 2024-09-12T22:49:39.718 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.443797153, 2024-09-12T22:49:39.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078517689999999998, 2024-09-12T22:49:39.718 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:39.718 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:39.718 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:39.718 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:39.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:39.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217245+0000", 2024-09-12T22:49:39.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:39.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217245+0000", 2024-09-12T22:49:39.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:39.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217246+0000", 2024-09-12T22:49:39.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5199999999999996e-07 2024-09-12T22:49:39.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:39.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217253+0000", 2024-09-12T22:49:39.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1330000000000001e-06 2024-09-12T22:49:39.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:39.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217261+0000", 2024-09-12T22:49:39.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4500000000000004e-06 2024-09-12T22:49:39.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217267+0000", 2024-09-12T22:49:39.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-06 2024-09-12T22:49:39.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:39.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217309+0000", 2024-09-12T22:49:39.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1535000000000001e-05 2024-09-12T22:49:39.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:39.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217325+0000", 2024-09-12T22:49:39.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6208000000000001e-05 2024-09-12T22:49:39.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:39.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.225071+0000", 2024-09-12T22:49:39.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077461470000000001 2024-09-12T22:49:39.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:39.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.225097+0000", 2024-09-12T22:49:39.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5384e-05 2024-09-12T22:49:39.722 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.722 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:39.722 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.723 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:144 4.20 4:069ea127:::10000000289.00000000:head [write 0~1223] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:39.723 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.294752+0000", 2024-09-12T22:49:39.723 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.36628968000000001, 2024-09-12T22:49:39.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083421970000000008, 2024-09-12T22:49:39.723 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:39.723 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:39.723 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:39.723 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:39.723 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:39.723 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:39.723 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 144 2024-09-12T22:49:39.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.723 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:39.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:39.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294752+0000", 2024-09-12T22:49:39.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:39.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294752+0000", 2024-09-12T22:49:39.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:39.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294753+0000", 2024-09-12T22:49:39.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.37e-07 2024-09-12T22:49:39.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:39.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294757+0000", 2024-09-12T22:49:39.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.811e-06 2024-09-12T22:49:39.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:39.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294765+0000", 2024-09-12T22:49:39.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0390000000000005e-06 2024-09-12T22:49:39.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294771+0000", 2024-09-12T22:49:39.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2689999999999996e-06 2024-09-12T22:49:39.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:39.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294816+0000", 2024-09-12T22:49:39.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5046000000000002e-05 2024-09-12T22:49:39.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:39.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294887+0000", 2024-09-12T22:49:39.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0609000000000001e-05 2024-09-12T22:49:39.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:39.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.302989+0000", 2024-09-12T22:49:39.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081019409999999997 2024-09-12T22:49:39.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:39.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.303033+0000", 2024-09-12T22:49:39.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4190999999999998e-05 2024-09-12T22:49:39.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:39.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.303095+0000", 2024-09-12T22:49:39.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1654000000000003e-05 2024-09-12T22:49:39.728 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.728 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:39.728 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.728 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:145 4.16 4:696afb02:::1000000028a.00000000:head [write 0~55211] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:39.728 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.296232+0000", 2024-09-12T22:49:39.728 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.36481012600000001, 2024-09-12T22:49:39.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.006909475, 2024-09-12T22:49:39.728 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:39.728 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:39.729 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:39.729 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:39.729 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:39.729 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:39.729 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 145 2024-09-12T22:49:39.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.729 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:39.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:39.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.296232+0000", 2024-09-12T22:49:39.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:39.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.296232+0000", 2024-09-12T22:49:39.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:39.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.296232+0000", 2024-09-12T22:49:39.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9800000000000004e-07 2024-09-12T22:49:39.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:39.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.296279+0000", 2024-09-12T22:49:39.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6353999999999997e-05 2024-09-12T22:49:39.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:39.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.296286+0000", 2024-09-12T22:49:39.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0779999999999998e-06 2024-09-12T22:49:39.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.296291+0000", 2024-09-12T22:49:39.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0950000000000003e-06 2024-09-12T22:49:39.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:39.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.296336+0000", 2024-09-12T22:49:39.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4563e-05 2024-09-12T22:49:39.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:39.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.296404+0000", 2024-09-12T22:49:39.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8756000000000004e-05 2024-09-12T22:49:39.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:39.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.303017+0000", 2024-09-12T22:49:39.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0066131159999999996 2024-09-12T22:49:39.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:39.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.303064+0000", 2024-09-12T22:49:39.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6728999999999999e-05 2024-09-12T22:49:39.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:39.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.303141+0000", 2024-09-12T22:49:39.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7286000000000005e-05 2024-09-12T22:49:39.734 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.734 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:39.735 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.735 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:150 4.a 4:53071690:::1000000028f.00000000:head [write 0~111] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:39.735 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.301030+0000", 2024-09-12T22:49:39.735 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.36001239000000002, 2024-09-12T22:49:39.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077464659999999996, 2024-09-12T22:49:39.735 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:39.735 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:39.735 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:39.735 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:39.735 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:39.735 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:39.736 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 150 2024-09-12T22:49:39.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.736 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:39.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:39.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301030+0000", 2024-09-12T22:49:39.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:39.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301030+0000", 2024-09-12T22:49:39.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:39.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301031+0000", 2024-09-12T22:49:39.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.13e-06 2024-09-12T22:49:39.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:39.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301036+0000", 2024-09-12T22:49:39.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3519999999999997e-06 2024-09-12T22:49:39.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:39.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301050+0000", 2024-09-12T22:49:39.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3705e-05 2024-09-12T22:49:39.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301060+0000", 2024-09-12T22:49:39.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0042e-05 2024-09-12T22:49:39.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:39.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301114+0000", 2024-09-12T22:49:39.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4421e-05 2024-09-12T22:49:39.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:39.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301231+0000", 2024-09-12T22:49:39.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116552 2024-09-12T22:49:39.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:39.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.308695+0000", 2024-09-12T22:49:39.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0074639459999999999 2024-09-12T22:49:39.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:39.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.308735+0000", 2024-09-12T22:49:39.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0181e-05 2024-09-12T22:49:39.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:39.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.308776+0000", 2024-09-12T22:49:39.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1137000000000003e-05 2024-09-12T22:49:39.740 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.740 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:39.741 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.741 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:151 4.7 4:e25a3370:::10000000290.00000000:head [write 0~6349] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:39.741 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.301970+0000", 2024-09-12T22:49:39.741 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.35907218899999999, 2024-09-12T22:49:39.741 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082601040000000008, 2024-09-12T22:49:39.741 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:39.741 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:39.741 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:39.741 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:39.741 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:39.741 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:39.742 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 151 2024-09-12T22:49:39.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.742 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:39.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.742 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:39.742 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301970+0000", 2024-09-12T22:49:39.742 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.742 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:39.742 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301970+0000", 2024-09-12T22:49:39.742 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:39.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301970+0000", 2024-09-12T22:49:39.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0699999999999998e-07 2024-09-12T22:49:39.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:39.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301977+0000", 2024-09-12T22:49:39.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0890000000000002e-06 2024-09-12T22:49:39.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:39.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301984+0000", 2024-09-12T22:49:39.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.511e-06 2024-09-12T22:49:39.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.744 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.744 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301988+0000", 2024-09-12T22:49:39.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7079999999999999e-06 2024-09-12T22:49:39.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.744 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:39.744 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.302027+0000", 2024-09-12T22:49:39.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9113999999999999e-05 2024-09-12T22:49:39.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:39.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.302099+0000", 2024-09-12T22:49:39.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2673e-05 2024-09-12T22:49:39.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:39.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.302174+0000", 2024-09-12T22:49:39.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4274000000000001e-05 2024-09-12T22:49:39.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:39.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.308696+0000", 2024-09-12T22:49:39.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065225159999999999 2024-09-12T22:49:39.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.746 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:39.746 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.310175+0000", 2024-09-12T22:49:39.746 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014790350000000001 2024-09-12T22:49:39.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.746 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:39.746 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.310205+0000", 2024-09-12T22:49:39.746 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9799e-05 2024-09-12T22:49:39.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.746 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:39.747 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.310230+0000", 2024-09-12T22:49:39.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4978e-05 2024-09-12T22:49:39.747 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.747 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:39.747 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.747 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:194 4.16 4:6af67b46:::100000002bb.00000000:head [write 0~111] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:39.747 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.339531+0000", 2024-09-12T22:49:39.747 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.321511027, 2024-09-12T22:49:39.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073351789999999998, 2024-09-12T22:49:39.747 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:39.747 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:39.748 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:39.748 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:39.748 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:39.748 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:39.748 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 194 2024-09-12T22:49:39.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.748 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:39.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.748 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:39.748 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339531+0000", 2024-09-12T22:49:39.748 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.749 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:39.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339531+0000", 2024-09-12T22:49:39.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.749 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:39.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339532+0000", 2024-09-12T22:49:39.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8100000000000002e-07 2024-09-12T22:49:39.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.749 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:39.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339536+0000", 2024-09-12T22:49:39.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8739999999999997e-06 2024-09-12T22:49:39.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.750 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:39.750 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339546+0000", 2024-09-12T22:49:39.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0567999999999999e-05 2024-09-12T22:49:39.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.750 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.750 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339552+0000", 2024-09-12T22:49:39.751 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4750000000000001e-06 2024-09-12T22:49:39.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.751 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:39.751 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339593+0000", 2024-09-12T22:49:39.751 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1230999999999999e-05 2024-09-12T22:49:39.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.751 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:39.751 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339664+0000", 2024-09-12T22:49:39.751 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0769e-05 2024-09-12T22:49:39.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.752 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:39.752 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.346724+0000", 2024-09-12T22:49:39.752 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070602249999999998 2024-09-12T22:49:39.752 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.752 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.752 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:39.752 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.346778+0000", 2024-09-12T22:49:39.752 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4469999999999999e-05 2024-09-12T22:49:39.752 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.752 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.752 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:39.752 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.346866+0000", 2024-09-12T22:49:39.752 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7786000000000003e-05 2024-09-12T22:49:39.753 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.753 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:39.753 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.753 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:198 4.12 4:4a0eff6f:::100000002bf.00000000:head [write 0~98] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:39.753 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.343572+0000", 2024-09-12T22:49:39.753 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.31747027999999999, 2024-09-12T22:49:39.753 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084413230000000006, 2024-09-12T22:49:39.753 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:39.753 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:39.753 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:39.754 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:39.754 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:39.754 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:39.754 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 198 2024-09-12T22:49:39.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.754 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:39.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:39.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343572+0000", 2024-09-12T22:49:39.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:39.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343572+0000", 2024-09-12T22:49:39.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.755 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:39.755 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343573+0000", 2024-09-12T22:49:39.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:49:39.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.755 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:39.755 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343578+0000", 2024-09-12T22:49:39.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4750000000000001e-06 2024-09-12T22:49:39.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.756 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:39.756 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343589+0000", 2024-09-12T22:49:39.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0709e-05 2024-09-12T22:49:39.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.756 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.756 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343594+0000", 2024-09-12T22:49:39.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4360000000000001e-06 2024-09-12T22:49:39.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.756 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:39.756 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343668+0000", 2024-09-12T22:49:39.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3907999999999998e-05 2024-09-12T22:49:39.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:39.757 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343741+0000", 2024-09-12T22:49:39.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2922000000000004e-05 2024-09-12T22:49:39.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:39.757 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343841+0000", 2024-09-12T22:49:39.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100412 2024-09-12T22:49:39.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:39.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349501+0000", 2024-09-12T22:49:39.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005659776 2024-09-12T22:49:39.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:39.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.351940+0000", 2024-09-12T22:49:39.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024390839999999998 2024-09-12T22:49:39.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:39.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.351986+0000", 2024-09-12T22:49:39.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5970999999999997e-05 2024-09-12T22:49:39.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:39.759 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352013+0000", 2024-09-12T22:49:39.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6871000000000001e-05 2024-09-12T22:49:39.759 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.759 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:39.759 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.759 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:205 4.37 4:ef7c8488:::100000002c6.00000000:head [write 0~98] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:39.759 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.349405+0000", 2024-09-12T22:49:39.759 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.31163755399999998, 2024-09-12T22:49:39.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078250019999999993, 2024-09-12T22:49:39.760 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:39.760 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:39.760 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:39.760 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:39.760 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:39.760 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:39.760 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 205 2024-09-12T22:49:39.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.760 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:39.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.760 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:39.760 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349405+0000", 2024-09-12T22:49:39.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:39.761 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349405+0000", 2024-09-12T22:49:39.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:39.761 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349405+0000", 2024-09-12T22:49:39.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:49:39.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:39.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349409+0000", 2024-09-12T22:49:39.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1359999999999999e-06 2024-09-12T22:49:39.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:39.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349418+0000", 2024-09-12T22:49:39.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3289999999999994e-06 2024-09-12T22:49:39.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349423+0000", 2024-09-12T22:49:39.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9949999999999996e-06 2024-09-12T22:49:39.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:39.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349469+0000", 2024-09-12T22:49:39.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6008999999999999e-05 2024-09-12T22:49:39.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:39.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349570+0000", 2024-09-12T22:49:39.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100831 2024-09-12T22:49:39.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:39.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349682+0000", 2024-09-12T22:49:39.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011268 2024-09-12T22:49:39.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:39.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.351968+0000", 2024-09-12T22:49:39.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022860379999999998 2024-09-12T22:49:39.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:39.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.357145+0000", 2024-09-12T22:49:39.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051769759999999998 2024-09-12T22:49:39.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:39.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.357187+0000", 2024-09-12T22:49:39.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1248999999999998e-05 2024-09-12T22:49:39.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:39.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.357230+0000", 2024-09-12T22:49:39.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3010000000000003e-05 2024-09-12T22:49:39.765 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.765 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:39.766 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.766 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:208 4.1c e50/17 4:3b628a21:::100000002c9.00000000:head v 50'2, mlcod=0'0)", 2024-09-12T22:49:39.766 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.352179+0000", 2024-09-12T22:49:39.766 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.30886353500000002, 2024-09-12T22:49:39.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0076543849999999997, 2024-09-12T22:49:39.766 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:39.766 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:39.766 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:39.766 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:39.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.766 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:39.767 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352179+0000", 2024-09-12T22:49:39.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:39.767 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352179+0000", 2024-09-12T22:49:39.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:39.767 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352179+0000", 2024-09-12T22:49:39.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0200000000000002e-07 2024-09-12T22:49:39.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:39.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352184+0000", 2024-09-12T22:49:39.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0470000000000001e-06 2024-09-12T22:49:39.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:39.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352190+0000", 2024-09-12T22:49:39.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9519999999999999e-06 2024-09-12T22:49:39.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352194+0000", 2024-09-12T22:49:39.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.369e-06 2024-09-12T22:49:39.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:39.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352232+0000", 2024-09-12T22:49:39.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7752e-05 2024-09-12T22:49:39.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:39.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352249+0000", 2024-09-12T22:49:39.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6796e-05 2024-09-12T22:49:39.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:39.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.359795+0000", 2024-09-12T22:49:39.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0075457989999999997 2024-09-12T22:49:39.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:39.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.359833+0000", 2024-09-12T22:49:39.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8167999999999998e-05 2024-09-12T22:49:39.770 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.770 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:39.771 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.771 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:247 4.a 4:5080b297:::100000002f5.00000000:head [write 0~12498] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:39.771 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.390848+0000", 2024-09-12T22:49:39.771 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.27019393800000002, 2024-09-12T22:49:39.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071234089999999998, 2024-09-12T22:49:39.771 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:39.771 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:39.771 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:39.771 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:39.771 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:39.771 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:39.772 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 247 2024-09-12T22:49:39.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.772 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:39.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:39.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.390848+0000", 2024-09-12T22:49:39.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:39.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.390848+0000", 2024-09-12T22:49:39.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:39.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:39.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.390849+0000", 2024-09-12T22:49:39.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-09-12T22:49:39.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:39.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.390860+0000", 2024-09-12T22:49:39.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.151e-05 2024-09-12T22:49:39.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:39.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.390869+0000", 2024-09-12T22:49:39.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3389999999999993e-06 2024-09-12T22:49:39.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:39.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.390877+0000", 2024-09-12T22:49:39.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3310000000000004e-06 2024-09-12T22:49:39.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:39.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.390930+0000", 2024-09-12T22:49:39.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2685999999999997e-05 2024-09-12T22:49:39.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:39.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.391048+0000", 2024-09-12T22:49:39.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000118566 2024-09-12T22:49:39.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:39.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.397864+0000", 2024-09-12T22:49:39.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0068154690000000002 2024-09-12T22:49:39.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:39.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.397904+0000", 2024-09-12T22:49:39.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0185000000000002e-05 2024-09-12T22:49:39.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:39.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:39.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:39.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.397972+0000", 2024-09-12T22:49:39.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7552999999999995e-05 2024-09-12T22:49:39.776 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.776 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:39.776 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.776 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:39.776 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:39.776 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:39.778 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:39.776+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:39.778 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:39.878 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:39.877+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:39.888 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:39.888 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:39.888 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:49:39.888 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:39.897 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:39.983 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:39.982+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:40.050 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:40.050 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:40.051 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:49:40.051 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:49:40.051 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:40.060 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:40.080 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:40.079+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:40.182 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:40.180+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:40.213 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:40.213 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:49:40.213 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:49:40.213 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:49:40.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.214 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:40.214 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:40.214 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 95.046938286, 2024-09-12T22:49:40.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:49:40.214 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:40.214 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:40.214 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:40.214 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:40.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.214 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:40.214 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:40.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.215 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:40.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:40.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.215 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:40.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:49:40.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:49:40.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:40.216 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:49:40.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:49:40.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:40.216 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:49:40.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:49:40.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:40.217 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:49:40.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:49:40.217 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.217 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.217 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:40.217 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:40.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:49:40.217 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.217 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.217 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:40.217 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:40.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:49:40.217 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:40.218 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:49:40.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:49:40.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:40.218 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:49:40.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:49:40.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:40.218 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:49:40.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:49:40.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:40.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:49:40.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:49:40.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:40.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:49:40.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:49:40.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.220 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:40.220 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:49:40.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:49:40.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.220 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:40.220 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:49:40.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:49:40.220 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.220 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:40.220 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.221 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:40.221 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:40.221 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 95.046838769000004, 2024-09-12T22:49:40.221 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:49:40.221 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:40.221 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:40.221 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:40.221 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:40.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.221 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:40.221 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:40.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.222 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:40.222 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:40.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.222 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:40.222 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:49:40.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:49:40.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:40.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:49:40.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:49:40.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:40.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:49:40.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:49:40.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:40.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:49:40.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:49:40.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:40.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:49:40.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:49:40.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:40.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:49:40.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:49:40.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.225 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.225 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:40.225 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:49:40.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:49:40.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.225 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.225 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:40.225 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:49:40.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:49:40.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.225 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.226 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:40.226 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:49:40.226 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:49:40.226 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.226 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.226 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:40.226 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:49:40.226 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:49:40.226 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.226 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.226 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:40.226 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:49:40.227 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:49:40.227 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.227 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.227 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:40.227 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:49:40.227 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:49:40.227 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.227 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.227 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:40.227 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:49:40.227 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:49:40.227 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.228 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:40.228 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.228 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.228 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.228 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:40.228 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:40.228 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 95.046794030000001, 2024-09-12T22:49:40.228 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:49:40.228 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:40.228 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:40.228 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:40.228 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:40.229 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.229 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:40.229 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:40.229 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.229 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.229 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.229 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:40.229 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:40.229 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.229 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.229 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.230 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:40.230 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:49:40.230 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:49:40.230 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.230 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.230 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:40.230 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:40.230 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:49:40.230 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.230 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.230 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:40.230 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:40.231 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:49:40.231 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.231 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.231 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:40.231 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:49:40.231 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:49:40.231 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.231 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.231 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:40.231 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:49:40.231 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:49:40.231 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.232 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.232 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:40.232 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:49:40.232 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:49:40.232 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.232 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.232 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:40.232 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:49:40.232 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:49:40.232 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.232 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.232 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:40.233 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:49:40.233 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:49:40.233 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.233 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.233 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:40.233 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:49:40.233 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:49:40.233 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.233 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.233 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:40.233 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:49:40.233 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:49:40.233 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.234 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.234 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:40.234 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:49:40.234 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:49:40.234 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.234 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.234 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:40.234 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:49:40.234 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:49:40.234 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.234 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.234 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:40.235 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:49:40.235 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:49:40.235 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.235 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:40.235 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.235 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.235 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.235 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:40.235 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:40.235 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 95.046566329000001, 2024-09-12T22:49:40.235 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:49:40.235 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:40.235 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:40.235 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:40.236 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:40.236 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.236 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:40.236 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:40.236 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.236 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.236 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.236 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:40.236 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:40.236 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.236 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.236 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.236 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:40.237 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:49:40.237 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:49:40.237 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.237 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.237 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:40.237 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:49:40.237 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:49:40.237 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.237 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.237 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:40.237 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:49:40.237 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:49:40.237 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.237 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.237 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:40.238 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:49:40.238 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:49:40.238 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.238 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.238 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:40.238 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:49:40.238 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:49:40.238 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.238 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.238 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:40.238 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:49:40.238 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:49:40.238 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.239 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.239 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:40.239 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:49:40.239 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:49:40.239 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.239 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.239 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:40.239 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:49:40.239 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:49:40.239 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.239 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.239 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:40.240 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:49:40.240 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:49:40.240 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.240 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.240 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:40.240 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:49:40.240 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:49:40.240 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.240 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.240 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:40.240 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:49:40.240 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:49:40.241 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.241 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.241 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:40.241 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:49:40.241 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:49:40.241 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.241 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.241 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:40.241 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:49:40.241 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:49:40.241 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.241 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:40.242 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.242 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.242 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.242 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:40.242 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:40.242 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 95.046401220999996, 2024-09-12T22:49:40.242 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:49:40.242 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:40.242 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:40.242 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:40.242 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:40.242 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.242 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:40.242 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:40.243 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.243 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.243 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.243 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:40.243 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:40.243 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.243 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.243 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.243 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:40.243 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:49:40.243 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:49:40.243 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.243 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.243 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:40.244 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:49:40.244 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:49:40.244 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.244 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.244 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:40.244 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:49:40.244 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:49:40.244 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.244 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.244 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:40.244 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:49:40.244 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:49:40.244 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.245 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.245 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:40.245 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:49:40.245 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:49:40.245 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.245 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.245 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:40.245 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:49:40.245 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:49:40.245 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.245 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.245 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:40.246 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:49:40.246 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:49:40.246 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.246 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.246 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:40.246 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:49:40.246 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:49:40.246 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.246 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.246 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:40.246 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:49:40.246 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:49:40.246 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.247 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.247 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:40.247 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:49:40.247 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:49:40.247 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.247 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.247 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:40.247 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:49:40.247 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:49:40.247 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.247 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.247 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:40.248 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:49:40.248 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:49:40.248 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.248 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.248 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:40.248 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:49:40.248 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:49:40.248 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.248 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:40.248 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.248 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.249 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.249 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:40.249 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:40.249 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 95.046339935999995, 2024-09-12T22:49:40.249 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:49:40.249 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:40.249 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:40.249 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:40.249 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:40.249 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.249 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:40.250 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:40.250 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.250 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.250 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.250 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:40.250 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:40.250 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.250 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.250 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.250 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:40.250 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:40.250 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:49:40.251 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.251 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.251 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:40.251 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:49:40.251 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:49:40.251 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.251 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.251 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:40.251 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:49:40.251 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:49:40.251 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.251 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.251 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:40.252 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:49:40.252 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:49:40.252 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.252 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.252 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:40.252 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:49:40.252 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:49:40.252 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.252 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.252 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:40.252 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:49:40.252 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:49:40.252 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.253 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.253 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:40.253 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:49:40.253 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:49:40.253 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.253 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.253 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:40.253 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:49:40.253 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:49:40.253 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.253 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.253 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:40.253 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:49:40.253 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:49:40.254 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.254 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.254 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:40.254 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:49:40.254 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:49:40.254 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.254 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.254 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:40.254 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:49:40.254 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:49:40.254 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.254 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.254 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:40.254 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:49:40.255 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:49:40.255 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.255 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.255 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:40.255 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:49:40.255 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:49:40.255 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.255 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:40.255 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.255 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.255 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.255 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:40.256 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:40.256 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 95.046259828000004, 2024-09-12T22:49:40.256 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:49:40.256 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:40.256 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:40.256 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:40.256 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:40.256 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.256 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:40.256 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:40.256 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.256 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.256 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.257 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:40.257 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:40.257 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.257 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.257 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.257 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:40.257 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:49:40.257 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:49:40.257 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.257 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.257 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:40.257 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:49:40.258 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:49:40.258 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.258 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.258 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:40.258 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:49:40.258 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:49:40.258 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.258 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.258 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:40.258 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:49:40.258 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:49:40.258 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.258 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.259 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:40.259 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:49:40.259 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:49:40.259 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.259 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.259 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:40.259 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:49:40.259 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:49:40.259 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.259 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.259 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:40.259 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:49:40.259 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:49:40.260 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.260 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.260 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:40.260 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:49:40.260 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:49:40.260 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.260 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.260 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:40.260 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:49:40.260 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:49:40.260 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.260 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.261 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:40.261 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:49:40.261 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:49:40.261 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.261 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.261 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:40.261 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:49:40.261 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:49:40.261 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.261 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.261 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:40.261 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:49:40.261 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:49:40.262 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.262 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.262 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:40.262 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:49:40.262 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:49:40.262 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.262 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:40.262 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.262 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.262 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.262 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:40.262 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:40.262 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 95.046210875, 2024-09-12T22:49:40.262 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:49:40.263 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:40.263 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:40.263 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:40.263 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:40.263 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.263 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:40.263 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:40.263 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.263 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.263 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.263 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:40.263 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:40.263 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.263 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.264 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.264 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:40.264 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:40.264 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:49:40.264 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.264 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.264 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:40.264 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:49:40.264 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:49:40.264 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.264 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.264 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:40.265 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:49:40.265 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:49:40.265 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.265 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.265 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:40.265 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:49:40.265 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:49:40.265 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.265 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.265 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:40.265 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:49:40.265 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:49:40.266 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.266 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.266 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:40.266 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:49:40.266 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:49:40.266 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.266 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.266 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:40.266 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:49:40.266 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:49:40.266 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.266 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:40.266 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.267 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.267 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.267 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:40.267 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:40.267 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 95.046161775000002, 2024-09-12T22:49:40.267 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:49:40.267 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:40.267 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:40.267 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:40.267 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:40.267 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.267 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:40.267 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:40.268 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.268 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.268 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.268 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:40.268 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:40.268 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.268 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.268 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.268 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:40.268 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:49:40.268 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:49:40.268 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.269 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.269 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:40.269 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:49:40.269 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:49:40.269 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.269 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.269 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:40.269 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:49:40.269 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:49:40.269 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.269 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.269 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:40.270 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:49:40.270 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:49:40.270 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.270 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.270 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:40.270 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:49:40.270 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:49:40.270 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.270 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.270 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:40.270 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:49:40.270 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:49:40.270 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.270 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.271 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:40.271 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:49:40.271 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:49:40.271 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.271 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:40.271 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.271 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.271 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:40.271 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.082046+0000", 2024-09-12T22:49:40.271 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.1291028190000001, 2024-09-12T22:49:40.271 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012182124000000001, 2024-09-12T22:49:40.271 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:40.272 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:40.272 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:40.272 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:40.272 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:40.272 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:40.272 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 4 2024-09-12T22:49:40.272 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.272 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:40.272 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.272 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:40.272 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.082046+0000", 2024-09-12T22:49:40.272 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.272 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.273 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.273 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:40.273 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.082046+0000", 2024-09-12T22:49:40.273 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.273 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.273 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.273 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:40.273 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.082048+0000", 2024-09-12T22:49:40.273 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5969999999999999e-06 2024-09-12T22:49:40.273 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.273 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.273 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:40.273 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.087738+0000", 2024-09-12T22:49:40.274 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0056892499999999999 2024-09-12T22:49:40.274 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.274 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.274 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:40.274 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.087782+0000", 2024-09-12T22:49:40.274 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4267999999999997e-05 2024-09-12T22:49:40.274 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.274 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.274 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:40.274 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.087795+0000", 2024-09-12T22:49:40.274 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3560000000000001e-05 2024-09-12T22:49:40.274 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.275 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.275 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:40.275 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.087897+0000", 2024-09-12T22:49:40.275 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000102098 2024-09-12T22:49:40.275 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.275 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.275 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:40.275 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.087992+0000", 2024-09-12T22:49:40.275 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4407000000000006e-05 2024-09-12T22:49:40.275 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.275 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.275 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:40.276 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.094121+0000", 2024-09-12T22:49:40.276 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0061287340000000003 2024-09-12T22:49:40.276 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.276 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.276 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:40.276 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.094164+0000", 2024-09-12T22:49:40.276 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3269000000000002e-05 2024-09-12T22:49:40.276 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.276 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.276 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:40.276 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.094228+0000", 2024-09-12T22:49:40.276 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3941000000000003e-05 2024-09-12T22:49:40.277 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.277 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:40.277 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.277 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.277 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.277 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:40.277 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.159925+0000", 2024-09-12T22:49:40.277 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.05122388, 2024-09-12T22:49:40.277 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0099924560000000003, 2024-09-12T22:49:40.277 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:40.277 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:40.277 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:40.277 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:40.278 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:40.278 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:40.278 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 6 2024-09-12T22:49:40.278 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.278 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:40.278 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.278 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:40.278 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.159925+0000", 2024-09-12T22:49:40.278 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.278 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.278 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.278 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:40.278 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.159925+0000", 2024-09-12T22:49:40.279 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.279 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.279 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.279 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:40.279 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.159926+0000", 2024-09-12T22:49:40.279 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4890000000000001e-06 2024-09-12T22:49:40.279 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.279 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.279 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:40.279 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.163620+0000", 2024-09-12T22:49:40.279 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003694021 2024-09-12T22:49:40.279 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.280 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.280 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:40.280 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.163635+0000", 2024-09-12T22:49:40.280 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4732999999999999e-05 2024-09-12T22:49:40.280 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.280 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.280 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:40.280 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.163643+0000", 2024-09-12T22:49:40.280 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7209999999999994e-06 2024-09-12T22:49:40.280 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.280 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.280 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:40.280 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.163725+0000", 2024-09-12T22:49:40.281 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2263999999999997e-05 2024-09-12T22:49:40.281 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.281 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.281 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:40.281 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.163866+0000", 2024-09-12T22:49:40.281 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014159200000000001 2024-09-12T22:49:40.281 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.281 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.281 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:40.281 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.169766+0000", 2024-09-12T22:49:40.281 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0058992109999999997 2024-09-12T22:49:40.281 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.281 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.282 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:40.282 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.169817+0000", 2024-09-12T22:49:40.282 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1115000000000001e-05 2024-09-12T22:49:40.282 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.282 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.282 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:40.282 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.169917+0000", 2024-09-12T22:49:40.282 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010030999999999999 2024-09-12T22:49:40.282 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.282 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:40.282 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.282 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.282 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.283 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4459.0:5 4.10 e50/17 4:09a4c37f:::10000000003.00000001:head v 50'1, mlcod=0'0)", 2024-09-12T22:49:40.283 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.167838+0000", 2024-09-12T22:49:40.283 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.04331069, 2024-09-12T22:49:40.283 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011071799, 2024-09-12T22:49:40.283 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:40.283 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:40.283 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:40.283 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:40.283 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.283 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:40.283 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.167838+0000", 2024-09-12T22:49:40.283 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.283 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.284 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.284 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:40.284 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.167838+0000", 2024-09-12T22:49:40.284 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.284 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.284 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.284 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:40.284 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.167839+0000", 2024-09-12T22:49:40.284 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5600000000000004e-07 2024-09-12T22:49:40.284 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.284 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.284 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:40.284 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.172178+0000", 2024-09-12T22:49:40.285 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043395860000000003 2024-09-12T22:49:40.285 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.285 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.285 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:40.285 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.172192+0000", 2024-09-12T22:49:40.285 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3451999999999999e-05 2024-09-12T22:49:40.285 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.285 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.285 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:40.285 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.172205+0000", 2024-09-12T22:49:40.285 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2853e-05 2024-09-12T22:49:40.285 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.285 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.286 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:40.286 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.172281+0000", 2024-09-12T22:49:40.286 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6093000000000005e-05 2024-09-12T22:49:40.286 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.286 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.286 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:40.286 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.172301+0000", 2024-09-12T22:49:40.286 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0276e-05 2024-09-12T22:49:40.286 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.286 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.286 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:40.286 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.178879+0000", 2024-09-12T22:49:40.286 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0065783539999999998 2024-09-12T22:49:40.287 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.287 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.287 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:40.287 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.178910+0000", 2024-09-12T22:49:40.287 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0329e-05 2024-09-12T22:49:40.287 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.287 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:40.287 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.287 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.287 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.287 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:57 4.9 4:91e366d7:::10000000230.00000000:head [write 0~1966] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:40.287 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.216970+0000", 2024-09-12T22:49:40.287 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.99417891599999997, 2024-09-12T22:49:40.288 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082673929999999996, 2024-09-12T22:49:40.288 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:40.288 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:40.288 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:40.288 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:40.288 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:40.288 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:40.288 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 57 2024-09-12T22:49:40.288 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.288 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:40.288 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.288 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:40.289 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.216970+0000", 2024-09-12T22:49:40.289 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.289 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.289 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.289 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:40.289 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.216970+0000", 2024-09-12T22:49:40.289 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.289 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.289 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.289 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:40.289 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.216970+0000", 2024-09-12T22:49:40.289 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:49:40.289 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.290 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.290 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:40.290 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.216977+0000", 2024-09-12T22:49:40.290 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1999999999999997e-06 2024-09-12T22:49:40.290 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.290 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.290 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:40.290 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.216985+0000", 2024-09-12T22:49:40.290 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.909e-06 2024-09-12T22:49:40.290 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.290 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.290 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:40.290 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.216991+0000", 2024-09-12T22:49:40.290 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4260000000000002e-06 2024-09-12T22:49:40.291 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.291 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.291 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:40.291 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.217025+0000", 2024-09-12T22:49:40.291 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4591999999999997e-05 2024-09-12T22:49:40.291 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.291 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.291 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:40.291 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.217089+0000", 2024-09-12T22:49:40.291 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3226999999999996e-05 2024-09-12T22:49:40.291 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.291 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.291 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:40.292 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.217152+0000", 2024-09-12T22:49:40.292 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3089999999999994e-05 2024-09-12T22:49:40.292 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.292 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.292 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:40.292 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.217745+0000", 2024-09-12T22:49:40.292 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00059294899999999995 2024-09-12T22:49:40.292 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.292 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.292 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:40.292 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.225195+0000", 2024-09-12T22:49:40.292 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.007450623 2024-09-12T22:49:40.292 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.292 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.292 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:40.293 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.225219+0000", 2024-09-12T22:49:40.293 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3773000000000001e-05 2024-09-12T22:49:40.293 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.293 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.293 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:40.293 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.225237+0000", 2024-09-12T22:49:40.293 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7927999999999998e-05 2024-09-12T22:49:40.293 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.293 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:40.293 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.293 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.293 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.293 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:75 4.2e 4:7528f44f:::10000000242.00000000:head [write 0~1151] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:40.294 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.232047+0000", 2024-09-12T22:49:40.294 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.97910123999999998, 2024-09-12T22:49:40.294 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082051009999999994, 2024-09-12T22:49:40.294 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:40.294 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:40.294 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:40.294 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:40.294 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:40.294 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:40.295 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 75 2024-09-12T22:49:40.295 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.295 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:40.295 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.295 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:40.295 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232047+0000", 2024-09-12T22:49:40.295 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.295 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.295 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.295 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:40.295 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232047+0000", 2024-09-12T22:49:40.295 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.295 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.296 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.296 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:40.296 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232048+0000", 2024-09-12T22:49:40.296 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6700000000000003e-07 2024-09-12T22:49:40.296 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.296 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.296 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:40.296 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232052+0000", 2024-09-12T22:49:40.296 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1139999999999999e-06 2024-09-12T22:49:40.296 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.296 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.296 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:40.296 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232063+0000", 2024-09-12T22:49:40.297 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0781000000000001e-05 2024-09-12T22:49:40.297 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.297 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.297 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:40.297 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232068+0000", 2024-09-12T22:49:40.297 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0579999999999997e-06 2024-09-12T22:49:40.297 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.297 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.297 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:40.297 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232102+0000", 2024-09-12T22:49:40.297 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3976000000000001e-05 2024-09-12T22:49:40.297 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.297 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.298 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:40.298 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232174+0000", 2024-09-12T22:49:40.298 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2254000000000003e-05 2024-09-12T22:49:40.298 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.298 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.298 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:40.298 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232245+0000", 2024-09-12T22:49:40.298 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0597000000000002e-05 2024-09-12T22:49:40.298 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.298 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.298 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:40.298 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.233156+0000", 2024-09-12T22:49:40.298 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00091127799999999996 2024-09-12T22:49:40.299 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.299 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.299 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:40.299 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.240194+0000", 2024-09-12T22:49:40.299 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0070376140000000002 2024-09-12T22:49:40.299 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.299 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.299 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:40.299 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.240228+0000", 2024-09-12T22:49:40.299 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4347999999999997e-05 2024-09-12T22:49:40.299 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.299 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.300 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:40.300 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.240252+0000", 2024-09-12T22:49:40.300 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4314000000000001e-05 2024-09-12T22:49:40.300 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.300 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:40.300 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.300 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.300 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.300 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:76 4.25 4:a7ae8a0f:::10000000243.00000000:head [write 0~1194] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:40.300 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.232867+0000", 2024-09-12T22:49:40.300 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.97828119000000002, 2024-09-12T22:49:40.300 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074145970000000002, 2024-09-12T22:49:40.300 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:40.300 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:40.301 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:40.301 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:40.301 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:40.301 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:40.301 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 76 2024-09-12T22:49:40.301 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.301 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:40.301 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.301 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:40.301 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232867+0000", 2024-09-12T22:49:40.301 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.301 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.301 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.302 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:40.302 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232867+0000", 2024-09-12T22:49:40.302 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.302 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.302 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.302 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:40.302 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232868+0000", 2024-09-12T22:49:40.302 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6000000000000003e-07 2024-09-12T22:49:40.302 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.302 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.302 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:40.302 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232877+0000", 2024-09-12T22:49:40.302 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5140000000000001e-06 2024-09-12T22:49:40.303 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.303 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.303 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:40.303 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232888+0000", 2024-09-12T22:49:40.303 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0927999999999999e-05 2024-09-12T22:49:40.303 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.303 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.303 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:40.303 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232892+0000", 2024-09-12T22:49:40.303 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8999999999999997e-06 2024-09-12T22:49:40.303 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.303 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.303 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:40.304 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232936+0000", 2024-09-12T22:49:40.304 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3779000000000002e-05 2024-09-12T22:49:40.304 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.304 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.304 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:40.304 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.233005+0000", 2024-09-12T22:49:40.304 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8685999999999999e-05 2024-09-12T22:49:40.304 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.304 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.304 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:40.304 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.240176+0000", 2024-09-12T22:49:40.304 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071707070000000001 2024-09-12T22:49:40.305 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.305 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.305 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:40.305 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.240232+0000", 2024-09-12T22:49:40.305 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6493000000000003e-05 2024-09-12T22:49:40.305 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.305 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.305 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:40.305 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.240282+0000", 2024-09-12T22:49:40.305 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9830000000000002e-05 2024-09-12T22:49:40.305 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.305 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:40.306 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.306 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.306 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.306 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:127 4.3 4:c2ce25ce:::10000000277.00000000:head [write 0~111] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:40.306 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.279463+0000", 2024-09-12T22:49:40.306 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.93168514700000005, 2024-09-12T22:49:40.306 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0083277809999999994, 2024-09-12T22:49:40.306 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:40.306 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:40.306 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:40.306 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:40.307 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:40.307 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:40.307 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 127 2024-09-12T22:49:40.307 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.307 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:40.307 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.307 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:40.307 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.279463+0000", 2024-09-12T22:49:40.307 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.307 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.307 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.307 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:40.308 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.279463+0000", 2024-09-12T22:49:40.308 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.308 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.308 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.308 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:40.308 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.279464+0000", 2024-09-12T22:49:40.308 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4899999999999995e-07 2024-09-12T22:49:40.308 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.308 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.308 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:40.308 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.279468+0000", 2024-09-12T22:49:40.308 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6720000000000002e-06 2024-09-12T22:49:40.308 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.309 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.309 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:40.309 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.279475+0000", 2024-09-12T22:49:40.309 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3180000000000001e-06 2024-09-12T22:49:40.309 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.309 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.309 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:40.309 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.279480+0000", 2024-09-12T22:49:40.309 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2599999999999996e-06 2024-09-12T22:49:40.309 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.309 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.309 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:40.309 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.279519+0000", 2024-09-12T22:49:40.310 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8549e-05 2024-09-12T22:49:40.310 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.310 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.310 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:40.310 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.279577+0000", 2024-09-12T22:49:40.310 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7812999999999997e-05 2024-09-12T22:49:40.310 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.310 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.310 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:40.310 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.287689+0000", 2024-09-12T22:49:40.310 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081127490000000007 2024-09-12T22:49:40.310 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.310 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.311 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:40.311 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.287730+0000", 2024-09-12T22:49:40.311 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1044000000000002e-05 2024-09-12T22:49:40.311 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.311 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.311 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:40.311 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.287791+0000", 2024-09-12T22:49:40.311 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0826999999999999e-05 2024-09-12T22:49:40.311 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.311 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:40.311 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.311 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.311 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.312 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:128 4.2e 4:74579a32:::10000000278.00000000:head [write 0~111] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:40.312 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.280292+0000", 2024-09-12T22:49:40.312 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.93085626200000005, 2024-09-12T22:49:40.312 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075002829999999999, 2024-09-12T22:49:40.312 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:40.312 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:40.312 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:40.312 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:40.312 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:40.312 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:40.312 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 128 2024-09-12T22:49:40.312 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.312 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:40.313 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.313 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:40.313 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.280292+0000", 2024-09-12T22:49:40.313 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.313 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.313 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.313 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:40.313 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.280292+0000", 2024-09-12T22:49:40.313 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.313 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.313 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.313 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:40.314 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.280293+0000", 2024-09-12T22:49:40.314 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7199999999999998e-07 2024-09-12T22:49:40.314 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.314 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.314 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:40.314 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.280297+0000", 2024-09-12T22:49:40.314 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0239999999999999e-06 2024-09-12T22:49:40.314 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.314 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.314 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:40.314 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.280308+0000", 2024-09-12T22:49:40.314 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0855e-05 2024-09-12T22:49:40.314 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.315 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.315 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:40.315 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.280313+0000", 2024-09-12T22:49:40.315 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0069999999999997e-06 2024-09-12T22:49:40.315 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.315 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.315 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:40.315 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.280351+0000", 2024-09-12T22:49:40.315 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8263000000000003e-05 2024-09-12T22:49:40.315 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.315 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.315 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:40.315 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.280420+0000", 2024-09-12T22:49:40.316 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8997000000000004e-05 2024-09-12T22:49:40.316 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.316 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.316 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:40.316 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.280492+0000", 2024-09-12T22:49:40.316 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1444000000000002e-05 2024-09-12T22:49:40.316 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.316 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.316 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:40.316 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.281313+0000", 2024-09-12T22:49:40.316 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00082160600000000001 2024-09-12T22:49:40.316 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.316 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.317 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:40.317 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.287738+0000", 2024-09-12T22:49:40.317 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0064246069999999997 2024-09-12T22:49:40.317 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.317 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.317 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:40.317 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.287762+0000", 2024-09-12T22:49:40.317 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4179e-05 2024-09-12T22:49:40.317 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.317 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.317 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:40.317 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.287793+0000", 2024-09-12T22:49:40.318 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0528999999999999e-05 2024-09-12T22:49:40.318 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.318 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:40.318 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.318 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.318 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.318 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4459.0:151 4.7 e50/17 4:e25a3370:::10000000290.00000000:head v 50'3, mlcod=50'1)", 2024-09-12T22:49:40.318 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.302310+0000", 2024-09-12T22:49:40.318 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.90883873100000001, 2024-09-12T22:49:40.318 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0077636090000000003, 2024-09-12T22:49:40.318 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:40.318 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:40.318 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:40.318 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:40.319 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.319 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:40.319 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302310+0000", 2024-09-12T22:49:40.319 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.319 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.319 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.319 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:40.319 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302310+0000", 2024-09-12T22:49:40.319 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.319 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.319 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.319 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:40.319 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302310+0000", 2024-09-12T22:49:40.320 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4000000000000001e-07 2024-09-12T22:49:40.320 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.320 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.320 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:40.320 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302336+0000", 2024-09-12T22:49:40.320 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5887000000000001e-05 2024-09-12T22:49:40.320 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.320 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.320 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:40.320 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302346+0000", 2024-09-12T22:49:40.320 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8679999999999994e-06 2024-09-12T22:49:40.320 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.320 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.321 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:40.321 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302351+0000", 2024-09-12T22:49:40.321 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7600000000000002e-06 2024-09-12T22:49:40.321 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.321 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.321 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:40.321 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302392+0000", 2024-09-12T22:49:40.321 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1124999999999997e-05 2024-09-12T22:49:40.321 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.321 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.321 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:40.321 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302411+0000", 2024-09-12T22:49:40.321 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9357000000000001e-05 2024-09-12T22:49:40.321 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.322 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.322 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:40.322 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.310029+0000", 2024-09-12T22:49:40.322 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0076178050000000001 2024-09-12T22:49:40.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.322 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.322 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:40.322 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.310073+0000", 2024-09-12T22:49:40.322 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4166999999999999e-05 2024-09-12T22:49:40.322 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.322 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:40.322 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.323 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.323 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:152 4.25 4:a61cbf99:::10000000291.00000000:head [write 0~111] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:40.323 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.302816+0000", 2024-09-12T22:49:40.323 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.90833287399999996, 2024-09-12T22:49:40.323 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0073514330000000001, 2024-09-12T22:49:40.323 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:40.323 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:40.323 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:40.323 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:40.323 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:40.323 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:40.323 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 152 2024-09-12T22:49:40.323 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.323 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:40.324 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.324 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:40.324 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302816+0000", 2024-09-12T22:49:40.324 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.324 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.324 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.324 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:40.324 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302816+0000", 2024-09-12T22:49:40.324 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.324 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.324 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.324 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:40.324 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302817+0000", 2024-09-12T22:49:40.325 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8299999999999995e-07 2024-09-12T22:49:40.325 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.325 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.325 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:40.325 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302821+0000", 2024-09-12T22:49:40.325 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2629999999999997e-06 2024-09-12T22:49:40.325 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.325 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.325 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:40.325 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302832+0000", 2024-09-12T22:49:40.325 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0815000000000001e-05 2024-09-12T22:49:40.325 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.325 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.326 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:40.326 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302837+0000", 2024-09-12T22:49:40.326 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0590000000000002e-06 2024-09-12T22:49:40.326 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.326 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.326 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:40.326 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302884+0000", 2024-09-12T22:49:40.326 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7638e-05 2024-09-12T22:49:40.326 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.326 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.326 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:40.326 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302954+0000", 2024-09-12T22:49:40.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9380000000000003e-05 2024-09-12T22:49:40.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:40.327 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.310056+0000", 2024-09-12T22:49:40.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071018729999999999 2024-09-12T22:49:40.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:40.327 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.310098+0000", 2024-09-12T22:49:40.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2218000000000001e-05 2024-09-12T22:49:40.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.328 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:40.328 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.310167+0000", 2024-09-12T22:49:40.328 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9303999999999999e-05 2024-09-12T22:49:40.328 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.328 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:40.328 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.328 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:208 4.1c 4:3b628a21:::100000002c9.00000000:head [write 0~98] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:40.328 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.351805+0000", 2024-09-12T22:49:40.329 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.85934326599999999, 2024-09-12T22:49:40.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082360720000000005, 2024-09-12T22:49:40.329 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:40.329 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:40.329 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:40.329 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:40.329 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:40.329 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:40.329 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 208 2024-09-12T22:49:40.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.329 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:40.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.330 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:40.330 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.351805+0000", 2024-09-12T22:49:40.330 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.330 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.330 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.330 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:40.330 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.351805+0000", 2024-09-12T22:49:40.330 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:40.330 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.330 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.330 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:40.330 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.351806+0000", 2024-09-12T22:49:40.330 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9599999999999999e-07 2024-09-12T22:49:40.331 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.331 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.331 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:40.331 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.351809+0000", 2024-09-12T22:49:40.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7970000000000001e-06 2024-09-12T22:49:40.331 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.331 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.331 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:40.331 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.351816+0000", 2024-09-12T22:49:40.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8029999999999997e-06 2024-09-12T22:49:40.331 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.331 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.331 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:40.332 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.351820+0000", 2024-09-12T22:49:40.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2990000000000001e-06 2024-09-12T22:49:40.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:40.332 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.351882+0000", 2024-09-12T22:49:40.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2187999999999995e-05 2024-09-12T22:49:40.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:40.332 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.351986+0000", 2024-09-12T22:49:40.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000104387 2024-09-12T22:49:40.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.333 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:40.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.352107+0000", 2024-09-12T22:49:40.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000120384 2024-09-12T22:49:40.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.333 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:40.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.354089+0000", 2024-09-12T22:49:40.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001981961 2024-09-12T22:49:40.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.333 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:40.334 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.359962+0000", 2024-09-12T22:49:40.334 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0058737729999999997 2024-09-12T22:49:40.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.334 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:40.334 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.360007+0000", 2024-09-12T22:49:40.334 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4668e-05 2024-09-12T22:49:40.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:40.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:40.334 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:40.334 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.360041+0000", 2024-09-12T22:49:40.334 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4316000000000001e-05 2024-09-12T22:49:40.335 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.335 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:40.335 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.335 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:40.335 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:40.335 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:40.337 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:40.337 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:40.335+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:40.399 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:49:40.437 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:40.436+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:40.444 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:40.444 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:40.444 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:49:40.444 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:40.453 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:40.538 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:40.537+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:40.548 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:49:40.548 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:49:40.559 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:40.559 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:40.559 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:49:40.559 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:49:40.559 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:40.567 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:49:40.567 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:49:40.567 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:49:40.568 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:40.570 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:49:40.571 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:49:40.609 INFO:teuthology.orchestra.run.smithi066.stderr:noscrub is unset 2024-09-12T22:49:40.639 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:40.638+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:40.715 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:40.716 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:40.725 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:40.740 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:40.739+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:40.834 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:40.834 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:40.841 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:40.840+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:40.843 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:40.942 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:40.941+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:40.996 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:40.996 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:41.005 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:41.049 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:41.048+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:41.112 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:41.113 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:41.122 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:41.163 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:41.162+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:41.237 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:41.238 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:41.245 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:41.244+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:41.248 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:41.346 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:41.345+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:41.357 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:41.358 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:41.367 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:41.446 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:41.445+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:41.515 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:41.515 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:41.524 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:41.547 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:41.546+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:41.636 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:41.636 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:41.645 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:41.647 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:41.646+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:41.748 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:41.747+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:41.754 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:41.754 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:41.764 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:41.849 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:41.848+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:41.874 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:41.874 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:41.888 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:41.950 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:41.949+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:41.999 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:42.000 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:42.009 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:42.053 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:42.052+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:42.121 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:42.122 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:42.124 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~70s 2024-09-12T22:49:42.131 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:42.172 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:42.171+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:42.252 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:42.251+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:42.278 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:42.279 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:42.288 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:42.353 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:42.352+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:42.400 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:42.400 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:42.409 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:42.454 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:42.453+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:42.518 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:42.518 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:42.528 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:42.555 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:42.554+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:42.572 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:49:42.625 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:49:42.656 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:42.655+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:42.673 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:42.673 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:42.683 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:42.722 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:49:42.722 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:49:42.743 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:49:42.744 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:49:42.744 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:49:42.748 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:49:42.748 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:49:42.758 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:42.756+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:42.791 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:42.791 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:42.791 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:49:42.791 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:42.800 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:42.859 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:42.858+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:42.951 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:42.951 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:42.951 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:49:42.951 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:49:42.951 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:42.959 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:42.958+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:42.960 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:43.060 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:43.059+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:43.069 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:43.069 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:49:43.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:49:43.070 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:49:43.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.070 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:43.070 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:43.070 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 97.897185708999999, 2024-09-12T22:49:43.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:49:43.070 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:43.070 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:43.070 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:43.070 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:43.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:43.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:43.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:43.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:43.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:43.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:49:43.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:49:43.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:43.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:49:43.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:49:43.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:43.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:49:43.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:49:43.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:49:43.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:49:43.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:43.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:49:43.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:49:43.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:43.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:49:43.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:49:43.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:43.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:49:43.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:49:43.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:43.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:49:43.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:49:43.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:43.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:49:43.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:49:43.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:43.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:49:43.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:49:43.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:43.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:49:43.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:49:43.076 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.076 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:43.076 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.076 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:43.076 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:43.076 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 97.897114051000003, 2024-09-12T22:49:43.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:49:43.076 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:43.076 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:43.076 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:43.077 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:43.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:43.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:43.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:43.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:43.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:43.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:49:43.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:49:43.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:43.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:49:43.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:49:43.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:43.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:49:43.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:49:43.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:49:43.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:49:43.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:43.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:49:43.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:49:43.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:43.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:49:43.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:49:43.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:43.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:49:43.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:49:43.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:43.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:49:43.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:49:43.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:43.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:49:43.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:49:43.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:43.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:49:43.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:49:43.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:43.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:49:43.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:49:43.082 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.082 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:43.082 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.082 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:43.082 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:43.082 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 97.897071333, 2024-09-12T22:49:43.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:49:43.082 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:43.082 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:43.082 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:43.083 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:43.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:43.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:43.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:43.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:43.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:43.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:49:43.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:49:43.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:43.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:49:43.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:49:43.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:43.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:49:43.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:49:43.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:49:43.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:49:43.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:43.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:49:43.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:49:43.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:43.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:49:43.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:49:43.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:43.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:49:43.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:49:43.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:43.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:49:43.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:49:43.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:43.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:49:43.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:49:43.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:43.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:49:43.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:49:43.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:43.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:49:43.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:49:43.087 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.088 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:43.088 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.088 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:43.088 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:43.088 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 97.897033415999999, 2024-09-12T22:49:43.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:49:43.088 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:43.088 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:43.088 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:43.088 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:43.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:43.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:43.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:43.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:43.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:43.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:49:43.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:49:43.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:43.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:49:43.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:49:43.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:43.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:49:43.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:49:43.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:49:43.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:49:43.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:43.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:49:43.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:49:43.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:43.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:49:43.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:49:43.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:43.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:43.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:49:43.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:43.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:49:43.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:49:43.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:43.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:49:43.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:49:43.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:43.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:49:43.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:49:43.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:43.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:49:43.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:49:43.093 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.093 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:43.093 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.094 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:43.094 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:43.094 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 97.897009964999995, 2024-09-12T22:49:43.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:49:43.094 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:43.094 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:43.094 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:43.094 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:43.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:43.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:43.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:43.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:43.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:43.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:49:43.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:49:43.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:43.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:49:43.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:49:43.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:43.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:49:43.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:49:43.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:49:43.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:49:43.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:43.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:49:43.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:49:43.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:43.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:49:43.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:49:43.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:43.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:43.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:49:43.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:43.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:49:43.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:49:43.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:43.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:49:43.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:49:43.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:43.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:49:43.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:49:43.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:43.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:49:43.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:49:43.099 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.099 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:43.099 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.099 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:43.099 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:43.100 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 97.896985728000004, 2024-09-12T22:49:43.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:49:43.100 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:43.100 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:43.100 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:43.100 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:43.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:43.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:43.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:43.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:43.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:43.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:43.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:49:43.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:43.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:49:43.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:49:43.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:43.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:49:43.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:49:43.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:49:43.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:49:43.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:43.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:49:43.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:49:43.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:43.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:49:43.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:49:43.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:43.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:49:43.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:49:43.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:43.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:49:43.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:49:43.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:43.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:49:43.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:49:43.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:43.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:49:43.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:49:43.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:43.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:49:43.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:49:43.105 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.105 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:43.105 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.105 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:43.105 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:43.105 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 97.896957810999993, 2024-09-12T22:49:43.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:49:43.106 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:43.106 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:43.106 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:43.106 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:43.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:43.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:43.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:43.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:43.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:43.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:43.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:49:43.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:43.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:49:43.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:49:43.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:43.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:49:43.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:49:43.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:49:43.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:49:43.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:43.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:49:43.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:49:43.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:43.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:49:43.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:49:43.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:43.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:49:43.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:49:43.109 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.109 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:43.109 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.110 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:43.110 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:43.110 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 97.896883316, 2024-09-12T22:49:43.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:49:43.110 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:43.110 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:43.110 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:43.110 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:43.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:43.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:43.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:43.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:43.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:43.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:49:43.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:49:43.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:43.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:49:43.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:49:43.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:43.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:49:43.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:49:43.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:49:43.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:49:43.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:43.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:49:43.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:49:43.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:43.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:49:43.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:49:43.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:43.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:49:43.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:49:43.113 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.114 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:43.114 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.114 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:43.114 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:43.114 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 97.896837288, 2024-09-12T22:49:43.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:49:43.114 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:43.114 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:43.114 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:43.114 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:43.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:43.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:43.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:43.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:43.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:43.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:49:43.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:49:43.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:43.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:49:43.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:49:43.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:43.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:49:43.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:49:43.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:49:43.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:49:43.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:43.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:49:43.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:49:43.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:43.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:49:43.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:49:43.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:43.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:49:43.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:49:43.118 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.118 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:43.118 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.118 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:43.118 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.160867+0000", 2024-09-12T22:49:43.118 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.9068541159999999, 2024-09-12T22:49:43.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018225736999999999, 2024-09-12T22:49:43.119 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:43.119 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:43.119 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:43.119 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:43.119 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:43.119 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:43.119 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 5 2024-09-12T22:49:43.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.119 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:43.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:43.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.160867+0000", 2024-09-12T22:49:43.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:43.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.160867+0000", 2024-09-12T22:49:43.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:43.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.160869+0000", 2024-09-12T22:49:43.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1500000000000002e-06 2024-09-12T22:49:43.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:43.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.167303+0000", 2024-09-12T22:49:43.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0064335690000000001 2024-09-12T22:49:43.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:43.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.167320+0000", 2024-09-12T22:49:43.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7329e-05 2024-09-12T22:49:43.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.167329+0000", 2024-09-12T22:49:43.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4069999999999993e-06 2024-09-12T22:49:43.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:43.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.167402+0000", 2024-09-12T22:49:43.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3184999999999998e-05 2024-09-12T22:49:43.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:43.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.167550+0000", 2024-09-12T22:49:43.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014852499999999999 2024-09-12T22:49:43.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:43.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.167689+0000", 2024-09-12T22:49:43.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013904799999999999 2024-09-12T22:49:43.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:43.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.176328+0000", 2024-09-12T22:49:43.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0086384979999999997 2024-09-12T22:49:43.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:43.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.179037+0000", 2024-09-12T22:49:43.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027092599999999998 2024-09-12T22:49:43.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:43.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.179066+0000", 2024-09-12T22:49:43.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9132000000000002e-05 2024-09-12T22:49:43.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:43.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.179093+0000", 2024-09-12T22:49:43.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6633999999999999e-05 2024-09-12T22:49:43.124 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.124 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:43.124 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.124 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:57 4.9 e50/17 4:91e366d7:::10000000230.00000000:head v 50'1, mlcod=0'0)", 2024-09-12T22:49:43.124 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.217245+0000", 2024-09-12T22:49:43.125 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.850476381, 2024-09-12T22:49:43.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078517689999999998, 2024-09-12T22:49:43.125 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:43.125 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:43.125 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:43.125 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:43.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:43.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217245+0000", 2024-09-12T22:49:43.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:43.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217245+0000", 2024-09-12T22:49:43.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:43.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217246+0000", 2024-09-12T22:49:43.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5199999999999996e-07 2024-09-12T22:49:43.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:43.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217253+0000", 2024-09-12T22:49:43.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1330000000000001e-06 2024-09-12T22:49:43.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:43.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217261+0000", 2024-09-12T22:49:43.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4500000000000004e-06 2024-09-12T22:49:43.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217267+0000", 2024-09-12T22:49:43.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-06 2024-09-12T22:49:43.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:43.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217309+0000", 2024-09-12T22:49:43.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1535000000000001e-05 2024-09-12T22:49:43.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:43.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217325+0000", 2024-09-12T22:49:43.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6208000000000001e-05 2024-09-12T22:49:43.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:43.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.225071+0000", 2024-09-12T22:49:43.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077461470000000001 2024-09-12T22:49:43.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:43.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.225097+0000", 2024-09-12T22:49:43.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5384e-05 2024-09-12T22:49:43.129 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.129 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:43.129 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.129 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:144 4.20 4:069ea127:::10000000289.00000000:head [write 0~1223] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:43.129 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.294752+0000", 2024-09-12T22:49:43.129 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.7729689080000002, 2024-09-12T22:49:43.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083421970000000008, 2024-09-12T22:49:43.129 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:43.129 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:43.130 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:43.130 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:43.130 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:43.130 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:43.130 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 144 2024-09-12T22:49:43.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.130 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:43.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:43.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294752+0000", 2024-09-12T22:49:43.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:43.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294752+0000", 2024-09-12T22:49:43.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:43.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294753+0000", 2024-09-12T22:49:43.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.37e-07 2024-09-12T22:49:43.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:43.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294757+0000", 2024-09-12T22:49:43.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.811e-06 2024-09-12T22:49:43.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:43.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294765+0000", 2024-09-12T22:49:43.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0390000000000005e-06 2024-09-12T22:49:43.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294771+0000", 2024-09-12T22:49:43.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2689999999999996e-06 2024-09-12T22:49:43.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:43.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294816+0000", 2024-09-12T22:49:43.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5046000000000002e-05 2024-09-12T22:49:43.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:43.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294887+0000", 2024-09-12T22:49:43.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0609000000000001e-05 2024-09-12T22:49:43.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:43.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.302989+0000", 2024-09-12T22:49:43.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081019409999999997 2024-09-12T22:49:43.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:43.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.303033+0000", 2024-09-12T22:49:43.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4190999999999998e-05 2024-09-12T22:49:43.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:43.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.303095+0000", 2024-09-12T22:49:43.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1654000000000003e-05 2024-09-12T22:49:43.134 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.134 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:43.134 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.134 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:145 4.16 4:696afb02:::1000000028a.00000000:head [write 0~55211] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:43.135 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.296232+0000", 2024-09-12T22:49:43.135 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.7714893539999998, 2024-09-12T22:49:43.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.006909475, 2024-09-12T22:49:43.135 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:43.135 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:43.135 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:43.135 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:43.135 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:43.135 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:43.135 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 145 2024-09-12T22:49:43.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.135 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:43.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:43.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.296232+0000", 2024-09-12T22:49:43.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:43.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.296232+0000", 2024-09-12T22:49:43.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:43.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.296232+0000", 2024-09-12T22:49:43.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9800000000000004e-07 2024-09-12T22:49:43.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:43.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.296279+0000", 2024-09-12T22:49:43.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6353999999999997e-05 2024-09-12T22:49:43.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:43.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.296286+0000", 2024-09-12T22:49:43.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0779999999999998e-06 2024-09-12T22:49:43.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.296291+0000", 2024-09-12T22:49:43.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0950000000000003e-06 2024-09-12T22:49:43.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:43.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.296336+0000", 2024-09-12T22:49:43.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4563e-05 2024-09-12T22:49:43.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:43.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.296404+0000", 2024-09-12T22:49:43.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8756000000000004e-05 2024-09-12T22:49:43.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:43.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.303017+0000", 2024-09-12T22:49:43.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0066131159999999996 2024-09-12T22:49:43.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:43.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.303064+0000", 2024-09-12T22:49:43.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6728999999999999e-05 2024-09-12T22:49:43.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:43.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.303141+0000", 2024-09-12T22:49:43.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7286000000000005e-05 2024-09-12T22:49:43.139 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.139 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:43.139 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.140 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:150 4.a 4:53071690:::1000000028f.00000000:head [write 0~111] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:43.140 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.301030+0000", 2024-09-12T22:49:43.140 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.7666916179999999, 2024-09-12T22:49:43.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077464659999999996, 2024-09-12T22:49:43.140 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:43.140 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:43.140 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:43.140 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:43.140 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:43.140 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:43.140 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 150 2024-09-12T22:49:43.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.141 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:43.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:43.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301030+0000", 2024-09-12T22:49:43.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:43.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301030+0000", 2024-09-12T22:49:43.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:43.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301031+0000", 2024-09-12T22:49:43.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.13e-06 2024-09-12T22:49:43.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:43.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301036+0000", 2024-09-12T22:49:43.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3519999999999997e-06 2024-09-12T22:49:43.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:43.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301050+0000", 2024-09-12T22:49:43.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3705e-05 2024-09-12T22:49:43.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301060+0000", 2024-09-12T22:49:43.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0042e-05 2024-09-12T22:49:43.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:43.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301114+0000", 2024-09-12T22:49:43.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4421e-05 2024-09-12T22:49:43.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:43.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301231+0000", 2024-09-12T22:49:43.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116552 2024-09-12T22:49:43.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:43.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.308695+0000", 2024-09-12T22:49:43.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0074639459999999999 2024-09-12T22:49:43.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:43.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.308735+0000", 2024-09-12T22:49:43.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0181e-05 2024-09-12T22:49:43.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:43.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.308776+0000", 2024-09-12T22:49:43.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1137000000000003e-05 2024-09-12T22:49:43.145 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.145 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:43.145 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.145 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:151 4.7 4:e25a3370:::10000000290.00000000:head [write 0~6349] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:43.145 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.301970+0000", 2024-09-12T22:49:43.145 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.7657514170000002, 2024-09-12T22:49:43.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082601040000000008, 2024-09-12T22:49:43.145 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:43.146 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:43.146 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:43.146 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:43.146 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:43.146 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:43.146 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 151 2024-09-12T22:49:43.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.146 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:43.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:43.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301970+0000", 2024-09-12T22:49:43.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:43.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301970+0000", 2024-09-12T22:49:43.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:43.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301970+0000", 2024-09-12T22:49:43.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0699999999999998e-07 2024-09-12T22:49:43.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:43.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301977+0000", 2024-09-12T22:49:43.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0890000000000002e-06 2024-09-12T22:49:43.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:43.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301984+0000", 2024-09-12T22:49:43.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.511e-06 2024-09-12T22:49:43.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301988+0000", 2024-09-12T22:49:43.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7079999999999999e-06 2024-09-12T22:49:43.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:43.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.302027+0000", 2024-09-12T22:49:43.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9113999999999999e-05 2024-09-12T22:49:43.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:43.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.302099+0000", 2024-09-12T22:49:43.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2673e-05 2024-09-12T22:49:43.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:43.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.302174+0000", 2024-09-12T22:49:43.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4274000000000001e-05 2024-09-12T22:49:43.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:43.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.308696+0000", 2024-09-12T22:49:43.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065225159999999999 2024-09-12T22:49:43.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:43.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.310175+0000", 2024-09-12T22:49:43.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014790350000000001 2024-09-12T22:49:43.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:43.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.310205+0000", 2024-09-12T22:49:43.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9799e-05 2024-09-12T22:49:43.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:43.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.310230+0000", 2024-09-12T22:49:43.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4978e-05 2024-09-12T22:49:43.151 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.151 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:43.151 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.151 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:194 4.16 4:6af67b46:::100000002bb.00000000:head [write 0~111] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:43.151 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.339531+0000", 2024-09-12T22:49:43.151 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.7281902549999999, 2024-09-12T22:49:43.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073351789999999998, 2024-09-12T22:49:43.151 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:43.151 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:43.151 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:43.151 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:43.152 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:43.152 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:43.152 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 194 2024-09-12T22:49:43.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.152 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:43.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:43.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339531+0000", 2024-09-12T22:49:43.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:43.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339531+0000", 2024-09-12T22:49:43.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:43.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339532+0000", 2024-09-12T22:49:43.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8100000000000002e-07 2024-09-12T22:49:43.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:43.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339536+0000", 2024-09-12T22:49:43.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8739999999999997e-06 2024-09-12T22:49:43.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:43.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339546+0000", 2024-09-12T22:49:43.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0567999999999999e-05 2024-09-12T22:49:43.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339552+0000", 2024-09-12T22:49:43.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4750000000000001e-06 2024-09-12T22:49:43.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:43.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339593+0000", 2024-09-12T22:49:43.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1230999999999999e-05 2024-09-12T22:49:43.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:43.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339664+0000", 2024-09-12T22:49:43.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0769e-05 2024-09-12T22:49:43.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:43.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.346724+0000", 2024-09-12T22:49:43.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070602249999999998 2024-09-12T22:49:43.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:43.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.346778+0000", 2024-09-12T22:49:43.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4469999999999999e-05 2024-09-12T22:49:43.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:43.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.346866+0000", 2024-09-12T22:49:43.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7786000000000003e-05 2024-09-12T22:49:43.156 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.156 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:43.156 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.156 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:198 4.12 4:4a0eff6f:::100000002bf.00000000:head [write 0~98] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:43.156 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.343572+0000", 2024-09-12T22:49:43.156 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.724149508, 2024-09-12T22:49:43.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084413230000000006, 2024-09-12T22:49:43.156 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:43.156 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:43.156 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:43.157 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:43.157 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:43.157 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:43.157 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 198 2024-09-12T22:49:43.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.157 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:43.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:43.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343572+0000", 2024-09-12T22:49:43.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:43.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343572+0000", 2024-09-12T22:49:43.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:43.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343573+0000", 2024-09-12T22:49:43.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:49:43.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:43.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343578+0000", 2024-09-12T22:49:43.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4750000000000001e-06 2024-09-12T22:49:43.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:43.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343589+0000", 2024-09-12T22:49:43.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0709e-05 2024-09-12T22:49:43.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343594+0000", 2024-09-12T22:49:43.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4360000000000001e-06 2024-09-12T22:49:43.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:43.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343668+0000", 2024-09-12T22:49:43.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3907999999999998e-05 2024-09-12T22:49:43.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:43.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343741+0000", 2024-09-12T22:49:43.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2922000000000004e-05 2024-09-12T22:49:43.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:43.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343841+0000", 2024-09-12T22:49:43.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100412 2024-09-12T22:49:43.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:43.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349501+0000", 2024-09-12T22:49:43.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005659776 2024-09-12T22:49:43.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.161 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:43.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.351940+0000", 2024-09-12T22:49:43.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024390839999999998 2024-09-12T22:49:43.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.161 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:43.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.351986+0000", 2024-09-12T22:49:43.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5970999999999997e-05 2024-09-12T22:49:43.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.161 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:43.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352013+0000", 2024-09-12T22:49:43.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6871000000000001e-05 2024-09-12T22:49:43.162 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.162 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:43.162 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.162 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:205 4.37 4:ef7c8488:::100000002c6.00000000:head [write 0~98] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:43.162 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.349405+0000", 2024-09-12T22:49:43.162 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.718316782, 2024-09-12T22:49:43.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078250019999999993, 2024-09-12T22:49:43.162 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:43.162 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:43.162 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:43.162 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:43.162 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:43.163 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:43.163 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 205 2024-09-12T22:49:43.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.163 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:43.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:43.163 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349405+0000", 2024-09-12T22:49:43.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:43.163 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349405+0000", 2024-09-12T22:49:43.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:43.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349405+0000", 2024-09-12T22:49:43.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:49:43.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:43.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349409+0000", 2024-09-12T22:49:43.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1359999999999999e-06 2024-09-12T22:49:43.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:43.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349418+0000", 2024-09-12T22:49:43.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3289999999999994e-06 2024-09-12T22:49:43.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349423+0000", 2024-09-12T22:49:43.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9949999999999996e-06 2024-09-12T22:49:43.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:43.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349469+0000", 2024-09-12T22:49:43.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6008999999999999e-05 2024-09-12T22:49:43.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:43.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349570+0000", 2024-09-12T22:49:43.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100831 2024-09-12T22:49:43.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:43.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349682+0000", 2024-09-12T22:49:43.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011268 2024-09-12T22:49:43.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:43.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.351968+0000", 2024-09-12T22:49:43.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022860379999999998 2024-09-12T22:49:43.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.167 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:43.167 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.357145+0000", 2024-09-12T22:49:43.167 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051769759999999998 2024-09-12T22:49:43.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.167 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:43.167 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.357187+0000", 2024-09-12T22:49:43.167 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1248999999999998e-05 2024-09-12T22:49:43.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.167 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:43.167 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.357230+0000", 2024-09-12T22:49:43.167 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3010000000000003e-05 2024-09-12T22:49:43.167 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.167 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:43.168 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.168 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:208 4.1c e50/17 4:3b628a21:::100000002c9.00000000:head v 50'2, mlcod=0'0)", 2024-09-12T22:49:43.168 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.352179+0000", 2024-09-12T22:49:43.168 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.7155427630000002, 2024-09-12T22:49:43.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0076543849999999997, 2024-09-12T22:49:43.168 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:43.168 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:43.168 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:43.168 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:43.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.168 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:43.168 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352179+0000", 2024-09-12T22:49:43.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:43.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352179+0000", 2024-09-12T22:49:43.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:43.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352179+0000", 2024-09-12T22:49:43.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0200000000000002e-07 2024-09-12T22:49:43.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:43.170 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352184+0000", 2024-09-12T22:49:43.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0470000000000001e-06 2024-09-12T22:49:43.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:43.170 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352190+0000", 2024-09-12T22:49:43.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9519999999999999e-06 2024-09-12T22:49:43.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.170 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352194+0000", 2024-09-12T22:49:43.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.369e-06 2024-09-12T22:49:43.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:43.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352232+0000", 2024-09-12T22:49:43.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7752e-05 2024-09-12T22:49:43.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:43.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352249+0000", 2024-09-12T22:49:43.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6796e-05 2024-09-12T22:49:43.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:43.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.359795+0000", 2024-09-12T22:49:43.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0075457989999999997 2024-09-12T22:49:43.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:43.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.359833+0000", 2024-09-12T22:49:43.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8167999999999998e-05 2024-09-12T22:49:43.172 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.172 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:43.172 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.172 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:247 4.a 4:5080b297:::100000002f5.00000000:head [write 0~12498] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:43.172 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.390848+0000", 2024-09-12T22:49:43.173 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.676873166, 2024-09-12T22:49:43.173 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071234089999999998, 2024-09-12T22:49:43.173 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:43.173 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:43.173 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:43.173 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:43.173 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:43.173 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:43.173 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 247 2024-09-12T22:49:43.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.173 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:43.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.173 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:43.174 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.390848+0000", 2024-09-12T22:49:43.174 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.174 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:43.174 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.390848+0000", 2024-09-12T22:49:43.174 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.174 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:43.174 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.390849+0000", 2024-09-12T22:49:43.174 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-09-12T22:49:43.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:43.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.390860+0000", 2024-09-12T22:49:43.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.151e-05 2024-09-12T22:49:43.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:43.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.390869+0000", 2024-09-12T22:49:43.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3389999999999993e-06 2024-09-12T22:49:43.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.390877+0000", 2024-09-12T22:49:43.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3310000000000004e-06 2024-09-12T22:49:43.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:43.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.390930+0000", 2024-09-12T22:49:43.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2685999999999997e-05 2024-09-12T22:49:43.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:43.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.391048+0000", 2024-09-12T22:49:43.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000118566 2024-09-12T22:49:43.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:43.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.397864+0000", 2024-09-12T22:49:43.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0068154690000000002 2024-09-12T22:49:43.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:43.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.397904+0000", 2024-09-12T22:49:43.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0185000000000002e-05 2024-09-12T22:49:43.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:43.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.397972+0000", 2024-09-12T22:49:43.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7552999999999995e-05 2024-09-12T22:49:43.177 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.178 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:43.178 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.178 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.178 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:43.178 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:43.179 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:43.178+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:43.179 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:43.280 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:43.279+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:43.287 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:43.287 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:43.287 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:49:43.287 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:43.296 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:43.381 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:43.380+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:43.407 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:43.407 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:43.408 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:49:43.408 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:49:43.408 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:43.417 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:43.481 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:43.480+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:43.568 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:43.568 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:49:43.568 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:49:43.568 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:49:43.568 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.568 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:43.568 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:43.568 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 98.401701762000002, 2024-09-12T22:49:43.568 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:49:43.569 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:43.569 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:43.569 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:43.569 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:43.569 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.569 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:43.569 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:43.569 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.569 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.569 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.569 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:43.569 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:43.569 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.570 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.570 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:43.570 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:49:43.570 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:49:43.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.570 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.570 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:43.570 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:49:43.570 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:49:43.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.570 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.570 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:43.570 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:49:43.571 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:49:43.571 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.571 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.571 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.571 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:49:43.571 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:49:43.571 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.571 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.571 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:43.571 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:43.571 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:49:43.571 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.571 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.572 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:43.572 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:43.572 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:49:43.572 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.572 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.572 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:43.572 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:49:43.572 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:49:43.572 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.572 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.572 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:43.572 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:49:43.572 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:49:43.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.573 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:43.573 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:49:43.573 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:49:43.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.573 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:43.573 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:49:43.573 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:49:43.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.573 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:43.574 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:49:43.574 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:49:43.574 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.574 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.574 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:43.574 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:49:43.574 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:49:43.574 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.574 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.574 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:43.574 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:49:43.574 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:49:43.574 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.575 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:43.575 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.575 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.575 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.575 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:43.575 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:43.575 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 98.401602245000007, 2024-09-12T22:49:43.575 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:49:43.575 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:43.575 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:43.575 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:43.575 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:43.575 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.576 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:43.576 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:43.576 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.576 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.576 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.576 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:43.576 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:43.576 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.576 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.576 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.576 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:43.576 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:49:43.576 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:49:43.577 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.577 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.577 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:43.577 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:49:43.577 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:49:43.577 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.577 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.577 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:43.577 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:49:43.577 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:49:43.577 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.577 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.577 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.578 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:49:43.578 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:49:43.578 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.578 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.578 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:43.578 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:49:43.578 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:49:43.578 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.578 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.578 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:43.578 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:49:43.578 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:49:43.578 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.578 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.579 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:43.579 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:49:43.579 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:49:43.579 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.579 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.579 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:43.579 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:49:43.579 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:49:43.579 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.579 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.579 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:43.579 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:49:43.579 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:49:43.580 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.580 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.580 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:43.580 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:49:43.580 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:49:43.580 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.580 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.580 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:43.580 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:49:43.580 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:49:43.580 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.580 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.581 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:43.581 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:49:43.581 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:49:43.581 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.581 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.581 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:43.581 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:49:43.581 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:49:43.581 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.581 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:43.581 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.581 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.581 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.581 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:43.582 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:43.582 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 98.401557506000003, 2024-09-12T22:49:43.582 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:49:43.582 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:43.582 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:43.582 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:43.582 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:43.582 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.582 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:43.582 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:43.582 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.582 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.582 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.583 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:43.583 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:43.583 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.583 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.583 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.583 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:43.583 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:49:43.583 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:49:43.583 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.583 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.583 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:43.583 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:43.583 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:49:43.583 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.584 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.584 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:43.584 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:43.584 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:49:43.584 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.584 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.584 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.584 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:49:43.584 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:49:43.584 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.584 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.584 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:43.584 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:49:43.584 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:49:43.585 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.585 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.585 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:43.585 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:49:43.585 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:49:43.585 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.585 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.585 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:43.585 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:49:43.585 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:49:43.585 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.585 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.585 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:43.586 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:49:43.586 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:49:43.586 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.586 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.586 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:43.586 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:49:43.586 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:49:43.586 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.586 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.586 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:43.586 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:49:43.586 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:49:43.586 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.586 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.587 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:43.587 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:49:43.587 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:49:43.587 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.587 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.587 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:43.587 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:49:43.587 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:49:43.587 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.587 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.587 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:43.587 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:49:43.587 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:49:43.588 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.588 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:43.588 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.588 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.588 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.588 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:43.588 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:43.588 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 98.401329805000003, 2024-09-12T22:49:43.588 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:49:43.588 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:43.588 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:43.588 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:43.589 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:43.589 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.589 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:43.589 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:43.589 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.589 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.589 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.589 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:43.589 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:43.589 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.589 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.589 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.589 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:43.590 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:49:43.590 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:49:43.590 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.590 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.590 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:43.590 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:49:43.590 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:49:43.590 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.590 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.590 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:43.590 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:49:43.590 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:49:43.590 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.590 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.591 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.591 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:49:43.591 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:49:43.591 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.591 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.591 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:43.591 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:49:43.591 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:49:43.591 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.591 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.591 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:43.591 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:49:43.591 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:49:43.591 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.592 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.592 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:43.592 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:49:43.592 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:49:43.592 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.592 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.592 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:43.592 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:49:43.592 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:49:43.592 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.592 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.592 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:43.592 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:49:43.593 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:49:43.593 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.593 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.593 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:43.593 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:49:43.593 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:49:43.593 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.593 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.593 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:43.593 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:49:43.593 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:49:43.593 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.593 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.594 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:43.594 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:49:43.594 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:49:43.594 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.594 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.594 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:43.594 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:49:43.594 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:49:43.594 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.594 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:43.594 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.594 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.594 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.595 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:43.595 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:43.595 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 98.401164696999999, 2024-09-12T22:49:43.595 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:49:43.595 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:43.595 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:43.595 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:43.595 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:43.595 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.595 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:43.595 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:43.595 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.595 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.595 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.596 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:43.596 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:43.596 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.596 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.596 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.596 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:43.596 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:49:43.596 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:49:43.596 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.596 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.596 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:43.596 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:49:43.596 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:49:43.597 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.597 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.597 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:43.597 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:49:43.597 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:49:43.597 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.597 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.597 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.597 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:49:43.597 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:49:43.597 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.597 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.597 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:43.598 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:49:43.598 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:49:43.598 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.598 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.598 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:43.598 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:49:43.598 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:49:43.598 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.598 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.598 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:43.598 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:49:43.598 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:49:43.598 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.599 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.599 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:43.599 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:49:43.599 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:49:43.599 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.599 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.599 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:43.599 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:49:43.599 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:49:43.599 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.599 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.599 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:43.599 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:49:43.599 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:49:43.600 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.600 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.600 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:43.600 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:49:43.600 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:49:43.600 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.600 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.600 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:43.600 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:49:43.600 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:49:43.600 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.600 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.600 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:43.600 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:49:43.601 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:49:43.601 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.601 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:43.601 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.601 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.601 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.601 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:43.601 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:43.601 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 98.401103411999998, 2024-09-12T22:49:43.601 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:49:43.601 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:43.601 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:43.601 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:43.602 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:43.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.602 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:43.602 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:43.602 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.602 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:43.602 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:43.602 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.602 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:43.602 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:43.603 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:49:43.603 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.603 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.603 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:43.603 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:49:43.603 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:49:43.603 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.603 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.603 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:43.603 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:49:43.603 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:49:43.603 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.603 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.603 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.604 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:49:43.604 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:49:43.604 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.604 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.604 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:43.604 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:49:43.604 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:49:43.604 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.604 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.604 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:43.604 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:49:43.604 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:49:43.604 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.605 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.605 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:43.605 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:49:43.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:49:43.605 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.605 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.605 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:43.605 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:49:43.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:49:43.605 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.605 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.605 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:43.605 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:49:43.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:49:43.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.606 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.606 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:43.606 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:49:43.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:49:43.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.606 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.606 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:43.606 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:49:43.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:49:43.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.606 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.607 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:43.607 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:49:43.607 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:49:43.607 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.607 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.607 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:43.607 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:49:43.607 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:49:43.607 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.607 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:43.607 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.607 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.607 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.607 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:43.608 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:43.608 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 98.401023304000006, 2024-09-12T22:49:43.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:49:43.608 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:43.608 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:43.608 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:43.608 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:43.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.608 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:43.608 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:43.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:43.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:43.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:43.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:49:43.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:49:43.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:43.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:49:43.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:49:43.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.610 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.610 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:43.610 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:49:43.610 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:49:43.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.610 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.610 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.610 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:49:43.610 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:49:43.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.610 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.610 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:43.610 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:49:43.611 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:49:43.611 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.611 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.611 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:43.611 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:49:43.611 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:49:43.611 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.611 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.611 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:43.611 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:49:43.611 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:49:43.611 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.611 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.612 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:43.612 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:49:43.612 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:49:43.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.612 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.612 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:43.612 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:49:43.612 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:49:43.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.612 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.612 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:43.612 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:49:43.612 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:49:43.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:43.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:49:43.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:49:43.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:43.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:49:43.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:49:43.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:43.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:49:43.614 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:49:43.614 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.614 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:43.614 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.614 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.614 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.614 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:43.614 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:43.614 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 98.400974351000002, 2024-09-12T22:49:43.614 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:49:43.614 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:43.614 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:43.614 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:43.615 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:43.615 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.615 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:43.615 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:43.615 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.615 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.615 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.615 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:43.615 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:43.615 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.615 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.616 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:43.616 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:43.616 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:49:43.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.616 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:43.616 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:49:43.616 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:49:43.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.617 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.617 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:43.617 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:49:43.617 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:49:43.617 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.617 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.617 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.617 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:49:43.617 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:49:43.618 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.618 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.618 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:43.618 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:49:43.618 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:49:43.618 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.618 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.618 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:43.618 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:49:43.618 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:49:43.618 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.618 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.618 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:43.618 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:49:43.619 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:49:43.619 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.619 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:43.619 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.619 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.619 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.619 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:43.619 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:43.619 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 98.400925251000004, 2024-09-12T22:49:43.619 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:49:43.619 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:43.619 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:43.619 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:43.620 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:43.620 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.620 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:43.620 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:43.620 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.620 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.620 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.620 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:43.620 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:43.620 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.620 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.620 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.620 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:43.621 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:49:43.621 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:49:43.621 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.621 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.621 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:43.621 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:49:43.621 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:49:43.621 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.621 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.621 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:43.621 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:49:43.621 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:49:43.621 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.622 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.622 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.622 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:49:43.622 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:49:43.622 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.622 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.622 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:43.622 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:49:43.622 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:49:43.622 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.622 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.622 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:43.622 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:49:43.622 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:49:43.623 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.623 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.623 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:43.623 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:49:43.623 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:49:43.623 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.623 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:43.623 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.623 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.623 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.623 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:43.623 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.082046+0000", 2024-09-12T22:49:43.623 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.4838662950000003, 2024-09-12T22:49:43.624 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012182124000000001, 2024-09-12T22:49:43.624 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:43.624 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:43.624 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:43.624 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:43.624 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:43.624 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:43.624 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 4 2024-09-12T22:49:43.624 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.624 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:43.624 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.624 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:43.624 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.082046+0000", 2024-09-12T22:49:43.624 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.625 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.625 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.625 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:43.625 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.082046+0000", 2024-09-12T22:49:43.625 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.625 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.625 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.625 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:43.625 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.082048+0000", 2024-09-12T22:49:43.625 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5969999999999999e-06 2024-09-12T22:49:43.625 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.625 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.626 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:43.626 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.087738+0000", 2024-09-12T22:49:43.626 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0056892499999999999 2024-09-12T22:49:43.626 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.626 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.626 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:43.626 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.087782+0000", 2024-09-12T22:49:43.626 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4267999999999997e-05 2024-09-12T22:49:43.626 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.626 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.626 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.626 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.087795+0000", 2024-09-12T22:49:43.626 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3560000000000001e-05 2024-09-12T22:49:43.627 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.627 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.627 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:43.627 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.087897+0000", 2024-09-12T22:49:43.627 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000102098 2024-09-12T22:49:43.627 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.627 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.627 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:43.627 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.087992+0000", 2024-09-12T22:49:43.627 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4407000000000006e-05 2024-09-12T22:49:43.627 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.627 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.627 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:43.627 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.094121+0000", 2024-09-12T22:49:43.628 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0061287340000000003 2024-09-12T22:49:43.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.628 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.628 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:43.628 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.094164+0000", 2024-09-12T22:49:43.628 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3269000000000002e-05 2024-09-12T22:49:43.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.628 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.628 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:43.628 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.094228+0000", 2024-09-12T22:49:43.628 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3941000000000003e-05 2024-09-12T22:49:43.628 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.629 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:43.629 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.629 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.629 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.629 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:43.629 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.159925+0000", 2024-09-12T22:49:43.629 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.4059873559999998, 2024-09-12T22:49:43.629 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0099924560000000003, 2024-09-12T22:49:43.629 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:43.629 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:43.629 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:43.629 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:43.629 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:43.630 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:43.630 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 6 2024-09-12T22:49:43.630 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.630 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:43.630 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.630 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:43.630 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.159925+0000", 2024-09-12T22:49:43.630 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.630 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.630 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.630 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:43.630 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.159925+0000", 2024-09-12T22:49:43.630 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.630 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.631 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.631 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:43.631 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.159926+0000", 2024-09-12T22:49:43.631 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4890000000000001e-06 2024-09-12T22:49:43.631 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.631 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.631 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:43.631 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.163620+0000", 2024-09-12T22:49:43.631 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003694021 2024-09-12T22:49:43.631 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.631 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.631 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:43.631 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.163635+0000", 2024-09-12T22:49:43.632 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4732999999999999e-05 2024-09-12T22:49:43.632 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.632 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.632 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.632 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.163643+0000", 2024-09-12T22:49:43.632 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7209999999999994e-06 2024-09-12T22:49:43.632 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.632 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.632 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:43.632 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.163725+0000", 2024-09-12T22:49:43.632 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2263999999999997e-05 2024-09-12T22:49:43.632 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.632 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.633 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:43.633 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.163866+0000", 2024-09-12T22:49:43.633 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014159200000000001 2024-09-12T22:49:43.633 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.633 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.633 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:43.633 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.169766+0000", 2024-09-12T22:49:43.633 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0058992109999999997 2024-09-12T22:49:43.633 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.633 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.633 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:43.633 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.169817+0000", 2024-09-12T22:49:43.633 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1115000000000001e-05 2024-09-12T22:49:43.633 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.634 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.634 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:43.634 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.169917+0000", 2024-09-12T22:49:43.634 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010030999999999999 2024-09-12T22:49:43.634 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.634 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:43.634 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.634 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.634 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.634 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4459.0:5 4.10 e50/17 4:09a4c37f:::10000000003.00000001:head v 50'1, mlcod=0'0)", 2024-09-12T22:49:43.634 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.167838+0000", 2024-09-12T22:49:43.634 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.3980741659999998, 2024-09-12T22:49:43.634 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011071799, 2024-09-12T22:49:43.634 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:43.635 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:43.635 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:43.635 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:43.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.635 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:43.635 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.167838+0000", 2024-09-12T22:49:43.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.635 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.635 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:43.635 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.167838+0000", 2024-09-12T22:49:43.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.635 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.636 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.636 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:43.636 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.167839+0000", 2024-09-12T22:49:43.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5600000000000004e-07 2024-09-12T22:49:43.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.636 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.636 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:43.636 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.172178+0000", 2024-09-12T22:49:43.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043395860000000003 2024-09-12T22:49:43.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.636 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.636 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:43.636 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.172192+0000", 2024-09-12T22:49:43.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3451999999999999e-05 2024-09-12T22:49:43.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.637 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.637 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.172205+0000", 2024-09-12T22:49:43.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2853e-05 2024-09-12T22:49:43.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.637 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:43.637 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.172281+0000", 2024-09-12T22:49:43.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6093000000000005e-05 2024-09-12T22:49:43.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.637 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:43.637 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.172301+0000", 2024-09-12T22:49:43.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0276e-05 2024-09-12T22:49:43.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:43.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.178879+0000", 2024-09-12T22:49:43.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0065783539999999998 2024-09-12T22:49:43.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:43.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.178910+0000", 2024-09-12T22:49:43.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0329e-05 2024-09-12T22:49:43.638 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.638 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:43.639 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.639 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:57 4.9 4:91e366d7:::10000000230.00000000:head [write 0~1966] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:43.639 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.216970+0000", 2024-09-12T22:49:43.639 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.3489423919999997, 2024-09-12T22:49:43.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082673929999999996, 2024-09-12T22:49:43.639 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:43.639 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:43.639 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:43.639 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:43.639 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:43.639 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:43.639 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 57 2024-09-12T22:49:43.640 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.640 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:43.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:43.640 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.216970+0000", 2024-09-12T22:49:43.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.640 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:43.640 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.216970+0000", 2024-09-12T22:49:43.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.640 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.641 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:43.641 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.216970+0000", 2024-09-12T22:49:43.641 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:49:43.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.641 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.641 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:43.641 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.216977+0000", 2024-09-12T22:49:43.641 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1999999999999997e-06 2024-09-12T22:49:43.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.641 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.641 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:43.641 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.216985+0000", 2024-09-12T22:49:43.641 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.909e-06 2024-09-12T22:49:43.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.216991+0000", 2024-09-12T22:49:43.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4260000000000002e-06 2024-09-12T22:49:43.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:43.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.217025+0000", 2024-09-12T22:49:43.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4591999999999997e-05 2024-09-12T22:49:43.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:43.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.217089+0000", 2024-09-12T22:49:43.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3226999999999996e-05 2024-09-12T22:49:43.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.643 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:43.643 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.217152+0000", 2024-09-12T22:49:43.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3089999999999994e-05 2024-09-12T22:49:43.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.643 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:43.643 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.217745+0000", 2024-09-12T22:49:43.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00059294899999999995 2024-09-12T22:49:43.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.644 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:43.644 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.225195+0000", 2024-09-12T22:49:43.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.007450623 2024-09-12T22:49:43.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.644 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:43.644 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.225219+0000", 2024-09-12T22:49:43.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3773000000000001e-05 2024-09-12T22:49:43.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.644 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:43.644 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.225237+0000", 2024-09-12T22:49:43.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7927999999999998e-05 2024-09-12T22:49:43.645 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.645 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:43.645 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.645 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.645 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:75 4.2e 4:7528f44f:::10000000242.00000000:head [write 0~1151] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:43.645 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.232047+0000", 2024-09-12T22:49:43.645 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.3338647159999999, 2024-09-12T22:49:43.645 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082051009999999994, 2024-09-12T22:49:43.645 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:43.645 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:43.645 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:43.645 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:43.645 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:43.646 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:43.646 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 75 2024-09-12T22:49:43.646 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.646 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:43.646 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.646 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:43.646 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232047+0000", 2024-09-12T22:49:43.646 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.646 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.646 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.646 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:43.646 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232047+0000", 2024-09-12T22:49:43.646 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.647 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.647 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.647 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:43.647 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232048+0000", 2024-09-12T22:49:43.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6700000000000003e-07 2024-09-12T22:49:43.647 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.647 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.647 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:43.647 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232052+0000", 2024-09-12T22:49:43.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1139999999999999e-06 2024-09-12T22:49:43.647 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.647 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.647 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:43.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232063+0000", 2024-09-12T22:49:43.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0781000000000001e-05 2024-09-12T22:49:43.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.648 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.648 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232068+0000", 2024-09-12T22:49:43.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0579999999999997e-06 2024-09-12T22:49:43.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.648 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.648 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:43.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232102+0000", 2024-09-12T22:49:43.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3976000000000001e-05 2024-09-12T22:49:43.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.648 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:43.649 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232174+0000", 2024-09-12T22:49:43.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2254000000000003e-05 2024-09-12T22:49:43.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:43.649 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232245+0000", 2024-09-12T22:49:43.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0597000000000002e-05 2024-09-12T22:49:43.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:43.649 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.233156+0000", 2024-09-12T22:49:43.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00091127799999999996 2024-09-12T22:49:43.650 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.650 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.650 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:43.650 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.240194+0000", 2024-09-12T22:49:43.650 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0070376140000000002 2024-09-12T22:49:43.650 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.650 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.650 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:43.650 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.240228+0000", 2024-09-12T22:49:43.650 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4347999999999997e-05 2024-09-12T22:49:43.650 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.650 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.650 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:43.650 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.240252+0000", 2024-09-12T22:49:43.651 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4314000000000001e-05 2024-09-12T22:49:43.651 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.651 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:43.651 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.651 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.651 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.651 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:76 4.25 4:a7ae8a0f:::10000000243.00000000:head [write 0~1194] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:43.651 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.232867+0000", 2024-09-12T22:49:43.651 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.3330446660000002, 2024-09-12T22:49:43.651 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074145970000000002, 2024-09-12T22:49:43.651 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:43.651 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:43.651 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:43.651 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:43.652 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:43.652 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:43.652 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 76 2024-09-12T22:49:43.652 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.652 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:43.652 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.652 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:43.652 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232867+0000", 2024-09-12T22:49:43.652 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.652 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.652 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.652 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:43.652 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232867+0000", 2024-09-12T22:49:43.653 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.653 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:43.653 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232868+0000", 2024-09-12T22:49:43.653 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6000000000000003e-07 2024-09-12T22:49:43.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.653 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:43.653 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232877+0000", 2024-09-12T22:49:43.653 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5140000000000001e-06 2024-09-12T22:49:43.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.654 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:43.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232888+0000", 2024-09-12T22:49:43.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0927999999999999e-05 2024-09-12T22:49:43.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.654 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232892+0000", 2024-09-12T22:49:43.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8999999999999997e-06 2024-09-12T22:49:43.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.654 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:43.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232936+0000", 2024-09-12T22:49:43.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3779000000000002e-05 2024-09-12T22:49:43.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.655 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.655 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:43.655 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.233005+0000", 2024-09-12T22:49:43.655 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8685999999999999e-05 2024-09-12T22:49:43.655 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.655 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.655 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:43.655 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.240176+0000", 2024-09-12T22:49:43.655 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071707070000000001 2024-09-12T22:49:43.655 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.655 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.655 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:43.655 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.240232+0000", 2024-09-12T22:49:43.656 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6493000000000003e-05 2024-09-12T22:49:43.656 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.656 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.656 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:43.656 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.240282+0000", 2024-09-12T22:49:43.656 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9830000000000002e-05 2024-09-12T22:49:43.656 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.656 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:43.656 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.656 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.656 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.656 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:127 4.3 4:c2ce25ce:::10000000277.00000000:head [write 0~111] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:43.656 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.279463+0000", 2024-09-12T22:49:43.657 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.2864486230000001, 2024-09-12T22:49:43.657 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0083277809999999994, 2024-09-12T22:49:43.657 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:43.657 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:43.657 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:43.657 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:43.657 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:43.657 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:43.657 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 127 2024-09-12T22:49:43.657 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.657 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:43.657 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.658 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:43.658 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.279463+0000", 2024-09-12T22:49:43.658 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.658 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.658 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:43.658 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.279463+0000", 2024-09-12T22:49:43.658 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.658 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.658 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:43.658 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.279464+0000", 2024-09-12T22:49:43.658 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4899999999999995e-07 2024-09-12T22:49:43.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.659 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:43.659 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.279468+0000", 2024-09-12T22:49:43.659 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6720000000000002e-06 2024-09-12T22:49:43.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.659 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:43.659 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.279475+0000", 2024-09-12T22:49:43.659 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3180000000000001e-06 2024-09-12T22:49:43.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.659 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.659 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.279480+0000", 2024-09-12T22:49:43.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2599999999999996e-06 2024-09-12T22:49:43.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.660 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.660 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:43.660 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.279519+0000", 2024-09-12T22:49:43.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8549e-05 2024-09-12T22:49:43.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.660 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.660 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:43.660 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.279577+0000", 2024-09-12T22:49:43.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7812999999999997e-05 2024-09-12T22:49:43.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.660 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:43.661 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.287689+0000", 2024-09-12T22:49:43.661 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081127490000000007 2024-09-12T22:49:43.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.661 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:43.661 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.287730+0000", 2024-09-12T22:49:43.661 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1044000000000002e-05 2024-09-12T22:49:43.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.661 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:43.661 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.287791+0000", 2024-09-12T22:49:43.661 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0826999999999999e-05 2024-09-12T22:49:43.661 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.662 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:43.662 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.662 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.662 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.662 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:128 4.2e 4:74579a32:::10000000278.00000000:head [write 0~111] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:43.662 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.280292+0000", 2024-09-12T22:49:43.662 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.2856197380000003, 2024-09-12T22:49:43.662 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075002829999999999, 2024-09-12T22:49:43.662 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:43.662 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:43.662 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:43.662 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:43.662 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:43.663 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:43.663 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 128 2024-09-12T22:49:43.663 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.663 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:43.663 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.663 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:43.663 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.280292+0000", 2024-09-12T22:49:43.663 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.663 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.663 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.663 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:43.663 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.280292+0000", 2024-09-12T22:49:43.663 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.664 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.664 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.664 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:43.664 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.280293+0000", 2024-09-12T22:49:43.664 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7199999999999998e-07 2024-09-12T22:49:43.664 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.664 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.664 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:43.664 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.280297+0000", 2024-09-12T22:49:43.664 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0239999999999999e-06 2024-09-12T22:49:43.664 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.664 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.665 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:43.665 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.280308+0000", 2024-09-12T22:49:43.665 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0855e-05 2024-09-12T22:49:43.665 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.665 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.665 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.665 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.280313+0000", 2024-09-12T22:49:43.665 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0069999999999997e-06 2024-09-12T22:49:43.665 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.665 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.665 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:43.665 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.280351+0000", 2024-09-12T22:49:43.665 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8263000000000003e-05 2024-09-12T22:49:43.666 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.666 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.666 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:43.666 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.280420+0000", 2024-09-12T22:49:43.666 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8997000000000004e-05 2024-09-12T22:49:43.666 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.666 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.666 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:43.666 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.280492+0000", 2024-09-12T22:49:43.666 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1444000000000002e-05 2024-09-12T22:49:43.666 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.666 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.666 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:43.667 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.281313+0000", 2024-09-12T22:49:43.667 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00082160600000000001 2024-09-12T22:49:43.667 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.667 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.667 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:43.667 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.287738+0000", 2024-09-12T22:49:43.667 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0064246069999999997 2024-09-12T22:49:43.667 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.667 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.667 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:43.667 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.287762+0000", 2024-09-12T22:49:43.667 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4179e-05 2024-09-12T22:49:43.667 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:43.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.287793+0000", 2024-09-12T22:49:43.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0528999999999999e-05 2024-09-12T22:49:43.668 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.668 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:43.668 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.668 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4459.0:151 4.7 e50/17 4:e25a3370:::10000000290.00000000:head v 50'3, mlcod=50'1)", 2024-09-12T22:49:43.668 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.302310+0000", 2024-09-12T22:49:43.668 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.2636022069999999, 2024-09-12T22:49:43.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0077636090000000003, 2024-09-12T22:49:43.669 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:43.669 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:43.669 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:43.669 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:43.669 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.669 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:43.669 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302310+0000", 2024-09-12T22:49:43.669 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.669 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.669 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:43.669 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302310+0000", 2024-09-12T22:49:43.669 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.670 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.670 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:43.670 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302310+0000", 2024-09-12T22:49:43.670 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4000000000000001e-07 2024-09-12T22:49:43.670 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.670 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.670 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:43.670 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302336+0000", 2024-09-12T22:49:43.670 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5887000000000001e-05 2024-09-12T22:49:43.670 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.670 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.670 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:43.670 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302346+0000", 2024-09-12T22:49:43.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8679999999999994e-06 2024-09-12T22:49:43.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.671 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.671 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.671 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302351+0000", 2024-09-12T22:49:43.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7600000000000002e-06 2024-09-12T22:49:43.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.671 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.671 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:43.671 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302392+0000", 2024-09-12T22:49:43.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1124999999999997e-05 2024-09-12T22:49:43.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.671 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.672 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:43.672 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302411+0000", 2024-09-12T22:49:43.672 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9357000000000001e-05 2024-09-12T22:49:43.672 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.672 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:43.672 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.310029+0000", 2024-09-12T22:49:43.672 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0076178050000000001 2024-09-12T22:49:43.672 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.672 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:43.672 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.310073+0000", 2024-09-12T22:49:43.673 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4166999999999999e-05 2024-09-12T22:49:43.673 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.673 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:43.673 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.673 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:152 4.25 4:a61cbf99:::10000000291.00000000:head [write 0~111] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:43.673 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.302816+0000", 2024-09-12T22:49:43.673 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.2630963499999996, 2024-09-12T22:49:43.673 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0073514330000000001, 2024-09-12T22:49:43.673 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:43.673 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:43.673 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:43.673 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:43.674 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:43.674 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:43.674 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 152 2024-09-12T22:49:43.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.674 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:43.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.674 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:43.674 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302816+0000", 2024-09-12T22:49:43.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.674 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:43.674 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302816+0000", 2024-09-12T22:49:43.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:43.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302817+0000", 2024-09-12T22:49:43.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8299999999999995e-07 2024-09-12T22:49:43.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:43.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302821+0000", 2024-09-12T22:49:43.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2629999999999997e-06 2024-09-12T22:49:43.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:43.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302832+0000", 2024-09-12T22:49:43.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0815000000000001e-05 2024-09-12T22:49:43.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302837+0000", 2024-09-12T22:49:43.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0590000000000002e-06 2024-09-12T22:49:43.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:43.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302884+0000", 2024-09-12T22:49:43.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7638e-05 2024-09-12T22:49:43.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.677 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:43.677 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302954+0000", 2024-09-12T22:49:43.677 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9380000000000003e-05 2024-09-12T22:49:43.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.677 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:43.677 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.310056+0000", 2024-09-12T22:49:43.677 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071018729999999999 2024-09-12T22:49:43.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.677 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:43.677 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.310098+0000", 2024-09-12T22:49:43.678 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2218000000000001e-05 2024-09-12T22:49:43.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.678 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.678 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:43.678 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.310167+0000", 2024-09-12T22:49:43.678 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9303999999999999e-05 2024-09-12T22:49:43.678 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.678 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:43.678 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.678 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.678 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:208 4.1c 4:3b628a21:::100000002c9.00000000:head [write 0~98] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:43.678 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.351805+0000", 2024-09-12T22:49:43.679 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.2141067420000002, 2024-09-12T22:49:43.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082360720000000005, 2024-09-12T22:49:43.679 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:43.679 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:43.679 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:43.679 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:43.679 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:43.679 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:43.679 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 208 2024-09-12T22:49:43.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.679 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:43.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:43.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.351805+0000", 2024-09-12T22:49:43.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:43.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.351805+0000", 2024-09-12T22:49:43.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:43.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:43.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.351806+0000", 2024-09-12T22:49:43.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9599999999999999e-07 2024-09-12T22:49:43.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:43.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.351809+0000", 2024-09-12T22:49:43.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7970000000000001e-06 2024-09-12T22:49:43.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:43.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.351816+0000", 2024-09-12T22:49:43.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8029999999999997e-06 2024-09-12T22:49:43.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.351820+0000", 2024-09-12T22:49:43.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2990000000000001e-06 2024-09-12T22:49:43.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:43.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.351882+0000", 2024-09-12T22:49:43.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2187999999999995e-05 2024-09-12T22:49:43.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:43.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.351986+0000", 2024-09-12T22:49:43.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000104387 2024-09-12T22:49:43.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:43.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.352107+0000", 2024-09-12T22:49:43.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000120384 2024-09-12T22:49:43.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:43.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.354089+0000", 2024-09-12T22:49:43.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001981961 2024-09-12T22:49:43.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:43.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.359962+0000", 2024-09-12T22:49:43.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0058737729999999997 2024-09-12T22:49:43.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:43.684 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.360007+0000", 2024-09-12T22:49:43.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4668e-05 2024-09-12T22:49:43.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:43.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:43.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:43.684 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.360041+0000", 2024-09-12T22:49:43.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4316000000000001e-05 2024-09-12T22:49:43.684 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.684 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:43.684 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.684 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:43.684 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:43.685 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:43.686 INFO:teuthology.orchestra.run.smithi066.stderr:nodeep-scrub is unset 2024-09-12T22:49:43.687 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:43.687 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:43.685+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:43.786 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:43.785+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:43.795 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:43.795 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:49:43.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.796 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:4218 4.16 4:6bc7ba27:::10000001402.00000000:head [write 0~654 in=654b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:49:43.796 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:43.794752+0000", 2024-09-12T22:49:43.796 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.00050658599999999995, 2024-09-12T22:49:43.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00052380099999999995, 2024-09-12T22:49:43.796 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:43.796 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:43.796 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:43.796 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:43.796 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:43.796 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:43.796 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 4218 2024-09-12T22:49:43.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.796 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:43.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:43.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:43.794752+0000", 2024-09-12T22:49:43.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:43.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:43.794752+0000", 2024-09-12T22:49:43.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:43.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:43.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:43.794752+0000", 2024-09-12T22:49:43.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7300000000000005e-07 2024-09-12T22:49:43.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:43.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:43.794756+0000", 2024-09-12T22:49:43.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9149999999999998e-06 2024-09-12T22:49:43.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:43.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:43.794767+0000", 2024-09-12T22:49:43.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0664e-05 2024-09-12T22:49:43.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:43.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:43.794772+0000", 2024-09-12T22:49:43.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1089999999999997e-06 2024-09-12T22:49:43.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:43.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:43.794806+0000", 2024-09-12T22:49:43.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3834000000000002e-05 2024-09-12T22:49:43.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:43.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:43.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:43.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:43.794888+0000", 2024-09-12T22:49:43.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1639999999999998e-05 2024-09-12T22:49:43.799 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.799 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:43.800 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.800 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:43.800 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-12T22:49:43.800 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 1 2024-09-12T22:49:43.800 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:43.805 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:43.887 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:43.886+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:43.917 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:43.918 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:43.918 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:49:43.918 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:49:43.918 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:43.927 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:43.987 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:43.986+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:44.036 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:44.036 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:49:44.036 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:49:44.036 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:49:44.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.036 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:44.036 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:44.036 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 98.863506964999999, 2024-09-12T22:49:44.036 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:49:44.037 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:44.037 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:44.037 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:44.037 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:44.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.037 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:44.037 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:44.037 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.037 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.037 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:44.037 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:44.037 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.038 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:44.038 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:49:44.038 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:49:44.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.038 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:44.038 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:49:44.038 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:49:44.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.038 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:44.038 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:49:44.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:49:44.039 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.039 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.039 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:49:44.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:49:44.039 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.039 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:44.039 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:49:44.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:49:44.039 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.040 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:44.040 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:49:44.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:49:44.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.040 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:44.040 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:49:44.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:49:44.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.040 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:44.040 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:49:44.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:49:44.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.041 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:44.041 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:49:44.041 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:49:44.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.041 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:44.041 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:49:44.041 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:49:44.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.041 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:44.041 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:49:44.042 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:49:44.042 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.042 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:44.042 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.042 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.042 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:44.042 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:44.042 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 98.863435307000003, 2024-09-12T22:49:44.042 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:49:44.042 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:44.042 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:44.042 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:44.042 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:44.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.043 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:44.043 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:44.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.043 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:44.043 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:44.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.043 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:44.043 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:49:44.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:49:44.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:44.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:49:44.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:49:44.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:44.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:49:44.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:49:44.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:49:44.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:49:44.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:44.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:49:44.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:49:44.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:44.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:49:44.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:49:44.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:44.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:49:44.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:49:44.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:44.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:49:44.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:49:44.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:44.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:49:44.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:49:44.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:44.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:49:44.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:49:44.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:44.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:49:44.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:49:44.049 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.049 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:44.049 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.049 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:44.049 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:44.049 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 98.863392589, 2024-09-12T22:49:44.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:49:44.049 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:44.050 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:44.050 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:44.050 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:44.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:44.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:44.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:44.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:44.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:44.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:49:44.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:49:44.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:44.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:49:44.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:49:44.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:44.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:49:44.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:49:44.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:49:44.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:49:44.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:44.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:49:44.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:49:44.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:44.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:49:44.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:49:44.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:44.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:49:44.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:49:44.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:44.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:49:44.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:49:44.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:44.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:49:44.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:49:44.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:44.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:49:44.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:49:44.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:44.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:49:44.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:49:44.055 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.055 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:44.055 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.055 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:44.055 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:44.055 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 98.863354672, 2024-09-12T22:49:44.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:49:44.055 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:44.055 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:44.055 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:44.056 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:44.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:44.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:44.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:44.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:44.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:44.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:49:44.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:49:44.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:44.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:49:44.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:49:44.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:44.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:49:44.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:49:44.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:49:44.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:49:44.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:44.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:49:44.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:49:44.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:44.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:49:44.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:49:44.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:44.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:44.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:49:44.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:44.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:49:44.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:49:44.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:44.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:49:44.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:49:44.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:44.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:49:44.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:49:44.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:44.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:49:44.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:49:44.061 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.061 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:44.061 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.061 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:44.061 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:44.061 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 98.863331220999996, 2024-09-12T22:49:44.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:49:44.061 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:44.061 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:44.061 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:44.062 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:44.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:44.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:44.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:44.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:44.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:44.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:49:44.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:49:44.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:44.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:49:44.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:49:44.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:44.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:49:44.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:49:44.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:49:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:49:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:49:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:49:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:49:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:49:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:49:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:49:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:49:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:49:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:49:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:49:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:49:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:49:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:49:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 98.863306984000005, 2024-09-12T22:49:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070814010000000002, 2024-09-12T22:49:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170736+0000", 2024-09-12T22:49:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:49:44.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:44.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170740+0000", 2024-09-12T22:49:44.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3950000000000001e-06 2024-09-12T22:49:44.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:44.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170745+0000", 2024-09-12T22:49:44.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6420000000000004e-06 2024-09-12T22:49:44.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170750+0000", 2024-09-12T22:49:44.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2020000000000003e-06 2024-09-12T22:49:44.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:44.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170799+0000", 2024-09-12T22:49:44.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8588999999999998e-05 2024-09-12T22:49:44.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:44.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170964+0000", 2024-09-12T22:49:44.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016534500000000001 2024-09-12T22:49:44.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:44.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171098+0000", 2024-09-12T22:49:44.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133275 2024-09-12T22:49:44.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:44.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172791+0000", 2024-09-12T22:49:44.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016933930000000001 2024-09-12T22:49:44.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:44.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177724+0000", 2024-09-12T22:49:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049334000000000001 2024-09-12T22:49:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177776+0000", 2024-09-12T22:49:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1514000000000002e-05 2024-09-12T22:49:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177817+0000", 2024-09-12T22:49:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1139e-05 2024-09-12T22:49:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.073 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:44.073 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:44.073 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 98.863279066999993, 2024-09-12T22:49:44.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:49:44.073 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:44.073 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:44.073 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:44.073 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:44.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:44.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:44.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:44.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:44.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:44.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:44.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:49:44.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:44.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:49:44.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:49:44.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:44.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:49:44.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:49:44.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:49:44.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:49:44.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:44.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:49:44.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:49:44.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:44.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:49:44.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:49:44.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:44.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:49:44.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:49:44.077 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.077 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:44.077 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.077 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:44.077 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:44.077 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 98.863204572000001, 2024-09-12T22:49:44.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:49:44.077 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:44.077 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:44.077 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:49:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:49:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:49:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:49:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:49:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:49:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:49:44.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:49:44.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:44.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:49:44.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:49:44.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:44.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:49:44.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:49:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:49:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:49:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 98.863158544000001, 2024-09-12T22:49:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:49:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:49:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:49:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:49:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:49:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:49:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:49:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:49:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:49:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:49:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:49:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:49:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:49:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:49:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:49:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.160867+0000", 2024-09-12T22:49:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.8731753720000004, 2024-09-12T22:49:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018225736999999999, 2024-09-12T22:49:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 5 2024-09-12T22:49:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.160867+0000", 2024-09-12T22:49:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.160867+0000", 2024-09-12T22:49:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.160869+0000", 2024-09-12T22:49:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1500000000000002e-06 2024-09-12T22:49:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.167303+0000", 2024-09-12T22:49:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0064335690000000001 2024-09-12T22:49:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.167320+0000", 2024-09-12T22:49:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7329e-05 2024-09-12T22:49:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.167329+0000", 2024-09-12T22:49:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4069999999999993e-06 2024-09-12T22:49:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.167402+0000", 2024-09-12T22:49:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3184999999999998e-05 2024-09-12T22:49:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.167550+0000", 2024-09-12T22:49:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014852499999999999 2024-09-12T22:49:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.167689+0000", 2024-09-12T22:49:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013904799999999999 2024-09-12T22:49:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.176328+0000", 2024-09-12T22:49:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0086384979999999997 2024-09-12T22:49:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.179037+0000", 2024-09-12T22:49:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027092599999999998 2024-09-12T22:49:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.179066+0000", 2024-09-12T22:49:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9132000000000002e-05 2024-09-12T22:49:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.179093+0000", 2024-09-12T22:49:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6633999999999999e-05 2024-09-12T22:49:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.092 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:57 4.9 e50/17 4:91e366d7:::10000000230.00000000:head v 50'1, mlcod=0'0)", 2024-09-12T22:49:44.092 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.217245+0000", 2024-09-12T22:49:44.092 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.8167976369999996, 2024-09-12T22:49:44.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078517689999999998, 2024-09-12T22:49:44.092 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:44.092 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:44.092 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:44.092 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:44.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:44.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217245+0000", 2024-09-12T22:49:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217245+0000", 2024-09-12T22:49:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217246+0000", 2024-09-12T22:49:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5199999999999996e-07 2024-09-12T22:49:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217253+0000", 2024-09-12T22:49:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1330000000000001e-06 2024-09-12T22:49:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217261+0000", 2024-09-12T22:49:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4500000000000004e-06 2024-09-12T22:49:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217267+0000", 2024-09-12T22:49:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-06 2024-09-12T22:49:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217309+0000", 2024-09-12T22:49:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1535000000000001e-05 2024-09-12T22:49:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217325+0000", 2024-09-12T22:49:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6208000000000001e-05 2024-09-12T22:49:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.225071+0000", 2024-09-12T22:49:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077461470000000001 2024-09-12T22:49:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.225097+0000", 2024-09-12T22:49:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5384e-05 2024-09-12T22:49:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:144 4.20 4:069ea127:::10000000289.00000000:head [write 0~1223] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.294752+0000", 2024-09-12T22:49:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.7392901639999998, 2024-09-12T22:49:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083421970000000008, 2024-09-12T22:49:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 144 2024-09-12T22:49:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294752+0000", 2024-09-12T22:49:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294752+0000", 2024-09-12T22:49:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294753+0000", 2024-09-12T22:49:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.37e-07 2024-09-12T22:49:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294757+0000", 2024-09-12T22:49:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.811e-06 2024-09-12T22:49:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294765+0000", 2024-09-12T22:49:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0390000000000005e-06 2024-09-12T22:49:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294771+0000", 2024-09-12T22:49:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2689999999999996e-06 2024-09-12T22:49:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294816+0000", 2024-09-12T22:49:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5046000000000002e-05 2024-09-12T22:49:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294887+0000", 2024-09-12T22:49:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0609000000000001e-05 2024-09-12T22:49:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:44.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.302989+0000", 2024-09-12T22:49:44.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081019409999999997 2024-09-12T22:49:44.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:44.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.303033+0000", 2024-09-12T22:49:44.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4190999999999998e-05 2024-09-12T22:49:44.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:44.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.303095+0000", 2024-09-12T22:49:44.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1654000000000003e-05 2024-09-12T22:49:44.101 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:145 4.16 4:696afb02:::1000000028a.00000000:head [write 0~55211] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.296232+0000", 2024-09-12T22:49:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.7378106100000004, 2024-09-12T22:49:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.006909475, 2024-09-12T22:49:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 145 2024-09-12T22:49:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.296232+0000", 2024-09-12T22:49:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.296232+0000", 2024-09-12T22:49:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.296232+0000", 2024-09-12T22:49:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9800000000000004e-07 2024-09-12T22:49:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.296279+0000", 2024-09-12T22:49:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6353999999999997e-05 2024-09-12T22:49:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.296286+0000", 2024-09-12T22:49:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0779999999999998e-06 2024-09-12T22:49:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.296291+0000", 2024-09-12T22:49:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0950000000000003e-06 2024-09-12T22:49:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.296336+0000", 2024-09-12T22:49:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4563e-05 2024-09-12T22:49:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.296404+0000", 2024-09-12T22:49:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8756000000000004e-05 2024-09-12T22:49:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.303017+0000", 2024-09-12T22:49:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0066131159999999996 2024-09-12T22:49:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.303064+0000", 2024-09-12T22:49:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6728999999999999e-05 2024-09-12T22:49:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.303141+0000", 2024-09-12T22:49:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7286000000000005e-05 2024-09-12T22:49:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:150 4.a 4:53071690:::1000000028f.00000000:head [write 0~111] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.301030+0000", 2024-09-12T22:49:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.7330128739999999, 2024-09-12T22:49:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077464659999999996, 2024-09-12T22:49:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 150 2024-09-12T22:49:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301030+0000", 2024-09-12T22:49:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301030+0000", 2024-09-12T22:49:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301031+0000", 2024-09-12T22:49:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.13e-06 2024-09-12T22:49:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301036+0000", 2024-09-12T22:49:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3519999999999997e-06 2024-09-12T22:49:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301050+0000", 2024-09-12T22:49:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3705e-05 2024-09-12T22:49:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301060+0000", 2024-09-12T22:49:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0042e-05 2024-09-12T22:49:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301114+0000", 2024-09-12T22:49:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4421e-05 2024-09-12T22:49:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301231+0000", 2024-09-12T22:49:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116552 2024-09-12T22:49:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.308695+0000", 2024-09-12T22:49:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0074639459999999999 2024-09-12T22:49:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.308735+0000", 2024-09-12T22:49:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0181e-05 2024-09-12T22:49:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.308776+0000", 2024-09-12T22:49:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1137000000000003e-05 2024-09-12T22:49:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:151 4.7 4:e25a3370:::10000000290.00000000:head [write 0~6349] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.301970+0000", 2024-09-12T22:49:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.7320726730000002, 2024-09-12T22:49:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082601040000000008, 2024-09-12T22:49:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 151 2024-09-12T22:49:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301970+0000", 2024-09-12T22:49:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301970+0000", 2024-09-12T22:49:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301970+0000", 2024-09-12T22:49:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0699999999999998e-07 2024-09-12T22:49:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301977+0000", 2024-09-12T22:49:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0890000000000002e-06 2024-09-12T22:49:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301984+0000", 2024-09-12T22:49:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.511e-06 2024-09-12T22:49:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301988+0000", 2024-09-12T22:49:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7079999999999999e-06 2024-09-12T22:49:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.302027+0000", 2024-09-12T22:49:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9113999999999999e-05 2024-09-12T22:49:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.302099+0000", 2024-09-12T22:49:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2673e-05 2024-09-12T22:49:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.302174+0000", 2024-09-12T22:49:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4274000000000001e-05 2024-09-12T22:49:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.308696+0000", 2024-09-12T22:49:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065225159999999999 2024-09-12T22:49:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.310175+0000", 2024-09-12T22:49:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014790350000000001 2024-09-12T22:49:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.310205+0000", 2024-09-12T22:49:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9799e-05 2024-09-12T22:49:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.310230+0000", 2024-09-12T22:49:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4978e-05 2024-09-12T22:49:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:194 4.16 4:6af67b46:::100000002bb.00000000:head [write 0~111] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.339531+0000", 2024-09-12T22:49:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.694511511, 2024-09-12T22:49:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073351789999999998, 2024-09-12T22:49:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 194 2024-09-12T22:49:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339531+0000", 2024-09-12T22:49:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339531+0000", 2024-09-12T22:49:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339532+0000", 2024-09-12T22:49:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8100000000000002e-07 2024-09-12T22:49:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339536+0000", 2024-09-12T22:49:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8739999999999997e-06 2024-09-12T22:49:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339546+0000", 2024-09-12T22:49:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0567999999999999e-05 2024-09-12T22:49:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339552+0000", 2024-09-12T22:49:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4750000000000001e-06 2024-09-12T22:49:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339593+0000", 2024-09-12T22:49:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1230999999999999e-05 2024-09-12T22:49:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339664+0000", 2024-09-12T22:49:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0769e-05 2024-09-12T22:49:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.346724+0000", 2024-09-12T22:49:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070602249999999998 2024-09-12T22:49:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.346778+0000", 2024-09-12T22:49:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4469999999999999e-05 2024-09-12T22:49:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.346866+0000", 2024-09-12T22:49:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7786000000000003e-05 2024-09-12T22:49:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:198 4.12 4:4a0eff6f:::100000002bf.00000000:head [write 0~98] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.343572+0000", 2024-09-12T22:49:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.6904707639999996, 2024-09-12T22:49:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084413230000000006, 2024-09-12T22:49:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 198 2024-09-12T22:49:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:44.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343572+0000", 2024-09-12T22:49:44.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:44.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343572+0000", 2024-09-12T22:49:44.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:44.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343573+0000", 2024-09-12T22:49:44.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:49:44.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:44.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343578+0000", 2024-09-12T22:49:44.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4750000000000001e-06 2024-09-12T22:49:44.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:44.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343589+0000", 2024-09-12T22:49:44.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0709e-05 2024-09-12T22:49:44.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343594+0000", 2024-09-12T22:49:44.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4360000000000001e-06 2024-09-12T22:49:44.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:44.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343668+0000", 2024-09-12T22:49:44.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3907999999999998e-05 2024-09-12T22:49:44.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:44.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343741+0000", 2024-09-12T22:49:44.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2922000000000004e-05 2024-09-12T22:49:44.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:44.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343841+0000", 2024-09-12T22:49:44.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100412 2024-09-12T22:49:44.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:44.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349501+0000", 2024-09-12T22:49:44.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005659776 2024-09-12T22:49:44.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:44.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.351940+0000", 2024-09-12T22:49:44.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024390839999999998 2024-09-12T22:49:44.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:44.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.351986+0000", 2024-09-12T22:49:44.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5970999999999997e-05 2024-09-12T22:49:44.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:44.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352013+0000", 2024-09-12T22:49:44.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6871000000000001e-05 2024-09-12T22:49:44.130 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.130 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:44.131 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.131 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:205 4.37 4:ef7c8488:::100000002c6.00000000:head [write 0~98] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:44.131 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.349405+0000", 2024-09-12T22:49:44.131 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.6846380380000001, 2024-09-12T22:49:44.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078250019999999993, 2024-09-12T22:49:44.131 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:44.131 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:44.131 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:44.131 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:44.131 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:44.131 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:44.132 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 205 2024-09-12T22:49:44.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.132 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:44.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:44.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349405+0000", 2024-09-12T22:49:44.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:44.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349405+0000", 2024-09-12T22:49:44.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:44.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349405+0000", 2024-09-12T22:49:44.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:49:44.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:44.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349409+0000", 2024-09-12T22:49:44.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1359999999999999e-06 2024-09-12T22:49:44.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:44.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349418+0000", 2024-09-12T22:49:44.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3289999999999994e-06 2024-09-12T22:49:44.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349423+0000", 2024-09-12T22:49:44.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9949999999999996e-06 2024-09-12T22:49:44.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:44.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349469+0000", 2024-09-12T22:49:44.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6008999999999999e-05 2024-09-12T22:49:44.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:44.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349570+0000", 2024-09-12T22:49:44.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100831 2024-09-12T22:49:44.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:44.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349682+0000", 2024-09-12T22:49:44.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011268 2024-09-12T22:49:44.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:44.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.351968+0000", 2024-09-12T22:49:44.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022860379999999998 2024-09-12T22:49:44.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:44.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.357145+0000", 2024-09-12T22:49:44.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051769759999999998 2024-09-12T22:49:44.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:44.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.357187+0000", 2024-09-12T22:49:44.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1248999999999998e-05 2024-09-12T22:49:44.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:44.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.357230+0000", 2024-09-12T22:49:44.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3010000000000003e-05 2024-09-12T22:49:44.137 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.137 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:44.137 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.137 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:208 4.1c e50/17 4:3b628a21:::100000002c9.00000000:head v 50'2, mlcod=0'0)", 2024-09-12T22:49:44.137 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.352179+0000", 2024-09-12T22:49:44.137 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.6818640189999998, 2024-09-12T22:49:44.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0076543849999999997, 2024-09-12T22:49:44.137 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:44.137 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:44.137 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:44.137 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:44.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:44.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352179+0000", 2024-09-12T22:49:44.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:44.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352179+0000", 2024-09-12T22:49:44.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:44.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352179+0000", 2024-09-12T22:49:44.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0200000000000002e-07 2024-09-12T22:49:44.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:44.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352184+0000", 2024-09-12T22:49:44.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0470000000000001e-06 2024-09-12T22:49:44.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:44.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352190+0000", 2024-09-12T22:49:44.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9519999999999999e-06 2024-09-12T22:49:44.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352194+0000", 2024-09-12T22:49:44.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.369e-06 2024-09-12T22:49:44.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:44.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352232+0000", 2024-09-12T22:49:44.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7752e-05 2024-09-12T22:49:44.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:44.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352249+0000", 2024-09-12T22:49:44.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6796e-05 2024-09-12T22:49:44.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:44.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.359795+0000", 2024-09-12T22:49:44.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0075457989999999997 2024-09-12T22:49:44.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:44.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.359833+0000", 2024-09-12T22:49:44.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8167999999999998e-05 2024-09-12T22:49:44.141 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.141 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:44.141 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.142 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:247 4.a 4:5080b297:::100000002f5.00000000:head [write 0~12498] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:44.142 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.390848+0000", 2024-09-12T22:49:44.142 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.6431944219999997, 2024-09-12T22:49:44.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071234089999999998, 2024-09-12T22:49:44.142 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:44.142 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:44.142 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:44.142 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:44.142 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:44.142 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:44.142 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 247 2024-09-12T22:49:44.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.143 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:44.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:44.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.390848+0000", 2024-09-12T22:49:44.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:44.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.390848+0000", 2024-09-12T22:49:44.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:44.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.390849+0000", 2024-09-12T22:49:44.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-09-12T22:49:44.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:44.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.390860+0000", 2024-09-12T22:49:44.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.151e-05 2024-09-12T22:49:44.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:44.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.390869+0000", 2024-09-12T22:49:44.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3389999999999993e-06 2024-09-12T22:49:44.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.390877+0000", 2024-09-12T22:49:44.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3310000000000004e-06 2024-09-12T22:49:44.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:44.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.390930+0000", 2024-09-12T22:49:44.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2685999999999997e-05 2024-09-12T22:49:44.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:44.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.391048+0000", 2024-09-12T22:49:44.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000118566 2024-09-12T22:49:44.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:44.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.397864+0000", 2024-09-12T22:49:44.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0068154690000000002 2024-09-12T22:49:44.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:44.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.397904+0000", 2024-09-12T22:49:44.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0185000000000002e-05 2024-09-12T22:49:44.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:44.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.397972+0000", 2024-09-12T22:49:44.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7552999999999995e-05 2024-09-12T22:49:44.147 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.147 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:44.147 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.147 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.147 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:44.147 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:44.148 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:44.147+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:44.149 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:44.249 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:44.248+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:44.256 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:44.256 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:44.257 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:49:44.257 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:44.266 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:44.350 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:44.349+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:44.373 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:44.374 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:44.374 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:49:44.374 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:49:44.374 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:44.383 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:44.451 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:44.450+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:44.496 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:44.496 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:49:44.496 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:49:44.496 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:49:44.497 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.497 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:44.497 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:44.497 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 99.33007594, 2024-09-12T22:49:44.497 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:49:44.497 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:44.497 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:44.497 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:44.497 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:44.497 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.497 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:44.497 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:44.497 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.498 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.498 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.498 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:44.498 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:44.498 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.498 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.498 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.498 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:44.498 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:49:44.498 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:49:44.498 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.498 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.498 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:44.499 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:49:44.499 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:49:44.499 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.499 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.499 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:44.499 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:49:44.499 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:49:44.499 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.499 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.499 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.499 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:49:44.499 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:49:44.499 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.500 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.500 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:44.500 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:44.500 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:49:44.500 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.500 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.500 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:44.500 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:44.500 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:49:44.500 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.500 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.501 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:44.501 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:49:44.501 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:49:44.501 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.501 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.501 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:44.501 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:49:44.501 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:49:44.501 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.501 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.501 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:44.501 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:49:44.501 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:49:44.502 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.502 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.502 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:44.502 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:49:44.502 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:49:44.502 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.502 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.502 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:44.502 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:49:44.502 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:49:44.502 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.502 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.502 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:44.503 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:49:44.503 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:49:44.503 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.503 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.503 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:44.503 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:49:44.503 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:49:44.503 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.503 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:44.503 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.503 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.503 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.503 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:44.504 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:44.504 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 99.329976423000005, 2024-09-12T22:49:44.504 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:49:44.504 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:44.504 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:44.504 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:44.504 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:44.504 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.504 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:44.504 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:44.504 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.504 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.504 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.505 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:44.505 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:44.505 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.505 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.505 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.505 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:44.505 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:49:44.505 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:49:44.505 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.505 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.505 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:44.505 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:49:44.505 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:49:44.506 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.506 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.506 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:44.506 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:49:44.506 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:49:44.506 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.506 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.506 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.506 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:49:44.506 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:49:44.506 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.506 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.506 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:44.507 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:49:44.507 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:49:44.507 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.507 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.507 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:44.507 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:49:44.507 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:49:44.507 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.507 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.507 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:44.507 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:49:44.507 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:49:44.507 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.507 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.508 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:44.508 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:49:44.508 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:49:44.508 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.508 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.508 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:44.508 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:49:44.508 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:49:44.508 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.508 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.508 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:44.508 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:49:44.509 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:49:44.509 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.509 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.509 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:44.509 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:49:44.509 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:49:44.509 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.509 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.509 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:44.509 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:49:44.509 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:49:44.509 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.509 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.510 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:44.510 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:49:44.510 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:49:44.510 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.510 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:44.510 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.510 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.510 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.510 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:44.510 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:44.510 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 99.329931684000002, 2024-09-12T22:49:44.510 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:49:44.511 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:44.511 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:44.511 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:44.511 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:44.511 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.511 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:44.511 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:44.511 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.511 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.511 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.511 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:44.511 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:44.511 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.512 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.512 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.512 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:44.512 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:49:44.512 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:49:44.512 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.512 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.512 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:44.512 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:44.512 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:49:44.512 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.512 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.513 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:44.513 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:44.513 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:49:44.513 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.513 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.513 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.513 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:49:44.513 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:49:44.513 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.513 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.513 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:44.513 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:49:44.513 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:49:44.513 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.514 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.514 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:44.514 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:49:44.514 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:49:44.514 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.514 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.514 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:44.514 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:49:44.514 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:49:44.514 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.514 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.514 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:44.514 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:49:44.515 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:49:44.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.515 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.515 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:44.515 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:49:44.515 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:49:44.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.515 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.515 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:44.515 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:49:44.515 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:49:44.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.515 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.516 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:44.516 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:49:44.516 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:49:44.516 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.516 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.516 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:44.516 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:49:44.516 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:49:44.516 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.516 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.516 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:44.516 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:49:44.516 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:49:44.517 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.517 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:44.517 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.517 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.517 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.517 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:44.517 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:44.517 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 99.329703983000002, 2024-09-12T22:49:44.517 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:49:44.517 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:44.517 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:44.517 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:44.517 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:44.518 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.518 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:44.518 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:44.518 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.518 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.518 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.518 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:44.518 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:44.518 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.518 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.518 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.519 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:44.519 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:49:44.519 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:49:44.519 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.519 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.519 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:44.519 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:49:44.519 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:49:44.519 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.519 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.519 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:44.519 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:49:44.520 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:49:44.520 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.520 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.520 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.520 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:49:44.520 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:49:44.520 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.520 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.520 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:44.520 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:49:44.520 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:49:44.521 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.521 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.521 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:44.521 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:49:44.521 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:49:44.521 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.521 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.521 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:44.521 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:49:44.521 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:49:44.521 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.522 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.522 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:44.522 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:49:44.522 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:49:44.522 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.522 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.522 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:44.522 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:49:44.522 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:49:44.522 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.522 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.522 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:44.523 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:49:44.523 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:49:44.523 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.523 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.523 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:44.523 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:49:44.523 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:49:44.523 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.523 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.523 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:44.523 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:49:44.523 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:49:44.523 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.523 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.524 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:44.524 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:49:44.524 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:49:44.524 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.524 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:44.524 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.524 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.524 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.524 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:44.524 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:44.524 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 99.329538874999997, 2024-09-12T22:49:44.524 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:49:44.524 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:44.525 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:44.525 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:44.525 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:44.525 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.525 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:44.525 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:44.525 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.525 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.525 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.525 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:44.525 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:44.525 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.525 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.526 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.526 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:44.526 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:49:44.526 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:49:44.526 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.526 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.526 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:44.526 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:49:44.526 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:49:44.526 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.526 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.526 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:44.526 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:49:44.527 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:49:44.527 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.527 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.527 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.527 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:49:44.527 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:49:44.527 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.527 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.527 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:44.527 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:49:44.527 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:49:44.527 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.527 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.528 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:44.528 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:49:44.528 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:49:44.528 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.528 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.528 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:44.528 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:49:44.528 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:49:44.528 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.528 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.528 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:44.528 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:49:44.529 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:49:44.529 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.529 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.529 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:44.529 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:49:44.529 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:49:44.529 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.529 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.529 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:44.529 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:49:44.529 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:49:44.529 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.529 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.530 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:44.530 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:49:44.530 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:49:44.530 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.530 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.530 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:44.530 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:49:44.530 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:49:44.530 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.530 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.530 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:44.530 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:49:44.530 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:49:44.531 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.531 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:44.531 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.531 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.531 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.531 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:44.531 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:44.531 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 99.329477589999996, 2024-09-12T22:49:44.531 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:49:44.531 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:44.531 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:44.531 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:44.531 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:44.532 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.532 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:44.532 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:44.532 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.532 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.532 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.532 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:44.532 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:44.532 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.532 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.532 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.532 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:44.532 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:44.533 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:49:44.533 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.533 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.533 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:44.533 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:49:44.533 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:49:44.533 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.533 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.533 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:44.533 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:49:44.533 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:49:44.533 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.533 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.534 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.534 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:49:44.534 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:49:44.534 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.534 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.534 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:44.534 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:49:44.534 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:49:44.534 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.534 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.534 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:44.534 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:49:44.534 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:49:44.534 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.535 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.535 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:44.535 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:49:44.535 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:49:44.535 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.535 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.535 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:44.535 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:49:44.535 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:49:44.535 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.535 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.535 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:44.535 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:49:44.536 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:49:44.536 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.536 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.536 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:44.536 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:49:44.536 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:49:44.536 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.536 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.536 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:44.536 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:49:44.536 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:49:44.536 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.536 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.537 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:44.537 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:49:44.537 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:49:44.537 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.537 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.537 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:44.537 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:49:44.537 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:49:44.537 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.537 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:44.537 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.537 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.537 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.538 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:44.538 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:44.538 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 99.329397482000005, 2024-09-12T22:49:44.538 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:49:44.538 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:44.538 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:44.538 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:44.538 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:44.538 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.538 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:44.538 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:44.538 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.538 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.539 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.539 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:44.539 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:44.539 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.539 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.539 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.539 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:44.539 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:49:44.539 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:49:44.539 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.539 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.539 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:44.539 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:49:44.540 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:49:44.540 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.540 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.540 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:44.540 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:49:44.540 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:49:44.540 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.540 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.540 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.540 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:49:44.540 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:49:44.540 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.541 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.541 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:44.541 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:49:44.541 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:49:44.541 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.541 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.541 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:44.541 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:49:44.541 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:49:44.541 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.541 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.541 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:44.541 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:49:44.542 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:49:44.542 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.542 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.542 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:44.542 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:49:44.542 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:49:44.542 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.542 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.542 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:44.542 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:49:44.542 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:49:44.542 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.542 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.543 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:44.543 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:49:44.543 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:49:44.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.543 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.543 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:44.543 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:49:44.543 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:49:44.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.543 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.543 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:44.543 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:49:44.543 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:49:44.544 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.544 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.544 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:44.544 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:49:44.544 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:49:44.544 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.544 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:44.544 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.544 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.544 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.544 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:44.544 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:44.544 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 99.329348529000001, 2024-09-12T22:49:44.545 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:49:44.545 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:44.545 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:44.545 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:44.545 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:44.545 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.545 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:44.545 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:44.545 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.545 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.545 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.545 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:44.545 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:44.546 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.546 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.546 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.546 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:44.546 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:44.546 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:49:44.546 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.546 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.546 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:44.546 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:49:44.546 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:49:44.546 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.546 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.546 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:44.547 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:49:44.547 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:49:44.547 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.547 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.547 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.547 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:49:44.547 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:49:44.547 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.547 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.547 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:44.547 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:49:44.547 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:49:44.547 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.547 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.548 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:44.548 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:49:44.548 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:49:44.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.548 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.548 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:44.548 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:49:44.548 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:49:44.548 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.548 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:44.548 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.549 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.549 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:44.549 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:44.549 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 99.329299429000002, 2024-09-12T22:49:44.549 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:49:44.549 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:44.549 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:44.549 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:44.549 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:44.549 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.549 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:44.549 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:44.549 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.550 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.550 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.550 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:44.550 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:44.550 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.550 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.550 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.550 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:44.550 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:49:44.550 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:49:44.550 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.550 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.550 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:44.551 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:49:44.551 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:49:44.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.551 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.551 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:44.551 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:49:44.551 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:49:44.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.551 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.551 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.551 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:49:44.551 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:49:44.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.552 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.552 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:44.552 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:49:44.552 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:49:44.552 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.552 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.552 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:44.552 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:49:44.552 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:49:44.552 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.552 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.552 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:44.552 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:49:44.553 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:49:44.553 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.553 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:44.553 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.553 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.553 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.553 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:44.553 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.082046+0000", 2024-09-12T22:49:44.553 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.4122404729999998, 2024-09-12T22:49:44.553 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012182124000000001, 2024-09-12T22:49:44.553 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:44.553 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:44.553 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:44.554 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:44.554 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:44.554 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:44.554 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 4 2024-09-12T22:49:44.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.554 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:44.554 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.554 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:44.554 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.082046+0000", 2024-09-12T22:49:44.554 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.554 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.554 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:44.555 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.082046+0000", 2024-09-12T22:49:44.555 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.555 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.555 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.555 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:44.555 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.082048+0000", 2024-09-12T22:49:44.555 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5969999999999999e-06 2024-09-12T22:49:44.555 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.555 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.555 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:44.555 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.087738+0000", 2024-09-12T22:49:44.555 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0056892499999999999 2024-09-12T22:49:44.555 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.556 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:44.556 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.087782+0000", 2024-09-12T22:49:44.556 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4267999999999997e-05 2024-09-12T22:49:44.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.556 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.556 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.087795+0000", 2024-09-12T22:49:44.556 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3560000000000001e-05 2024-09-12T22:49:44.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.557 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:44.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.087897+0000", 2024-09-12T22:49:44.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000102098 2024-09-12T22:49:44.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.557 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.557 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:44.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.087992+0000", 2024-09-12T22:49:44.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4407000000000006e-05 2024-09-12T22:49:44.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.557 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.557 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:44.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.094121+0000", 2024-09-12T22:49:44.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0061287340000000003 2024-09-12T22:49:44.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.558 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.558 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:44.558 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.094164+0000", 2024-09-12T22:49:44.558 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3269000000000002e-05 2024-09-12T22:49:44.558 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.558 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.558 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:44.558 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.094228+0000", 2024-09-12T22:49:44.558 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3941000000000003e-05 2024-09-12T22:49:44.558 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.558 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:44.558 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.559 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.559 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.559 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:44.559 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.159925+0000", 2024-09-12T22:49:44.559 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.3343615340000001, 2024-09-12T22:49:44.559 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0099924560000000003, 2024-09-12T22:49:44.559 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:44.559 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:44.559 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:44.559 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:44.559 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:44.559 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:44.560 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 6 2024-09-12T22:49:44.560 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.560 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:44.560 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.560 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:44.560 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.159925+0000", 2024-09-12T22:49:44.560 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.560 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.560 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.560 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:44.560 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.159925+0000", 2024-09-12T22:49:44.560 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.560 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.561 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.561 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:44.561 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.159926+0000", 2024-09-12T22:49:44.561 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4890000000000001e-06 2024-09-12T22:49:44.561 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.561 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.561 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:44.561 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.163620+0000", 2024-09-12T22:49:44.561 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003694021 2024-09-12T22:49:44.561 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.561 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.561 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:44.562 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.163635+0000", 2024-09-12T22:49:44.562 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4732999999999999e-05 2024-09-12T22:49:44.562 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.562 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.562 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.562 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.163643+0000", 2024-09-12T22:49:44.562 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7209999999999994e-06 2024-09-12T22:49:44.562 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.562 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.562 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:44.562 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.163725+0000", 2024-09-12T22:49:44.562 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2263999999999997e-05 2024-09-12T22:49:44.562 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.563 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.563 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:44.563 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.163866+0000", 2024-09-12T22:49:44.563 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014159200000000001 2024-09-12T22:49:44.563 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.563 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.563 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:44.563 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.169766+0000", 2024-09-12T22:49:44.563 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0058992109999999997 2024-09-12T22:49:44.563 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.563 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.563 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:44.563 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.169817+0000", 2024-09-12T22:49:44.564 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1115000000000001e-05 2024-09-12T22:49:44.564 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.564 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.564 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:44.564 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.169917+0000", 2024-09-12T22:49:44.564 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010030999999999999 2024-09-12T22:49:44.564 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.564 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:44.564 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.564 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.564 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.564 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4459.0:5 4.10 e50/17 4:09a4c37f:::10000000003.00000001:head v 50'1, mlcod=0'0)", 2024-09-12T22:49:44.565 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.167838+0000", 2024-09-12T22:49:44.565 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.3264483440000001, 2024-09-12T22:49:44.565 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011071799, 2024-09-12T22:49:44.565 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:44.565 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:44.565 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:44.565 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:44.565 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.565 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:44.565 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.167838+0000", 2024-09-12T22:49:44.565 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.565 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.565 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.566 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:44.566 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.167838+0000", 2024-09-12T22:49:44.566 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.566 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.566 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.566 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:44.566 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.167839+0000", 2024-09-12T22:49:44.566 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5600000000000004e-07 2024-09-12T22:49:44.566 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.566 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.566 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:44.566 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.172178+0000", 2024-09-12T22:49:44.567 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043395860000000003 2024-09-12T22:49:44.567 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.567 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.567 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:44.567 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.172192+0000", 2024-09-12T22:49:44.567 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3451999999999999e-05 2024-09-12T22:49:44.567 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.567 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.567 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.567 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.172205+0000", 2024-09-12T22:49:44.567 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2853e-05 2024-09-12T22:49:44.567 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.568 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.568 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:44.568 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.172281+0000", 2024-09-12T22:49:44.568 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6093000000000005e-05 2024-09-12T22:49:44.568 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.568 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.568 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:44.568 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.172301+0000", 2024-09-12T22:49:44.568 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0276e-05 2024-09-12T22:49:44.568 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.568 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.568 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:44.568 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.178879+0000", 2024-09-12T22:49:44.569 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0065783539999999998 2024-09-12T22:49:44.569 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.569 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.569 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:44.569 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.178910+0000", 2024-09-12T22:49:44.569 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0329e-05 2024-09-12T22:49:44.569 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.569 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:44.569 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.569 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.569 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.569 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:57 4.9 4:91e366d7:::10000000230.00000000:head [write 0~1966] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:44.570 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.216970+0000", 2024-09-12T22:49:44.570 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.27731657, 2024-09-12T22:49:44.570 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082673929999999996, 2024-09-12T22:49:44.570 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:44.570 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:44.570 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:44.570 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:44.570 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:44.570 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:44.570 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 57 2024-09-12T22:49:44.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.570 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:44.571 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.571 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:44.571 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.216970+0000", 2024-09-12T22:49:44.571 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.571 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.571 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.571 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:44.571 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.216970+0000", 2024-09-12T22:49:44.571 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.571 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.571 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.571 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:44.572 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.216970+0000", 2024-09-12T22:49:44.572 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:49:44.572 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.572 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.572 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:44.572 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.216977+0000", 2024-09-12T22:49:44.572 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1999999999999997e-06 2024-09-12T22:49:44.572 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.572 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.572 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:44.572 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.216985+0000", 2024-09-12T22:49:44.572 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.909e-06 2024-09-12T22:49:44.572 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.573 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.573 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.216991+0000", 2024-09-12T22:49:44.573 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4260000000000002e-06 2024-09-12T22:49:44.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.573 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:44.573 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.217025+0000", 2024-09-12T22:49:44.573 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4591999999999997e-05 2024-09-12T22:49:44.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.573 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:44.574 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.217089+0000", 2024-09-12T22:49:44.574 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3226999999999996e-05 2024-09-12T22:49:44.574 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.574 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.574 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:44.574 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.217152+0000", 2024-09-12T22:49:44.574 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3089999999999994e-05 2024-09-12T22:49:44.574 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.574 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.574 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:44.574 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.217745+0000", 2024-09-12T22:49:44.574 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00059294899999999995 2024-09-12T22:49:44.574 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.575 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.575 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:44.575 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.225195+0000", 2024-09-12T22:49:44.575 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.007450623 2024-09-12T22:49:44.575 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.575 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.575 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:44.575 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.225219+0000", 2024-09-12T22:49:44.575 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3773000000000001e-05 2024-09-12T22:49:44.575 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.575 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.575 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:44.575 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.225237+0000", 2024-09-12T22:49:44.576 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7927999999999998e-05 2024-09-12T22:49:44.576 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.576 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:44.576 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.576 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.576 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.576 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:75 4.2e 4:7528f44f:::10000000242.00000000:head [write 0~1151] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:44.576 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.232047+0000", 2024-09-12T22:49:44.576 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.2622388940000002, 2024-09-12T22:49:44.576 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082051009999999994, 2024-09-12T22:49:44.576 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:44.576 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:44.576 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:44.577 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:44.577 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:44.577 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:44.577 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 75 2024-09-12T22:49:44.577 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.577 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:44.577 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.577 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:44.577 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232047+0000", 2024-09-12T22:49:44.577 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.577 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.577 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.578 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:44.578 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232047+0000", 2024-09-12T22:49:44.578 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.578 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.578 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.578 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:44.578 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232048+0000", 2024-09-12T22:49:44.578 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6700000000000003e-07 2024-09-12T22:49:44.578 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.578 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.578 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:44.578 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232052+0000", 2024-09-12T22:49:44.578 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1139999999999999e-06 2024-09-12T22:49:44.578 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.579 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.579 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:44.579 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232063+0000", 2024-09-12T22:49:44.579 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0781000000000001e-05 2024-09-12T22:49:44.579 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.579 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.579 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.579 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232068+0000", 2024-09-12T22:49:44.579 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0579999999999997e-06 2024-09-12T22:49:44.579 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.579 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.579 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:44.580 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232102+0000", 2024-09-12T22:49:44.580 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3976000000000001e-05 2024-09-12T22:49:44.580 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.580 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.580 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:44.580 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232174+0000", 2024-09-12T22:49:44.580 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2254000000000003e-05 2024-09-12T22:49:44.580 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.580 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.580 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:44.580 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232245+0000", 2024-09-12T22:49:44.580 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0597000000000002e-05 2024-09-12T22:49:44.581 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.581 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.581 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:44.581 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.233156+0000", 2024-09-12T22:49:44.581 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00091127799999999996 2024-09-12T22:49:44.581 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.581 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.581 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:44.581 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.240194+0000", 2024-09-12T22:49:44.581 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0070376140000000002 2024-09-12T22:49:44.581 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.581 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.582 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:44.582 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.240228+0000", 2024-09-12T22:49:44.582 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4347999999999997e-05 2024-09-12T22:49:44.582 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.582 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.582 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:44.582 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.240252+0000", 2024-09-12T22:49:44.582 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4314000000000001e-05 2024-09-12T22:49:44.582 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.582 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:44.582 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.582 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.583 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.583 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:76 4.25 4:a7ae8a0f:::10000000243.00000000:head [write 0~1194] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:44.583 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.232867+0000", 2024-09-12T22:49:44.583 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.2614188439999996, 2024-09-12T22:49:44.583 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074145970000000002, 2024-09-12T22:49:44.583 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:44.583 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:44.583 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:44.583 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:44.583 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:44.583 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:44.583 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 76 2024-09-12T22:49:44.583 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.584 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:44.584 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.584 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:44.584 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232867+0000", 2024-09-12T22:49:44.584 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.584 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.584 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.584 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:44.584 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232867+0000", 2024-09-12T22:49:44.584 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.584 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.584 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.585 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:44.585 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232868+0000", 2024-09-12T22:49:44.585 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6000000000000003e-07 2024-09-12T22:49:44.585 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.585 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.585 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:44.585 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232877+0000", 2024-09-12T22:49:44.585 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5140000000000001e-06 2024-09-12T22:49:44.585 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.585 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.585 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:44.585 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232888+0000", 2024-09-12T22:49:44.585 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0927999999999999e-05 2024-09-12T22:49:44.586 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.586 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.586 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.586 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232892+0000", 2024-09-12T22:49:44.586 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8999999999999997e-06 2024-09-12T22:49:44.586 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.586 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.586 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:44.586 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232936+0000", 2024-09-12T22:49:44.586 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3779000000000002e-05 2024-09-12T22:49:44.586 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.586 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.587 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:44.587 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.233005+0000", 2024-09-12T22:49:44.587 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8685999999999999e-05 2024-09-12T22:49:44.587 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.587 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.587 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:44.587 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.240176+0000", 2024-09-12T22:49:44.587 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071707070000000001 2024-09-12T22:49:44.587 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.587 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.587 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:44.587 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.240232+0000", 2024-09-12T22:49:44.587 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6493000000000003e-05 2024-09-12T22:49:44.588 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.588 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.588 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:44.588 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.240282+0000", 2024-09-12T22:49:44.588 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9830000000000002e-05 2024-09-12T22:49:44.588 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.588 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:44.588 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.588 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.588 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.588 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:127 4.3 4:c2ce25ce:::10000000277.00000000:head [write 0~111] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:44.588 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.279463+0000", 2024-09-12T22:49:44.589 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.2148228010000004, 2024-09-12T22:49:44.589 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0083277809999999994, 2024-09-12T22:49:44.589 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:44.589 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:44.589 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:44.589 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:44.589 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:44.589 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:44.589 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 127 2024-09-12T22:49:44.589 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.589 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:44.589 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.589 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:44.590 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.279463+0000", 2024-09-12T22:49:44.590 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.590 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.590 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.590 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:44.590 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.279463+0000", 2024-09-12T22:49:44.590 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.590 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.590 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.590 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:44.590 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.279464+0000", 2024-09-12T22:49:44.590 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4899999999999995e-07 2024-09-12T22:49:44.590 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.591 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.591 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:44.591 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.279468+0000", 2024-09-12T22:49:44.591 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6720000000000002e-06 2024-09-12T22:49:44.591 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.591 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.591 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:44.591 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.279475+0000", 2024-09-12T22:49:44.591 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3180000000000001e-06 2024-09-12T22:49:44.591 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.591 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.591 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.591 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.279480+0000", 2024-09-12T22:49:44.592 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2599999999999996e-06 2024-09-12T22:49:44.592 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.592 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.592 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:44.592 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.279519+0000", 2024-09-12T22:49:44.592 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8549e-05 2024-09-12T22:49:44.592 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.592 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.592 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:44.592 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.279577+0000", 2024-09-12T22:49:44.592 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7812999999999997e-05 2024-09-12T22:49:44.592 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.592 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.593 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:44.593 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.287689+0000", 2024-09-12T22:49:44.593 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081127490000000007 2024-09-12T22:49:44.593 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.593 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.593 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:44.593 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.287730+0000", 2024-09-12T22:49:44.593 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1044000000000002e-05 2024-09-12T22:49:44.593 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.593 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.593 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:44.593 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.287791+0000", 2024-09-12T22:49:44.593 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0826999999999999e-05 2024-09-12T22:49:44.594 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.594 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:44.594 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.594 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.594 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.594 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:128 4.2e 4:74579a32:::10000000278.00000000:head [write 0~111] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:44.594 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.280292+0000", 2024-09-12T22:49:44.594 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.2139939159999997, 2024-09-12T22:49:44.594 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075002829999999999, 2024-09-12T22:49:44.594 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:44.594 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:44.594 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:44.594 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:44.595 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:44.595 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:44.595 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 128 2024-09-12T22:49:44.595 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.595 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:44.595 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.595 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:44.595 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.280292+0000", 2024-09-12T22:49:44.595 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.595 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.595 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.595 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:44.595 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.280292+0000", 2024-09-12T22:49:44.596 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.596 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.596 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.596 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:44.596 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.280293+0000", 2024-09-12T22:49:44.596 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7199999999999998e-07 2024-09-12T22:49:44.596 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.596 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.596 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:44.596 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.280297+0000", 2024-09-12T22:49:44.596 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0239999999999999e-06 2024-09-12T22:49:44.596 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.597 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.597 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:44.597 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.280308+0000", 2024-09-12T22:49:44.597 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0855e-05 2024-09-12T22:49:44.597 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.597 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.597 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.597 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.280313+0000", 2024-09-12T22:49:44.597 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0069999999999997e-06 2024-09-12T22:49:44.597 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.597 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.597 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:44.597 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.280351+0000", 2024-09-12T22:49:44.598 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8263000000000003e-05 2024-09-12T22:49:44.598 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.598 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.598 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:44.598 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.280420+0000", 2024-09-12T22:49:44.598 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8997000000000004e-05 2024-09-12T22:49:44.598 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.598 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.598 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:44.598 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.280492+0000", 2024-09-12T22:49:44.598 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1444000000000002e-05 2024-09-12T22:49:44.598 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.598 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.599 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:44.599 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.281313+0000", 2024-09-12T22:49:44.599 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00082160600000000001 2024-09-12T22:49:44.599 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.599 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.599 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:44.599 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.287738+0000", 2024-09-12T22:49:44.599 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0064246069999999997 2024-09-12T22:49:44.599 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.599 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.599 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:44.599 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.287762+0000", 2024-09-12T22:49:44.599 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4179e-05 2024-09-12T22:49:44.600 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.600 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.600 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:44.600 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.287793+0000", 2024-09-12T22:49:44.600 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0528999999999999e-05 2024-09-12T22:49:44.600 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.600 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:44.600 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.600 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.600 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.600 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4459.0:151 4.7 e50/17 4:e25a3370:::10000000290.00000000:head v 50'3, mlcod=50'1)", 2024-09-12T22:49:44.600 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.302310+0000", 2024-09-12T22:49:44.600 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.1919763850000002, 2024-09-12T22:49:44.601 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0077636090000000003, 2024-09-12T22:49:44.601 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:44.601 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:44.601 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:44.601 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:44.601 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.601 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:44.601 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302310+0000", 2024-09-12T22:49:44.601 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.601 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.601 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.601 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:44.601 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302310+0000", 2024-09-12T22:49:44.602 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.602 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:44.602 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302310+0000", 2024-09-12T22:49:44.602 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4000000000000001e-07 2024-09-12T22:49:44.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.602 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:44.602 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302336+0000", 2024-09-12T22:49:44.602 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5887000000000001e-05 2024-09-12T22:49:44.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.603 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:44.603 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302346+0000", 2024-09-12T22:49:44.603 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8679999999999994e-06 2024-09-12T22:49:44.603 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.603 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.603 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.603 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302351+0000", 2024-09-12T22:49:44.603 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7600000000000002e-06 2024-09-12T22:49:44.603 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.603 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.603 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:44.603 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302392+0000", 2024-09-12T22:49:44.603 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1124999999999997e-05 2024-09-12T22:49:44.604 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.604 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.604 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:44.604 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302411+0000", 2024-09-12T22:49:44.604 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9357000000000001e-05 2024-09-12T22:49:44.604 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.604 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.604 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:44.604 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.310029+0000", 2024-09-12T22:49:44.604 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0076178050000000001 2024-09-12T22:49:44.604 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.604 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.605 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:44.605 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.310073+0000", 2024-09-12T22:49:44.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4166999999999999e-05 2024-09-12T22:49:44.605 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.605 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:44.605 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.605 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.605 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.605 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:152 4.25 4:a61cbf99:::10000000291.00000000:head [write 0~111] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:44.605 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.302816+0000", 2024-09-12T22:49:44.605 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.191470528, 2024-09-12T22:49:44.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0073514330000000001, 2024-09-12T22:49:44.605 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:44.606 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:44.606 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:44.606 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:44.606 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:44.606 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:44.606 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 152 2024-09-12T22:49:44.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.606 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:44.606 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.606 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:44.606 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302816+0000", 2024-09-12T22:49:44.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.607 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.607 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:44.607 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302816+0000", 2024-09-12T22:49:44.607 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.607 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.607 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.607 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:44.607 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302817+0000", 2024-09-12T22:49:44.607 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8299999999999995e-07 2024-09-12T22:49:44.607 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.607 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.607 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:44.607 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302821+0000", 2024-09-12T22:49:44.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2629999999999997e-06 2024-09-12T22:49:44.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.608 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:44.608 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302832+0000", 2024-09-12T22:49:44.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0815000000000001e-05 2024-09-12T22:49:44.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.608 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.608 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302837+0000", 2024-09-12T22:49:44.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0590000000000002e-06 2024-09-12T22:49:44.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:44.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302884+0000", 2024-09-12T22:49:44.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7638e-05 2024-09-12T22:49:44.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:44.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302954+0000", 2024-09-12T22:49:44.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9380000000000003e-05 2024-09-12T22:49:44.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:44.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.310056+0000", 2024-09-12T22:49:44.610 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071018729999999999 2024-09-12T22:49:44.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.610 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.610 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:44.610 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.310098+0000", 2024-09-12T22:49:44.610 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2218000000000001e-05 2024-09-12T22:49:44.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.610 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.610 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:44.610 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.310167+0000", 2024-09-12T22:49:44.610 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9303999999999999e-05 2024-09-12T22:49:44.610 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.610 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:44.611 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.611 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.611 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.611 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:208 4.1c 4:3b628a21:::100000002c9.00000000:head [write 0~98] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:44.611 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.351805+0000", 2024-09-12T22:49:44.611 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.1424809199999997, 2024-09-12T22:49:44.611 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082360720000000005, 2024-09-12T22:49:44.611 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:44.611 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:44.611 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:44.611 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:44.611 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:44.612 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:44.612 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 208 2024-09-12T22:49:44.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.612 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:44.612 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.612 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:44.612 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.351805+0000", 2024-09-12T22:49:44.612 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.612 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.612 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:44.612 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.351805+0000", 2024-09-12T22:49:44.612 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:44.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:44.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.351806+0000", 2024-09-12T22:49:44.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9599999999999999e-07 2024-09-12T22:49:44.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:44.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.351809+0000", 2024-09-12T22:49:44.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7970000000000001e-06 2024-09-12T22:49:44.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:44.614 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.351816+0000", 2024-09-12T22:49:44.614 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8029999999999997e-06 2024-09-12T22:49:44.614 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.614 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.614 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.614 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.351820+0000", 2024-09-12T22:49:44.614 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2990000000000001e-06 2024-09-12T22:49:44.614 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.614 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.614 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:44.614 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.351882+0000", 2024-09-12T22:49:44.614 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2187999999999995e-05 2024-09-12T22:49:44.614 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.614 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.615 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:44.615 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.351986+0000", 2024-09-12T22:49:44.615 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000104387 2024-09-12T22:49:44.615 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.615 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.615 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:44.615 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.352107+0000", 2024-09-12T22:49:44.615 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000120384 2024-09-12T22:49:44.615 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.615 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.615 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:44.615 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.354089+0000", 2024-09-12T22:49:44.615 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001981961 2024-09-12T22:49:44.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.616 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:44.616 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.359962+0000", 2024-09-12T22:49:44.616 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0058737729999999997 2024-09-12T22:49:44.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.616 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:44.616 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.360007+0000", 2024-09-12T22:49:44.616 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4668e-05 2024-09-12T22:49:44.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:44.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:44.616 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:44.617 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.360041+0000", 2024-09-12T22:49:44.617 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4316000000000001e-05 2024-09-12T22:49:44.617 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.617 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:44.617 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.617 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:44.617 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:44.617 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:44.619 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:44.619 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:44.617+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:44.719 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:44.718+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:44.727 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:44.727 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:49:44.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.727 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:5079 4.3c 4:3fc3202c:::100000017b5.00000000:head [write 0~1476 in=1476b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:49:44.727 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:44.726137+0000", 2024-09-12T22:49:44.727 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.00064541900000000005, 2024-09-12T22:49:44.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000668532, 2024-09-12T22:49:44.727 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:44.728 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:44.728 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:44.728 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:44.728 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:44.728 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:44.728 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 5079 2024-09-12T22:49:44.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.728 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:44.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:44.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:44.726137+0000", 2024-09-12T22:49:44.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:44.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:44.726137+0000", 2024-09-12T22:49:44.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:44.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:44.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:44.726138+0000", 2024-09-12T22:49:44.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0599999999999999e-07 2024-09-12T22:49:44.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:44.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:44.726143+0000", 2024-09-12T22:49:44.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5000000000000001e-06 2024-09-12T22:49:44.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:44.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:44.726154+0000", 2024-09-12T22:49:44.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.166e-05 2024-09-12T22:49:44.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:44.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:44.726159+0000", 2024-09-12T22:49:44.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9479999999999999e-06 2024-09-12T22:49:44.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:44.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:44.726197+0000", 2024-09-12T22:49:44.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7305000000000003e-05 2024-09-12T22:49:44.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:44.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:44.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:44.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:44.726272+0000", 2024-09-12T22:49:44.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5667000000000006e-05 2024-09-12T22:49:44.731 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.731 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:44.731 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.731 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:44.731 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-12T22:49:44.731 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 1 2024-09-12T22:49:44.732 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:44.736 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:44.749 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:49:44.821 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:44.820+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:44.886 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:49:44.886 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:49:44.888 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:44.889 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:44.889 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:49:44.889 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:49:44.889 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:44.899 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:44.909 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:49:44.909 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:49:44.909 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:49:44.912 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:49:44.913 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:49:44.922 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:44.921+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:45.006 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:45.006 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:45.015 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:45.059 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:45.058+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:45.124 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:45.123+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:45.129 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:45.129 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:45.139 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:45.226 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:45.224+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:45.288 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:45.289 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:45.298 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:45.343 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:45.342+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:45.411 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:45.411 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:45.421 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:45.466 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:45.465+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:45.528 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:45.527+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:45.532 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:45.532 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:45.541 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:45.632 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:45.628+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:45.688 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:49:45.691 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:45.691 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:45.700 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:45.741 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:45.740+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:45.832 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:45.831+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:45.848 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:45.848 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:45.858 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:45.933 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:45.932+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:45.966 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:45.966 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:45.975 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:46.034 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:46.033+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:46.088 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:46.088 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:46.094 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:46.135 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:46.134+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:46.236 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:46.235+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:46.243 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:46.243 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:46.252 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:46.337 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:46.336+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:46.363 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:46.363 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:46.372 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:46.438 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:46.437+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:46.523 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:46.524 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:46.533 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:46.577 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:46.576+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:46.621 INFO:teuthology.orchestra.run.smithi066.stderr:noscrub is set 2024-09-12T22:49:46.639 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:46.638+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:46.640 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:46.641 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:46.650 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:46.741 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:46.740+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:46.759 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:46.759 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:46.768 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:46.853 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:46.852+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:46.914 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:49:46.920 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:46.920 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:46.931 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:46.972 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:46.971+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:47.044 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:47.043+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:47.054 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:49:47.055 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:49:47.074 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:49:47.074 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:49:47.074 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:49:47.077 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:49:47.078 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:49:47.083 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:47.083 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:49:47.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:49:47.083 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:49:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 101.916879256, 2024-09-12T22:49:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011096346999999999, 2024-09-12T22:49:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:47.085 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:47.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.085 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.085 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.085 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:47.085 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164210+0000", 2024-09-12T22:49:47.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.085 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.085 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.085 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:47.085 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164222+0000", 2024-09-12T22:49:47.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.154e-05 2024-09-12T22:49:47.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.086 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:47.086 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164230+0000", 2024-09-12T22:49:47.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:49:47.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.086 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:47.086 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164244+0000", 2024-09-12T22:49:47.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3653e-05 2024-09-12T22:49:47.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164272+0000", 2024-09-12T22:49:47.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8045999999999999e-05 2024-09-12T22:49:47.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7237000000000005e-05 2024-09-12T22:49:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1109999999999997e-06 2024-09-12T22:49:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165862+0000", 2024-09-12T22:49:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001493215 2024-09-12T22:49:47.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:47.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166008+0000", 2024-09-12T22:49:47.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014590499999999999 2024-09-12T22:49:47.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:47.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166151+0000", 2024-09-12T22:49:47.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014329699999999999 2024-09-12T22:49:47.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.090 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:47.090 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174257+0000", 2024-09-12T22:49:47.090 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081057460000000005 2024-09-12T22:49:47.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.090 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:47.090 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175154+0000", 2024-09-12T22:49:47.090 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000897027 2024-09-12T22:49:47.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.090 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175260+0000", 2024-09-12T22:49:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0001063 2024-09-12T22:49:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175307+0000", 2024-09-12T22:49:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6690999999999997e-05 2024-09-12T22:49:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 101.91677973900001, 2024-09-12T22:49:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011109773, 2024-09-12T22:49:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164310+0000", 2024-09-12T22:49:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164311+0000", 2024-09-12T22:49:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0400000000000005e-07 2024-09-12T22:49:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:47.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164316+0000", 2024-09-12T22:49:47.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-09-12T22:49:47.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:47.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164324+0000", 2024-09-12T22:49:47.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7320000000000004e-06 2024-09-12T22:49:47.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164342+0000", 2024-09-12T22:49:47.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7487e-05 2024-09-12T22:49:47.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.095 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:47.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164619+0000", 2024-09-12T22:49:47.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00027728600000000001 2024-09-12T22:49:47.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.095 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:47.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164645+0000", 2024-09-12T22:49:47.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5452e-05 2024-09-12T22:49:47.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166444+0000", 2024-09-12T22:49:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001799061 2024-09-12T22:49:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166493+0000", 2024-09-12T22:49:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9628e-05 2024-09-12T22:49:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:47.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166574+0000", 2024-09-12T22:49:47.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0629000000000003e-05 2024-09-12T22:49:47.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:47.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174894+0000", 2024-09-12T22:49:47.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.008319735 2024-09-12T22:49:47.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:47.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175322+0000", 2024-09-12T22:49:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042848099999999998 2024-09-12T22:49:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175383+0000", 2024-09-12T22:49:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1079000000000003e-05 2024-09-12T22:49:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175420+0000", 2024-09-12T22:49:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6356999999999998e-05 2024-09-12T22:49:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:47.099 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.099 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:47.099 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:47.099 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 101.916735, 2024-09-12T22:49:47.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011154763999999999, 2024-09-12T22:49:47.099 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:47.099 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:47.099 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:47.099 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:47.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:47.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:47.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:47.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164354+0000", 2024-09-12T22:49:47.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:47.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164355+0000", 2024-09-12T22:49:47.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:49:47.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:47.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164359+0000", 2024-09-12T22:49:47.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2479999999999998e-06 2024-09-12T22:49:47.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:47.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164368+0000", 2024-09-12T22:49:47.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6670000000000002e-06 2024-09-12T22:49:47.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.102 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164398+0000", 2024-09-12T22:49:47.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-09-12T22:49:47.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.102 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:47.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164692+0000", 2024-09-12T22:49:47.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000294813 2024-09-12T22:49:47.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.102 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:47.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164724+0000", 2024-09-12T22:49:47.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2129999999999999e-05 2024-09-12T22:49:47.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:47.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166747+0000", 2024-09-12T22:49:47.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020226860000000001 2024-09-12T22:49:47.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:47.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166825+0000", 2024-09-12T22:49:47.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8095000000000004e-05 2024-09-12T22:49:47.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.104 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:47.104 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166903+0000", 2024-09-12T22:49:47.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7642e-05 2024-09-12T22:49:47.104 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.104 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.104 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:47.104 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174414+0000", 2024-09-12T22:49:47.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075110039999999999 2024-09-12T22:49:47.104 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.104 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.104 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:47.104 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175431+0000", 2024-09-12T22:49:47.105 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010175570000000001 2024-09-12T22:49:47.105 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.105 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.105 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:47.105 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175470+0000", 2024-09-12T22:49:47.105 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8402000000000003e-05 2024-09-12T22:49:47.105 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.105 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.105 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:47.105 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175509+0000", 2024-09-12T22:49:47.105 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:49:47.105 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.109 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:47.109 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.109 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.109 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.109 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:47.110 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:47.110 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 101.916507299, 2024-09-12T22:49:47.110 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011008687, 2024-09-12T22:49:47.110 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:47.110 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:47.110 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:47.110 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:47.110 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.110 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:47.110 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:47.110 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.110 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.110 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.110 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:47.111 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164582+0000", 2024-09-12T22:49:47.111 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.111 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.111 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:47.111 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164583+0000", 2024-09-12T22:49:47.111 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2999999999999999e-07 2024-09-12T22:49:47.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.111 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.111 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:47.111 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164598+0000", 2024-09-12T22:49:47.111 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4983999999999999e-05 2024-09-12T22:49:47.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.112 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.112 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:47.112 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164634+0000", 2024-09-12T22:49:47.112 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:49:47.112 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.112 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.112 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.112 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164729+0000", 2024-09-12T22:49:47.112 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5236999999999996e-05 2024-09-12T22:49:47.112 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.112 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.112 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:47.113 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164794+0000", 2024-09-12T22:49:47.113 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4556999999999999e-05 2024-09-12T22:49:47.113 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.113 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.113 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:47.113 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164799+0000", 2024-09-12T22:49:47.113 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9280000000000001e-06 2024-09-12T22:49:47.113 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.113 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.113 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:47.113 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167154+0000", 2024-09-12T22:49:47.113 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023547590000000001 2024-09-12T22:49:47.114 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.114 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.114 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:47.114 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167197+0000", 2024-09-12T22:49:47.114 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3022999999999998e-05 2024-09-12T22:49:47.114 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.114 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.114 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:47.114 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.167273+0000", 2024-09-12T22:49:47.114 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6897000000000006e-05 2024-09-12T22:49:47.114 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.114 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.114 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:47.114 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175133+0000", 2024-09-12T22:49:47.115 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078597479999999997 2024-09-12T22:49:47.115 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.115 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.115 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:47.115 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175518+0000", 2024-09-12T22:49:47.115 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038433 2024-09-12T22:49:47.115 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.115 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.115 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:47.115 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175558+0000", 2024-09-12T22:49:47.115 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0467999999999999e-05 2024-09-12T22:49:47.115 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.115 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.116 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:47.116 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175591+0000", 2024-09-12T22:49:47.116 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2876000000000002e-05 2024-09-12T22:49:47.116 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.116 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:47.116 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.116 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.116 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.116 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:47.116 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:47.117 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 101.916342191, 2024-09-12T22:49:47.117 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010041244, 2024-09-12T22:49:47.117 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:47.117 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:47.117 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:47.117 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:47.117 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.117 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:47.117 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:47.117 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.117 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.117 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.117 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:47.117 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164747+0000", 2024-09-12T22:49:47.118 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.118 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:47.118 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164748+0000", 2024-09-12T22:49:47.118 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:49:47.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.118 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:47.118 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164753+0000", 2024-09-12T22:49:47.118 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.746e-06 2024-09-12T22:49:47.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.119 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:47.119 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164777+0000", 2024-09-12T22:49:47.119 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4204999999999999e-05 2024-09-12T22:49:47.119 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.119 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.119 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.119 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164783+0000", 2024-09-12T22:49:47.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:49:47.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.120 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.120 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:47.120 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164869+0000", 2024-09-12T22:49:47.121 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5782e-05 2024-09-12T22:49:47.121 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.121 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.121 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-09-12T22:49:47.121 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164882+0000", 2024-09-12T22:49:47.121 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:49:47.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:47.122 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166021+0000", 2024-09-12T22:49:47.122 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011388679999999999 2024-09-12T22:49:47.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.123 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:47.123 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166155+0000", 2024-09-12T22:49:47.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013401799999999999 2024-09-12T22:49:47.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.123 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:47.123 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166266+0000", 2024-09-12T22:49:47.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011102100000000001 2024-09-12T22:49:47.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:47.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174279+0000", 2024-09-12T22:49:47.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080137230000000004 2024-09-12T22:49:47.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.125 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:47.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174420+0000", 2024-09-12T22:49:47.125 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141073 2024-09-12T22:49:47.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.126 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:47.126 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174742+0000", 2024-09-12T22:49:47.126 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000321799 2024-09-12T22:49:47.126 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.126 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.126 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:47.127 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174789+0000", 2024-09-12T22:49:47.127 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6388999999999999e-05 2024-09-12T22:49:47.127 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.127 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:47.127 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.128 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:47.128 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:47.128 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 101.916280906, 2024-09-12T22:49:47.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010191957, 2024-09-12T22:49:47.129 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:47.129 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:47.129 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:47.129 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:47.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:47.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:47.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.131 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:47.131 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:47.131 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.131 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.131 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.132 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:47.132 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164809+0000", 2024-09-12T22:49:47.132 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:49:47.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:47.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164814+0000", 2024-09-12T22:49:47.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2069999999999997e-06 2024-09-12T22:49:47.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:47.134 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164822+0000", 2024-09-12T22:49:47.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5960000000000004e-06 2024-09-12T22:49:47.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.134 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164830+0000", 2024-09-12T22:49:47.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:49:47.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:47.136 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164922+0000", 2024-09-12T22:49:47.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1224999999999995e-05 2024-09-12T22:49:47.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.136 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:47.137 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164926+0000", 2024-09-12T22:49:47.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1790000000000001e-06 2024-09-12T22:49:47.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:47.137 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166457+0000", 2024-09-12T22:49:47.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00153166 2024-09-12T22:49:47.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:47.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166506+0000", 2024-09-12T22:49:47.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495999999999998e-05 2024-09-12T22:49:47.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:47.139 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166584+0000", 2024-09-12T22:49:47.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8429000000000004e-05 2024-09-12T22:49:47.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.140 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:47.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174797+0000", 2024-09-12T22:49:47.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082130740000000008 2024-09-12T22:49:47.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:47.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174844+0000", 2024-09-12T22:49:47.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6783000000000003e-05 2024-09-12T22:49:47.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:47.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174957+0000", 2024-09-12T22:49:47.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011233700000000001 2024-09-12T22:49:47.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:47.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175001+0000", 2024-09-12T22:49:47.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3928999999999999e-05 2024-09-12T22:49:47.143 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.144 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:47.144 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.144 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:47.145 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:47.145 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 101.91620079800001, 2024-09-12T22:49:47.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010791418000000001, 2024-09-12T22:49:47.145 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:47.145 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:47.145 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:47.146 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:47.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:47.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:47.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:47.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164889+0000", 2024-09-12T22:49:47.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:47.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164890+0000", 2024-09-12T22:49:47.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.083e-06 2024-09-12T22:49:47.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:47.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164897+0000", 2024-09-12T22:49:47.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9689999999999997e-06 2024-09-12T22:49:47.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:47.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164909+0000", 2024-09-12T22:49:47.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2500000000000001e-05 2024-09-12T22:49:47.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164917+0000", 2024-09-12T22:49:47.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.554e-06 2024-09-12T22:49:47.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:47.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164970+0000", 2024-09-12T22:49:47.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:49:47.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.152 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:49:47.152 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164974+0000", 2024-09-12T22:49:47.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1690000000000002e-06 2024-09-12T22:49:47.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.153 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:47.153 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166756+0000", 2024-09-12T22:49:47.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001782339 2024-09-12T22:49:47.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:47.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166832+0000", 2024-09-12T22:49:47.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6025000000000005e-05 2024-09-12T22:49:47.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:47.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.166919+0000", 2024-09-12T22:49:47.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6817999999999994e-05 2024-09-12T22:49:47.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:47.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175469+0000", 2024-09-12T22:49:47.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085500360000000004 2024-09-12T22:49:47.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:47.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175599+0000", 2024-09-12T22:49:47.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000129519 2024-09-12T22:49:47.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:47.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175646+0000", 2024-09-12T22:49:47.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6924e-05 2024-09-12T22:49:47.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:47.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.175680+0000", 2024-09-12T22:49:47.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4462999999999999e-05 2024-09-12T22:49:47.159 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.159 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:47.160 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.160 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:47.160 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:47.161 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 101.916151845, 2024-09-12T22:49:47.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094561799999999998, 2024-09-12T22:49:47.161 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:47.161 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:47.161 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:47.161 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:47.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:47.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:47.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.163 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:47.163 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:47.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:47.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164938+0000", 2024-09-12T22:49:47.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0299999999999998e-07 2024-09-12T22:49:47.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:47.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164942+0000", 2024-09-12T22:49:47.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7330000000000001e-06 2024-09-12T22:49:47.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:47.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164950+0000", 2024-09-12T22:49:47.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1300000000000001e-06 2024-09-12T22:49:47.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.167 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164958+0000", 2024-09-12T22:49:47.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6599999999999995e-06 2024-09-12T22:49:47.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.167 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:47.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165223+0000", 2024-09-12T22:49:47.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026472399999999998 2024-09-12T22:49:47.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:47.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165332+0000", 2024-09-12T22:49:47.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109478 2024-09-12T22:49:47.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:47.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.174394+0000", 2024-09-12T22:49:47.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090617519999999993 2024-09-12T22:49:47.170 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.170 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:47.170 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.171 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:47.171 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:47.171 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 101.916102745, 2024-09-12T22:49:47.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086374829999999996, 2024-09-12T22:49:47.171 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:47.172 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:47.172 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:47.172 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:47.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:47.173 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:47.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.173 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:47.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164987+0000", 2024-09-12T22:49:47.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:47.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164988+0000", 2024-09-12T22:49:47.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.322e-06 2024-09-12T22:49:47.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:47.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.164994+0000", 2024-09-12T22:49:47.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-09-12T22:49:47.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:47.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165006+0000", 2024-09-12T22:49:47.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2153999999999999e-05 2024-09-12T22:49:47.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.177 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.177 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.177 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165047+0000", 2024-09-12T22:49:47.178 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1520000000000002e-05 2024-09-12T22:49:47.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.178 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:47.178 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165114+0000", 2024-09-12T22:49:47.178 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6333000000000003e-05 2024-09-12T22:49:47.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:47.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.165213+0000", 2024-09-12T22:49:47.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9565e-05 2024-09-12T22:49:47.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:47.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:48:05.173624+0000", 2024-09-12T22:49:47.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084109590000000008 2024-09-12T22:49:47.180 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.181 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:47.181 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.181 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:47.182 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.082046+0000", 2024-09-12T22:49:47.182 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 7.9990437889999999, 2024-09-12T22:49:47.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012182124000000001, 2024-09-12T22:49:47.182 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:47.182 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:47.182 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:47.183 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:47.183 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:47.183 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:47.183 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 4 2024-09-12T22:49:47.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.183 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:47.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:47.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.082046+0000", 2024-09-12T22:49:47.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:47.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.082046+0000", 2024-09-12T22:49:47.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:47.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.082048+0000", 2024-09-12T22:49:47.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5969999999999999e-06 2024-09-12T22:49:47.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:47.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.087738+0000", 2024-09-12T22:49:47.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0056892499999999999 2024-09-12T22:49:47.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:47.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.087782+0000", 2024-09-12T22:49:47.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4267999999999997e-05 2024-09-12T22:49:47.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.087795+0000", 2024-09-12T22:49:47.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3560000000000001e-05 2024-09-12T22:49:47.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:47.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.087897+0000", 2024-09-12T22:49:47.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000102098 2024-09-12T22:49:47.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:47.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.087992+0000", 2024-09-12T22:49:47.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4407000000000006e-05 2024-09-12T22:49:47.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:47.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.094121+0000", 2024-09-12T22:49:47.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0061287340000000003 2024-09-12T22:49:47.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:47.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.094164+0000", 2024-09-12T22:49:47.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3269000000000002e-05 2024-09-12T22:49:47.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:47.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.094228+0000", 2024-09-12T22:49:47.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3941000000000003e-05 2024-09-12T22:49:47.188 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.188 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:47.188 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.188 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:47.188 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.159925+0000", 2024-09-12T22:49:47.188 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 7.9211648500000003, 2024-09-12T22:49:47.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0099924560000000003, 2024-09-12T22:49:47.189 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:47.189 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:47.189 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:47.189 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:47.189 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:47.189 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:47.189 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 6 2024-09-12T22:49:47.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.189 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:47.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:47.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.159925+0000", 2024-09-12T22:49:47.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:47.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.159925+0000", 2024-09-12T22:49:47.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:47.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.159926+0000", 2024-09-12T22:49:47.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4890000000000001e-06 2024-09-12T22:49:47.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:47.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.163620+0000", 2024-09-12T22:49:47.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003694021 2024-09-12T22:49:47.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:47.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.163635+0000", 2024-09-12T22:49:47.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4732999999999999e-05 2024-09-12T22:49:47.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.163643+0000", 2024-09-12T22:49:47.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7209999999999994e-06 2024-09-12T22:49:47.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:47.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.163725+0000", 2024-09-12T22:49:47.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2263999999999997e-05 2024-09-12T22:49:47.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:47.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.163866+0000", 2024-09-12T22:49:47.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014159200000000001 2024-09-12T22:49:47.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:47.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.169766+0000", 2024-09-12T22:49:47.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0058992109999999997 2024-09-12T22:49:47.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.193 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:47.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.169817+0000", 2024-09-12T22:49:47.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1115000000000001e-05 2024-09-12T22:49:47.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.193 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:47.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.169917+0000", 2024-09-12T22:49:47.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010030999999999999 2024-09-12T22:49:47.193 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.193 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:47.193 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.193 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4459.0:5 4.10 e50/17 4:09a4c37f:::10000000003.00000001:head v 50'1, mlcod=0'0)", 2024-09-12T22:49:47.194 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.167838+0000", 2024-09-12T22:49:47.194 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 7.9132516600000002, 2024-09-12T22:49:47.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011071799, 2024-09-12T22:49:47.194 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:47.194 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:47.194 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:47.194 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:47.194 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.194 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:47.194 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.167838+0000", 2024-09-12T22:49:47.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.194 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:47.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.167838+0000", 2024-09-12T22:49:47.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:47.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.167839+0000", 2024-09-12T22:49:47.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5600000000000004e-07 2024-09-12T22:49:47.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:47.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.172178+0000", 2024-09-12T22:49:47.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043395860000000003 2024-09-12T22:49:47.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:47.196 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.172192+0000", 2024-09-12T22:49:47.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3451999999999999e-05 2024-09-12T22:49:47.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.196 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.172205+0000", 2024-09-12T22:49:47.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2853e-05 2024-09-12T22:49:47.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:47.196 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.172281+0000", 2024-09-12T22:49:47.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6093000000000005e-05 2024-09-12T22:49:47.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.197 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:47.197 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.172301+0000", 2024-09-12T22:49:47.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0276e-05 2024-09-12T22:49:47.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.197 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:47.197 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.178879+0000", 2024-09-12T22:49:47.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0065783539999999998 2024-09-12T22:49:47.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.197 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:47.197 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.178910+0000", 2024-09-12T22:49:47.198 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0329e-05 2024-09-12T22:49:47.198 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.198 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:47.198 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.198 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:57 4.9 4:91e366d7:::10000000230.00000000:head [write 0~1966] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:47.198 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.216970+0000", 2024-09-12T22:49:47.198 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 7.8641198860000001, 2024-09-12T22:49:47.198 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082673929999999996, 2024-09-12T22:49:47.198 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:47.198 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:47.198 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:47.198 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:47.198 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:47.199 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:47.199 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 57 2024-09-12T22:49:47.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.199 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:47.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:47.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.216970+0000", 2024-09-12T22:49:47.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:47.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.216970+0000", 2024-09-12T22:49:47.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:47.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.216970+0000", 2024-09-12T22:49:47.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:49:47.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:47.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.216977+0000", 2024-09-12T22:49:47.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1999999999999997e-06 2024-09-12T22:49:47.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:47.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.216985+0000", 2024-09-12T22:49:47.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.909e-06 2024-09-12T22:49:47.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.216991+0000", 2024-09-12T22:49:47.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4260000000000002e-06 2024-09-12T22:49:47.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:47.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.217025+0000", 2024-09-12T22:49:47.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4591999999999997e-05 2024-09-12T22:49:47.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:47.202 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.217089+0000", 2024-09-12T22:49:47.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3226999999999996e-05 2024-09-12T22:49:47.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.202 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:47.202 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.217152+0000", 2024-09-12T22:49:47.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3089999999999994e-05 2024-09-12T22:49:47.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.202 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:47.202 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.217745+0000", 2024-09-12T22:49:47.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00059294899999999995 2024-09-12T22:49:47.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.203 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:47.203 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.225195+0000", 2024-09-12T22:49:47.203 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.007450623 2024-09-12T22:49:47.203 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.203 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.203 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:47.203 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.225219+0000", 2024-09-12T22:49:47.203 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3773000000000001e-05 2024-09-12T22:49:47.203 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.203 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.203 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:47.203 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.225237+0000", 2024-09-12T22:49:47.203 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7927999999999998e-05 2024-09-12T22:49:47.203 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.204 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:47.204 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.204 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.204 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:75 4.2e 4:7528f44f:::10000000242.00000000:head [write 0~1151] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:47.204 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.232047+0000", 2024-09-12T22:49:47.204 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 7.8490422100000004, 2024-09-12T22:49:47.204 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082051009999999994, 2024-09-12T22:49:47.204 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:47.204 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:47.204 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:47.204 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:47.204 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:47.205 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:47.205 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 75 2024-09-12T22:49:47.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.205 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:47.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:47.205 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232047+0000", 2024-09-12T22:49:47.205 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:47.205 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232047+0000", 2024-09-12T22:49:47.205 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.206 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:47.206 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232048+0000", 2024-09-12T22:49:47.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6700000000000003e-07 2024-09-12T22:49:47.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.206 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:47.206 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232052+0000", 2024-09-12T22:49:47.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1139999999999999e-06 2024-09-12T22:49:47.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.206 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:47.206 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232063+0000", 2024-09-12T22:49:47.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0781000000000001e-05 2024-09-12T22:49:47.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.207 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.207 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.207 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232068+0000", 2024-09-12T22:49:47.207 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0579999999999997e-06 2024-09-12T22:49:47.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.207 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.207 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:47.207 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232102+0000", 2024-09-12T22:49:47.207 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3976000000000001e-05 2024-09-12T22:49:47.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.207 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.207 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:47.207 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232174+0000", 2024-09-12T22:49:47.208 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2254000000000003e-05 2024-09-12T22:49:47.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.208 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:47.208 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232245+0000", 2024-09-12T22:49:47.208 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0597000000000002e-05 2024-09-12T22:49:47.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.208 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:47.208 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.233156+0000", 2024-09-12T22:49:47.208 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00091127799999999996 2024-09-12T22:49:47.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.208 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:47.209 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.240194+0000", 2024-09-12T22:49:47.209 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0070376140000000002 2024-09-12T22:49:47.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.209 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.209 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:47.209 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.240228+0000", 2024-09-12T22:49:47.209 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4347999999999997e-05 2024-09-12T22:49:47.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.209 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.209 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:47.209 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.240252+0000", 2024-09-12T22:49:47.209 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4314000000000001e-05 2024-09-12T22:49:47.209 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.209 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:47.210 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.210 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.210 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.210 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:76 4.25 4:a7ae8a0f:::10000000243.00000000:head [write 0~1194] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:47.210 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.232867+0000", 2024-09-12T22:49:47.210 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 7.8482221599999997, 2024-09-12T22:49:47.210 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074145970000000002, 2024-09-12T22:49:47.210 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:47.210 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:47.210 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:47.210 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:47.210 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:47.210 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:47.210 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 76 2024-09-12T22:49:47.211 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.211 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:47.211 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.211 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:47.211 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232867+0000", 2024-09-12T22:49:47.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.211 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.211 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.211 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:47.211 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232867+0000", 2024-09-12T22:49:47.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.211 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.211 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.211 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:47.212 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232868+0000", 2024-09-12T22:49:47.212 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6000000000000003e-07 2024-09-12T22:49:47.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.212 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.212 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:47.212 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232877+0000", 2024-09-12T22:49:47.212 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5140000000000001e-06 2024-09-12T22:49:47.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.212 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.212 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:47.212 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232888+0000", 2024-09-12T22:49:47.212 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0927999999999999e-05 2024-09-12T22:49:47.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.212 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.213 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.213 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232892+0000", 2024-09-12T22:49:47.213 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8999999999999997e-06 2024-09-12T22:49:47.213 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.213 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.213 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:47.213 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.232936+0000", 2024-09-12T22:49:47.213 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3779000000000002e-05 2024-09-12T22:49:47.213 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.213 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.213 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:47.213 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.233005+0000", 2024-09-12T22:49:47.213 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8685999999999999e-05 2024-09-12T22:49:47.213 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.214 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:47.214 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.240176+0000", 2024-09-12T22:49:47.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071707070000000001 2024-09-12T22:49:47.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.214 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:47.214 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.240232+0000", 2024-09-12T22:49:47.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6493000000000003e-05 2024-09-12T22:49:47.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.214 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:47.214 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.240282+0000", 2024-09-12T22:49:47.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9830000000000002e-05 2024-09-12T22:49:47.215 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.215 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:47.215 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.215 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:127 4.3 4:c2ce25ce:::10000000277.00000000:head [write 0~111] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:47.215 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.279463+0000", 2024-09-12T22:49:47.215 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 7.8016261169999996, 2024-09-12T22:49:47.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0083277809999999994, 2024-09-12T22:49:47.215 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:47.215 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:47.215 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:47.215 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:47.216 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:47.216 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:47.216 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 127 2024-09-12T22:49:47.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.216 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:47.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:47.216 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.279463+0000", 2024-09-12T22:49:47.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:47.216 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.279463+0000", 2024-09-12T22:49:47.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.217 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.217 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.217 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:47.217 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.279464+0000", 2024-09-12T22:49:47.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4899999999999995e-07 2024-09-12T22:49:47.217 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.217 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.217 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:47.217 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.279468+0000", 2024-09-12T22:49:47.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6720000000000002e-06 2024-09-12T22:49:47.217 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.217 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.217 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:47.217 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.279475+0000", 2024-09-12T22:49:47.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3180000000000001e-06 2024-09-12T22:49:47.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.218 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.279480+0000", 2024-09-12T22:49:47.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2599999999999996e-06 2024-09-12T22:49:47.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:47.218 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.279519+0000", 2024-09-12T22:49:47.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8549e-05 2024-09-12T22:49:47.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:47.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.279577+0000", 2024-09-12T22:49:47.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7812999999999997e-05 2024-09-12T22:49:47.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:47.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.287689+0000", 2024-09-12T22:49:47.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081127490000000007 2024-09-12T22:49:47.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:47.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.287730+0000", 2024-09-12T22:49:47.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1044000000000002e-05 2024-09-12T22:49:47.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.220 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:47.220 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.287791+0000", 2024-09-12T22:49:47.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0826999999999999e-05 2024-09-12T22:49:47.220 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.220 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:47.220 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.220 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:128 4.2e 4:74579a32:::10000000278.00000000:head [write 0~111] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:47.220 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.280292+0000", 2024-09-12T22:49:47.220 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 7.8007972319999999, 2024-09-12T22:49:47.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075002829999999999, 2024-09-12T22:49:47.220 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:47.220 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:47.221 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:47.221 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:47.221 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:47.221 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:47.221 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 128 2024-09-12T22:49:47.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.221 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:47.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.221 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:47.221 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.280292+0000", 2024-09-12T22:49:47.221 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.221 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:47.222 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.280292+0000", 2024-09-12T22:49:47.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.222 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:47.222 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.280293+0000", 2024-09-12T22:49:47.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7199999999999998e-07 2024-09-12T22:49:47.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.222 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:47.222 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.280297+0000", 2024-09-12T22:49:47.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0239999999999999e-06 2024-09-12T22:49:47.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:47.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.280308+0000", 2024-09-12T22:49:47.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0855e-05 2024-09-12T22:49:47.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.280313+0000", 2024-09-12T22:49:47.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0069999999999997e-06 2024-09-12T22:49:47.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:47.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.280351+0000", 2024-09-12T22:49:47.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8263000000000003e-05 2024-09-12T22:49:47.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:47.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.280420+0000", 2024-09-12T22:49:47.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8997000000000004e-05 2024-09-12T22:49:47.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:47.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.280492+0000", 2024-09-12T22:49:47.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1444000000000002e-05 2024-09-12T22:49:47.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:47.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.281313+0000", 2024-09-12T22:49:47.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00082160600000000001 2024-09-12T22:49:47.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.225 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.225 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:47.225 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.287738+0000", 2024-09-12T22:49:47.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0064246069999999997 2024-09-12T22:49:47.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.225 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.225 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:47.225 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.287762+0000", 2024-09-12T22:49:47.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4179e-05 2024-09-12T22:49:47.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.225 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.225 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:47.225 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.287793+0000", 2024-09-12T22:49:47.226 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0528999999999999e-05 2024-09-12T22:49:47.226 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.226 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:47.226 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.226 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.226 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.226 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4459.0:151 4.7 e50/17 4:e25a3370:::10000000290.00000000:head v 50'3, mlcod=50'1)", 2024-09-12T22:49:47.226 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.302310+0000", 2024-09-12T22:49:47.226 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 7.7787797010000004, 2024-09-12T22:49:47.226 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0077636090000000003, 2024-09-12T22:49:47.226 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:47.226 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:47.226 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:47.226 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:47.227 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.227 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:47.227 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302310+0000", 2024-09-12T22:49:47.227 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.227 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.227 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.227 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:47.227 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302310+0000", 2024-09-12T22:49:47.227 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.227 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.227 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.227 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:47.227 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302310+0000", 2024-09-12T22:49:47.227 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4000000000000001e-07 2024-09-12T22:49:47.228 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.228 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.228 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:47.228 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302336+0000", 2024-09-12T22:49:47.228 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5887000000000001e-05 2024-09-12T22:49:47.228 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.228 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.228 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:47.228 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302346+0000", 2024-09-12T22:49:47.228 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8679999999999994e-06 2024-09-12T22:49:47.228 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.228 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.228 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.229 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302351+0000", 2024-09-12T22:49:47.229 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7600000000000002e-06 2024-09-12T22:49:47.229 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.229 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.229 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:47.229 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302392+0000", 2024-09-12T22:49:47.229 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1124999999999997e-05 2024-09-12T22:49:47.229 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.229 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.229 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:47.229 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302411+0000", 2024-09-12T22:49:47.229 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9357000000000001e-05 2024-09-12T22:49:47.229 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.229 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.230 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:47.230 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.310029+0000", 2024-09-12T22:49:47.230 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0076178050000000001 2024-09-12T22:49:47.230 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.230 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.230 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:47.230 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.310073+0000", 2024-09-12T22:49:47.230 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4166999999999999e-05 2024-09-12T22:49:47.230 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.230 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:47.230 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.230 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.230 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.230 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:152 4.25 4:a61cbf99:::10000000291.00000000:head [write 0~111] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:47.231 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.302816+0000", 2024-09-12T22:49:47.231 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 7.7782738440000001, 2024-09-12T22:49:47.231 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0073514330000000001, 2024-09-12T22:49:47.231 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:47.231 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:47.231 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:47.231 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:47.231 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:47.231 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:47.231 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 152 2024-09-12T22:49:47.231 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.231 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:47.231 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.231 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:47.232 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302816+0000", 2024-09-12T22:49:47.232 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.232 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.232 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.232 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:47.232 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302816+0000", 2024-09-12T22:49:47.232 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.232 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.232 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.232 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:47.232 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302817+0000", 2024-09-12T22:49:47.232 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8299999999999995e-07 2024-09-12T22:49:47.232 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.233 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.233 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:47.233 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302821+0000", 2024-09-12T22:49:47.233 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2629999999999997e-06 2024-09-12T22:49:47.233 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.233 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.233 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:47.233 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302832+0000", 2024-09-12T22:49:47.233 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0815000000000001e-05 2024-09-12T22:49:47.233 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.233 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.233 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.233 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302837+0000", 2024-09-12T22:49:47.233 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0590000000000002e-06 2024-09-12T22:49:47.234 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.234 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.234 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:47.234 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302884+0000", 2024-09-12T22:49:47.234 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7638e-05 2024-09-12T22:49:47.234 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.234 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.234 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:47.234 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.302954+0000", 2024-09-12T22:49:47.234 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9380000000000003e-05 2024-09-12T22:49:47.234 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.234 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.234 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:47.234 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.310056+0000", 2024-09-12T22:49:47.235 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071018729999999999 2024-09-12T22:49:47.235 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.235 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.235 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:47.235 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.310098+0000", 2024-09-12T22:49:47.235 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2218000000000001e-05 2024-09-12T22:49:47.235 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.235 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.235 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:47.235 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.310167+0000", 2024-09-12T22:49:47.235 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9303999999999999e-05 2024-09-12T22:49:47.235 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.235 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:47.235 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.236 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.236 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.236 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:208 4.1c 4:3b628a21:::100000002c9.00000000:head [write 0~98] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:47.236 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:39.351805+0000", 2024-09-12T22:49:47.236 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 7.7292842359999998, 2024-09-12T22:49:47.236 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082360720000000005, 2024-09-12T22:49:47.236 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:47.236 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:47.236 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:47.236 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:47.236 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:47.236 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:47.236 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 208 2024-09-12T22:49:47.237 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.237 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:47.237 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.237 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:47.237 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.351805+0000", 2024-09-12T22:49:47.237 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.237 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.237 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.237 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:47.237 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.351805+0000", 2024-09-12T22:49:47.237 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.237 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.237 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.237 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:47.238 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.351806+0000", 2024-09-12T22:49:47.238 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9599999999999999e-07 2024-09-12T22:49:47.238 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.238 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.238 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:47.238 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.351809+0000", 2024-09-12T22:49:47.238 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7970000000000001e-06 2024-09-12T22:49:47.238 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.238 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.238 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:47.238 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.351816+0000", 2024-09-12T22:49:47.238 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8029999999999997e-06 2024-09-12T22:49:47.238 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.238 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.239 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.239 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.351820+0000", 2024-09-12T22:49:47.239 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2990000000000001e-06 2024-09-12T22:49:47.239 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.239 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.239 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:47.239 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.351882+0000", 2024-09-12T22:49:47.239 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2187999999999995e-05 2024-09-12T22:49:47.239 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.239 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.239 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:47.239 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.351986+0000", 2024-09-12T22:49:47.239 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000104387 2024-09-12T22:49:47.239 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.239 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.240 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:47.240 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.352107+0000", 2024-09-12T22:49:47.240 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000120384 2024-09-12T22:49:47.240 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.240 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.240 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:47.240 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.354089+0000", 2024-09-12T22:49:47.240 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001981961 2024-09-12T22:49:47.240 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.240 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.240 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:47.240 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.359962+0000", 2024-09-12T22:49:47.240 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0058737729999999997 2024-09-12T22:49:47.240 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.241 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.241 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:47.241 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.360007+0000", 2024-09-12T22:49:47.241 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4668e-05 2024-09-12T22:49:47.241 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.241 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.241 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:47.241 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:39.360041+0000", 2024-09-12T22:49:47.241 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4316000000000001e-05 2024-09-12T22:49:47.241 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.241 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:47.241 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.241 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.242 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:47.242 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:47.243 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:47.244 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:47.242+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:47.344 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:47.343+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:47.351 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:47.351 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:49:47.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.351 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:7417 4.f 4:f393c583:::100000021d8.00000000:head [write 0~360 in=360b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:49:47.351 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:47.349828+0000", 2024-09-12T22:49:47.352 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.00069858400000000003, 2024-09-12T22:49:47.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00071420299999999995, 2024-09-12T22:49:47.352 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:47.352 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:47.352 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:49:47.352 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:47.353 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:47.353 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:47.353 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 7417 2024-09-12T22:49:47.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.353 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:47.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:47.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.349828+0000", 2024-09-12T22:49:47.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:47.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.349828+0000", 2024-09-12T22:49:47.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:47.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.349830+0000", 2024-09-12T22:49:47.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.111e-06 2024-09-12T22:49:47.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:47.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.349835+0000", 2024-09-12T22:49:47.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1699999999999996e-06 2024-09-12T22:49:47.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:47.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.349848+0000", 2024-09-12T22:49:47.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3647e-05 2024-09-12T22:49:47.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.349856+0000", 2024-09-12T22:49:47.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3579999999999997e-06 2024-09-12T22:49:47.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:47.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.349915+0000", 2024-09-12T22:49:47.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8933e-05 2024-09-12T22:49:47.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:47.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.350028+0000", 2024-09-12T22:49:47.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113408 2024-09-12T22:49:47.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:47.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.350109+0000", 2024-09-12T22:49:47.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1326e-05 2024-09-12T22:49:47.360 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.360 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:47.360 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.360 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.361 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-12T22:49:47.361 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 1 2024-09-12T22:49:47.361 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:47.363 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:47.447 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:47.446+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:47.513 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:47.513 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:47.513 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:49:47.513 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:49:47.513 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:47.522 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:47.545 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:47.544+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:47.645 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:47.644+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:47.674 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:47.674 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:49:47.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:49:47.674 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:49:47.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.674 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:47.674 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:47.674 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 102.501308021, 2024-09-12T22:49:47.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:49:47.674 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:47.675 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:47.675 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:47.675 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:47.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:47.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:47.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:47.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:47.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:47.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:49:47.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:49:47.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:47.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:49:47.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:49:47.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:47.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:49:47.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:49:47.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:49:47.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:49:47.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:47.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:49:47.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:49:47.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:47.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:49:47.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:49:47.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:47.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:49:47.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:49:47.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:47.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:49:47.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:49:47.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:47.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:49:47.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:49:47.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:47.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:49:47.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:49:47.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:47.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:49:47.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:49:47.680 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.680 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:47.680 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.681 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:47.681 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:47.681 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 102.501236363, 2024-09-12T22:49:47.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:49:47.681 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:47.682 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:47.682 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:47.682 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:47.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:47.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:47.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:47.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:47.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:47.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:49:47.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:49:47.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:47.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:49:47.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:49:47.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:47.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:49:47.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:49:47.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:49:47.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:49:47.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:47.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:49:47.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:49:47.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:47.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:49:47.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:49:47.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:47.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:49:47.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:49:47.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:47.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:49:47.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:49:47.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:47.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:49:47.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:49:47.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:47.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:49:47.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:49:47.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:47.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:49:47.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:49:47.687 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.687 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:47.687 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.687 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:47.687 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:47.688 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 102.501193645, 2024-09-12T22:49:47.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:49:47.688 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:47.688 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:47.688 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:47.688 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:47.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:47.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:47.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:47.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:47.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:47.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:49:47.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:49:47.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:47.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:49:47.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:49:47.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:47.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:49:47.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:49:47.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:49:47.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:49:47.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:47.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:49:47.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:49:47.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:47.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:49:47.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:49:47.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:47.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:49:47.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:49:47.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:47.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:49:47.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:49:47.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:47.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:49:47.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:49:47.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:47.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:49:47.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:49:47.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:47.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:49:47.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:49:47.693 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.693 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:47.693 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.694 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:47.694 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:47.694 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 102.501155728, 2024-09-12T22:49:47.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:49:47.694 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:47.694 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:47.694 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:47.694 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:47.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:47.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:47.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:47.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:47.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:47.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:49:47.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:49:47.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:47.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:49:47.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:49:47.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:47.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:49:47.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:49:47.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:49:47.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:49:47.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:47.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:49:47.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:49:47.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:47.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:49:47.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:49:47.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:47.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:47.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:49:47.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:47.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:49:47.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:49:47.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:47.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:49:47.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:49:47.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:47.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:49:47.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:49:47.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:47.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:49:47.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:49:47.699 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.700 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:47.700 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.700 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:47.700 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:47.700 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 102.501132277, 2024-09-12T22:49:47.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:49:47.700 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:47.700 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:47.700 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:47.700 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:47.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:47.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:47.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:47.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:47.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:47.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:49:47.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:49:47.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:47.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:49:47.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:49:47.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:47.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:49:47.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:49:47.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:49:47.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:49:47.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:47.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:49:47.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:49:47.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:47.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:49:47.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:49:47.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:47.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:47.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:49:47.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:47.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:49:47.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:49:47.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:47.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:49:47.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:49:47.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:47.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:49:47.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:49:47.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:47.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:49:47.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:49:47.705 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.705 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:47.706 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.706 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:47.706 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:47.706 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 102.50108012299999, 2024-09-12T22:49:47.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:49:47.706 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:47.706 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:47.706 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:47.706 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:47.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:47.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:47.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:47.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:47.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:47.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:47.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:49:47.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:47.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:49:47.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:49:47.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:47.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:49:47.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:49:47.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:49:47.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:49:47.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:47.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:49:47.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:49:47.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:47.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:49:47.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:49:47.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:47.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:49:47.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:49:47.710 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.710 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:47.710 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.710 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:47.710 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:47.710 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 102.501005628, 2024-09-12T22:49:47.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:49:47.711 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:47.711 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:47.711 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:47.711 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:47.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:47.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:47.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:47.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:47.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:47.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:49:47.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:49:47.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:47.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:49:47.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:49:47.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:47.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:49:47.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:49:47.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:49:47.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:49:47.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:47.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:49:47.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:49:47.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:47.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:49:47.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:49:47.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:47.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:49:47.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:49:47.714 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.714 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:47.714 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.715 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:47.715 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:47.715 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 102.5009596, 2024-09-12T22:49:47.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:49:47.715 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:47.715 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:47.715 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:47.715 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:47.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:47.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:47.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:47.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:47.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:47.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:49:47.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:49:47.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:47.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:49:47.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:49:47.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:47.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:49:47.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:49:47.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:49:47.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:49:47.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:47.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:49:47.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:49:47.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:47.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:49:47.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:49:47.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:47.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:49:47.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:49:47.719 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.719 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:47.719 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.719 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:47.719 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.160867+0000", 2024-09-12T22:49:47.719 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.5109764279999993, 2024-09-12T22:49:47.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018225736999999999, 2024-09-12T22:49:47.719 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:47.719 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:47.719 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:47.720 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:47.720 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:47.720 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:47.720 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 5 2024-09-12T22:49:47.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.720 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:47.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:47.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.160867+0000", 2024-09-12T22:49:47.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:47.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.160867+0000", 2024-09-12T22:49:47.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:47.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.160869+0000", 2024-09-12T22:49:47.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1500000000000002e-06 2024-09-12T22:49:47.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:47.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.167303+0000", 2024-09-12T22:49:47.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0064335690000000001 2024-09-12T22:49:47.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:47.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.167320+0000", 2024-09-12T22:49:47.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7329e-05 2024-09-12T22:49:47.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.167329+0000", 2024-09-12T22:49:47.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4069999999999993e-06 2024-09-12T22:49:47.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:47.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.167402+0000", 2024-09-12T22:49:47.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3184999999999998e-05 2024-09-12T22:49:47.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:47.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.167550+0000", 2024-09-12T22:49:47.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014852499999999999 2024-09-12T22:49:47.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:47.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.167689+0000", 2024-09-12T22:49:47.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013904799999999999 2024-09-12T22:49:47.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:47.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.176328+0000", 2024-09-12T22:49:47.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0086384979999999997 2024-09-12T22:49:47.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:47.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.179037+0000", 2024-09-12T22:49:47.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027092599999999998 2024-09-12T22:49:47.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:47.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.179066+0000", 2024-09-12T22:49:47.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9132000000000002e-05 2024-09-12T22:49:47.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:47.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.179093+0000", 2024-09-12T22:49:47.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6633999999999999e-05 2024-09-12T22:49:47.725 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.725 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:47.725 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.726 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:57 4.9 e50/17 4:91e366d7:::10000000230.00000000:head v 50'1, mlcod=0'0)", 2024-09-12T22:49:47.726 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.217245+0000", 2024-09-12T22:49:47.726 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.4545986929999994, 2024-09-12T22:49:47.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078517689999999998, 2024-09-12T22:49:47.726 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:47.726 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:47.726 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:47.726 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:47.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:47.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217245+0000", 2024-09-12T22:49:47.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:47.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217245+0000", 2024-09-12T22:49:47.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:47.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217246+0000", 2024-09-12T22:49:47.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5199999999999996e-07 2024-09-12T22:49:47.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:47.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217253+0000", 2024-09-12T22:49:47.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1330000000000001e-06 2024-09-12T22:49:47.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:47.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217261+0000", 2024-09-12T22:49:47.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4500000000000004e-06 2024-09-12T22:49:47.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217267+0000", 2024-09-12T22:49:47.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-06 2024-09-12T22:49:47.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:47.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217309+0000", 2024-09-12T22:49:47.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1535000000000001e-05 2024-09-12T22:49:47.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:47.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217325+0000", 2024-09-12T22:49:47.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6208000000000001e-05 2024-09-12T22:49:47.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:47.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.225071+0000", 2024-09-12T22:49:47.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077461470000000001 2024-09-12T22:49:47.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:47.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.225097+0000", 2024-09-12T22:49:47.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5384e-05 2024-09-12T22:49:47.730 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.730 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:47.730 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.730 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:144 4.20 4:069ea127:::10000000289.00000000:head [write 0~1223] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:47.730 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.294752+0000", 2024-09-12T22:49:47.730 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.3770912200000005, 2024-09-12T22:49:47.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083421970000000008, 2024-09-12T22:49:47.731 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:47.731 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:47.731 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:47.731 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:47.731 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:47.731 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:47.731 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 144 2024-09-12T22:49:47.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.731 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:47.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:47.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294752+0000", 2024-09-12T22:49:47.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:47.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294752+0000", 2024-09-12T22:49:47.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:47.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294753+0000", 2024-09-12T22:49:47.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.37e-07 2024-09-12T22:49:47.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:47.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294757+0000", 2024-09-12T22:49:47.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.811e-06 2024-09-12T22:49:47.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:47.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294765+0000", 2024-09-12T22:49:47.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0390000000000005e-06 2024-09-12T22:49:47.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294771+0000", 2024-09-12T22:49:47.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2689999999999996e-06 2024-09-12T22:49:47.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:47.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294816+0000", 2024-09-12T22:49:47.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5046000000000002e-05 2024-09-12T22:49:47.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:47.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294887+0000", 2024-09-12T22:49:47.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0609000000000001e-05 2024-09-12T22:49:47.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:47.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.302989+0000", 2024-09-12T22:49:47.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081019409999999997 2024-09-12T22:49:47.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:47.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.303033+0000", 2024-09-12T22:49:47.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4190999999999998e-05 2024-09-12T22:49:47.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:47.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.303095+0000", 2024-09-12T22:49:47.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1654000000000003e-05 2024-09-12T22:49:47.736 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.736 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:47.736 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.736 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:150 4.a 4:53071690:::1000000028f.00000000:head [write 0~111] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:47.736 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.301030+0000", 2024-09-12T22:49:47.736 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.3708139300000006, 2024-09-12T22:49:47.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077464659999999996, 2024-09-12T22:49:47.736 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:47.736 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:47.736 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:47.736 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:47.737 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:47.737 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:47.737 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 150 2024-09-12T22:49:47.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.737 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:47.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:47.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301030+0000", 2024-09-12T22:49:47.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:47.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301030+0000", 2024-09-12T22:49:47.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:47.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301031+0000", 2024-09-12T22:49:47.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.13e-06 2024-09-12T22:49:47.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:47.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301036+0000", 2024-09-12T22:49:47.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3519999999999997e-06 2024-09-12T22:49:47.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:47.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301050+0000", 2024-09-12T22:49:47.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3705e-05 2024-09-12T22:49:47.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301060+0000", 2024-09-12T22:49:47.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0042e-05 2024-09-12T22:49:47.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:47.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301114+0000", 2024-09-12T22:49:47.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4421e-05 2024-09-12T22:49:47.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:47.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301231+0000", 2024-09-12T22:49:47.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116552 2024-09-12T22:49:47.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:47.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.308695+0000", 2024-09-12T22:49:47.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0074639459999999999 2024-09-12T22:49:47.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.741 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:47.741 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.308735+0000", 2024-09-12T22:49:47.741 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0181e-05 2024-09-12T22:49:47.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.741 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:47.741 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.308776+0000", 2024-09-12T22:49:47.741 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1137000000000003e-05 2024-09-12T22:49:47.741 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.741 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:47.741 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.742 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:151 4.7 4:e25a3370:::10000000290.00000000:head [write 0~6349] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:47.742 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.301970+0000", 2024-09-12T22:49:47.742 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.369873729, 2024-09-12T22:49:47.742 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082601040000000008, 2024-09-12T22:49:47.742 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:47.742 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:47.742 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:47.742 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:47.742 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:47.742 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:47.742 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 151 2024-09-12T22:49:47.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.742 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:47.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:47.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301970+0000", 2024-09-12T22:49:47.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:47.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301970+0000", 2024-09-12T22:49:47.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:47.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301970+0000", 2024-09-12T22:49:47.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0699999999999998e-07 2024-09-12T22:49:47.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.744 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:47.744 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301977+0000", 2024-09-12T22:49:47.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0890000000000002e-06 2024-09-12T22:49:47.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.744 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:47.744 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301984+0000", 2024-09-12T22:49:47.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.511e-06 2024-09-12T22:49:47.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301988+0000", 2024-09-12T22:49:47.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7079999999999999e-06 2024-09-12T22:49:47.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:47.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.302027+0000", 2024-09-12T22:49:47.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9113999999999999e-05 2024-09-12T22:49:47.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:47.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.302099+0000", 2024-09-12T22:49:47.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2673e-05 2024-09-12T22:49:47.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.746 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:47.746 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.302174+0000", 2024-09-12T22:49:47.746 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4274000000000001e-05 2024-09-12T22:49:47.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.746 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:47.746 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.308696+0000", 2024-09-12T22:49:47.746 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065225159999999999 2024-09-12T22:49:47.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.746 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:47.747 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.310175+0000", 2024-09-12T22:49:47.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014790350000000001 2024-09-12T22:49:47.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.747 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:47.747 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.310205+0000", 2024-09-12T22:49:47.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9799e-05 2024-09-12T22:49:47.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.747 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:47.747 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.310230+0000", 2024-09-12T22:49:47.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4978e-05 2024-09-12T22:49:47.747 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.747 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:47.748 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.748 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:194 4.16 4:6af67b46:::100000002bb.00000000:head [write 0~111] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:47.748 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.339531+0000", 2024-09-12T22:49:47.748 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.3323125670000007, 2024-09-12T22:49:47.748 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073351789999999998, 2024-09-12T22:49:47.748 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:47.748 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:47.748 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:47.748 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:47.748 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:47.748 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:47.749 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 194 2024-09-12T22:49:47.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.749 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:47.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.749 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:47.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339531+0000", 2024-09-12T22:49:47.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.749 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:47.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339531+0000", 2024-09-12T22:49:47.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.750 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:47.750 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339532+0000", 2024-09-12T22:49:47.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8100000000000002e-07 2024-09-12T22:49:47.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.750 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:47.750 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339536+0000", 2024-09-12T22:49:47.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8739999999999997e-06 2024-09-12T22:49:47.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.750 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:47.750 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339546+0000", 2024-09-12T22:49:47.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0567999999999999e-05 2024-09-12T22:49:47.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.751 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.751 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339552+0000", 2024-09-12T22:49:47.751 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4750000000000001e-06 2024-09-12T22:49:47.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.751 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:47.751 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339593+0000", 2024-09-12T22:49:47.751 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1230999999999999e-05 2024-09-12T22:49:47.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.751 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:47.751 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339664+0000", 2024-09-12T22:49:47.752 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0769e-05 2024-09-12T22:49:47.752 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.752 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.752 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:47.752 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.346724+0000", 2024-09-12T22:49:47.752 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070602249999999998 2024-09-12T22:49:47.752 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.752 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.752 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:47.752 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.346778+0000", 2024-09-12T22:49:47.752 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4469999999999999e-05 2024-09-12T22:49:47.752 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.752 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.753 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:47.753 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.346866+0000", 2024-09-12T22:49:47.753 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7786000000000003e-05 2024-09-12T22:49:47.753 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.753 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:47.753 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.753 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:198 4.12 4:4a0eff6f:::100000002bf.00000000:head [write 0~98] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:47.753 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.343572+0000", 2024-09-12T22:49:47.753 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.3282718199999994, 2024-09-12T22:49:47.753 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084413230000000006, 2024-09-12T22:49:47.753 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:47.753 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:47.754 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:47.754 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:47.754 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:47.754 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:47.754 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 198 2024-09-12T22:49:47.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.754 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:47.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:47.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343572+0000", 2024-09-12T22:49:47.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.755 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:47.755 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343572+0000", 2024-09-12T22:49:47.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.755 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:47.755 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343573+0000", 2024-09-12T22:49:47.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:49:47.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.755 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:47.755 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343578+0000", 2024-09-12T22:49:47.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4750000000000001e-06 2024-09-12T22:49:47.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.756 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:47.756 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343589+0000", 2024-09-12T22:49:47.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0709e-05 2024-09-12T22:49:47.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.756 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.756 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343594+0000", 2024-09-12T22:49:47.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4360000000000001e-06 2024-09-12T22:49:47.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.756 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:47.756 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343668+0000", 2024-09-12T22:49:47.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3907999999999998e-05 2024-09-12T22:49:47.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:47.757 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343741+0000", 2024-09-12T22:49:47.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2922000000000004e-05 2024-09-12T22:49:47.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:47.757 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343841+0000", 2024-09-12T22:49:47.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100412 2024-09-12T22:49:47.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:47.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349501+0000", 2024-09-12T22:49:47.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005659776 2024-09-12T22:49:47.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:47.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.351940+0000", 2024-09-12T22:49:47.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024390839999999998 2024-09-12T22:49:47.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:47.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.351986+0000", 2024-09-12T22:49:47.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5970999999999997e-05 2024-09-12T22:49:47.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:47.759 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352013+0000", 2024-09-12T22:49:47.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6871000000000001e-05 2024-09-12T22:49:47.759 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.759 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:47.759 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.759 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:205 4.37 4:ef7c8488:::100000002c6.00000000:head [write 0~98] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:47.759 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.349405+0000", 2024-09-12T22:49:47.759 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.3224390939999999, 2024-09-12T22:49:47.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078250019999999993, 2024-09-12T22:49:47.759 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:47.760 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:47.760 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:47.760 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:47.760 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:47.760 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:47.760 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 205 2024-09-12T22:49:47.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.760 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:47.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.760 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:47.760 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349405+0000", 2024-09-12T22:49:47.760 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:47.761 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349405+0000", 2024-09-12T22:49:47.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:47.761 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349405+0000", 2024-09-12T22:49:47.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:49:47.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:47.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349409+0000", 2024-09-12T22:49:47.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1359999999999999e-06 2024-09-12T22:49:47.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:47.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349418+0000", 2024-09-12T22:49:47.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3289999999999994e-06 2024-09-12T22:49:47.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349423+0000", 2024-09-12T22:49:47.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9949999999999996e-06 2024-09-12T22:49:47.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:47.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349469+0000", 2024-09-12T22:49:47.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6008999999999999e-05 2024-09-12T22:49:47.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:47.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349570+0000", 2024-09-12T22:49:47.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100831 2024-09-12T22:49:47.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:47.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349682+0000", 2024-09-12T22:49:47.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011268 2024-09-12T22:49:47.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:47.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.351968+0000", 2024-09-12T22:49:47.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022860379999999998 2024-09-12T22:49:47.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:47.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.357145+0000", 2024-09-12T22:49:47.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051769759999999998 2024-09-12T22:49:47.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:47.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.357187+0000", 2024-09-12T22:49:47.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1248999999999998e-05 2024-09-12T22:49:47.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:47.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.357230+0000", 2024-09-12T22:49:47.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3010000000000003e-05 2024-09-12T22:49:47.765 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.765 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:47.765 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.766 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:208 4.1c e50/17 4:3b628a21:::100000002c9.00000000:head v 50'2, mlcod=0'0)", 2024-09-12T22:49:47.766 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.352179+0000", 2024-09-12T22:49:47.766 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.3196650749999996, 2024-09-12T22:49:47.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0076543849999999997, 2024-09-12T22:49:47.766 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:47.766 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:47.766 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:47.766 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:47.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.766 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:47.766 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352179+0000", 2024-09-12T22:49:47.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:47.767 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352179+0000", 2024-09-12T22:49:47.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:47.767 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352179+0000", 2024-09-12T22:49:47.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0200000000000002e-07 2024-09-12T22:49:47.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:47.767 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352184+0000", 2024-09-12T22:49:47.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0470000000000001e-06 2024-09-12T22:49:47.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:47.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352190+0000", 2024-09-12T22:49:47.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9519999999999999e-06 2024-09-12T22:49:47.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352194+0000", 2024-09-12T22:49:47.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.369e-06 2024-09-12T22:49:47.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:47.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352232+0000", 2024-09-12T22:49:47.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7752e-05 2024-09-12T22:49:47.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:47.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352249+0000", 2024-09-12T22:49:47.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6796e-05 2024-09-12T22:49:47.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:47.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.359795+0000", 2024-09-12T22:49:47.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0075457989999999997 2024-09-12T22:49:47.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:47.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.359833+0000", 2024-09-12T22:49:47.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8167999999999998e-05 2024-09-12T22:49:47.770 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.770 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:47.770 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.770 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:247 4.a 4:5080b297:::100000002f5.00000000:head [write 0~12498] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:47.770 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.390848+0000", 2024-09-12T22:49:47.771 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.2809954779999995, 2024-09-12T22:49:47.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071234089999999998, 2024-09-12T22:49:47.771 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:47.771 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:47.771 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:47.771 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:47.771 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:47.771 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:47.771 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 247 2024-09-12T22:49:47.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.771 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:47.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:47.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.390848+0000", 2024-09-12T22:49:47.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:47.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.390848+0000", 2024-09-12T22:49:47.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:47.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.390849+0000", 2024-09-12T22:49:47.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-09-12T22:49:47.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:47.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.390860+0000", 2024-09-12T22:49:47.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.151e-05 2024-09-12T22:49:47.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:47.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.390869+0000", 2024-09-12T22:49:47.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3389999999999993e-06 2024-09-12T22:49:47.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.390877+0000", 2024-09-12T22:49:47.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3310000000000004e-06 2024-09-12T22:49:47.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:47.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.390930+0000", 2024-09-12T22:49:47.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2685999999999997e-05 2024-09-12T22:49:47.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:47.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.391048+0000", 2024-09-12T22:49:47.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000118566 2024-09-12T22:49:47.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:47.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.397864+0000", 2024-09-12T22:49:47.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0068154690000000002 2024-09-12T22:49:47.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:47.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.397904+0000", 2024-09-12T22:49:47.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0185000000000002e-05 2024-09-12T22:49:47.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:47.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.397972+0000", 2024-09-12T22:49:47.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7552999999999995e-05 2024-09-12T22:49:47.776 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.776 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:47.776 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.776 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:85 3.1a e53/16 3:5e41ab69:::200.00000005:head v 53'3, mlcod=18'1)", 2024-09-12T22:49:47.776 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:47.160254+0000", 2024-09-12T22:49:47.776 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.51158928000000004, 2024-09-12T22:49:47.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0095139999999999999, 2024-09-12T22:49:47.776 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:47.776 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:47.776 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:47.776 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:47.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:47.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.160254+0000", 2024-09-12T22:49:47.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:47.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.160254+0000", 2024-09-12T22:49:47.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:47.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.160255+0000", 2024-09-12T22:49:47.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9400000000000005e-07 2024-09-12T22:49:47.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.778 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:47.778 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.162952+0000", 2024-09-12T22:49:47.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002697362 2024-09-12T22:49:47.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.778 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:47.778 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.162959+0000", 2024-09-12T22:49:47.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.392e-06 2024-09-12T22:49:47.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.162966+0000", 2024-09-12T22:49:47.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1069999999999999e-06 2024-09-12T22:49:47.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:47.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.163008+0000", 2024-09-12T22:49:47.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2138999999999998e-05 2024-09-12T22:49:47.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:47.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.163027+0000", 2024-09-12T22:49:47.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9284e-05 2024-09-12T22:49:47.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:47.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.169732+0000", 2024-09-12T22:49:47.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0067044490000000003 2024-09-12T22:49:47.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:47.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.169768+0000", 2024-09-12T22:49:47.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6672999999999999e-05 2024-09-12T22:49:47.780 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.781 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:47.781 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.781 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:156 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:47.781 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:47.186337+0000", 2024-09-12T22:49:47.781 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.48550700499999999, 2024-09-12T22:49:47.781 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079697589999999999, 2024-09-12T22:49:47.781 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:47.781 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:47.781 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:47.781 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:47.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.782 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:47.782 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.186337+0000", 2024-09-12T22:49:47.782 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.782 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.782 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:47.782 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.186337+0000", 2024-09-12T22:49:47.782 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:47.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.782 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.782 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:47.782 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.186337+0000", 2024-09-12T22:49:47.782 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5799999999999998e-07 2024-09-12T22:49:47.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.783 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:47.783 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.186462+0000", 2024-09-12T22:49:47.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012466699999999999 2024-09-12T22:49:47.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.783 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:47.783 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.186472+0000", 2024-09-12T22:49:47.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4490000000000005e-06 2024-09-12T22:49:47.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.783 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.783 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.186480+0000", 2024-09-12T22:49:47.784 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6940000000000001e-06 2024-09-12T22:49:47.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.784 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:47.784 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.186517+0000", 2024-09-12T22:49:47.784 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6445000000000001e-05 2024-09-12T22:49:47.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.784 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:47.784 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.186573+0000", 2024-09-12T22:49:47.784 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6221000000000003e-05 2024-09-12T22:49:47.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.785 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:47.785 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.194171+0000", 2024-09-12T22:49:47.785 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0075985280000000002 2024-09-12T22:49:47.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.785 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.785 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:47.785 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.194227+0000", 2024-09-12T22:49:47.785 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5862000000000001e-05 2024-09-12T22:49:47.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:47.785 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:47.785 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:47.785 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.194306+0000", 2024-09-12T22:49:47.785 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9134999999999994e-05 2024-09-12T22:49:47.786 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.786 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:47.786 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.786 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:47.786 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:47.786 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:47.787 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:47.786+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:47.788 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:47.888 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:47.887+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:47.895 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:47.896 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:49:47.896 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.896 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:7859 4.32 4:4f4b4390:::100000023cf.00000000:head [write 0~2046 in=2046b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:49:47.896 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.894724+0000", 2024-09-12T22:49:47.896 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.00063970100000000001, 2024-09-12T22:49:47.896 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00065852, 2024-09-12T22:49:47.896 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:47.896 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:47.896 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:47.896 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:47.897 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:47.897 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:47.897 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 7859 2024-09-12T22:49:47.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.897 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:47.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.897 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:47.897 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.894724+0000", 2024-09-12T22:49:47.897 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.897 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:47.897 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.894724+0000", 2024-09-12T22:49:47.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:47.898 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.898 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.898 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:47.898 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.894725+0000", 2024-09-12T22:49:47.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7899999999999998e-07 2024-09-12T22:49:47.898 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.898 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.898 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:47.898 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.894730+0000", 2024-09-12T22:49:47.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2499999999999997e-06 2024-09-12T22:49:47.898 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.898 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.899 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:47.899 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.894739+0000", 2024-09-12T22:49:47.899 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9430000000000006e-06 2024-09-12T22:49:47.899 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.899 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:47.899 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.894743+0000", 2024-09-12T22:49:47.899 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6140000000000002e-06 2024-09-12T22:49:47.899 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.899 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:47.900 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.894792+0000", 2024-09-12T22:49:47.900 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8571e-05 2024-09-12T22:49:47.900 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:47.900 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:47.900 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:47.900 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.894910+0000", 2024-09-12T22:49:47.900 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000117988 2024-09-12T22:49:47.900 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.901 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:47.901 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.901 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:47.901 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-12T22:49:47.901 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 1 2024-09-12T22:49:47.901 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:47.905 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:47.989 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:47.988+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:48.062 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:48.062 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:48.062 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:49:48.062 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:49:48.063 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:48.072 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:48.089 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~76s 2024-09-12T22:49:48.089 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:48.088+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:48.191 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:48.190+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:48.227 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:48.227 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:49:48.227 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:49:48.228 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:49:48.228 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.228 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:115 3.1e 3:7bf7e7b5:::200.00000006:head [write 32566~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:48.228 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.160031+0000", 2024-09-12T22:49:48.228 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.064760261, 2024-09-12T22:49:48.228 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01896836, 2024-09-12T22:49:48.228 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:48.228 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:48.228 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:48.228 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:48.228 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.228 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:48.228 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160031+0000", 2024-09-12T22:49:48.229 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.229 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.229 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.229 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:48.229 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160031+0000", 2024-09-12T22:49:48.229 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.229 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.229 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.229 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:48.229 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160031+0000", 2024-09-12T22:49:48.229 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0900000000000001e-07 2024-09-12T22:49:48.229 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.229 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.230 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:48.230 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160032+0000", 2024-09-12T22:49:48.230 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.598e-06 2024-09-12T22:49:48.230 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.230 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.230 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:48.230 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160036+0000", 2024-09-12T22:49:48.230 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.929e-06 2024-09-12T22:49:48.230 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.230 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.230 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.230 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160039+0000", 2024-09-12T22:49:48.230 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5629999999999999e-06 2024-09-12T22:49:48.230 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.231 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.231 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:48.231 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.175741+0000", 2024-09-12T22:49:48.231 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015701802000000001 2024-09-12T22:49:48.231 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.231 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.231 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:48.231 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.175790+0000", 2024-09-12T22:49:48.231 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9048999999999997e-05 2024-09-12T22:49:48.231 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.231 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.231 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:48.231 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.175860+0000", 2024-09-12T22:49:48.232 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0215000000000005e-05 2024-09-12T22:49:48.232 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.232 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.232 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:48.232 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.176674+0000", 2024-09-12T22:49:48.232 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00081351199999999996 2024-09-12T22:49:48.232 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.232 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.232 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:48.232 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.178934+0000", 2024-09-12T22:49:48.232 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022602540000000002 2024-09-12T22:49:48.232 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.232 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.232 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:48.233 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.178959+0000", 2024-09-12T22:49:48.233 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5423999999999999e-05 2024-09-12T22:49:48.233 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.233 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.233 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:48.233 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.178999+0000", 2024-09-12T22:49:48.233 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9805000000000003e-05 2024-09-12T22:49:48.233 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.233 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:48.233 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.233 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.233 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.233 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:116 3.1e 3:7bf7e7b5:::200.00000006:head [write 33965~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:48.234 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.160042+0000", 2024-09-12T22:49:48.234 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.06474896, 2024-09-12T22:49:48.234 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.019984564999999999, 2024-09-12T22:49:48.234 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:48.234 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:48.234 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:48.234 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:48.234 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.234 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:48.234 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160042+0000", 2024-09-12T22:49:48.234 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.234 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.234 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.234 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:48.235 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160042+0000", 2024-09-12T22:49:48.235 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.235 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.235 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.235 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:48.235 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160042+0000", 2024-09-12T22:49:48.235 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.22e-07 2024-09-12T22:49:48.235 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.235 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.235 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:48.235 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160047+0000", 2024-09-12T22:49:48.235 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9899999999999997e-06 2024-09-12T22:49:48.235 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.236 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.236 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:48.236 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160051+0000", 2024-09-12T22:49:48.236 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2230000000000001e-06 2024-09-12T22:49:48.236 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.236 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.236 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.236 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160054+0000", 2024-09-12T22:49:48.236 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6860000000000002e-06 2024-09-12T22:49:48.236 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.236 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.236 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:48.236 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.176303+0000", 2024-09-12T22:49:48.237 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016248439 2024-09-12T22:49:48.237 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.237 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.237 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:48.237 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.176348+0000", 2024-09-12T22:49:48.237 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5173000000000003e-05 2024-09-12T22:49:48.237 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.237 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.237 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:48.237 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.176413+0000", 2024-09-12T22:49:48.237 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5228999999999995e-05 2024-09-12T22:49:48.237 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.237 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.238 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:48.238 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.179853+0000", 2024-09-12T22:49:48.238 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034401470000000002 2024-09-12T22:49:48.238 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.238 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.238 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:48.238 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.179919+0000", 2024-09-12T22:49:48.238 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6063999999999996e-05 2024-09-12T22:49:48.238 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.238 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.238 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:48.238 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.179950+0000", 2024-09-12T22:49:48.238 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1010999999999998e-05 2024-09-12T22:49:48.239 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.239 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.239 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:48.239 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.180027+0000", 2024-09-12T22:49:48.239 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6380999999999999e-05 2024-09-12T22:49:48.239 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.239 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:48.239 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.239 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.239 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.239 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:117 3.1e 3:7bf7e7b5:::200.00000006:head [write 35364~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:48.239 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.160057+0000", 2024-09-12T22:49:48.239 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.064733588, 2024-09-12T22:49:48.240 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022917138, 2024-09-12T22:49:48.240 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:48.240 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:48.240 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:48.240 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:48.240 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.240 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:48.240 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160057+0000", 2024-09-12T22:49:48.240 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.240 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.240 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.240 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:48.240 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160057+0000", 2024-09-12T22:49:48.241 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.241 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.241 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.241 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:48.241 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160058+0000", 2024-09-12T22:49:48.241 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.16e-07 2024-09-12T22:49:48.241 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.241 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.241 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:48.241 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160059+0000", 2024-09-12T22:49:48.241 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4410000000000001e-06 2024-09-12T22:49:48.241 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.241 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.241 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:48.242 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160063+0000", 2024-09-12T22:49:48.242 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9790000000000004e-06 2024-09-12T22:49:48.242 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.242 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.242 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.242 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160068+0000", 2024-09-12T22:49:48.242 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0629999999999996e-06 2024-09-12T22:49:48.242 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.242 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.242 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:48.242 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.176699+0000", 2024-09-12T22:49:48.242 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016630781000000001 2024-09-12T22:49:48.243 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.243 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.243 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:48.243 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.176741+0000", 2024-09-12T22:49:48.243 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1959999999999998e-05 2024-09-12T22:49:48.243 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.243 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.243 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:48.243 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.176807+0000", 2024-09-12T22:49:48.243 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6711999999999994e-05 2024-09-12T22:49:48.243 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.243 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.243 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:48.243 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.179858+0000", 2024-09-12T22:49:48.243 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003050582 2024-09-12T22:49:48.244 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.244 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.244 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:48.244 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.182889+0000", 2024-09-12T22:49:48.244 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030313750000000002 2024-09-12T22:49:48.244 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.244 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.244 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:48.244 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.182922+0000", 2024-09-12T22:49:48.244 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2379000000000003e-05 2024-09-12T22:49:48.244 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.244 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.244 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:48.245 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.182974+0000", 2024-09-12T22:49:48.245 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2649999999999999e-05 2024-09-12T22:49:48.245 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.245 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:48.245 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.246 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.246 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.246 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:118 3.1e 3:7bf7e7b5:::200.00000006:head [write 36767~1414 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:48.246 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.160073+0000", 2024-09-12T22:49:48.246 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.064717659, 2024-09-12T22:49:48.246 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023013767000000001, 2024-09-12T22:49:48.246 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:48.246 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:48.246 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:48.246 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:48.247 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.247 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:48.248 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160073+0000", 2024-09-12T22:49:48.248 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.248 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.248 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.248 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:48.248 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160073+0000", 2024-09-12T22:49:48.249 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.249 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.249 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.249 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:48.249 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160074+0000", 2024-09-12T22:49:48.249 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6899999999999998e-07 2024-09-12T22:49:48.250 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.250 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.250 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:48.250 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160079+0000", 2024-09-12T22:49:48.250 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3199999999999999e-06 2024-09-12T22:49:48.250 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.250 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.250 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:48.251 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160092+0000", 2024-09-12T22:49:48.251 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2850000000000001e-05 2024-09-12T22:49:48.251 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.251 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.251 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.251 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160096+0000", 2024-09-12T22:49:48.251 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1509999999999997e-06 2024-09-12T22:49:48.251 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.251 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.251 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:48.251 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.177067+0000", 2024-09-12T22:49:48.252 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016970827000000001 2024-09-12T22:49:48.252 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.252 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.252 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:48.252 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.177110+0000", 2024-09-12T22:49:48.252 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3446999999999999e-05 2024-09-12T22:49:48.252 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.252 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.252 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:48.252 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.177177+0000", 2024-09-12T22:49:48.252 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6612999999999994e-05 2024-09-12T22:49:48.252 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.253 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.253 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:48.253 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.179865+0000", 2024-09-12T22:49:48.253 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0026877770000000001 2024-09-12T22:49:48.253 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.253 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.253 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:48.253 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.183009+0000", 2024-09-12T22:49:48.253 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031447390000000001 2024-09-12T22:49:48.253 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.253 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.253 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:48.254 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.183040+0000", 2024-09-12T22:49:48.254 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0213e-05 2024-09-12T22:49:48.254 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.254 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.254 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:48.254 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.183087+0000", 2024-09-12T22:49:48.254 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7460999999999998e-05 2024-09-12T22:49:48.254 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.254 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:48.254 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.254 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.254 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.254 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:119 3.1e 3:7bf7e7b5:::200.00000006:head [write 38181~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:48.255 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.160117+0000", 2024-09-12T22:49:48.255 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.064674095, 2024-09-12T22:49:48.255 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023084609999999998, 2024-09-12T22:49:48.255 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:48.255 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:48.255 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:48.255 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:48.255 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.255 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:48.255 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160117+0000", 2024-09-12T22:49:48.255 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.256 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.256 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.256 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:48.256 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160117+0000", 2024-09-12T22:49:48.256 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.256 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.256 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.256 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:48.256 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160117+0000", 2024-09-12T22:49:48.256 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1800000000000002e-07 2024-09-12T22:49:48.256 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.256 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.257 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:48.257 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160119+0000", 2024-09-12T22:49:48.257 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.136e-06 2024-09-12T22:49:48.257 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.257 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.257 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:48.257 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160124+0000", 2024-09-12T22:49:48.257 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3610000000000003e-06 2024-09-12T22:49:48.257 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.257 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.258 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.258 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160126+0000", 2024-09-12T22:49:48.258 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7140000000000002e-06 2024-09-12T22:49:48.258 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.258 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.258 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:48.258 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.177501+0000", 2024-09-12T22:49:48.258 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.017374351 2024-09-12T22:49:48.258 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.258 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.258 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:48.259 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.177548+0000", 2024-09-12T22:49:48.259 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7321000000000003e-05 2024-09-12T22:49:48.259 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.259 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.259 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:48.259 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.177626+0000", 2024-09-12T22:49:48.259 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7546000000000006e-05 2024-09-12T22:49:48.259 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.259 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.259 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:48.259 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.179877+0000", 2024-09-12T22:49:48.259 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022512769999999999 2024-09-12T22:49:48.259 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.260 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.260 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:48.260 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.183128+0000", 2024-09-12T22:49:48.260 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032514079999999999 2024-09-12T22:49:48.260 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.260 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.260 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:48.260 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.183156+0000", 2024-09-12T22:49:48.260 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8155999999999999e-05 2024-09-12T22:49:48.260 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.261 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.261 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:48.261 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.183201+0000", 2024-09-12T22:49:48.261 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5021999999999997e-05 2024-09-12T22:49:48.261 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.261 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:48.261 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.262 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.262 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.262 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:120 3.1e 3:7bf7e7b5:::200.00000006:head [write 39581~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:48.262 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.160130+0000", 2024-09-12T22:49:48.262 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.064661093, 2024-09-12T22:49:48.262 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023171166999999999, 2024-09-12T22:49:48.262 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:48.263 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:48.263 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:48.263 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:48.263 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.263 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:48.263 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160130+0000", 2024-09-12T22:49:48.263 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.263 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.263 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.263 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:48.263 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160130+0000", 2024-09-12T22:49:48.263 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.263 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.264 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.264 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:48.264 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160130+0000", 2024-09-12T22:49:48.264 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1199999999999999e-07 2024-09-12T22:49:48.264 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.264 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.264 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:48.264 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160132+0000", 2024-09-12T22:49:48.264 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8810000000000001e-06 2024-09-12T22:49:48.264 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.264 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.265 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:48.265 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160135+0000", 2024-09-12T22:49:48.265 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.078e-06 2024-09-12T22:49:48.265 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.265 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.265 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.265 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160138+0000", 2024-09-12T22:49:48.265 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9569999999999998e-06 2024-09-12T22:49:48.265 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.265 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.265 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:48.265 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.177849+0000", 2024-09-12T22:49:48.266 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.017711286999999999 2024-09-12T22:49:48.266 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.266 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.266 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:48.266 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.177900+0000", 2024-09-12T22:49:48.266 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0695000000000002e-05 2024-09-12T22:49:48.266 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.266 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.266 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:48.267 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.177967+0000", 2024-09-12T22:49:48.267 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6604000000000001e-05 2024-09-12T22:49:48.267 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.267 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.267 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:48.267 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.179884+0000", 2024-09-12T22:49:48.267 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019170249999999999 2024-09-12T22:49:48.267 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.267 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.268 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:48.268 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.183230+0000", 2024-09-12T22:49:48.268 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033465690000000002 2024-09-12T22:49:48.268 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.268 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.268 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:48.268 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.183259+0000", 2024-09-12T22:49:48.268 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8628000000000001e-05 2024-09-12T22:49:48.268 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.268 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.268 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:48.268 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.183301+0000", 2024-09-12T22:49:48.268 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2231000000000003e-05 2024-09-12T22:49:48.269 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.269 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:48.269 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.269 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.269 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.269 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:121 3.1e 3:7bf7e7b5:::200.00000006:head [write 40980~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:48.269 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.160141+0000", 2024-09-12T22:49:48.269 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.0646500210000001, 2024-09-12T22:49:48.269 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023288197, 2024-09-12T22:49:48.269 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:48.269 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:48.269 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:48.270 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:48.270 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.270 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:48.270 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160141+0000", 2024-09-12T22:49:48.270 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.270 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.270 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.270 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:48.270 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160141+0000", 2024-09-12T22:49:48.270 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.270 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.270 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.270 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:48.271 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160141+0000", 2024-09-12T22:49:48.271 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2099999999999998e-07 2024-09-12T22:49:48.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.271 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.271 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:48.271 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160146+0000", 2024-09-12T22:49:48.271 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8230000000000002e-06 2024-09-12T22:49:48.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.271 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.271 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:48.271 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160149+0000", 2024-09-12T22:49:48.271 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.337e-06 2024-09-12T22:49:48.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.271 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.272 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.272 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160152+0000", 2024-09-12T22:49:48.272 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4399999999999999e-06 2024-09-12T22:49:48.272 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.272 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.272 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:48.272 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.178307+0000", 2024-09-12T22:49:48.272 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018155161 2024-09-12T22:49:48.273 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.273 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.273 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:48.273 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.178386+0000", 2024-09-12T22:49:48.273 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8966000000000003e-05 2024-09-12T22:49:48.273 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.274 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.274 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:48.274 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.178536+0000", 2024-09-12T22:49:48.274 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015024799999999999 2024-09-12T22:49:48.274 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.274 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.274 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:48.274 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.180379+0000", 2024-09-12T22:49:48.274 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00184242 2024-09-12T22:49:48.274 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.274 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.274 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:48.274 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.183341+0000", 2024-09-12T22:49:48.275 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0029626819999999999 2024-09-12T22:49:48.275 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.275 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.275 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:48.275 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.183370+0000", 2024-09-12T22:49:48.275 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:49:48.275 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.275 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.275 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:48.275 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.183429+0000", 2024-09-12T22:49:48.275 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9406e-05 2024-09-12T22:49:48.275 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.275 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:48.275 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.276 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.276 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.276 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:122 3.1e 3:7bf7e7b5:::200.00000006:head [write 42381~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:48.276 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.160155+0000", 2024-09-12T22:49:48.276 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.0646360269999999, 2024-09-12T22:49:48.276 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.025228924, 2024-09-12T22:49:48.276 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:48.276 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:48.276 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:48.276 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:48.276 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.276 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:48.277 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160155+0000", 2024-09-12T22:49:48.277 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.277 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.277 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.277 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:48.277 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160155+0000", 2024-09-12T22:49:48.277 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.277 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.277 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.277 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:48.277 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160155+0000", 2024-09-12T22:49:48.277 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1199999999999999e-07 2024-09-12T22:49:48.277 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.278 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.278 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:48.278 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160157+0000", 2024-09-12T22:49:48.278 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.838e-06 2024-09-12T22:49:48.278 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.278 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.278 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:48.278 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160160+0000", 2024-09-12T22:49:48.278 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3900000000000002e-06 2024-09-12T22:49:48.278 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.278 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.278 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.279 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160170+0000", 2024-09-12T22:49:48.279 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3160000000000003e-06 2024-09-12T22:49:48.279 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.279 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.279 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:48.279 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.179029+0000", 2024-09-12T22:49:48.279 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018858935 2024-09-12T22:49:48.279 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.279 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.279 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:48.279 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.179074+0000", 2024-09-12T22:49:48.279 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5386999999999998e-05 2024-09-12T22:49:48.280 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.280 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.280 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:48.280 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.179178+0000", 2024-09-12T22:49:48.280 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010391399999999999 2024-09-12T22:49:48.280 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.280 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.280 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:48.280 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.181184+0000", 2024-09-12T22:49:48.280 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020062550000000002 2024-09-12T22:49:48.281 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.281 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.281 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:48.281 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.185306+0000", 2024-09-12T22:49:48.281 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0041221349999999999 2024-09-12T22:49:48.281 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.281 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.281 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:48.281 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.185337+0000", 2024-09-12T22:49:48.281 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1080000000000001e-05 2024-09-12T22:49:48.281 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.281 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.281 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:48.282 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.185384+0000", 2024-09-12T22:49:48.282 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6461999999999997e-05 2024-09-12T22:49:48.282 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.282 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:48.282 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.282 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.282 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.282 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:167 3.1e 3:7bf7e7b5:::200.00000006:head [write 170486~2427 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:48.282 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.188170+0000", 2024-09-12T22:49:48.282 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.036621244, 2024-09-12T22:49:48.282 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.019307458999999999, 2024-09-12T22:49:48.282 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:48.282 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:48.283 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:48.283 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:48.283 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.283 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:48.283 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188170+0000", 2024-09-12T22:49:48.283 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.283 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.283 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.283 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:48.283 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188170+0000", 2024-09-12T22:49:48.283 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.283 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.284 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.284 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:48.284 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188170+0000", 2024-09-12T22:49:48.284 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:49:48.284 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.284 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.284 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:48.284 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188178+0000", 2024-09-12T22:49:48.284 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6590000000000007e-06 2024-09-12T22:49:48.284 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.284 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.285 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:48.285 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188184+0000", 2024-09-12T22:49:48.285 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4200000000000004e-06 2024-09-12T22:49:48.285 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.285 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.285 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.285 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188189+0000", 2024-09-12T22:49:48.285 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6909999999999996e-06 2024-09-12T22:49:48.285 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.285 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.285 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:48.285 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.201064+0000", 2024-09-12T22:49:48.286 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012875202000000001 2024-09-12T22:49:48.286 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.286 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.286 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:48.286 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.201112+0000", 2024-09-12T22:49:48.286 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7608000000000002e-05 2024-09-12T22:49:48.286 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.286 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.286 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:48.286 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.201217+0000", 2024-09-12T22:49:48.286 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000104936 2024-09-12T22:49:48.286 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.286 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.287 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:48.287 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.202933+0000", 2024-09-12T22:49:48.287 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001715921 2024-09-12T22:49:48.287 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.287 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.287 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:48.287 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207409+0000", 2024-09-12T22:49:48.287 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044768719999999998 2024-09-12T22:49:48.287 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.288 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.288 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:48.288 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207436+0000", 2024-09-12T22:49:48.288 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6312000000000002e-05 2024-09-12T22:49:48.288 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.288 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.288 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:48.288 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207477+0000", 2024-09-12T22:49:48.289 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1331000000000001e-05 2024-09-12T22:49:48.289 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.289 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:48.289 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.289 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.289 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.289 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:168 3.1e 3:7bf7e7b5:::200.00000006:head [write 172913~2437 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:48.289 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.188195+0000", 2024-09-12T22:49:48.289 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.0365955149999999, 2024-09-12T22:49:48.289 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.019344936, 2024-09-12T22:49:48.289 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:48.289 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:48.289 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:48.290 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:48.290 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.290 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:48.290 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188195+0000", 2024-09-12T22:49:48.290 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.290 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.290 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.290 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:48.290 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188195+0000", 2024-09-12T22:49:48.290 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.290 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.290 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.291 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:48.291 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188196+0000", 2024-09-12T22:49:48.291 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8099999999999998e-07 2024-09-12T22:49:48.291 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.291 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.291 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:48.291 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188199+0000", 2024-09-12T22:49:48.291 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4620000000000001e-06 2024-09-12T22:49:48.291 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.291 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.291 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:48.291 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188205+0000", 2024-09-12T22:49:48.291 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7599999999999999e-06 2024-09-12T22:49:48.292 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.292 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.292 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.292 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188210+0000", 2024-09-12T22:49:48.292 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:49:48.292 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.292 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.292 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:48.292 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.201526+0000", 2024-09-12T22:49:48.292 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013316527999999999 2024-09-12T22:49:48.292 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.292 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.293 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:48.293 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.201569+0000", 2024-09-12T22:49:48.293 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3328999999999998e-05 2024-09-12T22:49:48.293 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.293 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.293 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:48.293 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.201636+0000", 2024-09-12T22:49:48.293 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6320000000000002e-05 2024-09-12T22:49:48.293 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.293 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.293 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:48.293 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.202961+0000", 2024-09-12T22:49:48.293 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00132551 2024-09-12T22:49:48.294 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.294 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.294 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:48.294 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207482+0000", 2024-09-12T22:49:48.294 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045204370000000004 2024-09-12T22:49:48.294 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.294 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.294 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:48.294 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207504+0000", 2024-09-12T22:49:48.294 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1956000000000001e-05 2024-09-12T22:49:48.294 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.294 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.294 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:48.294 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207540+0000", 2024-09-12T22:49:48.295 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6754000000000001e-05 2024-09-12T22:49:48.295 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.295 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:48.295 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.295 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.295 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.295 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:169 3.1e 3:7bf7e7b5:::200.00000006:head [write 175350~1910 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:48.295 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.188216+0000", 2024-09-12T22:49:48.295 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.0365753550000001, 2024-09-12T22:49:48.295 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.019389085, 2024-09-12T22:49:48.295 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:48.295 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:48.295 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:48.296 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:48.296 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.296 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:48.296 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188216+0000", 2024-09-12T22:49:48.296 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.296 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.296 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.296 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:48.296 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188216+0000", 2024-09-12T22:49:48.296 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.296 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.297 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.297 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:48.297 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188216+0000", 2024-09-12T22:49:48.297 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3799999999999998e-07 2024-09-12T22:49:48.297 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.297 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.298 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:48.298 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188223+0000", 2024-09-12T22:49:48.298 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4200000000000001e-06 2024-09-12T22:49:48.298 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.298 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.298 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:48.299 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188229+0000", 2024-09-12T22:49:48.299 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1789999999999996e-06 2024-09-12T22:49:48.299 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.299 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.299 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.300 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188235+0000", 2024-09-12T22:49:48.300 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0150000000000003e-06 2024-09-12T22:49:48.300 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.300 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.300 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:48.300 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.201986+0000", 2024-09-12T22:49:48.300 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013751974 2024-09-12T22:49:48.301 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.301 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.301 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:48.301 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.202031+0000", 2024-09-12T22:49:48.301 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4694999999999998e-05 2024-09-12T22:49:48.301 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.301 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.302 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:48.302 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.202100+0000", 2024-09-12T22:49:48.302 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8638000000000003e-05 2024-09-12T22:49:48.302 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.302 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.302 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:48.302 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.202990+0000", 2024-09-12T22:49:48.303 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089015800000000005 2024-09-12T22:49:48.303 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.303 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.303 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:48.303 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207544+0000", 2024-09-12T22:49:48.303 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045542990000000004 2024-09-12T22:49:48.304 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.304 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.304 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:48.304 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207565+0000", 2024-09-12T22:49:48.304 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1138e-05 2024-09-12T22:49:48.304 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.305 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.305 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:48.305 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207605+0000", 2024-09-12T22:49:48.305 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9230999999999998e-05 2024-09-12T22:49:48.305 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.305 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:48.305 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.306 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.306 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.306 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:170 3.1e 3:7bf7e7b5:::200.00000006:head [write 177260~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:48.306 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.188241+0000", 2024-09-12T22:49:48.306 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.0365499659999999, 2024-09-12T22:49:48.306 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.019428737000000001, 2024-09-12T22:49:48.306 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:48.306 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:48.306 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:48.306 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:48.307 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.307 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:48.307 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188241+0000", 2024-09-12T22:49:48.307 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.307 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.307 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.307 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:48.307 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188241+0000", 2024-09-12T22:49:48.307 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.307 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.307 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.308 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:48.308 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188241+0000", 2024-09-12T22:49:48.308 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5999999999999999e-07 2024-09-12T22:49:48.308 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.308 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.308 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:48.308 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188247+0000", 2024-09-12T22:49:48.308 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.677e-06 2024-09-12T22:49:48.308 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.308 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.308 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:48.308 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188253+0000", 2024-09-12T22:49:48.308 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9209999999999997e-06 2024-09-12T22:49:48.309 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.309 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.309 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.309 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188258+0000", 2024-09-12T22:49:48.309 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0610000000000003e-06 2024-09-12T22:49:48.309 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.309 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.309 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:48.309 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.202382+0000", 2024-09-12T22:49:48.309 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014124166 2024-09-12T22:49:48.309 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.309 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.310 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:48.310 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.202428+0000", 2024-09-12T22:49:48.310 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5966e-05 2024-09-12T22:49:48.310 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.310 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.310 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:48.310 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.202496+0000", 2024-09-12T22:49:48.310 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7999999999999999e-05 2024-09-12T22:49:48.310 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.310 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.310 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:48.310 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.203882+0000", 2024-09-12T22:49:48.310 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001386235 2024-09-12T22:49:48.311 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.311 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.311 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:48.311 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207608+0000", 2024-09-12T22:49:48.311 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00372609 2024-09-12T22:49:48.311 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.311 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.311 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:48.311 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207631+0000", 2024-09-12T22:49:48.311 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2569999999999999e-05 2024-09-12T22:49:48.311 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.311 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.311 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:48.312 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207670+0000", 2024-09-12T22:49:48.312 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8690999999999999e-05 2024-09-12T22:49:48.312 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.312 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:48.312 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.312 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.312 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.312 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:171 3.1e 3:7bf7e7b5:::200.00000006:head [write 179169~1938 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:48.312 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.188475+0000", 2024-09-12T22:49:48.312 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.0363154999999999, 2024-09-12T22:49:48.312 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.019261460000000001, 2024-09-12T22:49:48.312 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:48.313 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:48.313 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:48.313 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:48.313 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.313 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:48.313 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188475+0000", 2024-09-12T22:49:48.313 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.313 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.313 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.313 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:48.313 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188475+0000", 2024-09-12T22:49:48.313 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.313 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.314 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.314 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:48.314 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188476+0000", 2024-09-12T22:49:48.314 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0900000000000001e-07 2024-09-12T22:49:48.314 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.314 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.314 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:48.314 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188480+0000", 2024-09-12T22:49:48.314 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7069999999999998e-06 2024-09-12T22:49:48.314 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.314 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.315 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:48.315 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188489+0000", 2024-09-12T22:49:48.315 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2690000000000005e-06 2024-09-12T22:49:48.315 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.315 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.315 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.315 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188494+0000", 2024-09-12T22:49:48.315 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3360000000000002e-06 2024-09-12T22:49:48.315 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.315 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.315 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:48.316 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.203014+0000", 2024-09-12T22:49:48.316 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01451971 2024-09-12T22:49:48.316 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.316 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.316 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:48.316 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.203057+0000", 2024-09-12T22:49:48.316 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3287000000000001e-05 2024-09-12T22:49:48.316 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.316 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.316 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:48.316 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.203136+0000", 2024-09-12T22:49:48.316 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9159999999999994e-05 2024-09-12T22:49:48.316 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.317 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.317 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:48.317 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.204664+0000", 2024-09-12T22:49:48.317 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00152717 2024-09-12T22:49:48.317 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.317 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.317 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:48.317 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207674+0000", 2024-09-12T22:49:48.317 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030104929999999999 2024-09-12T22:49:48.317 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.317 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.317 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:48.318 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207696+0000", 2024-09-12T22:49:48.318 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2157000000000001e-05 2024-09-12T22:49:48.318 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.318 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.318 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:48.318 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207737+0000", 2024-09-12T22:49:48.318 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0562000000000002e-05 2024-09-12T22:49:48.318 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.318 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:48.318 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.318 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.318 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.318 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:172 3.1e 3:7bf7e7b5:::200.00000006:head [write 181107~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:48.319 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.188511+0000", 2024-09-12T22:49:48.319 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.0362796460000001, 2024-09-12T22:49:48.319 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.019289285999999999, 2024-09-12T22:49:48.319 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:48.319 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:48.319 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:48.319 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:48.319 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.319 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:48.319 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188511+0000", 2024-09-12T22:49:48.319 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.319 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.319 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.319 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:48.320 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188511+0000", 2024-09-12T22:49:48.320 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.320 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.320 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.320 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:48.320 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188512+0000", 2024-09-12T22:49:48.320 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.13e-07 2024-09-12T22:49:48.320 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.320 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.320 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:48.320 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188515+0000", 2024-09-12T22:49:48.321 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1310000000000002e-06 2024-09-12T22:49:48.321 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.321 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.321 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:48.321 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188523+0000", 2024-09-12T22:49:48.321 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7510000000000008e-06 2024-09-12T22:49:48.321 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.321 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.321 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.321 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188527+0000", 2024-09-12T22:49:48.322 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7870000000000001e-06 2024-09-12T22:49:48.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.322 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.322 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:48.322 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.203413+0000", 2024-09-12T22:49:48.322 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01488593 2024-09-12T22:49:48.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.322 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.322 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:48.322 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.203484+0000", 2024-09-12T22:49:48.322 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0783000000000003e-05 2024-09-12T22:49:48.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.322 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.323 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:48.323 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.203608+0000", 2024-09-12T22:49:48.323 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012370600000000001 2024-09-12T22:49:48.323 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.323 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.323 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:48.323 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.205204+0000", 2024-09-12T22:49:48.323 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001596606 2024-09-12T22:49:48.323 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.323 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.323 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:48.323 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207741+0000", 2024-09-12T22:49:48.323 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0025370089999999998 2024-09-12T22:49:48.324 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.324 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.324 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:48.324 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207763+0000", 2024-09-12T22:49:48.324 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1838999999999999e-05 2024-09-12T22:49:48.324 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.324 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.324 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:48.324 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207801+0000", 2024-09-12T22:49:48.324 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7231000000000003e-05 2024-09-12T22:49:48.325 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.325 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:48.325 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.325 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.325 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.325 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:173 3.1e 3:7bf7e7b5:::200.00000006:head [write 182514~2449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:48.325 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.188541+0000", 2024-09-12T22:49:48.325 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.0362499519999999, 2024-09-12T22:49:48.325 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.021263447000000001, 2024-09-12T22:49:48.325 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:48.325 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:48.326 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:48.326 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:48.326 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.326 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:48.326 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188541+0000", 2024-09-12T22:49:48.326 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.326 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.326 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.326 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:48.326 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188541+0000", 2024-09-12T22:49:48.326 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.326 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:48.327 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188541+0000", 2024-09-12T22:49:48.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0100000000000005e-07 2024-09-12T22:49:48.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:48.327 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188545+0000", 2024-09-12T22:49:48.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1310000000000002e-06 2024-09-12T22:49:48.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:48.328 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188551+0000", 2024-09-12T22:49:48.328 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6699999999999997e-06 2024-09-12T22:49:48.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.328 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.328 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188556+0000", 2024-09-12T22:49:48.328 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0000000000000004e-06 2024-09-12T22:49:48.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.328 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:48.328 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.203911+0000", 2024-09-12T22:49:48.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015354948 2024-09-12T22:49:48.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.329 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:48.329 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.203957+0000", 2024-09-12T22:49:48.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.587e-05 2024-09-12T22:49:48.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.329 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:48.329 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.204039+0000", 2024-09-12T22:49:48.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1672e-05 2024-09-12T22:49:48.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:48.332 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.205249+0000", 2024-09-12T22:49:48.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001210493 2024-09-12T22:49:48.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:48.332 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.209729+0000", 2024-09-12T22:49:48.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044796239999999998 2024-09-12T22:49:48.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.333 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:48.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.209759+0000", 2024-09-12T22:49:48.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9691000000000001e-05 2024-09-12T22:49:48.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.333 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:48.334 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.209804+0000", 2024-09-12T22:49:48.334 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5847000000000003e-05 2024-09-12T22:49:48.334 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.334 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:48.334 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.334 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:174 3.1e 3:7bf7e7b5:::200.00000006:head [write 184963~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:48.334 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.188594+0000", 2024-09-12T22:49:48.335 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.036196661, 2024-09-12T22:49:48.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.021300155000000001, 2024-09-12T22:49:48.335 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:48.335 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:48.335 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:48.335 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:48.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.335 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:48.335 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188594+0000", 2024-09-12T22:49:48.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.336 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:48.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188594+0000", 2024-09-12T22:49:48.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.336 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:48.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188595+0000", 2024-09-12T22:49:48.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2799999999999995e-07 2024-09-12T22:49:48.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.336 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:48.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188598+0000", 2024-09-12T22:49:48.337 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.27e-06 2024-09-12T22:49:48.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.337 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:48.337 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188605+0000", 2024-09-12T22:49:48.337 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1670000000000002e-06 2024-09-12T22:49:48.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.337 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.337 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188611+0000", 2024-09-12T22:49:48.337 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3329999999999996e-06 2024-09-12T22:49:48.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.338 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:48.338 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.204291+0000", 2024-09-12T22:49:48.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015680383999999999 2024-09-12T22:49:48.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.338 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:48.338 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.204334+0000", 2024-09-12T22:49:48.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2904999999999997e-05 2024-09-12T22:49:48.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.338 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:48.339 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.204399+0000", 2024-09-12T22:49:48.339 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4894000000000006e-05 2024-09-12T22:49:48.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.339 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.339 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:48.339 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.206814+0000", 2024-09-12T22:49:48.339 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0024151760000000002 2024-09-12T22:49:48.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.339 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.339 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:48.339 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.209809+0000", 2024-09-12T22:49:48.339 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0029953240000000002 2024-09-12T22:49:48.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:48.340 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.209837+0000", 2024-09-12T22:49:48.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7521999999999998e-05 2024-09-12T22:49:48.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:48.340 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.209894+0000", 2024-09-12T22:49:48.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7451999999999998e-05 2024-09-12T22:49:48.340 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.340 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:48.340 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.341 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:175 3.1e 3:7bf7e7b5:::200.00000006:head [write 186365~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:48.341 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.188623+0000", 2024-09-12T22:49:48.341 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.0361675770000001, 2024-09-12T22:49:48.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.021347469000000001, 2024-09-12T22:49:48.341 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:48.341 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:48.341 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:48.341 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:48.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.342 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:48.342 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188623+0000", 2024-09-12T22:49:48.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.342 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:48.342 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188623+0000", 2024-09-12T22:49:48.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.342 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:48.342 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188624+0000", 2024-09-12T22:49:48.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5200000000000002e-07 2024-09-12T22:49:48.343 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.343 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.343 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:48.343 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188627+0000", 2024-09-12T22:49:48.343 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7319999999999998e-06 2024-09-12T22:49:48.343 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.343 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.343 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:48.343 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188633+0000", 2024-09-12T22:49:48.343 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5989999999999998e-06 2024-09-12T22:49:48.343 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.343 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.343 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.344 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188638+0000", 2024-09-12T22:49:48.344 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8160000000000001e-06 2024-09-12T22:49:48.344 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.344 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.344 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:48.344 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.205285+0000", 2024-09-12T22:49:48.344 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016647408999999998 2024-09-12T22:49:48.344 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.344 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.344 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:48.345 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.205325+0000", 2024-09-12T22:49:48.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9521999999999999e-05 2024-09-12T22:49:48.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.345 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.345 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:48.345 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.205389+0000", 2024-09-12T22:49:48.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4259999999999998e-05 2024-09-12T22:49:48.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.345 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.345 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:48.345 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.206855+0000", 2024-09-12T22:49:48.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0014656129999999999 2024-09-12T22:49:48.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.346 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:48.346 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.209899+0000", 2024-09-12T22:49:48.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003044658 2024-09-12T22:49:48.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.346 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:48.346 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.209925+0000", 2024-09-12T22:49:48.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5193000000000001e-05 2024-09-12T22:49:48.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.346 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:48.346 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.209971+0000", 2024-09-12T22:49:48.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6214999999999997e-05 2024-09-12T22:49:48.347 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.347 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:48.347 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.347 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.347 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:176 3.1e 3:7bf7e7b5:::200.00000006:head [write 187766~3374 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:48.347 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.190952+0000", 2024-09-12T22:49:48.347 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.033838558, 2024-09-12T22:49:48.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.019086334, 2024-09-12T22:49:48.348 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:48.348 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:48.348 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:48.348 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:48.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.348 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:48.348 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.190952+0000", 2024-09-12T22:49:48.348 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.348 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.348 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:48.348 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.190952+0000", 2024-09-12T22:49:48.349 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.349 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.349 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.349 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:48.349 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.190953+0000", 2024-09-12T22:49:48.349 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.61e-07 2024-09-12T22:49:48.349 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.349 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.349 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:48.349 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.190959+0000", 2024-09-12T22:49:48.349 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5990000000000001e-06 2024-09-12T22:49:48.349 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.349 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.350 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:48.350 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.190967+0000", 2024-09-12T22:49:48.350 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7509999999999997e-06 2024-09-12T22:49:48.350 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.350 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.350 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.350 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.190974+0000", 2024-09-12T22:49:48.350 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.268e-06 2024-09-12T22:49:48.351 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.351 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.351 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:48.351 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.205622+0000", 2024-09-12T22:49:48.351 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01464855 2024-09-12T22:49:48.351 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.352 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.352 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:48.352 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.205663+0000", 2024-09-12T22:49:48.352 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0599999999999998e-05 2024-09-12T22:49:48.352 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.352 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.352 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:48.352 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.205724+0000", 2024-09-12T22:49:48.352 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0708000000000002e-05 2024-09-12T22:49:48.352 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.353 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.353 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:48.353 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.206904+0000", 2024-09-12T22:49:48.353 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011807549999999999 2024-09-12T22:49:48.353 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.353 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.353 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:48.353 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.209975+0000", 2024-09-12T22:49:48.353 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003070536 2024-09-12T22:49:48.354 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.354 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:48.354 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.209999+0000", 2024-09-12T22:49:48.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3726999999999998e-05 2024-09-12T22:49:48.355 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.355 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.355 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:48.355 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.210039+0000", 2024-09-12T22:49:48.355 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0079e-05 2024-09-12T22:49:48.355 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.356 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:48.356 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.356 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.356 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.356 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:185 3.1e 3:7bf7e7b5:::200.00000006:head [write 218211~1926 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:48.356 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.197107+0000", 2024-09-12T22:49:48.356 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.027684002, 2024-09-12T22:49:48.357 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.019102594000000001, 2024-09-12T22:49:48.357 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:48.357 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:48.357 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:48.357 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:48.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:48.358 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.197107+0000", 2024-09-12T22:49:48.358 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.358 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.358 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:48.358 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.197107+0000", 2024-09-12T22:49:48.358 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.359 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.359 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.359 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:48.359 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.197107+0000", 2024-09-12T22:49:48.359 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:49:48.359 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.360 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.360 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:48.360 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.197112+0000", 2024-09-12T22:49:48.360 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5560000000000001e-06 2024-09-12T22:49:48.360 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.360 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.361 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:48.361 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.197119+0000", 2024-09-12T22:49:48.361 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4150000000000002e-06 2024-09-12T22:49:48.361 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.361 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.362 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.197126+0000", 2024-09-12T22:49:48.362 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2099999999999998e-06 2024-09-12T22:49:48.362 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.362 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.362 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:48.362 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.212954+0000", 2024-09-12T22:49:48.362 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015828828999999999 2024-09-12T22:49:48.362 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.362 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.362 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:48.362 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.213002+0000", 2024-09-12T22:49:48.362 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7426000000000003e-05 2024-09-12T22:49:48.362 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.363 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.363 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:48.363 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.213069+0000", 2024-09-12T22:49:48.363 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7337999999999998e-05 2024-09-12T22:49:48.363 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.363 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.363 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:48.363 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.213932+0000", 2024-09-12T22:49:48.363 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00086254099999999998 2024-09-12T22:49:48.363 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.363 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.363 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:48.364 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.216129+0000", 2024-09-12T22:49:48.364 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0021976220000000002 2024-09-12T22:49:48.364 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.364 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.364 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:48.364 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.216162+0000", 2024-09-12T22:49:48.364 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2716999999999999e-05 2024-09-12T22:49:48.364 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.364 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.364 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:48.364 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.216210+0000", 2024-09-12T22:49:48.364 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7380999999999999e-05 2024-09-12T22:49:48.365 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.365 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:48.365 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.365 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.365 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.365 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:186 3.1e 3:7bf7e7b5:::200.00000006:head [write 220137~6982 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:48.365 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.197880+0000", 2024-09-12T22:49:48.365 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.0269111500000001, 2024-09-12T22:49:48.365 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.021088583000000001, 2024-09-12T22:49:48.365 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:48.366 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:48.366 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:48.366 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:48.366 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.366 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:48.366 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.197880+0000", 2024-09-12T22:49:48.366 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.367 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.367 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.367 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:48.367 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.197880+0000", 2024-09-12T22:49:48.367 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:48.367 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.367 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.367 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:48.367 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.197881+0000", 2024-09-12T22:49:48.367 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9699999999999995e-07 2024-09-12T22:49:48.367 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.368 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.368 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:48.368 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.197890+0000", 2024-09-12T22:49:48.368 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1859999999999998e-06 2024-09-12T22:49:48.368 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.369 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.369 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:48.369 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.197898+0000", 2024-09-12T22:49:48.369 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3389999999999993e-06 2024-09-12T22:49:48.369 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.369 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.369 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.369 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.197905+0000", 2024-09-12T22:49:48.369 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4710000000000004e-06 2024-09-12T22:49:48.369 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.370 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.370 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:48.370 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.213366+0000", 2024-09-12T22:49:48.370 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015461383 2024-09-12T22:49:48.370 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.370 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.370 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:48.370 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.213436+0000", 2024-09-12T22:49:48.370 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0499000000000004e-05 2024-09-12T22:49:48.370 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.370 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.370 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:48.370 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.213530+0000", 2024-09-12T22:49:48.371 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3833999999999996e-05 2024-09-12T22:49:48.371 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.371 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.371 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:48.371 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.214117+0000", 2024-09-12T22:49:48.371 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00058681900000000003 2024-09-12T22:49:48.371 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.371 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.371 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:48.371 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.218855+0000", 2024-09-12T22:49:48.371 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047378860000000002 2024-09-12T22:49:48.371 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.372 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.372 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:48.372 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.218910+0000", 2024-09-12T22:49:48.372 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4613e-05 2024-09-12T22:49:48.372 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:48.372 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:48.372 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:48.372 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.218968+0000", 2024-09-12T22:49:48.372 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8755999999999998e-05 2024-09-12T22:49:48.372 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.372 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:48.373 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.373 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:48.373 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:48.373 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:48.374 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:48.375 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:48.373+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:48.475 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:48.473+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:48.484 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:48.485 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:48.485 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:49:48.485 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:48.494 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:48.576 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:48.575+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:48.636 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:49:48.651 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:48.651 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:48.651 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:49:48.651 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:49:48.652 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:48.661 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:48.705 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:48.704+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:48.768 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:48.768 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:49:48.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:49:48.768 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:49:48.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.769 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:48.769 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:48.769 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 103.59584788399999, 2024-09-12T22:49:48.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078134699999999994, 2024-09-12T22:49:48.769 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:48.769 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:48.769 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:48.769 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:48.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:48.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:48.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:48.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170536+0000", 2024-09-12T22:49:48.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:48.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170540+0000", 2024-09-12T22:49:48.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:49:48.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:48.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170556+0000", 2024-09-12T22:49:48.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5739e-05 2024-09-12T22:49:48.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:48.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170568+0000", 2024-09-12T22:49:48.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.225e-05 2024-09-12T22:49:48.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170577+0000", 2024-09-12T22:49:48.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2910000000000007e-06 2024-09-12T22:49:48.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:48.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170661+0000", 2024-09-12T22:49:48.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4876000000000005e-05 2024-09-12T22:49:48.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:48.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170848+0000", 2024-09-12T22:49:48.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000186126 2024-09-12T22:49:48.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:48.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171035+0000", 2024-09-12T22:49:48.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018751999999999999 2024-09-12T22:49:48.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:48.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173270+0000", 2024-09-12T22:49:48.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002234949 2024-09-12T22:49:48.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:48.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178254+0000", 2024-09-12T22:49:48.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049835890000000001 2024-09-12T22:49:48.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:48.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178309+0000", 2024-09-12T22:49:48.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5174999999999999e-05 2024-09-12T22:49:48.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:48.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178349+0000", 2024-09-12T22:49:48.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0364999999999997e-05 2024-09-12T22:49:48.775 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.775 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:48.775 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.775 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:48.775 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:48.775 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 103.595776226, 2024-09-12T22:49:48.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078842370000000005, 2024-09-12T22:49:48.775 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:48.775 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:48.775 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:48.775 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:48.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:48.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:48.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:48.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170607+0000", 2024-09-12T22:49:48.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:48.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170608+0000", 2024-09-12T22:49:48.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:49:48.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:48.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170612+0000", 2024-09-12T22:49:48.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3939999999999998e-06 2024-09-12T22:49:48.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.778 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:48.778 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170629+0000", 2024-09-12T22:49:48.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6523000000000001e-05 2024-09-12T22:49:48.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170638+0000", 2024-09-12T22:49:48.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7390000000000005e-06 2024-09-12T22:49:48.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:48.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171481+0000", 2024-09-12T22:49:48.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084353200000000003 2024-09-12T22:49:48.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.781 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:48.781 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171569+0000", 2024-09-12T22:49:48.781 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7800000000000006e-05 2024-09-12T22:49:48.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.781 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:48.781 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171696+0000", 2024-09-12T22:49:48.781 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126797 2024-09-12T22:49:48.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.781 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:48.781 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173276+0000", 2024-09-12T22:49:48.781 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001579848 2024-09-12T22:49:48.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.782 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.782 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:48.782 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178408+0000", 2024-09-12T22:49:48.782 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051325090000000004 2024-09-12T22:49:48.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.782 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.782 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:48.782 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178454+0000", 2024-09-12T22:49:48.782 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5657e-05 2024-09-12T22:49:48.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.782 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.782 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:48.782 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178492+0000", 2024-09-12T22:49:48.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:49:48.783 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.783 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:48.783 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.783 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:48.783 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:48.783 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 103.595733508, 2024-09-12T22:49:48.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083973659999999999, 2024-09-12T22:49:48.783 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:48.783 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:48.783 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:48.783 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:48.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.784 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:48.784 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:48.784 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.784 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:48.784 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170650+0000", 2024-09-12T22:49:48.784 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.784 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:48.785 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170651+0000", 2024-09-12T22:49:48.785 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:49:48.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.785 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.785 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:48.785 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170663+0000", 2024-09-12T22:49:48.785 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1970000000000001e-05 2024-09-12T22:49:48.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.786 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:48.786 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170671+0000", 2024-09-12T22:49:48.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2830000000000001e-06 2024-09-12T22:49:48.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.786 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.786 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170679+0000", 2024-09-12T22:49:48.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7579999999999992e-06 2024-09-12T22:49:48.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.786 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:48.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171417+0000", 2024-09-12T22:49:48.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00073795700000000002 2024-09-12T22:49:48.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:48.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171576+0000", 2024-09-12T22:49:48.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015956799999999999 2024-09-12T22:49:48.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:48.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171749+0000", 2024-09-12T22:49:48.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017243400000000001 2024-09-12T22:49:48.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.788 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:48.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173281+0000", 2024-09-12T22:49:48.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015327019999999999 2024-09-12T22:49:48.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.788 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:48.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178937+0000", 2024-09-12T22:49:48.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056561019999999997 2024-09-12T22:49:48.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.788 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:48.789 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178983+0000", 2024-09-12T22:49:48.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.583e-05 2024-09-12T22:49:48.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:48.789 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179047+0000", 2024-09-12T22:49:48.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4065000000000004e-05 2024-09-12T22:49:48.789 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.790 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:48.790 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.790 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:48.790 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:48.790 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 103.59569559099999, 2024-09-12T22:49:48.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084639190000000003, 2024-09-12T22:49:48.790 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:48.791 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:48.791 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:48.791 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:48.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:48.791 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:48.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:48.791 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170688+0000", 2024-09-12T22:49:48.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:48.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170689+0000", 2024-09-12T22:49:48.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1399999999999997e-07 2024-09-12T22:49:48.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:48.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170693+0000", 2024-09-12T22:49:48.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:49:48.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:48.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170700+0000", 2024-09-12T22:49:48.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.99e-06 2024-09-12T22:49:48.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170705+0000", 2024-09-12T22:49:48.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1900000000000003e-06 2024-09-12T22:49:48.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:48.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172272+0000", 2024-09-12T22:49:48.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001566401 2024-09-12T22:49:48.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:48.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172342+0000", 2024-09-12T22:49:48.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0488999999999995e-05 2024-09-12T22:49:48.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:48.796 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:48.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012512600000000001 2024-09-12T22:49:48.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.796 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.796 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:48.796 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173287+0000", 2024-09-12T22:49:48.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081927900000000001 2024-09-12T22:49:48.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.796 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.796 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:48.796 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179081+0000", 2024-09-12T22:49:48.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057943780000000002 2024-09-12T22:49:48.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:48.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179126+0000", 2024-09-12T22:49:48.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5541999999999999e-05 2024-09-12T22:49:48.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:48.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.179152+0000", 2024-09-12T22:49:48.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5389999999999999e-05 2024-09-12T22:49:48.797 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.797 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:48.797 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.798 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:48.798 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:48.798 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 103.59567214, 2024-09-12T22:49:48.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007902694, 2024-09-12T22:49:48.798 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:48.798 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:48.798 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:48.798 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:48.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:48.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:48.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:48.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170711+0000", 2024-09-12T22:49:48.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:48.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170712+0000", 2024-09-12T22:49:48.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2024-09-12T22:49:48.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:48.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170715+0000", 2024-09-12T22:49:48.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.191e-06 2024-09-12T22:49:48.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.800 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:48.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170722+0000", 2024-09-12T22:49:48.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.46e-06 2024-09-12T22:49:48.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170727+0000", 2024-09-12T22:49:48.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:49:48.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:48.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172230+0000", 2024-09-12T22:49:48.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015030149999999999 2024-09-12T22:49:48.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:48.802 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172353+0000", 2024-09-12T22:49:48.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278300000000001 2024-09-12T22:49:48.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.802 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.802 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-12T22:49:48.802 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172467+0000", 2024-09-12T22:49:48.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114109 2024-09-12T22:49:48.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.802 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.802 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:48.802 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.173776+0000", 2024-09-12T22:49:48.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087140000000001 2024-09-12T22:49:48.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.803 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:48.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178522+0000", 2024-09-12T22:49:48.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047462429999999998 2024-09-12T22:49:48.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.803 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:48.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178576+0000", 2024-09-12T22:49:48.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3807999999999997e-05 2024-09-12T22:49:48.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:48.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178614+0000", 2024-09-12T22:49:48.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8047999999999999e-05 2024-09-12T22:49:48.804 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.804 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:48.804 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.804 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:48.804 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:48.804 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 103.595619986, 2024-09-12T22:49:48.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071845859999999998, 2024-09-12T22:49:48.805 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:48.805 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:48.805 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:48.805 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:48.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:48.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:48.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:48.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:48.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:48.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170764+0000", 2024-09-12T22:49:48.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:49:48.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:48.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170767+0000", 2024-09-12T22:49:48.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1140000000000002e-06 2024-09-12T22:49:48.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.807 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.807 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:48.807 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170776+0000", 2024-09-12T22:49:48.807 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:49:48.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.807 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.807 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.807 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170783+0000", 2024-09-12T22:49:48.807 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9720000000000003e-06 2024-09-12T22:49:48.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.807 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.808 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:48.808 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171536+0000", 2024-09-12T22:49:48.808 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00075303399999999997 2024-09-12T22:49:48.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.808 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:48.808 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171670+0000", 2024-09-12T22:49:48.808 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448900000000001 2024-09-12T22:49:48.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.808 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:48.808 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.177948+0000", 2024-09-12T22:49:48.808 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062778089999999996 2024-09-12T22:49:48.809 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.809 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:48.809 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.809 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:48.809 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:48.809 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 103.595545491, 2024-09-12T22:49:48.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078845740000000001, 2024-09-12T22:49:48.809 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:48.809 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:48.809 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:48.809 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:48.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.810 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:48.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:48.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.810 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:48.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170838+0000", 2024-09-12T22:49:48.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.810 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:48.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170839+0000", 2024-09-12T22:49:48.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:49:48.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.811 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:48.811 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170842+0000", 2024-09-12T22:49:48.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4450000000000001e-06 2024-09-12T22:49:48.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.812 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:48.812 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170850+0000", 2024-09-12T22:49:48.812 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2120000000000003e-06 2024-09-12T22:49:48.812 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.812 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.812 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170871+0000", 2024-09-12T22:49:48.812 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0237999999999998e-05 2024-09-12T22:49:48.812 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.812 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:48.812 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172832+0000", 2024-09-12T22:49:48.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001961703 2024-09-12T22:49:48.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.813 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:48.813 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.172973+0000", 2024-09-12T22:49:48.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014119800000000001 2024-09-12T22:49:48.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.813 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:48.813 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178723+0000", 2024-09-12T22:49:48.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057491520000000004 2024-09-12T22:49:48.813 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.813 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:48.814 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.814 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:49:48.814 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:48.814 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 103.595499463, 2024-09-12T22:49:48.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072939789999999999, 2024-09-12T22:49:48.814 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:48.814 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:48.814 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:48.814 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:48.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:48.814 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:48.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:48.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170884+0000", 2024-09-12T22:49:48.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:48.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170885+0000", 2024-09-12T22:49:48.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5700000000000002e-07 2024-09-12T22:49:48.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.816 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:48.816 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170888+0000", 2024-09-12T22:49:48.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:49:48.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.816 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:48.816 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170904+0000", 2024-09-12T22:49:48.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:49:48.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.817 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.817 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.817 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170911+0000", 2024-09-12T22:49:48.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1380000000000001e-06 2024-09-12T22:49:48.817 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.817 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.817 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:48.817 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.170973+0000", 2024-09-12T22:49:48.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1549000000000003e-05 2024-09-12T22:49:48.817 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.817 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.817 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:48.817 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.171074+0000", 2024-09-12T22:49:48.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010097700000000001 2024-09-12T22:49:48.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.818 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.818 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:48.818 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:48:05.178178+0000", 2024-09-12T22:49:48.818 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007104043 2024-09-12T22:49:48.818 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.818 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:48.818 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.819 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.819 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.819 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:48.819 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.160867+0000", 2024-09-12T22:49:48.819 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.6055162910000007, 2024-09-12T22:49:48.819 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018225736999999999, 2024-09-12T22:49:48.819 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:48.820 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:48.820 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:48.820 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:48.820 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:48.820 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:48.820 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 5 2024-09-12T22:49:48.820 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.820 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:48.820 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.820 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:48.820 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.160867+0000", 2024-09-12T22:49:48.820 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.821 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.821 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.821 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:48.821 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.160867+0000", 2024-09-12T22:49:48.821 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.821 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.821 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.821 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:48.821 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.160869+0000", 2024-09-12T22:49:48.821 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1500000000000002e-06 2024-09-12T22:49:48.821 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.822 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.822 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:48.822 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.167303+0000", 2024-09-12T22:49:48.822 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0064335690000000001 2024-09-12T22:49:48.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.822 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.822 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:48.822 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.167320+0000", 2024-09-12T22:49:48.822 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7329e-05 2024-09-12T22:49:48.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.823 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.823 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.167329+0000", 2024-09-12T22:49:48.823 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4069999999999993e-06 2024-09-12T22:49:48.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.823 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:48.823 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.167402+0000", 2024-09-12T22:49:48.823 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3184999999999998e-05 2024-09-12T22:49:48.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.824 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.824 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:48.824 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.167550+0000", 2024-09-12T22:49:48.824 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014852499999999999 2024-09-12T22:49:48.824 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.824 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.824 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:48.824 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.167689+0000", 2024-09-12T22:49:48.824 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013904799999999999 2024-09-12T22:49:48.824 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.824 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.824 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:48.825 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.176328+0000", 2024-09-12T22:49:48.825 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0086384979999999997 2024-09-12T22:49:48.825 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.825 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.825 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:48.825 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.179037+0000", 2024-09-12T22:49:48.825 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027092599999999998 2024-09-12T22:49:48.825 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.825 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.825 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:48.825 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.179066+0000", 2024-09-12T22:49:48.825 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9132000000000002e-05 2024-09-12T22:49:48.825 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.826 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.826 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:48.826 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.179093+0000", 2024-09-12T22:49:48.826 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6633999999999999e-05 2024-09-12T22:49:48.826 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.826 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:48.826 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.826 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.826 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:57 4.9 e50/17 4:91e366d7:::10000000230.00000000:head v 50'1, mlcod=0'0)", 2024-09-12T22:49:48.826 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.217245+0000", 2024-09-12T22:49:48.826 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.5491385560000008, 2024-09-12T22:49:48.826 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078517689999999998, 2024-09-12T22:49:48.827 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:48.827 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:48.827 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:48.827 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:48.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.827 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:48.827 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217245+0000", 2024-09-12T22:49:48.827 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.828 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:48.828 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217245+0000", 2024-09-12T22:49:48.828 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.828 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.828 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.828 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:48.828 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217246+0000", 2024-09-12T22:49:48.828 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5199999999999996e-07 2024-09-12T22:49:48.828 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.828 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.828 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:48.829 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217253+0000", 2024-09-12T22:49:48.829 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1330000000000001e-06 2024-09-12T22:49:48.829 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.829 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.829 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:48.829 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217261+0000", 2024-09-12T22:49:48.829 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4500000000000004e-06 2024-09-12T22:49:48.829 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.829 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.830 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.830 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217267+0000", 2024-09-12T22:49:48.830 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-06 2024-09-12T22:49:48.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.830 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.830 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:48.830 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217309+0000", 2024-09-12T22:49:48.831 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1535000000000001e-05 2024-09-12T22:49:48.831 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.831 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.831 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:48.831 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.217325+0000", 2024-09-12T22:49:48.831 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6208000000000001e-05 2024-09-12T22:49:48.831 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.831 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.832 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:48.832 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.225071+0000", 2024-09-12T22:49:48.832 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077461470000000001 2024-09-12T22:49:48.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.832 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.832 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:48.832 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.225097+0000", 2024-09-12T22:49:48.832 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5384e-05 2024-09-12T22:49:48.832 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.833 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:48.833 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.833 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.833 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.833 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:144 4.20 4:069ea127:::10000000289.00000000:head [write 0~1223] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:48.833 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.294752+0000", 2024-09-12T22:49:48.833 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.4716310830000001, 2024-09-12T22:49:48.834 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083421970000000008, 2024-09-12T22:49:48.834 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:48.834 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:48.834 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:48.834 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:48.834 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:48.835 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:48.835 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 144 2024-09-12T22:49:48.835 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.835 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:48.836 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.836 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:48.837 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294752+0000", 2024-09-12T22:49:48.837 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.837 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:48.837 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294752+0000", 2024-09-12T22:49:48.837 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.837 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:48.838 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294753+0000", 2024-09-12T22:49:48.838 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.37e-07 2024-09-12T22:49:48.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.838 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:48.838 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294757+0000", 2024-09-12T22:49:48.838 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.811e-06 2024-09-12T22:49:48.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.838 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:48.838 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294765+0000", 2024-09-12T22:49:48.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0390000000000005e-06 2024-09-12T22:49:48.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.839 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.839 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294771+0000", 2024-09-12T22:49:48.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2689999999999996e-06 2024-09-12T22:49:48.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.839 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:48.839 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294816+0000", 2024-09-12T22:49:48.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5046000000000002e-05 2024-09-12T22:49:48.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.840 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.840 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:48.840 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.294887+0000", 2024-09-12T22:49:48.840 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0609000000000001e-05 2024-09-12T22:49:48.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.840 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.840 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:48.840 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.302989+0000", 2024-09-12T22:49:48.840 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081019409999999997 2024-09-12T22:49:48.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.840 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.841 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:48.841 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.303033+0000", 2024-09-12T22:49:48.841 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4190999999999998e-05 2024-09-12T22:49:48.841 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.841 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.841 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:48.841 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.303095+0000", 2024-09-12T22:49:48.841 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1654000000000003e-05 2024-09-12T22:49:48.841 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.841 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:48.841 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.841 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.841 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.842 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:150 4.a 4:53071690:::1000000028f.00000000:head [write 0~111] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:48.842 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.301030+0000", 2024-09-12T22:49:48.842 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.4653537930000002, 2024-09-12T22:49:48.842 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077464659999999996, 2024-09-12T22:49:48.842 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:48.842 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:48.842 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:48.842 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:48.842 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:48.842 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:48.842 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 150 2024-09-12T22:49:48.842 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.842 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:48.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.843 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:48.843 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301030+0000", 2024-09-12T22:49:48.843 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.843 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:48.843 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301030+0000", 2024-09-12T22:49:48.843 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.844 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:48.844 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301031+0000", 2024-09-12T22:49:48.844 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.13e-06 2024-09-12T22:49:48.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.844 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:48.844 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301036+0000", 2024-09-12T22:49:48.844 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3519999999999997e-06 2024-09-12T22:49:48.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.845 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:48.845 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301050+0000", 2024-09-12T22:49:48.845 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3705e-05 2024-09-12T22:49:48.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.845 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.845 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.845 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301060+0000", 2024-09-12T22:49:48.845 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0042e-05 2024-09-12T22:49:48.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.845 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.846 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:48.846 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301114+0000", 2024-09-12T22:49:48.846 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4421e-05 2024-09-12T22:49:48.846 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.846 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.846 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:48.846 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301231+0000", 2024-09-12T22:49:48.846 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116552 2024-09-12T22:49:48.846 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.846 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.846 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:48.846 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.308695+0000", 2024-09-12T22:49:48.847 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0074639459999999999 2024-09-12T22:49:48.847 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.847 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.847 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:48.847 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.308735+0000", 2024-09-12T22:49:48.847 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0181e-05 2024-09-12T22:49:48.847 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.848 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.848 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:48.848 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.308776+0000", 2024-09-12T22:49:48.848 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1137000000000003e-05 2024-09-12T22:49:48.848 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.848 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:48.848 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.848 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.848 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.848 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:151 4.7 4:e25a3370:::10000000290.00000000:head [write 0~6349] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:48.848 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.301970+0000", 2024-09-12T22:49:48.848 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.4644135919999997, 2024-09-12T22:49:48.849 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082601040000000008, 2024-09-12T22:49:48.849 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:48.849 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:48.849 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:48.849 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:48.849 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:48.849 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:48.849 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 151 2024-09-12T22:49:48.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.849 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:48.849 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.850 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:48.850 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301970+0000", 2024-09-12T22:49:48.850 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.850 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.850 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:48.850 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301970+0000", 2024-09-12T22:49:48.850 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.850 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.851 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:48.851 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301970+0000", 2024-09-12T22:49:48.851 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0699999999999998e-07 2024-09-12T22:49:48.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.852 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:48.852 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301977+0000", 2024-09-12T22:49:48.852 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0890000000000002e-06 2024-09-12T22:49:48.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.852 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.852 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:48.852 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301984+0000", 2024-09-12T22:49:48.852 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.511e-06 2024-09-12T22:49:48.853 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.853 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.853 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.853 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.301988+0000", 2024-09-12T22:49:48.853 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7079999999999999e-06 2024-09-12T22:49:48.853 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.853 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.853 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:48.853 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.302027+0000", 2024-09-12T22:49:48.853 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9113999999999999e-05 2024-09-12T22:49:48.853 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.853 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.853 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:48.854 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.302099+0000", 2024-09-12T22:49:48.854 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2673e-05 2024-09-12T22:49:48.854 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.854 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.854 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:48.854 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.302174+0000", 2024-09-12T22:49:48.854 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4274000000000001e-05 2024-09-12T22:49:48.854 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.854 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.854 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:48.854 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.308696+0000", 2024-09-12T22:49:48.854 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065225159999999999 2024-09-12T22:49:48.854 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.854 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.855 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:48.855 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.310175+0000", 2024-09-12T22:49:48.855 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014790350000000001 2024-09-12T22:49:48.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.855 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:48.855 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.310205+0000", 2024-09-12T22:49:48.855 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9799e-05 2024-09-12T22:49:48.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.855 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:48.855 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.310230+0000", 2024-09-12T22:49:48.855 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4978e-05 2024-09-12T22:49:48.856 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.856 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:48.856 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.856 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:194 4.16 4:6af67b46:::100000002bb.00000000:head [write 0~111] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:48.856 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.339531+0000", 2024-09-12T22:49:48.856 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.4268524300000003, 2024-09-12T22:49:48.856 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073351789999999998, 2024-09-12T22:49:48.856 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:48.856 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:48.856 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:48.856 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:48.857 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:48.857 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:48.857 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 194 2024-09-12T22:49:48.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.857 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:48.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.857 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:48.857 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339531+0000", 2024-09-12T22:49:48.858 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.858 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:48.858 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339531+0000", 2024-09-12T22:49:48.858 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.858 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:48.859 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339532+0000", 2024-09-12T22:49:48.859 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8100000000000002e-07 2024-09-12T22:49:48.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.859 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:48.859 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339536+0000", 2024-09-12T22:49:48.859 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8739999999999997e-06 2024-09-12T22:49:48.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.860 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:48.860 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339546+0000", 2024-09-12T22:49:48.860 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0567999999999999e-05 2024-09-12T22:49:48.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.860 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.860 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339552+0000", 2024-09-12T22:49:48.861 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4750000000000001e-06 2024-09-12T22:49:48.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.861 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:48.861 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339593+0000", 2024-09-12T22:49:48.861 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1230999999999999e-05 2024-09-12T22:49:48.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.862 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:48.862 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.339664+0000", 2024-09-12T22:49:48.862 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0769e-05 2024-09-12T22:49:48.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.862 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:48.862 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.346724+0000", 2024-09-12T22:49:48.862 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070602249999999998 2024-09-12T22:49:48.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:48.863 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.346778+0000", 2024-09-12T22:49:48.863 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4469999999999999e-05 2024-09-12T22:49:48.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:48.864 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.346866+0000", 2024-09-12T22:49:48.864 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7786000000000003e-05 2024-09-12T22:49:48.864 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.864 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:48.864 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.864 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:198 4.12 4:4a0eff6f:::100000002bf.00000000:head [write 0~98] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:48.864 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.343572+0000", 2024-09-12T22:49:48.865 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.4228116830000008, 2024-09-12T22:49:48.865 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0084413230000000006, 2024-09-12T22:49:48.865 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:48.865 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:48.865 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:48.865 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:48.865 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:48.865 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:48.866 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 198 2024-09-12T22:49:48.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.866 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:48.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.866 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:48.866 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343572+0000", 2024-09-12T22:49:48.866 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.867 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:48.867 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343572+0000", 2024-09-12T22:49:48.867 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.867 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.867 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:48.867 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343573+0000", 2024-09-12T22:49:48.867 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:49:48.868 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.868 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.868 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:48.868 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343578+0000", 2024-09-12T22:49:48.868 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4750000000000001e-06 2024-09-12T22:49:48.868 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.868 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.868 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:48.869 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343589+0000", 2024-09-12T22:49:48.869 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0709e-05 2024-09-12T22:49:48.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.869 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.869 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343594+0000", 2024-09-12T22:49:48.869 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4360000000000001e-06 2024-09-12T22:49:48.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.870 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:48.870 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343668+0000", 2024-09-12T22:49:48.870 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3907999999999998e-05 2024-09-12T22:49:48.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.870 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:48.871 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343741+0000", 2024-09-12T22:49:48.871 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2922000000000004e-05 2024-09-12T22:49:48.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.871 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:48.871 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.343841+0000", 2024-09-12T22:49:48.871 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100412 2024-09-12T22:49:48.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.871 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:48.872 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349501+0000", 2024-09-12T22:49:48.872 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005659776 2024-09-12T22:49:48.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.872 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.872 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:48.872 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.351940+0000", 2024-09-12T22:49:48.872 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024390839999999998 2024-09-12T22:49:48.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.872 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.872 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:48.872 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.351986+0000", 2024-09-12T22:49:48.873 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5970999999999997e-05 2024-09-12T22:49:48.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.873 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.873 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:48.873 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352013+0000", 2024-09-12T22:49:48.873 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6871000000000001e-05 2024-09-12T22:49:48.873 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.873 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:48.873 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.873 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.873 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:205 4.37 4:ef7c8488:::100000002c6.00000000:head [write 0~98] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:48.873 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.349405+0000", 2024-09-12T22:49:48.874 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.4169789569999995, 2024-09-12T22:49:48.874 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078250019999999993, 2024-09-12T22:49:48.874 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:48.874 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:48.874 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:48.874 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:48.874 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:48.874 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:48.874 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 205 2024-09-12T22:49:48.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.874 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:48.874 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.874 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:48.874 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349405+0000", 2024-09-12T22:49:48.875 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.875 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.875 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:48.875 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349405+0000", 2024-09-12T22:49:48.875 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.875 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.875 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:48.875 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349405+0000", 2024-09-12T22:49:48.875 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4900000000000005e-07 2024-09-12T22:49:48.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.875 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.876 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:48.876 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349409+0000", 2024-09-12T22:49:48.876 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1359999999999999e-06 2024-09-12T22:49:48.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.876 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:48.876 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349418+0000", 2024-09-12T22:49:48.876 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3289999999999994e-06 2024-09-12T22:49:48.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.876 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.876 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349423+0000", 2024-09-12T22:49:48.876 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9949999999999996e-06 2024-09-12T22:49:48.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.877 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:48.877 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349469+0000", 2024-09-12T22:49:48.877 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6008999999999999e-05 2024-09-12T22:49:48.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.877 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:48.877 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349570+0000", 2024-09-12T22:49:48.877 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100831 2024-09-12T22:49:48.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.877 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:48.877 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.349682+0000", 2024-09-12T22:49:48.877 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011268 2024-09-12T22:49:48.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.878 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:48.878 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.351968+0000", 2024-09-12T22:49:48.878 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022860379999999998 2024-09-12T22:49:48.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.878 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:48.878 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.357145+0000", 2024-09-12T22:49:48.878 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051769759999999998 2024-09-12T22:49:48.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.878 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:48.878 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.357187+0000", 2024-09-12T22:49:48.879 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1248999999999998e-05 2024-09-12T22:49:48.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.879 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.879 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:48.879 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.357230+0000", 2024-09-12T22:49:48.879 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3010000000000003e-05 2024-09-12T22:49:48.879 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.879 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:48.879 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.879 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.879 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:208 4.1c e50/17 4:3b628a21:::100000002c9.00000000:head v 50'2, mlcod=0'0)", 2024-09-12T22:49:48.879 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.352179+0000", 2024-09-12T22:49:48.880 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.4142049379999992, 2024-09-12T22:49:48.880 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0076543849999999997, 2024-09-12T22:49:48.880 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:48.880 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:48.880 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:48.880 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:48.880 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.880 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:48.880 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352179+0000", 2024-09-12T22:49:48.880 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.880 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.881 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.881 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:48.881 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352179+0000", 2024-09-12T22:49:48.881 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.881 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.881 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.881 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:48.881 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352179+0000", 2024-09-12T22:49:48.881 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0200000000000002e-07 2024-09-12T22:49:48.881 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.881 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.881 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:48.881 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352184+0000", 2024-09-12T22:49:48.882 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0470000000000001e-06 2024-09-12T22:49:48.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.882 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:48.882 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352190+0000", 2024-09-12T22:49:48.882 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9519999999999999e-06 2024-09-12T22:49:48.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.882 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.882 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352194+0000", 2024-09-12T22:49:48.882 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.369e-06 2024-09-12T22:49:48.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.882 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:48.883 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352232+0000", 2024-09-12T22:49:48.883 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7752e-05 2024-09-12T22:49:48.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.883 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.883 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:48.883 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.352249+0000", 2024-09-12T22:49:48.883 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6796e-05 2024-09-12T22:49:48.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.883 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.883 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:48.883 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.359795+0000", 2024-09-12T22:49:48.883 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0075457989999999997 2024-09-12T22:49:48.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.884 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.884 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:48.884 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.359833+0000", 2024-09-12T22:49:48.884 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8167999999999998e-05 2024-09-12T22:49:48.884 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.884 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:48.884 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.884 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.884 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.884 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:247 4.a 4:5080b297:::100000002f5.00000000:head [write 0~12498] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:48.884 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.390848+0000", 2024-09-12T22:49:48.884 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.3755353410000009, 2024-09-12T22:49:48.884 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071234089999999998, 2024-09-12T22:49:48.885 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:48.885 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:48.885 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:48.885 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:48.885 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:48.885 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:48.885 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 247 2024-09-12T22:49:48.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.885 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:48.885 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.885 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:48.885 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.390848+0000", 2024-09-12T22:49:48.885 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.886 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.886 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:48.886 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.390848+0000", 2024-09-12T22:49:48.886 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.886 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.886 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.886 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:48.886 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.390849+0000", 2024-09-12T22:49:48.886 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7000000000000004e-07 2024-09-12T22:49:48.886 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.886 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.886 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:48.886 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.390860+0000", 2024-09-12T22:49:48.887 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.151e-05 2024-09-12T22:49:48.887 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.887 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.887 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:48.887 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.390869+0000", 2024-09-12T22:49:48.887 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3389999999999993e-06 2024-09-12T22:49:48.887 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.887 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.887 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.887 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.390877+0000", 2024-09-12T22:49:48.887 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3310000000000004e-06 2024-09-12T22:49:48.887 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.887 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.887 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:48.888 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.390930+0000", 2024-09-12T22:49:48.888 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2685999999999997e-05 2024-09-12T22:49:48.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.888 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:48.888 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.391048+0000", 2024-09-12T22:49:48.888 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000118566 2024-09-12T22:49:48.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.888 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:48.889 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.397864+0000", 2024-09-12T22:49:48.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0068154690000000002 2024-09-12T22:49:48.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.889 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:48.889 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.397904+0000", 2024-09-12T22:49:48.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0185000000000002e-05 2024-09-12T22:49:48.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.889 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:48.889 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.397972+0000", 2024-09-12T22:49:48.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7552999999999995e-05 2024-09-12T22:49:48.889 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.890 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:48.890 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.890 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.890 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.890 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:85 3.1a e53/16 3:5e41ab69:::200.00000005:head v 53'3, mlcod=18'1)", 2024-09-12T22:49:48.890 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:47.160254+0000", 2024-09-12T22:49:48.890 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 1.606129143, 2024-09-12T22:49:48.890 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0095139999999999999, 2024-09-12T22:49:48.890 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:48.890 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:48.890 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:48.891 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:48.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.891 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:48.891 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.160254+0000", 2024-09-12T22:49:48.891 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.891 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:48.891 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.160254+0000", 2024-09-12T22:49:48.891 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.892 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.892 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:48.892 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.160255+0000", 2024-09-12T22:49:48.892 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9400000000000005e-07 2024-09-12T22:49:48.892 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.892 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.892 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:48.892 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.162952+0000", 2024-09-12T22:49:48.892 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002697362 2024-09-12T22:49:48.892 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.892 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.892 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:48.893 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.162959+0000", 2024-09-12T22:49:48.893 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.392e-06 2024-09-12T22:49:48.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.893 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.893 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.162966+0000", 2024-09-12T22:49:48.893 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1069999999999999e-06 2024-09-12T22:49:48.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.893 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:48.893 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.163008+0000", 2024-09-12T22:49:48.893 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2138999999999998e-05 2024-09-12T22:49:48.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:48.894 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.163027+0000", 2024-09-12T22:49:48.894 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9284e-05 2024-09-12T22:49:48.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:48.894 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.169732+0000", 2024-09-12T22:49:48.894 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0067044490000000003 2024-09-12T22:49:48.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:48.895 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.169768+0000", 2024-09-12T22:49:48.895 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6672999999999999e-05 2024-09-12T22:49:48.895 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.895 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:48.895 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.895 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.895 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:156 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:48.895 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:47.186337+0000", 2024-09-12T22:49:48.895 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 1.5800468680000002, 2024-09-12T22:49:48.895 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079697589999999999, 2024-09-12T22:49:48.895 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:48.895 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:48.896 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:48.896 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:48.896 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.896 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:48.896 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.186337+0000", 2024-09-12T22:49:48.896 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.896 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.896 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:48.896 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.186337+0000", 2024-09-12T22:49:48.896 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:48.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.897 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.897 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:48.897 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.186337+0000", 2024-09-12T22:49:48.897 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5799999999999998e-07 2024-09-12T22:49:48.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.897 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.897 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:48.897 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.186462+0000", 2024-09-12T22:49:48.897 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012466699999999999 2024-09-12T22:49:48.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.897 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.898 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:48.898 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.186472+0000", 2024-09-12T22:49:48.898 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4490000000000005e-06 2024-09-12T22:49:48.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.898 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:48.898 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.186480+0000", 2024-09-12T22:49:48.898 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6940000000000001e-06 2024-09-12T22:49:48.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.898 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:48.898 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.186517+0000", 2024-09-12T22:49:48.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6445000000000001e-05 2024-09-12T22:49:48.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:48.899 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.186573+0000", 2024-09-12T22:49:48.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6221000000000003e-05 2024-09-12T22:49:48.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:48.899 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.194171+0000", 2024-09-12T22:49:48.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0075985280000000002 2024-09-12T22:49:48.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:48.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.194227+0000", 2024-09-12T22:49:48.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5862000000000001e-05 2024-09-12T22:49:48.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:48.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:48.900 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:48.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:47.194306+0000", 2024-09-12T22:49:48.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9134999999999994e-05 2024-09-12T22:49:48.900 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.900 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:48.900 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.900 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:48.900 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:48.900 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:48.902 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:48.903 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:48.901+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:49.002 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:49.001+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:49.010 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:49.011 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:49:49.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:49.011 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:8765 4.1f 4:f9c8b310:::10000002814.00000000:head [write 0~915 in=915b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:49:49.011 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:49.009809+0000", 2024-09-12T22:49:49.011 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.00056979000000000003, 2024-09-12T22:49:49.012 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00058613100000000004, 2024-09-12T22:49:49.012 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:49.012 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:49.012 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:49.012 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:49.013 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:49.013 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:49.013 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 8765 2024-09-12T22:49:49.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:49.013 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:49.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:49.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:49.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:49.009809+0000", 2024-09-12T22:49:49.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:49.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:49.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:49.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:49.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:49.009809+0000", 2024-09-12T22:49:49.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:49.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:49.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:49.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:49.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:49.009809+0000", 2024-09-12T22:49:49.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1900000000000001e-07 2024-09-12T22:49:49.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:49.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:49.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:49.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:49.009814+0000", 2024-09-12T22:49:49.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3069999999999996e-06 2024-09-12T22:49:49.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:49.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:49.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:49.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:49.009824+0000", 2024-09-12T22:49:49.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0033e-05 2024-09-12T22:49:49.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:49.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:49.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:49.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:49.009831+0000", 2024-09-12T22:49:49.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2019999999999998e-06 2024-09-12T22:49:49.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:49.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:49.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:49.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:49.009904+0000", 2024-09-12T22:49:49.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3221999999999998e-05 2024-09-12T22:49:49.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:49.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:49.018 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:49.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:49.009985+0000", 2024-09-12T22:49:49.019 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0283000000000004e-05 2024-09-12T22:49:49.019 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:49.019 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:49.019 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:49.019 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:49.019 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-12T22:49:49.019 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 1 2024-09-12T22:49:49.020 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:49.021 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:49.079 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:49:49.106 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:49.105+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:49.170 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:49.170 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:49.170 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:49:49.170 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:49:49.170 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:49.179 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:49.220 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:49.219+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:49.220 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:49:49.221 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:49:49.240 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:49:49.241 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:49:49.241 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:49:49.244 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:49:49.244 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:49:49.306 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:49.304+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:49.326 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:49.327 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:49.337 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:49.407 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:49.406+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:49.447 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:49.447 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:49.456 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:49.509 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:49.508+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:49.565 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:49.565 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:49.574 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:49.609 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:49.608+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:49.632 INFO:teuthology.orchestra.run.smithi066.stderr:nodeep-scrub is set 2024-09-12T22:49:49.685 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:49.685 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:49.695 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:49.739 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:49.738+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:49.804 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:49.804 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:49.811 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:49.810+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:49.813 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:49.912 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:49.910+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:49.964 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:49.964 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:49.974 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:50.019 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:50.018+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:50.081 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:50.081 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:50.090 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:50.131 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:50.130+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:50.199 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:50.199 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:50.208 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:50.252 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:50.250+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:50.314 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:50.314 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:50.315 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:50.313+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:50.323 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:50.416 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:50.415+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:50.480 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:50.480 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:50.490 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:50.532 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:50.530+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:50.601 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:50.601 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:50.611 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:50.655 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:50.654+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:50.719 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:50.719 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:50.720 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:50.718+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:50.728 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:50.820 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:50.819+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:50.882 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:50.882 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:50.891 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:50.932 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:50.931+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:51.003 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:51.004 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:51.013 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:51.057 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:51.055+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:51.121 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:51.121 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:51.123 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:51.121+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:51.131 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:51.133 INFO:tasks.workunit.client.0.smithi066.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-12T22:49:51.136 INFO:tasks.workunit.client.0.smithi066.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-12T22:49:51.136 INFO:tasks.workunit.client.0.smithi066.stderr:+ make 2024-09-12T22:49:51.185 INFO:tasks.workunit.client.0.smithi066.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-12T22:49:51.225 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:51.224+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:51.245 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:49:51.273 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:51.273 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:51.281 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:51.326 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:51.324+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:51.383 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:51.383 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:51.386 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:49:51.387 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:49:51.392 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:51.404 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:49:51.405 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:49:51.405 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:49:51.407 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:49:51.408 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:49:51.436 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:51.435+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:51.478 INFO:tasks.workunit.client.0.smithi066.stderr:++ readlink -f fsstress 2024-09-12T22:49:51.479 INFO:tasks.workunit.client.0.smithi066.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-12T22:49:51.479 INFO:tasks.workunit.client.0.smithi066.stderr:+ popd 2024-09-12T22:49:51.480 INFO:tasks.workunit.client.0.smithi066.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-12T22:49:51.480 INFO:tasks.workunit.client.0.smithi066.stderr:+ popd 2024-09-12T22:49:51.481 INFO:tasks.workunit.client.0.smithi066.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-12T22:49:51.481 INFO:tasks.workunit.client.0.smithi066.stderr:++ mktemp -d -p . 2024-09-12T22:49:51.482 INFO:tasks.workunit.client.0.smithi066.stderr:+ T=./tmp.DBxqgsalZD 2024-09-12T22:49:51.482 INFO:tasks.workunit.client.0.smithi066.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.DBxqgsalZD -l 1 -n 1000 -p 10 -v 2024-09-12T22:49:51.484 INFO:tasks.workunit.client.0.smithi066.stdout:seed = 1726223028 2024-09-12T22:49:51.485 INFO:tasks.workunit.client.0.smithi066.stdout:1/0: dread - no filename 2024-09-12T22:49:51.485 INFO:tasks.workunit.client.0.smithi066.stdout:1/1: read - no filename 2024-09-12T22:49:51.486 INFO:tasks.workunit.client.0.smithi066.stdout:0/0: mknod c0 0 2024-09-12T22:49:51.486 INFO:tasks.workunit.client.0.smithi066.stdout:0/1: fdatasync - no filename 2024-09-12T22:49:51.486 INFO:tasks.workunit.client.0.smithi066.stdout:0/2: dread - no filename 2024-09-12T22:49:51.486 INFO:tasks.workunit.client.0.smithi066.stdout:2/0: unlink - no file 2024-09-12T22:49:51.486 INFO:tasks.workunit.client.0.smithi066.stdout:2/1: dwrite - no filename 2024-09-12T22:49:51.486 INFO:tasks.workunit.client.0.smithi066.stdout:2/2: fsync - no filename 2024-09-12T22:49:51.486 INFO:tasks.workunit.client.0.smithi066.stdout:1/2: mkdir d0 0 2024-09-12T22:49:51.487 INFO:tasks.workunit.client.0.smithi066.stdout:1/3: dread - no filename 2024-09-12T22:49:51.487 INFO:tasks.workunit.client.0.smithi066.stdout:0/3: mkdir d1 0 2024-09-12T22:49:51.487 INFO:tasks.workunit.client.0.smithi066.stdout:3/0: truncate - no filename 2024-09-12T22:49:51.487 INFO:tasks.workunit.client.0.smithi066.stdout:3/1: dread - no filename 2024-09-12T22:49:51.487 INFO:tasks.workunit.client.0.smithi066.stdout:2/3: mknod c0 0 2024-09-12T22:49:51.487 INFO:tasks.workunit.client.0.smithi066.stdout:2/4: dread - no filename 2024-09-12T22:49:51.487 INFO:tasks.workunit.client.0.smithi066.stdout:2/5: write - no filename 2024-09-12T22:49:51.487 INFO:tasks.workunit.client.0.smithi066.stdout:2/6: rmdir - no directory 2024-09-12T22:49:51.487 INFO:tasks.workunit.client.0.smithi066.stdout:2/7: truncate - no filename 2024-09-12T22:49:51.488 INFO:tasks.workunit.client.0.smithi066.stdout:0/4: creat d1/f2 x:0 0 0 2024-09-12T22:49:51.488 INFO:tasks.workunit.client.0.smithi066.stdout:2/8: mkdir d1 0 2024-09-12T22:49:51.489 INFO:tasks.workunit.client.0.smithi066.stdout:2/9: write - no filename 2024-09-12T22:49:51.489 INFO:tasks.workunit.client.0.smithi066.stdout:2/10: dwrite - no filename 2024-09-12T22:49:51.489 INFO:tasks.workunit.client.0.smithi066.stdout:3/2: mkdir d0 0 2024-09-12T22:49:51.489 INFO:tasks.workunit.client.0.smithi066.stdout:4/0: write - no filename 2024-09-12T22:49:51.489 INFO:tasks.workunit.client.0.smithi066.stdout:1/4: getdents d0 0 2024-09-12T22:49:51.489 INFO:tasks.workunit.client.0.smithi066.stdout:1/5: dread - no filename 2024-09-12T22:49:51.489 INFO:tasks.workunit.client.0.smithi066.stdout:1/6: write - no filename 2024-09-12T22:49:51.489 INFO:tasks.workunit.client.0.smithi066.stdout:3/3: rename d0 to d0/d1 22 2024-09-12T22:49:51.489 INFO:tasks.workunit.client.0.smithi066.stdout:0/5: mkdir d1/d3 0 2024-09-12T22:49:51.489 INFO:tasks.workunit.client.0.smithi066.stdout:4/1: mknod c0 0 2024-09-12T22:49:51.489 INFO:tasks.workunit.client.0.smithi066.stdout:2/11: mknod d1/c2 0 2024-09-12T22:49:51.489 INFO:tasks.workunit.client.0.smithi066.stdout:0/6: dread - d1/f2 zero size 2024-09-12T22:49:51.493 INFO:tasks.workunit.client.0.smithi066.stdout:4/2: creat f1 x:0 0 0 2024-09-12T22:49:51.493 INFO:tasks.workunit.client.0.smithi066.stdout:1/7: symlink d0/l1 0 2024-09-12T22:49:51.493 INFO:tasks.workunit.client.0.smithi066.stdout:2/12: rmdir d1 39 2024-09-12T22:49:51.494 INFO:tasks.workunit.client.0.smithi066.stdout:2/13: dread - no filename 2024-09-12T22:49:51.494 INFO:tasks.workunit.client.0.smithi066.stdout:2/14: dwrite - no filename 2024-09-12T22:49:51.494 INFO:tasks.workunit.client.0.smithi066.stdout:2/15: dwrite - no filename 2024-09-12T22:49:51.494 INFO:tasks.workunit.client.0.smithi066.stdout:7/0: truncate - no filename 2024-09-12T22:49:51.494 INFO:tasks.workunit.client.0.smithi066.stdout:7/1: rename - no filename 2024-09-12T22:49:51.494 INFO:tasks.workunit.client.0.smithi066.stdout:7/2: truncate - no filename 2024-09-12T22:49:51.494 INFO:tasks.workunit.client.0.smithi066.stdout:7/3: dwrite - no filename 2024-09-12T22:49:51.494 INFO:tasks.workunit.client.0.smithi066.stdout:7/4: readlink - no filename 2024-09-12T22:49:51.494 INFO:tasks.workunit.client.0.smithi066.stdout:5/0: mknod c0 0 2024-09-12T22:49:51.494 INFO:tasks.workunit.client.0.smithi066.stdout:5/1: read - no filename 2024-09-12T22:49:51.494 INFO:tasks.workunit.client.0.smithi066.stdout:4/3: mknod c2 0 2024-09-12T22:49:51.494 INFO:tasks.workunit.client.0.smithi066.stdout:3/4: getdents d0 0 2024-09-12T22:49:51.495 INFO:tasks.workunit.client.0.smithi066.stdout:3/5: unlink - no file 2024-09-12T22:49:51.495 INFO:tasks.workunit.client.0.smithi066.stdout:6/0: creat f0 x:0 0 0 2024-09-12T22:49:51.495 INFO:tasks.workunit.client.0.smithi066.stdout:4/4: stat c2 0 2024-09-12T22:49:51.495 INFO:tasks.workunit.client.0.smithi066.stdout:1/8: creat d0/f2 x:0 0 0 2024-09-12T22:49:51.495 INFO:tasks.workunit.client.0.smithi066.stdout:0/7: rename d1/d3 to d1/d4 0 2024-09-12T22:49:51.495 INFO:tasks.workunit.client.0.smithi066.stdout:6/1: dread - f0 zero size 2024-09-12T22:49:51.495 INFO:tasks.workunit.client.0.smithi066.stdout:7/5: getdents . 0 2024-09-12T22:49:51.495 INFO:tasks.workunit.client.0.smithi066.stdout:7/6: dread - no filename 2024-09-12T22:49:51.495 INFO:tasks.workunit.client.0.smithi066.stdout:7/7: readlink - no filename 2024-09-12T22:49:51.495 INFO:tasks.workunit.client.0.smithi066.stdout:7/8: unlink - no file 2024-09-12T22:49:51.495 INFO:tasks.workunit.client.0.smithi066.stdout:1/9: mknod d0/c3 0 2024-09-12T22:49:51.495 INFO:tasks.workunit.client.0.smithi066.stdout:5/2: link c0 c1 0 2024-09-12T22:49:51.495 INFO:tasks.workunit.client.0.smithi066.stdout:5/3: dread - no filename 2024-09-12T22:49:51.496 INFO:tasks.workunit.client.0.smithi066.stdout:3/6: mkdir d0/d2 0 2024-09-12T22:49:51.496 INFO:tasks.workunit.client.0.smithi066.stdout:6/2: chown f0 82210 1 2024-09-12T22:49:51.496 INFO:tasks.workunit.client.0.smithi066.stdout:8/0: symlink l0 0 2024-09-12T22:49:51.496 INFO:tasks.workunit.client.0.smithi066.stdout:8/1: dread - no filename 2024-09-12T22:49:51.496 INFO:tasks.workunit.client.0.smithi066.stdout:8/2: write - no filename 2024-09-12T22:49:51.496 INFO:tasks.workunit.client.0.smithi066.stdout:9/0: creat f0 x:0 0 0 2024-09-12T22:49:51.496 INFO:tasks.workunit.client.0.smithi066.stdout:0/8: mknod d1/d4/c5 0 2024-09-12T22:49:51.496 INFO:tasks.workunit.client.0.smithi066.stdout:6/3: chown f0 333420 1 2024-09-12T22:49:51.496 INFO:tasks.workunit.client.0.smithi066.stdout:5/4: symlink l2 0 2024-09-12T22:49:51.496 INFO:tasks.workunit.client.0.smithi066.stdout:5/5: write - no filename 2024-09-12T22:49:51.496 INFO:tasks.workunit.client.0.smithi066.stdout:8/3: symlink l1 0 2024-09-12T22:49:51.496 INFO:tasks.workunit.client.0.smithi066.stdout:1/10: dread - d0/f2 zero size 2024-09-12T22:49:51.496 INFO:tasks.workunit.client.0.smithi066.stdout:5/6: readlink l2 0 2024-09-12T22:49:51.497 INFO:tasks.workunit.client.0.smithi066.stdout:5/7: dwrite - no filename 2024-09-12T22:49:51.497 INFO:tasks.workunit.client.0.smithi066.stdout:7/9: getdents . 0 2024-09-12T22:49:51.497 INFO:tasks.workunit.client.0.smithi066.stdout:9/1: symlink l1 0 2024-09-12T22:49:51.497 INFO:tasks.workunit.client.0.smithi066.stdout:7/10: chown . 388 1 2024-09-12T22:49:51.497 INFO:tasks.workunit.client.0.smithi066.stdout:8/4: rename l1 to l2 0 2024-09-12T22:49:51.497 INFO:tasks.workunit.client.0.smithi066.stdout:8/5: write - no filename 2024-09-12T22:49:51.497 INFO:tasks.workunit.client.0.smithi066.stdout:8/6: write - no filename 2024-09-12T22:49:51.497 INFO:tasks.workunit.client.0.smithi066.stdout:8/7: write - no filename 2024-09-12T22:49:51.497 INFO:tasks.workunit.client.0.smithi066.stdout:0/9: truncate d1/f2 558613 0 2024-09-12T22:49:51.497 INFO:tasks.workunit.client.0.smithi066.stdout:6/4: rename f0 to f1 0 2024-09-12T22:49:51.497 INFO:tasks.workunit.client.0.smithi066.stdout:2/16: creat d1/f3 x:0 0 0 2024-09-12T22:49:51.497 INFO:tasks.workunit.client.0.smithi066.stdout:5/8: creat f3 x:0 0 0 2024-09-12T22:49:51.498 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:51.498 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:51.498 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:49:51.498 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:49:51.498 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:51.500 INFO:tasks.workunit.client.0.smithi066.stdout:9/2: rename f0 to f2 0 2024-09-12T22:49:51.500 INFO:tasks.workunit.client.0.smithi066.stdout:7/11: mkdir d0 0 2024-09-12T22:49:51.501 INFO:tasks.workunit.client.0.smithi066.stdout:7/12: read - no filename 2024-09-12T22:49:51.501 INFO:tasks.workunit.client.0.smithi066.stdout:7/13: unlink - no file 2024-09-12T22:49:51.501 INFO:tasks.workunit.client.0.smithi066.stdout:7/14: dwrite - no filename 2024-09-12T22:49:51.501 INFO:tasks.workunit.client.0.smithi066.stdout:7/15: read - no filename 2024-09-12T22:49:51.501 INFO:tasks.workunit.client.0.smithi066.stdout:8/8: rename l0 to l3 0 2024-09-12T22:49:51.501 INFO:tasks.workunit.client.0.smithi066.stdout:6/5: truncate f1 186139 0 2024-09-12T22:49:51.501 INFO:tasks.workunit.client.0.smithi066.stdout:2/17: creat d1/f4 x:0 0 0 2024-09-12T22:49:51.501 INFO:tasks.workunit.client.0.smithi066.stdout:9/3: truncate f2 177046 0 2024-09-12T22:49:51.501 INFO:tasks.workunit.client.0.smithi066.stdout:7/16: rename d0 to d0/d1 22 2024-09-12T22:49:51.501 INFO:tasks.workunit.client.0.smithi066.stdout:7/17: write - no filename 2024-09-12T22:49:51.501 INFO:tasks.workunit.client.0.smithi066.stdout:7/18: write - no filename 2024-09-12T22:49:51.501 INFO:tasks.workunit.client.0.smithi066.stdout:0/10: write d1/f2 [1554402,121499] 0 2024-09-12T22:49:51.501 INFO:tasks.workunit.client.0.smithi066.stdout:6/6: chown f1 1 1 2024-09-12T22:49:51.502 INFO:tasks.workunit.client.0.smithi066.stdout:8/9: symlink l4 0 2024-09-12T22:49:51.502 INFO:tasks.workunit.client.0.smithi066.stdout:8/10: read - no filename 2024-09-12T22:49:51.502 INFO:tasks.workunit.client.0.smithi066.stdout:2/18: symlink d1/l5 0 2024-09-12T22:49:51.502 INFO:tasks.workunit.client.0.smithi066.stdout:7/19: mknod d0/c2 0 2024-09-12T22:49:51.502 INFO:tasks.workunit.client.0.smithi066.stdout:7/20: fdatasync - no filename 2024-09-12T22:49:51.502 INFO:tasks.workunit.client.0.smithi066.stdout:8/11: link l4 l5 0 2024-09-12T22:49:51.502 INFO:tasks.workunit.client.0.smithi066.stdout:0/11: link d1/f2 d1/f6 0 2024-09-12T22:49:51.502 INFO:tasks.workunit.client.0.smithi066.stdout:7/21: stat d0 0 2024-09-12T22:49:51.502 INFO:tasks.workunit.client.0.smithi066.stdout:9/4: write f2 [986122,1056] 0 2024-09-12T22:49:51.502 INFO:tasks.workunit.client.0.smithi066.stdout:1/11: getdents d0 0 2024-09-12T22:49:51.502 INFO:tasks.workunit.client.0.smithi066.stdout:0/12: stat d1/f2 0 2024-09-12T22:49:51.502 INFO:tasks.workunit.client.0.smithi066.stdout:9/5: write f2 [1382060,79294] 0 2024-09-12T22:49:51.502 INFO:tasks.workunit.client.0.smithi066.stdout:8/12: mknod c6 0 2024-09-12T22:49:51.502 INFO:tasks.workunit.client.0.smithi066.stdout:8/13: dwrite - no filename 2024-09-12T22:49:51.503 INFO:tasks.workunit.client.0.smithi066.stdout:1/12: chown d0/f2 188 1 2024-09-12T22:49:51.503 INFO:tasks.workunit.client.0.smithi066.stdout:2/19: rmdir d1 39 2024-09-12T22:49:51.503 INFO:tasks.workunit.client.0.smithi066.stdout:7/22: rmdir d0 39 2024-09-12T22:49:51.503 INFO:tasks.workunit.client.0.smithi066.stdout:7/23: write - no filename 2024-09-12T22:49:51.503 INFO:tasks.workunit.client.0.smithi066.stdout:2/20: fsync d1/f3 0 2024-09-12T22:49:51.504 INFO:tasks.workunit.client.0.smithi066.stdout:8/14: mknod c7 0 2024-09-12T22:49:51.504 INFO:tasks.workunit.client.0.smithi066.stdout:8/15: write - no filename 2024-09-12T22:49:51.504 INFO:tasks.workunit.client.0.smithi066.stdout:7/24: rmdir d0 39 2024-09-12T22:49:51.504 INFO:tasks.workunit.client.0.smithi066.stdout:7/25: dread - no filename 2024-09-12T22:49:51.504 INFO:tasks.workunit.client.0.smithi066.stdout:2/21: stat d1/c2 0 2024-09-12T22:49:51.505 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:51.506 INFO:tasks.workunit.client.0.smithi066.stdout:2/22: unlink d1/c2 0 2024-09-12T22:49:51.506 INFO:tasks.workunit.client.0.smithi066.stdout:8/16: chown l3 145887204 1 2024-09-12T22:49:51.507 INFO:tasks.workunit.client.0.smithi066.stdout:7/26: creat d0/f3 x:0 0 0 2024-09-12T22:49:51.507 INFO:tasks.workunit.client.0.smithi066.stdout:5/9: dwrite f3 [0,4194304] 0 2024-09-12T22:49:51.509 INFO:tasks.workunit.client.0.smithi066.stdout:8/17: mknod c8 0 2024-09-12T22:49:51.509 INFO:tasks.workunit.client.0.smithi066.stdout:8/18: dwrite - no filename 2024-09-12T22:49:51.510 INFO:tasks.workunit.client.0.smithi066.stdout:9/6: dread f2 [0,4194304] 0 2024-09-12T22:49:51.510 INFO:tasks.workunit.client.0.smithi066.stdout:2/23: write d1/f4 [63085,103619] 0 2024-09-12T22:49:51.511 INFO:tasks.workunit.client.0.smithi066.stdout:6/7: dwrite f1 [0,4194304] 0 2024-09-12T22:49:51.511 INFO:tasks.workunit.client.0.smithi066.stdout:6/8: rmdir - no directory 2024-09-12T22:49:51.512 INFO:tasks.workunit.client.0.smithi066.stdout:8/19: symlink l9 0 2024-09-12T22:49:51.512 INFO:tasks.workunit.client.0.smithi066.stdout:9/7: symlink l3 0 2024-09-12T22:49:51.513 INFO:tasks.workunit.client.0.smithi066.stdout:7/27: write d0/f3 [948686,93762] 0 2024-09-12T22:49:51.514 INFO:tasks.workunit.client.0.smithi066.stdout:8/20: creat fa x:0 0 0 2024-09-12T22:49:51.514 INFO:tasks.workunit.client.0.smithi066.stdout:0/13: dwrite d1/f2 [0,4194304] 0 2024-09-12T22:49:51.515 INFO:tasks.workunit.client.0.smithi066.stdout:0/14: chown d1 24061 1 2024-09-12T22:49:51.515 INFO:tasks.workunit.client.0.smithi066.stdout:9/8: write f2 [414355,35944] 0 2024-09-12T22:49:51.516 INFO:tasks.workunit.client.0.smithi066.stdout:1/13: dwrite d0/f2 [0,4194304] 0 2024-09-12T22:49:51.517 INFO:tasks.workunit.client.0.smithi066.stdout:9/9: symlink l4 0 2024-09-12T22:49:51.517 INFO:tasks.workunit.client.0.smithi066.stdout:8/21: write fa [387386,15718] 0 2024-09-12T22:49:51.517 INFO:tasks.workunit.client.0.smithi066.stdout:0/15: creat d1/f7 x:0 0 0 2024-09-12T22:49:51.519 INFO:tasks.workunit.client.0.smithi066.stdout:0/16: dread - d1/f7 zero size 2024-09-12T22:49:51.519 INFO:tasks.workunit.client.0.smithi066.stdout:8/22: unlink l4 0 2024-09-12T22:49:51.519 INFO:tasks.workunit.client.0.smithi066.stdout:1/14: chown d0/f2 109 1 2024-09-12T22:49:51.521 INFO:tasks.workunit.client.0.smithi066.stdout:1/15: chown d0/l1 2075823 1 2024-09-12T22:49:51.521 INFO:tasks.workunit.client.0.smithi066.stdout:8/23: rename l9 to lb 0 2024-09-12T22:49:51.521 INFO:tasks.workunit.client.0.smithi066.stdout:0/17: chown d1/f6 1458 1 2024-09-12T22:49:51.521 INFO:tasks.workunit.client.0.smithi066.stdout:5/10: fsync f3 0 2024-09-12T22:49:51.523 INFO:tasks.workunit.client.0.smithi066.stdout:0/18: mkdir d1/d8 0 2024-09-12T22:49:51.523 INFO:tasks.workunit.client.0.smithi066.stdout:8/24: write fa [1082752,98208] 0 2024-09-12T22:49:51.524 INFO:tasks.workunit.client.0.smithi066.stdout:2/24: dread d1/f4 [0,4194304] 0 2024-09-12T22:49:51.524 INFO:tasks.workunit.client.0.smithi066.stdout:6/9: dwrite f1 [4194304,4194304] 0 2024-09-12T22:49:51.526 INFO:tasks.workunit.client.0.smithi066.stdout:2/25: readlink d1/l5 0 2024-09-12T22:49:51.527 INFO:tasks.workunit.client.0.smithi066.stdout:0/19: creat d1/d8/f9 x:0 0 0 2024-09-12T22:49:51.527 INFO:tasks.workunit.client.0.smithi066.stdout:7/28: dwrite d0/f3 [0,4194304] 0 2024-09-12T22:49:51.527 INFO:tasks.workunit.client.0.smithi066.stdout:6/10: creat f2 x:0 0 0 2024-09-12T22:49:51.529 INFO:tasks.workunit.client.0.smithi066.stdout:7/29: symlink d0/l4 0 2024-09-12T22:49:51.531 INFO:tasks.workunit.client.0.smithi066.stdout:2/26: write d1/f4 [83979,15652] 0 2024-09-12T22:49:51.531 INFO:tasks.workunit.client.0.smithi066.stdout:0/20: rename d1/d4/c5 to d1/d8/ca 0 2024-09-12T22:49:51.534 INFO:tasks.workunit.client.0.smithi066.stdout:5/11: dread f3 [0,4194304] 0 2024-09-12T22:49:51.534 INFO:tasks.workunit.client.0.smithi066.stdout:0/21: chown d1/f2 8170149 1 2024-09-12T22:49:51.534 INFO:tasks.workunit.client.0.smithi066.stdout:2/27: write d1/f4 [354507,7976] 0 2024-09-12T22:49:51.536 INFO:tasks.workunit.client.0.smithi066.stdout:1/16: dwrite d0/f2 [4194304,4194304] 0 2024-09-12T22:49:51.536 INFO:tasks.workunit.client.0.smithi066.stdout:5/12: fdatasync f3 0 2024-09-12T22:49:51.537 INFO:tasks.workunit.client.0.smithi066.stdout:2/28: write d1/f4 [107903,22978] 0 2024-09-12T22:49:51.538 INFO:tasks.workunit.client.0.smithi066.stdout:8/25: dwrite fa [0,4194304] 0 2024-09-12T22:49:51.538 INFO:tasks.workunit.client.0.smithi066.stdout:1/17: rename d0 to d0/d4 22 2024-09-12T22:49:51.539 INFO:tasks.workunit.client.0.smithi066.stdout:5/13: chown c1 996816367 1 2024-09-12T22:49:51.539 INFO:tasks.workunit.client.0.smithi066.stdout:2/29: read - d1/f3 zero size 2024-09-12T22:49:51.540 INFO:tasks.workunit.client.0.smithi066.stdout:6/11: dread f1 [0,4194304] 0 2024-09-12T22:49:51.540 INFO:tasks.workunit.client.0.smithi066.stdout:0/22: rename d1/d8/ca to d1/d8/cb 0 2024-09-12T22:49:51.540 INFO:tasks.workunit.client.0.smithi066.stdout:1/18: write d0/f2 [8024,99547] 0 2024-09-12T22:49:51.541 INFO:tasks.workunit.client.0.smithi066.stdout:5/14: truncate f3 1479489 0 2024-09-12T22:49:51.541 INFO:tasks.workunit.client.0.smithi066.stdout:2/30: chown d1/f3 987077 1 2024-09-12T22:49:51.541 INFO:tasks.workunit.client.0.smithi066.stdout:6/12: creat f3 x:0 0 0 2024-09-12T22:49:51.542 INFO:tasks.workunit.client.0.smithi066.stdout:7/30: dwrite d0/f3 [0,4194304] 0 2024-09-12T22:49:51.542 INFO:tasks.workunit.client.0.smithi066.stdout:6/13: unlink f3 0 2024-09-12T22:49:51.542 INFO:tasks.workunit.client.0.smithi066.stdout:0/23: rename d1/d8/f9 to d1/fc 0 2024-09-12T22:49:51.542 INFO:tasks.workunit.client.0.smithi066.stdout:2/31: creat d1/f6 x:0 0 0 2024-09-12T22:49:51.543 INFO:tasks.workunit.client.0.smithi066.stdout:6/14: write f2 [819000,166] 0 2024-09-12T22:49:51.543 INFO:tasks.workunit.client.0.smithi066.stdout:0/24: mkdir d1/d4/dd 0 2024-09-12T22:49:51.544 INFO:tasks.workunit.client.0.smithi066.stdout:2/32: creat d1/f7 x:0 0 0 2024-09-12T22:49:51.544 INFO:tasks.workunit.client.0.smithi066.stdout:6/15: write f2 [235716,32168] 0 2024-09-12T22:49:51.544 INFO:tasks.workunit.client.0.smithi066.stdout:0/25: rename d1/f6 to d1/d8/fe 0 2024-09-12T22:49:51.546 INFO:tasks.workunit.client.0.smithi066.stdout:8/26: dread fa [0,4194304] 0 2024-09-12T22:49:51.546 INFO:tasks.workunit.client.0.smithi066.stdout:0/26: write d1/d8/fe [4090935,119467] 0 2024-09-12T22:49:51.547 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:51.545+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:51.547 INFO:tasks.workunit.client.0.smithi066.stdout:0/27: creat d1/d4/ff x:0 0 0 2024-09-12T22:49:51.547 INFO:tasks.workunit.client.0.smithi066.stdout:0/28: chown d1/d4/dd 55436 1 2024-09-12T22:49:51.547 INFO:tasks.workunit.client.0.smithi066.stdout:6/16: dread f1 [4194304,4194304] 0 2024-09-12T22:49:51.548 INFO:tasks.workunit.client.0.smithi066.stdout:6/17: truncate f2 1515280 0 2024-09-12T22:49:51.549 INFO:tasks.workunit.client.0.smithi066.stdout:6/18: write f1 [914666,78079] 0 2024-09-12T22:49:51.549 INFO:tasks.workunit.client.0.smithi066.stdout:6/19: write f1 [5948290,77714] 0 2024-09-12T22:49:51.550 INFO:tasks.workunit.client.0.smithi066.stdout:0/29: dread d1/d8/fe [0,4194304] 0 2024-09-12T22:49:51.551 INFO:tasks.workunit.client.0.smithi066.stdout:0/30: truncate d1/d8/fe 4283631 0 2024-09-12T22:49:51.552 INFO:tasks.workunit.client.0.smithi066.stdout:0/31: chown d1/d4/ff 238266 1 2024-09-12T22:49:51.552 INFO:tasks.workunit.client.0.smithi066.stdout:6/20: dread f1 [0,4194304] 0 2024-09-12T22:49:51.553 INFO:tasks.workunit.client.0.smithi066.stdout:0/32: creat d1/f10 x:0 0 0 2024-09-12T22:49:51.553 INFO:tasks.workunit.client.0.smithi066.stdout:0/33: write d1/f10 [8924,5601] 0 2024-09-12T22:49:51.554 INFO:tasks.workunit.client.0.smithi066.stdout:0/34: symlink d1/d4/dd/l11 0 2024-09-12T22:49:51.555 INFO:tasks.workunit.client.0.smithi066.stdout:2/33: truncate d1/f4 139751 0 2024-09-12T22:49:51.555 INFO:tasks.workunit.client.0.smithi066.stdout:5/15: truncate f3 1752811 0 2024-09-12T22:49:51.556 INFO:tasks.workunit.client.0.smithi066.stdout:2/34: creat d1/f8 x:0 0 0 2024-09-12T22:49:51.556 INFO:tasks.workunit.client.0.smithi066.stdout:6/21: dwrite f2 [0,4194304] 0 2024-09-12T22:49:51.560 INFO:tasks.workunit.client.0.smithi066.stdout:6/22: fsync f1 0 2024-09-12T22:49:51.561 INFO:tasks.workunit.client.0.smithi066.stdout:8/27: fdatasync fa 0 2024-09-12T22:49:51.561 INFO:tasks.workunit.client.0.smithi066.stdout:6/23: read f1 [8217088,48773] 0 2024-09-12T22:49:51.562 INFO:tasks.workunit.client.0.smithi066.stdout:0/35: rename d1/d4 to d1/d12 0 2024-09-12T22:49:51.562 INFO:tasks.workunit.client.0.smithi066.stdout:5/16: truncate f3 2125216 0 2024-09-12T22:49:51.562 INFO:tasks.workunit.client.0.smithi066.stdout:2/35: dwrite d1/f8 [0,4194304] 0 2024-09-12T22:49:51.562 INFO:tasks.workunit.client.0.smithi066.stdout:8/28: readlink l5 0 2024-09-12T22:49:51.563 INFO:tasks.workunit.client.0.smithi066.stdout:8/29: write fa [2343514,18156] 0 2024-09-12T22:49:51.563 INFO:tasks.workunit.client.0.smithi066.stdout:2/36: unlink d1/f7 0 2024-09-12T22:49:51.563 INFO:tasks.workunit.client.0.smithi066.stdout:0/36: unlink d1/d8/cb 0 2024-09-12T22:49:51.563 INFO:tasks.workunit.client.0.smithi066.stdout:2/37: chown d1 138220 1 2024-09-12T22:49:51.564 INFO:tasks.workunit.client.0.smithi066.stdout:2/38: fsync d1/f4 0 2024-09-12T22:49:51.564 INFO:tasks.workunit.client.0.smithi066.stdout:0/37: chown d1/d12/dd/l11 173 1 2024-09-12T22:49:51.564 INFO:tasks.workunit.client.0.smithi066.stdout:8/30: link c8 cc 0 2024-09-12T22:49:51.565 INFO:tasks.workunit.client.0.smithi066.stdout:7/31: fdatasync d0/f3 0 2024-09-12T22:49:51.565 INFO:tasks.workunit.client.0.smithi066.stdout:2/39: creat d1/f9 x:0 0 0 2024-09-12T22:49:51.565 INFO:tasks.workunit.client.0.smithi066.stdout:0/38: write d1/d12/ff [112820,11851] 0 2024-09-12T22:49:51.565 INFO:tasks.workunit.client.0.smithi066.stdout:6/24: dread f2 [0,4194304] 0 2024-09-12T22:49:51.566 INFO:tasks.workunit.client.0.smithi066.stdout:2/40: truncate d1/f9 764028 0 2024-09-12T22:49:51.566 INFO:tasks.workunit.client.0.smithi066.stdout:6/25: mknod c4 0 2024-09-12T22:49:51.566 INFO:tasks.workunit.client.0.smithi066.stdout:0/39: mkdir d1/d12/d13 0 2024-09-12T22:49:51.566 INFO:tasks.workunit.client.0.smithi066.stdout:7/32: truncate d0/f3 1769906 0 2024-09-12T22:49:51.567 INFO:tasks.workunit.client.0.smithi066.stdout:2/41: truncate d1/f4 349229 0 2024-09-12T22:49:51.567 INFO:tasks.workunit.client.0.smithi066.stdout:2/42: stat d1/f3 0 2024-09-12T22:49:51.567 INFO:tasks.workunit.client.0.smithi066.stdout:2/43: read - d1/f6 zero size 2024-09-12T22:49:51.568 INFO:tasks.workunit.client.0.smithi066.stdout:6/26: dread f2 [0,4194304] 0 2024-09-12T22:49:51.569 INFO:tasks.workunit.client.0.smithi066.stdout:6/27: creat f5 x:0 0 0 2024-09-12T22:49:51.569 INFO:tasks.workunit.client.0.smithi066.stdout:6/28: rmdir - no directory 2024-09-12T22:49:51.569 INFO:tasks.workunit.client.0.smithi066.stdout:0/40: getdents d1/d12 0 2024-09-12T22:49:51.570 INFO:tasks.workunit.client.0.smithi066.stdout:6/29: truncate f1 5455448 0 2024-09-12T22:49:51.570 INFO:tasks.workunit.client.0.smithi066.stdout:0/41: readlink d1/d12/dd/l11 0 2024-09-12T22:49:51.571 INFO:tasks.workunit.client.0.smithi066.stdout:6/30: mkdir d6 0 2024-09-12T22:49:51.571 INFO:tasks.workunit.client.0.smithi066.stdout:5/17: dread f3 [0,4194304] 0 2024-09-12T22:49:51.571 INFO:tasks.workunit.client.0.smithi066.stdout:0/42: write d1/fc [444493,71653] 0 2024-09-12T22:49:51.572 INFO:tasks.workunit.client.0.smithi066.stdout:0/43: unlink d1/fc 0 2024-09-12T22:49:51.572 INFO:tasks.workunit.client.0.smithi066.stdout:0/44: rename d1/d12/dd to d1/d12/dd/d14 22 2024-09-12T22:49:51.577 INFO:tasks.workunit.client.0.smithi066.stdout:6/31: dwrite f2 [0,4194304] 0 2024-09-12T22:49:51.577 INFO:tasks.workunit.client.0.smithi066.stdout:5/18: dwrite f3 [0,4194304] 0 2024-09-12T22:49:51.578 INFO:tasks.workunit.client.0.smithi066.stdout:5/19: creat f4 x:0 0 0 2024-09-12T22:49:51.578 INFO:tasks.workunit.client.0.smithi066.stdout:5/20: dread - f4 zero size 2024-09-12T22:49:51.578 INFO:tasks.workunit.client.0.smithi066.stdout:7/33: dwrite d0/f3 [0,4194304] 0 2024-09-12T22:49:51.580 INFO:tasks.workunit.client.0.smithi066.stdout:7/34: link d0/f3 d0/f5 0 2024-09-12T22:49:51.584 INFO:tasks.workunit.client.0.smithi066.stdout:5/21: dwrite f3 [4194304,4194304] 0 2024-09-12T22:49:51.584 INFO:tasks.workunit.client.0.smithi066.stdout:7/35: dread d0/f3 [0,4194304] 0 2024-09-12T22:49:51.589 INFO:tasks.workunit.client.0.smithi066.stdout:7/36: dread d0/f3 [0,4194304] 0 2024-09-12T22:49:51.591 INFO:tasks.workunit.client.0.smithi066.stdout:5/22: dwrite f4 [0,4194304] 0 2024-09-12T22:49:51.595 INFO:tasks.workunit.client.0.smithi066.stdout:7/37: dwrite d0/f5 [0,4194304] 0 2024-09-12T22:49:51.596 INFO:tasks.workunit.client.0.smithi066.stdout:7/38: write d0/f5 [115269,50046] 0 2024-09-12T22:49:51.596 INFO:tasks.workunit.client.0.smithi066.stdout:7/39: mkdir d0/d6 0 2024-09-12T22:49:51.612 INFO:tasks.workunit.client.0.smithi066.stdout:5/23: fsync f3 0 2024-09-12T22:49:51.612 INFO:tasks.workunit.client.0.smithi066.stdout:5/24: mkdir d5 0 2024-09-12T22:49:51.612 INFO:tasks.workunit.client.0.smithi066.stdout:5/25: write f4 [5086599,121440] 0 2024-09-12T22:49:51.613 INFO:tasks.workunit.client.0.smithi066.stdout:5/26: symlink d5/l6 0 2024-09-12T22:49:51.613 INFO:tasks.workunit.client.0.smithi066.stdout:5/27: chown d5 35483393 1 2024-09-12T22:49:51.617 INFO:tasks.workunit.client.0.smithi066.stdout:5/28: dwrite f4 [0,4194304] 0 2024-09-12T22:49:51.621 INFO:tasks.workunit.client.0.smithi066.stdout:5/29: dwrite f4 [0,4194304] 0 2024-09-12T22:49:51.624 INFO:tasks.workunit.client.0.smithi066.stdout:5/30: dread f4 [0,4194304] 0 2024-09-12T22:49:51.624 INFO:tasks.workunit.client.0.smithi066.stdout:5/31: chown d5 56 1 2024-09-12T22:49:51.625 INFO:tasks.workunit.client.0.smithi066.stdout:5/32: link f4 d5/f7 0 2024-09-12T22:49:51.625 INFO:tasks.workunit.client.0.smithi066.stdout:5/33: creat d5/f8 x:0 0 0 2024-09-12T22:49:51.627 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:51.625+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:51.630 INFO:tasks.workunit.client.0.smithi066.stdout:5/34: dwrite f4 [0,4194304] 0 2024-09-12T22:49:51.631 INFO:tasks.workunit.client.0.smithi066.stdout:5/35: rename d5/f8 to d5/f9 0 2024-09-12T22:49:51.632 INFO:tasks.workunit.client.0.smithi066.stdout:5/36: symlink d5/la 0 2024-09-12T22:49:51.633 INFO:tasks.workunit.client.0.smithi066.stdout:5/37: chown f3 35 1 2024-09-12T22:49:51.633 INFO:tasks.workunit.client.0.smithi066.stdout:5/38: write f4 [3015899,126765] 0 2024-09-12T22:49:51.633 INFO:tasks.workunit.client.0.smithi066.stdout:5/39: readlink d5/l6 0 2024-09-12T22:49:51.634 INFO:tasks.workunit.client.0.smithi066.stdout:5/40: write f3 [3785091,16404] 0 2024-09-12T22:49:51.634 INFO:tasks.workunit.client.0.smithi066.stdout:5/41: rename d5/l6 to d5/lb 0 2024-09-12T22:49:51.635 INFO:tasks.workunit.client.0.smithi066.stdout:5/42: mknod d5/cc 0 2024-09-12T22:49:51.636 INFO:tasks.workunit.client.0.smithi066.stdout:5/43: write d5/f7 [4673181,89384] 0 2024-09-12T22:49:51.641 INFO:tasks.workunit.client.0.smithi066.stdout:5/44: getdents d5 0 2024-09-12T22:49:51.645 INFO:tasks.workunit.client.0.smithi066.stdout:5/45: truncate d5/f7 4531809 0 2024-09-12T22:49:51.645 INFO:tasks.workunit.client.0.smithi066.stdout:5/46: chown l2 24640 1 2024-09-12T22:49:51.646 INFO:tasks.workunit.client.0.smithi066.stdout:5/47: write d5/f9 [613768,28454] 0 2024-09-12T22:49:51.646 INFO:tasks.workunit.client.0.smithi066.stdout:5/48: write f3 [401326,55176] 0 2024-09-12T22:49:51.647 INFO:tasks.workunit.client.0.smithi066.stdout:5/49: symlink d5/ld 0 2024-09-12T22:49:51.647 INFO:tasks.workunit.client.0.smithi066.stdout:5/50: truncate d5/f9 1343214 0 2024-09-12T22:49:51.647 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:49:51.649 INFO:tasks.workunit.client.0.smithi066.stdout:5/51: chown d5/f9 33068061 1 2024-09-12T22:49:51.649 INFO:tasks.workunit.client.0.smithi066.stdout:5/52: chown d5/cc 7 1 2024-09-12T22:49:51.649 INFO:tasks.workunit.client.0.smithi066.stdout:5/53: chown d5/f9 46 1 2024-09-12T22:49:51.649 INFO:tasks.workunit.client.0.smithi066.stdout:5/54: mkdir d5/de 0 2024-09-12T22:49:51.653 INFO:tasks.workunit.client.0.smithi066.stdout:5/55: dwrite d5/f9 [0,4194304] 0 2024-09-12T22:49:51.653 INFO:tasks.workunit.client.0.smithi066.stdout:5/56: chown c1 29699 1 2024-09-12T22:49:51.658 INFO:tasks.workunit.client.0.smithi066.stdout:5/57: dwrite f3 [8388608,4194304] 0 2024-09-12T22:49:51.658 INFO:tasks.workunit.client.0.smithi066.stdout:5/58: rmdir d5 39 2024-09-12T22:49:51.659 INFO:tasks.workunit.client.0.smithi066.stdout:5/59: creat d5/de/ff x:0 0 0 2024-09-12T22:49:51.661 INFO:tasks.workunit.client.0.smithi066.stdout:5/60: mknod d5/c10 0 2024-09-12T22:49:51.661 INFO:tasks.workunit.client.0.smithi066.stdout:5/61: unlink d5/cc 0 2024-09-12T22:49:51.663 INFO:tasks.workunit.client.0.smithi066.stdout:5/62: read d5/f7 [35269,67843] 0 2024-09-12T22:49:51.663 INFO:tasks.workunit.client.0.smithi066.stdout:5/63: write f3 [9921069,76410] 0 2024-09-12T22:49:51.663 INFO:tasks.workunit.client.0.smithi066.stdout:5/64: read f4 [1521974,8583] 0 2024-09-12T22:49:51.664 INFO:tasks.workunit.client.0.smithi066.stdout:5/65: truncate d5/de/ff 81385 0 2024-09-12T22:49:51.664 INFO:tasks.workunit.client.0.smithi066.stdout:5/66: write f3 [9667098,80333] 0 2024-09-12T22:49:51.669 INFO:tasks.workunit.client.0.smithi066.stdout:5/67: dwrite d5/f7 [0,4194304] 0 2024-09-12T22:49:51.671 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:51.671 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:49:51.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:49:51.671 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:49:51.671 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.671 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:116 3.1e 3:7bf7e7b5:::200.00000006:head [write 33965~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:51.671 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.160042+0000", 2024-09-12T22:49:51.671 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.5085791950000003, 2024-09-12T22:49:51.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.019984564999999999, 2024-09-12T22:49:51.671 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:51.672 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:51.672 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:51.672 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:51.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.672 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:51.672 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160042+0000", 2024-09-12T22:49:51.672 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.672 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.672 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:51.672 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160042+0000", 2024-09-12T22:49:51.672 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.672 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.673 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:51.673 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160042+0000", 2024-09-12T22:49:51.673 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.22e-07 2024-09-12T22:49:51.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.673 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:51.673 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160047+0000", 2024-09-12T22:49:51.673 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9899999999999997e-06 2024-09-12T22:49:51.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.673 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:51.673 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160051+0000", 2024-09-12T22:49:51.673 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2230000000000001e-06 2024-09-12T22:49:51.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.674 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:51.674 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160054+0000", 2024-09-12T22:49:51.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6860000000000002e-06 2024-09-12T22:49:51.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.674 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:51.674 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.176303+0000", 2024-09-12T22:49:51.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016248439 2024-09-12T22:49:51.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.674 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:51.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.176348+0000", 2024-09-12T22:49:51.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5173000000000003e-05 2024-09-12T22:49:51.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:51.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.176413+0000", 2024-09-12T22:49:51.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5228999999999995e-05 2024-09-12T22:49:51.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:51.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.179853+0000", 2024-09-12T22:49:51.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034401470000000002 2024-09-12T22:49:51.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:51.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.179919+0000", 2024-09-12T22:49:51.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6063999999999996e-05 2024-09-12T22:49:51.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:51.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.179950+0000", 2024-09-12T22:49:51.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1010999999999998e-05 2024-09-12T22:49:51.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:51.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.180027+0000", 2024-09-12T22:49:51.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6380999999999999e-05 2024-09-12T22:49:51.677 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.677 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:51.677 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.677 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:117 3.1e 3:7bf7e7b5:::200.00000006:head [write 35364~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:51.677 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.160057+0000", 2024-09-12T22:49:51.677 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.5085638230000002, 2024-09-12T22:49:51.677 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022917138, 2024-09-12T22:49:51.677 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:51.677 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:51.677 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:51.677 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:51.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.678 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:51.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160057+0000", 2024-09-12T22:49:51.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:51.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160057+0000", 2024-09-12T22:49:51.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:51.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160058+0000", 2024-09-12T22:49:51.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.16e-07 2024-09-12T22:49:51.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:51.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160059+0000", 2024-09-12T22:49:51.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4410000000000001e-06 2024-09-12T22:49:51.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:51.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160063+0000", 2024-09-12T22:49:51.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9790000000000004e-06 2024-09-12T22:49:51.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:51.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160068+0000", 2024-09-12T22:49:51.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0629999999999996e-06 2024-09-12T22:49:51.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:51.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.176699+0000", 2024-09-12T22:49:51.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016630781000000001 2024-09-12T22:49:51.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:51.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.176741+0000", 2024-09-12T22:49:51.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1959999999999998e-05 2024-09-12T22:49:51.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:51.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.176807+0000", 2024-09-12T22:49:51.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6711999999999994e-05 2024-09-12T22:49:51.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:51.684 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.179858+0000", 2024-09-12T22:49:51.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003050582 2024-09-12T22:49:51.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:51.684 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.182889+0000", 2024-09-12T22:49:51.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030313750000000002 2024-09-12T22:49:51.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:51.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.182922+0000", 2024-09-12T22:49:51.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2379000000000003e-05 2024-09-12T22:49:51.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:51.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.182974+0000", 2024-09-12T22:49:51.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2649999999999999e-05 2024-09-12T22:49:51.685 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.685 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:51.685 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.686 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:118 3.1e 3:7bf7e7b5:::200.00000006:head [write 36767~1414 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:51.686 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.160073+0000", 2024-09-12T22:49:51.686 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.5085478940000003, 2024-09-12T22:49:51.686 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023013767000000001, 2024-09-12T22:49:51.686 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:51.686 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:51.686 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:51.686 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:51.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.686 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:51.686 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160073+0000", 2024-09-12T22:49:51.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.687 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:51.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160073+0000", 2024-09-12T22:49:51.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.687 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:51.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160074+0000", 2024-09-12T22:49:51.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6899999999999998e-07 2024-09-12T22:49:51.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:51.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160079+0000", 2024-09-12T22:49:51.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3199999999999999e-06 2024-09-12T22:49:51.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:51.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160092+0000", 2024-09-12T22:49:51.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2850000000000001e-05 2024-09-12T22:49:51.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:51.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160096+0000", 2024-09-12T22:49:51.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1509999999999997e-06 2024-09-12T22:49:51.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:51.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.177067+0000", 2024-09-12T22:49:51.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016970827000000001 2024-09-12T22:49:51.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:51.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.177110+0000", 2024-09-12T22:49:51.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3446999999999999e-05 2024-09-12T22:49:51.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:51.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.177177+0000", 2024-09-12T22:49:51.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6612999999999994e-05 2024-09-12T22:49:51.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.690 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:51.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.179865+0000", 2024-09-12T22:49:51.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0026877770000000001 2024-09-12T22:49:51.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.690 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:51.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.183009+0000", 2024-09-12T22:49:51.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031447390000000001 2024-09-12T22:49:51.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.691 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:51.691 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.183040+0000", 2024-09-12T22:49:51.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0213e-05 2024-09-12T22:49:51.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.691 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:51.691 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.183087+0000", 2024-09-12T22:49:51.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7460999999999998e-05 2024-09-12T22:49:51.691 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.691 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:51.691 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.691 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:119 3.1e 3:7bf7e7b5:::200.00000006:head [write 38181~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:51.692 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.160117+0000", 2024-09-12T22:49:51.692 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.5085043300000001, 2024-09-12T22:49:51.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023084609999999998, 2024-09-12T22:49:51.692 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:51.692 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:51.692 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:51.692 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:51.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:51.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160117+0000", 2024-09-12T22:49:51.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:51.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160117+0000", 2024-09-12T22:49:51.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:51.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160117+0000", 2024-09-12T22:49:51.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1800000000000002e-07 2024-09-12T22:49:51.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:51.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160119+0000", 2024-09-12T22:49:51.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.136e-06 2024-09-12T22:49:51.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:51.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160124+0000", 2024-09-12T22:49:51.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3610000000000003e-06 2024-09-12T22:49:51.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:51.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160126+0000", 2024-09-12T22:49:51.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7140000000000002e-06 2024-09-12T22:49:51.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:51.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.177501+0000", 2024-09-12T22:49:51.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.017374351 2024-09-12T22:49:51.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.695 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:51.695 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.177548+0000", 2024-09-12T22:49:51.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7321000000000003e-05 2024-09-12T22:49:51.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.695 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:51.695 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.177626+0000", 2024-09-12T22:49:51.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7546000000000006e-05 2024-09-12T22:49:51.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.695 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:51.696 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.179877+0000", 2024-09-12T22:49:51.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022512769999999999 2024-09-12T22:49:51.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.696 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:51.696 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.183128+0000", 2024-09-12T22:49:51.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032514079999999999 2024-09-12T22:49:51.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.696 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:51.696 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.183156+0000", 2024-09-12T22:49:51.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8155999999999999e-05 2024-09-12T22:49:51.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.697 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:51.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.183201+0000", 2024-09-12T22:49:51.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5021999999999997e-05 2024-09-12T22:49:51.697 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.697 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:51.697 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.697 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:120 3.1e 3:7bf7e7b5:::200.00000006:head [write 39581~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:51.697 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.160130+0000", 2024-09-12T22:49:51.697 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.5084913279999999, 2024-09-12T22:49:51.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023171166999999999, 2024-09-12T22:49:51.698 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:51.698 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:51.698 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:51.698 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:51.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.698 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:51.698 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160130+0000", 2024-09-12T22:49:51.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.698 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:51.698 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160130+0000", 2024-09-12T22:49:51.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.699 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:51.699 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160130+0000", 2024-09-12T22:49:51.699 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1199999999999999e-07 2024-09-12T22:49:51.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.699 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:51.699 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160132+0000", 2024-09-12T22:49:51.699 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8810000000000001e-06 2024-09-12T22:49:51.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.699 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:51.699 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160135+0000", 2024-09-12T22:49:51.700 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.078e-06 2024-09-12T22:49:51.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.700 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.700 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:51.700 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160138+0000", 2024-09-12T22:49:51.700 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9569999999999998e-06 2024-09-12T22:49:51.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.700 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.700 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:51.700 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.177849+0000", 2024-09-12T22:49:51.700 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.017711286999999999 2024-09-12T22:49:51.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.700 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:51.701 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.177900+0000", 2024-09-12T22:49:51.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0695000000000002e-05 2024-09-12T22:49:51.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:51.701 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.177967+0000", 2024-09-12T22:49:51.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6604000000000001e-05 2024-09-12T22:49:51.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:51.701 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.179884+0000", 2024-09-12T22:49:51.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019170249999999999 2024-09-12T22:49:51.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.702 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:51.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.183230+0000", 2024-09-12T22:49:51.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033465690000000002 2024-09-12T22:49:51.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.702 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:51.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.183259+0000", 2024-09-12T22:49:51.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8628000000000001e-05 2024-09-12T22:49:51.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.702 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:51.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.183301+0000", 2024-09-12T22:49:51.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2231000000000003e-05 2024-09-12T22:49:51.703 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.703 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:51.703 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.703 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:121 3.1e 3:7bf7e7b5:::200.00000006:head [write 40980~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:51.703 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.160141+0000", 2024-09-12T22:49:51.703 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.5084802560000004, 2024-09-12T22:49:51.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023288197, 2024-09-12T22:49:51.703 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:51.703 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:51.703 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:51.703 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:51.704 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.704 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:51.704 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160141+0000", 2024-09-12T22:49:51.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.704 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.704 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:51.704 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160141+0000", 2024-09-12T22:49:51.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.704 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.704 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:51.704 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160141+0000", 2024-09-12T22:49:51.705 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2099999999999998e-07 2024-09-12T22:49:51.705 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.705 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:51.705 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160146+0000", 2024-09-12T22:49:51.705 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8230000000000002e-06 2024-09-12T22:49:51.705 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.705 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:51.705 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160149+0000", 2024-09-12T22:49:51.705 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.337e-06 2024-09-12T22:49:51.705 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.705 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:51.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160152+0000", 2024-09-12T22:49:51.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4399999999999999e-06 2024-09-12T22:49:51.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:51.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.178307+0000", 2024-09-12T22:49:51.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018155161 2024-09-12T22:49:51.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:51.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.178386+0000", 2024-09-12T22:49:51.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8966000000000003e-05 2024-09-12T22:49:51.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:51.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.178536+0000", 2024-09-12T22:49:51.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015024799999999999 2024-09-12T22:49:51.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:51.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.180379+0000", 2024-09-12T22:49:51.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00184242 2024-09-12T22:49:51.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:51.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.183341+0000", 2024-09-12T22:49:51.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0029626819999999999 2024-09-12T22:49:51.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.708 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:51.708 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.183370+0000", 2024-09-12T22:49:51.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:49:51.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.708 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:51.708 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.183429+0000", 2024-09-12T22:49:51.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9406e-05 2024-09-12T22:49:51.708 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.708 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:51.708 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.709 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.709 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:122 3.1e 3:7bf7e7b5:::200.00000006:head [write 42381~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:51.709 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.160155+0000", 2024-09-12T22:49:51.709 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.5084662619999998, 2024-09-12T22:49:51.709 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.025228924, 2024-09-12T22:49:51.709 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:51.709 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:51.709 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:51.709 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:51.709 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.709 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:51.709 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160155+0000", 2024-09-12T22:49:51.709 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:51.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160155+0000", 2024-09-12T22:49:51.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:51.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160155+0000", 2024-09-12T22:49:51.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1199999999999999e-07 2024-09-12T22:49:51.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:51.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160157+0000", 2024-09-12T22:49:51.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.838e-06 2024-09-12T22:49:51.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:51.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160160+0000", 2024-09-12T22:49:51.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3900000000000002e-06 2024-09-12T22:49:51.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:51.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160170+0000", 2024-09-12T22:49:51.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3160000000000003e-06 2024-09-12T22:49:51.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:51.712 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.179029+0000", 2024-09-12T22:49:51.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018858935 2024-09-12T22:49:51.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:51.712 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.179074+0000", 2024-09-12T22:49:51.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5386999999999998e-05 2024-09-12T22:49:51.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:51.712 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.179178+0000", 2024-09-12T22:49:51.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010391399999999999 2024-09-12T22:49:51.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.713 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:51.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.181184+0000", 2024-09-12T22:49:51.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020062550000000002 2024-09-12T22:49:51.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.713 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:51.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.185306+0000", 2024-09-12T22:49:51.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0041221349999999999 2024-09-12T22:49:51.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.713 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:51.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.185337+0000", 2024-09-12T22:49:51.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1080000000000001e-05 2024-09-12T22:49:51.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.714 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.714 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:51.714 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.185384+0000", 2024-09-12T22:49:51.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6461999999999997e-05 2024-09-12T22:49:51.714 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.714 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:51.714 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.714 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.714 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.714 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:167 3.1e 3:7bf7e7b5:::200.00000006:head [write 170486~2427 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:51.714 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.188170+0000", 2024-09-12T22:49:51.714 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.4804514790000001, 2024-09-12T22:49:51.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.019307458999999999, 2024-09-12T22:49:51.715 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:51.715 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:51.715 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:51.715 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:51.715 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.715 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:51.715 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188170+0000", 2024-09-12T22:49:51.715 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.715 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.715 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:51.715 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188170+0000", 2024-09-12T22:49:51.715 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:51.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188170+0000", 2024-09-12T22:49:51.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:49:51.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:51.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188178+0000", 2024-09-12T22:49:51.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6590000000000007e-06 2024-09-12T22:49:51.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:51.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188184+0000", 2024-09-12T22:49:51.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4200000000000004e-06 2024-09-12T22:49:51.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:51.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188189+0000", 2024-09-12T22:49:51.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6909999999999996e-06 2024-09-12T22:49:51.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:51.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.201064+0000", 2024-09-12T22:49:51.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012875202000000001 2024-09-12T22:49:51.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:51.718 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.201112+0000", 2024-09-12T22:49:51.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7608000000000002e-05 2024-09-12T22:49:51.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.718 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:51.718 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.201217+0000", 2024-09-12T22:49:51.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000104936 2024-09-12T22:49:51.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.718 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:51.718 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.202933+0000", 2024-09-12T22:49:51.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001715921 2024-09-12T22:49:51.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:51.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207409+0000", 2024-09-12T22:49:51.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044768719999999998 2024-09-12T22:49:51.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:51.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207436+0000", 2024-09-12T22:49:51.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6312000000000002e-05 2024-09-12T22:49:51.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:51.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207477+0000", 2024-09-12T22:49:51.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1331000000000001e-05 2024-09-12T22:49:51.720 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.720 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:51.720 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.720 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:168 3.1e 3:7bf7e7b5:::200.00000006:head [write 172913~2437 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:51.720 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.188195+0000", 2024-09-12T22:49:51.720 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.4804257500000002, 2024-09-12T22:49:51.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.019344936, 2024-09-12T22:49:51.720 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:51.720 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:51.720 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:51.720 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:51.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:51.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188195+0000", 2024-09-12T22:49:51.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:51.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188195+0000", 2024-09-12T22:49:51.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:51.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188196+0000", 2024-09-12T22:49:51.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8099999999999998e-07 2024-09-12T22:49:51.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:51.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188199+0000", 2024-09-12T22:49:51.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4620000000000001e-06 2024-09-12T22:49:51.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:51.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188205+0000", 2024-09-12T22:49:51.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7599999999999999e-06 2024-09-12T22:49:51.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:51.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188210+0000", 2024-09-12T22:49:51.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:49:51.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.723 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:51.723 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.201526+0000", 2024-09-12T22:49:51.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013316527999999999 2024-09-12T22:49:51.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.723 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:51.723 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.201569+0000", 2024-09-12T22:49:51.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3328999999999998e-05 2024-09-12T22:49:51.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.723 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:51.724 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.201636+0000", 2024-09-12T22:49:51.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6320000000000002e-05 2024-09-12T22:49:51.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.724 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:51.724 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.202961+0000", 2024-09-12T22:49:51.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00132551 2024-09-12T22:49:51.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.724 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:51.724 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207482+0000", 2024-09-12T22:49:51.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045204370000000004 2024-09-12T22:49:51.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:51.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207504+0000", 2024-09-12T22:49:51.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1956000000000001e-05 2024-09-12T22:49:51.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:51.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207540+0000", 2024-09-12T22:49:51.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6754000000000001e-05 2024-09-12T22:49:51.725 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.725 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:51.725 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.726 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:169 3.1e 3:7bf7e7b5:::200.00000006:head [write 175350~1910 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:51.726 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.188216+0000", 2024-09-12T22:49:51.726 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.4804055900000002, 2024-09-12T22:49:51.726 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.019389085, 2024-09-12T22:49:51.726 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:51.726 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:51.726 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:51.726 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:51.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.726 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:51.726 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188216+0000", 2024-09-12T22:49:51.726 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:51.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188216+0000", 2024-09-12T22:49:51.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:51.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188216+0000", 2024-09-12T22:49:51.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3799999999999998e-07 2024-09-12T22:49:51.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:51.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188223+0000", 2024-09-12T22:49:51.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4200000000000001e-06 2024-09-12T22:49:51.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:51.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188229+0000", 2024-09-12T22:49:51.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1789999999999996e-06 2024-09-12T22:49:51.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:51.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188235+0000", 2024-09-12T22:49:51.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0150000000000003e-06 2024-09-12T22:49:51.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:51.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.201986+0000", 2024-09-12T22:49:51.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013751974 2024-09-12T22:49:51.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:51.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.202031+0000", 2024-09-12T22:49:51.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4694999999999998e-05 2024-09-12T22:49:51.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:51.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.202100+0000", 2024-09-12T22:49:51.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8638000000000003e-05 2024-09-12T22:49:51.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:51.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.202990+0000", 2024-09-12T22:49:51.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089015800000000005 2024-09-12T22:49:51.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:51.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207544+0000", 2024-09-12T22:49:51.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045542990000000004 2024-09-12T22:49:51.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:51.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207565+0000", 2024-09-12T22:49:51.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1138e-05 2024-09-12T22:49:51.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:51.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207605+0000", 2024-09-12T22:49:51.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9230999999999998e-05 2024-09-12T22:49:51.731 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.731 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:51.731 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.731 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:170 3.1e 3:7bf7e7b5:::200.00000006:head [write 177260~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:51.731 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.188241+0000", 2024-09-12T22:49:51.731 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.480380201, 2024-09-12T22:49:51.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.019428737000000001, 2024-09-12T22:49:51.731 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:51.732 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:51.732 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:51.732 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:51.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.732 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:51.732 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188241+0000", 2024-09-12T22:49:51.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.732 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:51.732 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188241+0000", 2024-09-12T22:49:51.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:51.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188241+0000", 2024-09-12T22:49:51.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5999999999999999e-07 2024-09-12T22:49:51.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:51.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188247+0000", 2024-09-12T22:49:51.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.677e-06 2024-09-12T22:49:51.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:51.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188253+0000", 2024-09-12T22:49:51.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9209999999999997e-06 2024-09-12T22:49:51.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:51.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188258+0000", 2024-09-12T22:49:51.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0610000000000003e-06 2024-09-12T22:49:51.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:51.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.202382+0000", 2024-09-12T22:49:51.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014124166 2024-09-12T22:49:51.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:51.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.202428+0000", 2024-09-12T22:49:51.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5966e-05 2024-09-12T22:49:51.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:51.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.202496+0000", 2024-09-12T22:49:51.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7999999999999999e-05 2024-09-12T22:49:51.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:51.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.203882+0000", 2024-09-12T22:49:51.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001386235 2024-09-12T22:49:51.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:51.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207608+0000", 2024-09-12T22:49:51.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00372609 2024-09-12T22:49:51.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:51.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207631+0000", 2024-09-12T22:49:51.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2569999999999999e-05 2024-09-12T22:49:51.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:51.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207670+0000", 2024-09-12T22:49:51.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8690999999999999e-05 2024-09-12T22:49:51.737 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.737 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:51.737 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.737 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:172 3.1e 3:7bf7e7b5:::200.00000006:head [write 181107~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:51.737 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.188511+0000", 2024-09-12T22:49:51.737 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.4801098809999997, 2024-09-12T22:49:51.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.019289285999999999, 2024-09-12T22:49:51.738 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:51.738 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:51.738 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:51.738 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:51.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.738 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:51.738 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188511+0000", 2024-09-12T22:49:51.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.738 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.738 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:51.738 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188511+0000", 2024-09-12T22:49:51.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.739 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:51.739 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188512+0000", 2024-09-12T22:49:51.739 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.13e-07 2024-09-12T22:49:51.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.739 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:51.739 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188515+0000", 2024-09-12T22:49:51.739 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1310000000000002e-06 2024-09-12T22:49:51.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.739 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:51.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188523+0000", 2024-09-12T22:49:51.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7510000000000008e-06 2024-09-12T22:49:51.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:51.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188527+0000", 2024-09-12T22:49:51.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7870000000000001e-06 2024-09-12T22:49:51.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:51.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.203413+0000", 2024-09-12T22:49:51.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01488593 2024-09-12T22:49:51.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:51.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.203484+0000", 2024-09-12T22:49:51.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0783000000000003e-05 2024-09-12T22:49:51.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:51.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.203608+0000", 2024-09-12T22:49:51.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012370600000000001 2024-09-12T22:49:51.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:51.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.205204+0000", 2024-09-12T22:49:51.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001596606 2024-09-12T22:49:51.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.742 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:51.742 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207741+0000", 2024-09-12T22:49:51.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0025370089999999998 2024-09-12T22:49:51.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.742 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:51.742 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207763+0000", 2024-09-12T22:49:51.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1838999999999999e-05 2024-09-12T22:49:51.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.743 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:51.743 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207801+0000", 2024-09-12T22:49:51.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7231000000000003e-05 2024-09-12T22:49:51.743 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.743 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:51.743 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.743 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:173 3.1e 3:7bf7e7b5:::200.00000006:head [write 182514~2449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:51.743 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.188541+0000", 2024-09-12T22:49:51.743 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.4800801870000004, 2024-09-12T22:49:51.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.021263447000000001, 2024-09-12T22:49:51.743 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:51.744 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:51.744 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:51.744 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:51.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:51.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188541+0000", 2024-09-12T22:49:51.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:51.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188541+0000", 2024-09-12T22:49:51.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:51.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188541+0000", 2024-09-12T22:49:51.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0100000000000005e-07 2024-09-12T22:49:51.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:51.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188545+0000", 2024-09-12T22:49:51.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1310000000000002e-06 2024-09-12T22:49:51.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:51.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188551+0000", 2024-09-12T22:49:51.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6699999999999997e-06 2024-09-12T22:49:51.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:51.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188556+0000", 2024-09-12T22:49:51.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0000000000000004e-06 2024-09-12T22:49:51.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:51.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.203911+0000", 2024-09-12T22:49:51.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015354948 2024-09-12T22:49:51.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:51.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.203957+0000", 2024-09-12T22:49:51.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.587e-05 2024-09-12T22:49:51.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:51.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.204039+0000", 2024-09-12T22:49:51.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1672e-05 2024-09-12T22:49:51.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:51.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.205249+0000", 2024-09-12T22:49:51.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001210493 2024-09-12T22:49:51.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.748 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:51.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.209729+0000", 2024-09-12T22:49:51.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044796239999999998 2024-09-12T22:49:51.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.748 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:51.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.209759+0000", 2024-09-12T22:49:51.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9691000000000001e-05 2024-09-12T22:49:51.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.748 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:51.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.209804+0000", 2024-09-12T22:49:51.749 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5847000000000003e-05 2024-09-12T22:49:51.749 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.749 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:51.749 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.749 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.749 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:174 3.1e 3:7bf7e7b5:::200.00000006:head [write 184963~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:51.749 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.188594+0000", 2024-09-12T22:49:51.749 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.480026896, 2024-09-12T22:49:51.749 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.021300155000000001, 2024-09-12T22:49:51.749 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:51.749 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:51.749 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:51.749 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:51.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:51.750 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188594+0000", 2024-09-12T22:49:51.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:51.750 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188594+0000", 2024-09-12T22:49:51.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:51.750 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188595+0000", 2024-09-12T22:49:51.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2799999999999995e-07 2024-09-12T22:49:51.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:51.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188598+0000", 2024-09-12T22:49:51.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.27e-06 2024-09-12T22:49:51.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:51.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188605+0000", 2024-09-12T22:49:51.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1670000000000002e-06 2024-09-12T22:49:51.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:51.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188611+0000", 2024-09-12T22:49:51.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3329999999999996e-06 2024-09-12T22:49:51.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:51.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.204291+0000", 2024-09-12T22:49:51.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015680383999999999 2024-09-12T22:49:51.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:51.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.204334+0000", 2024-09-12T22:49:51.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2904999999999997e-05 2024-09-12T22:49:51.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:51.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.204399+0000", 2024-09-12T22:49:51.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4894000000000006e-05 2024-09-12T22:49:51.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:51.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.206814+0000", 2024-09-12T22:49:51.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0024151760000000002 2024-09-12T22:49:51.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:51.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.209809+0000", 2024-09-12T22:49:51.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0029953240000000002 2024-09-12T22:49:51.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:51.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.209837+0000", 2024-09-12T22:49:51.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7521999999999998e-05 2024-09-12T22:49:51.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:51.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.209894+0000", 2024-09-12T22:49:51.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7451999999999998e-05 2024-09-12T22:49:51.754 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.755 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:51.755 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.755 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:175 3.1e 3:7bf7e7b5:::200.00000006:head [write 186365~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:51.755 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.188623+0000", 2024-09-12T22:49:51.755 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.4799978119999997, 2024-09-12T22:49:51.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.021347469000000001, 2024-09-12T22:49:51.755 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:51.755 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:51.755 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:51.755 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:51.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:51.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188623+0000", 2024-09-12T22:49:51.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:51.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188623+0000", 2024-09-12T22:49:51.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:51.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188624+0000", 2024-09-12T22:49:51.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5200000000000002e-07 2024-09-12T22:49:51.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:51.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188627+0000", 2024-09-12T22:49:51.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7319999999999998e-06 2024-09-12T22:49:51.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:51.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188633+0000", 2024-09-12T22:49:51.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5989999999999998e-06 2024-09-12T22:49:51.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:51.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188638+0000", 2024-09-12T22:49:51.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8160000000000001e-06 2024-09-12T22:49:51.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:51.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.205285+0000", 2024-09-12T22:49:51.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016647408999999998 2024-09-12T22:49:51.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:51.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.205325+0000", 2024-09-12T22:49:51.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9521999999999999e-05 2024-09-12T22:49:51.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:51.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.205389+0000", 2024-09-12T22:49:51.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4259999999999998e-05 2024-09-12T22:49:51.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:51.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.206855+0000", 2024-09-12T22:49:51.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0014656129999999999 2024-09-12T22:49:51.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:51.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.209899+0000", 2024-09-12T22:49:51.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003044658 2024-09-12T22:49:51.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:51.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.209925+0000", 2024-09-12T22:49:51.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5193000000000001e-05 2024-09-12T22:49:51.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:51.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.209971+0000", 2024-09-12T22:49:51.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6214999999999997e-05 2024-09-12T22:49:51.760 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.760 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:51.760 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.761 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:186 3.1e 3:7bf7e7b5:::200.00000006:head [write 220137~6982 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:51.761 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.197880+0000", 2024-09-12T22:49:51.761 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.4707413850000002, 2024-09-12T22:49:51.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.021088583000000001, 2024-09-12T22:49:51.761 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:51.761 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:51.761 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:51.761 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:51.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:51.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.197880+0000", 2024-09-12T22:49:51.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:51.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.197880+0000", 2024-09-12T22:49:51.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:51.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.197881+0000", 2024-09-12T22:49:51.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9699999999999995e-07 2024-09-12T22:49:51.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:51.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.197890+0000", 2024-09-12T22:49:51.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1859999999999998e-06 2024-09-12T22:49:51.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:51.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.197898+0000", 2024-09-12T22:49:51.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3389999999999993e-06 2024-09-12T22:49:51.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:51.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.197905+0000", 2024-09-12T22:49:51.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4710000000000004e-06 2024-09-12T22:49:51.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:51.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.213366+0000", 2024-09-12T22:49:51.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015461383 2024-09-12T22:49:51.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:51.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.213436+0000", 2024-09-12T22:49:51.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0499000000000004e-05 2024-09-12T22:49:51.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:51.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.213530+0000", 2024-09-12T22:49:51.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3833999999999996e-05 2024-09-12T22:49:51.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:51.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.214117+0000", 2024-09-12T22:49:51.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00058681900000000003 2024-09-12T22:49:51.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:51.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.218855+0000", 2024-09-12T22:49:51.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047378860000000002 2024-09-12T22:49:51.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:51.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.218910+0000", 2024-09-12T22:49:51.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4613e-05 2024-09-12T22:49:51.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:51.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.218968+0000", 2024-09-12T22:49:51.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8755999999999998e-05 2024-09-12T22:49:51.766 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.766 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:51.766 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.766 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:10661 4.33 4:cf068428:::100000030d3.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:49:51.766 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:51.527973+0000", 2024-09-12T22:49:51.767 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.140648204, 2024-09-12T22:49:51.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.021462103999999999, 2024-09-12T22:49:51.767 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:51.767 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:51.767 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:51.767 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:51.767 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:51.767 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:51.767 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 10661 2024-09-12T22:49:51.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.767 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:51.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:51.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.527973+0000", 2024-09-12T22:49:51.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:51.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.527973+0000", 2024-09-12T22:49:51.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:51.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.527974+0000", 2024-09-12T22:49:51.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2399999999999997e-07 2024-09-12T22:49:51.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:51.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.535177+0000", 2024-09-12T22:49:51.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0072034129999999997 2024-09-12T22:49:51.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:51.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.535186+0000", 2024-09-12T22:49:51.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0710000000000001e-06 2024-09-12T22:49:51.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:51.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.535191+0000", 2024-09-12T22:49:51.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:49:51.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:51.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.535237+0000", 2024-09-12T22:49:51.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6576999999999998e-05 2024-09-12T22:49:51.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:51.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.535319+0000", 2024-09-12T22:49:51.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1384000000000005e-05 2024-09-12T22:49:51.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:51.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.535446+0000", 2024-09-12T22:49:51.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012761200000000001 2024-09-12T22:49:51.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:51.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.547779+0000", 2024-09-12T22:49:51.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012332242 2024-09-12T22:49:51.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:51.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.549362+0000", 2024-09-12T22:49:51.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001583564 2024-09-12T22:49:51.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:51.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.549401+0000", 2024-09-12T22:49:51.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8541000000000003e-05 2024-09-12T22:49:51.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:51.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.549435+0000", 2024-09-12T22:49:51.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4289000000000003e-05 2024-09-12T22:49:51.772 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.772 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:51.772 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.772 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:10664 4.2e 4:77d2457d:::100000030c0.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:49:51.772 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:51.536905+0000", 2024-09-12T22:49:51.773 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.131716047, 2024-09-12T22:49:51.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.024857089999999998, 2024-09-12T22:49:51.773 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:51.773 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:51.773 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:51.773 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:51.773 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:51.773 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:51.773 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 10664 2024-09-12T22:49:51.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.773 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:51.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:51.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.536905+0000", 2024-09-12T22:49:51.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:51.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.536905+0000", 2024-09-12T22:49:51.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:51.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.536906+0000", 2024-09-12T22:49:51.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0049999999999999e-06 2024-09-12T22:49:51.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:51.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.545080+0000", 2024-09-12T22:49:51.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081741360000000002 2024-09-12T22:49:51.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:51.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.545091+0000", 2024-09-12T22:49:51.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0773e-05 2024-09-12T22:49:51.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:51.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.545112+0000", 2024-09-12T22:49:51.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0577999999999998e-05 2024-09-12T22:49:51.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:51.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.545156+0000", 2024-09-12T22:49:51.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4626000000000003e-05 2024-09-12T22:49:51.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:51.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.545265+0000", 2024-09-12T22:49:51.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010919100000000001 2024-09-12T22:49:51.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:51.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.545344+0000", 2024-09-12T22:49:51.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8870999999999998e-05 2024-09-12T22:49:51.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:51.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.559936+0000", 2024-09-12T22:49:51.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014592159 2024-09-12T22:49:51.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:51.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.561655+0000", 2024-09-12T22:49:51.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001718065 2024-09-12T22:49:51.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:51.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.561710+0000", 2024-09-12T22:49:51.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5084000000000003e-05 2024-09-12T22:49:51.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:51.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.561762+0000", 2024-09-12T22:49:51.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2602000000000002e-05 2024-09-12T22:49:51.778 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.778 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:51.778 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.779 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:10686 4.33 4:cf068428:::100000030d3.00000000:head [write 0~4194304 [2@1769906]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:49:51.779 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:51.586622+0000", 2024-09-12T22:49:51.779 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.081998967000000006, 2024-09-12T22:49:51.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.027146674999999999, 2024-09-12T22:49:51.779 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:51.779 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:51.779 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:51.779 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:51.779 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:51.779 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:51.779 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 10686 2024-09-12T22:49:51.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.779 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:51.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:51.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.586622+0000", 2024-09-12T22:49:51.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:51.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.586622+0000", 2024-09-12T22:49:51.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:51.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.586624+0000", 2024-09-12T22:49:51.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3400000000000001e-06 2024-09-12T22:49:51.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:51.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.593104+0000", 2024-09-12T22:49:51.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0064806489999999998 2024-09-12T22:49:51.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:51.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.593115+0000", 2024-09-12T22:49:51.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.115e-05 2024-09-12T22:49:51.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:51.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.593122+0000", 2024-09-12T22:49:51.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1659999999999997e-06 2024-09-12T22:49:51.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:51.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.593186+0000", 2024-09-12T22:49:51.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3349999999999995e-05 2024-09-12T22:49:51.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:51.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.593282+0000", 2024-09-12T22:49:51.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6434999999999994e-05 2024-09-12T22:49:51.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:51.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.593433+0000", 2024-09-12T22:49:51.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015100899999999999 2024-09-12T22:49:51.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:51.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.599785+0000", 2024-09-12T22:49:51.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063515230000000004 2024-09-12T22:49:51.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:51.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.613682+0000", 2024-09-12T22:49:51.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013897197999999999 2024-09-12T22:49:51.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:51.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.613722+0000", 2024-09-12T22:49:51.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.032e-05 2024-09-12T22:49:51.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:51.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.613769+0000", 2024-09-12T22:49:51.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6535000000000001e-05 2024-09-12T22:49:51.785 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.785 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:51.785 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.785 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:10689 4.33 4:cf068428:::100000030d3.00000000:head [write 0~4194304 [2@1769906]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:49:51.785 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:51.595855+0000", 2024-09-12T22:49:51.785 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.072766599000000001, 2024-09-12T22:49:51.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.019983436, 2024-09-12T22:49:51.786 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:51.786 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:51.786 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:51.786 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:51.786 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:51.786 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:51.786 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 10689 2024-09-12T22:49:51.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.786 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:51.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:51.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.595855+0000", 2024-09-12T22:49:51.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:51.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.595855+0000", 2024-09-12T22:49:51.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:51.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:51.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.595857+0000", 2024-09-12T22:49:51.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0600000000000002e-06 2024-09-12T22:49:51.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:51.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.602808+0000", 2024-09-12T22:49:51.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069516639999999998 2024-09-12T22:49:51.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:51.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.602824+0000", 2024-09-12T22:49:51.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5954999999999999e-05 2024-09-12T22:49:51.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:51.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.602834+0000", 2024-09-12T22:49:51.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0079e-05 2024-09-12T22:49:51.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:51.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.602894+0000", 2024-09-12T22:49:51.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9287999999999999e-05 2024-09-12T22:49:51.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:51.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.602956+0000", 2024-09-12T22:49:51.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2299999999999996e-05 2024-09-12T22:49:51.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:51.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.603045+0000", 2024-09-12T22:49:51.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9402999999999998e-05 2024-09-12T22:49:51.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:51.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.610126+0000", 2024-09-12T22:49:51.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0070803580000000001 2024-09-12T22:49:51.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:51.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.615727+0000", 2024-09-12T22:49:51.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0056010310000000002 2024-09-12T22:49:51.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:51.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.615792+0000", 2024-09-12T22:49:51.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4926999999999997e-05 2024-09-12T22:49:51.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:51.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:51.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:51.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.615838+0000", 2024-09-12T22:49:51.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6371e-05 2024-09-12T22:49:51.791 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.791 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:51.791 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.791 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:51.791 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:51.791 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:51.794 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:51.797 INFO:tasks.workunit.client.0.smithi066.stdout:5/68: truncate d5/f7 1582458 0 2024-09-12T22:49:51.797 INFO:tasks.workunit.client.0.smithi066.stdout:5/69: mkdir d5/d11 0 2024-09-12T22:49:51.797 INFO:tasks.workunit.client.0.smithi066.stdout:5/70: chown d5/de 766 1 2024-09-12T22:49:51.797 INFO:tasks.workunit.client.0.smithi066.stdout:5/71: rename d5/f7 to d5/f12 0 2024-09-12T22:49:51.797 INFO:tasks.workunit.client.0.smithi066.stdout:5/72: dwrite d5/f9 [0,4194304] 0 2024-09-12T22:49:51.797 INFO:tasks.workunit.client.0.smithi066.stdout:5/73: dwrite d5/f9 [0,4194304] 0 2024-09-12T22:49:51.798 INFO:tasks.workunit.client.0.smithi066.stdout:5/74: link c0 d5/c13 0 2024-09-12T22:49:51.798 INFO:tasks.workunit.client.0.smithi066.stdout:5/75: mkdir d5/d14 0 2024-09-12T22:49:51.798 INFO:tasks.workunit.client.0.smithi066.stdout:5/76: dread d5/f9 [0,4194304] 0 2024-09-12T22:49:51.798 INFO:tasks.workunit.client.0.smithi066.stdout:5/77: dread f3 [4194304,4194304] 0 2024-09-12T22:49:51.798 INFO:tasks.workunit.client.0.smithi066.stdout:5/78: readlink l2 0 2024-09-12T22:49:51.798 INFO:tasks.workunit.client.0.smithi066.stdout:5/79: fsync d5/f12 0 2024-09-12T22:49:51.798 INFO:tasks.workunit.client.0.smithi066.stdout:5/80: fdatasync d5/de/ff 0 2024-09-12T22:49:51.798 INFO:tasks.workunit.client.0.smithi066.stdout:5/81: dwrite d5/de/ff [0,4194304] 0 2024-09-12T22:49:51.798 INFO:tasks.workunit.client.0.smithi066.stdout:5/82: chown c0 379665050 1 2024-09-12T22:49:51.798 INFO:tasks.workunit.client.0.smithi066.stdout:5/83: mkdir d5/d15 0 2024-09-12T22:49:51.798 INFO:tasks.workunit.client.0.smithi066.stdout:5/84: dwrite f3 [0,4194304] 0 2024-09-12T22:49:51.798 INFO:tasks.workunit.client.0.smithi066.stdout:5/85: chown f4 409 1 2024-09-12T22:49:51.798 INFO:tasks.workunit.client.0.smithi066.stdout:5/86: rename d5/d11 to d5/d11/d16 22 2024-09-12T22:49:51.798 INFO:tasks.workunit.client.0.smithi066.stdout:5/87: rmdir d5 39 2024-09-12T22:49:51.799 INFO:tasks.workunit.client.0.smithi066.stdout:5/88: fsync f4 0 2024-09-12T22:49:51.799 INFO:tasks.workunit.client.0.smithi066.stdout:5/89: chown d5/f9 366455 1 2024-09-12T22:49:51.799 INFO:tasks.workunit.client.0.smithi066.stdout:5/90: stat d5/d15 0 2024-09-12T22:49:51.799 INFO:tasks.workunit.client.0.smithi066.stdout:5/91: truncate f3 2779189 0 2024-09-12T22:49:51.799 INFO:tasks.workunit.client.0.smithi066.stdout:5/92: fdatasync d5/f9 0 2024-09-12T22:49:51.799 INFO:tasks.workunit.client.0.smithi066.stdout:5/93: truncate f3 1677567 0 2024-09-12T22:49:51.799 INFO:tasks.workunit.client.0.smithi066.stdout:5/94: creat d5/d15/f17 x:0 0 0 2024-09-12T22:49:51.799 INFO:tasks.workunit.client.0.smithi066.stdout:5/95: fdatasync d5/f12 0 2024-09-12T22:49:51.799 INFO:tasks.workunit.client.0.smithi066.stdout:5/96: symlink d5/de/l18 0 2024-09-12T22:49:51.799 INFO:tasks.workunit.client.0.smithi066.stdout:5/97: fsync f3 0 2024-09-12T22:49:51.799 INFO:tasks.workunit.client.0.smithi066.stdout:5/98: write d5/de/ff [2545779,8520] 0 2024-09-12T22:49:51.799 INFO:tasks.workunit.client.0.smithi066.stdout:5/99: link d5/c13 d5/d14/c19 0 2024-09-12T22:49:51.799 INFO:tasks.workunit.client.0.smithi066.stdout:5/100: truncate d5/d15/f17 683825 0 2024-09-12T22:49:51.799 INFO:tasks.workunit.client.0.smithi066.stdout:5/101: dread d5/de/ff [0,4194304] 0 2024-09-12T22:49:51.800 INFO:tasks.workunit.client.0.smithi066.stdout:5/102: creat d5/d15/f1a x:0 0 0 2024-09-12T22:49:51.800 INFO:tasks.workunit.client.0.smithi066.stdout:5/103: write d5/de/ff [1460622,3548] 0 2024-09-12T22:49:51.800 INFO:tasks.workunit.client.0.smithi066.stdout:5/104: write d5/d15/f1a [819197,128630] 0 2024-09-12T22:49:51.800 INFO:tasks.workunit.client.0.smithi066.stdout:5/105: link d5/d15/f17 d5/d11/f1b 0 2024-09-12T22:49:51.800 INFO:tasks.workunit.client.0.smithi066.stdout:5/106: rmdir d5/d11 39 2024-09-12T22:49:51.800 INFO:tasks.workunit.client.0.smithi066.stdout:5/107: dwrite f4 [0,4194304] 0 2024-09-12T22:49:51.800 INFO:tasks.workunit.client.0.smithi066.stdout:5/108: read d5/d15/f17 [584447,84501] 0 2024-09-12T22:49:51.800 INFO:tasks.workunit.client.0.smithi066.stdout:5/109: dread d5/d11/f1b [0,4194304] 0 2024-09-12T22:49:51.800 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:51.791+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:51.894 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:51.892+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:51.902 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:51.902 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:51.902 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:49:51.902 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:51.911 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:51.995 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:51.993+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:52.054 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:52.054 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:52.054 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:49:52.054 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:49:52.054 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:52.062 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:52.103 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:52.102+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:52.197 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:52.196+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:52.211 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:52.212 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:49:52.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:49:52.212 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:49:52.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.212 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:49:52.212 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:39.160867+0000", 2024-09-12T22:49:52.212 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.048624362, 2024-09-12T22:49:52.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018225736999999999, 2024-09-12T22:49:52.212 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:52.212 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:52.212 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.212 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:52.213 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:52.213 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:52.216 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 5 2024-09-12T22:49:52.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.216 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:52.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:52.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.160867+0000", 2024-09-12T22:49:52.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:52.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.160867+0000", 2024-09-12T22:49:52.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:52.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.160869+0000", 2024-09-12T22:49:52.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1500000000000002e-06 2024-09-12T22:49:52.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:52.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.167303+0000", 2024-09-12T22:49:52.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0064335690000000001 2024-09-12T22:49:52.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:52.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.167320+0000", 2024-09-12T22:49:52.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7329e-05 2024-09-12T22:49:52.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.167329+0000", 2024-09-12T22:49:52.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4069999999999993e-06 2024-09-12T22:49:52.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:52.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.167402+0000", 2024-09-12T22:49:52.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3184999999999998e-05 2024-09-12T22:49:52.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:52.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.167550+0000", 2024-09-12T22:49:52.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014852499999999999 2024-09-12T22:49:52.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:52.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.167689+0000", 2024-09-12T22:49:52.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013904799999999999 2024-09-12T22:49:52.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:52.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.176328+0000", 2024-09-12T22:49:52.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0086384979999999997 2024-09-12T22:49:52.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:52.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.179037+0000", 2024-09-12T22:49:52.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027092599999999998 2024-09-12T22:49:52.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:52.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.179066+0000", 2024-09-12T22:49:52.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9132000000000002e-05 2024-09-12T22:49:52.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.221 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:52.221 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:39.179093+0000", 2024-09-12T22:49:52.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6633999999999999e-05 2024-09-12T22:49:52.221 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.221 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:52.221 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.221 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:10650 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4063232] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:49:52.221 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:51.511323+0000", 2024-09-12T22:49:52.221 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.69816837300000001, 2024-09-12T22:49:52.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016423151, 2024-09-12T22:49:52.222 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:52.222 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:52.222 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.222 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:52.222 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:52.222 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:52.222 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 10650 2024-09-12T22:49:52.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.223 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:52.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:52.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.511323+0000", 2024-09-12T22:49:52.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:52.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.511323+0000", 2024-09-12T22:49:52.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:52.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.511324+0000", 2024-09-12T22:49:52.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1999999999999999e-07 2024-09-12T22:49:52.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:52.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.520355+0000", 2024-09-12T22:49:52.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090310310000000001 2024-09-12T22:49:52.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:52.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.520368+0000", 2024-09-12T22:49:52.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3604999999999999e-05 2024-09-12T22:49:52.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.520376+0000", 2024-09-12T22:49:52.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0890000000000002e-06 2024-09-12T22:49:52.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:52.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.520414+0000", 2024-09-12T22:49:52.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8869999999999999e-05 2024-09-12T22:49:52.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:52.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.520526+0000", 2024-09-12T22:49:52.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000111251 2024-09-12T22:49:52.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:52.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.527600+0000", 2024-09-12T22:49:52.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070746760000000002 2024-09-12T22:49:52.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:52.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.527657+0000", 2024-09-12T22:49:52.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.702e-05 2024-09-12T22:49:52.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.227 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:52.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.527746+0000", 2024-09-12T22:49:52.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8988999999999998e-05 2024-09-12T22:49:52.227 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.227 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:52.227 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.227 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:10657 4.2c 4:37692a73:::100000030c0.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:49:52.227 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:51.520481+0000", 2024-09-12T22:49:52.227 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.68901104599999996, 2024-09-12T22:49:52.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017635642999999999, 2024-09-12T22:49:52.228 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:52.228 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:52.228 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.228 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:52.228 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:52.228 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:52.228 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 10657 2024-09-12T22:49:52.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.228 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:52.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:52.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.520481+0000", 2024-09-12T22:49:52.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:52.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.520481+0000", 2024-09-12T22:49:52.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:52.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.520481+0000", 2024-09-12T22:49:52.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2000000000000001e-07 2024-09-12T22:49:52.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:52.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.529937+0000", 2024-09-12T22:49:52.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0094561950000000006 2024-09-12T22:49:52.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:52.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.529953+0000", 2024-09-12T22:49:52.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6243999999999999e-05 2024-09-12T22:49:52.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.529964+0000", 2024-09-12T22:49:52.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0617e-05 2024-09-12T22:49:52.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:52.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.530032+0000", 2024-09-12T22:49:52.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8198e-05 2024-09-12T22:49:52.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:52.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.530156+0000", 2024-09-12T22:49:52.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000123387 2024-09-12T22:49:52.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:52.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.538022+0000", 2024-09-12T22:49:52.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078668550000000007 2024-09-12T22:49:52.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:52.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.538059+0000", 2024-09-12T22:49:52.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6293e-05 2024-09-12T22:49:52.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.233 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:52.233 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.538116+0000", 2024-09-12T22:49:52.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7534000000000002e-05 2024-09-12T22:49:52.233 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.233 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:52.233 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.233 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:10660 4.23 4:c5bf0e37:::100000030bf.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:49:52.233 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:51.530144+0000", 2024-09-12T22:49:52.233 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.67934714799999996, 2024-09-12T22:49:52.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026397501, 2024-09-12T22:49:52.234 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:52.234 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:52.234 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.234 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:52.234 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:52.234 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:52.234 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 10660 2024-09-12T22:49:52.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.234 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:52.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:52.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.530144+0000", 2024-09-12T22:49:52.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:52.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.530144+0000", 2024-09-12T22:49:52.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:52.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.530145+0000", 2024-09-12T22:49:52.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:49:52.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:52.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.537338+0000", 2024-09-12T22:49:52.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071928679999999998 2024-09-12T22:49:52.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:52.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.537357+0000", 2024-09-12T22:49:52.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8804000000000002e-05 2024-09-12T22:49:52.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.537382+0000", 2024-09-12T22:49:52.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5055e-05 2024-09-12T22:49:52.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:52.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.537432+0000", 2024-09-12T22:49:52.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0562999999999997e-05 2024-09-12T22:49:52.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:52.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.537546+0000", 2024-09-12T22:49:52.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114088 2024-09-12T22:49:52.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:52.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.537665+0000", 2024-09-12T22:49:52.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000118171 2024-09-12T22:49:52.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:52.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.541897+0000", 2024-09-12T22:49:52.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042323739999999997 2024-09-12T22:49:52.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:52.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.556413+0000", 2024-09-12T22:49:52.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014515689999999999 2024-09-12T22:49:52.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:52.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.556475+0000", 2024-09-12T22:49:52.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2045999999999995e-05 2024-09-12T22:49:52.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:52.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.556542+0000", 2024-09-12T22:49:52.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7216000000000002e-05 2024-09-12T22:49:52.239 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.239 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:52.239 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.239 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:10661 4.33 e54/17 4:cf068428:::100000030d3.00000000:head v 54'166, mlcod=54'164)", 2024-09-12T22:49:52.240 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:51.535541+0000", 2024-09-12T22:49:52.240 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.67395104100000003, 2024-09-12T22:49:52.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012797938999999999, 2024-09-12T22:49:52.240 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:52.240 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:52.240 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.240 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:52.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:52.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.535541+0000", 2024-09-12T22:49:52.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:52.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.535541+0000", 2024-09-12T22:49:52.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:52.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.535542+0000", 2024-09-12T22:49:52.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2440000000000001e-06 2024-09-12T22:49:52.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:52.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.540583+0000", 2024-09-12T22:49:52.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050410949999999998 2024-09-12T22:49:52.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:52.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.540595+0000", 2024-09-12T22:49:52.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2576e-05 2024-09-12T22:49:52.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.540603+0000", 2024-09-12T22:49:52.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4399999999999999e-06 2024-09-12T22:49:52.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:52.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.540660+0000", 2024-09-12T22:49:52.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7272000000000003e-05 2024-09-12T22:49:52.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:52.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.540696+0000", 2024-09-12T22:49:52.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6118000000000002e-05 2024-09-12T22:49:52.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:52.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.548303+0000", 2024-09-12T22:49:52.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0076071699999999999 2024-09-12T22:49:52.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:52.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.548338+0000", 2024-09-12T22:49:52.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5024000000000002e-05 2024-09-12T22:49:52.244 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.244 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:52.244 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.244 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:10666 4.35 4:addad63f:::100000030d7.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:49:52.244 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:51.539293+0000", 2024-09-12T22:49:52.244 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.67019890800000004, 2024-09-12T22:49:52.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021734917999999999, 2024-09-12T22:49:52.245 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:52.245 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:52.245 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.245 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:52.245 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:52.245 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:52.245 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 10666 2024-09-12T22:49:52.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.245 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:52.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:52.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.539293+0000", 2024-09-12T22:49:52.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:52.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.539293+0000", 2024-09-12T22:49:52.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:52.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.539294+0000", 2024-09-12T22:49:52.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4810000000000001e-06 2024-09-12T22:49:52.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:52.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.547493+0000", 2024-09-12T22:49:52.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081989490000000005 2024-09-12T22:49:52.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:52.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.547507+0000", 2024-09-12T22:49:52.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3599e-05 2024-09-12T22:49:52.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.547514+0000", 2024-09-12T22:49:52.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9970000000000001e-06 2024-09-12T22:49:52.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:52.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.547574+0000", 2024-09-12T22:49:52.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0208999999999999e-05 2024-09-12T22:49:52.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:52.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.547657+0000", 2024-09-12T22:49:52.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2631000000000002e-05 2024-09-12T22:49:52.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:52.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.560880+0000", 2024-09-12T22:49:52.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013223613 2024-09-12T22:49:52.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:52.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.560949+0000", 2024-09-12T22:49:52.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9235999999999999e-05 2024-09-12T22:49:52.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:52.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.561028+0000", 2024-09-12T22:49:52.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8202999999999996e-05 2024-09-12T22:49:52.251 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.251 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:52.251 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.252 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:10664 4.2e e54/17 4:77d2457d:::100000030c0.00000001:head v 54'165, mlcod=54'163)", 2024-09-12T22:49:52.252 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:51.545504+0000", 2024-09-12T22:49:52.252 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.66398729000000001, 2024-09-12T22:49:52.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016017370999999999, 2024-09-12T22:49:52.252 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:52.252 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:52.252 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.252 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:52.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:52.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.545504+0000", 2024-09-12T22:49:52.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:52.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.545504+0000", 2024-09-12T22:49:52.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:52.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.545505+0000", 2024-09-12T22:49:52.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.7100000000000011e-07 2024-09-12T22:49:52.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:52.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.550087+0000", 2024-09-12T22:49:52.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045812960000000003 2024-09-12T22:49:52.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:52.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.550095+0000", 2024-09-12T22:49:52.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7430000000000008e-06 2024-09-12T22:49:52.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.550101+0000", 2024-09-12T22:49:52.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1410000000000002e-06 2024-09-12T22:49:52.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:52.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.550141+0000", 2024-09-12T22:49:52.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9255000000000003e-05 2024-09-12T22:49:52.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:52.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.550160+0000", 2024-09-12T22:49:52.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9091999999999999e-05 2024-09-12T22:49:52.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:52.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.561485+0000", 2024-09-12T22:49:52.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011325244 2024-09-12T22:49:52.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:52.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.561522+0000", 2024-09-12T22:49:52.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6628999999999998e-05 2024-09-12T22:49:52.256 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.256 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:52.256 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.256 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:10674 4.23 4:c5bf0e37:::100000030bf.00000001:head [write 1753986~77714] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:49:52.257 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:51.549734+0000", 2024-09-12T22:49:52.257 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.65975729500000002, 2024-09-12T22:49:52.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010611397999999999, 2024-09-12T22:49:52.257 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:52.257 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:52.257 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.257 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:52.257 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:52.257 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:52.257 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 10674 2024-09-12T22:49:52.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.257 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:52.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:52.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.549734+0000", 2024-09-12T22:49:52.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:52.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.549734+0000", 2024-09-12T22:49:52.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:52.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.549735+0000", 2024-09-12T22:49:52.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.92e-07 2024-09-12T22:49:52.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:52.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.550226+0000", 2024-09-12T22:49:52.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00049086699999999997 2024-09-12T22:49:52.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:52.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.550238+0000", 2024-09-12T22:49:52.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.171e-05 2024-09-12T22:49:52.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.550244+0000", 2024-09-12T22:49:52.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5819999999999998e-06 2024-09-12T22:49:52.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:52.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.550291+0000", 2024-09-12T22:49:52.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6607999999999998e-05 2024-09-12T22:49:52.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:52.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.550367+0000", 2024-09-12T22:49:52.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5747000000000005e-05 2024-09-12T22:49:52.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:52.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.550480+0000", 2024-09-12T22:49:52.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011316599999999999 2024-09-12T22:49:52.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:52.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.551706+0000", 2024-09-12T22:49:52.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012259860000000001 2024-09-12T22:49:52.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:52.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.560281+0000", 2024-09-12T22:49:52.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0085749510000000008 2024-09-12T22:49:52.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:52.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.560315+0000", 2024-09-12T22:49:52.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.464e-05 2024-09-12T22:49:52.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:52.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.560346+0000", 2024-09-12T22:49:52.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0349e-05 2024-09-12T22:49:52.262 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.262 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:52.262 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.263 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:10668 4.33 e54/17 4:cf068428:::100000030d3.00000000:head v 54'168, mlcod=54'165)", 2024-09-12T22:49:52.263 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:51.552492+0000", 2024-09-12T22:49:52.263 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.656999691, 2024-09-12T22:49:52.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011566832000000001, 2024-09-12T22:49:52.263 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:52.263 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:52.263 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.263 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:52.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:52.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.552492+0000", 2024-09-12T22:49:52.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:52.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.552492+0000", 2024-09-12T22:49:52.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:52.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.552492+0000", 2024-09-12T22:49:52.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9599999999999999e-07 2024-09-12T22:49:52.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:52.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.556245+0000", 2024-09-12T22:49:52.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0037522979999999998 2024-09-12T22:49:52.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:52.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.556255+0000", 2024-09-12T22:49:52.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0183000000000001e-05 2024-09-12T22:49:52.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.556261+0000", 2024-09-12T22:49:52.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7230000000000001e-06 2024-09-12T22:49:52.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:52.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.556307+0000", 2024-09-12T22:49:52.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6282999999999997e-05 2024-09-12T22:49:52.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:52.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.556322+0000", 2024-09-12T22:49:52.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5075999999999999e-05 2024-09-12T22:49:52.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:52.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.564031+0000", 2024-09-12T22:49:52.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077091759999999999 2024-09-12T22:49:52.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:52.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.564059+0000", 2024-09-12T22:49:52.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7597e-05 2024-09-12T22:49:52.267 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.267 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:52.267 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.267 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:10687 4.1e 4:7aad8e66:::100000030cb.00000001:head [write 0~4194304 [2@0]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:49:52.267 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:51.585194+0000", 2024-09-12T22:49:52.268 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.62429776800000003, 2024-09-12T22:49:52.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026355747999999998, 2024-09-12T22:49:52.268 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:52.268 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:52.268 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.268 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:52.268 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:52.268 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:52.268 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 10687 2024-09-12T22:49:52.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.268 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:52.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:52.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.585194+0000", 2024-09-12T22:49:52.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:52.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.585194+0000", 2024-09-12T22:49:52.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:52.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.585195+0000", 2024-09-12T22:49:52.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6750000000000001e-06 2024-09-12T22:49:52.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:52.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.594769+0000", 2024-09-12T22:49:52.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0095737649999999997 2024-09-12T22:49:52.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:52.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.594784+0000", 2024-09-12T22:49:52.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5075999999999999e-05 2024-09-12T22:49:52.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.594792+0000", 2024-09-12T22:49:52.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2370000000000003e-06 2024-09-12T22:49:52.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:52.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.594859+0000", 2024-09-12T22:49:52.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7792000000000004e-05 2024-09-12T22:49:52.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:52.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.595018+0000", 2024-09-12T22:49:52.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000158846 2024-09-12T22:49:52.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:52.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.611397+0000", 2024-09-12T22:49:52.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0163786 2024-09-12T22:49:52.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:52.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.611461+0000", 2024-09-12T22:49:52.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4090999999999993e-05 2024-09-12T22:49:52.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:52.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.611550+0000", 2024-09-12T22:49:52.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8665999999999994e-05 2024-09-12T22:49:52.273 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.273 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:52.273 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.273 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:10686 4.33 e54/17 4:cf068428:::100000030d3.00000000:head v 54'171, mlcod=54'168)", 2024-09-12T22:49:52.273 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:51.593562+0000", 2024-09-12T22:49:52.273 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.61592964400000005, 2024-09-12T22:49:52.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020021779999999999, 2024-09-12T22:49:52.273 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:52.273 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:52.273 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.273 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:52.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:52.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.593562+0000", 2024-09-12T22:49:52.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:52.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.593562+0000", 2024-09-12T22:49:52.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:52.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.593563+0000", 2024-09-12T22:49:52.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9100000000000002e-07 2024-09-12T22:49:52.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:52.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.598701+0000", 2024-09-12T22:49:52.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051386219999999998 2024-09-12T22:49:52.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:52.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.598713+0000", 2024-09-12T22:49:52.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-05 2024-09-12T22:49:52.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.598720+0000", 2024-09-12T22:49:52.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.002e-06 2024-09-12T22:49:52.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:52.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.598801+0000", 2024-09-12T22:49:52.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0418000000000002e-05 2024-09-12T22:49:52.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:52.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.598818+0000", 2024-09-12T22:49:52.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6960999999999999e-05 2024-09-12T22:49:52.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:52.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.613494+0000", 2024-09-12T22:49:52.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014676827999999999 2024-09-12T22:49:52.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:52.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.613584+0000", 2024-09-12T22:49:52.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9357999999999994e-05 2024-09-12T22:49:52.277 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.277 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:52.277 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.278 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:10688 4.21 4:858ae08d:::100000030eb.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:49:52.278 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:51.594814+0000", 2024-09-12T22:49:52.278 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.61467793999999998, 2024-09-12T22:49:52.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021333970000000001, 2024-09-12T22:49:52.278 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:52.278 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:52.278 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.278 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:52.278 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:52.278 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:52.278 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 10688 2024-09-12T22:49:52.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.279 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:52.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:52.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.594814+0000", 2024-09-12T22:49:52.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:52.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.594814+0000", 2024-09-12T22:49:52.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:52.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.594815+0000", 2024-09-12T22:49:52.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:49:52.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:52.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.603365+0000", 2024-09-12T22:49:52.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0085505919999999992 2024-09-12T22:49:52.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:52.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.603379+0000", 2024-09-12T22:49:52.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3871e-05 2024-09-12T22:49:52.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.603387+0000", 2024-09-12T22:49:52.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9340000000000006e-06 2024-09-12T22:49:52.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:52.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.603449+0000", 2024-09-12T22:49:52.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1713999999999999e-05 2024-09-12T22:49:52.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:52.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.603560+0000", 2024-09-12T22:49:52.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000111301 2024-09-12T22:49:52.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:52.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.603661+0000", 2024-09-12T22:49:52.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101374 2024-09-12T22:49:52.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:52.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.613668+0000", 2024-09-12T22:49:52.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010006251000000001 2024-09-12T22:49:52.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:52.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.616091+0000", 2024-09-12T22:49:52.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002423007 2024-09-12T22:49:52.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:52.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.616122+0000", 2024-09-12T22:49:52.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1504000000000002e-05 2024-09-12T22:49:52.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:52.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.616148+0000", 2024-09-12T22:49:52.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5456000000000002e-05 2024-09-12T22:49:52.284 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.284 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:52.284 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.284 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:10689 4.33 e54/17 4:cf068428:::100000030d3.00000000:head v 54'172, mlcod=54'169)", 2024-09-12T22:49:52.285 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:51.603419+0000", 2024-09-12T22:49:52.285 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.60607303199999996, 2024-09-12T22:49:52.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012189767000000001, 2024-09-12T22:49:52.285 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:52.285 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:52.285 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.285 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:52.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:52.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.603419+0000", 2024-09-12T22:49:52.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:52.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.603419+0000", 2024-09-12T22:49:52.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:52.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.603419+0000", 2024-09-12T22:49:52.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3200000000000004e-07 2024-09-12T22:49:52.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:52.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.607241+0000", 2024-09-12T22:49:52.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0038219270000000001 2024-09-12T22:49:52.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:52.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.607261+0000", 2024-09-12T22:49:52.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9814999999999999e-05 2024-09-12T22:49:52.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.607286+0000", 2024-09-12T22:49:52.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4369e-05 2024-09-12T22:49:52.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:52.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.607333+0000", 2024-09-12T22:49:52.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7592000000000001e-05 2024-09-12T22:49:52.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:52.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.607361+0000", 2024-09-12T22:49:52.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7797000000000002e-05 2024-09-12T22:49:52.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:52.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.615572+0000", 2024-09-12T22:49:52.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082114609999999998 2024-09-12T22:49:52.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:52.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.615608+0000", 2024-09-12T22:49:52.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5973999999999998e-05 2024-09-12T22:49:52.289 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.289 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:52.289 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.289 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:10692 4.21 4:858ae08d:::100000030eb.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:49:52.289 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:51.617623+0000", 2024-09-12T22:49:52.289 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.591868489, 2024-09-12T22:49:52.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021128404, 2024-09-12T22:49:52.290 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:52.290 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:52.290 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.290 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:52.290 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:52.290 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:52.290 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 10692 2024-09-12T22:49:52.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.290 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:52.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:52.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.617623+0000", 2024-09-12T22:49:52.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:52.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.617623+0000", 2024-09-12T22:49:52.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:52.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.617624+0000", 2024-09-12T22:49:52.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.066e-06 2024-09-12T22:49:52.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:52.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.621453+0000", 2024-09-12T22:49:52.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0038290849999999999 2024-09-12T22:49:52.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:52.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.621468+0000", 2024-09-12T22:49:52.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4619e-05 2024-09-12T22:49:52.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.621474+0000", 2024-09-12T22:49:52.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1240000000000002e-06 2024-09-12T22:49:52.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:52.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.621545+0000", 2024-09-12T22:49:52.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0623000000000005e-05 2024-09-12T22:49:52.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:52.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.621606+0000", 2024-09-12T22:49:52.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1865000000000005e-05 2024-09-12T22:49:52.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:52.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.621695+0000", 2024-09-12T22:49:52.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8531999999999999e-05 2024-09-12T22:49:52.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:52.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.628954+0000", 2024-09-12T22:49:52.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007258497 2024-09-12T22:49:52.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:52.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.638655+0000", 2024-09-12T22:49:52.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0097013180000000004 2024-09-12T22:49:52.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:52.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.638700+0000", 2024-09-12T22:49:52.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5252e-05 2024-09-12T22:49:52.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:52.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.638752+0000", 2024-09-12T22:49:52.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1422999999999999e-05 2024-09-12T22:49:52.295 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.295 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:52.295 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.296 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:10693 4.21 4:858ae08d:::100000030eb.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:49:52.296 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:51.622030+0000", 2024-09-12T22:49:52.296 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.58746155899999997, 2024-09-12T22:49:52.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021176598000000001, 2024-09-12T22:49:52.296 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:52.296 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:52.296 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.296 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:52.296 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:52.296 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:52.297 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 10693 2024-09-12T22:49:52.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.297 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:52.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:52.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.622030+0000", 2024-09-12T22:49:52.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:52.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.622030+0000", 2024-09-12T22:49:52.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:52.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.622031+0000", 2024-09-12T22:49:52.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.341e-06 2024-09-12T22:49:52.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:52.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.625884+0000", 2024-09-12T22:49:52.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0038527219999999998 2024-09-12T22:49:52.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:52.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.625903+0000", 2024-09-12T22:49:52.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9004999999999998e-05 2024-09-12T22:49:52.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.625911+0000", 2024-09-12T22:49:52.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.627e-06 2024-09-12T22:49:52.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:52.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.625965+0000", 2024-09-12T22:49:52.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3908e-05 2024-09-12T22:49:52.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:52.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.626031+0000", 2024-09-12T22:49:52.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6088999999999997e-05 2024-09-12T22:49:52.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:52.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.626119+0000", 2024-09-12T22:49:52.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8261000000000001e-05 2024-09-12T22:49:52.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:52.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.631054+0000", 2024-09-12T22:49:52.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049349399999999996 2024-09-12T22:49:52.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:52.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.643072+0000", 2024-09-12T22:49:52.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012017932 2024-09-12T22:49:52.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:52.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.643158+0000", 2024-09-12T22:49:52.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6642000000000002e-05 2024-09-12T22:49:52.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:52.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.643207+0000", 2024-09-12T22:49:52.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8130999999999997e-05 2024-09-12T22:49:52.302 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.302 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:52.302 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.302 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:10695 4.21 4:858ae08d:::100000030eb.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:49:52.302 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:51.630560+0000", 2024-09-12T22:49:52.302 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.57893189899999997, 2024-09-12T22:49:52.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015189612999999999, 2024-09-12T22:49:52.303 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:52.303 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:52.303 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.303 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:52.303 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:52.303 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:52.303 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 10695 2024-09-12T22:49:52.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.303 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:52.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:52.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.630560+0000", 2024-09-12T22:49:52.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:52.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.630560+0000", 2024-09-12T22:49:52.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:52.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.630561+0000", 2024-09-12T22:49:52.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2139999999999999e-06 2024-09-12T22:49:52.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:52.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.634469+0000", 2024-09-12T22:49:52.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0039079759999999996 2024-09-12T22:49:52.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:52.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.634482+0000", 2024-09-12T22:49:52.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3509000000000001e-05 2024-09-12T22:49:52.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.634507+0000", 2024-09-12T22:49:52.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5007999999999998e-05 2024-09-12T22:49:52.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:52.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.634567+0000", 2024-09-12T22:49:52.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9740000000000001e-05 2024-09-12T22:49:52.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:52.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.634645+0000", 2024-09-12T22:49:52.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7934000000000003e-05 2024-09-12T22:49:52.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:52.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.634739+0000", 2024-09-12T22:49:52.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3584000000000004e-05 2024-09-12T22:49:52.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:52.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.641451+0000", 2024-09-12T22:49:52.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0067119509999999999 2024-09-12T22:49:52.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:52.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.645676+0000", 2024-09-12T22:49:52.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042254470000000002 2024-09-12T22:49:52.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:52.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.645709+0000", 2024-09-12T22:49:52.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.277e-05 2024-09-12T22:49:52.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:52.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.645749+0000", 2024-09-12T22:49:52.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0479999999999999e-05 2024-09-12T22:49:52.309 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.309 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:52.309 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.309 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:10696 4.21 4:858ae08d:::100000030eb.00000000:head [write 3015899~126765] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:49:52.309 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:51.634526+0000", 2024-09-12T22:49:52.309 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.57496512499999997, 2024-09-12T22:49:52.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011325086999999999, 2024-09-12T22:49:52.310 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:52.310 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:52.310 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.310 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:52.310 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:52.310 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:52.310 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 10696 2024-09-12T22:49:52.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.310 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:52.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:52.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.634526+0000", 2024-09-12T22:49:52.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:52.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.634526+0000", 2024-09-12T22:49:52.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:52.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.634527+0000", 2024-09-12T22:49:52.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8899999999999998e-07 2024-09-12T22:49:52.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:52.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.634577+0000", 2024-09-12T22:49:52.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9104999999999998e-05 2024-09-12T22:49:52.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:52.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.634585+0000", 2024-09-12T22:49:52.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9470000000000003e-06 2024-09-12T22:49:52.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.634590+0000", 2024-09-12T22:49:52.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5099999999999998e-06 2024-09-12T22:49:52.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:52.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.637998+0000", 2024-09-12T22:49:52.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003407565 2024-09-12T22:49:52.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:52.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.638061+0000", 2024-09-12T22:49:52.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3027999999999994e-05 2024-09-12T22:49:52.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:52.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.638149+0000", 2024-09-12T22:49:52.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8146999999999995e-05 2024-09-12T22:49:52.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:52.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.641551+0000", 2024-09-12T22:49:52.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0034017930000000002 2024-09-12T22:49:52.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:52.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.645799+0000", 2024-09-12T22:49:52.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042482140000000002 2024-09-12T22:49:52.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:52.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.645829+0000", 2024-09-12T22:49:52.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0439000000000001e-05 2024-09-12T22:49:52.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:52.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.645852+0000", 2024-09-12T22:49:52.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2350000000000001e-05 2024-09-12T22:49:52.315 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.315 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:52.315 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.315 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:10705 4.21 4:858ae08d:::100000030eb.00000000:head [write 0~4194304 [2@4194304]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:49:52.316 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:51.669774+0000", 2024-09-12T22:49:52.316 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.53971770699999999, 2024-09-12T22:49:52.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013633192000000001, 2024-09-12T22:49:52.316 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:52.316 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:52.316 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.316 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:52.316 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:52.316 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:52.316 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 10705 2024-09-12T22:49:52.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.316 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:52.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:52.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.669774+0000", 2024-09-12T22:49:52.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:52.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.669774+0000", 2024-09-12T22:49:52.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:52.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.669775+0000", 2024-09-12T22:49:52.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.215e-06 2024-09-12T22:49:52.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:52.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.674052+0000", 2024-09-12T22:49:52.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042764489999999999 2024-09-12T22:49:52.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:52.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.674065+0000", 2024-09-12T22:49:52.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3106e-05 2024-09-12T22:49:52.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.674071+0000", 2024-09-12T22:49:52.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3350000000000003e-06 2024-09-12T22:49:52.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:52.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.674121+0000", 2024-09-12T22:49:52.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0290999999999997e-05 2024-09-12T22:49:52.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:52.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.674187+0000", 2024-09-12T22:49:52.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5932000000000005e-05 2024-09-12T22:49:52.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:52.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.674280+0000", 2024-09-12T22:49:52.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2536999999999998e-05 2024-09-12T22:49:52.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:52.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.678449+0000", 2024-09-12T22:49:52.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0041687750000000004 2024-09-12T22:49:52.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:52.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.683339+0000", 2024-09-12T22:49:52.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0048908240000000002 2024-09-12T22:49:52.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:52.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.683375+0000", 2024-09-12T22:49:52.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5296999999999998e-05 2024-09-12T22:49:52.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:52.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.683407+0000", 2024-09-12T22:49:52.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2431000000000002e-05 2024-09-12T22:49:52.321 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.322 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:52.322 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.322 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:10709 4.33 e54/17 4:cc614d18:::100000030cb.00000000:head v 54'176, mlcod=54'174)", 2024-09-12T22:49:52.322 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:51.708466+0000", 2024-09-12T22:49:52.322 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.50102540900000003, 2024-09-12T22:49:52.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011073135, 2024-09-12T22:49:52.322 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:52.322 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:52.322 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.322 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:52.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:52.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.708466+0000", 2024-09-12T22:49:52.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:52.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.708466+0000", 2024-09-12T22:49:52.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:52.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.708467+0000", 2024-09-12T22:49:52.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0070000000000001e-06 2024-09-12T22:49:52.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:52.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.712111+0000", 2024-09-12T22:49:52.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00364424 2024-09-12T22:49:52.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:52.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.712126+0000", 2024-09-12T22:49:52.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4790000000000001e-05 2024-09-12T22:49:52.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.712134+0000", 2024-09-12T22:49:52.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6179999999999997e-06 2024-09-12T22:49:52.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:52.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.712211+0000", 2024-09-12T22:49:52.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6947999999999996e-05 2024-09-12T22:49:52.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:52.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.712227+0000", 2024-09-12T22:49:52.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6531000000000001e-05 2024-09-12T22:49:52.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:52.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.719509+0000", 2024-09-12T22:49:52.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072819979999999996 2024-09-12T22:49:52.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:52.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.719539+0000", 2024-09-12T22:49:52.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0003000000000001e-05 2024-09-12T22:49:52.326 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.326 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:52.326 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.327 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:10713 4.21 4:858ae08d:::100000030eb.00000000:head [write 0~4194304 [3@1582458]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:49:52.327 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:51.770654+0000", 2024-09-12T22:49:52.327 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.43883796899999999, 2024-09-12T22:49:52.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014804028, 2024-09-12T22:49:52.327 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:52.327 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:52.327 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.327 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:52.327 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:52.327 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:52.327 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 10713 2024-09-12T22:49:52.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.328 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:52.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:52.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.770654+0000", 2024-09-12T22:49:52.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:52.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.770654+0000", 2024-09-12T22:49:52.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:52.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:52.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.770654+0000", 2024-09-12T22:49:52.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1800000000000005e-07 2024-09-12T22:49:52.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:52.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.774645+0000", 2024-09-12T22:49:52.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003990637 2024-09-12T22:49:52.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:52.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.774655+0000", 2024-09-12T22:49:52.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0258000000000001e-05 2024-09-12T22:49:52.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.774660+0000", 2024-09-12T22:49:52.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8829999999999997e-06 2024-09-12T22:49:52.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:52.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.774734+0000", 2024-09-12T22:49:52.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3645000000000004e-05 2024-09-12T22:49:52.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:52.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.774788+0000", 2024-09-12T22:49:52.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3922000000000003e-05 2024-09-12T22:49:52.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:52.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.774868+0000", 2024-09-12T22:49:52.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9957999999999996e-05 2024-09-12T22:49:52.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:52.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.780659+0000", 2024-09-12T22:49:52.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057908129999999997 2024-09-12T22:49:52.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:52.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.785305+0000", 2024-09-12T22:49:52.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0046464369999999998 2024-09-12T22:49:52.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:52.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.785394+0000", 2024-09-12T22:49:52.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8677999999999994e-05 2024-09-12T22:49:52.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:52.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:52.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:52.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.785458+0000", 2024-09-12T22:49:52.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3979000000000005e-05 2024-09-12T22:49:52.333 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.333 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:52.333 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.333 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:52.333 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:52.333 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:52.335 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:52.333+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:52.335 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:52.436 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:52.435+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:52.450 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:52.450 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:52.450 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:49:52.450 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:52.459 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:52.537 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:52.535+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:52.603 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:52.604 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:52.604 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:49:52.604 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:49:52.604 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:52.613 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:52.651 INFO:teuthology.orchestra.run.smithi066.stderr:noscrub is unset 2024-09-12T22:49:52.657 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:52.656+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:52.718 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:52.719 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:49:52.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:49:52.719 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:49:52.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.719 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:116 3.1e 3:7bf7e7b5:::200.00000006:head [write 33965~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:52.719 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.160042+0000", 2024-09-12T22:49:52.719 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.5562171149999999, 2024-09-12T22:49:52.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.019984564999999999, 2024-09-12T22:49:52.719 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:52.719 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:52.720 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.720 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:52.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.720 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:52.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160042+0000", 2024-09-12T22:49:52.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.720 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:52.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160042+0000", 2024-09-12T22:49:52.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:52.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160042+0000", 2024-09-12T22:49:52.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.22e-07 2024-09-12T22:49:52.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:52.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160047+0000", 2024-09-12T22:49:52.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9899999999999997e-06 2024-09-12T22:49:52.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:52.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160051+0000", 2024-09-12T22:49:52.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2230000000000001e-06 2024-09-12T22:49:52.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160054+0000", 2024-09-12T22:49:52.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6860000000000002e-06 2024-09-12T22:49:52.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:52.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.176303+0000", 2024-09-12T22:49:52.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016248439 2024-09-12T22:49:52.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.723 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:52.723 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.176348+0000", 2024-09-12T22:49:52.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5173000000000003e-05 2024-09-12T22:49:52.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.723 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:52.723 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.176413+0000", 2024-09-12T22:49:52.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5228999999999995e-05 2024-09-12T22:49:52.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.724 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:52.724 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.179853+0000", 2024-09-12T22:49:52.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034401470000000002 2024-09-12T22:49:52.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.724 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:52.724 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.179919+0000", 2024-09-12T22:49:52.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6063999999999996e-05 2024-09-12T22:49:52.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:52.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.179950+0000", 2024-09-12T22:49:52.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1010999999999998e-05 2024-09-12T22:49:52.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:52.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.180027+0000", 2024-09-12T22:49:52.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6380999999999999e-05 2024-09-12T22:49:52.725 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.725 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:52.725 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.726 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:117 3.1e 3:7bf7e7b5:::200.00000006:head [write 35364~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:52.726 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.160057+0000", 2024-09-12T22:49:52.726 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.5562017429999999, 2024-09-12T22:49:52.726 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022917138, 2024-09-12T22:49:52.726 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:52.726 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:52.726 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.726 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:52.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.726 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:52.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160057+0000", 2024-09-12T22:49:52.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:52.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160057+0000", 2024-09-12T22:49:52.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:52.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160058+0000", 2024-09-12T22:49:52.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.16e-07 2024-09-12T22:49:52.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:52.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160059+0000", 2024-09-12T22:49:52.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4410000000000001e-06 2024-09-12T22:49:52.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:52.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160063+0000", 2024-09-12T22:49:52.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9790000000000004e-06 2024-09-12T22:49:52.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160068+0000", 2024-09-12T22:49:52.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0629999999999996e-06 2024-09-12T22:49:52.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:52.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.176699+0000", 2024-09-12T22:49:52.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016630781000000001 2024-09-12T22:49:52.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:52.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.176741+0000", 2024-09-12T22:49:52.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1959999999999998e-05 2024-09-12T22:49:52.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:52.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.176807+0000", 2024-09-12T22:49:52.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6711999999999994e-05 2024-09-12T22:49:52.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:52.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.179858+0000", 2024-09-12T22:49:52.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003050582 2024-09-12T22:49:52.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:52.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.182889+0000", 2024-09-12T22:49:52.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030313750000000002 2024-09-12T22:49:52.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:52.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.182922+0000", 2024-09-12T22:49:52.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2379000000000003e-05 2024-09-12T22:49:52.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:52.732 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.182974+0000", 2024-09-12T22:49:52.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2649999999999999e-05 2024-09-12T22:49:52.732 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.732 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:52.732 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.732 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:118 3.1e 3:7bf7e7b5:::200.00000006:head [write 36767~1414 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:52.732 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.160073+0000", 2024-09-12T22:49:52.732 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.556185814, 2024-09-12T22:49:52.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023013767000000001, 2024-09-12T22:49:52.732 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:52.733 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:52.733 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.733 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:52.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:52.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160073+0000", 2024-09-12T22:49:52.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:52.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160073+0000", 2024-09-12T22:49:52.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:52.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160074+0000", 2024-09-12T22:49:52.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6899999999999998e-07 2024-09-12T22:49:52.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:52.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160079+0000", 2024-09-12T22:49:52.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3199999999999999e-06 2024-09-12T22:49:52.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:52.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160092+0000", 2024-09-12T22:49:52.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2850000000000001e-05 2024-09-12T22:49:52.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160096+0000", 2024-09-12T22:49:52.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1509999999999997e-06 2024-09-12T22:49:52.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:52.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.177067+0000", 2024-09-12T22:49:52.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016970827000000001 2024-09-12T22:49:52.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:52.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.177110+0000", 2024-09-12T22:49:52.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3446999999999999e-05 2024-09-12T22:49:52.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:52.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.177177+0000", 2024-09-12T22:49:52.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6612999999999994e-05 2024-09-12T22:49:52.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:52.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.179865+0000", 2024-09-12T22:49:52.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0026877770000000001 2024-09-12T22:49:52.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:52.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.183009+0000", 2024-09-12T22:49:52.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031447390000000001 2024-09-12T22:49:52.738 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.738 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:52.738 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.183040+0000", 2024-09-12T22:49:52.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0213e-05 2024-09-12T22:49:52.738 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.738 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:52.738 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.183087+0000", 2024-09-12T22:49:52.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7460999999999998e-05 2024-09-12T22:49:52.738 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.739 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:52.739 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.739 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:119 3.1e 3:7bf7e7b5:::200.00000006:head [write 38181~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:52.739 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.160117+0000", 2024-09-12T22:49:52.739 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.5561422499999997, 2024-09-12T22:49:52.739 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023084609999999998, 2024-09-12T22:49:52.739 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:52.739 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:52.739 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.739 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:52.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:52.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160117+0000", 2024-09-12T22:49:52.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:52.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160117+0000", 2024-09-12T22:49:52.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:52.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160117+0000", 2024-09-12T22:49:52.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1800000000000002e-07 2024-09-12T22:49:52.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:52.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160119+0000", 2024-09-12T22:49:52.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.136e-06 2024-09-12T22:49:52.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:52.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160124+0000", 2024-09-12T22:49:52.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3610000000000003e-06 2024-09-12T22:49:52.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.742 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.742 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160126+0000", 2024-09-12T22:49:52.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7140000000000002e-06 2024-09-12T22:49:52.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.742 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:52.742 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.177501+0000", 2024-09-12T22:49:52.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.017374351 2024-09-12T22:49:52.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.742 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:52.742 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.177548+0000", 2024-09-12T22:49:52.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7321000000000003e-05 2024-09-12T22:49:52.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.743 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:52.743 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.177626+0000", 2024-09-12T22:49:52.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7546000000000006e-05 2024-09-12T22:49:52.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.743 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:52.743 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.179877+0000", 2024-09-12T22:49:52.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022512769999999999 2024-09-12T22:49:52.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:52.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.183128+0000", 2024-09-12T22:49:52.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032514079999999999 2024-09-12T22:49:52.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:52.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.183156+0000", 2024-09-12T22:49:52.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8155999999999999e-05 2024-09-12T22:49:52.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:52.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.183201+0000", 2024-09-12T22:49:52.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5021999999999997e-05 2024-09-12T22:49:52.745 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.745 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:52.745 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.745 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:120 3.1e 3:7bf7e7b5:::200.00000006:head [write 39581~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:52.745 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.160130+0000", 2024-09-12T22:49:52.745 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.5561292479999995, 2024-09-12T22:49:52.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023171166999999999, 2024-09-12T22:49:52.745 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:52.745 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:52.745 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.745 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:52.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:52.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160130+0000", 2024-09-12T22:49:52.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:52.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160130+0000", 2024-09-12T22:49:52.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:52.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160130+0000", 2024-09-12T22:49:52.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1199999999999999e-07 2024-09-12T22:49:52.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:52.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160132+0000", 2024-09-12T22:49:52.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8810000000000001e-06 2024-09-12T22:49:52.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:52.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160135+0000", 2024-09-12T22:49:52.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.078e-06 2024-09-12T22:49:52.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160138+0000", 2024-09-12T22:49:52.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9569999999999998e-06 2024-09-12T22:49:52.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.748 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:52.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.177849+0000", 2024-09-12T22:49:52.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.017711286999999999 2024-09-12T22:49:52.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.748 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:52.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.177900+0000", 2024-09-12T22:49:52.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0695000000000002e-05 2024-09-12T22:49:52.749 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.749 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:52.749 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.177967+0000", 2024-09-12T22:49:52.749 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6604000000000001e-05 2024-09-12T22:49:52.749 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.749 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:52.749 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.179884+0000", 2024-09-12T22:49:52.749 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019170249999999999 2024-09-12T22:49:52.749 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:52.750 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.183230+0000", 2024-09-12T22:49:52.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033465690000000002 2024-09-12T22:49:52.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:52.750 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.183259+0000", 2024-09-12T22:49:52.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8628000000000001e-05 2024-09-12T22:49:52.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:52.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.183301+0000", 2024-09-12T22:49:52.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2231000000000003e-05 2024-09-12T22:49:52.751 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.751 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:52.751 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.751 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:121 3.1e 3:7bf7e7b5:::200.00000006:head [write 40980~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:52.751 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.160141+0000", 2024-09-12T22:49:52.751 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.556118176, 2024-09-12T22:49:52.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023288197, 2024-09-12T22:49:52.751 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:52.752 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:52.752 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.752 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:52.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:52.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160141+0000", 2024-09-12T22:49:52.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:52.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160141+0000", 2024-09-12T22:49:52.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:52.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160141+0000", 2024-09-12T22:49:52.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2099999999999998e-07 2024-09-12T22:49:52.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:52.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160146+0000", 2024-09-12T22:49:52.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8230000000000002e-06 2024-09-12T22:49:52.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:52.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160149+0000", 2024-09-12T22:49:52.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.337e-06 2024-09-12T22:49:52.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160152+0000", 2024-09-12T22:49:52.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4399999999999999e-06 2024-09-12T22:49:52.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:52.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.178307+0000", 2024-09-12T22:49:52.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018155161 2024-09-12T22:49:52.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:52.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.178386+0000", 2024-09-12T22:49:52.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8966000000000003e-05 2024-09-12T22:49:52.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:52.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.178536+0000", 2024-09-12T22:49:52.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015024799999999999 2024-09-12T22:49:52.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:52.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.180379+0000", 2024-09-12T22:49:52.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00184242 2024-09-12T22:49:52.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:52.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.183341+0000", 2024-09-12T22:49:52.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0029626819999999999 2024-09-12T22:49:52.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:52.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.183370+0000", 2024-09-12T22:49:52.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8393000000000001e-05 2024-09-12T22:49:52.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:52.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.183429+0000", 2024-09-12T22:49:52.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9406e-05 2024-09-12T22:49:52.757 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.757 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:52.757 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.757 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:122 3.1e 3:7bf7e7b5:::200.00000006:head [write 42381~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:52.757 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.160155+0000", 2024-09-12T22:49:52.758 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.5561041820000003, 2024-09-12T22:49:52.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.025228924, 2024-09-12T22:49:52.758 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:52.758 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:52.758 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.758 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:52.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:52.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160155+0000", 2024-09-12T22:49:52.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:52.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160155+0000", 2024-09-12T22:49:52.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:52.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160155+0000", 2024-09-12T22:49:52.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1199999999999999e-07 2024-09-12T22:49:52.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:52.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160157+0000", 2024-09-12T22:49:52.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.838e-06 2024-09-12T22:49:52.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:52.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160160+0000", 2024-09-12T22:49:52.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3900000000000002e-06 2024-09-12T22:49:52.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.160170+0000", 2024-09-12T22:49:52.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3160000000000003e-06 2024-09-12T22:49:52.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:52.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.179029+0000", 2024-09-12T22:49:52.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018858935 2024-09-12T22:49:52.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:52.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.179074+0000", 2024-09-12T22:49:52.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5386999999999998e-05 2024-09-12T22:49:52.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:52.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.179178+0000", 2024-09-12T22:49:52.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010391399999999999 2024-09-12T22:49:52.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:52.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.181184+0000", 2024-09-12T22:49:52.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020062550000000002 2024-09-12T22:49:52.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:52.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.185306+0000", 2024-09-12T22:49:52.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0041221349999999999 2024-09-12T22:49:52.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:52.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.185337+0000", 2024-09-12T22:49:52.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1080000000000001e-05 2024-09-12T22:49:52.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:52.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.185384+0000", 2024-09-12T22:49:52.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6461999999999997e-05 2024-09-12T22:49:52.763 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.763 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:52.763 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.763 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:167 3.1e 3:7bf7e7b5:::200.00000006:head [write 170486~2427 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:52.763 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.188170+0000", 2024-09-12T22:49:52.763 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.5280893989999997, 2024-09-12T22:49:52.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.019307458999999999, 2024-09-12T22:49:52.764 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:52.764 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:52.764 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.764 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:52.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:52.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188170+0000", 2024-09-12T22:49:52.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:52.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188170+0000", 2024-09-12T22:49:52.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:52.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188170+0000", 2024-09-12T22:49:52.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:49:52.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:52.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188178+0000", 2024-09-12T22:49:52.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6590000000000007e-06 2024-09-12T22:49:52.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:52.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188184+0000", 2024-09-12T22:49:52.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4200000000000004e-06 2024-09-12T22:49:52.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188189+0000", 2024-09-12T22:49:52.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6909999999999996e-06 2024-09-12T22:49:52.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:52.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.201064+0000", 2024-09-12T22:49:52.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012875202000000001 2024-09-12T22:49:52.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:52.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.201112+0000", 2024-09-12T22:49:52.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7608000000000002e-05 2024-09-12T22:49:52.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:52.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.201217+0000", 2024-09-12T22:49:52.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000104936 2024-09-12T22:49:52.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:52.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.202933+0000", 2024-09-12T22:49:52.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001715921 2024-09-12T22:49:52.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:52.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207409+0000", 2024-09-12T22:49:52.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044768719999999998 2024-09-12T22:49:52.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:52.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207436+0000", 2024-09-12T22:49:52.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6312000000000002e-05 2024-09-12T22:49:52.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:52.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207477+0000", 2024-09-12T22:49:52.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1331000000000001e-05 2024-09-12T22:49:52.770 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.770 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:52.770 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.770 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:168 3.1e 3:7bf7e7b5:::200.00000006:head [write 172913~2437 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:52.770 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.188195+0000", 2024-09-12T22:49:52.770 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.5280636699999999, 2024-09-12T22:49:52.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.019344936, 2024-09-12T22:49:52.771 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:52.771 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:52.771 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.771 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:52.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:52.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188195+0000", 2024-09-12T22:49:52.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:52.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188195+0000", 2024-09-12T22:49:52.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:52.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188196+0000", 2024-09-12T22:49:52.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8099999999999998e-07 2024-09-12T22:49:52.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:52.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188199+0000", 2024-09-12T22:49:52.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4620000000000001e-06 2024-09-12T22:49:52.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:52.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188205+0000", 2024-09-12T22:49:52.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7599999999999999e-06 2024-09-12T22:49:52.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188210+0000", 2024-09-12T22:49:52.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:49:52.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:52.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.201526+0000", 2024-09-12T22:49:52.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013316527999999999 2024-09-12T22:49:52.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:52.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.201569+0000", 2024-09-12T22:49:52.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3328999999999998e-05 2024-09-12T22:49:52.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:52.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.201636+0000", 2024-09-12T22:49:52.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6320000000000002e-05 2024-09-12T22:49:52.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:52.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.202961+0000", 2024-09-12T22:49:52.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00132551 2024-09-12T22:49:52.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:52.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207482+0000", 2024-09-12T22:49:52.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045204370000000004 2024-09-12T22:49:52.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:52.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207504+0000", 2024-09-12T22:49:52.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1956000000000001e-05 2024-09-12T22:49:52.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:52.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207540+0000", 2024-09-12T22:49:52.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6754000000000001e-05 2024-09-12T22:49:52.776 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.776 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:52.776 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.776 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:169 3.1e 3:7bf7e7b5:::200.00000006:head [write 175350~1910 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:52.776 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.188216+0000", 2024-09-12T22:49:52.777 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.5280435099999998, 2024-09-12T22:49:52.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.019389085, 2024-09-12T22:49:52.777 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:52.777 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:52.777 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.777 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:52.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:52.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188216+0000", 2024-09-12T22:49:52.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:52.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188216+0000", 2024-09-12T22:49:52.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:52.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188216+0000", 2024-09-12T22:49:52.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3799999999999998e-07 2024-09-12T22:49:52.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:52.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188223+0000", 2024-09-12T22:49:52.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4200000000000001e-06 2024-09-12T22:49:52.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:52.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188229+0000", 2024-09-12T22:49:52.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1789999999999996e-06 2024-09-12T22:49:52.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188235+0000", 2024-09-12T22:49:52.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0150000000000003e-06 2024-09-12T22:49:52.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:52.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.201986+0000", 2024-09-12T22:49:52.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013751974 2024-09-12T22:49:52.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:52.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.202031+0000", 2024-09-12T22:49:52.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4694999999999998e-05 2024-09-12T22:49:52.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:52.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.202100+0000", 2024-09-12T22:49:52.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8638000000000003e-05 2024-09-12T22:49:52.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:52.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.202990+0000", 2024-09-12T22:49:52.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089015800000000005 2024-09-12T22:49:52.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:52.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207544+0000", 2024-09-12T22:49:52.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045542990000000004 2024-09-12T22:49:52.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:52.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207565+0000", 2024-09-12T22:49:52.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1138e-05 2024-09-12T22:49:52.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:52.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207605+0000", 2024-09-12T22:49:52.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9230999999999998e-05 2024-09-12T22:49:52.782 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.782 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:52.782 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.782 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:170 3.1e 3:7bf7e7b5:::200.00000006:head [write 177260~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:52.782 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.188241+0000", 2024-09-12T22:49:52.783 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.5280181209999997, 2024-09-12T22:49:52.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.019428737000000001, 2024-09-12T22:49:52.783 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:52.783 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:52.783 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.783 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:52.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:52.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188241+0000", 2024-09-12T22:49:52.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:52.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188241+0000", 2024-09-12T22:49:52.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:52.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188241+0000", 2024-09-12T22:49:52.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5999999999999999e-07 2024-09-12T22:49:52.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:52.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188247+0000", 2024-09-12T22:49:52.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.677e-06 2024-09-12T22:49:52.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:52.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188253+0000", 2024-09-12T22:49:52.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9209999999999997e-06 2024-09-12T22:49:52.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188258+0000", 2024-09-12T22:49:52.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0610000000000003e-06 2024-09-12T22:49:52.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:52.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.202382+0000", 2024-09-12T22:49:52.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014124166 2024-09-12T22:49:52.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:52.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.202428+0000", 2024-09-12T22:49:52.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5966e-05 2024-09-12T22:49:52.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:52.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.202496+0000", 2024-09-12T22:49:52.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7999999999999999e-05 2024-09-12T22:49:52.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:52.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.203882+0000", 2024-09-12T22:49:52.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001386235 2024-09-12T22:49:52.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:52.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207608+0000", 2024-09-12T22:49:52.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00372609 2024-09-12T22:49:52.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:52.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207631+0000", 2024-09-12T22:49:52.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2569999999999999e-05 2024-09-12T22:49:52.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:52.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207670+0000", 2024-09-12T22:49:52.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8690999999999999e-05 2024-09-12T22:49:52.788 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.788 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:52.788 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.788 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:172 3.1e 3:7bf7e7b5:::200.00000006:head [write 181107~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:52.788 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.188511+0000", 2024-09-12T22:49:52.788 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.5277478010000003, 2024-09-12T22:49:52.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.019289285999999999, 2024-09-12T22:49:52.789 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:52.789 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:52.789 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.789 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:52.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:52.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188511+0000", 2024-09-12T22:49:52.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:52.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188511+0000", 2024-09-12T22:49:52.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:52.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188512+0000", 2024-09-12T22:49:52.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.13e-07 2024-09-12T22:49:52.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:52.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188515+0000", 2024-09-12T22:49:52.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1310000000000002e-06 2024-09-12T22:49:52.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:52.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188523+0000", 2024-09-12T22:49:52.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7510000000000008e-06 2024-09-12T22:49:52.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188527+0000", 2024-09-12T22:49:52.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7870000000000001e-06 2024-09-12T22:49:52.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:52.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.203413+0000", 2024-09-12T22:49:52.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01488593 2024-09-12T22:49:52.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:52.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.203484+0000", 2024-09-12T22:49:52.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0783000000000003e-05 2024-09-12T22:49:52.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:52.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.203608+0000", 2024-09-12T22:49:52.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012370600000000001 2024-09-12T22:49:52.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:52.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.205204+0000", 2024-09-12T22:49:52.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001596606 2024-09-12T22:49:52.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:52.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207741+0000", 2024-09-12T22:49:52.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0025370089999999998 2024-09-12T22:49:52.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:52.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207763+0000", 2024-09-12T22:49:52.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1838999999999999e-05 2024-09-12T22:49:52.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:52.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.207801+0000", 2024-09-12T22:49:52.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7231000000000003e-05 2024-09-12T22:49:52.794 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.794 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:52.794 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.794 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:173 3.1e 3:7bf7e7b5:::200.00000006:head [write 182514~2449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:52.794 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.188541+0000", 2024-09-12T22:49:52.794 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.5277181070000001, 2024-09-12T22:49:52.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.021263447000000001, 2024-09-12T22:49:52.794 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:52.795 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:52.795 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.795 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:52.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:52.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188541+0000", 2024-09-12T22:49:52.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:52.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188541+0000", 2024-09-12T22:49:52.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:52.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188541+0000", 2024-09-12T22:49:52.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0100000000000005e-07 2024-09-12T22:49:52.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:52.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188545+0000", 2024-09-12T22:49:52.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1310000000000002e-06 2024-09-12T22:49:52.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:52.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188551+0000", 2024-09-12T22:49:52.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6699999999999997e-06 2024-09-12T22:49:52.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188556+0000", 2024-09-12T22:49:52.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0000000000000004e-06 2024-09-12T22:49:52.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:52.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.203911+0000", 2024-09-12T22:49:52.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015354948 2024-09-12T22:49:52.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:52.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.203957+0000", 2024-09-12T22:49:52.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.587e-05 2024-09-12T22:49:52.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:52.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.204039+0000", 2024-09-12T22:49:52.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1672e-05 2024-09-12T22:49:52.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:52.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.205249+0000", 2024-09-12T22:49:52.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001210493 2024-09-12T22:49:52.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:52.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.209729+0000", 2024-09-12T22:49:52.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044796239999999998 2024-09-12T22:49:52.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:52.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.209759+0000", 2024-09-12T22:49:52.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9691000000000001e-05 2024-09-12T22:49:52.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:52.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.209804+0000", 2024-09-12T22:49:52.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5847000000000003e-05 2024-09-12T22:49:52.800 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.800 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:52.800 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.800 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:174 3.1e 3:7bf7e7b5:::200.00000006:head [write 184963~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:52.800 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.188594+0000", 2024-09-12T22:49:52.800 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.5276648159999997, 2024-09-12T22:49:52.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.021300155000000001, 2024-09-12T22:49:52.800 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:52.801 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:52.801 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.801 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:52.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:52.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188594+0000", 2024-09-12T22:49:52.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:52.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188594+0000", 2024-09-12T22:49:52.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:52.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188595+0000", 2024-09-12T22:49:52.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2799999999999995e-07 2024-09-12T22:49:52.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:52.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188598+0000", 2024-09-12T22:49:52.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.27e-06 2024-09-12T22:49:52.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:52.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188605+0000", 2024-09-12T22:49:52.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1670000000000002e-06 2024-09-12T22:49:52.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188611+0000", 2024-09-12T22:49:52.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3329999999999996e-06 2024-09-12T22:49:52.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:52.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.204291+0000", 2024-09-12T22:49:52.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015680383999999999 2024-09-12T22:49:52.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:52.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.204334+0000", 2024-09-12T22:49:52.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2904999999999997e-05 2024-09-12T22:49:52.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:52.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.204399+0000", 2024-09-12T22:49:52.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4894000000000006e-05 2024-09-12T22:49:52.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:52.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.206814+0000", 2024-09-12T22:49:52.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0024151760000000002 2024-09-12T22:49:52.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:52.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.209809+0000", 2024-09-12T22:49:52.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0029953240000000002 2024-09-12T22:49:52.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:52.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.209837+0000", 2024-09-12T22:49:52.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7521999999999998e-05 2024-09-12T22:49:52.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:52.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.209894+0000", 2024-09-12T22:49:52.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7451999999999998e-05 2024-09-12T22:49:52.806 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.806 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:52.806 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.806 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:175 3.1e 3:7bf7e7b5:::200.00000006:head [write 186365~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:52.806 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.188623+0000", 2024-09-12T22:49:52.806 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.5276357320000002, 2024-09-12T22:49:52.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.021347469000000001, 2024-09-12T22:49:52.806 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:52.806 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:52.806 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.806 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:52.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:52.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188623+0000", 2024-09-12T22:49:52.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:52.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188623+0000", 2024-09-12T22:49:52.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:52.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188624+0000", 2024-09-12T22:49:52.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5200000000000002e-07 2024-09-12T22:49:52.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:52.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188627+0000", 2024-09-12T22:49:52.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7319999999999998e-06 2024-09-12T22:49:52.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:52.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188633+0000", 2024-09-12T22:49:52.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5989999999999998e-06 2024-09-12T22:49:52.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.188638+0000", 2024-09-12T22:49:52.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8160000000000001e-06 2024-09-12T22:49:52.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:52.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.205285+0000", 2024-09-12T22:49:52.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016647408999999998 2024-09-12T22:49:52.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:52.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.205325+0000", 2024-09-12T22:49:52.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9521999999999999e-05 2024-09-12T22:49:52.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:52.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.205389+0000", 2024-09-12T22:49:52.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4259999999999998e-05 2024-09-12T22:49:52.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:52.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.206855+0000", 2024-09-12T22:49:52.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0014656129999999999 2024-09-12T22:49:52.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:52.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.209899+0000", 2024-09-12T22:49:52.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003044658 2024-09-12T22:49:52.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:52.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.209925+0000", 2024-09-12T22:49:52.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5193000000000001e-05 2024-09-12T22:49:52.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:52.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.209971+0000", 2024-09-12T22:49:52.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6214999999999997e-05 2024-09-12T22:49:52.811 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.811 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:52.812 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.812 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:186 3.1e 3:7bf7e7b5:::200.00000006:head [write 220137~6982 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:49:52.812 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:47.197880+0000", 2024-09-12T22:49:52.812 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.5183793049999998, 2024-09-12T22:49:52.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.021088583000000001, 2024-09-12T22:49:52.812 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:52.812 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:52.812 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.812 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:52.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:52.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.197880+0000", 2024-09-12T22:49:52.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:52.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.197880+0000", 2024-09-12T22:49:52.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:52.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.197881+0000", 2024-09-12T22:49:52.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9699999999999995e-07 2024-09-12T22:49:52.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:52.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.197890+0000", 2024-09-12T22:49:52.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1859999999999998e-06 2024-09-12T22:49:52.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:52.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.197898+0000", 2024-09-12T22:49:52.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3389999999999993e-06 2024-09-12T22:49:52.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.197905+0000", 2024-09-12T22:49:52.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4710000000000004e-06 2024-09-12T22:49:52.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:52.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.213366+0000", 2024-09-12T22:49:52.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015461383 2024-09-12T22:49:52.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:52.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.213436+0000", 2024-09-12T22:49:52.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0499000000000004e-05 2024-09-12T22:49:52.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:52.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.213530+0000", 2024-09-12T22:49:52.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3833999999999996e-05 2024-09-12T22:49:52.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:52.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.214117+0000", 2024-09-12T22:49:52.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00058681900000000003 2024-09-12T22:49:52.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:52.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.218855+0000", 2024-09-12T22:49:52.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047378860000000002 2024-09-12T22:49:52.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:52.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.218910+0000", 2024-09-12T22:49:52.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4613e-05 2024-09-12T22:49:52.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:52.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:47.218968+0000", 2024-09-12T22:49:52.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8755999999999998e-05 2024-09-12T22:49:52.818 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.818 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:52.818 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.818 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:10661 4.33 4:cf068428:::100000030d3.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:49:52.818 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:51.527973+0000", 2024-09-12T22:49:52.818 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.188286124, 2024-09-12T22:49:52.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.021462103999999999, 2024-09-12T22:49:52.818 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:52.819 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:52.819 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.819 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:52.819 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:52.819 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:52.819 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 10661 2024-09-12T22:49:52.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.819 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:52.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:52.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.527973+0000", 2024-09-12T22:49:52.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:52.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.527973+0000", 2024-09-12T22:49:52.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:52.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.527974+0000", 2024-09-12T22:49:52.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2399999999999997e-07 2024-09-12T22:49:52.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:52.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.535177+0000", 2024-09-12T22:49:52.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0072034129999999997 2024-09-12T22:49:52.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:52.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.535186+0000", 2024-09-12T22:49:52.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0710000000000001e-06 2024-09-12T22:49:52.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.535191+0000", 2024-09-12T22:49:52.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:49:52.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:52.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.535237+0000", 2024-09-12T22:49:52.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6576999999999998e-05 2024-09-12T22:49:52.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:52.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.535319+0000", 2024-09-12T22:49:52.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1384000000000005e-05 2024-09-12T22:49:52.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:52.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.535446+0000", 2024-09-12T22:49:52.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012761200000000001 2024-09-12T22:49:52.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:52.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.547779+0000", 2024-09-12T22:49:52.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012332242 2024-09-12T22:49:52.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:52.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.549362+0000", 2024-09-12T22:49:52.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001583564 2024-09-12T22:49:52.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:52.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.549401+0000", 2024-09-12T22:49:52.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8541000000000003e-05 2024-09-12T22:49:52.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:52.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.549435+0000", 2024-09-12T22:49:52.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4289000000000003e-05 2024-09-12T22:49:52.824 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.824 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:52.824 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.824 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:10664 4.2e 4:77d2457d:::100000030c0.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:49:52.824 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:51.536905+0000", 2024-09-12T22:49:52.825 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.1793539669999999, 2024-09-12T22:49:52.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.024857089999999998, 2024-09-12T22:49:52.825 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:52.825 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:52.825 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.825 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:52.825 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:52.825 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:52.825 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 10664 2024-09-12T22:49:52.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.825 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:52.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:52.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.536905+0000", 2024-09-12T22:49:52.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:52.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.536905+0000", 2024-09-12T22:49:52.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:52.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.536906+0000", 2024-09-12T22:49:52.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0049999999999999e-06 2024-09-12T22:49:52.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:52.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.545080+0000", 2024-09-12T22:49:52.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081741360000000002 2024-09-12T22:49:52.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:52.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.545091+0000", 2024-09-12T22:49:52.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0773e-05 2024-09-12T22:49:52.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.545112+0000", 2024-09-12T22:49:52.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0577999999999998e-05 2024-09-12T22:49:52.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:52.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.545156+0000", 2024-09-12T22:49:52.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4626000000000003e-05 2024-09-12T22:49:52.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:52.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.545265+0000", 2024-09-12T22:49:52.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010919100000000001 2024-09-12T22:49:52.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:52.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.545344+0000", 2024-09-12T22:49:52.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8870999999999998e-05 2024-09-12T22:49:52.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:52.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.559936+0000", 2024-09-12T22:49:52.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014592159 2024-09-12T22:49:52.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:52.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.561655+0000", 2024-09-12T22:49:52.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001718065 2024-09-12T22:49:52.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:52.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.561710+0000", 2024-09-12T22:49:52.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5084000000000003e-05 2024-09-12T22:49:52.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:52.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.561762+0000", 2024-09-12T22:49:52.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2602000000000002e-05 2024-09-12T22:49:52.833 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.833 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:52.833 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.834 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:10686 4.33 4:cf068428:::100000030d3.00000000:head [write 0~4194304 [2@1769906]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:49:52.834 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:51.586622+0000", 2024-09-12T22:49:52.834 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.129636887, 2024-09-12T22:49:52.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.027146674999999999, 2024-09-12T22:49:52.834 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:52.834 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:52.834 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.834 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:52.834 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:52.834 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:52.834 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 10686 2024-09-12T22:49:52.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.834 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:52.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:52.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.586622+0000", 2024-09-12T22:49:52.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:52.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.586622+0000", 2024-09-12T22:49:52.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:52.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.586624+0000", 2024-09-12T22:49:52.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3400000000000001e-06 2024-09-12T22:49:52.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:52.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.593104+0000", 2024-09-12T22:49:52.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0064806489999999998 2024-09-12T22:49:52.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:52.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.593115+0000", 2024-09-12T22:49:52.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.115e-05 2024-09-12T22:49:52.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.593122+0000", 2024-09-12T22:49:52.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1659999999999997e-06 2024-09-12T22:49:52.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:52.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.593186+0000", 2024-09-12T22:49:52.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3349999999999995e-05 2024-09-12T22:49:52.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:52.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.593282+0000", 2024-09-12T22:49:52.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6434999999999994e-05 2024-09-12T22:49:52.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:52.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.593433+0000", 2024-09-12T22:49:52.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015100899999999999 2024-09-12T22:49:52.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:52.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.599785+0000", 2024-09-12T22:49:52.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063515230000000004 2024-09-12T22:49:52.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:52.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.613682+0000", 2024-09-12T22:49:52.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013897197999999999 2024-09-12T22:49:52.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:52.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.613722+0000", 2024-09-12T22:49:52.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.032e-05 2024-09-12T22:49:52.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:52.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.613769+0000", 2024-09-12T22:49:52.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6535000000000001e-05 2024-09-12T22:49:52.840 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.840 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:52.840 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.840 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:10689 4.33 4:cf068428:::100000030d3.00000000:head [write 0~4194304 [2@1769906]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:49:52.840 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:51.595855+0000", 2024-09-12T22:49:52.840 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.120404519, 2024-09-12T22:49:52.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.019983436, 2024-09-12T22:49:52.840 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:52.841 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:52.841 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:52.841 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:52.841 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:52.841 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:52.841 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 10689 2024-09-12T22:49:52.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.841 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:52.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:52.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.595855+0000", 2024-09-12T22:49:52.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:52.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.595855+0000", 2024-09-12T22:49:52.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:52.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:52.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.595857+0000", 2024-09-12T22:49:52.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0600000000000002e-06 2024-09-12T22:49:52.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:52.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.602808+0000", 2024-09-12T22:49:52.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069516639999999998 2024-09-12T22:49:52.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:52.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.602824+0000", 2024-09-12T22:49:52.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5954999999999999e-05 2024-09-12T22:49:52.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:52.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.602834+0000", 2024-09-12T22:49:52.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0079e-05 2024-09-12T22:49:52.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:52.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.602894+0000", 2024-09-12T22:49:52.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9287999999999999e-05 2024-09-12T22:49:52.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:52.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.602956+0000", 2024-09-12T22:49:52.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2299999999999996e-05 2024-09-12T22:49:52.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:52.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.603045+0000", 2024-09-12T22:49:52.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9402999999999998e-05 2024-09-12T22:49:52.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:52.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.610126+0000", 2024-09-12T22:49:52.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0070803580000000001 2024-09-12T22:49:52.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:52.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.615727+0000", 2024-09-12T22:49:52.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0056010310000000002 2024-09-12T22:49:52.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:52.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.615792+0000", 2024-09-12T22:49:52.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4926999999999997e-05 2024-09-12T22:49:52.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:52.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:52.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:52.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.615838+0000", 2024-09-12T22:49:52.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6371e-05 2024-09-12T22:49:52.846 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.846 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:52.846 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.846 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:52.846 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:52.847 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:52.848 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:52.849 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:52.846+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:52.949 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:52.947+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:52.955 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:52.955 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:52.955 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:49:52.955 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:52.963 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:53.050 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:53.049+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:53.107 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:53.107 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:53.107 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:49:53.107 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:49:53.107 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:53.117 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:53.150 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:53.149+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:53.222 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:53.222 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:49:53.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:49:53.223 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:49:53.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.223 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:10660 4.23 4:c5bf0e37:::100000030bf.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:49:53.223 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:51.530144+0000", 2024-09-12T22:49:53.223 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 1.6905320939999999, 2024-09-12T22:49:53.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026397501, 2024-09-12T22:49:53.223 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:53.223 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:53.223 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:53.223 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:53.223 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:53.224 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:53.224 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 10660 2024-09-12T22:49:53.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.224 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:53.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:53.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.530144+0000", 2024-09-12T22:49:53.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:53.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.530144+0000", 2024-09-12T22:49:53.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:53.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.530145+0000", 2024-09-12T22:49:53.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:49:53.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:53.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.537338+0000", 2024-09-12T22:49:53.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071928679999999998 2024-09-12T22:49:53.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:53.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.537357+0000", 2024-09-12T22:49:53.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8804000000000002e-05 2024-09-12T22:49:53.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:53.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.537382+0000", 2024-09-12T22:49:53.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5055e-05 2024-09-12T22:49:53.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:53.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.537432+0000", 2024-09-12T22:49:53.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0562999999999997e-05 2024-09-12T22:49:53.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.227 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:53.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.537546+0000", 2024-09-12T22:49:53.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114088 2024-09-12T22:49:53.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.227 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:53.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.537665+0000", 2024-09-12T22:49:53.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000118171 2024-09-12T22:49:53.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.227 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:53.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.541897+0000", 2024-09-12T22:49:53.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042323739999999997 2024-09-12T22:49:53.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:53.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.556413+0000", 2024-09-12T22:49:53.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014515689999999999 2024-09-12T22:49:53.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:53.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.556475+0000", 2024-09-12T22:49:53.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2045999999999995e-05 2024-09-12T22:49:53.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:53.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.556542+0000", 2024-09-12T22:49:53.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7216000000000002e-05 2024-09-12T22:49:53.229 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.229 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:53.229 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.229 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:10666 4.35 4:addad63f:::100000030d7.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:49:53.229 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:51.539293+0000", 2024-09-12T22:49:53.229 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 1.6813838539999999, 2024-09-12T22:49:53.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021734917999999999, 2024-09-12T22:49:53.229 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:53.230 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:53.230 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:53.230 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:53.230 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:53.230 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:53.230 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 10666 2024-09-12T22:49:53.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.230 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:53.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:53.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.539293+0000", 2024-09-12T22:49:53.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:53.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.539293+0000", 2024-09-12T22:49:53.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:53.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.539294+0000", 2024-09-12T22:49:53.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4810000000000001e-06 2024-09-12T22:49:53.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:53.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.547493+0000", 2024-09-12T22:49:53.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0081989490000000005 2024-09-12T22:49:53.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:53.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.547507+0000", 2024-09-12T22:49:53.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3599e-05 2024-09-12T22:49:53.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.233 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:53.233 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.547514+0000", 2024-09-12T22:49:53.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9970000000000001e-06 2024-09-12T22:49:53.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:53.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.547574+0000", 2024-09-12T22:49:53.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0208999999999999e-05 2024-09-12T22:49:53.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:53.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.547657+0000", 2024-09-12T22:49:53.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2631000000000002e-05 2024-09-12T22:49:53.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:53.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.560880+0000", 2024-09-12T22:49:53.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013223613 2024-09-12T22:49:53.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:53.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.560949+0000", 2024-09-12T22:49:53.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9235999999999999e-05 2024-09-12T22:49:53.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:53.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.561028+0000", 2024-09-12T22:49:53.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8202999999999996e-05 2024-09-12T22:49:53.238 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.238 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:53.238 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.238 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:10687 4.1e 4:7aad8e66:::100000030cb.00000001:head [write 0~4194304 [2@0]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:49:53.238 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:51.585194+0000", 2024-09-12T22:49:53.238 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 1.6354827140000001, 2024-09-12T22:49:53.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026355747999999998, 2024-09-12T22:49:53.239 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:53.239 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:53.239 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:53.239 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:53.239 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:53.239 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:53.239 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 10687 2024-09-12T22:49:53.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.239 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:53.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:53.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.585194+0000", 2024-09-12T22:49:53.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:53.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.585194+0000", 2024-09-12T22:49:53.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:53.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.585195+0000", 2024-09-12T22:49:53.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6750000000000001e-06 2024-09-12T22:49:53.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:53.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.594769+0000", 2024-09-12T22:49:53.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0095737649999999997 2024-09-12T22:49:53.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:53.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.594784+0000", 2024-09-12T22:49:53.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5075999999999999e-05 2024-09-12T22:49:53.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:53.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.594792+0000", 2024-09-12T22:49:53.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2370000000000003e-06 2024-09-12T22:49:53.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:53.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.594859+0000", 2024-09-12T22:49:53.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7792000000000004e-05 2024-09-12T22:49:53.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:53.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.595018+0000", 2024-09-12T22:49:53.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000158846 2024-09-12T22:49:53.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:53.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.611397+0000", 2024-09-12T22:49:53.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0163786 2024-09-12T22:49:53.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:53.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.611461+0000", 2024-09-12T22:49:53.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4090999999999993e-05 2024-09-12T22:49:53.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:53.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.611550+0000", 2024-09-12T22:49:53.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8665999999999994e-05 2024-09-12T22:49:53.244 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.244 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:53.244 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.244 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:10686 4.33 e54/17 4:cf068428:::100000030d3.00000000:head v 54'171, mlcod=54'168)", 2024-09-12T22:49:53.245 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:51.593562+0000", 2024-09-12T22:49:53.245 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 1.6271145900000001, 2024-09-12T22:49:53.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020021779999999999, 2024-09-12T22:49:53.245 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:53.245 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:53.245 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:53.245 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:53.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:53.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.593562+0000", 2024-09-12T22:49:53.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:53.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.593562+0000", 2024-09-12T22:49:53.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:53.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.593563+0000", 2024-09-12T22:49:53.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9100000000000002e-07 2024-09-12T22:49:53.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:53.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.598701+0000", 2024-09-12T22:49:53.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051386219999999998 2024-09-12T22:49:53.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:53.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.598713+0000", 2024-09-12T22:49:53.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.17e-05 2024-09-12T22:49:53.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:53.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.598720+0000", 2024-09-12T22:49:53.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.002e-06 2024-09-12T22:49:53.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:53.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.598801+0000", 2024-09-12T22:49:53.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0418000000000002e-05 2024-09-12T22:49:53.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:53.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.598818+0000", 2024-09-12T22:49:53.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6960999999999999e-05 2024-09-12T22:49:53.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:53.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.613494+0000", 2024-09-12T22:49:53.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014676827999999999 2024-09-12T22:49:53.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:53.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.613584+0000", 2024-09-12T22:49:53.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9357999999999994e-05 2024-09-12T22:49:53.249 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.249 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:53.249 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.249 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:10688 4.21 4:858ae08d:::100000030eb.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:49:53.249 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:51.594814+0000", 2024-09-12T22:49:53.249 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 1.625862886, 2024-09-12T22:49:53.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021333970000000001, 2024-09-12T22:49:53.250 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:53.250 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:53.250 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:53.250 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:53.250 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:53.250 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:53.250 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 10688 2024-09-12T22:49:53.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.250 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:53.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:53.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.594814+0000", 2024-09-12T22:49:53.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:53.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.594814+0000", 2024-09-12T22:49:53.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:53.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.594815+0000", 2024-09-12T22:49:53.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:49:53.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:53.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.603365+0000", 2024-09-12T22:49:53.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0085505919999999992 2024-09-12T22:49:53.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:53.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.603379+0000", 2024-09-12T22:49:53.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3871e-05 2024-09-12T22:49:53.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:53.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.603387+0000", 2024-09-12T22:49:53.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9340000000000006e-06 2024-09-12T22:49:53.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:53.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.603449+0000", 2024-09-12T22:49:53.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1713999999999999e-05 2024-09-12T22:49:53.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:53.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.603560+0000", 2024-09-12T22:49:53.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000111301 2024-09-12T22:49:53.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:53.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.603661+0000", 2024-09-12T22:49:53.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101374 2024-09-12T22:49:53.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:53.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.613668+0000", 2024-09-12T22:49:53.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010006251000000001 2024-09-12T22:49:53.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:53.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.616091+0000", 2024-09-12T22:49:53.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002423007 2024-09-12T22:49:53.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:53.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.616122+0000", 2024-09-12T22:49:53.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1504000000000002e-05 2024-09-12T22:49:53.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:53.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.616148+0000", 2024-09-12T22:49:53.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5456000000000002e-05 2024-09-12T22:49:53.256 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.256 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:53.256 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.256 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:10692 4.21 4:858ae08d:::100000030eb.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:49:53.256 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:51.617623+0000", 2024-09-12T22:49:53.256 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 1.6030534350000001, 2024-09-12T22:49:53.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021128404, 2024-09-12T22:49:53.257 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:53.257 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:53.257 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:53.257 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:53.257 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:53.257 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:53.257 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 10692 2024-09-12T22:49:53.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.257 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:53.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:53.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.617623+0000", 2024-09-12T22:49:53.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:53.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.617623+0000", 2024-09-12T22:49:53.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:53.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.617624+0000", 2024-09-12T22:49:53.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.066e-06 2024-09-12T22:49:53.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:53.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.621453+0000", 2024-09-12T22:49:53.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0038290849999999999 2024-09-12T22:49:53.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:53.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.621468+0000", 2024-09-12T22:49:53.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4619e-05 2024-09-12T22:49:53.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:53.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.621474+0000", 2024-09-12T22:49:53.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1240000000000002e-06 2024-09-12T22:49:53.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:53.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.621545+0000", 2024-09-12T22:49:53.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0623000000000005e-05 2024-09-12T22:49:53.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:53.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.621606+0000", 2024-09-12T22:49:53.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1865000000000005e-05 2024-09-12T22:49:53.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:53.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.621695+0000", 2024-09-12T22:49:53.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8531999999999999e-05 2024-09-12T22:49:53.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:53.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.628954+0000", 2024-09-12T22:49:53.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007258497 2024-09-12T22:49:53.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:53.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.638655+0000", 2024-09-12T22:49:53.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0097013180000000004 2024-09-12T22:49:53.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:53.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.638700+0000", 2024-09-12T22:49:53.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5252e-05 2024-09-12T22:49:53.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:53.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.638752+0000", 2024-09-12T22:49:53.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1422999999999999e-05 2024-09-12T22:49:53.263 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.263 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:53.263 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.263 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:10693 4.21 4:858ae08d:::100000030eb.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:49:53.263 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:51.622030+0000", 2024-09-12T22:49:53.263 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 1.5986465050000001, 2024-09-12T22:49:53.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021176598000000001, 2024-09-12T22:49:53.263 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:53.263 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:53.264 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:53.264 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:53.264 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:53.264 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:53.264 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 10693 2024-09-12T22:49:53.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.264 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:53.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:53.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.622030+0000", 2024-09-12T22:49:53.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:53.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.622030+0000", 2024-09-12T22:49:53.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:53.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.622031+0000", 2024-09-12T22:49:53.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.341e-06 2024-09-12T22:49:53.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:53.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.625884+0000", 2024-09-12T22:49:53.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0038527219999999998 2024-09-12T22:49:53.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:53.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.625903+0000", 2024-09-12T22:49:53.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9004999999999998e-05 2024-09-12T22:49:53.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:53.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.625911+0000", 2024-09-12T22:49:53.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.627e-06 2024-09-12T22:49:53.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:53.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.625965+0000", 2024-09-12T22:49:53.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3908e-05 2024-09-12T22:49:53.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:53.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.626031+0000", 2024-09-12T22:49:53.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6088999999999997e-05 2024-09-12T22:49:53.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:53.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.626119+0000", 2024-09-12T22:49:53.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8261000000000001e-05 2024-09-12T22:49:53.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:53.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.631054+0000", 2024-09-12T22:49:53.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049349399999999996 2024-09-12T22:49:53.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:53.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.643072+0000", 2024-09-12T22:49:53.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012017932 2024-09-12T22:49:53.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:53.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.643158+0000", 2024-09-12T22:49:53.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6642000000000002e-05 2024-09-12T22:49:53.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:53.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.643207+0000", 2024-09-12T22:49:53.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8130999999999997e-05 2024-09-12T22:49:53.269 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.269 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:53.269 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.269 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:321 3.13 3:ceffbd45:::200.0000000a:head [write 1750131~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:49:53.269 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:52.152122+0000", 2024-09-12T22:49:53.270 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 1.0685543930000001, 2024-09-12T22:49:53.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020067295999999998, 2024-09-12T22:49:53.270 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:53.270 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:53.270 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:53.270 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:53.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:53.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152122+0000", 2024-09-12T22:49:53.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:53.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152122+0000", 2024-09-12T22:49:53.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:53.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152122+0000", 2024-09-12T22:49:53.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4499999999999998e-07 2024-09-12T22:49:53.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:53.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152125+0000", 2024-09-12T22:49:53.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9380000000000001e-06 2024-09-12T22:49:53.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:53.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152131+0000", 2024-09-12T22:49:53.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9349999999999999e-06 2024-09-12T22:49:53.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:53.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152136+0000", 2024-09-12T22:49:53.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7090000000000001e-06 2024-09-12T22:49:53.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:53.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.170471+0000", 2024-09-12T22:49:53.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018334864999999999 2024-09-12T22:49:53.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:53.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.170522+0000", 2024-09-12T22:49:53.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1140999999999997e-05 2024-09-12T22:49:53.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:53.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.172097+0000", 2024-09-12T22:49:53.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015746670000000001 2024-09-12T22:49:53.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:53.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.172139+0000", 2024-09-12T22:49:53.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1865e-05 2024-09-12T22:49:53.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:53.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.172189+0000", 2024-09-12T22:49:53.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0831000000000002e-05 2024-09-12T22:49:53.275 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.275 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:53.275 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.276 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:322 3.13 3:ceffbd45:::200.0000000a:head [write 1751534~2254 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:49:53.276 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:52.152142+0000", 2024-09-12T22:49:53.276 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 1.0685344969999999, 2024-09-12T22:49:53.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021023179999999999, 2024-09-12T22:49:53.276 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:53.276 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:53.276 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:53.276 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:53.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:53.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152142+0000", 2024-09-12T22:49:53.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:53.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152142+0000", 2024-09-12T22:49:53.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:53.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152142+0000", 2024-09-12T22:49:53.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7300000000000002e-07 2024-09-12T22:49:53.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:53.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152150+0000", 2024-09-12T22:49:53.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4390000000000003e-06 2024-09-12T22:49:53.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:53.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152156+0000", 2024-09-12T22:49:53.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1319999999999999e-06 2024-09-12T22:49:53.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:53.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152161+0000", 2024-09-12T22:49:53.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6929999999999998e-06 2024-09-12T22:49:53.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:53.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.171072+0000", 2024-09-12T22:49:53.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018910869 2024-09-12T22:49:53.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:53.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.171150+0000", 2024-09-12T22:49:53.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8144000000000003e-05 2024-09-12T22:49:53.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:53.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.173079+0000", 2024-09-12T22:49:53.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019295149999999999 2024-09-12T22:49:53.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:53.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.173109+0000", 2024-09-12T22:49:53.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9879e-05 2024-09-12T22:49:53.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:53.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.173165+0000", 2024-09-12T22:49:53.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6135999999999999e-05 2024-09-12T22:49:53.280 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.280 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:53.281 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.281 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:323 3.13 3:ceffbd45:::200.0000000a:head [write 1753788~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:49:53.281 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:52.152168+0000", 2024-09-12T22:49:53.281 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 1.0685088039999999, 2024-09-12T22:49:53.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021078046, 2024-09-12T22:49:53.281 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:53.281 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:53.281 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:53.281 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:53.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:53.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152168+0000", 2024-09-12T22:49:53.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:53.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152168+0000", 2024-09-12T22:49:53.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:53.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152168+0000", 2024-09-12T22:49:53.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9700000000000002e-07 2024-09-12T22:49:53.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:53.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152172+0000", 2024-09-12T22:49:53.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6030000000000001e-06 2024-09-12T22:49:53.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:53.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152177+0000", 2024-09-12T22:49:53.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6439999999999997e-06 2024-09-12T22:49:53.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:53.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152182+0000", 2024-09-12T22:49:53.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6630000000000001e-06 2024-09-12T22:49:53.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:53.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.171613+0000", 2024-09-12T22:49:53.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019430810999999999 2024-09-12T22:49:53.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:53.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.171661+0000", 2024-09-12T22:49:53.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8368000000000002e-05 2024-09-12T22:49:53.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:53.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.173171+0000", 2024-09-12T22:49:53.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015095 2024-09-12T22:49:53.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:53.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.173198+0000", 2024-09-12T22:49:53.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7509e-05 2024-09-12T22:49:53.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:53.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.173246+0000", 2024-09-12T22:49:53.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7550999999999999e-05 2024-09-12T22:49:53.287 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.287 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:53.287 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.287 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:324 3.13 3:ceffbd45:::200.0000000a:head [write 1755187~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:49:53.287 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:52.152189+0000", 2024-09-12T22:49:53.287 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 1.068487636, 2024-09-12T22:49:53.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021940095999999999, 2024-09-12T22:49:53.287 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:53.287 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:53.288 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:53.288 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:53.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:53.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152189+0000", 2024-09-12T22:49:53.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:53.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152189+0000", 2024-09-12T22:49:53.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:53.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152189+0000", 2024-09-12T22:49:53.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.89e-07 2024-09-12T22:49:53.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:53.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152192+0000", 2024-09-12T22:49:53.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8789999999999999e-06 2024-09-12T22:49:53.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:53.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152199+0000", 2024-09-12T22:49:53.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5570000000000001e-06 2024-09-12T22:49:53.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:53.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152203+0000", 2024-09-12T22:49:53.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6820000000000002e-06 2024-09-12T22:49:53.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:53.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.172228+0000", 2024-09-12T22:49:53.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020024855000000001 2024-09-12T22:49:53.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:53.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.172306+0000", 2024-09-12T22:49:53.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7915000000000002e-05 2024-09-12T22:49:53.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:53.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.174043+0000", 2024-09-12T22:49:53.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017369589999999999 2024-09-12T22:49:53.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:53.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.174071+0000", 2024-09-12T22:49:53.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7875999999999999e-05 2024-09-12T22:49:53.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:53.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.174129+0000", 2024-09-12T22:49:53.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7983999999999999e-05 2024-09-12T22:49:53.292 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.292 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:53.292 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.293 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:325 3.13 3:ceffbd45:::200.0000000a:head [write 1756590~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:49:53.293 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:52.152210+0000", 2024-09-12T22:49:53.293 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 1.068466669, 2024-09-12T22:49:53.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024037256, 2024-09-12T22:49:53.293 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:53.293 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:53.294 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:53.294 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:53.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:53.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152210+0000", 2024-09-12T22:49:53.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:53.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152210+0000", 2024-09-12T22:49:53.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:53.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152210+0000", 2024-09-12T22:49:53.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8099999999999998e-07 2024-09-12T22:49:53.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:53.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152216+0000", 2024-09-12T22:49:53.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1129999999999997e-06 2024-09-12T22:49:53.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:53.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152224+0000", 2024-09-12T22:49:53.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3200000000000002e-06 2024-09-12T22:49:53.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:53.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152228+0000", 2024-09-12T22:49:53.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.634e-06 2024-09-12T22:49:53.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:53.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.172693+0000", 2024-09-12T22:49:53.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020464970999999998 2024-09-12T22:49:53.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:53.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.172739+0000", 2024-09-12T22:49:53.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5985000000000001e-05 2024-09-12T22:49:53.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:53.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.176151+0000", 2024-09-12T22:49:53.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0034113889999999999 2024-09-12T22:49:53.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:53.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.176182+0000", 2024-09-12T22:49:53.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1472e-05 2024-09-12T22:49:53.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:53.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.176247+0000", 2024-09-12T22:49:53.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4991000000000002e-05 2024-09-12T22:49:53.298 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.298 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:53.298 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.299 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:326 3.13 3:ceffbd45:::200.0000000a:head [write 1757992~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:49:53.299 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:52.152235+0000", 2024-09-12T22:49:53.299 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 1.0684415620000001, 2024-09-12T22:49:53.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027255317000000001, 2024-09-12T22:49:53.299 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:53.299 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:53.299 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:53.299 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:53.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:53.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152235+0000", 2024-09-12T22:49:53.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:53.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152235+0000", 2024-09-12T22:49:53.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:53.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152235+0000", 2024-09-12T22:49:53.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4000000000000002e-07 2024-09-12T22:49:53.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:53.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152239+0000", 2024-09-12T22:49:53.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1520000000000001e-06 2024-09-12T22:49:53.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:53.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152245+0000", 2024-09-12T22:49:53.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7610000000000002e-06 2024-09-12T22:49:53.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:53.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152250+0000", 2024-09-12T22:49:53.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:49:53.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:53.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.173288+0000", 2024-09-12T22:49:53.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021038333999999999 2024-09-12T22:49:53.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:53.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.173365+0000", 2024-09-12T22:49:53.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6501999999999994e-05 2024-09-12T22:49:53.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:53.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.179397+0000", 2024-09-12T22:49:53.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0060320110000000003 2024-09-12T22:49:53.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:53.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.179428+0000", 2024-09-12T22:49:53.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0973000000000003e-05 2024-09-12T22:49:53.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:53.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.179490+0000", 2024-09-12T22:49:53.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2305999999999996e-05 2024-09-12T22:49:53.305 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.305 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:53.306 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.306 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:327 3.13 3:ceffbd45:::200.0000000a:head [write 1759390~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:49:53.306 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:52.152270+0000", 2024-09-12T22:49:53.306 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 1.0684066130000001, 2024-09-12T22:49:53.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.028205562, 2024-09-12T22:49:53.306 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:53.306 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:53.306 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:53.306 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:53.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:53.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152270+0000", 2024-09-12T22:49:53.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:53.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152270+0000", 2024-09-12T22:49:53.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:53.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152270+0000", 2024-09-12T22:49:53.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.34e-07 2024-09-12T22:49:53.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:53.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152277+0000", 2024-09-12T22:49:53.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3219999999999998e-06 2024-09-12T22:49:53.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:53.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152283+0000", 2024-09-12T22:49:53.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5989999999999998e-06 2024-09-12T22:49:53.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:53.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152288+0000", 2024-09-12T22:49:53.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1970000000000004e-06 2024-09-12T22:49:53.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:53.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.173749+0000", 2024-09-12T22:49:53.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021460374000000001 2024-09-12T22:49:53.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:53.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.173794+0000", 2024-09-12T22:49:53.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5631999999999999e-05 2024-09-12T22:49:53.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:53.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.180389+0000", 2024-09-12T22:49:53.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065943219999999997 2024-09-12T22:49:53.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:53.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.180417+0000", 2024-09-12T22:49:53.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8319000000000001e-05 2024-09-12T22:49:53.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:53.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.180475+0000", 2024-09-12T22:49:53.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8362999999999997e-05 2024-09-12T22:49:53.311 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.311 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:53.311 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.311 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:328 3.13 3:ceffbd45:::200.0000000a:head [write 1760803~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:49:53.311 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:52.152298+0000", 2024-09-12T22:49:53.311 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 1.068378512, 2024-09-12T22:49:53.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.028261623, 2024-09-12T22:49:53.311 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:53.311 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:53.311 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:53.311 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:53.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:53.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152298+0000", 2024-09-12T22:49:53.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:53.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152298+0000", 2024-09-12T22:49:53.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:53.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152299+0000", 2024-09-12T22:49:53.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0999999999999999e-07 2024-09-12T22:49:53.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:53.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152301+0000", 2024-09-12T22:49:53.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4449999999999999e-06 2024-09-12T22:49:53.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:53.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152307+0000", 2024-09-12T22:49:53.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.728e-06 2024-09-12T22:49:53.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:53.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152312+0000", 2024-09-12T22:49:53.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9509999999999997e-06 2024-09-12T22:49:53.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:53.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.174167+0000", 2024-09-12T22:49:53.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021855001999999998 2024-09-12T22:49:53.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:53.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.174244+0000", 2024-09-12T22:49:53.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6921000000000004e-05 2024-09-12T22:49:53.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:53.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.180481+0000", 2024-09-12T22:49:53.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.006237584 2024-09-12T22:49:53.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:53.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.180509+0000", 2024-09-12T22:49:53.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7894000000000001e-05 2024-09-12T22:49:53.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:53.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.180560+0000", 2024-09-12T22:49:53.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0587999999999997e-05 2024-09-12T22:49:53.316 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.316 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:53.316 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.316 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:329 3.13 3:ceffbd45:::200.0000000a:head [write 1762211~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:49:53.316 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:52.152317+0000", 2024-09-12T22:49:53.316 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 1.0683592120000001, 2024-09-12T22:49:53.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.028327268999999999, 2024-09-12T22:49:53.317 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:53.317 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:53.317 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:53.317 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:53.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:53.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152317+0000", 2024-09-12T22:49:53.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:53.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152317+0000", 2024-09-12T22:49:53.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:53.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152318+0000", 2024-09-12T22:49:53.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:49:53.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:53.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152323+0000", 2024-09-12T22:49:53.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6380000000000001e-06 2024-09-12T22:49:53.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:53.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152329+0000", 2024-09-12T22:49:53.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9669999999999998e-06 2024-09-12T22:49:53.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:53.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152334+0000", 2024-09-12T22:49:53.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7169999999999999e-06 2024-09-12T22:49:53.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:53.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.174735+0000", 2024-09-12T22:49:53.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022400663000000001 2024-09-12T22:49:53.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:53.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.174808+0000", 2024-09-12T22:49:53.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3536999999999997e-05 2024-09-12T22:49:53.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:53.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.180564+0000", 2024-09-12T22:49:53.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005756176 2024-09-12T22:49:53.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:53.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.180590+0000", 2024-09-12T22:49:53.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5432999999999999e-05 2024-09-12T22:49:53.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:53.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.180645+0000", 2024-09-12T22:49:53.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4744999999999998e-05 2024-09-12T22:49:53.321 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.321 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:53.321 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.322 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:330 3.13 3:ceffbd45:::200.0000000a:head [write 1763614~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:49:53.322 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:52.152340+0000", 2024-09-12T22:49:53.322 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 1.0683366430000001, 2024-09-12T22:49:53.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.028391953000000001, 2024-09-12T22:49:53.322 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:53.322 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:53.322 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:53.322 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:53.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:53.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152340+0000", 2024-09-12T22:49:53.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:53.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152340+0000", 2024-09-12T22:49:53.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:53.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152340+0000", 2024-09-12T22:49:53.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7500000000000001e-07 2024-09-12T22:49:53.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:53.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152346+0000", 2024-09-12T22:49:53.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-09-12T22:49:53.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:53.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152352+0000", 2024-09-12T22:49:53.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7899999999999996e-06 2024-09-12T22:49:53.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:53.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152356+0000", 2024-09-12T22:49:53.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:49:53.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:53.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.175226+0000", 2024-09-12T22:49:53.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022870214999999999 2024-09-12T22:49:53.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:53.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.175303+0000", 2024-09-12T22:49:53.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6361999999999998e-05 2024-09-12T22:49:53.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:53.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.180650+0000", 2024-09-12T22:49:53.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053471880000000001 2024-09-12T22:49:53.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:53.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.180684+0000", 2024-09-12T22:49:53.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3847999999999998e-05 2024-09-12T22:49:53.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:53.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.180732+0000", 2024-09-12T22:49:53.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8021e-05 2024-09-12T22:49:53.326 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.326 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:53.326 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.327 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:331 3.13 3:ceffbd45:::200.0000000a:head [write 1765014~4322 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:49:53.327 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:52.154070+0000", 2024-09-12T22:49:53.327 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 1.066606231, 2024-09-12T22:49:53.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026747646999999999, 2024-09-12T22:49:53.327 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:53.327 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:53.327 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:53.327 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:53.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:53.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.154070+0000", 2024-09-12T22:49:53.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:53.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.154070+0000", 2024-09-12T22:49:53.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:53.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.154071+0000", 2024-09-12T22:49:53.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8999999999999995e-07 2024-09-12T22:49:53.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:53.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.154079+0000", 2024-09-12T22:49:53.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8739999999999995e-06 2024-09-12T22:49:53.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:53.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.154089+0000", 2024-09-12T22:49:53.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0139000000000001e-05 2024-09-12T22:49:53.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:53.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.154096+0000", 2024-09-12T22:49:53.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1679999999999998e-06 2024-09-12T22:49:53.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:53.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.175715+0000", 2024-09-12T22:49:53.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021618663999999999 2024-09-12T22:49:53.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:53.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.175765+0000", 2024-09-12T22:49:53.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9990000000000001e-05 2024-09-12T22:49:53.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:53.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.180737+0000", 2024-09-12T22:49:53.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049722029999999997 2024-09-12T22:49:53.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:53.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.180771+0000", 2024-09-12T22:49:53.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3929e-05 2024-09-12T22:49:53.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:53.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.180818+0000", 2024-09-12T22:49:53.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.689e-05 2024-09-12T22:49:53.331 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.331 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:53.331 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.332 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:332 3.13 3:ceffbd45:::200.0000000a:head [write 1769336~2768 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:49:53.332 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:52.157180+0000", 2024-09-12T22:49:53.332 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 1.063496529, 2024-09-12T22:49:53.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023742829999999999, 2024-09-12T22:49:53.332 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:53.332 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:53.332 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:53.332 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:53.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:53.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.157180+0000", 2024-09-12T22:49:53.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:53.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.157180+0000", 2024-09-12T22:49:53.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:53.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.157181+0000", 2024-09-12T22:49:53.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9299999999999997e-07 2024-09-12T22:49:53.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:53.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.157186+0000", 2024-09-12T22:49:53.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.826e-06 2024-09-12T22:49:53.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:53.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.157195+0000", 2024-09-12T22:49:53.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3840000000000003e-06 2024-09-12T22:49:53.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:53.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.157202+0000", 2024-09-12T22:49:53.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9110000000000004e-06 2024-09-12T22:49:53.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:53.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.176286+0000", 2024-09-12T22:49:53.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019084429999999999 2024-09-12T22:49:53.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:53.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.176372+0000", 2024-09-12T22:49:53.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5484999999999999e-05 2024-09-12T22:49:53.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:53.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.180823+0000", 2024-09-12T22:49:53.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044513720000000003 2024-09-12T22:49:53.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:53.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.180848+0000", 2024-09-12T22:49:53.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5131999999999999e-05 2024-09-12T22:49:53.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:53.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.180923+0000", 2024-09-12T22:49:53.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4497000000000002e-05 2024-09-12T22:49:53.336 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.336 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:53.337 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.337 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:333 3.13 3:ceffbd45:::200.0000000a:head [write 1772104~3816 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:49:53.337 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:52.160013+0000", 2024-09-12T22:49:53.337 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 1.060663726, 2024-09-12T22:49:53.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021021808999999999, 2024-09-12T22:49:53.337 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:53.337 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:53.337 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:53.337 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:53.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:53.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.160013+0000", 2024-09-12T22:49:53.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:53.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.160013+0000", 2024-09-12T22:49:53.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:53.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:53.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.160014+0000", 2024-09-12T22:49:53.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9699999999999994e-07 2024-09-12T22:49:53.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:53.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.160022+0000", 2024-09-12T22:49:53.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6070000000000008e-06 2024-09-12T22:49:53.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:53.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.160034+0000", 2024-09-12T22:49:53.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2014999999999999e-05 2024-09-12T22:49:53.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:53.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.160042+0000", 2024-09-12T22:49:53.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6350000000000006e-06 2024-09-12T22:49:53.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:53.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.176842+0000", 2024-09-12T22:49:53.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016799544 2024-09-12T22:49:53.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:53.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.176919+0000", 2024-09-12T22:49:53.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7358e-05 2024-09-12T22:49:53.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:53.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.180929+0000", 2024-09-12T22:49:53.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040103650000000001 2024-09-12T22:49:53.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:53.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.180977+0000", 2024-09-12T22:49:53.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8053999999999998e-05 2024-09-12T22:49:53.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:53.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:53.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:53.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.181035+0000", 2024-09-12T22:49:53.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7234000000000001e-05 2024-09-12T22:49:53.342 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.342 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:53.342 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.342 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:53.342 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:53.342 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:53.344 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:53.342+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:53.344 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:53.346 INFO:tasks.workunit.client.0.smithi066.stdout:4/5: sync 2024-09-12T22:49:53.351 INFO:tasks.workunit.client.0.smithi066.stdout:4/6: dwrite f1 [0,4194304] 0 2024-09-12T22:49:53.354 INFO:tasks.workunit.client.0.smithi066.stdout:4/7: creat f3 x:0 0 0 2024-09-12T22:49:53.354 INFO:tasks.workunit.client.0.smithi066.stdout:4/8: unlink c0 0 2024-09-12T22:49:53.355 INFO:tasks.workunit.client.0.smithi066.stdout:4/9: symlink l4 0 2024-09-12T22:49:53.355 INFO:tasks.workunit.client.0.smithi066.stdout:4/10: readlink l4 0 2024-09-12T22:49:53.356 INFO:tasks.workunit.client.0.smithi066.stdout:4/11: mkdir d5 0 2024-09-12T22:49:53.356 INFO:tasks.workunit.client.0.smithi066.stdout:4/12: unlink c2 0 2024-09-12T22:49:53.357 INFO:tasks.workunit.client.0.smithi066.stdout:4/13: mknod d5/c6 0 2024-09-12T22:49:53.362 INFO:tasks.workunit.client.0.smithi066.stdout:4/14: dwrite f1 [0,4194304] 0 2024-09-12T22:49:53.368 INFO:tasks.workunit.client.0.smithi066.stdout:4/15: dwrite f1 [0,4194304] 0 2024-09-12T22:49:53.372 INFO:tasks.workunit.client.0.smithi066.stdout:4/16: rename f3 to d5/f7 0 2024-09-12T22:49:53.375 INFO:tasks.workunit.client.0.smithi066.stdout:4/17: mkdir d5/d8 0 2024-09-12T22:49:53.375 INFO:tasks.workunit.client.0.smithi066.stdout:4/18: dread - d5/f7 zero size 2024-09-12T22:49:53.376 INFO:tasks.workunit.client.0.smithi066.stdout:4/19: write f1 [2257996,50834] 0 2024-09-12T22:49:53.409 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:49:53.445 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:53.444+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:53.453 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:53.453 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:53.453 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:49:53.453 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:53.461 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:53.464 INFO:tasks.workunit.client.0.smithi066.stdout:0/45: sync 2024-09-12T22:49:53.464 INFO:tasks.workunit.client.0.smithi066.stdout:7/40: sync 2024-09-12T22:49:53.465 INFO:tasks.workunit.client.0.smithi066.stdout:9/10: sync 2024-09-12T22:49:53.465 INFO:tasks.workunit.client.0.smithi066.stdout:3/7: sync 2024-09-12T22:49:53.465 INFO:tasks.workunit.client.0.smithi066.stdout:3/8: link - no file 2024-09-12T22:49:53.465 INFO:tasks.workunit.client.0.smithi066.stdout:1/19: sync 2024-09-12T22:49:53.465 INFO:tasks.workunit.client.0.smithi066.stdout:3/9: dwrite - no filename 2024-09-12T22:49:53.465 INFO:tasks.workunit.client.0.smithi066.stdout:3/10: truncate - no filename 2024-09-12T22:49:53.465 INFO:tasks.workunit.client.0.smithi066.stdout:2/44: sync 2024-09-12T22:49:53.465 INFO:tasks.workunit.client.0.smithi066.stdout:8/31: sync 2024-09-12T22:49:53.465 INFO:tasks.workunit.client.0.smithi066.stdout:6/32: sync 2024-09-12T22:49:53.465 INFO:tasks.workunit.client.0.smithi066.stdout:5/110: sync 2024-09-12T22:49:53.467 INFO:tasks.workunit.client.0.smithi066.stdout:3/11: rename d0 to d0/d2/d3 22 2024-09-12T22:49:53.468 INFO:tasks.workunit.client.0.smithi066.stdout:3/12: stat d0 0 2024-09-12T22:49:53.468 INFO:tasks.workunit.client.0.smithi066.stdout:0/46: unlink c0 0 2024-09-12T22:49:53.468 INFO:tasks.workunit.client.0.smithi066.stdout:6/33: fsync f1 0 2024-09-12T22:49:53.468 INFO:tasks.workunit.client.0.smithi066.stdout:3/13: chown d0/d2 7399 1 2024-09-12T22:49:53.468 INFO:tasks.workunit.client.0.smithi066.stdout:7/41: symlink d0/d6/l7 0 2024-09-12T22:49:53.468 INFO:tasks.workunit.client.0.smithi066.stdout:5/111: symlink d5/d14/l1c 0 2024-09-12T22:49:53.468 INFO:tasks.workunit.client.0.smithi066.stdout:0/47: unlink d1/d12/ff 0 2024-09-12T22:49:53.468 INFO:tasks.workunit.client.0.smithi066.stdout:6/34: chown f1 167991687 1 2024-09-12T22:49:53.468 INFO:tasks.workunit.client.0.smithi066.stdout:8/32: getdents . 0 2024-09-12T22:49:53.468 INFO:tasks.workunit.client.0.smithi066.stdout:3/14: mknod d0/d2/c4 0 2024-09-12T22:49:53.468 INFO:tasks.workunit.client.0.smithi066.stdout:3/15: readlink - no filename 2024-09-12T22:49:53.468 INFO:tasks.workunit.client.0.smithi066.stdout:3/16: write - no filename 2024-09-12T22:49:53.469 INFO:tasks.workunit.client.0.smithi066.stdout:6/35: dread - f5 zero size 2024-09-12T22:49:53.469 INFO:tasks.workunit.client.0.smithi066.stdout:8/33: write fa [806161,91223] 0 2024-09-12T22:49:53.469 INFO:tasks.workunit.client.0.smithi066.stdout:3/17: symlink d0/l5 0 2024-09-12T22:49:53.470 INFO:tasks.workunit.client.0.smithi066.stdout:0/48: link d1/d8/fe d1/d8/f15 0 2024-09-12T22:49:53.470 INFO:tasks.workunit.client.0.smithi066.stdout:6/36: mkdir d6/d7 0 2024-09-12T22:49:53.470 INFO:tasks.workunit.client.0.smithi066.stdout:1/20: dread d0/f2 [0,4194304] 0 2024-09-12T22:49:53.470 INFO:tasks.workunit.client.0.smithi066.stdout:8/34: mknod cd 0 2024-09-12T22:49:53.470 INFO:tasks.workunit.client.0.smithi066.stdout:6/37: fsync f2 0 2024-09-12T22:49:53.470 INFO:tasks.workunit.client.0.smithi066.stdout:7/42: getdents d0/d6 0 2024-09-12T22:49:53.471 INFO:tasks.workunit.client.0.smithi066.stdout:3/18: mkdir d0/d2/d6 0 2024-09-12T22:49:53.471 INFO:tasks.workunit.client.0.smithi066.stdout:3/19: write - no filename 2024-09-12T22:49:53.472 INFO:tasks.workunit.client.0.smithi066.stdout:1/21: rmdir d0 39 2024-09-12T22:49:53.472 INFO:tasks.workunit.client.0.smithi066.stdout:0/49: fdatasync d1/d8/f15 0 2024-09-12T22:49:53.473 INFO:tasks.workunit.client.0.smithi066.stdout:2/45: dwrite d1/f3 [0,4194304] 0 2024-09-12T22:49:53.473 INFO:tasks.workunit.client.0.smithi066.stdout:7/43: creat d0/d6/f8 x:0 0 0 2024-09-12T22:49:53.473 INFO:tasks.workunit.client.0.smithi066.stdout:6/38: write f2 [661437,67327] 0 2024-09-12T22:49:53.473 INFO:tasks.workunit.client.0.smithi066.stdout:8/35: chown cc 13205507 1 2024-09-12T22:49:53.474 INFO:tasks.workunit.client.0.smithi066.stdout:2/46: dread - d1/f6 zero size 2024-09-12T22:49:53.474 INFO:tasks.workunit.client.0.smithi066.stdout:3/20: mkdir d0/d2/d7 0 2024-09-12T22:49:53.474 INFO:tasks.workunit.client.0.smithi066.stdout:3/21: dread - no filename 2024-09-12T22:49:53.474 INFO:tasks.workunit.client.0.smithi066.stdout:1/22: symlink d0/l5 0 2024-09-12T22:49:53.475 INFO:tasks.workunit.client.0.smithi066.stdout:8/36: fdatasync fa 0 2024-09-12T22:49:53.475 INFO:tasks.workunit.client.0.smithi066.stdout:1/23: fsync d0/f2 0 2024-09-12T22:49:53.476 INFO:tasks.workunit.client.0.smithi066.stdout:2/47: write d1/f6 [982124,56653] 0 2024-09-12T22:49:53.476 INFO:tasks.workunit.client.0.smithi066.stdout:1/24: chown d0 1151 1 2024-09-12T22:49:53.477 INFO:tasks.workunit.client.0.smithi066.stdout:3/22: getdents d0 0 2024-09-12T22:49:53.478 INFO:tasks.workunit.client.0.smithi066.stdout:8/37: creat fe x:0 0 0 2024-09-12T22:49:53.478 INFO:tasks.workunit.client.0.smithi066.stdout:2/48: unlink d1/f9 0 2024-09-12T22:49:53.479 INFO:tasks.workunit.client.0.smithi066.stdout:5/112: dwrite d5/d15/f17 [0,4194304] 0 2024-09-12T22:49:53.479 INFO:tasks.workunit.client.0.smithi066.stdout:7/44: truncate d0/f5 2168226 0 2024-09-12T22:49:53.479 INFO:tasks.workunit.client.0.smithi066.stdout:0/50: dread d1/f10 [0,4194304] 0 2024-09-12T22:49:53.479 INFO:tasks.workunit.client.0.smithi066.stdout:8/38: unlink fe 0 2024-09-12T22:49:53.480 INFO:tasks.workunit.client.0.smithi066.stdout:3/23: rename d0/d2/d6 to d0/d2/d6/d8 22 2024-09-12T22:49:53.480 INFO:tasks.workunit.client.0.smithi066.stdout:3/24: dwrite - no filename 2024-09-12T22:49:53.480 INFO:tasks.workunit.client.0.smithi066.stdout:3/25: dread - no filename 2024-09-12T22:49:53.481 INFO:tasks.workunit.client.0.smithi066.stdout:7/45: write d0/d6/f8 [100762,16414] 0 2024-09-12T22:49:53.481 INFO:tasks.workunit.client.0.smithi066.stdout:8/39: symlink lf 0 2024-09-12T22:49:53.482 INFO:tasks.workunit.client.0.smithi066.stdout:0/51: read - d1/f7 zero size 2024-09-12T22:49:53.482 INFO:tasks.workunit.client.0.smithi066.stdout:6/39: dwrite f2 [4194304,4194304] 0 2024-09-12T22:49:53.483 INFO:tasks.workunit.client.0.smithi066.stdout:7/46: chown d0/d6/l7 916248 1 2024-09-12T22:49:53.485 INFO:tasks.workunit.client.0.smithi066.stdout:3/26: creat d0/d2/d6/f9 x:0 0 0 2024-09-12T22:49:53.485 INFO:tasks.workunit.client.0.smithi066.stdout:8/40: rename c6 to c10 0 2024-09-12T22:49:53.485 INFO:tasks.workunit.client.0.smithi066.stdout:8/41: chown fa 64 1 2024-09-12T22:49:53.485 INFO:tasks.workunit.client.0.smithi066.stdout:3/27: write d0/d2/d6/f9 [120060,34464] 0 2024-09-12T22:49:53.487 INFO:tasks.workunit.client.0.smithi066.stdout:3/28: creat d0/d2/fa x:0 0 0 2024-09-12T22:49:53.487 INFO:tasks.workunit.client.0.smithi066.stdout:8/42: creat f11 x:0 0 0 2024-09-12T22:49:53.487 INFO:tasks.workunit.client.0.smithi066.stdout:6/40: dread f2 [0,4194304] 0 2024-09-12T22:49:53.487 INFO:tasks.workunit.client.0.smithi066.stdout:7/47: fdatasync d0/f3 0 2024-09-12T22:49:53.487 INFO:tasks.workunit.client.0.smithi066.stdout:8/43: dread - f11 zero size 2024-09-12T22:49:53.488 INFO:tasks.workunit.client.0.smithi066.stdout:3/29: read - d0/d2/fa zero size 2024-09-12T22:49:53.488 INFO:tasks.workunit.client.0.smithi066.stdout:6/41: symlink d6/l8 0 2024-09-12T22:49:53.488 INFO:tasks.workunit.client.0.smithi066.stdout:8/44: write f11 [884770,55750] 0 2024-09-12T22:49:53.488 INFO:tasks.workunit.client.0.smithi066.stdout:6/42: rename d6/l8 to d6/d7/l9 0 2024-09-12T22:49:53.489 INFO:tasks.workunit.client.0.smithi066.stdout:6/43: fsync f1 0 2024-09-12T22:49:53.489 INFO:tasks.workunit.client.0.smithi066.stdout:0/52: write d1/d8/fe [546990,41878] 0 2024-09-12T22:49:53.490 INFO:tasks.workunit.client.0.smithi066.stdout:6/44: chown f1 206564 1 2024-09-12T22:49:53.490 INFO:tasks.workunit.client.0.smithi066.stdout:2/49: dread d1/f6 [0,4194304] 0 2024-09-12T22:49:53.490 INFO:tasks.workunit.client.0.smithi066.stdout:0/53: rmdir d1/d12 39 2024-09-12T22:49:53.490 INFO:tasks.workunit.client.0.smithi066.stdout:6/45: stat d6/d7 0 2024-09-12T22:49:53.491 INFO:tasks.workunit.client.0.smithi066.stdout:6/46: fsync f5 0 2024-09-12T22:49:53.491 INFO:tasks.workunit.client.0.smithi066.stdout:2/50: write d1/f4 [909234,63429] 0 2024-09-12T22:49:53.492 INFO:tasks.workunit.client.0.smithi066.stdout:8/45: dread fa [0,4194304] 0 2024-09-12T22:49:53.492 INFO:tasks.workunit.client.0.smithi066.stdout:0/54: symlink d1/d12/d13/l16 0 2024-09-12T22:49:53.494 INFO:tasks.workunit.client.0.smithi066.stdout:8/46: readlink l2 0 2024-09-12T22:49:53.494 INFO:tasks.workunit.client.0.smithi066.stdout:2/51: rename d1/l5 to d1/la 0 2024-09-12T22:49:53.494 INFO:tasks.workunit.client.0.smithi066.stdout:5/113: dwrite f3 [0,4194304] 0 2024-09-12T22:49:53.495 INFO:tasks.workunit.client.0.smithi066.stdout:6/47: write f1 [5568056,29483] 0 2024-09-12T22:49:53.495 INFO:tasks.workunit.client.0.smithi066.stdout:0/55: getdents d1 0 2024-09-12T22:49:53.495 INFO:tasks.workunit.client.0.smithi066.stdout:8/47: chown c10 0 1 2024-09-12T22:49:53.495 INFO:tasks.workunit.client.0.smithi066.stdout:4/20: sync 2024-09-12T22:49:53.495 INFO:tasks.workunit.client.0.smithi066.stdout:5/114: write d5/f12 [4063132,54177] 0 2024-09-12T22:49:53.496 INFO:tasks.workunit.client.0.smithi066.stdout:8/48: fsync f11 0 2024-09-12T22:49:53.496 INFO:tasks.workunit.client.0.smithi066.stdout:6/48: chown c4 0 1 2024-09-12T22:49:53.496 INFO:tasks.workunit.client.0.smithi066.stdout:2/52: dread d1/f6 [0,4194304] 0 2024-09-12T22:49:53.497 INFO:tasks.workunit.client.0.smithi066.stdout:4/21: mkdir d5/d9 0 2024-09-12T22:49:53.497 INFO:tasks.workunit.client.0.smithi066.stdout:4/22: dread - d5/f7 zero size 2024-09-12T22:49:53.498 INFO:tasks.workunit.client.0.smithi066.stdout:2/53: mkdir d1/db 0 2024-09-12T22:49:53.498 INFO:tasks.workunit.client.0.smithi066.stdout:4/23: dread - d5/f7 zero size 2024-09-12T22:49:53.499 INFO:tasks.workunit.client.0.smithi066.stdout:6/49: truncate f2 5802669 0 2024-09-12T22:49:53.499 INFO:tasks.workunit.client.0.smithi066.stdout:2/54: mknod d1/cc 0 2024-09-12T22:49:53.499 INFO:tasks.workunit.client.0.smithi066.stdout:4/24: fdatasync f1 0 2024-09-12T22:49:53.501 INFO:tasks.workunit.client.0.smithi066.stdout:2/55: mkdir d1/dd 0 2024-09-12T22:49:53.501 INFO:tasks.workunit.client.0.smithi066.stdout:0/56: truncate d1/d8/fe 436901 0 2024-09-12T22:49:53.501 INFO:tasks.workunit.client.0.smithi066.stdout:7/48: dread d0/f3 [0,4194304] 0 2024-09-12T22:49:53.502 INFO:tasks.workunit.client.0.smithi066.stdout:4/25: mknod d5/d9/ca 0 2024-09-12T22:49:53.502 INFO:tasks.workunit.client.0.smithi066.stdout:5/115: dread d5/f12 [0,4194304] 0 2024-09-12T22:49:53.503 INFO:tasks.workunit.client.0.smithi066.stdout:2/56: read d1/f4 [64017,91162] 0 2024-09-12T22:49:53.503 INFO:tasks.workunit.client.0.smithi066.stdout:4/26: mkdir d5/d9/db 0 2024-09-12T22:49:53.504 INFO:tasks.workunit.client.0.smithi066.stdout:8/49: dwrite fa [0,4194304] 0 2024-09-12T22:49:53.504 INFO:tasks.workunit.client.0.smithi066.stdout:5/116: rmdir d5/d15 39 2024-09-12T22:49:53.505 INFO:tasks.workunit.client.0.smithi066.stdout:8/50: chown cc 1817192 1 2024-09-12T22:49:53.507 INFO:tasks.workunit.client.0.smithi066.stdout:5/117: creat d5/d11/f1d x:0 0 0 2024-09-12T22:49:53.507 INFO:tasks.workunit.client.0.smithi066.stdout:7/49: dread d0/f3 [0,4194304] 0 2024-09-12T22:49:53.507 INFO:tasks.workunit.client.0.smithi066.stdout:6/50: dwrite f2 [0,4194304] 0 2024-09-12T22:49:53.507 INFO:tasks.workunit.client.0.smithi066.stdout:0/57: fsync d1/d8/f15 0 2024-09-12T22:49:53.507 INFO:tasks.workunit.client.0.smithi066.stdout:4/27: mknod d5/d9/db/cc 0 2024-09-12T22:49:53.509 INFO:tasks.workunit.client.0.smithi066.stdout:6/51: rename f5 to d6/d7/fa 0 2024-09-12T22:49:53.510 INFO:tasks.workunit.client.0.smithi066.stdout:0/58: fdatasync d1/d8/f15 0 2024-09-12T22:49:53.510 INFO:tasks.workunit.client.0.smithi066.stdout:4/28: write d5/f7 [409939,59602] 0 2024-09-12T22:49:53.510 INFO:tasks.workunit.client.0.smithi066.stdout:6/52: chown f1 8 1 2024-09-12T22:49:53.513 INFO:tasks.workunit.client.0.smithi066.stdout:4/29: write f1 [1674156,53225] 0 2024-09-12T22:49:53.513 INFO:tasks.workunit.client.0.smithi066.stdout:8/51: dwrite fa [0,4194304] 0 2024-09-12T22:49:53.514 INFO:tasks.workunit.client.0.smithi066.stdout:2/57: dwrite d1/f4 [0,4194304] 0 2024-09-12T22:49:53.515 INFO:tasks.workunit.client.0.smithi066.stdout:0/59: write d1/d8/fe [33158,23456] 0 2024-09-12T22:49:53.516 INFO:tasks.workunit.client.0.smithi066.stdout:4/30: symlink d5/d8/ld 0 2024-09-12T22:49:53.516 INFO:tasks.workunit.client.0.smithi066.stdout:8/52: mknod c12 0 2024-09-12T22:49:53.517 INFO:tasks.workunit.client.0.smithi066.stdout:0/60: write d1/f2 [735501,30802] 0 2024-09-12T22:49:53.517 INFO:tasks.workunit.client.0.smithi066.stdout:8/53: stat lb 0 2024-09-12T22:49:53.518 INFO:tasks.workunit.client.0.smithi066.stdout:8/54: link fa f13 0 2024-09-12T22:49:53.518 INFO:tasks.workunit.client.0.smithi066.stdout:5/118: truncate d5/d15/f17 3093206 0 2024-09-12T22:49:53.519 INFO:tasks.workunit.client.0.smithi066.stdout:6/53: truncate f1 1876328 0 2024-09-12T22:49:53.519 INFO:tasks.workunit.client.0.smithi066.stdout:5/119: mknod d5/de/c1e 0 2024-09-12T22:49:53.520 INFO:tasks.workunit.client.0.smithi066.stdout:4/31: dread f1 [0,4194304] 0 2024-09-12T22:49:53.520 INFO:tasks.workunit.client.0.smithi066.stdout:5/120: symlink d5/de/l1f 0 2024-09-12T22:49:53.520 INFO:tasks.workunit.client.0.smithi066.stdout:6/54: truncate d6/d7/fa 188524 0 2024-09-12T22:49:53.521 INFO:tasks.workunit.client.0.smithi066.stdout:5/121: read f3 [1262703,52761] 0 2024-09-12T22:49:53.522 INFO:tasks.workunit.client.0.smithi066.stdout:6/55: creat d6/fb x:0 0 0 2024-09-12T22:49:53.522 INFO:tasks.workunit.client.0.smithi066.stdout:3/30: sync 2024-09-12T22:49:53.522 INFO:tasks.workunit.client.0.smithi066.stdout:1/25: sync 2024-09-12T22:49:53.522 INFO:tasks.workunit.client.0.smithi066.stdout:9/11: sync 2024-09-12T22:49:53.522 INFO:tasks.workunit.client.0.smithi066.stdout:2/58: sync 2024-09-12T22:49:53.522 INFO:tasks.workunit.client.0.smithi066.stdout:4/32: rename d5/d9/db to d5/d9/de 0 2024-09-12T22:49:53.523 INFO:tasks.workunit.client.0.smithi066.stdout:9/12: read f2 [278070,87627] 0 2024-09-12T22:49:53.523 INFO:tasks.workunit.client.0.smithi066.stdout:1/26: creat d0/f6 x:0 0 0 2024-09-12T22:49:53.523 INFO:tasks.workunit.client.0.smithi066.stdout:4/33: read f1 [653600,1840] 0 2024-09-12T22:49:53.523 INFO:tasks.workunit.client.0.smithi066.stdout:5/122: symlink d5/d11/l20 0 2024-09-12T22:49:53.524 INFO:tasks.workunit.client.0.smithi066.stdout:9/13: creat f5 x:0 0 0 2024-09-12T22:49:53.524 INFO:tasks.workunit.client.0.smithi066.stdout:3/31: write d0/d2/d6/f9 [400559,66444] 0 2024-09-12T22:49:53.524 INFO:tasks.workunit.client.0.smithi066.stdout:1/27: fsync d0/f2 0 2024-09-12T22:49:53.525 INFO:tasks.workunit.client.0.smithi066.stdout:4/34: unlink d5/d9/ca 0 2024-09-12T22:49:53.525 INFO:tasks.workunit.client.0.smithi066.stdout:9/14: rename f2 to f6 0 2024-09-12T22:49:53.525 INFO:tasks.workunit.client.0.smithi066.stdout:8/55: dwrite f11 [0,4194304] 0 2024-09-12T22:49:53.525 INFO:tasks.workunit.client.0.smithi066.stdout:5/123: mkdir d5/d11/d21 0 2024-09-12T22:49:53.525 INFO:tasks.workunit.client.0.smithi066.stdout:3/32: readlink d0/l5 0 2024-09-12T22:49:53.526 INFO:tasks.workunit.client.0.smithi066.stdout:1/28: creat d0/f7 x:0 0 0 2024-09-12T22:49:53.526 INFO:tasks.workunit.client.0.smithi066.stdout:9/15: rename f5 to f7 0 2024-09-12T22:49:53.526 INFO:tasks.workunit.client.0.smithi066.stdout:4/35: symlink d5/d9/lf 0 2024-09-12T22:49:53.527 INFO:tasks.workunit.client.0.smithi066.stdout:8/56: mknod c14 0 2024-09-12T22:49:53.527 INFO:tasks.workunit.client.0.smithi066.stdout:5/124: truncate d5/d11/f1d 483962 0 2024-09-12T22:49:53.528 INFO:tasks.workunit.client.0.smithi066.stdout:5/125: mknod d5/d14/c22 0 2024-09-12T22:49:53.529 INFO:tasks.workunit.client.0.smithi066.stdout:9/16: dread f6 [0,4194304] 0 2024-09-12T22:49:53.529 INFO:tasks.workunit.client.0.smithi066.stdout:2/59: dwrite d1/f6 [0,4194304] 0 2024-09-12T22:49:53.530 INFO:tasks.workunit.client.0.smithi066.stdout:2/60: write d1/f4 [4963049,119377] 0 2024-09-12T22:49:53.531 INFO:tasks.workunit.client.0.smithi066.stdout:9/17: unlink l3 0 2024-09-12T22:49:53.531 INFO:tasks.workunit.client.0.smithi066.stdout:9/18: dread - f7 zero size 2024-09-12T22:49:53.532 INFO:tasks.workunit.client.0.smithi066.stdout:2/61: mknod d1/dd/ce 0 2024-09-12T22:49:53.532 INFO:tasks.workunit.client.0.smithi066.stdout:9/19: chown f7 479010 1 2024-09-12T22:49:53.532 INFO:tasks.workunit.client.0.smithi066.stdout:2/62: write d1/f8 [2862841,107012] 0 2024-09-12T22:49:53.533 INFO:tasks.workunit.client.0.smithi066.stdout:8/57: dwrite fa [0,4194304] 0 2024-09-12T22:49:53.535 INFO:tasks.workunit.client.0.smithi066.stdout:2/63: write d1/f8 [1293072,123128] 0 2024-09-12T22:49:53.535 INFO:tasks.workunit.client.0.smithi066.stdout:8/58: creat f15 x:0 0 0 2024-09-12T22:49:53.535 INFO:tasks.workunit.client.0.smithi066.stdout:2/64: readlink d1/la 0 2024-09-12T22:49:53.536 INFO:tasks.workunit.client.0.smithi066.stdout:6/56: dread f1 [0,4194304] 0 2024-09-12T22:49:53.536 INFO:tasks.workunit.client.0.smithi066.stdout:8/59: write f15 [426535,67829] 0 2024-09-12T22:49:53.538 INFO:tasks.workunit.client.0.smithi066.stdout:0/61: dread d1/f2 [0,4194304] 0 2024-09-12T22:49:53.538 INFO:tasks.workunit.client.0.smithi066.stdout:1/29: fsync d0/f7 0 2024-09-12T22:49:53.538 INFO:tasks.workunit.client.0.smithi066.stdout:4/36: rename d5/d9 to d5/d8/d10 0 2024-09-12T22:49:53.538 INFO:tasks.workunit.client.0.smithi066.stdout:6/57: mkdir d6/d7/dc 0 2024-09-12T22:49:53.538 INFO:tasks.workunit.client.0.smithi066.stdout:0/62: dread - d1/f7 zero size 2024-09-12T22:49:53.539 INFO:tasks.workunit.client.0.smithi066.stdout:8/60: creat f16 x:0 0 0 2024-09-12T22:49:53.539 INFO:tasks.workunit.client.0.smithi066.stdout:2/65: rename c0 to d1/dd/cf 0 2024-09-12T22:49:53.539 INFO:tasks.workunit.client.0.smithi066.stdout:4/37: write f1 [4126431,957] 0 2024-09-12T22:49:53.540 INFO:tasks.workunit.client.0.smithi066.stdout:9/20: dwrite f7 [0,4194304] 0 2024-09-12T22:49:53.541 INFO:tasks.workunit.client.0.smithi066.stdout:8/61: unlink lf 0 2024-09-12T22:49:53.541 INFO:tasks.workunit.client.0.smithi066.stdout:4/38: stat f1 0 2024-09-12T22:49:53.542 INFO:tasks.workunit.client.0.smithi066.stdout:2/66: symlink d1/dd/l10 0 2024-09-12T22:49:53.542 INFO:tasks.workunit.client.0.smithi066.stdout:0/63: write d1/d8/fe [1074826,61486] 0 2024-09-12T22:49:53.543 INFO:tasks.workunit.client.0.smithi066.stdout:6/58: truncate d6/d7/fa 1094456 0 2024-09-12T22:49:53.543 INFO:tasks.workunit.client.0.smithi066.stdout:4/39: unlink d5/f7 0 2024-09-12T22:49:53.544 INFO:tasks.workunit.client.0.smithi066.stdout:6/59: chown f1 32970 1 2024-09-12T22:49:53.544 INFO:tasks.workunit.client.0.smithi066.stdout:7/50: sync 2024-09-12T22:49:53.545 INFO:tasks.workunit.client.0.smithi066.stdout:4/40: unlink l4 0 2024-09-12T22:49:53.545 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:53.544+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:53.546 INFO:tasks.workunit.client.0.smithi066.stdout:0/64: creat d1/d12/f17 x:0 0 0 2024-09-12T22:49:53.546 INFO:tasks.workunit.client.0.smithi066.stdout:0/65: sync 2024-09-12T22:49:53.546 INFO:tasks.workunit.client.0.smithi066.stdout:9/21: dread f6 [0,4194304] 0 2024-09-12T22:49:53.547 INFO:tasks.workunit.client.0.smithi066.stdout:3/33: dread d0/d2/d6/f9 [0,4194304] 0 2024-09-12T22:49:53.548 INFO:tasks.workunit.client.0.smithi066.stdout:4/41: mknod d5/c11 0 2024-09-12T22:49:53.548 INFO:tasks.workunit.client.0.smithi066.stdout:7/51: creat d0/d6/f9 x:0 0 0 2024-09-12T22:49:53.549 INFO:tasks.workunit.client.0.smithi066.stdout:3/34: mknod d0/cb 0 2024-09-12T22:49:53.550 INFO:tasks.workunit.client.0.smithi066.stdout:9/22: write f7 [1825431,65175] 0 2024-09-12T22:49:53.550 INFO:tasks.workunit.client.0.smithi066.stdout:4/42: creat d5/d8/f12 x:0 0 0 2024-09-12T22:49:53.551 INFO:tasks.workunit.client.0.smithi066.stdout:5/126: dwrite d5/d11/f1b [0,4194304] 0 2024-09-12T22:49:53.551 INFO:tasks.workunit.client.0.smithi066.stdout:1/30: dread d0/f2 [0,4194304] 0 2024-09-12T22:49:53.551 INFO:tasks.workunit.client.0.smithi066.stdout:8/62: dwrite fa [4194304,4194304] 0 2024-09-12T22:49:53.554 INFO:tasks.workunit.client.0.smithi066.stdout:5/127: read f4 [3635266,906] 0 2024-09-12T22:49:53.556 INFO:tasks.workunit.client.0.smithi066.stdout:2/67: truncate d1/f8 988184 0 2024-09-12T22:49:53.557 INFO:tasks.workunit.client.0.smithi066.stdout:1/31: rmdir d0 39 2024-09-12T22:49:53.560 INFO:tasks.workunit.client.0.smithi066.stdout:9/23: dread f6 [0,4194304] 0 2024-09-12T22:49:53.560 INFO:tasks.workunit.client.0.smithi066.stdout:2/68: chown d1/dd/l10 42481655 1 2024-09-12T22:49:53.561 INFO:tasks.workunit.client.0.smithi066.stdout:3/35: write d0/d2/d6/f9 [1288353,50106] 0 2024-09-12T22:49:53.561 INFO:tasks.workunit.client.0.smithi066.stdout:6/60: dwrite d6/d7/fa [0,4194304] 0 2024-09-12T22:49:53.563 INFO:tasks.workunit.client.0.smithi066.stdout:5/128: fdatasync d5/f12 0 2024-09-12T22:49:53.563 INFO:tasks.workunit.client.0.smithi066.stdout:7/52: dwrite d0/f5 [0,4194304] 0 2024-09-12T22:49:53.564 INFO:tasks.workunit.client.0.smithi066.stdout:4/43: truncate f1 3426394 0 2024-09-12T22:49:53.564 INFO:tasks.workunit.client.0.smithi066.stdout:0/66: dwrite d1/f10 [0,4194304] 0 2024-09-12T22:49:53.565 INFO:tasks.workunit.client.0.smithi066.stdout:2/69: mkdir d1/d11 0 2024-09-12T22:49:53.568 INFO:tasks.workunit.client.0.smithi066.stdout:4/44: stat d5/d8/d10/de 0 2024-09-12T22:49:53.568 INFO:tasks.workunit.client.0.smithi066.stdout:8/63: dwrite fa [0,4194304] 0 2024-09-12T22:49:53.569 INFO:tasks.workunit.client.0.smithi066.stdout:3/36: write d0/d2/d6/f9 [2018152,99801] 0 2024-09-12T22:49:53.569 INFO:tasks.workunit.client.0.smithi066.stdout:6/61: getdents d6 0 2024-09-12T22:49:53.571 INFO:tasks.workunit.client.0.smithi066.stdout:4/45: chown d5/c6 208 1 2024-09-12T22:49:53.571 INFO:tasks.workunit.client.0.smithi066.stdout:1/32: rename d0/f2 to d0/f8 0 2024-09-12T22:49:53.571 INFO:tasks.workunit.client.0.smithi066.stdout:0/67: mknod d1/d12/dd/c18 0 2024-09-12T22:49:53.571 INFO:tasks.workunit.client.0.smithi066.stdout:3/37: chown d0/cb 5558 1 2024-09-12T22:49:53.573 INFO:tasks.workunit.client.0.smithi066.stdout:2/70: mkdir d1/dd/d12 0 2024-09-12T22:49:53.573 INFO:tasks.workunit.client.0.smithi066.stdout:9/24: dread f7 [0,4194304] 0 2024-09-12T22:49:53.576 INFO:tasks.workunit.client.0.smithi066.stdout:0/68: mknod d1/d8/c19 0 2024-09-12T22:49:53.576 INFO:tasks.workunit.client.0.smithi066.stdout:6/62: dread f1 [0,4194304] 0 2024-09-12T22:49:53.579 INFO:tasks.workunit.client.0.smithi066.stdout:3/38: creat d0/d2/d7/fc x:0 0 0 2024-09-12T22:49:53.579 INFO:tasks.workunit.client.0.smithi066.stdout:2/71: symlink d1/d11/l13 0 2024-09-12T22:49:53.580 INFO:tasks.workunit.client.0.smithi066.stdout:5/129: dwrite f4 [0,4194304] 0 2024-09-12T22:49:53.580 INFO:tasks.workunit.client.0.smithi066.stdout:6/63: symlink d6/d7/ld 0 2024-09-12T22:49:53.580 INFO:tasks.workunit.client.0.smithi066.stdout:8/64: dread fa [4194304,4194304] 0 2024-09-12T22:49:53.581 INFO:tasks.workunit.client.0.smithi066.stdout:7/53: dwrite d0/d6/f9 [0,4194304] 0 2024-09-12T22:49:53.582 INFO:tasks.workunit.client.0.smithi066.stdout:9/25: getdents . 0 2024-09-12T22:49:53.582 INFO:tasks.workunit.client.0.smithi066.stdout:5/130: write f4 [2209890,19937] 0 2024-09-12T22:49:53.582 INFO:tasks.workunit.client.0.smithi066.stdout:2/72: creat d1/dd/f14 x:0 0 0 2024-09-12T22:49:53.584 INFO:tasks.workunit.client.0.smithi066.stdout:3/39: creat d0/d2/d6/fd x:0 0 0 2024-09-12T22:49:53.584 INFO:tasks.workunit.client.0.smithi066.stdout:9/26: truncate f6 1612884 0 2024-09-12T22:49:53.585 INFO:tasks.workunit.client.0.smithi066.stdout:4/46: dread f1 [0,4194304] 0 2024-09-12T22:49:53.585 INFO:tasks.workunit.client.0.smithi066.stdout:1/33: dwrite d0/f7 [0,4194304] 0 2024-09-12T22:49:53.585 INFO:tasks.workunit.client.0.smithi066.stdout:3/40: readlink d0/l5 0 2024-09-12T22:49:53.586 INFO:tasks.workunit.client.0.smithi066.stdout:8/65: getdents . 0 2024-09-12T22:49:53.586 INFO:tasks.workunit.client.0.smithi066.stdout:7/54: dread d0/d6/f8 [0,4194304] 0 2024-09-12T22:49:53.587 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:53.587 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:53.587 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:49:53.587 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:49:53.588 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:53.588 INFO:tasks.workunit.client.0.smithi066.stdout:7/55: readlink d0/d6/l7 0 2024-09-12T22:49:53.588 INFO:tasks.workunit.client.0.smithi066.stdout:0/69: truncate d1/f2 895700 0 2024-09-12T22:49:53.589 INFO:tasks.workunit.client.0.smithi066.stdout:4/47: write d5/d8/f12 [298590,33132] 0 2024-09-12T22:49:53.590 INFO:tasks.workunit.client.0.smithi066.stdout:7/56: mkdir d0/d6/da 0 2024-09-12T22:49:53.590 INFO:tasks.workunit.client.0.smithi066.stdout:3/41: chown d0/cb 88779288 1 2024-09-12T22:49:53.590 INFO:tasks.workunit.client.0.smithi066.stdout:6/64: dread d6/d7/fa [0,4194304] 0 2024-09-12T22:49:53.591 INFO:tasks.workunit.client.0.smithi066.stdout:8/66: write f13 [3013598,71468] 0 2024-09-12T22:49:53.591 INFO:tasks.workunit.client.0.smithi066.stdout:0/70: write d1/f7 [853497,130082] 0 2024-09-12T22:49:53.593 INFO:tasks.workunit.client.0.smithi066.stdout:9/27: truncate f7 2638913 0 2024-09-12T22:49:53.593 INFO:tasks.workunit.client.0.smithi066.stdout:8/67: unlink c12 0 2024-09-12T22:49:53.593 INFO:tasks.workunit.client.0.smithi066.stdout:3/42: mknod d0/d2/d7/ce 0 2024-09-12T22:49:53.594 INFO:tasks.workunit.client.0.smithi066.stdout:2/73: dread d1/f3 [0,4194304] 0 2024-09-12T22:49:53.594 INFO:tasks.workunit.client.0.smithi066.stdout:4/48: link d5/c11 d5/d8/d10/de/c13 0 2024-09-12T22:49:53.595 INFO:tasks.workunit.client.0.smithi066.stdout:0/71: truncate d1/f10 4951312 0 2024-09-12T22:49:53.596 INFO:tasks.workunit.client.0.smithi066.stdout:3/43: symlink d0/d2/d7/lf 0 2024-09-12T22:49:53.596 INFO:tasks.workunit.client.0.smithi066.stdout:2/74: rename d1 to d1/db/d15 22 2024-09-12T22:49:53.597 INFO:tasks.workunit.client.0.smithi066.stdout:9/28: write f6 [764884,126694] 0 2024-09-12T22:49:53.597 INFO:tasks.workunit.client.0.smithi066.stdout:4/49: creat d5/d8/d10/de/f14 x:0 0 0 2024-09-12T22:49:53.597 INFO:tasks.workunit.client.0.smithi066.stdout:0/72: readlink d1/d12/d13/l16 0 2024-09-12T22:49:53.598 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:49:53.598 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:49:53.598 INFO:tasks.workunit.client.0.smithi066.stdout:5/131: dwrite d5/d15/f1a [0,4194304] 0 2024-09-12T22:49:53.599 INFO:tasks.workunit.client.0.smithi066.stdout:2/75: creat d1/d11/f16 x:0 0 0 2024-09-12T22:49:53.599 INFO:tasks.workunit.client.0.smithi066.stdout:1/34: dwrite d0/f8 [4194304,4194304] 0 2024-09-12T22:49:53.599 INFO:tasks.workunit.client.0.smithi066.stdout:9/29: getdents . 0 2024-09-12T22:49:53.599 INFO:tasks.workunit.client.0.smithi066.stdout:3/44: chown d0/d2/c4 805440 1 2024-09-12T22:49:53.600 INFO:tasks.workunit.client.0.smithi066.stdout:3/45: readlink d0/l5 0 2024-09-12T22:49:53.601 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:53.602 INFO:tasks.workunit.client.0.smithi066.stdout:5/132: write f3 [5149849,40252] 0 2024-09-12T22:49:53.602 INFO:tasks.workunit.client.0.smithi066.stdout:3/46: symlink d0/l10 0 2024-09-12T22:49:53.602 INFO:tasks.workunit.client.0.smithi066.stdout:9/30: getdents . 0 2024-09-12T22:49:53.603 INFO:tasks.workunit.client.0.smithi066.stdout:2/76: write d1/d11/f16 [16821,100898] 0 2024-09-12T22:49:53.604 INFO:tasks.workunit.client.0.smithi066.stdout:5/133: read d5/f12 [73419,39136] 0 2024-09-12T22:49:53.605 INFO:tasks.workunit.client.0.smithi066.stdout:8/68: mkdir d17 0 2024-09-12T22:49:53.606 INFO:tasks.workunit.client.0.smithi066.stdout:7/57: truncate d0/d6/f9 2914965 0 2024-09-12T22:49:53.607 INFO:tasks.workunit.client.0.smithi066.stdout:3/47: creat d0/d2/d7/f11 x:0 0 0 2024-09-12T22:49:53.608 INFO:tasks.workunit.client.0.smithi066.stdout:8/69: stat f13 0 2024-09-12T22:49:53.608 INFO:tasks.workunit.client.0.smithi066.stdout:5/134: write d5/d11/f1d [258004,16889] 0 2024-09-12T22:49:53.609 INFO:tasks.workunit.client.0.smithi066.stdout:7/58: mknod d0/d6/cb 0 2024-09-12T22:49:53.610 INFO:tasks.workunit.client.0.smithi066.stdout:1/35: dread d0/f7 [0,4194304] 0 2024-09-12T22:49:53.610 INFO:tasks.workunit.client.0.smithi066.stdout:2/77: mknod d1/db/c17 0 2024-09-12T22:49:53.610 INFO:tasks.workunit.client.0.smithi066.stdout:0/73: dwrite d1/d12/f17 [0,4194304] 0 2024-09-12T22:49:53.610 INFO:tasks.workunit.client.0.smithi066.stdout:8/70: fsync f11 0 2024-09-12T22:49:53.610 INFO:tasks.workunit.client.0.smithi066.stdout:4/50: dwrite d5/d8/d10/de/f14 [0,4194304] 0 2024-09-12T22:49:53.611 INFO:tasks.workunit.client.0.smithi066.stdout:7/59: chown d0/d6/f9 1031801166 1 2024-09-12T22:49:53.612 INFO:tasks.workunit.client.0.smithi066.stdout:4/51: rmdir d5/d8/d10/de 39 2024-09-12T22:49:53.613 INFO:tasks.workunit.client.0.smithi066.stdout:8/71: dread - f16 zero size 2024-09-12T22:49:53.613 INFO:tasks.workunit.client.0.smithi066.stdout:2/78: mkdir d1/dd/d12/d18 0 2024-09-12T22:49:53.617 INFO:tasks.workunit.client.0.smithi066.stdout:9/31: write f7 [1635644,98590] 0 2024-09-12T22:49:53.619 INFO:tasks.workunit.client.0.smithi066.stdout:8/72: symlink d17/l18 0 2024-09-12T22:49:53.620 INFO:tasks.workunit.client.0.smithi066.stdout:2/79: write d1/f3 [1554603,51474] 0 2024-09-12T22:49:53.620 INFO:tasks.workunit.client.0.smithi066.stdout:9/32: fsync f7 0 2024-09-12T22:49:53.622 INFO:tasks.workunit.client.0.smithi066.stdout:4/52: symlink d5/d8/d10/de/l15 0 2024-09-12T22:49:53.624 INFO:tasks.workunit.client.0.smithi066.stdout:8/73: symlink d17/l19 0 2024-09-12T22:49:53.624 INFO:tasks.workunit.client.0.smithi066.stdout:6/65: sync 2024-09-12T22:49:53.625 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:49:53.625 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:49:53.625 INFO:tasks.workunit.client.0.smithi066.stdout:3/48: dwrite d0/d2/fa [0,4194304] 0 2024-09-12T22:49:53.626 INFO:tasks.workunit.client.0.smithi066.stdout:9/33: chown l4 31063703 1 2024-09-12T22:49:53.626 INFO:tasks.workunit.client.0.smithi066.stdout:2/80: fdatasync d1/f8 0 2024-09-12T22:49:53.626 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:49:53.628 INFO:tasks.workunit.client.0.smithi066.stdout:1/36: dwrite d0/f8 [4194304,4194304] 0 2024-09-12T22:49:53.629 INFO:tasks.workunit.client.0.smithi066.stdout:6/66: symlink d6/d7/le 0 2024-09-12T22:49:53.631 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:49:53.631 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:49:53.632 INFO:tasks.workunit.client.0.smithi066.stdout:1/37: rmdir d0 39 2024-09-12T22:49:53.632 INFO:tasks.workunit.client.0.smithi066.stdout:0/74: dwrite d1/d12/f17 [0,4194304] 0 2024-09-12T22:49:53.632 INFO:tasks.workunit.client.0.smithi066.stdout:9/34: link f6 f8 0 2024-09-12T22:49:53.632 INFO:tasks.workunit.client.0.smithi066.stdout:7/60: dwrite d0/f3 [4194304,4194304] 0 2024-09-12T22:49:53.633 INFO:tasks.workunit.client.0.smithi066.stdout:3/49: truncate d0/d2/d6/fd 193837 0 2024-09-12T22:49:53.633 INFO:tasks.workunit.client.0.smithi066.stdout:5/135: dwrite f4 [0,4194304] 0 2024-09-12T22:49:53.633 INFO:tasks.workunit.client.0.smithi066.stdout:9/35: chown f8 1143 1 2024-09-12T22:49:53.633 INFO:tasks.workunit.client.0.smithi066.stdout:4/53: dread f1 [0,4194304] 0 2024-09-12T22:49:53.634 INFO:tasks.workunit.client.0.smithi066.stdout:1/38: mkdir d0/d9 0 2024-09-12T22:49:53.634 INFO:tasks.workunit.client.0.smithi066.stdout:7/61: mkdir d0/dc 0 2024-09-12T22:49:53.635 INFO:tasks.workunit.client.0.smithi066.stdout:9/36: mkdir d9 0 2024-09-12T22:49:53.635 INFO:tasks.workunit.client.0.smithi066.stdout:1/39: fsync d0/f6 0 2024-09-12T22:49:53.635 INFO:tasks.workunit.client.0.smithi066.stdout:5/136: mkdir d5/d11/d23 0 2024-09-12T22:49:53.636 INFO:tasks.workunit.client.0.smithi066.stdout:8/74: dread f13 [0,4194304] 0 2024-09-12T22:49:53.637 INFO:tasks.workunit.client.0.smithi066.stdout:0/75: rename d1/d8/f15 to d1/f1a 0 2024-09-12T22:49:53.638 INFO:tasks.workunit.client.0.smithi066.stdout:4/54: mkdir d5/d8/d16 0 2024-09-12T22:49:53.638 INFO:tasks.workunit.client.0.smithi066.stdout:5/137: chown d5/de/l18 55098 1 2024-09-12T22:49:53.638 INFO:tasks.workunit.client.0.smithi066.stdout:2/81: dwrite d1/f6 [0,4194304] 0 2024-09-12T22:49:53.639 INFO:tasks.workunit.client.0.smithi066.stdout:8/75: dread - f16 zero size 2024-09-12T22:49:53.640 INFO:tasks.workunit.client.0.smithi066.stdout:1/40: mknod d0/d9/ca 0 2024-09-12T22:49:53.643 INFO:tasks.workunit.client.0.smithi066.stdout:6/67: dwrite f2 [0,4194304] 0 2024-09-12T22:49:53.644 INFO:tasks.workunit.client.0.smithi066.stdout:8/76: write f13 [8575496,75842] 0 2024-09-12T22:49:53.649 INFO:tasks.workunit.client.0.smithi066.stdout:2/82: dread d1/f8 [0,4194304] 0 2024-09-12T22:49:53.649 INFO:tasks.workunit.client.0.smithi066.stdout:6/68: write d6/fb [528685,13427] 0 2024-09-12T22:49:53.649 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:53.648+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:53.650 INFO:tasks.workunit.client.0.smithi066.stdout:4/55: dread f1 [0,4194304] 0 2024-09-12T22:49:53.650 INFO:tasks.workunit.client.0.smithi066.stdout:2/83: creat d1/d11/f19 x:0 0 0 2024-09-12T22:49:53.651 INFO:tasks.workunit.client.0.smithi066.stdout:7/62: dwrite d0/f5 [0,4194304] 0 2024-09-12T22:49:53.653 INFO:tasks.workunit.client.0.smithi066.stdout:9/37: dwrite f6 [0,4194304] 0 2024-09-12T22:49:53.653 INFO:tasks.workunit.client.0.smithi066.stdout:5/138: dwrite d5/f9 [0,4194304] 0 2024-09-12T22:49:53.655 INFO:tasks.workunit.client.0.smithi066.stdout:4/56: rename d5/d8/ld to d5/d8/l17 0 2024-09-12T22:49:53.655 INFO:tasks.workunit.client.0.smithi066.stdout:2/84: rename d1/d11/l13 to d1/dd/d12/d18/l1a 0 2024-09-12T22:49:53.656 INFO:tasks.workunit.client.0.smithi066.stdout:1/41: dwrite d0/f7 [0,4194304] 0 2024-09-12T22:49:53.657 INFO:tasks.workunit.client.0.smithi066.stdout:5/139: creat d5/f24 x:0 0 0 2024-09-12T22:49:53.659 INFO:tasks.workunit.client.0.smithi066.stdout:4/57: creat d5/d8/d10/de/f18 x:0 0 0 2024-09-12T22:49:53.660 INFO:tasks.workunit.client.0.smithi066.stdout:8/77: dread fa [0,4194304] 0 2024-09-12T22:49:53.660 INFO:tasks.workunit.client.0.smithi066.stdout:1/42: write d0/f6 [1004073,78142] 0 2024-09-12T22:49:53.663 INFO:tasks.workunit.client.0.smithi066.stdout:4/58: creat d5/d8/f19 x:0 0 0 2024-09-12T22:49:53.663 INFO:tasks.workunit.client.0.smithi066.stdout:6/69: dwrite f2 [4194304,4194304] 0 2024-09-12T22:49:53.668 INFO:tasks.workunit.client.0.smithi066.stdout:7/63: dwrite d0/f3 [0,4194304] 0 2024-09-12T22:49:53.669 INFO:tasks.workunit.client.0.smithi066.stdout:9/38: dwrite f8 [0,4194304] 0 2024-09-12T22:49:53.670 INFO:tasks.workunit.client.0.smithi066.stdout:6/70: dread f1 [0,4194304] 0 2024-09-12T22:49:53.671 INFO:tasks.workunit.client.0.smithi066.stdout:7/64: fsync d0/d6/f9 0 2024-09-12T22:49:53.672 INFO:tasks.workunit.client.0.smithi066.stdout:5/140: dwrite d5/d15/f1a [0,4194304] 0 2024-09-12T22:49:53.672 INFO:tasks.workunit.client.0.smithi066.stdout:2/85: dwrite d1/f3 [0,4194304] 0 2024-09-12T22:49:53.673 INFO:tasks.workunit.client.0.smithi066.stdout:9/39: creat d9/fa x:0 0 0 2024-09-12T22:49:53.673 INFO:tasks.workunit.client.0.smithi066.stdout:6/71: fdatasync f1 0 2024-09-12T22:49:53.673 INFO:tasks.workunit.client.0.smithi066.stdout:7/65: rmdir d0/d6 39 2024-09-12T22:49:53.673 INFO:tasks.workunit.client.0.smithi066.stdout:8/78: dread f13 [0,4194304] 0 2024-09-12T22:49:53.674 INFO:tasks.workunit.client.0.smithi066.stdout:1/43: fdatasync d0/f7 0 2024-09-12T22:49:53.674 INFO:tasks.workunit.client.0.smithi066.stdout:5/141: stat d5/d11/d23 0 2024-09-12T22:49:53.675 INFO:tasks.workunit.client.0.smithi066.stdout:5/142: fsync f4 0 2024-09-12T22:49:53.676 INFO:tasks.workunit.client.0.smithi066.stdout:1/44: write d0/f8 [8506375,84889] 0 2024-09-12T22:49:53.676 INFO:tasks.workunit.client.0.smithi066.stdout:9/40: rename f6 to d9/fb 0 2024-09-12T22:49:53.677 INFO:tasks.workunit.client.0.smithi066.stdout:7/66: unlink d0/d6/cb 0 2024-09-12T22:49:53.678 INFO:tasks.workunit.client.0.smithi066.stdout:4/59: dwrite d5/d8/d10/de/f14 [0,4194304] 0 2024-09-12T22:49:53.679 INFO:tasks.workunit.client.0.smithi066.stdout:1/45: write d0/f6 [482436,67350] 0 2024-09-12T22:49:53.679 INFO:tasks.workunit.client.0.smithi066.stdout:9/41: mkdir d9/dc 0 2024-09-12T22:49:53.681 INFO:tasks.workunit.client.0.smithi066.stdout:1/46: write d0/f6 [1725708,68320] 0 2024-09-12T22:49:53.681 INFO:tasks.workunit.client.0.smithi066.stdout:4/60: read - d5/d8/d10/de/f18 zero size 2024-09-12T22:49:53.682 INFO:tasks.workunit.client.0.smithi066.stdout:2/86: dread d1/f3 [0,4194304] 0 2024-09-12T22:49:53.683 INFO:tasks.workunit.client.0.smithi066.stdout:8/79: dread fa [4194304,4194304] 0 2024-09-12T22:49:53.684 INFO:tasks.workunit.client.0.smithi066.stdout:8/80: symlink d17/l1a 0 2024-09-12T22:49:53.685 INFO:tasks.workunit.client.0.smithi066.stdout:5/143: dread f3 [0,4194304] 0 2024-09-12T22:49:53.685 INFO:tasks.workunit.client.0.smithi066.stdout:6/72: dwrite f2 [0,4194304] 0 2024-09-12T22:49:53.685 INFO:tasks.workunit.client.0.smithi066.stdout:4/61: write d5/d8/f12 [613481,8778] 0 2024-09-12T22:49:53.686 INFO:tasks.workunit.client.0.smithi066.stdout:8/81: mkdir d17/d1b 0 2024-09-12T22:49:53.687 INFO:tasks.workunit.client.0.smithi066.stdout:4/62: write d5/d8/f19 [264886,4843] 0 2024-09-12T22:49:53.687 INFO:tasks.workunit.client.0.smithi066.stdout:5/144: chown c0 8 1 2024-09-12T22:49:53.687 INFO:tasks.workunit.client.0.smithi066.stdout:9/42: dread d9/fb [0,4194304] 0 2024-09-12T22:49:53.688 INFO:tasks.workunit.client.0.smithi066.stdout:7/67: dwrite d0/d6/f8 [0,4194304] 0 2024-09-12T22:49:53.688 INFO:tasks.workunit.client.0.smithi066.stdout:5/145: rename d5 to d5/d15/d25 22 2024-09-12T22:49:53.689 INFO:tasks.workunit.client.0.smithi066.stdout:9/43: mkdir d9/dc/dd 0 2024-09-12T22:49:53.689 INFO:tasks.workunit.client.0.smithi066.stdout:2/87: dread d1/f3 [0,4194304] 0 2024-09-12T22:49:53.690 INFO:tasks.workunit.client.0.smithi066.stdout:5/146: rename c1 to d5/d11/d21/c26 0 2024-09-12T22:49:53.691 INFO:tasks.workunit.client.0.smithi066.stdout:9/44: link f8 d9/dc/fe 0 2024-09-12T22:49:53.692 INFO:tasks.workunit.client.0.smithi066.stdout:9/45: rename d9 to d9/df 22 2024-09-12T22:49:53.692 INFO:tasks.workunit.client.0.smithi066.stdout:2/88: unlink d1/dd/cf 0 2024-09-12T22:49:53.692 INFO:tasks.workunit.client.0.smithi066.stdout:5/147: write d5/d11/f1b [4730385,36020] 0 2024-09-12T22:49:53.692 INFO:tasks.workunit.client.0.smithi066.stdout:9/46: readlink l4 0 2024-09-12T22:49:53.692 INFO:tasks.workunit.client.0.smithi066.stdout:8/82: dread f13 [4194304,4194304] 0 2024-09-12T22:49:53.693 INFO:tasks.workunit.client.0.smithi066.stdout:7/68: dread d0/f3 [0,4194304] 0 2024-09-12T22:49:53.693 INFO:tasks.workunit.client.0.smithi066.stdout:8/83: fsync f15 0 2024-09-12T22:49:53.694 INFO:tasks.workunit.client.0.smithi066.stdout:9/47: creat d9/dc/f10 x:0 0 0 2024-09-12T22:49:53.694 INFO:tasks.workunit.client.0.smithi066.stdout:4/63: dread d5/d8/d10/de/f14 [0,4194304] 0 2024-09-12T22:49:53.694 INFO:tasks.workunit.client.0.smithi066.stdout:5/148: mknod d5/d11/d23/c27 0 2024-09-12T22:49:53.694 INFO:tasks.workunit.client.0.smithi066.stdout:7/69: symlink d0/ld 0 2024-09-12T22:49:53.694 INFO:tasks.workunit.client.0.smithi066.stdout:8/84: symlink d17/l1c 0 2024-09-12T22:49:53.695 INFO:tasks.workunit.client.0.smithi066.stdout:5/149: write d5/d15/f17 [2571534,114793] 0 2024-09-12T22:49:53.695 INFO:tasks.workunit.client.0.smithi066.stdout:9/48: creat d9/dc/dd/f11 x:0 0 0 2024-09-12T22:49:53.696 INFO:tasks.workunit.client.0.smithi066.stdout:9/49: readlink l4 0 2024-09-12T22:49:53.696 INFO:tasks.workunit.client.0.smithi066.stdout:8/85: rename d17/l19 to d17/d1b/l1d 0 2024-09-12T22:49:53.696 INFO:tasks.workunit.client.0.smithi066.stdout:4/64: creat d5/d8/d10/f1a x:0 0 0 2024-09-12T22:49:53.697 INFO:tasks.workunit.client.0.smithi066.stdout:5/150: creat d5/d14/f28 x:0 0 0 2024-09-12T22:49:53.697 INFO:tasks.workunit.client.0.smithi066.stdout:9/50: creat d9/dc/f12 x:0 0 0 2024-09-12T22:49:53.699 INFO:tasks.workunit.client.0.smithi066.stdout:4/65: unlink d5/d8/l17 0 2024-09-12T22:49:53.699 INFO:tasks.workunit.client.0.smithi066.stdout:2/89: dwrite d1/f8 [0,4194304] 0 2024-09-12T22:49:53.699 INFO:tasks.workunit.client.0.smithi066.stdout:6/73: dread d6/fb [0,4194304] 0 2024-09-12T22:49:53.699 INFO:tasks.workunit.client.0.smithi066.stdout:1/47: fdatasync d0/f6 0 2024-09-12T22:49:53.700 INFO:tasks.workunit.client.0.smithi066.stdout:9/51: chown d9/dc/f12 3652 1 2024-09-12T22:49:53.701 INFO:tasks.workunit.client.0.smithi066.stdout:2/90: readlink d1/dd/l10 0 2024-09-12T22:49:53.701 INFO:tasks.workunit.client.0.smithi066.stdout:6/74: mkdir d6/df 0 2024-09-12T22:49:53.702 INFO:tasks.workunit.client.0.smithi066.stdout:4/66: dread - d5/d8/d10/de/f18 zero size 2024-09-12T22:49:53.703 INFO:tasks.workunit.client.0.smithi066.stdout:6/75: symlink d6/l10 0 2024-09-12T22:49:53.703 INFO:tasks.workunit.client.0.smithi066.stdout:0/76: dread d1/f7 [0,4194304] 0 2024-09-12T22:49:53.704 INFO:tasks.workunit.client.0.smithi066.stdout:7/70: dwrite d0/d6/f8 [0,4194304] 0 2024-09-12T22:49:53.705 INFO:tasks.workunit.client.0.smithi066.stdout:2/91: creat d1/dd/d12/f1b x:0 0 0 2024-09-12T22:49:53.705 INFO:tasks.workunit.client.0.smithi066.stdout:7/71: readlink d0/ld 0 2024-09-12T22:49:53.706 INFO:tasks.workunit.client.0.smithi066.stdout:8/86: dwrite f13 [0,4194304] 0 2024-09-12T22:49:53.706 INFO:tasks.workunit.client.0.smithi066.stdout:5/151: dread f3 [0,4194304] 0 2024-09-12T22:49:53.707 INFO:tasks.workunit.client.0.smithi066.stdout:6/76: fdatasync d6/d7/fa 0 2024-09-12T22:49:53.708 INFO:tasks.workunit.client.0.smithi066.stdout:5/152: write f4 [1036866,7813] 0 2024-09-12T22:49:53.708 INFO:tasks.workunit.client.0.smithi066.stdout:8/87: stat l5 0 2024-09-12T22:49:53.709 INFO:tasks.workunit.client.0.smithi066.stdout:2/92: fsync d1/f3 0 2024-09-12T22:49:53.709 INFO:tasks.workunit.client.0.smithi066.stdout:1/48: dread d0/f8 [0,4194304] 0 2024-09-12T22:49:53.709 INFO:tasks.workunit.client.0.smithi066.stdout:4/67: mkdir d5/d8/d16/d1b 0 2024-09-12T22:49:53.710 INFO:tasks.workunit.client.0.smithi066.stdout:0/77: mkdir d1/d8/d1b 0 2024-09-12T22:49:53.710 INFO:tasks.workunit.client.0.smithi066.stdout:1/49: stat d0/l5 0 2024-09-12T22:49:53.710 INFO:tasks.workunit.client.0.smithi066.stdout:7/72: rmdir d0/d6/da 0 2024-09-12T22:49:53.710 INFO:tasks.workunit.client.0.smithi066.stdout:6/77: creat d6/d7/f11 x:0 0 0 2024-09-12T22:49:53.710 INFO:tasks.workunit.client.0.smithi066.stdout:5/153: chown d5/la 2094436 1 2024-09-12T22:49:53.711 INFO:tasks.workunit.client.0.smithi066.stdout:8/88: truncate f15 90968 0 2024-09-12T22:49:53.711 INFO:tasks.workunit.client.0.smithi066.stdout:2/93: symlink d1/d11/l1c 0 2024-09-12T22:49:53.711 INFO:tasks.workunit.client.0.smithi066.stdout:4/68: rename d5/c6 to d5/c1c 0 2024-09-12T22:49:53.711 INFO:tasks.workunit.client.0.smithi066.stdout:7/73: read d0/d6/f8 [1085849,99647] 0 2024-09-12T22:49:53.712 INFO:tasks.workunit.client.0.smithi066.stdout:0/78: write d1/f7 [1674527,85990] 0 2024-09-12T22:49:53.712 INFO:tasks.workunit.client.0.smithi066.stdout:6/78: write d6/fb [1222137,65739] 0 2024-09-12T22:49:53.712 INFO:tasks.workunit.client.0.smithi066.stdout:9/52: dwrite d9/fb [0,4194304] 0 2024-09-12T22:49:53.713 INFO:tasks.workunit.client.0.smithi066.stdout:8/89: creat d17/d1b/f1e x:0 0 0 2024-09-12T22:49:53.713 INFO:tasks.workunit.client.0.smithi066.stdout:4/69: rename d5 to d5/d8/d1d 22 2024-09-12T22:49:53.713 INFO:tasks.workunit.client.0.smithi066.stdout:7/74: chown d0/ld 423074843 1 2024-09-12T22:49:53.714 INFO:tasks.workunit.client.0.smithi066.stdout:9/53: creat d9/dc/dd/f13 x:0 0 0 2024-09-12T22:49:53.714 INFO:tasks.workunit.client.0.smithi066.stdout:4/70: write d5/d8/f19 [1291313,51099] 0 2024-09-12T22:49:53.714 INFO:tasks.workunit.client.0.smithi066.stdout:0/79: rename d1/d12 to d1/d8/d1c 0 2024-09-12T22:49:53.715 INFO:tasks.workunit.client.0.smithi066.stdout:7/75: rename d0/d6/l7 to d0/dc/le 0 2024-09-12T22:49:53.716 INFO:tasks.workunit.client.0.smithi066.stdout:9/54: rename d9/dc/dd to d9/dc/dd/d14 22 2024-09-12T22:49:53.717 INFO:tasks.workunit.client.0.smithi066.stdout:1/50: dwrite d0/f7 [0,4194304] 0 2024-09-12T22:49:53.717 INFO:tasks.workunit.client.0.smithi066.stdout:7/76: creat d0/ff x:0 0 0 2024-09-12T22:49:53.718 INFO:tasks.workunit.client.0.smithi066.stdout:1/51: stat d0/f7 0 2024-09-12T22:49:53.718 INFO:tasks.workunit.client.0.smithi066.stdout:9/55: rename l4 to d9/dc/l15 0 2024-09-12T22:49:53.719 INFO:tasks.workunit.client.0.smithi066.stdout:1/52: chown d0/l5 42 1 2024-09-12T22:49:53.719 INFO:tasks.workunit.client.0.smithi066.stdout:9/56: read f7 [1642187,124908] 0 2024-09-12T22:49:53.719 INFO:tasks.workunit.client.0.smithi066.stdout:8/90: dwrite f11 [0,4194304] 0 2024-09-12T22:49:53.719 INFO:tasks.workunit.client.0.smithi066.stdout:7/77: rename d0/f3 to d0/d6/f10 0 2024-09-12T22:49:53.720 INFO:tasks.workunit.client.0.smithi066.stdout:9/57: mknod d9/c16 0 2024-09-12T22:49:53.720 INFO:tasks.workunit.client.0.smithi066.stdout:8/91: unlink f13 0 2024-09-12T22:49:53.720 INFO:tasks.workunit.client.0.smithi066.stdout:9/58: fsync d9/fa 0 2024-09-12T22:49:53.720 INFO:tasks.workunit.client.0.smithi066.stdout:1/53: chown d0/f6 1956831 1 2024-09-12T22:49:53.720 INFO:tasks.workunit.client.0.smithi066.stdout:7/78: rename d0/c2 to d0/dc/c11 0 2024-09-12T22:49:53.721 INFO:tasks.workunit.client.0.smithi066.stdout:1/54: chown d0/f7 21563 1 2024-09-12T22:49:53.721 INFO:tasks.workunit.client.0.smithi066.stdout:9/59: rmdir d9/dc 39 2024-09-12T22:49:53.722 INFO:tasks.workunit.client.0.smithi066.stdout:1/55: write d0/f6 [1970884,17250] 0 2024-09-12T22:49:53.722 INFO:tasks.workunit.client.0.smithi066.stdout:9/60: symlink d9/dc/l17 0 2024-09-12T22:49:53.722 INFO:tasks.workunit.client.0.smithi066.stdout:3/50: sync 2024-09-12T22:49:53.729 INFO:tasks.workunit.client.0.smithi066.stdout:7/79: fsync d0/d6/f8 0 2024-09-12T22:49:53.731 INFO:tasks.workunit.client.0.smithi066.stdout:6/79: dread d6/fb [0,4194304] 0 2024-09-12T22:49:53.732 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:53.732 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:53.733 INFO:tasks.workunit.client.0.smithi066.stdout:5/154: truncate d5/f9 2480444 0 2024-09-12T22:49:53.734 INFO:tasks.workunit.client.0.smithi066.stdout:2/94: truncate d1/f8 2903337 0 2024-09-12T22:49:53.735 INFO:tasks.workunit.client.0.smithi066.stdout:6/80: dread f1 [0,4194304] 0 2024-09-12T22:49:53.735 INFO:tasks.workunit.client.0.smithi066.stdout:1/56: read d0/f6 [1046144,99320] 0 2024-09-12T22:49:53.736 INFO:tasks.workunit.client.0.smithi066.stdout:4/71: dread d5/d8/f19 [0,4194304] 0 2024-09-12T22:49:53.736 INFO:tasks.workunit.client.0.smithi066.stdout:7/80: dwrite d0/d6/f9 [0,4194304] 0 2024-09-12T22:49:53.736 INFO:tasks.workunit.client.0.smithi066.stdout:2/95: write d1/dd/d12/f1b [216906,33096] 0 2024-09-12T22:49:53.738 INFO:tasks.workunit.client.0.smithi066.stdout:6/81: dread f1 [0,4194304] 0 2024-09-12T22:49:53.739 INFO:tasks.workunit.client.0.smithi066.stdout:6/82: dread - d6/d7/f11 zero size 2024-09-12T22:49:53.740 INFO:tasks.workunit.client.0.smithi066.stdout:5/155: dread f4 [0,4194304] 0 2024-09-12T22:49:53.740 INFO:tasks.workunit.client.0.smithi066.stdout:6/83: dread - d6/d7/f11 zero size 2024-09-12T22:49:53.742 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:53.745 INFO:tasks.workunit.client.0.smithi066.stdout:6/84: dwrite d6/d7/fa [0,4194304] 0 2024-09-12T22:49:53.745 INFO:tasks.workunit.client.0.smithi066.stdout:8/92: write f15 [1109595,34611] 0 2024-09-12T22:49:53.752 INFO:tasks.workunit.client.0.smithi066.stdout:3/51: rename d0/d2/d7/ce to d0/c12 0 2024-09-12T22:49:53.752 INFO:tasks.workunit.client.0.smithi066.stdout:4/72: fdatasync d5/d8/f19 0 2024-09-12T22:49:53.752 INFO:tasks.workunit.client.0.smithi066.stdout:2/96: symlink d1/dd/d12/l1d 0 2024-09-12T22:49:53.753 INFO:tasks.workunit.client.0.smithi066.stdout:6/85: creat d6/df/f12 x:0 0 0 2024-09-12T22:49:53.753 INFO:tasks.workunit.client.0.smithi066.stdout:5/156: mknod d5/c29 0 2024-09-12T22:49:53.754 INFO:tasks.workunit.client.0.smithi066.stdout:0/80: symlink d1/d8/d1c/dd/l1d 0 2024-09-12T22:49:53.754 INFO:tasks.workunit.client.0.smithi066.stdout:2/97: mkdir d1/dd/d12/d1e 0 2024-09-12T22:49:53.754 INFO:tasks.workunit.client.0.smithi066.stdout:3/52: truncate d0/d2/d7/f11 359189 0 2024-09-12T22:49:53.754 INFO:tasks.workunit.client.0.smithi066.stdout:6/86: unlink f2 0 2024-09-12T22:49:53.757 INFO:tasks.workunit.client.0.smithi066.stdout:5/157: write d5/de/ff [2134243,99223] 0 2024-09-12T22:49:53.759 INFO:tasks.workunit.client.0.smithi066.stdout:8/93: dread fa [0,4194304] 0 2024-09-12T22:49:53.760 INFO:tasks.workunit.client.0.smithi066.stdout:1/57: dwrite d0/f8 [4194304,4194304] 0 2024-09-12T22:49:53.761 INFO:tasks.workunit.client.0.smithi066.stdout:7/81: dwrite d0/f5 [4194304,4194304] 0 2024-09-12T22:49:53.761 INFO:tasks.workunit.client.0.smithi066.stdout:4/73: mkdir d5/d8/d16/d1b/d1e 0 2024-09-12T22:49:53.764 INFO:tasks.workunit.client.0.smithi066.stdout:0/81: creat d1/d8/d1c/d13/f1e x:0 0 0 2024-09-12T22:49:53.764 INFO:tasks.workunit.client.0.smithi066.stdout:1/58: dread d0/f8 [4194304,4194304] 0 2024-09-12T22:49:53.765 INFO:tasks.workunit.client.0.smithi066.stdout:3/53: mkdir d0/d2/d7/d13 0 2024-09-12T22:49:53.766 INFO:tasks.workunit.client.0.smithi066.stdout:1/59: write d0/f7 [4010834,83009] 0 2024-09-12T22:49:53.766 INFO:tasks.workunit.client.0.smithi066.stdout:3/54: chown d0/d2/fa 405101075 1 2024-09-12T22:49:53.769 INFO:tasks.workunit.client.0.smithi066.stdout:5/158: symlink d5/d11/d23/l2a 0 2024-09-12T22:49:53.769 INFO:tasks.workunit.client.0.smithi066.stdout:8/94: creat d17/f1f x:0 0 0 2024-09-12T22:49:53.769 INFO:tasks.workunit.client.0.smithi066.stdout:7/82: creat d0/dc/f12 x:0 0 0 2024-09-12T22:49:53.769 INFO:tasks.workunit.client.0.smithi066.stdout:6/87: creat d6/d7/dc/f13 x:0 0 0 2024-09-12T22:49:53.769 INFO:tasks.workunit.client.0.smithi066.stdout:4/74: mkdir d5/d8/d16/d1b/d1e/d1f 0 2024-09-12T22:49:53.769 INFO:tasks.workunit.client.0.smithi066.stdout:1/60: rename d0/f8 to d0/d9/fb 0 2024-09-12T22:49:53.770 INFO:tasks.workunit.client.0.smithi066.stdout:3/55: creat d0/d2/d7/d13/f14 x:0 0 0 2024-09-12T22:49:53.770 INFO:tasks.workunit.client.0.smithi066.stdout:5/159: truncate d5/de/ff 5197623 0 2024-09-12T22:49:53.770 INFO:tasks.workunit.client.0.smithi066.stdout:6/88: rmdir d6/d7 39 2024-09-12T22:49:53.770 INFO:tasks.workunit.client.0.smithi066.stdout:1/61: fdatasync d0/f6 0 2024-09-12T22:49:53.770 INFO:tasks.workunit.client.0.smithi066.stdout:7/83: symlink d0/l13 0 2024-09-12T22:49:53.771 INFO:tasks.workunit.client.0.smithi066.stdout:3/56: stat d0/d2/d7/d13 0 2024-09-12T22:49:53.771 INFO:tasks.workunit.client.0.smithi066.stdout:5/160: creat d5/d11/d23/f2b x:0 0 0 2024-09-12T22:49:53.771 INFO:tasks.workunit.client.0.smithi066.stdout:1/62: mkdir d0/dc 0 2024-09-12T22:49:53.772 INFO:tasks.workunit.client.0.smithi066.stdout:1/63: chown d0/c3 736420 1 2024-09-12T22:49:53.772 INFO:tasks.workunit.client.0.smithi066.stdout:6/89: truncate d6/d7/dc/f13 623443 0 2024-09-12T22:49:53.772 INFO:tasks.workunit.client.0.smithi066.stdout:7/84: truncate d0/d6/f8 2769936 0 2024-09-12T22:49:53.772 INFO:tasks.workunit.client.0.smithi066.stdout:9/61: sync 2024-09-12T22:49:53.773 INFO:tasks.workunit.client.0.smithi066.stdout:7/85: mknod d0/d6/c14 0 2024-09-12T22:49:53.773 INFO:tasks.workunit.client.0.smithi066.stdout:9/62: dread - d9/dc/dd/f13 zero size 2024-09-12T22:49:53.775 INFO:tasks.workunit.client.0.smithi066.stdout:9/63: creat d9/dc/dd/f18 x:0 0 0 2024-09-12T22:49:53.775 INFO:tasks.workunit.client.0.smithi066.stdout:6/90: link d6/d7/l9 d6/d7/l14 0 2024-09-12T22:49:53.776 INFO:tasks.workunit.client.0.smithi066.stdout:5/161: dread d5/d15/f17 [0,4194304] 0 2024-09-12T22:49:53.776 INFO:tasks.workunit.client.0.smithi066.stdout:9/64: creat d9/dc/f19 x:0 0 0 2024-09-12T22:49:53.777 INFO:tasks.workunit.client.0.smithi066.stdout:3/57: dwrite d0/d2/d7/f11 [0,4194304] 0 2024-09-12T22:49:53.778 INFO:tasks.workunit.client.0.smithi066.stdout:1/64: dread d0/f6 [0,4194304] 0 2024-09-12T22:49:53.781 INFO:tasks.workunit.client.0.smithi066.stdout:1/65: chown d0/d9/ca 2 1 2024-09-12T22:49:53.783 INFO:tasks.workunit.client.0.smithi066.stdout:7/86: dwrite d0/dc/f12 [0,4194304] 0 2024-09-12T22:49:53.784 INFO:tasks.workunit.client.0.smithi066.stdout:1/66: write d0/f7 [3946693,12808] 0 2024-09-12T22:49:53.787 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:53.786+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:53.787 INFO:tasks.workunit.client.0.smithi066.stdout:1/67: chown d0/f7 13376 1 2024-09-12T22:49:53.788 INFO:tasks.workunit.client.0.smithi066.stdout:5/162: dwrite d5/f24 [0,4194304] 0 2024-09-12T22:49:53.790 INFO:tasks.workunit.client.0.smithi066.stdout:9/65: dwrite d9/dc/dd/f18 [0,4194304] 0 2024-09-12T22:49:53.790 INFO:tasks.workunit.client.0.smithi066.stdout:5/163: fsync d5/d14/f28 0 2024-09-12T22:49:53.791 INFO:tasks.workunit.client.0.smithi066.stdout:3/58: dwrite d0/d2/d6/f9 [0,4194304] 0 2024-09-12T22:49:53.792 INFO:tasks.workunit.client.0.smithi066.stdout:9/66: dread - d9/dc/dd/f11 zero size 2024-09-12T22:49:53.792 INFO:tasks.workunit.client.0.smithi066.stdout:9/67: fdatasync d9/fa 0 2024-09-12T22:49:53.794 INFO:tasks.workunit.client.0.smithi066.stdout:9/68: write d9/dc/f12 [38579,61669] 0 2024-09-12T22:49:53.794 INFO:tasks.workunit.client.0.smithi066.stdout:4/75: getdents d5/d8/d16/d1b 0 2024-09-12T22:49:53.795 INFO:tasks.workunit.client.0.smithi066.stdout:2/98: truncate d1/f4 4336731 0 2024-09-12T22:49:53.795 INFO:tasks.workunit.client.0.smithi066.stdout:7/87: symlink d0/dc/l15 0 2024-09-12T22:49:53.796 INFO:tasks.workunit.client.0.smithi066.stdout:1/68: mknod d0/cd 0 2024-09-12T22:49:53.796 INFO:tasks.workunit.client.0.smithi066.stdout:5/164: creat d5/d15/f2c x:0 0 0 2024-09-12T22:49:53.797 INFO:tasks.workunit.client.0.smithi066.stdout:3/59: rmdir d0/d2 39 2024-09-12T22:49:53.797 INFO:tasks.workunit.client.0.smithi066.stdout:9/69: unlink d9/dc/f12 0 2024-09-12T22:49:53.797 INFO:tasks.workunit.client.0.smithi066.stdout:2/99: rmdir d1/dd/d12 39 2024-09-12T22:49:53.798 INFO:tasks.workunit.client.0.smithi066.stdout:5/165: chown d5/d11/d21 31 1 2024-09-12T22:49:53.798 INFO:tasks.workunit.client.0.smithi066.stdout:7/88: write d0/f5 [9388469,30355] 0 2024-09-12T22:49:53.798 INFO:tasks.workunit.client.0.smithi066.stdout:1/69: write d0/f7 [1327137,119406] 0 2024-09-12T22:49:53.798 INFO:tasks.workunit.client.0.smithi066.stdout:4/76: creat d5/d8/d10/f20 x:0 0 0 2024-09-12T22:49:53.800 INFO:tasks.workunit.client.0.smithi066.stdout:2/100: chown d1/la 21383 1 2024-09-12T22:49:53.801 INFO:tasks.workunit.client.0.smithi066.stdout:5/166: rename d5/la to d5/d11/d23/l2d 0 2024-09-12T22:49:53.801 INFO:tasks.workunit.client.0.smithi066.stdout:4/77: mknod d5/d8/d16/c21 0 2024-09-12T22:49:53.802 INFO:tasks.workunit.client.0.smithi066.stdout:1/70: link d0/f6 d0/dc/fe 0 2024-09-12T22:49:53.802 INFO:tasks.workunit.client.0.smithi066.stdout:3/60: write d0/d2/d7/d13/f14 [240141,57397] 0 2024-09-12T22:49:53.802 INFO:tasks.workunit.client.0.smithi066.stdout:0/82: dwrite d1/f1a [0,4194304] 0 2024-09-12T22:49:53.803 INFO:tasks.workunit.client.0.smithi066.stdout:6/91: dwrite f1 [0,4194304] 0 2024-09-12T22:49:53.803 INFO:tasks.workunit.client.0.smithi066.stdout:4/78: chown d5/c11 2081 1 2024-09-12T22:49:53.803 INFO:tasks.workunit.client.0.smithi066.stdout:5/167: chown d5/c13 50457581 1 2024-09-12T22:49:53.804 INFO:tasks.workunit.client.0.smithi066.stdout:1/71: chown d0/d9/fb 37044 1 2024-09-12T22:49:53.804 INFO:tasks.workunit.client.0.smithi066.stdout:3/61: dread - d0/d2/d7/fc zero size 2024-09-12T22:49:53.804 INFO:tasks.workunit.client.0.smithi066.stdout:4/79: read d5/d8/f19 [721959,57611] 0 2024-09-12T22:49:53.805 INFO:tasks.workunit.client.0.smithi066.stdout:4/80: chown d5 3969670 1 2024-09-12T22:49:53.805 INFO:tasks.workunit.client.0.smithi066.stdout:0/83: mkdir d1/d8/d1f 0 2024-09-12T22:49:53.805 INFO:tasks.workunit.client.0.smithi066.stdout:5/168: symlink d5/d15/l2e 0 2024-09-12T22:49:53.805 INFO:tasks.workunit.client.0.smithi066.stdout:4/81: readlink d5/d8/d10/lf 0 2024-09-12T22:49:53.806 INFO:tasks.workunit.client.0.smithi066.stdout:0/84: fsync d1/d8/d1c/d13/f1e 0 2024-09-12T22:49:53.806 INFO:tasks.workunit.client.0.smithi066.stdout:2/101: getdents d1/dd/d12/d1e 0 2024-09-12T22:49:53.806 INFO:tasks.workunit.client.0.smithi066.stdout:6/92: rename d6/d7/l9 to d6/l15 0 2024-09-12T22:49:53.807 INFO:tasks.workunit.client.0.smithi066.stdout:6/93: dread - d6/df/f12 zero size 2024-09-12T22:49:53.809 INFO:tasks.workunit.client.0.smithi066.stdout:0/85: write d1/f2 [1305018,109952] 0 2024-09-12T22:49:53.809 INFO:tasks.workunit.client.0.smithi066.stdout:2/102: write d1/dd/f14 [806368,74431] 0 2024-09-12T22:49:53.810 INFO:tasks.workunit.client.0.smithi066.stdout:4/82: dread d5/d8/f19 [0,4194304] 0 2024-09-12T22:49:53.810 INFO:tasks.workunit.client.0.smithi066.stdout:9/70: getdents d9/dc 0 2024-09-12T22:49:53.811 INFO:tasks.workunit.client.0.smithi066.stdout:6/94: creat d6/d7/dc/f16 x:0 0 0 2024-09-12T22:49:53.812 INFO:tasks.workunit.client.0.smithi066.stdout:2/103: mknod d1/dd/d12/c1f 0 2024-09-12T22:49:53.812 INFO:tasks.workunit.client.0.smithi066.stdout:0/86: creat d1/d8/d1c/d13/f20 x:0 0 0 2024-09-12T22:49:53.813 INFO:tasks.workunit.client.0.smithi066.stdout:5/169: dread d5/d11/f1b [0,4194304] 0 2024-09-12T22:49:53.813 INFO:tasks.workunit.client.0.smithi066.stdout:1/72: dwrite d0/f6 [0,4194304] 0 2024-09-12T22:49:53.813 INFO:tasks.workunit.client.0.smithi066.stdout:4/83: link d5/c11 d5/d8/c22 0 2024-09-12T22:49:53.814 INFO:tasks.workunit.client.0.smithi066.stdout:0/87: chown d1/d8/fe 1 1 2024-09-12T22:49:53.814 INFO:tasks.workunit.client.0.smithi066.stdout:2/104: symlink d1/dd/d12/d1e/l20 0 2024-09-12T22:49:53.814 INFO:tasks.workunit.client.0.smithi066.stdout:6/95: link d6/fb d6/f17 0 2024-09-12T22:49:53.815 INFO:tasks.workunit.client.0.smithi066.stdout:5/170: creat d5/d11/d23/f2f x:0 0 0 2024-09-12T22:49:53.815 INFO:tasks.workunit.client.0.smithi066.stdout:2/105: unlink d1/db/c17 0 2024-09-12T22:49:53.817 INFO:tasks.workunit.client.0.smithi066.stdout:4/84: write d5/d8/f12 [933440,75127] 0 2024-09-12T22:49:53.817 INFO:tasks.workunit.client.0.smithi066.stdout:0/88: symlink d1/d8/d1c/d13/l21 0 2024-09-12T22:49:53.818 INFO:tasks.workunit.client.0.smithi066.stdout:6/96: rename f1 to d6/df/f18 0 2024-09-12T22:49:53.818 INFO:tasks.workunit.client.0.smithi066.stdout:1/73: fdatasync d0/d9/fb 0 2024-09-12T22:49:53.818 INFO:tasks.workunit.client.0.smithi066.stdout:2/106: stat d1/f6 0 2024-09-12T22:49:53.818 INFO:tasks.workunit.client.0.smithi066.stdout:5/171: symlink d5/d14/l30 0 2024-09-12T22:49:53.818 INFO:tasks.workunit.client.0.smithi066.stdout:5/172: readlink d5/d11/d23/l2a 0 2024-09-12T22:49:53.818 INFO:tasks.workunit.client.0.smithi066.stdout:0/89: creat d1/d8/d1c/d13/f22 x:0 0 0 2024-09-12T22:49:53.818 INFO:tasks.workunit.client.0.smithi066.stdout:4/85: mknod d5/d8/c23 0 2024-09-12T22:49:53.819 INFO:tasks.workunit.client.0.smithi066.stdout:5/173: read d5/d15/f17 [1612145,80585] 0 2024-09-12T22:49:53.819 INFO:tasks.workunit.client.0.smithi066.stdout:0/90: creat d1/d8/d1c/d13/f23 x:0 0 0 2024-09-12T22:49:53.820 INFO:tasks.workunit.client.0.smithi066.stdout:0/91: readlink d1/d8/d1c/dd/l11 0 2024-09-12T22:49:53.820 INFO:tasks.workunit.client.0.smithi066.stdout:5/174: mknod d5/d11/d21/c31 0 2024-09-12T22:49:53.821 INFO:tasks.workunit.client.0.smithi066.stdout:6/97: dread d6/df/f18 [0,4194304] 0 2024-09-12T22:49:53.821 INFO:tasks.workunit.client.0.smithi066.stdout:1/74: dread d0/dc/fe [0,4194304] 0 2024-09-12T22:49:53.821 INFO:tasks.workunit.client.0.smithi066.stdout:5/175: dread - d5/d11/d23/f2f zero size 2024-09-12T22:49:53.821 INFO:tasks.workunit.client.0.smithi066.stdout:0/92: write d1/f10 [4159560,14780] 0 2024-09-12T22:49:53.822 INFO:tasks.workunit.client.0.smithi066.stdout:8/95: sync 2024-09-12T22:49:53.822 INFO:tasks.workunit.client.0.smithi066.stdout:3/62: sync 2024-09-12T22:49:53.822 INFO:tasks.workunit.client.0.smithi066.stdout:1/75: write d0/f7 [5010049,88183] 0 2024-09-12T22:49:53.822 INFO:tasks.workunit.client.0.smithi066.stdout:6/98: write d6/d7/dc/f13 [1618316,77777] 0 2024-09-12T22:49:53.823 INFO:tasks.workunit.client.0.smithi066.stdout:0/93: creat d1/d8/d1b/f24 x:0 0 0 2024-09-12T22:49:53.823 INFO:tasks.workunit.client.0.smithi066.stdout:1/76: creat d0/ff x:0 0 0 2024-09-12T22:49:53.823 INFO:tasks.workunit.client.0.smithi066.stdout:6/99: symlink d6/d7/dc/l19 0 2024-09-12T22:49:53.823 INFO:tasks.workunit.client.0.smithi066.stdout:3/63: symlink d0/d2/d7/d13/l15 0 2024-09-12T22:49:53.823 INFO:tasks.workunit.client.0.smithi066.stdout:6/100: chown d6 0 1 2024-09-12T22:49:53.827 INFO:tasks.workunit.client.0.smithi066.stdout:9/71: truncate d9/dc/dd/f18 3722915 0 2024-09-12T22:49:53.827 INFO:tasks.workunit.client.0.smithi066.stdout:1/77: symlink d0/d9/l10 0 2024-09-12T22:49:53.827 INFO:tasks.workunit.client.0.smithi066.stdout:2/107: truncate d1/f6 3625959 0 2024-09-12T22:49:53.827 INFO:tasks.workunit.client.0.smithi066.stdout:4/86: truncate d5/d8/f12 392824 0 2024-09-12T22:49:53.828 INFO:tasks.workunit.client.0.smithi066.stdout:0/94: mkdir d1/d8/d1f/d25 0 2024-09-12T22:49:53.829 INFO:tasks.workunit.client.0.smithi066.stdout:3/64: mknod d0/c16 0 2024-09-12T22:49:53.829 INFO:tasks.workunit.client.0.smithi066.stdout:6/101: creat d6/d7/f1a x:0 0 0 2024-09-12T22:49:53.829 INFO:tasks.workunit.client.0.smithi066.stdout:1/78: symlink d0/l11 0 2024-09-12T22:49:53.829 INFO:tasks.workunit.client.0.smithi066.stdout:9/72: chown d9/dc/fe 36 1 2024-09-12T22:49:53.829 INFO:tasks.workunit.client.0.smithi066.stdout:2/108: dread - d1/d11/f19 zero size 2024-09-12T22:49:53.829 INFO:tasks.workunit.client.0.smithi066.stdout:4/87: chown d5/c11 1760466188 1 2024-09-12T22:49:53.829 INFO:tasks.workunit.client.0.smithi066.stdout:9/73: stat d9/dc/fe 0 2024-09-12T22:49:53.829 INFO:tasks.workunit.client.0.smithi066.stdout:0/95: chown d1/d8/c19 0 1 2024-09-12T22:49:53.830 INFO:tasks.workunit.client.0.smithi066.stdout:6/102: dread - d6/df/f12 zero size 2024-09-12T22:49:53.830 INFO:tasks.workunit.client.0.smithi066.stdout:3/65: read - d0/d2/d7/fc zero size 2024-09-12T22:49:53.830 INFO:tasks.workunit.client.0.smithi066.stdout:2/109: creat d1/dd/d12/f21 x:0 0 0 2024-09-12T22:49:53.831 INFO:tasks.workunit.client.0.smithi066.stdout:5/176: sync 2024-09-12T22:49:53.831 INFO:tasks.workunit.client.0.smithi066.stdout:7/89: sync 2024-09-12T22:49:53.831 INFO:tasks.workunit.client.0.smithi066.stdout:0/96: symlink d1/d8/d1f/l26 0 2024-09-12T22:49:53.831 INFO:tasks.workunit.client.0.smithi066.stdout:3/66: fsync d0/d2/d6/fd 0 2024-09-12T22:49:53.831 INFO:tasks.workunit.client.0.smithi066.stdout:9/74: creat d9/f1a x:0 0 0 2024-09-12T22:49:53.831 INFO:tasks.workunit.client.0.smithi066.stdout:8/96: dwrite fa [0,4194304] 0 2024-09-12T22:49:53.832 INFO:tasks.workunit.client.0.smithi066.stdout:0/97: read d1/d8/d1c/f17 [326401,38602] 0 2024-09-12T22:49:53.832 INFO:tasks.workunit.client.0.smithi066.stdout:7/90: truncate d0/ff 48747 0 2024-09-12T22:49:53.833 INFO:tasks.workunit.client.0.smithi066.stdout:2/110: symlink d1/d11/l22 0 2024-09-12T22:49:53.833 INFO:tasks.workunit.client.0.smithi066.stdout:6/103: unlink d6/d7/dc/f13 0 2024-09-12T22:49:53.833 INFO:tasks.workunit.client.0.smithi066.stdout:5/177: mkdir d5/d14/d32 0 2024-09-12T22:49:53.836 INFO:tasks.workunit.client.0.smithi066.stdout:1/79: truncate d0/f6 1397868 0 2024-09-12T22:49:53.837 INFO:tasks.workunit.client.0.smithi066.stdout:9/75: creat d9/dc/dd/f1b x:0 0 0 2024-09-12T22:49:53.837 INFO:tasks.workunit.client.0.smithi066.stdout:9/76: sync 2024-09-12T22:49:53.837 INFO:tasks.workunit.client.0.smithi066.stdout:3/67: mknod d0/d2/d7/c17 0 2024-09-12T22:49:53.839 INFO:tasks.workunit.client.0.smithi066.stdout:4/88: dwrite d5/d8/d10/f1a [0,4194304] 0 2024-09-12T22:49:53.839 INFO:tasks.workunit.client.0.smithi066.stdout:2/111: symlink d1/d11/l23 0 2024-09-12T22:49:53.842 INFO:tasks.workunit.client.0.smithi066.stdout:8/97: dwrite fa [0,4194304] 0 2024-09-12T22:49:53.843 INFO:tasks.workunit.client.0.smithi066.stdout:3/68: write d0/d2/d6/f9 [65856,85998] 0 2024-09-12T22:49:53.843 INFO:tasks.workunit.client.0.smithi066.stdout:4/89: write d5/d8/d10/f1a [4774703,80283] 0 2024-09-12T22:49:53.843 INFO:tasks.workunit.client.0.smithi066.stdout:8/98: read f11 [51963,47305] 0 2024-09-12T22:49:53.845 INFO:tasks.workunit.client.0.smithi066.stdout:0/98: dwrite d1/f1a [0,4194304] 0 2024-09-12T22:49:53.845 INFO:tasks.workunit.client.0.smithi066.stdout:7/91: dwrite d0/f5 [4194304,4194304] 0 2024-09-12T22:49:53.845 INFO:tasks.workunit.client.0.smithi066.stdout:2/112: creat d1/dd/d12/f24 x:0 0 0 2024-09-12T22:49:53.846 INFO:tasks.workunit.client.0.smithi066.stdout:3/69: chown d0/d2/d6/f9 435 1 2024-09-12T22:49:53.846 INFO:tasks.workunit.client.0.smithi066.stdout:2/113: chown d1/d11 801714232 1 2024-09-12T22:49:53.846 INFO:tasks.workunit.client.0.smithi066.stdout:6/104: link d6/d7/le d6/d7/l1b 0 2024-09-12T22:49:53.849 INFO:tasks.workunit.client.0.smithi066.stdout:7/92: write d0/f5 [4376954,87564] 0 2024-09-12T22:49:53.849 INFO:tasks.workunit.client.0.smithi066.stdout:9/77: creat d9/f1c x:0 0 0 2024-09-12T22:49:53.849 INFO:tasks.workunit.client.0.smithi066.stdout:0/99: mknod d1/d8/d1f/c27 0 2024-09-12T22:49:53.849 INFO:tasks.workunit.client.0.smithi066.stdout:5/178: dwrite f3 [4194304,4194304] 0 2024-09-12T22:49:53.849 INFO:tasks.workunit.client.0.smithi066.stdout:3/70: rmdir d0/d2/d7 39 2024-09-12T22:49:53.849 INFO:tasks.workunit.client.0.smithi066.stdout:2/114: creat d1/d11/f25 x:0 0 0 2024-09-12T22:49:53.849 INFO:tasks.workunit.client.0.smithi066.stdout:6/105: mknod d6/d7/dc/c1c 0 2024-09-12T22:49:53.850 INFO:tasks.workunit.client.0.smithi066.stdout:9/78: dread - d9/dc/dd/f13 zero size 2024-09-12T22:49:53.850 INFO:tasks.workunit.client.0.smithi066.stdout:5/179: symlink d5/d11/d21/l33 0 2024-09-12T22:49:53.851 INFO:tasks.workunit.client.0.smithi066.stdout:2/115: write d1/d11/f16 [489920,110198] 0 2024-09-12T22:49:53.851 INFO:tasks.workunit.client.0.smithi066.stdout:7/93: dread d0/ff [0,4194304] 0 2024-09-12T22:49:53.851 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:53.850+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:53.852 INFO:tasks.workunit.client.0.smithi066.stdout:6/106: write d6/d7/f11 [177568,87405] 0 2024-09-12T22:49:53.852 INFO:tasks.workunit.client.0.smithi066.stdout:3/71: creat d0/d2/d6/f18 x:0 0 0 2024-09-12T22:49:53.852 INFO:tasks.workunit.client.0.smithi066.stdout:0/100: write d1/d8/d1c/d13/f1e [157137,29493] 0 2024-09-12T22:49:53.853 INFO:tasks.workunit.client.0.smithi066.stdout:8/99: dread f11 [0,4194304] 0 2024-09-12T22:49:53.853 INFO:tasks.workunit.client.0.smithi066.stdout:5/180: creat d5/d15/f34 x:0 0 0 2024-09-12T22:49:53.853 INFO:tasks.workunit.client.0.smithi066.stdout:7/94: creat d0/dc/f16 x:0 0 0 2024-09-12T22:49:53.853 INFO:tasks.workunit.client.0.smithi066.stdout:2/116: fdatasync d1/d11/f25 0 2024-09-12T22:49:53.853 INFO:tasks.workunit.client.0.smithi066.stdout:9/79: truncate d9/dc/f19 676342 0 2024-09-12T22:49:53.854 INFO:tasks.workunit.client.0.smithi066.stdout:6/107: creat d6/d7/f1d x:0 0 0 2024-09-12T22:49:53.854 INFO:tasks.workunit.client.0.smithi066.stdout:4/90: dwrite d5/d8/d10/de/f18 [0,4194304] 0 2024-09-12T22:49:53.854 INFO:tasks.workunit.client.0.smithi066.stdout:3/72: creat d0/d2/d7/d13/f19 x:0 0 0 2024-09-12T22:49:53.854 INFO:tasks.workunit.client.0.smithi066.stdout:2/117: rmdir d1/dd/d12/d18 39 2024-09-12T22:49:53.855 INFO:tasks.workunit.client.0.smithi066.stdout:8/100: getdents d17 0 2024-09-12T22:49:53.855 INFO:tasks.workunit.client.0.smithi066.stdout:9/80: creat d9/dc/dd/f1d x:0 0 0 2024-09-12T22:49:53.855 INFO:tasks.workunit.client.0.smithi066.stdout:9/81: sync 2024-09-12T22:49:53.855 INFO:tasks.workunit.client.0.smithi066.stdout:7/95: write d0/d6/f9 [78703,128] 0 2024-09-12T22:49:53.856 INFO:tasks.workunit.client.0.smithi066.stdout:6/108: truncate d6/d7/f1a 250497 0 2024-09-12T22:49:53.856 INFO:tasks.workunit.client.0.smithi066.stdout:8/101: readlink l5 0 2024-09-12T22:49:53.856 INFO:tasks.workunit.client.0.smithi066.stdout:0/101: getdents d1/d8/d1c/dd 0 2024-09-12T22:49:53.857 INFO:tasks.workunit.client.0.smithi066.stdout:8/102: write d17/d1b/f1e [263973,95023] 0 2024-09-12T22:49:53.859 INFO:tasks.workunit.client.0.smithi066.stdout:3/73: creat d0/d2/d7/f1a x:0 0 0 2024-09-12T22:49:53.859 INFO:tasks.workunit.client.0.smithi066.stdout:0/102: dread - d1/d8/d1c/d13/f23 zero size 2024-09-12T22:49:53.859 INFO:tasks.workunit.client.0.smithi066.stdout:9/82: mkdir d9/d1e 0 2024-09-12T22:49:53.860 INFO:tasks.workunit.client.0.smithi066.stdout:4/91: truncate d5/d8/f19 517506 0 2024-09-12T22:49:53.860 INFO:tasks.workunit.client.0.smithi066.stdout:4/92: sync 2024-09-12T22:49:53.860 INFO:tasks.workunit.client.0.smithi066.stdout:9/83: stat d9/fa 0 2024-09-12T22:49:53.861 INFO:tasks.workunit.client.0.smithi066.stdout:8/103: rename d17/l18 to d17/d1b/l20 0 2024-09-12T22:49:53.861 INFO:tasks.workunit.client.0.smithi066.stdout:3/74: mkdir d0/d1b 0 2024-09-12T22:49:53.862 INFO:tasks.workunit.client.0.smithi066.stdout:8/104: dread - d17/f1f zero size 2024-09-12T22:49:53.863 INFO:tasks.workunit.client.0.smithi066.stdout:4/93: read d5/d8/d10/f1a [2196704,128333] 0 2024-09-12T22:49:53.863 INFO:tasks.workunit.client.0.smithi066.stdout:9/84: creat d9/dc/f1f x:0 0 0 2024-09-12T22:49:53.863 INFO:tasks.workunit.client.0.smithi066.stdout:0/103: creat d1/d8/d1c/dd/f28 x:0 0 0 2024-09-12T22:49:53.864 INFO:tasks.workunit.client.0.smithi066.stdout:3/75: fsync d0/d2/d6/fd 0 2024-09-12T22:49:53.864 INFO:tasks.workunit.client.0.smithi066.stdout:2/118: dwrite d1/d11/f25 [0,4194304] 0 2024-09-12T22:49:53.865 INFO:tasks.workunit.client.0.smithi066.stdout:4/94: creat d5/f24 x:0 0 0 2024-09-12T22:49:53.865 INFO:tasks.workunit.client.0.smithi066.stdout:8/105: write f15 [640209,42374] 0 2024-09-12T22:49:53.866 INFO:tasks.workunit.client.0.smithi066.stdout:1/80: chown d0/f6 7 1 2024-09-12T22:49:53.866 INFO:tasks.workunit.client.0.smithi066.stdout:5/181: creat d5/d14/d32/f35 x:0 0 0 2024-09-12T22:49:53.867 INFO:tasks.workunit.client.0.smithi066.stdout:2/119: mkdir d1/d11/d26 0 2024-09-12T22:49:53.867 INFO:tasks.workunit.client.0.smithi066.stdout:7/96: dwrite d0/d6/f9 [0,4194304] 0 2024-09-12T22:49:53.867 INFO:tasks.workunit.client.0.smithi066.stdout:3/76: symlink d0/d2/d6/l1c 0 2024-09-12T22:49:53.868 INFO:tasks.workunit.client.0.smithi066.stdout:0/104: creat d1/d8/d1c/dd/f29 x:0 0 0 2024-09-12T22:49:53.868 INFO:tasks.workunit.client.0.smithi066.stdout:1/81: fsync d0/f7 0 2024-09-12T22:49:53.868 INFO:tasks.workunit.client.0.smithi066.stdout:4/95: write f1 [443144,26696] 0 2024-09-12T22:49:53.869 INFO:tasks.workunit.client.0.smithi066.stdout:8/106: creat d17/f21 x:0 0 0 2024-09-12T22:49:53.869 INFO:tasks.workunit.client.0.smithi066.stdout:3/77: write d0/d2/fa [3916644,119543] 0 2024-09-12T22:49:53.870 INFO:tasks.workunit.client.0.smithi066.stdout:8/107: chown d17 10478 1 2024-09-12T22:49:53.871 INFO:tasks.workunit.client.0.smithi066.stdout:6/109: dwrite d6/df/f18 [0,4194304] 0 2024-09-12T22:49:53.872 INFO:tasks.workunit.client.0.smithi066.stdout:8/108: dread - d17/f1f zero size 2024-09-12T22:49:53.872 INFO:tasks.workunit.client.0.smithi066.stdout:4/96: write d5/f24 [35124,38986] 0 2024-09-12T22:49:53.873 INFO:tasks.workunit.client.0.smithi066.stdout:1/82: rename d0/cd to d0/d9/c12 0 2024-09-12T22:49:53.874 INFO:tasks.workunit.client.0.smithi066.stdout:6/110: fdatasync d6/df/f12 0 2024-09-12T22:49:53.875 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:53.875 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:53.875 INFO:tasks.workunit.client.0.smithi066.stdout:0/105: creat d1/f2a x:0 0 0 2024-09-12T22:49:53.875 INFO:tasks.workunit.client.0.smithi066.stdout:9/85: getdents d9 0 2024-09-12T22:49:53.876 INFO:tasks.workunit.client.0.smithi066.stdout:2/120: dread d1/d11/f16 [0,4194304] 0 2024-09-12T22:49:53.879 INFO:tasks.workunit.client.0.smithi066.stdout:5/182: dwrite d5/d15/f34 [0,4194304] 0 2024-09-12T22:49:53.881 INFO:tasks.workunit.client.0.smithi066.stdout:1/83: rename d0/f6 to d0/f13 0 2024-09-12T22:49:53.881 INFO:tasks.workunit.client.0.smithi066.stdout:7/97: dwrite d0/dc/f16 [0,4194304] 0 2024-09-12T22:49:53.883 INFO:tasks.workunit.client.0.smithi066.stdout:3/78: mkdir d0/d2/d1d 0 2024-09-12T22:49:53.884 INFO:tasks.workunit.client.0.smithi066.stdout:0/106: fsync d1/d8/d1c/d13/f1e 0 2024-09-12T22:49:53.885 INFO:tasks.workunit.client.0.smithi066.stdout:4/97: dread d5/d8/f19 [0,4194304] 0 2024-09-12T22:49:53.886 INFO:tasks.workunit.client.0.smithi066.stdout:0/107: mknod d1/c2b 0 2024-09-12T22:49:53.886 INFO:tasks.workunit.client.0.smithi066.stdout:8/109: dwrite f15 [0,4194304] 0 2024-09-12T22:49:53.887 INFO:tasks.workunit.client.0.smithi066.stdout:1/84: truncate d0/f13 1892998 0 2024-09-12T22:49:53.887 INFO:tasks.workunit.client.0.smithi066.stdout:6/111: dread d6/df/f18 [0,4194304] 0 2024-09-12T22:49:53.888 INFO:tasks.workunit.client.0.smithi066.stdout:0/108: creat d1/d8/d1f/f2c x:0 0 0 2024-09-12T22:49:53.888 INFO:tasks.workunit.client.0.smithi066.stdout:8/110: write f15 [1685417,31919] 0 2024-09-12T22:49:53.889 INFO:tasks.workunit.client.0.smithi066.stdout:5/183: dread f3 [4194304,4194304] 0 2024-09-12T22:49:53.890 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:53.890 INFO:tasks.workunit.client.0.smithi066.stdout:6/112: symlink d6/df/l1e 0 2024-09-12T22:49:53.891 INFO:tasks.workunit.client.0.smithi066.stdout:8/111: dread fa [8388608,4194304] 0 2024-09-12T22:49:53.893 INFO:tasks.workunit.client.0.smithi066.stdout:5/184: creat d5/f36 x:0 0 0 2024-09-12T22:49:53.899 INFO:tasks.workunit.client.0.smithi066.stdout:7/98: dwrite d0/dc/f12 [0,4194304] 0 2024-09-12T22:49:53.900 INFO:tasks.workunit.client.0.smithi066.stdout:2/121: truncate d1/d11/f16 61106 0 2024-09-12T22:49:53.900 INFO:tasks.workunit.client.0.smithi066.stdout:9/86: write d9/dc/dd/f18 [1742735,119627] 0 2024-09-12T22:49:53.900 INFO:tasks.workunit.client.0.smithi066.stdout:8/112: creat d17/f22 x:0 0 0 2024-09-12T22:49:53.905 INFO:tasks.workunit.client.0.smithi066.stdout:3/79: dwrite d0/d2/d7/f1a [0,4194304] 0 2024-09-12T22:49:53.906 INFO:tasks.workunit.client.0.smithi066.stdout:1/85: dwrite d0/f7 [4194304,4194304] 0 2024-09-12T22:49:53.906 INFO:tasks.workunit.client.0.smithi066.stdout:5/185: creat d5/de/f37 x:0 0 0 2024-09-12T22:49:53.907 INFO:tasks.workunit.client.0.smithi066.stdout:4/98: dwrite d5/d8/d10/f20 [0,4194304] 0 2024-09-12T22:49:53.907 INFO:tasks.workunit.client.0.smithi066.stdout:2/122: truncate d1/dd/f14 1436307 0 2024-09-12T22:49:53.907 INFO:tasks.workunit.client.0.smithi066.stdout:9/87: mknod d9/dc/c20 0 2024-09-12T22:49:53.908 INFO:tasks.workunit.client.0.smithi066.stdout:0/109: link d1/d8/d1c/d13/f22 d1/f2d 0 2024-09-12T22:49:53.908 INFO:tasks.workunit.client.0.smithi066.stdout:3/80: fdatasync d0/d2/d7/fc 0 2024-09-12T22:49:53.908 INFO:tasks.workunit.client.0.smithi066.stdout:1/86: readlink d0/l11 0 2024-09-12T22:49:53.909 INFO:tasks.workunit.client.0.smithi066.stdout:6/113: dread d6/d7/fa [0,4194304] 0 2024-09-12T22:49:53.916 INFO:tasks.workunit.client.0.smithi066.stdout:2/123: symlink d1/dd/l27 0 2024-09-12T22:49:53.917 INFO:tasks.workunit.client.0.smithi066.stdout:0/110: mkdir d1/d8/d1c/d2e 0 2024-09-12T22:49:53.917 INFO:tasks.workunit.client.0.smithi066.stdout:9/88: rename d9/c16 to d9/dc/dd/c21 0 2024-09-12T22:49:53.917 INFO:tasks.workunit.client.0.smithi066.stdout:7/99: dread d0/dc/f12 [0,4194304] 0 2024-09-12T22:49:53.918 INFO:tasks.workunit.client.0.smithi066.stdout:3/81: symlink d0/d2/d1d/l1e 0 2024-09-12T22:49:53.920 INFO:tasks.workunit.client.0.smithi066.stdout:1/87: truncate d0/dc/fe 614733 0 2024-09-12T22:49:53.921 INFO:tasks.workunit.client.0.smithi066.stdout:2/124: rename d1 to d1/dd/d28 22 2024-09-12T22:49:53.921 INFO:tasks.workunit.client.0.smithi066.stdout:5/186: write d5/f9 [2162370,128560] 0 2024-09-12T22:49:53.921 INFO:tasks.workunit.client.0.smithi066.stdout:8/113: dwrite d17/f1f [0,4194304] 0 2024-09-12T22:49:53.922 INFO:tasks.workunit.client.0.smithi066.stdout:6/114: link d6/d7/f11 d6/f1f 0 2024-09-12T22:49:53.923 INFO:tasks.workunit.client.0.smithi066.stdout:8/114: chown f16 18 1 2024-09-12T22:49:53.923 INFO:tasks.workunit.client.0.smithi066.stdout:3/82: creat d0/d2/d1d/f1f x:0 0 0 2024-09-12T22:49:53.923 INFO:tasks.workunit.client.0.smithi066.stdout:0/111: chown d1/d8/d1c/d13/f20 22717 1 2024-09-12T22:49:53.923 INFO:tasks.workunit.client.0.smithi066.stdout:5/187: rmdir d5/d11/d21 39 2024-09-12T22:49:53.923 INFO:tasks.workunit.client.0.smithi066.stdout:1/88: write d0/d9/fb [335819,69770] 0 2024-09-12T22:49:53.924 INFO:tasks.workunit.client.0.smithi066.stdout:6/115: fsync d6/d7/f1a 0 2024-09-12T22:49:53.924 INFO:tasks.workunit.client.0.smithi066.stdout:9/89: readlink d9/dc/l15 0 2024-09-12T22:49:53.924 INFO:tasks.workunit.client.0.smithi066.stdout:7/100: link d0/l4 d0/dc/l17 0 2024-09-12T22:49:53.924 INFO:tasks.workunit.client.0.smithi066.stdout:4/99: dread d5/d8/d10/de/f14 [0,4194304] 0 2024-09-12T22:49:53.925 INFO:tasks.workunit.client.0.smithi066.stdout:1/89: creat d0/d9/f14 x:0 0 0 2024-09-12T22:49:53.925 INFO:tasks.workunit.client.0.smithi066.stdout:0/112: mkdir d1/d8/d1c/d13/d2f 0 2024-09-12T22:49:53.925 INFO:tasks.workunit.client.0.smithi066.stdout:3/83: mknod d0/d2/d7/c20 0 2024-09-12T22:49:53.926 INFO:tasks.workunit.client.0.smithi066.stdout:9/90: write d9/f1c [303209,84599] 0 2024-09-12T22:49:53.926 INFO:tasks.workunit.client.0.smithi066.stdout:7/101: rmdir d0/dc 39 2024-09-12T22:49:53.926 INFO:tasks.workunit.client.0.smithi066.stdout:2/125: rename d1/d11/l23 to d1/dd/d12/d18/l29 0 2024-09-12T22:49:53.926 INFO:tasks.workunit.client.0.smithi066.stdout:4/100: symlink d5/l25 0 2024-09-12T22:49:53.926 INFO:tasks.workunit.client.0.smithi066.stdout:6/116: rename d6/df to d6/d20 0 2024-09-12T22:49:53.927 INFO:tasks.workunit.client.0.smithi066.stdout:1/90: mkdir d0/dc/d15 0 2024-09-12T22:49:53.927 INFO:tasks.workunit.client.0.smithi066.stdout:0/113: mkdir d1/d8/d1f/d30 0 2024-09-12T22:49:53.927 INFO:tasks.workunit.client.0.smithi066.stdout:1/91: chown d0 60986 1 2024-09-12T22:49:53.928 INFO:tasks.workunit.client.0.smithi066.stdout:5/188: dread f3 [0,4194304] 0 2024-09-12T22:49:53.928 INFO:tasks.workunit.client.0.smithi066.stdout:6/117: creat d6/d7/dc/f21 x:0 0 0 2024-09-12T22:49:53.928 INFO:tasks.workunit.client.0.smithi066.stdout:4/101: mkdir d5/d8/d16/d26 0 2024-09-12T22:49:53.928 INFO:tasks.workunit.client.0.smithi066.stdout:9/91: rmdir d9/d1e 0 2024-09-12T22:49:53.929 INFO:tasks.workunit.client.0.smithi066.stdout:8/115: dread fa [0,4194304] 0 2024-09-12T22:49:53.929 INFO:tasks.workunit.client.0.smithi066.stdout:6/118: stat d6/d7/f11 0 2024-09-12T22:49:53.929 INFO:tasks.workunit.client.0.smithi066.stdout:0/114: unlink d1/d8/d1c/d13/l21 0 2024-09-12T22:49:53.930 INFO:tasks.workunit.client.0.smithi066.stdout:4/102: creat d5/d8/d10/de/f27 x:0 0 0 2024-09-12T22:49:53.931 INFO:tasks.workunit.client.0.smithi066.stdout:8/116: write fa [6885584,21748] 0 2024-09-12T22:49:53.931 INFO:tasks.workunit.client.0.smithi066.stdout:6/119: dread - d6/d7/dc/f16 zero size 2024-09-12T22:49:53.934 INFO:tasks.workunit.client.0.smithi066.stdout:7/102: dread d0/dc/f12 [0,4194304] 0 2024-09-12T22:49:53.934 INFO:tasks.workunit.client.0.smithi066.stdout:9/92: dread d9/f1c [0,4194304] 0 2024-09-12T22:49:53.934 INFO:tasks.workunit.client.0.smithi066.stdout:6/120: creat d6/d20/f22 x:0 0 0 2024-09-12T22:49:53.934 INFO:tasks.workunit.client.0.smithi066.stdout:7/103: mkdir d0/d6/d18 0 2024-09-12T22:49:53.935 INFO:tasks.workunit.client.0.smithi066.stdout:2/126: dwrite d1/f8 [0,4194304] 0 2024-09-12T22:49:53.937 INFO:tasks.workunit.client.0.smithi066.stdout:1/92: read d0/dc/fe [62554,90401] 0 2024-09-12T22:49:53.937 INFO:tasks.workunit.client.0.smithi066.stdout:6/121: getdents d6/d7 0 2024-09-12T22:49:53.940 INFO:tasks.workunit.client.0.smithi066.stdout:3/84: getdents d0/d2/d7 0 2024-09-12T22:49:53.940 INFO:tasks.workunit.client.0.smithi066.stdout:1/93: write d0/ff [833736,45866] 0 2024-09-12T22:49:53.941 INFO:tasks.workunit.client.0.smithi066.stdout:2/127: write d1/dd/d12/f21 [795704,25308] 0 2024-09-12T22:49:53.941 INFO:tasks.workunit.client.0.smithi066.stdout:0/115: dwrite d1/f7 [0,4194304] 0 2024-09-12T22:49:53.941 INFO:tasks.workunit.client.0.smithi066.stdout:5/189: truncate d5/d15/f17 4599755 0 2024-09-12T22:49:53.942 INFO:tasks.workunit.client.0.smithi066.stdout:3/85: creat d0/d2/d1d/f21 x:0 0 0 2024-09-12T22:49:53.942 INFO:tasks.workunit.client.0.smithi066.stdout:4/103: dread d5/d8/d10/f20 [0,4194304] 0 2024-09-12T22:49:53.943 INFO:tasks.workunit.client.0.smithi066.stdout:7/104: write d0/dc/f12 [1842654,50840] 0 2024-09-12T22:49:53.943 INFO:tasks.workunit.client.0.smithi066.stdout:6/122: mkdir d6/d23 0 2024-09-12T22:49:53.944 INFO:tasks.workunit.client.0.smithi066.stdout:0/116: fsync d1/f10 0 2024-09-12T22:49:53.944 INFO:tasks.workunit.client.0.smithi066.stdout:5/190: creat d5/d14/f38 x:0 0 0 2024-09-12T22:49:53.944 INFO:tasks.workunit.client.0.smithi066.stdout:8/117: dwrite d17/d1b/f1e [0,4194304] 0 2024-09-12T22:49:53.944 INFO:tasks.workunit.client.0.smithi066.stdout:2/128: fsync d1/f6 0 2024-09-12T22:49:53.945 INFO:tasks.workunit.client.0.smithi066.stdout:2/129: chown d1/dd/l27 171 1 2024-09-12T22:49:53.945 INFO:tasks.workunit.client.0.smithi066.stdout:6/123: mkdir d6/d20/d24 0 2024-09-12T22:49:53.945 INFO:tasks.workunit.client.0.smithi066.stdout:4/104: creat d5/d8/d16/d1b/f28 x:0 0 0 2024-09-12T22:49:53.946 INFO:tasks.workunit.client.0.smithi066.stdout:5/191: mknod d5/d14/d32/c39 0 2024-09-12T22:49:53.946 INFO:tasks.workunit.client.0.smithi066.stdout:8/118: creat d17/d1b/f23 x:0 0 0 2024-09-12T22:49:53.946 INFO:tasks.workunit.client.0.smithi066.stdout:2/130: mkdir d1/d2a 0 2024-09-12T22:49:53.947 INFO:tasks.workunit.client.0.smithi066.stdout:0/117: truncate d1/d8/d1b/f24 99139 0 2024-09-12T22:49:53.947 INFO:tasks.workunit.client.0.smithi066.stdout:4/105: symlink d5/l29 0 2024-09-12T22:49:53.947 INFO:tasks.workunit.client.0.smithi066.stdout:3/86: rename d0/d2/d6/l1c to d0/d2/l22 0 2024-09-12T22:49:53.947 INFO:tasks.workunit.client.0.smithi066.stdout:1/94: fsync d0/ff 0 2024-09-12T22:49:53.948 INFO:tasks.workunit.client.0.smithi066.stdout:0/118: chown d1/f2a 32421203 1 2024-09-12T22:49:53.948 INFO:tasks.workunit.client.0.smithi066.stdout:5/192: write d5/de/f37 [360142,1779] 0 2024-09-12T22:49:53.948 INFO:tasks.workunit.client.0.smithi066.stdout:3/87: fsync d0/d2/d7/d13/f14 0 2024-09-12T22:49:53.948 INFO:tasks.workunit.client.0.smithi066.stdout:8/119: link cd d17/c24 0 2024-09-12T22:49:53.949 INFO:tasks.workunit.client.0.smithi066.stdout:2/131: rename d1/dd/d12/f1b to d1/f2b 0 2024-09-12T22:49:53.949 INFO:tasks.workunit.client.0.smithi066.stdout:8/120: dread - d17/f21 zero size 2024-09-12T22:49:53.949 INFO:tasks.workunit.client.0.smithi066.stdout:0/119: mknod d1/d8/d1c/dd/c31 0 2024-09-12T22:49:53.949 INFO:tasks.workunit.client.0.smithi066.stdout:5/193: truncate d5/d14/f28 861491 0 2024-09-12T22:49:53.950 INFO:tasks.workunit.client.0.smithi066.stdout:1/95: rename d0/d9/fb to d0/f16 0 2024-09-12T22:49:53.950 INFO:tasks.workunit.client.0.smithi066.stdout:3/88: creat d0/d2/d1d/f23 x:0 0 0 2024-09-12T22:49:53.951 INFO:tasks.workunit.client.0.smithi066.stdout:7/105: dread d0/d6/f9 [0,4194304] 0 2024-09-12T22:49:53.951 INFO:tasks.workunit.client.0.smithi066.stdout:0/120: read d1/f1a [1844040,92520] 0 2024-09-12T22:49:53.951 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~82s 2024-09-12T22:49:53.952 INFO:tasks.workunit.client.0.smithi066.stdout:5/194: symlink d5/d11/d21/l3a 0 2024-09-12T22:49:53.952 INFO:tasks.workunit.client.0.smithi066.stdout:6/124: dread d6/d7/f11 [0,4194304] 0 2024-09-12T22:49:53.952 INFO:tasks.workunit.client.0.smithi066.stdout:2/132: dread d1/f2b [0,4194304] 0 2024-09-12T22:49:53.952 INFO:tasks.workunit.client.0.smithi066.stdout:0/121: rename d1/c2b to d1/d8/d1c/c32 0 2024-09-12T22:49:53.953 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:53.951+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:53.953 INFO:tasks.workunit.client.0.smithi066.stdout:8/121: getdents d17/d1b 0 2024-09-12T22:49:53.953 INFO:tasks.workunit.client.0.smithi066.stdout:7/106: getdents d0/d6 0 2024-09-12T22:49:53.953 INFO:tasks.workunit.client.0.smithi066.stdout:5/195: creat d5/f3b x:0 0 0 2024-09-12T22:49:53.954 INFO:tasks.workunit.client.0.smithi066.stdout:6/125: unlink d6/d7/dc/f16 0 2024-09-12T22:49:53.955 INFO:tasks.workunit.client.0.smithi066.stdout:8/122: chown d17/l1a 752707489 1 2024-09-12T22:49:53.955 INFO:tasks.workunit.client.0.smithi066.stdout:5/196: fdatasync d5/de/ff 0 2024-09-12T22:49:53.955 INFO:tasks.workunit.client.0.smithi066.stdout:0/122: write d1/d8/d1f/f2c [862128,23784] 0 2024-09-12T22:49:53.955 INFO:tasks.workunit.client.0.smithi066.stdout:2/133: creat d1/dd/f2c x:0 0 0 2024-09-12T22:49:53.955 INFO:tasks.workunit.client.0.smithi066.stdout:8/123: readlink lb 0 2024-09-12T22:49:53.955 INFO:tasks.workunit.client.0.smithi066.stdout:6/126: chown d6/d7/f1a 2 1 2024-09-12T22:49:53.956 INFO:tasks.workunit.client.0.smithi066.stdout:5/197: symlink d5/d15/l3c 0 2024-09-12T22:49:53.956 INFO:tasks.workunit.client.0.smithi066.stdout:6/127: readlink d6/l15 0 2024-09-12T22:49:53.957 INFO:tasks.workunit.client.0.smithi066.stdout:8/124: symlink d17/l25 0 2024-09-12T22:49:53.960 INFO:tasks.workunit.client.0.smithi066.stdout:4/106: write d5/d8/f19 [188984,34336] 0 2024-09-12T22:49:53.960 INFO:tasks.workunit.client.0.smithi066.stdout:3/89: dwrite d0/d2/d1d/f1f [0,4194304] 0 2024-09-12T22:49:53.961 INFO:tasks.workunit.client.0.smithi066.stdout:7/107: dread d0/f5 [0,4194304] 0 2024-09-12T22:49:53.962 INFO:tasks.workunit.client.0.smithi066.stdout:6/128: dread d6/fb [0,4194304] 0 2024-09-12T22:49:53.962 INFO:tasks.workunit.client.0.smithi066.stdout:8/125: rmdir d17/d1b 39 2024-09-12T22:49:53.963 INFO:tasks.workunit.client.0.smithi066.stdout:4/107: fdatasync d5/d8/d16/d1b/f28 0 2024-09-12T22:49:53.963 INFO:tasks.workunit.client.0.smithi066.stdout:5/198: write f4 [4521593,80191] 0 2024-09-12T22:49:53.963 INFO:tasks.workunit.client.0.smithi066.stdout:3/90: read - d0/d2/d1d/f23 zero size 2024-09-12T22:49:53.963 INFO:tasks.workunit.client.0.smithi066.stdout:0/123: chown d1/d8/d1c/c32 57097 1 2024-09-12T22:49:53.963 INFO:tasks.workunit.client.0.smithi066.stdout:7/108: chown d0/d6/f10 75637 1 2024-09-12T22:49:53.964 INFO:tasks.workunit.client.0.smithi066.stdout:8/126: symlink d17/l26 0 2024-09-12T22:49:53.965 INFO:tasks.workunit.client.0.smithi066.stdout:3/91: rmdir d0/d2/d7 39 2024-09-12T22:49:53.965 INFO:tasks.workunit.client.0.smithi066.stdout:5/199: fdatasync f4 0 2024-09-12T22:49:53.965 INFO:tasks.workunit.client.0.smithi066.stdout:4/108: rmdir d5/d8/d16/d1b 39 2024-09-12T22:49:53.965 INFO:tasks.workunit.client.0.smithi066.stdout:2/134: dwrite d1/d11/f25 [0,4194304] 0 2024-09-12T22:49:53.966 INFO:tasks.workunit.client.0.smithi066.stdout:0/124: unlink d1/d8/c19 0 2024-09-12T22:49:53.966 INFO:tasks.workunit.client.0.smithi066.stdout:6/129: mkdir d6/d23/d25 0 2024-09-12T22:49:53.966 INFO:tasks.workunit.client.0.smithi066.stdout:7/109: mkdir d0/d19 0 2024-09-12T22:49:53.966 INFO:tasks.workunit.client.0.smithi066.stdout:5/200: chown d5/d11/d21/c26 4763924 1 2024-09-12T22:49:53.966 INFO:tasks.workunit.client.0.smithi066.stdout:2/135: dread - d1/dd/f2c zero size 2024-09-12T22:49:53.966 INFO:tasks.workunit.client.0.smithi066.stdout:6/130: mknod d6/d23/d25/c26 0 2024-09-12T22:49:53.967 INFO:tasks.workunit.client.0.smithi066.stdout:0/125: creat d1/d8/d1f/f33 x:0 0 0 2024-09-12T22:49:53.967 INFO:tasks.workunit.client.0.smithi066.stdout:4/109: dread d5/d8/f19 [0,4194304] 0 2024-09-12T22:49:53.967 INFO:tasks.workunit.client.0.smithi066.stdout:3/92: creat d0/d2/f24 x:0 0 0 2024-09-12T22:49:53.967 INFO:tasks.workunit.client.0.smithi066.stdout:5/201: symlink d5/d11/l3d 0 2024-09-12T22:49:53.967 INFO:tasks.workunit.client.0.smithi066.stdout:3/93: chown d0/d2/d1d 72708526 1 2024-09-12T22:49:53.968 INFO:tasks.workunit.client.0.smithi066.stdout:4/110: mknod d5/c2a 0 2024-09-12T22:49:53.968 INFO:tasks.workunit.client.0.smithi066.stdout:6/131: rename d6/d7/f1d to d6/d23/f27 0 2024-09-12T22:49:53.969 INFO:tasks.workunit.client.0.smithi066.stdout:8/127: truncate fa 5729720 0 2024-09-12T22:49:53.969 INFO:tasks.workunit.client.0.smithi066.stdout:3/94: read d0/d2/d1d/f1f [1803008,118017] 0 2024-09-12T22:49:53.969 INFO:tasks.workunit.client.0.smithi066.stdout:5/202: creat d5/f3e x:0 0 0 2024-09-12T22:49:53.970 INFO:tasks.workunit.client.0.smithi066.stdout:0/126: link d1/d8/d1c/d13/f22 d1/d8/d1f/d25/f34 0 2024-09-12T22:49:53.970 INFO:tasks.workunit.client.0.smithi066.stdout:4/111: write d5/d8/f19 [1497826,86272] 0 2024-09-12T22:49:53.970 INFO:tasks.workunit.client.0.smithi066.stdout:5/203: dread - d5/d14/d32/f35 zero size 2024-09-12T22:49:53.970 INFO:tasks.workunit.client.0.smithi066.stdout:8/128: creat d17/f27 x:0 0 0 2024-09-12T22:49:53.971 INFO:tasks.workunit.client.0.smithi066.stdout:3/95: write d0/d2/d7/f1a [2947185,74653] 0 2024-09-12T22:49:53.971 INFO:tasks.workunit.client.0.smithi066.stdout:0/127: stat d1/d8/d1c/dd/f28 0 2024-09-12T22:49:53.971 INFO:tasks.workunit.client.0.smithi066.stdout:5/204: fdatasync d5/d11/d23/f2b 0 2024-09-12T22:49:53.971 INFO:tasks.workunit.client.0.smithi066.stdout:2/136: dread d1/d11/f25 [0,4194304] 0 2024-09-12T22:49:53.971 INFO:tasks.workunit.client.0.smithi066.stdout:8/129: chown c10 243 1 2024-09-12T22:49:53.972 INFO:tasks.workunit.client.0.smithi066.stdout:4/112: creat d5/d8/d10/de/f2b x:0 0 0 2024-09-12T22:49:53.972 INFO:tasks.workunit.client.0.smithi066.stdout:0/128: creat d1/d8/f35 x:0 0 0 2024-09-12T22:49:53.972 INFO:tasks.workunit.client.0.smithi066.stdout:8/130: stat d17/l1c 0 2024-09-12T22:49:53.972 INFO:tasks.workunit.client.0.smithi066.stdout:2/137: chown d1/d11/l1c 4869774 1 2024-09-12T22:49:53.972 INFO:tasks.workunit.client.0.smithi066.stdout:0/129: chown d1/d8/d1f/d30 74671384 1 2024-09-12T22:49:53.972 INFO:tasks.workunit.client.0.smithi066.stdout:9/93: sync 2024-09-12T22:49:53.973 INFO:tasks.workunit.client.0.smithi066.stdout:1/96: sync 2024-09-12T22:49:53.973 INFO:tasks.workunit.client.0.smithi066.stdout:7/110: sync 2024-09-12T22:49:53.973 INFO:tasks.workunit.client.0.smithi066.stdout:8/131: truncate f16 1000475 0 2024-09-12T22:49:53.973 INFO:tasks.workunit.client.0.smithi066.stdout:4/113: mknod d5/d8/c2c 0 2024-09-12T22:49:53.973 INFO:tasks.workunit.client.0.smithi066.stdout:9/94: chown d9/dc 57782934 1 2024-09-12T22:49:53.974 INFO:tasks.workunit.client.0.smithi066.stdout:0/130: rename d1/d8/d1c/d2e to d1/d36 0 2024-09-12T22:49:53.974 INFO:tasks.workunit.client.0.smithi066.stdout:4/114: mkdir d5/d8/d10/de/d2d 0 2024-09-12T22:49:53.974 INFO:tasks.workunit.client.0.smithi066.stdout:2/138: link d1/d11/l22 d1/d11/d26/l2d 0 2024-09-12T22:49:53.975 INFO:tasks.workunit.client.0.smithi066.stdout:9/95: unlink d9/f1a 0 2024-09-12T22:49:53.975 INFO:tasks.workunit.client.0.smithi066.stdout:1/97: truncate d0/d9/f14 818181 0 2024-09-12T22:49:53.976 INFO:tasks.workunit.client.0.smithi066.stdout:0/131: rmdir d1 39 2024-09-12T22:49:53.977 INFO:tasks.workunit.client.0.smithi066.stdout:5/205: dread d5/d11/f1b [0,4194304] 0 2024-09-12T22:49:53.977 INFO:tasks.workunit.client.0.smithi066.stdout:1/98: rmdir d0/dc 39 2024-09-12T22:49:53.977 INFO:tasks.workunit.client.0.smithi066.stdout:9/96: unlink d9/dc/f10 0 2024-09-12T22:49:53.978 INFO:tasks.workunit.client.0.smithi066.stdout:8/132: rename lb to d17/l28 0 2024-09-12T22:49:53.978 INFO:tasks.workunit.client.0.smithi066.stdout:3/96: dwrite d0/d2/d1d/f21 [0,4194304] 0 2024-09-12T22:49:53.978 INFO:tasks.workunit.client.0.smithi066.stdout:7/111: rename d0/dc to d0/dc/d1a 22 2024-09-12T22:49:53.980 INFO:tasks.workunit.client.0.smithi066.stdout:4/115: dread d5/d8/f19 [0,4194304] 0 2024-09-12T22:49:53.980 INFO:tasks.workunit.client.0.smithi066.stdout:1/99: rmdir d0/d9 39 2024-09-12T22:49:53.980 INFO:tasks.workunit.client.0.smithi066.stdout:5/206: write d5/d14/f28 [1735016,127596] 0 2024-09-12T22:49:53.980 INFO:tasks.workunit.client.0.smithi066.stdout:1/100: readlink d0/l1 0 2024-09-12T22:49:53.980 INFO:tasks.workunit.client.0.smithi066.stdout:5/207: read d5/f24 [2645680,113258] 0 2024-09-12T22:49:53.981 INFO:tasks.workunit.client.0.smithi066.stdout:4/116: dread - d5/d8/d10/de/f2b zero size 2024-09-12T22:49:53.982 INFO:tasks.workunit.client.0.smithi066.stdout:5/208: write d5/d11/f1d [1033588,126617] 0 2024-09-12T22:49:53.982 INFO:tasks.workunit.client.0.smithi066.stdout:2/139: rename d1/d11/d26/l2d to d1/dd/d12/d1e/l2e 0 2024-09-12T22:49:53.983 INFO:tasks.workunit.client.0.smithi066.stdout:3/97: symlink d0/d2/l25 0 2024-09-12T22:49:53.983 INFO:tasks.workunit.client.0.smithi066.stdout:8/133: rename d17/f1f to d17/f29 0 2024-09-12T22:49:53.983 INFO:tasks.workunit.client.0.smithi066.stdout:1/101: chown d0/dc/fe 430235 1 2024-09-12T22:49:53.984 INFO:tasks.workunit.client.0.smithi066.stdout:7/112: rename d0/d6/c14 to d0/d19/c1b 0 2024-09-12T22:49:53.984 INFO:tasks.workunit.client.0.smithi066.stdout:3/98: mknod d0/d2/d1d/c26 0 2024-09-12T22:49:53.984 INFO:tasks.workunit.client.0.smithi066.stdout:5/209: write d5/d11/d23/f2b [327808,75115] 0 2024-09-12T22:49:53.985 INFO:tasks.workunit.client.0.smithi066.stdout:7/113: mknod d0/dc/c1c 0 2024-09-12T22:49:53.985 INFO:tasks.workunit.client.0.smithi066.stdout:9/97: dwrite f8 [0,4194304] 0 2024-09-12T22:49:53.985 INFO:tasks.workunit.client.0.smithi066.stdout:1/102: creat d0/dc/f17 x:0 0 0 2024-09-12T22:49:53.986 INFO:tasks.workunit.client.0.smithi066.stdout:3/99: mknod d0/d2/c27 0 2024-09-12T22:49:53.987 INFO:tasks.workunit.client.0.smithi066.stdout:0/132: truncate d1/f7 1523225 0 2024-09-12T22:49:53.988 INFO:tasks.workunit.client.0.smithi066.stdout:1/103: mknod d0/dc/c18 0 2024-09-12T22:49:53.988 INFO:tasks.workunit.client.0.smithi066.stdout:7/114: rename d0/d6/f10 to d0/dc/f1d 0 2024-09-12T22:49:53.989 INFO:tasks.workunit.client.0.smithi066.stdout:8/134: truncate fa 3596355 0 2024-09-12T22:49:53.989 INFO:tasks.workunit.client.0.smithi066.stdout:2/140: dread d1/f6 [0,4194304] 0 2024-09-12T22:49:53.989 INFO:tasks.workunit.client.0.smithi066.stdout:0/133: rename d1/d8/d1c to d1/d8/d1c/d37 22 2024-09-12T22:49:53.990 INFO:tasks.workunit.client.0.smithi066.stdout:7/115: unlink d0/d19/c1b 0 2024-09-12T22:49:53.991 INFO:tasks.workunit.client.0.smithi066.stdout:4/117: dwrite d5/d8/d16/d1b/f28 [0,4194304] 0 2024-09-12T22:49:53.991 INFO:tasks.workunit.client.0.smithi066.stdout:0/134: stat d1/d8/d1f/c27 0 2024-09-12T22:49:53.991 INFO:tasks.workunit.client.0.smithi066.stdout:8/135: rename d17/l1a to d17/d1b/l2a 0 2024-09-12T22:49:53.993 INFO:tasks.workunit.client.0.smithi066.stdout:1/104: dread d0/d9/f14 [0,4194304] 0 2024-09-12T22:49:53.993 INFO:tasks.workunit.client.0.smithi066.stdout:2/141: link d1/dd/d12/c1f d1/dd/d12/d1e/c2f 0 2024-09-12T22:49:53.994 INFO:tasks.workunit.client.0.smithi066.stdout:0/135: symlink d1/d8/d1f/d30/l38 0 2024-09-12T22:49:53.996 INFO:tasks.workunit.client.0.smithi066.stdout:4/118: chown d5/d8/d10/de/cc 6791981 1 2024-09-12T22:49:53.997 INFO:tasks.workunit.client.0.smithi066.stdout:5/210: truncate f3 6829151 0 2024-09-12T22:49:53.998 INFO:tasks.workunit.client.0.smithi066.stdout:0/136: fsync d1/d8/d1c/dd/f29 0 2024-09-12T22:49:53.998 INFO:tasks.workunit.client.0.smithi066.stdout:1/105: mkdir d0/d19 0 2024-09-12T22:49:53.998 INFO:tasks.workunit.client.0.smithi066.stdout:3/100: dwrite d0/d2/d1d/f23 [0,4194304] 0 2024-09-12T22:49:53.999 INFO:tasks.workunit.client.0.smithi066.stdout:2/142: link d1/f3 d1/d11/d26/f30 0 2024-09-12T22:49:54.000 INFO:tasks.workunit.client.0.smithi066.stdout:5/211: readlink d5/d15/l3c 0 2024-09-12T22:49:54.000 INFO:tasks.workunit.client.0.smithi066.stdout:9/98: dwrite d9/dc/dd/f18 [0,4194304] 0 2024-09-12T22:49:54.000 INFO:tasks.workunit.client.0.smithi066.stdout:1/106: symlink d0/dc/l1a 0 2024-09-12T22:49:54.001 INFO:tasks.workunit.client.0.smithi066.stdout:0/137: mknod d1/c39 0 2024-09-12T22:49:54.002 INFO:tasks.workunit.client.0.smithi066.stdout:2/143: chown d1/cc 0 1 2024-09-12T22:49:54.003 INFO:tasks.workunit.client.0.smithi066.stdout:1/107: chown d0/dc/f17 996 1 2024-09-12T22:49:54.004 INFO:tasks.workunit.client.0.smithi066.stdout:6/132: sync 2024-09-12T22:49:54.004 INFO:tasks.workunit.client.0.smithi066.stdout:3/101: mknod d0/d2/d7/d13/c28 0 2024-09-12T22:49:54.004 INFO:tasks.workunit.client.0.smithi066.stdout:8/136: dread f11 [0,4194304] 0 2024-09-12T22:49:54.005 INFO:tasks.workunit.client.0.smithi066.stdout:7/116: dwrite d0/f5 [4194304,4194304] 0 2024-09-12T22:49:54.005 INFO:tasks.workunit.client.0.smithi066.stdout:0/138: stat d1/f2 0 2024-09-12T22:49:54.005 INFO:tasks.workunit.client.0.smithi066.stdout:5/212: creat d5/f3f x:0 0 0 2024-09-12T22:49:54.005 INFO:tasks.workunit.client.0.smithi066.stdout:6/133: dread - d6/d20/f12 zero size 2024-09-12T22:49:54.005 INFO:tasks.workunit.client.0.smithi066.stdout:9/99: mknod d9/c22 0 2024-09-12T22:49:54.007 INFO:tasks.workunit.client.0.smithi066.stdout:9/100: mkdir d9/dc/d23 0 2024-09-12T22:49:54.008 INFO:tasks.workunit.client.0.smithi066.stdout:8/137: symlink d17/l2b 0 2024-09-12T22:49:54.009 INFO:tasks.workunit.client.0.smithi066.stdout:5/213: rename d5/d15/f34 to d5/d11/f40 0 2024-09-12T22:49:54.010 INFO:tasks.workunit.client.0.smithi066.stdout:8/138: mkdir d17/d2c 0 2024-09-12T22:49:54.010 INFO:tasks.workunit.client.0.smithi066.stdout:9/101: creat d9/dc/d23/f24 x:0 0 0 2024-09-12T22:49:54.011 INFO:tasks.workunit.client.0.smithi066.stdout:5/214: mknod d5/d11/d21/c41 0 2024-09-12T22:49:54.011 INFO:tasks.workunit.client.0.smithi066.stdout:1/108: dread d0/f16 [0,4194304] 0 2024-09-12T22:49:54.013 INFO:tasks.workunit.client.0.smithi066.stdout:8/139: rename d17/d1b/l1d to d17/d1b/l2d 0 2024-09-12T22:49:54.013 INFO:tasks.workunit.client.0.smithi066.stdout:3/102: dread d0/d2/d1d/f1f [0,4194304] 0 2024-09-12T22:49:54.013 INFO:tasks.workunit.client.0.smithi066.stdout:2/144: dwrite d1/d11/f19 [0,4194304] 0 2024-09-12T22:49:54.013 INFO:tasks.workunit.client.0.smithi066.stdout:4/119: dread d5/d8/d10/f1a [4194304,4194304] 0 2024-09-12T22:49:54.013 INFO:tasks.workunit.client.0.smithi066.stdout:5/215: mkdir d5/d14/d32/d42 0 2024-09-12T22:49:54.014 INFO:tasks.workunit.client.0.smithi066.stdout:9/102: write d9/dc/dd/f18 [4293574,41198] 0 2024-09-12T22:49:54.014 INFO:tasks.workunit.client.0.smithi066.stdout:6/134: dwrite d6/d7/f1a [0,4194304] 0 2024-09-12T22:49:54.015 INFO:tasks.workunit.client.0.smithi066.stdout:8/140: write d17/f22 [402706,117179] 0 2024-09-12T22:49:54.016 INFO:tasks.workunit.client.0.smithi066.stdout:9/103: readlink d9/dc/l17 0 2024-09-12T22:49:54.017 INFO:tasks.workunit.client.0.smithi066.stdout:9/104: readlink d9/dc/l17 0 2024-09-12T22:49:54.017 INFO:tasks.workunit.client.0.smithi066.stdout:1/109: truncate d0/dc/fe 983835 0 2024-09-12T22:49:54.017 INFO:tasks.workunit.client.0.smithi066.stdout:7/117: write d0/d6/f8 [2081454,72302] 0 2024-09-12T22:49:54.018 INFO:tasks.workunit.client.0.smithi066.stdout:3/103: mkdir d0/d2/d7/d29 0 2024-09-12T22:49:54.018 INFO:tasks.workunit.client.0.smithi066.stdout:8/141: write d17/f21 [80491,103447] 0 2024-09-12T22:49:54.018 INFO:tasks.workunit.client.0.smithi066.stdout:9/105: dread - d9/dc/dd/f1d zero size 2024-09-12T22:49:54.019 INFO:tasks.workunit.client.0.smithi066.stdout:7/118: creat d0/d19/f1e x:0 0 0 2024-09-12T22:49:54.019 INFO:tasks.workunit.client.0.smithi066.stdout:4/120: getdents d5/d8/d10/de/d2d 0 2024-09-12T22:49:54.019 INFO:tasks.workunit.client.0.smithi066.stdout:3/104: creat d0/d2/d1d/f2a x:0 0 0 2024-09-12T22:49:54.019 INFO:tasks.workunit.client.0.smithi066.stdout:8/142: write f16 [1856688,115247] 0 2024-09-12T22:49:54.020 INFO:tasks.workunit.client.0.smithi066.stdout:6/135: link d6/d7/dc/l19 d6/l28 0 2024-09-12T22:49:54.021 INFO:tasks.workunit.client.0.smithi066.stdout:5/216: dread f4 [0,4194304] 0 2024-09-12T22:49:54.021 INFO:tasks.workunit.client.0.smithi066.stdout:8/143: rmdir d17/d1b 39 2024-09-12T22:49:54.021 INFO:tasks.workunit.client.0.smithi066.stdout:3/105: readlink d0/d2/l22 0 2024-09-12T22:49:54.022 INFO:tasks.workunit.client.0.smithi066.stdout:4/121: fsync d5/d8/d10/f20 0 2024-09-12T22:49:54.022 INFO:tasks.workunit.client.0.smithi066.stdout:9/106: creat d9/f25 x:0 0 0 2024-09-12T22:49:54.022 INFO:tasks.workunit.client.0.smithi066.stdout:1/110: truncate d0/f7 4860168 0 2024-09-12T22:49:54.022 INFO:tasks.workunit.client.0.smithi066.stdout:5/217: chown d5/ld 2 1 2024-09-12T22:49:54.023 INFO:tasks.workunit.client.0.smithi066.stdout:6/136: link d6/d20/f22 d6/d23/f29 0 2024-09-12T22:49:54.024 INFO:tasks.workunit.client.0.smithi066.stdout:8/144: creat d17/d1b/f2e x:0 0 0 2024-09-12T22:49:54.024 INFO:tasks.workunit.client.0.smithi066.stdout:8/145: sync 2024-09-12T22:49:54.025 INFO:tasks.workunit.client.0.smithi066.stdout:9/107: rename d9/f25 to d9/f26 0 2024-09-12T22:49:54.026 INFO:tasks.workunit.client.0.smithi066.stdout:5/218: rename d5/f9 to d5/d11/f43 0 2024-09-12T22:49:54.027 INFO:tasks.workunit.client.0.smithi066.stdout:6/137: write d6/f1f [343202,84831] 0 2024-09-12T22:49:54.028 INFO:tasks.workunit.client.0.smithi066.stdout:0/139: dwrite d1/f7 [0,4194304] 0 2024-09-12T22:49:54.028 INFO:tasks.workunit.client.0.smithi066.stdout:2/145: dwrite d1/f6 [0,4194304] 0 2024-09-12T22:49:54.028 INFO:tasks.workunit.client.0.smithi066.stdout:1/111: dread d0/dc/fe [0,4194304] 0 2024-09-12T22:49:54.029 INFO:tasks.workunit.client.0.smithi066.stdout:9/108: creat d9/dc/f27 x:0 0 0 2024-09-12T22:49:54.030 INFO:tasks.workunit.client.0.smithi066.stdout:7/119: truncate d0/dc/f1d 6933323 0 2024-09-12T22:49:54.030 INFO:tasks.workunit.client.0.smithi066.stdout:9/109: sync 2024-09-12T22:49:54.030 INFO:tasks.workunit.client.0.smithi066.stdout:1/112: fdatasync d0/dc/f17 0 2024-09-12T22:49:54.030 INFO:tasks.workunit.client.0.smithi066.stdout:6/138: write d6/d7/f1a [543024,6381] 0 2024-09-12T22:49:54.031 INFO:tasks.workunit.client.0.smithi066.stdout:9/110: creat d9/dc/f28 x:0 0 0 2024-09-12T22:49:54.032 INFO:tasks.workunit.client.0.smithi066.stdout:8/146: link c8 d17/d2c/c2f 0 2024-09-12T22:49:54.032 INFO:tasks.workunit.client.0.smithi066.stdout:7/120: chown d0/d6/f8 9 1 2024-09-12T22:49:54.032 INFO:tasks.workunit.client.0.smithi066.stdout:4/122: dread d5/d8/d16/d1b/f28 [0,4194304] 0 2024-09-12T22:49:54.032 INFO:tasks.workunit.client.0.smithi066.stdout:2/146: write d1/f2b [380284,123541] 0 2024-09-12T22:49:54.034 INFO:tasks.workunit.client.0.smithi066.stdout:3/106: dwrite d0/d2/d7/fc [0,4194304] 0 2024-09-12T22:49:54.034 INFO:tasks.workunit.client.0.smithi066.stdout:5/219: link d5/d11/f1b d5/d14/d32/d42/f44 0 2024-09-12T22:49:54.035 INFO:tasks.workunit.client.0.smithi066.stdout:6/139: truncate d6/d23/f29 517420 0 2024-09-12T22:49:54.035 INFO:tasks.workunit.client.0.smithi066.stdout:5/220: fsync d5/f3f 0 2024-09-12T22:49:54.035 INFO:tasks.workunit.client.0.smithi066.stdout:0/140: truncate d1/d8/d1f/f33 166350 0 2024-09-12T22:49:54.035 INFO:tasks.workunit.client.0.smithi066.stdout:2/147: truncate d1/f2b 1256680 0 2024-09-12T22:49:54.036 INFO:tasks.workunit.client.0.smithi066.stdout:6/140: chown c4 0 1 2024-09-12T22:49:54.036 INFO:tasks.workunit.client.0.smithi066.stdout:1/113: link d0/d9/ca d0/d19/c1b 0 2024-09-12T22:49:54.036 INFO:tasks.workunit.client.0.smithi066.stdout:9/111: write d9/f26 [180975,23602] 0 2024-09-12T22:49:54.036 INFO:tasks.workunit.client.0.smithi066.stdout:7/121: write d0/d6/f9 [5200501,10231] 0 2024-09-12T22:49:54.037 INFO:tasks.workunit.client.0.smithi066.stdout:0/141: readlink d1/d8/d1c/d13/l16 0 2024-09-12T22:49:54.037 INFO:tasks.workunit.client.0.smithi066.stdout:4/123: link d5/d8/c23 d5/c2e 0 2024-09-12T22:49:54.037 INFO:tasks.workunit.client.0.smithi066.stdout:1/114: chown d0/dc 3821845 1 2024-09-12T22:49:54.037 INFO:tasks.workunit.client.0.smithi066.stdout:2/148: unlink d1/f4 0 2024-09-12T22:49:54.038 INFO:tasks.workunit.client.0.smithi066.stdout:5/221: mkdir d5/d45 0 2024-09-12T22:49:54.038 INFO:tasks.workunit.client.0.smithi066.stdout:6/141: chown d6/l28 6 1 2024-09-12T22:49:54.038 INFO:tasks.workunit.client.0.smithi066.stdout:7/122: creat d0/dc/f1f x:0 0 0 2024-09-12T22:49:54.039 INFO:tasks.workunit.client.0.smithi066.stdout:5/222: readlink d5/de/l1f 0 2024-09-12T22:49:54.039 INFO:tasks.workunit.client.0.smithi066.stdout:6/142: chown d6/d7/dc 276818898 1 2024-09-12T22:49:54.040 INFO:tasks.workunit.client.0.smithi066.stdout:7/123: rename d0 to d0/d20 22 2024-09-12T22:49:54.041 INFO:tasks.workunit.client.0.smithi066.stdout:1/115: dread d0/dc/fe [0,4194304] 0 2024-09-12T22:49:54.042 INFO:tasks.workunit.client.0.smithi066.stdout:8/147: dwrite f15 [0,4194304] 0 2024-09-12T22:49:54.042 INFO:tasks.workunit.client.0.smithi066.stdout:3/107: dread d0/d2/d7/fc [0,4194304] 0 2024-09-12T22:49:54.043 INFO:tasks.workunit.client.0.smithi066.stdout:9/112: dread d9/f26 [0,4194304] 0 2024-09-12T22:49:54.043 INFO:tasks.workunit.client.0.smithi066.stdout:6/143: creat d6/f2a x:0 0 0 2024-09-12T22:49:54.044 INFO:tasks.workunit.client.0.smithi066.stdout:1/116: creat d0/f1c x:0 0 0 2024-09-12T22:49:54.044 INFO:tasks.workunit.client.0.smithi066.stdout:2/149: dread d1/dd/f14 [0,4194304] 0 2024-09-12T22:49:54.045 INFO:tasks.workunit.client.0.smithi066.stdout:6/144: rmdir d6 39 2024-09-12T22:49:54.045 INFO:tasks.workunit.client.0.smithi066.stdout:8/148: read fa [407980,68936] 0 2024-09-12T22:49:54.045 INFO:tasks.workunit.client.0.smithi066.stdout:5/223: getdents d5/d14 0 2024-09-12T22:49:54.046 INFO:tasks.workunit.client.0.smithi066.stdout:3/108: symlink d0/d2/d6/l2b 0 2024-09-12T22:49:54.046 INFO:tasks.workunit.client.0.smithi066.stdout:4/124: dread d5/d8/d10/f20 [0,4194304] 0 2024-09-12T22:49:54.046 INFO:tasks.workunit.client.0.smithi066.stdout:9/113: write d9/fa [858464,1803] 0 2024-09-12T22:49:54.046 INFO:tasks.workunit.client.0.smithi066.stdout:0/142: dread d1/f10 [0,4194304] 0 2024-09-12T22:49:54.046 INFO:tasks.workunit.client.0.smithi066.stdout:1/117: chown d0/d9 1959648 1 2024-09-12T22:49:54.046 INFO:tasks.workunit.client.0.smithi066.stdout:5/224: chown d5/f24 129 1 2024-09-12T22:49:54.047 INFO:tasks.workunit.client.0.smithi066.stdout:9/114: write f7 [3546064,13637] 0 2024-09-12T22:49:54.047 INFO:tasks.workunit.client.0.smithi066.stdout:2/150: mknod d1/dd/c31 0 2024-09-12T22:49:54.047 INFO:tasks.workunit.client.0.smithi066.stdout:3/109: creat d0/d2/f2c x:0 0 0 2024-09-12T22:49:54.047 INFO:tasks.workunit.client.0.smithi066.stdout:4/125: write d5/d8/d10/de/f27 [303030,117875] 0 2024-09-12T22:49:54.048 INFO:tasks.workunit.client.0.smithi066.stdout:7/124: truncate d0/dc/f1d 2973905 0 2024-09-12T22:49:54.048 INFO:tasks.workunit.client.0.smithi066.stdout:9/115: truncate d9/dc/f27 491642 0 2024-09-12T22:49:54.049 INFO:tasks.workunit.client.0.smithi066.stdout:5/225: rename d5/d14/l30 to d5/d14/d32/l46 0 2024-09-12T22:49:54.049 INFO:tasks.workunit.client.0.smithi066.stdout:0/143: truncate d1/d8/d1c/f17 4991438 0 2024-09-12T22:49:54.050 INFO:tasks.workunit.client.0.smithi066.stdout:2/151: write d1/dd/f14 [1072208,67450] 0 2024-09-12T22:49:54.050 INFO:tasks.workunit.client.0.smithi066.stdout:3/110: fsync d0/d2/d7/f1a 0 2024-09-12T22:49:54.050 INFO:tasks.workunit.client.0.smithi066.stdout:9/116: rmdir d9 39 2024-09-12T22:49:54.050 INFO:tasks.workunit.client.0.smithi066.stdout:4/126: write d5/f24 [222636,19468] 0 2024-09-12T22:49:54.050 INFO:tasks.workunit.client.0.smithi066.stdout:7/125: creat d0/d6/f21 x:0 0 0 2024-09-12T22:49:54.050 INFO:tasks.workunit.client.0.smithi066.stdout:3/111: fsync d0/d2/fa 0 2024-09-12T22:49:54.051 INFO:tasks.workunit.client.0.smithi066.stdout:0/144: fsync d1/d8/d1c/dd/f28 0 2024-09-12T22:49:54.051 INFO:tasks.workunit.client.0.smithi066.stdout:9/117: read f7 [3391195,24301] 0 2024-09-12T22:49:54.051 INFO:tasks.workunit.client.0.smithi066.stdout:5/226: rename d5/de/f37 to d5/d11/d21/f47 0 2024-09-12T22:49:54.052 INFO:tasks.workunit.client.0.smithi066.stdout:4/127: symlink d5/d8/d16/d1b/l2f 0 2024-09-12T22:49:54.052 INFO:tasks.workunit.client.0.smithi066.stdout:7/126: dread - d0/d6/f21 zero size 2024-09-12T22:49:54.053 INFO:tasks.workunit.client.0.smithi066.stdout:3/112: fdatasync d0/d2/d7/f1a 0 2024-09-12T22:49:54.053 INFO:tasks.workunit.client.0.smithi066.stdout:5/227: write d5/f3e [809659,79841] 0 2024-09-12T22:49:54.057 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:54.051+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:54.059 INFO:tasks.workunit.client.0.smithi066.stdout:0/145: creat d1/d8/d1c/f3a x:0 0 0 2024-09-12T22:49:54.059 INFO:tasks.workunit.client.0.smithi066.stdout:9/118: mknod d9/dc/c29 0 2024-09-12T22:49:54.059 INFO:tasks.workunit.client.0.smithi066.stdout:7/127: mknod d0/dc/c22 0 2024-09-12T22:49:54.059 INFO:tasks.workunit.client.0.smithi066.stdout:6/145: dwrite d6/d20/f12 [0,4194304] 0 2024-09-12T22:49:54.059 INFO:tasks.workunit.client.0.smithi066.stdout:3/113: mknod d0/d2/d1d/c2d 0 2024-09-12T22:49:54.059 INFO:tasks.workunit.client.0.smithi066.stdout:9/119: chown d9/fa 14578 1 2024-09-12T22:49:54.060 INFO:tasks.workunit.client.0.smithi066.stdout:8/149: fdatasync f15 0 2024-09-12T22:49:54.060 INFO:tasks.workunit.client.0.smithi066.stdout:6/146: write d6/f1f [1424492,89641] 0 2024-09-12T22:49:54.060 INFO:tasks.workunit.client.0.smithi066.stdout:9/120: write d9/dc/dd/f11 [394649,30368] 0 2024-09-12T22:49:54.060 INFO:tasks.workunit.client.0.smithi066.stdout:1/118: write d0/d9/f14 [340790,81329] 0 2024-09-12T22:49:54.060 INFO:tasks.workunit.client.0.smithi066.stdout:1/119: sync 2024-09-12T22:49:54.060 INFO:tasks.workunit.client.0.smithi066.stdout:9/121: chown f7 0 1 2024-09-12T22:49:54.060 INFO:tasks.workunit.client.0.smithi066.stdout:4/128: creat d5/d8/d10/f30 x:0 0 0 2024-09-12T22:49:54.060 INFO:tasks.workunit.client.0.smithi066.stdout:6/147: mknod d6/d23/c2b 0 2024-09-12T22:49:54.060 INFO:tasks.workunit.client.0.smithi066.stdout:1/120: sync 2024-09-12T22:49:54.060 INFO:tasks.workunit.client.0.smithi066.stdout:2/152: write d1/f3 [4300571,128215] 0 2024-09-12T22:49:54.060 INFO:tasks.workunit.client.0.smithi066.stdout:9/122: fdatasync d9/dc/f28 0 2024-09-12T22:49:54.060 INFO:tasks.workunit.client.0.smithi066.stdout:3/114: mknod d0/d2/c2e 0 2024-09-12T22:49:54.060 INFO:tasks.workunit.client.0.smithi066.stdout:6/148: write d6/d7/f11 [1641138,41049] 0 2024-09-12T22:49:54.061 INFO:tasks.workunit.client.0.smithi066.stdout:4/129: readlink d5/d8/d10/de/l15 0 2024-09-12T22:49:54.061 INFO:tasks.workunit.client.0.smithi066.stdout:1/121: rename d0/d19 to d0/dc/d1d 0 2024-09-12T22:49:54.061 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:54.061 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:54.062 INFO:tasks.workunit.client.0.smithi066.stdout:6/149: readlink d6/d20/l1e 0 2024-09-12T22:49:54.062 INFO:tasks.workunit.client.0.smithi066.stdout:0/146: write d1/d8/d1f/d25/f34 [758737,51105] 0 2024-09-12T22:49:54.066 INFO:tasks.workunit.client.0.smithi066.stdout:8/150: dwrite d17/f22 [0,4194304] 0 2024-09-12T22:49:54.068 INFO:tasks.workunit.client.0.smithi066.stdout:5/228: dwrite f3 [4194304,4194304] 0 2024-09-12T22:49:54.069 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:54.070 INFO:tasks.workunit.client.0.smithi066.stdout:0/147: fdatasync d1/d8/d1c/f17 0 2024-09-12T22:49:54.071 INFO:tasks.workunit.client.0.smithi066.stdout:6/150: getdents d6/d7/dc 0 2024-09-12T22:49:54.071 INFO:tasks.workunit.client.0.smithi066.stdout:8/151: chown d17/d1b/f1e 1 1 2024-09-12T22:49:54.073 INFO:tasks.workunit.client.0.smithi066.stdout:2/153: dwrite d1/d11/f25 [0,4194304] 0 2024-09-12T22:49:54.073 INFO:tasks.workunit.client.0.smithi066.stdout:9/123: dwrite d9/dc/dd/f13 [0,4194304] 0 2024-09-12T22:49:54.074 INFO:tasks.workunit.client.0.smithi066.stdout:3/115: dread d0/d2/d1d/f21 [0,4194304] 0 2024-09-12T22:49:54.074 INFO:tasks.workunit.client.0.smithi066.stdout:4/130: dwrite f1 [0,4194304] 0 2024-09-12T22:49:54.074 INFO:tasks.workunit.client.0.smithi066.stdout:8/152: write d17/f27 [607817,6595] 0 2024-09-12T22:49:54.076 INFO:tasks.workunit.client.0.smithi066.stdout:0/148: link d1/c39 d1/d8/d1b/c3b 0 2024-09-12T22:49:54.076 INFO:tasks.workunit.client.0.smithi066.stdout:1/122: dwrite d0/f16 [4194304,4194304] 0 2024-09-12T22:49:54.076 INFO:tasks.workunit.client.0.smithi066.stdout:7/128: dread d0/f5 [0,4194304] 0 2024-09-12T22:49:54.076 INFO:tasks.workunit.client.0.smithi066.stdout:3/116: fdatasync d0/d2/d1d/f21 0 2024-09-12T22:49:54.076 INFO:tasks.workunit.client.0.smithi066.stdout:9/124: dread - d9/dc/dd/f1d zero size 2024-09-12T22:49:54.077 INFO:tasks.workunit.client.0.smithi066.stdout:4/131: write d5/d8/d10/de/f14 [1119058,123028] 0 2024-09-12T22:49:54.077 INFO:tasks.workunit.client.0.smithi066.stdout:0/149: readlink d1/d8/d1c/d13/l16 0 2024-09-12T22:49:54.078 INFO:tasks.workunit.client.0.smithi066.stdout:1/123: stat d0/f7 0 2024-09-12T22:49:54.079 INFO:tasks.workunit.client.0.smithi066.stdout:7/129: creat d0/dc/f23 x:0 0 0 2024-09-12T22:49:54.079 INFO:tasks.workunit.client.0.smithi066.stdout:3/117: rename d0/d2/d7/d13/c28 to d0/d2/d7/d13/c2f 0 2024-09-12T22:49:54.079 INFO:tasks.workunit.client.0.smithi066.stdout:0/150: symlink d1/d8/d1f/l3c 0 2024-09-12T22:49:54.079 INFO:tasks.workunit.client.0.smithi066.stdout:7/130: fdatasync d0/d6/f21 0 2024-09-12T22:49:54.080 INFO:tasks.workunit.client.0.smithi066.stdout:2/154: getdents d1/dd/d12/d18 0 2024-09-12T22:49:54.081 INFO:tasks.workunit.client.0.smithi066.stdout:4/132: getdents d5/d8 0 2024-09-12T22:49:54.081 INFO:tasks.workunit.client.0.smithi066.stdout:3/118: chown d0/d2/d7/f11 16360 1 2024-09-12T22:49:54.081 INFO:tasks.workunit.client.0.smithi066.stdout:5/229: dread d5/d14/d32/d42/f44 [0,4194304] 0 2024-09-12T22:49:54.081 INFO:tasks.workunit.client.0.smithi066.stdout:2/155: fsync d1/f6 0 2024-09-12T22:49:54.081 INFO:tasks.workunit.client.0.smithi066.stdout:1/124: dread d0/f7 [4194304,4194304] 0 2024-09-12T22:49:54.082 INFO:tasks.workunit.client.0.smithi066.stdout:7/131: truncate d0/d19/f1e 803324 0 2024-09-12T22:49:54.083 INFO:tasks.workunit.client.0.smithi066.stdout:3/119: write d0/d2/fa [3008301,31554] 0 2024-09-12T22:49:54.083 INFO:tasks.workunit.client.0.smithi066.stdout:5/230: creat d5/d14/d32/d42/f48 x:0 0 0 2024-09-12T22:49:54.083 INFO:tasks.workunit.client.0.smithi066.stdout:1/125: mkdir d0/dc/d1e 0 2024-09-12T22:49:54.084 INFO:tasks.workunit.client.0.smithi066.stdout:7/132: chown d0/d6 20343282 1 2024-09-12T22:49:54.085 INFO:tasks.workunit.client.0.smithi066.stdout:9/125: dwrite d9/dc/fe [0,4194304] 0 2024-09-12T22:49:54.085 INFO:tasks.workunit.client.0.smithi066.stdout:4/133: creat d5/d8/d10/f31 x:0 0 0 2024-09-12T22:49:54.085 INFO:tasks.workunit.client.0.smithi066.stdout:3/120: mknod d0/d2/d1d/c30 0 2024-09-12T22:49:54.086 INFO:tasks.workunit.client.0.smithi066.stdout:5/231: mkdir d5/d14/d32/d42/d49 0 2024-09-12T22:49:54.086 INFO:tasks.workunit.client.0.smithi066.stdout:0/151: dread d1/d8/d1c/f17 [0,4194304] 0 2024-09-12T22:49:54.087 INFO:tasks.workunit.client.0.smithi066.stdout:9/126: symlink d9/l2a 0 2024-09-12T22:49:54.087 INFO:tasks.workunit.client.0.smithi066.stdout:4/134: unlink d5/c2e 0 2024-09-12T22:49:54.087 INFO:tasks.workunit.client.0.smithi066.stdout:3/121: mkdir d0/d2/d7/d13/d31 0 2024-09-12T22:49:54.087 INFO:tasks.workunit.client.0.smithi066.stdout:5/232: creat d5/d11/d21/f4a x:0 0 0 2024-09-12T22:49:54.088 INFO:tasks.workunit.client.0.smithi066.stdout:5/233: sync 2024-09-12T22:49:54.088 INFO:tasks.workunit.client.0.smithi066.stdout:0/152: truncate d1/d8/fe 5161336 0 2024-09-12T22:49:54.088 INFO:tasks.workunit.client.0.smithi066.stdout:7/133: dread d0/dc/f1d [0,4194304] 0 2024-09-12T22:49:54.089 INFO:tasks.workunit.client.0.smithi066.stdout:3/122: write d0/d2/d6/f18 [1046760,121940] 0 2024-09-12T22:49:54.089 INFO:tasks.workunit.client.0.smithi066.stdout:4/135: write d5/d8/d10/de/f27 [1316074,115315] 0 2024-09-12T22:49:54.089 INFO:tasks.workunit.client.0.smithi066.stdout:9/127: symlink d9/l2b 0 2024-09-12T22:49:54.090 INFO:tasks.workunit.client.0.smithi066.stdout:0/153: creat d1/d8/d1f/d30/f3d x:0 0 0 2024-09-12T22:49:54.090 INFO:tasks.workunit.client.0.smithi066.stdout:5/234: link d5/d14/l1c d5/d15/l4b 0 2024-09-12T22:49:54.090 INFO:tasks.workunit.client.0.smithi066.stdout:3/123: symlink d0/d2/d1d/l32 0 2024-09-12T22:49:54.090 INFO:tasks.workunit.client.0.smithi066.stdout:5/235: unlink d5/d14/c22 0 2024-09-12T22:49:54.090 INFO:tasks.workunit.client.0.smithi066.stdout:0/154: symlink d1/l3e 0 2024-09-12T22:49:54.091 INFO:tasks.workunit.client.0.smithi066.stdout:4/136: link d5/d8/f19 d5/d8/d16/d1b/d1e/d1f/f32 0 2024-09-12T22:49:54.091 INFO:tasks.workunit.client.0.smithi066.stdout:7/134: rename d0/dc to d0/d19/d24 0 2024-09-12T22:49:54.091 INFO:tasks.workunit.client.0.smithi066.stdout:7/135: sync 2024-09-12T22:49:54.091 INFO:tasks.workunit.client.0.smithi066.stdout:6/151: truncate d6/d20/f12 4050956 0 2024-09-12T22:49:54.092 INFO:tasks.workunit.client.0.smithi066.stdout:6/152: sync 2024-09-12T22:49:54.092 INFO:tasks.workunit.client.0.smithi066.stdout:5/236: write d5/d11/d23/f2b [329764,77768] 0 2024-09-12T22:49:54.092 INFO:tasks.workunit.client.0.smithi066.stdout:3/124: write d0/d2/d1d/f1f [2354347,129777] 0 2024-09-12T22:49:54.092 INFO:tasks.workunit.client.0.smithi066.stdout:7/136: mkdir d0/d6/d25 0 2024-09-12T22:49:54.093 INFO:tasks.workunit.client.0.smithi066.stdout:6/153: mkdir d6/d23/d25/d2c 0 2024-09-12T22:49:54.093 INFO:tasks.workunit.client.0.smithi066.stdout:8/153: read f16 [1105503,119643] 0 2024-09-12T22:49:54.095 INFO:tasks.workunit.client.0.smithi066.stdout:5/237: write d5/d11/f1d [1341033,17488] 0 2024-09-12T22:49:54.095 INFO:tasks.workunit.client.0.smithi066.stdout:6/154: creat d6/d20/d24/f2d x:0 0 0 2024-09-12T22:49:54.095 INFO:tasks.workunit.client.0.smithi066.stdout:8/154: truncate f16 2990775 0 2024-09-12T22:49:54.095 INFO:tasks.workunit.client.0.smithi066.stdout:7/137: write d0/d19/d24/f12 [4188352,108829] 0 2024-09-12T22:49:54.096 INFO:tasks.workunit.client.0.smithi066.stdout:9/128: dwrite d9/dc/dd/f13 [0,4194304] 0 2024-09-12T22:49:54.096 INFO:tasks.workunit.client.0.smithi066.stdout:5/238: chown d5/d15/f17 141 1 2024-09-12T22:49:54.097 INFO:tasks.workunit.client.0.smithi066.stdout:6/155: truncate d6/f1f 2641876 0 2024-09-12T22:49:54.098 INFO:tasks.workunit.client.0.smithi066.stdout:2/156: dwrite d1/d11/f16 [0,4194304] 0 2024-09-12T22:49:54.098 INFO:tasks.workunit.client.0.smithi066.stdout:8/155: creat d17/d1b/f30 x:0 0 0 2024-09-12T22:49:54.099 INFO:tasks.workunit.client.0.smithi066.stdout:5/239: write d5/d14/d32/d42/f48 [228293,85788] 0 2024-09-12T22:49:54.100 INFO:tasks.workunit.client.0.smithi066.stdout:8/156: write f15 [3354421,129763] 0 2024-09-12T22:49:54.100 INFO:tasks.workunit.client.0.smithi066.stdout:2/157: symlink d1/d2a/l32 0 2024-09-12T22:49:54.100 INFO:tasks.workunit.client.0.smithi066.stdout:5/240: chown d5/d11/l20 15 1 2024-09-12T22:49:54.101 INFO:tasks.workunit.client.0.smithi066.stdout:3/125: dread d0/d2/d7/f1a [0,4194304] 0 2024-09-12T22:49:54.101 INFO:tasks.workunit.client.0.smithi066.stdout:2/158: dread - d1/dd/d12/f24 zero size 2024-09-12T22:49:54.102 INFO:tasks.workunit.client.0.smithi066.stdout:5/241: chown d5/de/l18 148 1 2024-09-12T22:49:54.103 INFO:tasks.workunit.client.0.smithi066.stdout:2/159: read d1/dd/f14 [641529,6080] 0 2024-09-12T22:49:54.103 INFO:tasks.workunit.client.0.smithi066.stdout:6/156: dread d6/d20/f18 [0,4194304] 0 2024-09-12T22:49:54.104 INFO:tasks.workunit.client.0.smithi066.stdout:5/242: symlink d5/d11/l4c 0 2024-09-12T22:49:54.107 INFO:tasks.workunit.client.0.smithi066.stdout:2/160: rename d1/dd/d12/d18 to d1/dd/d12/d18/d33 22 2024-09-12T22:49:54.107 INFO:tasks.workunit.client.0.smithi066.stdout:6/157: creat d6/d23/d25/f2e x:0 0 0 2024-09-12T22:49:54.107 INFO:tasks.workunit.client.0.smithi066.stdout:5/243: stat d5/d14/d32/d42/d49 0 2024-09-12T22:49:54.107 INFO:tasks.workunit.client.0.smithi066.stdout:9/129: dwrite d9/dc/d23/f24 [0,4194304] 0 2024-09-12T22:49:54.108 INFO:tasks.workunit.client.0.smithi066.stdout:2/161: write d1/f2b [1742115,39316] 0 2024-09-12T22:49:54.108 INFO:tasks.workunit.client.0.smithi066.stdout:1/126: dwrite d0/f13 [0,4194304] 0 2024-09-12T22:49:54.109 INFO:tasks.workunit.client.0.smithi066.stdout:6/158: creat d6/d20/d24/f2f x:0 0 0 2024-09-12T22:49:54.109 INFO:tasks.workunit.client.0.smithi066.stdout:9/130: rmdir d9/dc/d23 39 2024-09-12T22:49:54.109 INFO:tasks.workunit.client.0.smithi066.stdout:5/244: read d5/d11/f1b [4284125,96534] 0 2024-09-12T22:49:54.110 INFO:tasks.workunit.client.0.smithi066.stdout:2/162: write d1/f8 [3056692,68173] 0 2024-09-12T22:49:54.110 INFO:tasks.workunit.client.0.smithi066.stdout:2/163: sync 2024-09-12T22:49:54.110 INFO:tasks.workunit.client.0.smithi066.stdout:6/159: creat d6/d23/f30 x:0 0 0 2024-09-12T22:49:54.111 INFO:tasks.workunit.client.0.smithi066.stdout:9/131: symlink d9/dc/l2c 0 2024-09-12T22:49:54.111 INFO:tasks.workunit.client.0.smithi066.stdout:1/127: rmdir d0/dc/d15 0 2024-09-12T22:49:54.112 INFO:tasks.workunit.client.0.smithi066.stdout:3/126: dwrite d0/d2/d1d/f2a [0,4194304] 0 2024-09-12T22:49:54.112 INFO:tasks.workunit.client.0.smithi066.stdout:2/164: unlink d1/cc 0 2024-09-12T22:49:54.112 INFO:tasks.workunit.client.0.smithi066.stdout:6/160: symlink d6/d7/dc/l31 0 2024-09-12T22:49:54.114 INFO:tasks.workunit.client.0.smithi066.stdout:6/161: chown d6/d23/f30 0 1 2024-09-12T22:49:54.114 INFO:tasks.workunit.client.0.smithi066.stdout:3/127: mkdir d0/d2/d6/d33 0 2024-09-12T22:49:54.115 INFO:tasks.workunit.client.0.smithi066.stdout:2/165: creat d1/d2a/f34 x:0 0 0 2024-09-12T22:49:54.116 INFO:tasks.workunit.client.0.smithi066.stdout:0/155: write d1/d8/d1c/f17 [2520895,39465] 0 2024-09-12T22:49:54.116 INFO:tasks.workunit.client.0.smithi066.stdout:5/245: dread d5/d15/f17 [0,4194304] 0 2024-09-12T22:49:54.116 INFO:tasks.workunit.client.0.smithi066.stdout:7/138: write d0/f5 [1907420,32929] 0 2024-09-12T22:49:54.116 INFO:tasks.workunit.client.0.smithi066.stdout:8/157: write fa [2565986,107102] 0 2024-09-12T22:49:54.117 INFO:tasks.workunit.client.0.smithi066.stdout:8/158: sync 2024-09-12T22:49:54.117 INFO:tasks.workunit.client.0.smithi066.stdout:2/166: creat d1/dd/d12/d1e/f35 x:0 0 0 2024-09-12T22:49:54.118 INFO:tasks.workunit.client.0.smithi066.stdout:2/167: dread - d1/dd/f2c zero size 2024-09-12T22:49:54.119 INFO:tasks.workunit.client.0.smithi066.stdout:9/132: rename d9/dc/d23/f24 to d9/dc/f2d 0 2024-09-12T22:49:54.120 INFO:tasks.workunit.client.0.smithi066.stdout:4/137: dread d5/d8/d10/de/f27 [0,4194304] 0 2024-09-12T22:49:54.120 INFO:tasks.workunit.client.0.smithi066.stdout:2/168: stat d1/f8 0 2024-09-12T22:49:54.121 INFO:tasks.workunit.client.0.smithi066.stdout:3/128: getdents d0/d2/d7/d13 0 2024-09-12T22:49:54.121 INFO:tasks.workunit.client.0.smithi066.stdout:1/128: dwrite d0/dc/fe [0,4194304] 0 2024-09-12T22:49:54.122 INFO:tasks.workunit.client.0.smithi066.stdout:8/159: link d17/l26 d17/l31 0 2024-09-12T22:49:54.123 INFO:tasks.workunit.client.0.smithi066.stdout:7/139: rename d0/d6/d25 to d0/d19/d26 0 2024-09-12T22:49:54.124 INFO:tasks.workunit.client.0.smithi066.stdout:9/133: mknod d9/dc/d23/c2e 0 2024-09-12T22:49:54.124 INFO:tasks.workunit.client.0.smithi066.stdout:9/134: sync 2024-09-12T22:49:54.124 INFO:tasks.workunit.client.0.smithi066.stdout:1/129: rmdir d0/dc/d1d 39 2024-09-12T22:49:54.125 INFO:tasks.workunit.client.0.smithi066.stdout:2/169: write d1/dd/f2c [891939,116946] 0 2024-09-12T22:49:54.125 INFO:tasks.workunit.client.0.smithi066.stdout:4/138: unlink d5/d8/d16/d1b/d1e/d1f/f32 0 2024-09-12T22:49:54.126 INFO:tasks.workunit.client.0.smithi066.stdout:8/160: creat d17/d2c/f32 x:0 0 0 2024-09-12T22:49:54.127 INFO:tasks.workunit.client.0.smithi066.stdout:4/139: creat d5/f33 x:0 0 0 2024-09-12T22:49:54.128 INFO:tasks.workunit.client.0.smithi066.stdout:9/135: rmdir d9/dc/dd 39 2024-09-12T22:49:54.128 INFO:tasks.workunit.client.0.smithi066.stdout:7/140: mkdir d0/d6/d18/d27 0 2024-09-12T22:49:54.128 INFO:tasks.workunit.client.0.smithi066.stdout:7/141: sync 2024-09-12T22:49:54.129 INFO:tasks.workunit.client.0.smithi066.stdout:0/156: dwrite d1/d8/d1c/d13/f22 [0,4194304] 0 2024-09-12T22:49:54.129 INFO:tasks.workunit.client.0.smithi066.stdout:1/130: chown d0/f1c 774905262 1 2024-09-12T22:49:54.129 INFO:tasks.workunit.client.0.smithi066.stdout:6/162: dwrite d6/f17 [0,4194304] 0 2024-09-12T22:49:54.129 INFO:tasks.workunit.client.0.smithi066.stdout:5/246: dwrite d5/d11/d23/f2f [0,4194304] 0 2024-09-12T22:49:54.130 INFO:tasks.workunit.client.0.smithi066.stdout:3/129: rename d0/d2/d7/d13/l15 to d0/d2/d7/d13/l34 0 2024-09-12T22:49:54.130 INFO:tasks.workunit.client.0.smithi066.stdout:0/157: fsync d1/f10 0 2024-09-12T22:49:54.131 INFO:tasks.workunit.client.0.smithi066.stdout:6/163: mkdir d6/d20/d32 0 2024-09-12T22:49:54.131 INFO:tasks.workunit.client.0.smithi066.stdout:8/161: write f16 [3970648,66752] 0 2024-09-12T22:49:54.131 INFO:tasks.workunit.client.0.smithi066.stdout:7/142: rename d0/d19/d24/f23 to d0/d19/d26/f28 0 2024-09-12T22:49:54.131 INFO:tasks.workunit.client.0.smithi066.stdout:5/247: readlink d5/d11/d21/l3a 0 2024-09-12T22:49:54.132 INFO:tasks.workunit.client.0.smithi066.stdout:0/158: unlink d1/f2d 0 2024-09-12T22:49:54.132 INFO:tasks.workunit.client.0.smithi066.stdout:3/130: mknod d0/d2/d6/c35 0 2024-09-12T22:49:54.132 INFO:tasks.workunit.client.0.smithi066.stdout:4/140: link d5/d8/d10/f31 d5/d8/d16/d26/f34 0 2024-09-12T22:49:54.133 INFO:tasks.workunit.client.0.smithi066.stdout:6/164: unlink d6/d7/f1a 0 2024-09-12T22:49:54.134 INFO:tasks.workunit.client.0.smithi066.stdout:0/159: fdatasync d1/d8/fe 0 2024-09-12T22:49:54.135 INFO:tasks.workunit.client.0.smithi066.stdout:7/143: mkdir d0/d6/d18/d27/d29 0 2024-09-12T22:49:54.135 INFO:tasks.workunit.client.0.smithi066.stdout:6/165: mkdir d6/d20/d24/d33 0 2024-09-12T22:49:54.136 INFO:tasks.workunit.client.0.smithi066.stdout:3/131: rename d0/c16 to d0/d2/d6/d33/c36 0 2024-09-12T22:49:54.136 INFO:tasks.workunit.client.0.smithi066.stdout:0/160: dread - d1/f2a zero size 2024-09-12T22:49:54.137 INFO:tasks.workunit.client.0.smithi066.stdout:4/141: creat d5/d8/d16/f35 x:0 0 0 2024-09-12T22:49:54.138 INFO:tasks.workunit.client.0.smithi066.stdout:7/144: creat d0/d6/d18/d27/f2a x:0 0 0 2024-09-12T22:49:54.139 INFO:tasks.workunit.client.0.smithi066.stdout:0/161: read - d1/d8/f35 zero size 2024-09-12T22:49:54.141 INFO:tasks.workunit.client.0.smithi066.stdout:2/170: dwrite d1/d2a/f34 [0,4194304] 0 2024-09-12T22:49:54.141 INFO:tasks.workunit.client.0.smithi066.stdout:4/142: creat d5/d8/d10/f36 x:0 0 0 2024-09-12T22:49:54.141 INFO:tasks.workunit.client.0.smithi066.stdout:1/131: dwrite d0/dc/fe [0,4194304] 0 2024-09-12T22:49:54.142 INFO:tasks.workunit.client.0.smithi066.stdout:3/132: creat d0/d2/d7/d13/d31/f37 x:0 0 0 2024-09-12T22:49:54.142 INFO:tasks.workunit.client.0.smithi066.stdout:7/145: symlink d0/d19/d26/l2b 0 2024-09-12T22:49:54.143 INFO:tasks.workunit.client.0.smithi066.stdout:9/136: getdents d9/dc 0 2024-09-12T22:49:54.143 INFO:tasks.workunit.client.0.smithi066.stdout:5/248: dread d5/d11/f40 [0,4194304] 0 2024-09-12T22:49:54.143 INFO:tasks.workunit.client.0.smithi066.stdout:4/143: stat d5/d8/c2c 0 2024-09-12T22:49:54.143 INFO:tasks.workunit.client.0.smithi066.stdout:0/162: mknod d1/d8/d1b/c3f 0 2024-09-12T22:49:54.144 INFO:tasks.workunit.client.0.smithi066.stdout:1/132: stat d0/dc/fe 0 2024-09-12T22:49:54.144 INFO:tasks.workunit.client.0.smithi066.stdout:8/162: dwrite d17/d2c/f32 [0,4194304] 0 2024-09-12T22:49:54.145 INFO:tasks.workunit.client.0.smithi066.stdout:2/171: mknod d1/db/c36 0 2024-09-12T22:49:54.145 INFO:tasks.workunit.client.0.smithi066.stdout:9/137: unlink d9/f1c 0 2024-09-12T22:49:54.145 INFO:tasks.workunit.client.0.smithi066.stdout:1/133: fdatasync d0/ff 0 2024-09-12T22:49:54.145 INFO:tasks.workunit.client.0.smithi066.stdout:5/249: mkdir d5/d11/d21/d4d 0 2024-09-12T22:49:54.146 INFO:tasks.workunit.client.0.smithi066.stdout:3/133: chown d0/d2/d7/c17 2314 1 2024-09-12T22:49:54.146 INFO:tasks.workunit.client.0.smithi066.stdout:4/144: fdatasync d5/d8/d10/f30 0 2024-09-12T22:49:54.146 INFO:tasks.workunit.client.0.smithi066.stdout:2/172: symlink d1/d2a/l37 0 2024-09-12T22:49:54.146 INFO:tasks.workunit.client.0.smithi066.stdout:8/163: symlink d17/l33 0 2024-09-12T22:49:54.147 INFO:tasks.workunit.client.0.smithi066.stdout:9/138: write d9/f26 [523439,76991] 0 2024-09-12T22:49:54.148 INFO:tasks.workunit.client.0.smithi066.stdout:0/163: write d1/d8/d1c/d13/f22 [1014601,84284] 0 2024-09-12T22:49:54.148 INFO:tasks.workunit.client.0.smithi066.stdout:8/164: read d17/f22 [1135171,60443] 0 2024-09-12T22:49:54.149 INFO:tasks.workunit.client.0.smithi066.stdout:4/145: dread d5/f24 [0,4194304] 0 2024-09-12T22:49:54.149 INFO:tasks.workunit.client.0.smithi066.stdout:2/173: symlink d1/dd/d12/l38 0 2024-09-12T22:49:54.149 INFO:tasks.workunit.client.0.smithi066.stdout:6/166: dread d6/d7/f11 [0,4194304] 0 2024-09-12T22:49:54.149 INFO:tasks.workunit.client.0.smithi066.stdout:5/250: rmdir d5/d45 0 2024-09-12T22:49:54.150 INFO:tasks.workunit.client.0.smithi066.stdout:3/134: creat d0/f38 x:0 0 0 2024-09-12T22:49:54.150 INFO:tasks.workunit.client.0.smithi066.stdout:8/165: write d17/f27 [576970,74624] 0 2024-09-12T22:49:54.151 INFO:tasks.workunit.client.0.smithi066.stdout:4/146: fsync d5/d8/d10/de/f2b 0 2024-09-12T22:49:54.151 INFO:tasks.workunit.client.0.smithi066.stdout:0/164: mknod d1/d8/d1c/d13/d2f/c40 0 2024-09-12T22:49:54.151 INFO:tasks.workunit.client.0.smithi066.stdout:5/251: stat d5/d14/c19 0 2024-09-12T22:49:54.152 INFO:tasks.workunit.client.0.smithi066.stdout:3/135: read d0/d2/d1d/f1f [1680196,102060] 0 2024-09-12T22:49:54.152 INFO:tasks.workunit.client.0.smithi066.stdout:2/174: rename d1/f8 to d1/dd/d12/d1e/f39 0 2024-09-12T22:49:54.153 INFO:tasks.workunit.client.0.smithi066.stdout:8/166: creat d17/d2c/f34 x:0 0 0 2024-09-12T22:49:54.153 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:54.152+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:54.154 INFO:tasks.workunit.client.0.smithi066.stdout:5/252: chown d5/d11/d23/c27 13864067 1 2024-09-12T22:49:54.154 INFO:tasks.workunit.client.0.smithi066.stdout:8/167: stat d17/d2c/f32 0 2024-09-12T22:49:54.155 INFO:tasks.workunit.client.0.smithi066.stdout:0/165: write d1/d8/d1c/d13/f22 [5200072,46354] 0 2024-09-12T22:49:54.155 INFO:tasks.workunit.client.0.smithi066.stdout:1/134: dwrite d0/d9/f14 [0,4194304] 0 2024-09-12T22:49:54.155 INFO:tasks.workunit.client.0.smithi066.stdout:3/136: creat d0/d2/d7/d13/f39 x:0 0 0 2024-09-12T22:49:54.155 INFO:tasks.workunit.client.0.smithi066.stdout:2/175: mknod d1/d11/d26/c3a 0 2024-09-12T22:49:54.156 INFO:tasks.workunit.client.0.smithi066.stdout:5/253: creat d5/d11/d23/f4e x:0 0 0 2024-09-12T22:49:54.156 INFO:tasks.workunit.client.0.smithi066.stdout:8/168: creat d17/d2c/f35 x:0 0 0 2024-09-12T22:49:54.157 INFO:tasks.workunit.client.0.smithi066.stdout:4/147: dread d5/d8/d10/de/f27 [0,4194304] 0 2024-09-12T22:49:54.157 INFO:tasks.workunit.client.0.smithi066.stdout:3/137: dread - d0/d2/f24 zero size 2024-09-12T22:49:54.157 INFO:tasks.workunit.client.0.smithi066.stdout:1/135: write d0/dc/f17 [206359,107686] 0 2024-09-12T22:49:54.158 INFO:tasks.workunit.client.0.smithi066.stdout:0/166: write d1/d8/d1f/d25/f34 [2824886,81001] 0 2024-09-12T22:49:54.158 INFO:tasks.workunit.client.0.smithi066.stdout:5/254: creat d5/d15/f4f x:0 0 0 2024-09-12T22:49:54.158 INFO:tasks.workunit.client.0.smithi066.stdout:8/169: creat d17/f36 x:0 0 0 2024-09-12T22:49:54.159 INFO:tasks.workunit.client.0.smithi066.stdout:6/167: dwrite d6/d7/dc/f21 [0,4194304] 0 2024-09-12T22:49:54.160 INFO:tasks.workunit.client.0.smithi066.stdout:3/138: truncate d0/d2/f24 629622 0 2024-09-12T22:49:54.160 INFO:tasks.workunit.client.0.smithi066.stdout:7/146: dread d0/d19/f1e [0,4194304] 0 2024-09-12T22:49:54.160 INFO:tasks.workunit.client.0.smithi066.stdout:3/139: write d0/f38 [439164,59767] 0 2024-09-12T22:49:54.161 INFO:tasks.workunit.client.0.smithi066.stdout:0/167: creat d1/d8/f41 x:0 0 0 2024-09-12T22:49:54.162 INFO:tasks.workunit.client.0.smithi066.stdout:6/168: fdatasync d6/d23/f27 0 2024-09-12T22:49:54.162 INFO:tasks.workunit.client.0.smithi066.stdout:4/148: symlink d5/d8/d10/de/d2d/l37 0 2024-09-12T22:49:54.162 INFO:tasks.workunit.client.0.smithi066.stdout:0/168: symlink d1/d8/d1f/l42 0 2024-09-12T22:49:54.163 INFO:tasks.workunit.client.0.smithi066.stdout:1/136: rename d0/d9/c12 to d0/dc/d1d/c1f 0 2024-09-12T22:49:54.163 INFO:tasks.workunit.client.0.smithi066.stdout:3/140: creat d0/d2/d7/d29/f3a x:0 0 0 2024-09-12T22:49:54.163 INFO:tasks.workunit.client.0.smithi066.stdout:6/169: fdatasync d6/d20/d24/f2d 0 2024-09-12T22:49:54.163 INFO:tasks.workunit.client.0.smithi066.stdout:8/170: getdents d17/d1b 0 2024-09-12T22:49:54.163 INFO:tasks.workunit.client.0.smithi066.stdout:5/255: rename d5/d14/d32 to d5/de/d50 0 2024-09-12T22:49:54.164 INFO:tasks.workunit.client.0.smithi066.stdout:1/137: mknod d0/d9/c20 0 2024-09-12T22:49:54.164 INFO:tasks.workunit.client.0.smithi066.stdout:4/149: write d5/d8/d16/f35 [504734,116589] 0 2024-09-12T22:49:54.164 INFO:tasks.workunit.client.0.smithi066.stdout:3/141: chown d0/d2/d1d/f2a 194 1 2024-09-12T22:49:54.164 INFO:tasks.workunit.client.0.smithi066.stdout:8/171: dread - d17/d1b/f2e zero size 2024-09-12T22:49:54.165 INFO:tasks.workunit.client.0.smithi066.stdout:8/172: fsync f15 0 2024-09-12T22:49:54.165 INFO:tasks.workunit.client.0.smithi066.stdout:0/169: dread d1/d8/d1b/f24 [0,4194304] 0 2024-09-12T22:49:54.165 INFO:tasks.workunit.client.0.smithi066.stdout:8/173: fdatasync d17/d2c/f35 0 2024-09-12T22:49:54.166 INFO:tasks.workunit.client.0.smithi066.stdout:3/142: truncate d0/d2/d6/fd 643312 0 2024-09-12T22:49:54.166 INFO:tasks.workunit.client.0.smithi066.stdout:8/174: fdatasync d17/d1b/f2e 0 2024-09-12T22:49:54.167 INFO:tasks.workunit.client.0.smithi066.stdout:0/170: write d1/d8/d1c/dd/f28 [527087,77614] 0 2024-09-12T22:49:54.167 INFO:tasks.workunit.client.0.smithi066.stdout:4/150: read d5/d8/d16/f35 [13253,117041] 0 2024-09-12T22:49:54.167 INFO:tasks.workunit.client.0.smithi066.stdout:7/147: dread d0/d6/f9 [4194304,4194304] 0 2024-09-12T22:49:54.167 INFO:tasks.workunit.client.0.smithi066.stdout:6/170: dread d6/d7/f11 [0,4194304] 0 2024-09-12T22:49:54.168 INFO:tasks.workunit.client.0.smithi066.stdout:3/143: symlink d0/d2/d7/d29/l3b 0 2024-09-12T22:49:54.168 INFO:tasks.workunit.client.0.smithi066.stdout:4/151: truncate d5/f33 109992 0 2024-09-12T22:49:54.168 INFO:tasks.workunit.client.0.smithi066.stdout:7/148: fdatasync d0/d6/d18/d27/f2a 0 2024-09-12T22:49:54.168 INFO:tasks.workunit.client.0.smithi066.stdout:8/175: dread d17/f21 [0,4194304] 0 2024-09-12T22:49:54.168 INFO:tasks.workunit.client.0.smithi066.stdout:3/144: chown d0/l5 6258 1 2024-09-12T22:49:54.169 INFO:tasks.workunit.client.0.smithi066.stdout:0/171: dread d1/d8/d1c/f17 [4194304,4194304] 0 2024-09-12T22:49:54.169 INFO:tasks.workunit.client.0.smithi066.stdout:6/171: getdents d6/d23 0 2024-09-12T22:49:54.169 INFO:tasks.workunit.client.0.smithi066.stdout:7/149: write d0/d19/d26/f28 [470179,20805] 0 2024-09-12T22:49:54.171 INFO:tasks.workunit.client.0.smithi066.stdout:5/256: getdents d5/d11/d23 0 2024-09-12T22:49:54.171 INFO:tasks.workunit.client.0.smithi066.stdout:7/150: symlink d0/d19/d24/l2c 0 2024-09-12T22:49:54.172 INFO:tasks.workunit.client.0.smithi066.stdout:0/172: getdents d1/d8/d1c/d13 0 2024-09-12T22:49:54.172 INFO:tasks.workunit.client.0.smithi066.stdout:7/151: chown d0/ff 572 1 2024-09-12T22:49:54.172 INFO:tasks.workunit.client.0.smithi066.stdout:0/173: readlink d1/d8/d1f/l42 0 2024-09-12T22:49:54.173 INFO:tasks.workunit.client.0.smithi066.stdout:0/174: creat d1/d8/d1b/f43 x:0 0 0 2024-09-12T22:49:54.174 INFO:tasks.workunit.client.0.smithi066.stdout:8/176: fsync d17/f36 0 2024-09-12T22:49:54.174 INFO:tasks.workunit.client.0.smithi066.stdout:2/176: truncate d1/f3 2217949 0 2024-09-12T22:49:54.174 INFO:tasks.workunit.client.0.smithi066.stdout:3/145: dwrite d0/d2/f24 [0,4194304] 0 2024-09-12T22:49:54.175 INFO:tasks.workunit.client.0.smithi066.stdout:0/175: read d1/f7 [2452990,112413] 0 2024-09-12T22:49:54.177 INFO:tasks.workunit.client.0.smithi066.stdout:0/176: fsync d1/f2a 0 2024-09-12T22:49:54.177 INFO:tasks.workunit.client.0.smithi066.stdout:8/177: chown d17/l28 534564 1 2024-09-12T22:49:54.178 INFO:tasks.workunit.client.0.smithi066.stdout:2/177: creat d1/dd/d12/f3b x:0 0 0 2024-09-12T22:49:54.178 INFO:tasks.workunit.client.0.smithi066.stdout:6/172: truncate d6/fb 2001555 0 2024-09-12T22:49:54.179 INFO:tasks.workunit.client.0.smithi066.stdout:5/257: dwrite d5/d11/d23/f4e [0,4194304] 0 2024-09-12T22:49:54.179 INFO:tasks.workunit.client.0.smithi066.stdout:3/146: rename d0/d2/d7/d29/f3a to d0/d2/d7/d29/f3c 0 2024-09-12T22:49:54.179 INFO:tasks.workunit.client.0.smithi066.stdout:8/178: getdents d17/d1b 0 2024-09-12T22:49:54.180 INFO:tasks.workunit.client.0.smithi066.stdout:6/173: write d6/d23/f30 [426883,98309] 0 2024-09-12T22:49:54.181 INFO:tasks.workunit.client.0.smithi066.stdout:2/178: rename d1/dd/d12/l1d to d1/dd/d12/l3c 0 2024-09-12T22:49:54.181 INFO:tasks.workunit.client.0.smithi066.stdout:8/179: chown l3 31 1 2024-09-12T22:49:54.182 INFO:tasks.workunit.client.0.smithi066.stdout:6/174: mknod d6/d20/c34 0 2024-09-12T22:49:54.182 INFO:tasks.workunit.client.0.smithi066.stdout:2/179: stat d1/d11/l1c 0 2024-09-12T22:49:54.182 INFO:tasks.workunit.client.0.smithi066.stdout:4/152: dwrite d5/d8/f19 [0,4194304] 0 2024-09-12T22:49:54.182 INFO:tasks.workunit.client.0.smithi066.stdout:3/147: truncate d0/d2/d7/d13/f39 603074 0 2024-09-12T22:49:54.182 INFO:tasks.workunit.client.0.smithi066.stdout:8/180: rename d17/f36 to d17/d2c/f37 0 2024-09-12T22:49:54.183 INFO:tasks.workunit.client.0.smithi066.stdout:6/175: mkdir d6/d35 0 2024-09-12T22:49:54.183 INFO:tasks.workunit.client.0.smithi066.stdout:2/180: mkdir d1/dd/d3d 0 2024-09-12T22:49:54.183 INFO:tasks.workunit.client.0.smithi066.stdout:3/148: read d0/d2/d1d/f23 [592960,73659] 0 2024-09-12T22:49:54.183 INFO:tasks.workunit.client.0.smithi066.stdout:8/181: creat d17/d2c/f38 x:0 0 0 2024-09-12T22:49:54.184 INFO:tasks.workunit.client.0.smithi066.stdout:6/176: mknod d6/d20/d32/c36 0 2024-09-12T22:49:54.185 INFO:tasks.workunit.client.0.smithi066.stdout:8/182: chown cc 17128206 1 2024-09-12T22:49:54.187 INFO:tasks.workunit.client.0.smithi066.stdout:6/177: rename d6/d20/d24/f2d to d6/d7/dc/f37 0 2024-09-12T22:49:54.187 INFO:tasks.workunit.client.0.smithi066.stdout:8/183: rename d17/l1c to d17/l39 0 2024-09-12T22:49:54.188 INFO:tasks.workunit.client.0.smithi066.stdout:8/184: chown l3 2183 1 2024-09-12T22:49:54.188 INFO:tasks.workunit.client.0.smithi066.stdout:4/153: dread d5/d8/d16/d1b/f28 [0,4194304] 0 2024-09-12T22:49:54.189 INFO:tasks.workunit.client.0.smithi066.stdout:7/152: truncate d0/d19/d24/f1d 2176801 0 2024-09-12T22:49:54.190 INFO:tasks.workunit.client.0.smithi066.stdout:2/181: dread d1/f2b [0,4194304] 0 2024-09-12T22:49:54.190 INFO:tasks.workunit.client.0.smithi066.stdout:8/185: getdents d17/d1b 0 2024-09-12T22:49:54.191 INFO:tasks.workunit.client.0.smithi066.stdout:3/149: dwrite d0/d2/d6/fd [0,4194304] 0 2024-09-12T22:49:54.191 INFO:tasks.workunit.client.0.smithi066.stdout:4/154: write d5/d8/d16/d1b/f28 [443612,74377] 0 2024-09-12T22:49:54.192 INFO:tasks.workunit.client.0.smithi066.stdout:8/186: symlink d17/d2c/l3a 0 2024-09-12T22:49:54.193 INFO:tasks.workunit.client.0.smithi066.stdout:4/155: mkdir d5/d8/d16/d1b/d1e/d38 0 2024-09-12T22:49:54.193 INFO:tasks.workunit.client.0.smithi066.stdout:7/153: link d0/l13 d0/d6/l2d 0 2024-09-12T22:49:54.194 INFO:tasks.workunit.client.0.smithi066.stdout:7/154: stat d0/d19/d24/f1f 0 2024-09-12T22:49:54.194 INFO:tasks.workunit.client.0.smithi066.stdout:6/178: dwrite d6/d23/f30 [0,4194304] 0 2024-09-12T22:49:54.194 INFO:tasks.workunit.client.0.smithi066.stdout:4/156: mkdir d5/d8/d10/de/d39 0 2024-09-12T22:49:54.195 INFO:tasks.workunit.client.0.smithi066.stdout:7/155: stat d0/d19/d24/l15 0 2024-09-12T22:49:54.196 INFO:tasks.workunit.client.0.smithi066.stdout:9/139: dread f7 [0,4194304] 0 2024-09-12T22:49:54.197 INFO:tasks.workunit.client.0.smithi066.stdout:6/179: symlink d6/d20/d32/l38 0 2024-09-12T22:49:54.197 INFO:tasks.workunit.client.0.smithi066.stdout:9/140: rename d9/dc/d23/c2e to d9/dc/c2f 0 2024-09-12T22:49:54.197 INFO:tasks.workunit.client.0.smithi066.stdout:7/156: creat d0/d6/f2e x:0 0 0 2024-09-12T22:49:54.197 INFO:tasks.workunit.client.0.smithi066.stdout:2/182: dwrite d1/d2a/f34 [4194304,4194304] 0 2024-09-12T22:49:54.198 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:54.198 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:54.201 INFO:tasks.workunit.client.0.smithi066.stdout:2/183: dread d1/f2b [0,4194304] 0 2024-09-12T22:49:54.202 INFO:tasks.workunit.client.0.smithi066.stdout:2/184: creat d1/dd/d12/d18/f3e x:0 0 0 2024-09-12T22:49:54.203 INFO:tasks.workunit.client.0.smithi066.stdout:2/185: stat d1/d2a/l32 0 2024-09-12T22:49:54.203 INFO:tasks.workunit.client.0.smithi066.stdout:4/157: dwrite d5/f24 [0,4194304] 0 2024-09-12T22:49:54.204 INFO:tasks.workunit.client.0.smithi066.stdout:4/158: readlink d5/d8/d10/lf 0 2024-09-12T22:49:54.205 INFO:tasks.workunit.client.0.smithi066.stdout:9/141: dwrite d9/dc/dd/f13 [0,4194304] 0 2024-09-12T22:49:54.205 INFO:tasks.workunit.client.0.smithi066.stdout:2/186: creat d1/dd/d3d/f3f x:0 0 0 2024-09-12T22:49:54.206 INFO:tasks.workunit.client.0.smithi066.stdout:2/187: mknod d1/dd/d3d/c40 0 2024-09-12T22:49:54.206 INFO:tasks.workunit.client.0.smithi066.stdout:9/142: write d9/dc/dd/f1b [908755,24959] 0 2024-09-12T22:49:54.206 INFO:tasks.workunit.client.0.smithi066.stdout:1/138: sync 2024-09-12T22:49:54.207 INFO:tasks.workunit.client.0.smithi066.stdout:9/143: chown d9/l2b 13233 1 2024-09-12T22:49:54.207 INFO:tasks.workunit.client.0.smithi066.stdout:1/139: mkdir d0/d9/d21 0 2024-09-12T22:49:54.208 INFO:tasks.workunit.client.0.smithi066.stdout:2/188: dread - d1/dd/d12/d18/f3e zero size 2024-09-12T22:49:54.210 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:54.211 INFO:tasks.workunit.client.0.smithi066.stdout:2/189: mknod d1/dd/d12/d1e/c41 0 2024-09-12T22:49:54.211 INFO:tasks.workunit.client.0.smithi066.stdout:9/144: creat d9/dc/d23/f30 x:0 0 0 2024-09-12T22:49:54.212 INFO:tasks.workunit.client.0.smithi066.stdout:6/180: dwrite d6/d23/f30 [4194304,4194304] 0 2024-09-12T22:49:54.212 INFO:tasks.workunit.client.0.smithi066.stdout:4/159: dwrite d5/d8/d10/f1a [0,4194304] 0 2024-09-12T22:49:54.212 INFO:tasks.workunit.client.0.smithi066.stdout:9/145: write d9/dc/dd/f1b [1053206,1515] 0 2024-09-12T22:49:54.214 INFO:tasks.workunit.client.0.smithi066.stdout:4/160: symlink d5/d8/d10/de/l3a 0 2024-09-12T22:49:54.214 INFO:tasks.workunit.client.0.smithi066.stdout:9/146: mkdir d9/d31 0 2024-09-12T22:49:54.215 INFO:tasks.workunit.client.0.smithi066.stdout:1/140: dread d0/d9/f14 [0,4194304] 0 2024-09-12T22:49:54.216 INFO:tasks.workunit.client.0.smithi066.stdout:4/161: creat d5/d8/d10/de/d39/f3b x:0 0 0 2024-09-12T22:49:54.217 INFO:tasks.workunit.client.0.smithi066.stdout:9/147: write d9/dc/f1f [555235,38989] 0 2024-09-12T22:49:54.218 INFO:tasks.workunit.client.0.smithi066.stdout:9/148: chown d9/dc/f1f 2641 1 2024-09-12T22:49:54.218 INFO:tasks.workunit.client.0.smithi066.stdout:2/190: dwrite d1/dd/d12/d1e/f35 [0,4194304] 0 2024-09-12T22:49:54.219 INFO:tasks.workunit.client.0.smithi066.stdout:4/162: dread d5/d8/d10/de/f27 [0,4194304] 0 2024-09-12T22:49:54.220 INFO:tasks.workunit.client.0.smithi066.stdout:9/149: creat d9/f32 x:0 0 0 2024-09-12T22:49:54.220 INFO:tasks.workunit.client.0.smithi066.stdout:9/150: dread - d9/dc/dd/f1d zero size 2024-09-12T22:49:54.221 INFO:tasks.workunit.client.0.smithi066.stdout:4/163: link d5/c11 d5/d8/d16/d1b/d1e/c3c 0 2024-09-12T22:49:54.222 INFO:tasks.workunit.client.0.smithi066.stdout:4/164: write d5/d8/d10/f1a [4589417,69735] 0 2024-09-12T22:49:54.223 INFO:tasks.workunit.client.0.smithi066.stdout:4/165: symlink d5/d8/d16/d1b/d1e/l3d 0 2024-09-12T22:49:54.224 INFO:tasks.workunit.client.0.smithi066.stdout:4/166: rename d5/d8/d16/d26 to d5/d3e 0 2024-09-12T22:49:54.224 INFO:tasks.workunit.client.0.smithi066.stdout:4/167: dread - d5/d8/d10/f31 zero size 2024-09-12T22:49:54.224 INFO:tasks.workunit.client.0.smithi066.stdout:3/150: dread d0/d2/d7/d13/f14 [0,4194304] 0 2024-09-12T22:49:54.225 INFO:tasks.workunit.client.0.smithi066.stdout:3/151: readlink d0/d2/l22 0 2024-09-12T22:49:54.227 INFO:tasks.workunit.client.0.smithi066.stdout:2/191: read d1/dd/d12/f21 [321872,110668] 0 2024-09-12T22:49:54.228 INFO:tasks.workunit.client.0.smithi066.stdout:2/192: unlink d1/dd/d12/f3b 0 2024-09-12T22:49:54.228 INFO:tasks.workunit.client.0.smithi066.stdout:1/141: read d0/ff [274713,126342] 0 2024-09-12T22:49:54.229 INFO:tasks.workunit.client.0.smithi066.stdout:4/168: getdents d5/d8/d10/de 0 2024-09-12T22:49:54.229 INFO:tasks.workunit.client.0.smithi066.stdout:2/193: stat d1/dd/d12/d1e 0 2024-09-12T22:49:54.229 INFO:tasks.workunit.client.0.smithi066.stdout:3/152: dwrite d0/d2/d7/f11 [0,4194304] 0 2024-09-12T22:49:54.230 INFO:tasks.workunit.client.0.smithi066.stdout:1/142: write d0/dc/fe [5118354,73323] 0 2024-09-12T22:49:54.231 INFO:tasks.workunit.client.0.smithi066.stdout:9/151: truncate d9/dc/f2d 1863043 0 2024-09-12T22:49:54.231 INFO:tasks.workunit.client.0.smithi066.stdout:2/194: mkdir d1/db/d42 0 2024-09-12T22:49:54.232 INFO:tasks.workunit.client.0.smithi066.stdout:1/143: dread - d0/f1c zero size 2024-09-12T22:49:54.233 INFO:tasks.workunit.client.0.smithi066.stdout:4/169: creat d5/d8/d16/d1b/d1e/d38/f3f x:0 0 0 2024-09-12T22:49:54.233 INFO:tasks.workunit.client.0.smithi066.stdout:3/153: rename d0/d2/d7/fc to d0/d2/d7/d29/f3d 0 2024-09-12T22:49:54.234 INFO:tasks.workunit.client.0.smithi066.stdout:6/181: dwrite d6/fb [0,4194304] 0 2024-09-12T22:49:54.235 INFO:tasks.workunit.client.0.smithi066.stdout:3/154: link d0/d2/d7/c17 d0/c3e 0 2024-09-12T22:49:54.236 INFO:tasks.workunit.client.0.smithi066.stdout:8/187: sync 2024-09-12T22:49:54.236 INFO:tasks.workunit.client.0.smithi066.stdout:5/258: sync 2024-09-12T22:49:54.236 INFO:tasks.workunit.client.0.smithi066.stdout:0/177: sync 2024-09-12T22:49:54.240 INFO:tasks.workunit.client.0.smithi066.stdout:5/259: write d5/f3e [1887003,10678] 0 2024-09-12T22:49:54.241 INFO:tasks.workunit.client.0.smithi066.stdout:0/178: truncate d1/f2 5935069 0 2024-09-12T22:49:54.241 INFO:tasks.workunit.client.0.smithi066.stdout:8/188: unlink d17/d1b/l2d 0 2024-09-12T22:49:54.242 INFO:tasks.workunit.client.0.smithi066.stdout:5/260: stat d5/c29 0 2024-09-12T22:49:54.243 INFO:tasks.workunit.client.0.smithi066.stdout:1/144: dwrite d0/ff [0,4194304] 0 2024-09-12T22:49:54.243 INFO:tasks.workunit.client.0.smithi066.stdout:9/152: dwrite d9/dc/dd/f11 [0,4194304] 0 2024-09-12T22:49:54.244 INFO:tasks.workunit.client.0.smithi066.stdout:4/170: dwrite d5/d8/d10/de/f2b [0,4194304] 0 2024-09-12T22:49:54.244 INFO:tasks.workunit.client.0.smithi066.stdout:5/261: dread - d5/f36 zero size 2024-09-12T22:49:54.245 INFO:tasks.workunit.client.0.smithi066.stdout:7/157: dread d0/d19/d24/f16 [0,4194304] 0 2024-09-12T22:49:54.245 INFO:tasks.workunit.client.0.smithi066.stdout:1/145: fdatasync d0/f16 0 2024-09-12T22:49:54.245 INFO:tasks.workunit.client.0.smithi066.stdout:8/189: truncate d17/d2c/f34 483084 0 2024-09-12T22:49:54.246 INFO:tasks.workunit.client.0.smithi066.stdout:2/195: truncate d1/dd/f14 110777 0 2024-09-12T22:49:54.247 INFO:tasks.workunit.client.0.smithi066.stdout:7/158: fsync d0/d19/f1e 0 2024-09-12T22:49:54.247 INFO:tasks.workunit.client.0.smithi066.stdout:6/182: dwrite d6/d7/f11 [0,4194304] 0 2024-09-12T22:49:54.247 INFO:tasks.workunit.client.0.smithi066.stdout:8/190: chown c10 1 1 2024-09-12T22:49:54.248 INFO:tasks.workunit.client.0.smithi066.stdout:3/155: dread d0/d2/f24 [0,4194304] 0 2024-09-12T22:49:54.248 INFO:tasks.workunit.client.0.smithi066.stdout:0/179: truncate d1/d8/d1f/d25/f34 5749410 0 2024-09-12T22:49:54.248 INFO:tasks.workunit.client.0.smithi066.stdout:9/153: rename d9/dc/c2f to d9/dc/d23/c33 0 2024-09-12T22:49:54.248 INFO:tasks.workunit.client.0.smithi066.stdout:8/191: unlink fa 0 2024-09-12T22:49:54.249 INFO:tasks.workunit.client.0.smithi066.stdout:1/146: write d0/dc/fe [2824292,47078] 0 2024-09-12T22:49:54.249 INFO:tasks.workunit.client.0.smithi066.stdout:3/156: mknod d0/d2/d7/c3f 0 2024-09-12T22:49:54.250 INFO:tasks.workunit.client.0.smithi066.stdout:6/183: write d6/d23/f30 [2769442,117712] 0 2024-09-12T22:49:54.250 INFO:tasks.workunit.client.0.smithi066.stdout:9/154: mkdir d9/d31/d34 0 2024-09-12T22:49:54.252 INFO:tasks.workunit.client.0.smithi066.stdout:7/159: truncate d0/f5 373597 0 2024-09-12T22:49:54.252 INFO:tasks.workunit.client.0.smithi066.stdout:6/184: write d6/f1f [2042922,52079] 0 2024-09-12T22:49:54.253 INFO:tasks.workunit.client.0.smithi066.stdout:0/180: dread d1/d8/d1b/f24 [0,4194304] 0 2024-09-12T22:49:54.253 INFO:tasks.workunit.client.0.smithi066.stdout:3/157: mkdir d0/d2/d6/d33/d40 0 2024-09-12T22:49:54.254 INFO:tasks.workunit.client.0.smithi066.stdout:9/155: truncate d9/dc/f1f 1157130 0 2024-09-12T22:49:54.255 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:54.254+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:54.262 INFO:tasks.workunit.client.0.smithi066.stdout:1/147: creat d0/dc/f22 x:0 0 0 2024-09-12T22:49:54.262 INFO:tasks.workunit.client.0.smithi066.stdout:6/185: creat d6/d7/f39 x:0 0 0 2024-09-12T22:49:54.262 INFO:tasks.workunit.client.0.smithi066.stdout:0/181: read d1/d8/d1c/f17 [321592,4962] 0 2024-09-12T22:49:54.262 INFO:tasks.workunit.client.0.smithi066.stdout:4/171: dwrite d5/d8/d10/de/f27 [0,4194304] 0 2024-09-12T22:49:54.262 INFO:tasks.workunit.client.0.smithi066.stdout:5/262: dwrite d5/f24 [4194304,4194304] 0 2024-09-12T22:49:54.262 INFO:tasks.workunit.client.0.smithi066.stdout:2/196: dwrite d1/f2b [0,4194304] 0 2024-09-12T22:49:54.262 INFO:tasks.workunit.client.0.smithi066.stdout:7/160: link d0/d19/d24/f1f d0/f2f 0 2024-09-12T22:49:54.262 INFO:tasks.workunit.client.0.smithi066.stdout:9/156: write d9/dc/f28 [671113,122304] 0 2024-09-12T22:49:54.262 INFO:tasks.workunit.client.0.smithi066.stdout:1/148: read d0/dc/f17 [249330,102601] 0 2024-09-12T22:49:54.262 INFO:tasks.workunit.client.0.smithi066.stdout:6/186: fsync d6/d7/dc/f37 0 2024-09-12T22:49:54.263 INFO:tasks.workunit.client.0.smithi066.stdout:0/182: creat d1/d8/d1c/dd/f44 x:0 0 0 2024-09-12T22:49:54.263 INFO:tasks.workunit.client.0.smithi066.stdout:8/192: dwrite d17/d2c/f34 [0,4194304] 0 2024-09-12T22:49:54.263 INFO:tasks.workunit.client.0.smithi066.stdout:9/157: dread - d9/dc/d23/f30 zero size 2024-09-12T22:49:54.264 INFO:tasks.workunit.client.0.smithi066.stdout:2/197: mkdir d1/db/d42/d43 0 2024-09-12T22:49:54.264 INFO:tasks.workunit.client.0.smithi066.stdout:5/263: mknod d5/d11/c51 0 2024-09-12T22:49:54.264 INFO:tasks.workunit.client.0.smithi066.stdout:7/161: dread d0/d19/f1e [0,4194304] 0 2024-09-12T22:49:54.265 INFO:tasks.workunit.client.0.smithi066.stdout:0/183: link d1/f10 d1/d8/d1f/f45 0 2024-09-12T22:49:54.265 INFO:tasks.workunit.client.0.smithi066.stdout:9/158: chown d9/dc/f27 24 1 2024-09-12T22:49:54.266 INFO:tasks.workunit.client.0.smithi066.stdout:3/158: dread d0/d2/d1d/f21 [0,4194304] 0 2024-09-12T22:49:54.268 INFO:tasks.workunit.client.0.smithi066.stdout:0/184: dread - d1/d8/d1c/f3a zero size 2024-09-12T22:49:54.269 INFO:tasks.workunit.client.0.smithi066.stdout:0/185: readlink d1/l3e 0 2024-09-12T22:49:54.270 INFO:tasks.workunit.client.0.smithi066.stdout:3/159: write d0/d2/d7/d13/f19 [273880,100333] 0 2024-09-12T22:49:54.270 INFO:tasks.workunit.client.0.smithi066.stdout:7/162: truncate d0/d19/d24/f12 5129434 0 2024-09-12T22:49:54.271 INFO:tasks.workunit.client.0.smithi066.stdout:9/159: dread d9/dc/f27 [0,4194304] 0 2024-09-12T22:49:54.271 INFO:tasks.workunit.client.0.smithi066.stdout:2/198: getdents d1/dd/d12/d1e 0 2024-09-12T22:49:54.271 INFO:tasks.workunit.client.0.smithi066.stdout:2/199: sync 2024-09-12T22:49:54.271 INFO:tasks.workunit.client.0.smithi066.stdout:8/193: dwrite f15 [0,4194304] 0 2024-09-12T22:49:54.273 INFO:tasks.workunit.client.0.smithi066.stdout:0/186: creat d1/d8/d1f/f46 x:0 0 0 2024-09-12T22:49:54.274 INFO:tasks.workunit.client.0.smithi066.stdout:6/187: dwrite d6/f17 [0,4194304] 0 2024-09-12T22:49:54.274 INFO:tasks.workunit.client.0.smithi066.stdout:7/163: creat d0/d19/d26/f30 x:0 0 0 2024-09-12T22:49:54.274 INFO:tasks.workunit.client.0.smithi066.stdout:8/194: creat d17/d1b/f3b x:0 0 0 2024-09-12T22:49:54.274 INFO:tasks.workunit.client.0.smithi066.stdout:9/160: unlink d9/l2b 0 2024-09-12T22:49:54.274 INFO:tasks.workunit.client.0.smithi066.stdout:5/264: dread d5/d11/d23/f4e [0,4194304] 0 2024-09-12T22:49:54.275 INFO:tasks.workunit.client.0.smithi066.stdout:3/160: mknod d0/d2/d7/d13/d31/c41 0 2024-09-12T22:49:54.276 INFO:tasks.workunit.client.0.smithi066.stdout:4/172: write d5/d8/d10/f31 [404299,16933] 0 2024-09-12T22:49:54.276 INFO:tasks.workunit.client.0.smithi066.stdout:0/187: chown d1/d8/d1c/f17 2215301 1 2024-09-12T22:49:54.276 INFO:tasks.workunit.client.0.smithi066.stdout:5/265: chown d5/d11/f40 604 1 2024-09-12T22:49:54.277 INFO:tasks.workunit.client.0.smithi066.stdout:3/161: write d0/d2/d6/f9 [4726962,18103] 0 2024-09-12T22:49:54.277 INFO:tasks.workunit.client.0.smithi066.stdout:6/188: rename d6/d23/f30 to d6/d20/f3a 0 2024-09-12T22:49:54.277 INFO:tasks.workunit.client.0.smithi066.stdout:7/164: symlink d0/l31 0 2024-09-12T22:49:54.278 INFO:tasks.workunit.client.0.smithi066.stdout:5/266: mkdir d5/d11/d23/d52 0 2024-09-12T22:49:54.278 INFO:tasks.workunit.client.0.smithi066.stdout:0/188: mkdir d1/d8/d1f/d47 0 2024-09-12T22:49:54.279 INFO:tasks.workunit.client.0.smithi066.stdout:6/189: mknod d6/c3b 0 2024-09-12T22:49:54.279 INFO:tasks.workunit.client.0.smithi066.stdout:8/195: link d17/l31 d17/l3c 0 2024-09-12T22:49:54.280 INFO:tasks.workunit.client.0.smithi066.stdout:1/149: truncate d0/dc/fe 766304 0 2024-09-12T22:49:54.283 INFO:tasks.workunit.client.0.smithi066.stdout:9/161: dwrite d9/fa [0,4194304] 0 2024-09-12T22:49:54.283 INFO:tasks.workunit.client.0.smithi066.stdout:6/190: dread - d6/f2a zero size 2024-09-12T22:49:54.283 INFO:tasks.workunit.client.0.smithi066.stdout:8/196: chown d17/l26 45671 1 2024-09-12T22:49:54.284 INFO:tasks.workunit.client.0.smithi066.stdout:3/162: rename d0/d2/d7/f11 to d0/d2/d7/d29/f42 0 2024-09-12T22:49:54.284 INFO:tasks.workunit.client.0.smithi066.stdout:8/197: mknod d17/d2c/c3d 0 2024-09-12T22:49:54.285 INFO:tasks.workunit.client.0.smithi066.stdout:9/162: rename d9 to d9/d31/d34/d35 22 2024-09-12T22:49:54.287 INFO:tasks.workunit.client.0.smithi066.stdout:6/191: mkdir d6/d20/d32/d3c 0 2024-09-12T22:49:54.289 INFO:tasks.workunit.client.0.smithi066.stdout:4/173: truncate d5/d8/d10/f1a 528997 0 2024-09-12T22:49:54.289 INFO:tasks.workunit.client.0.smithi066.stdout:0/189: dwrite d1/d8/d1f/f2c [0,4194304] 0 2024-09-12T22:49:54.289 INFO:tasks.workunit.client.0.smithi066.stdout:9/163: chown d9/dc/dd/f18 12 1 2024-09-12T22:49:54.291 INFO:tasks.workunit.client.0.smithi066.stdout:7/165: dwrite d0/d19/d24/f16 [0,4194304] 0 2024-09-12T22:49:54.291 INFO:tasks.workunit.client.0.smithi066.stdout:5/267: dwrite d5/d14/f38 [0,4194304] 0 2024-09-12T22:49:54.291 INFO:tasks.workunit.client.0.smithi066.stdout:9/164: fsync d9/f26 0 2024-09-12T22:49:54.291 INFO:tasks.workunit.client.0.smithi066.stdout:6/192: creat d6/d20/d24/d33/f3d x:0 0 0 2024-09-12T22:49:54.292 INFO:tasks.workunit.client.0.smithi066.stdout:9/165: chown d9/dc 3295419 1 2024-09-12T22:49:54.292 INFO:tasks.workunit.client.0.smithi066.stdout:0/190: fsync d1/d8/d1c/dd/f44 0 2024-09-12T22:49:54.292 INFO:tasks.workunit.client.0.smithi066.stdout:4/174: creat d5/d8/d10/f40 x:0 0 0 2024-09-12T22:49:54.294 INFO:tasks.workunit.client.0.smithi066.stdout:5/268: unlink d5/de/d50/l46 0 2024-09-12T22:49:54.294 INFO:tasks.workunit.client.0.smithi066.stdout:9/166: mkdir d9/dc/d36 0 2024-09-12T22:49:54.294 INFO:tasks.workunit.client.0.smithi066.stdout:0/191: creat d1/d8/d1b/f48 x:0 0 0 2024-09-12T22:49:54.294 INFO:tasks.workunit.client.0.smithi066.stdout:4/175: unlink d5/d8/d10/de/d2d/l37 0 2024-09-12T22:49:54.295 INFO:tasks.workunit.client.0.smithi066.stdout:3/163: dwrite d0/d2/d1d/f21 [4194304,4194304] 0 2024-09-12T22:49:54.295 INFO:tasks.workunit.client.0.smithi066.stdout:9/167: fsync d9/dc/dd/f1d 0 2024-09-12T22:49:54.296 INFO:tasks.workunit.client.0.smithi066.stdout:0/192: dread d1/d8/d1b/f24 [0,4194304] 0 2024-09-12T22:49:54.297 INFO:tasks.workunit.client.0.smithi066.stdout:3/164: mkdir d0/d2/d7/d13/d43 0 2024-09-12T22:49:54.297 INFO:tasks.workunit.client.0.smithi066.stdout:1/150: sync 2024-09-12T22:49:54.297 INFO:tasks.workunit.client.0.smithi066.stdout:7/166: sync 2024-09-12T22:49:54.297 INFO:tasks.workunit.client.0.smithi066.stdout:4/176: link d5/f24 d5/d8/d16/f41 0 2024-09-12T22:49:54.298 INFO:tasks.workunit.client.0.smithi066.stdout:9/168: creat d9/d31/d34/f37 x:0 0 0 2024-09-12T22:49:54.299 INFO:tasks.workunit.client.0.smithi066.stdout:7/167: rename d0 to d0/d6/d18/d27/d32 22 2024-09-12T22:49:54.300 INFO:tasks.workunit.client.0.smithi066.stdout:1/151: write d0/dc/f17 [1202283,638] 0 2024-09-12T22:49:54.300 INFO:tasks.workunit.client.0.smithi066.stdout:4/177: truncate d5/f33 966840 0 2024-09-12T22:49:54.300 INFO:tasks.workunit.client.0.smithi066.stdout:9/169: creat d9/dc/f38 x:0 0 0 2024-09-12T22:49:54.301 INFO:tasks.workunit.client.0.smithi066.stdout:4/178: fdatasync d5/f24 0 2024-09-12T22:49:54.302 INFO:tasks.workunit.client.0.smithi066.stdout:1/152: write d0/d9/f14 [1717883,58258] 0 2024-09-12T22:49:54.305 INFO:tasks.workunit.client.0.smithi066.stdout:8/198: dwrite d17/f22 [0,4194304] 0 2024-09-12T22:49:54.305 INFO:tasks.workunit.client.0.smithi066.stdout:9/170: creat d9/dc/d36/f39 x:0 0 0 2024-09-12T22:49:54.305 INFO:tasks.workunit.client.0.smithi066.stdout:3/165: dread d0/d2/d7/f1a [0,4194304] 0 2024-09-12T22:49:54.305 INFO:tasks.workunit.client.0.smithi066.stdout:8/199: symlink d17/d2c/l3e 0 2024-09-12T22:49:54.305 INFO:tasks.workunit.client.0.smithi066.stdout:0/193: dwrite d1/d8/d1f/f33 [0,4194304] 0 2024-09-12T22:49:54.306 INFO:tasks.workunit.client.0.smithi066.stdout:9/171: fdatasync d9/dc/f19 0 2024-09-12T22:49:54.307 INFO:tasks.workunit.client.0.smithi066.stdout:7/168: dread d0/ff [0,4194304] 0 2024-09-12T22:49:54.308 INFO:tasks.workunit.client.0.smithi066.stdout:4/179: read d5/d3e/f34 [203053,4578] 0 2024-09-12T22:49:54.308 INFO:tasks.workunit.client.0.smithi066.stdout:1/153: link d0/dc/l1a d0/l23 0 2024-09-12T22:49:54.309 INFO:tasks.workunit.client.0.smithi066.stdout:4/180: rmdir d5/d8/d10/de 39 2024-09-12T22:49:54.310 INFO:tasks.workunit.client.0.smithi066.stdout:1/154: creat d0/dc/d1d/f24 x:0 0 0 2024-09-12T22:49:54.311 INFO:tasks.workunit.client.0.smithi066.stdout:7/169: rename d0/d6/d18 to d0/d19/d24/d33 0 2024-09-12T22:49:54.311 INFO:tasks.workunit.client.0.smithi066.stdout:3/166: sync 2024-09-12T22:49:54.311 INFO:tasks.workunit.client.0.smithi066.stdout:1/155: stat d0/dc 0 2024-09-12T22:49:54.312 INFO:tasks.workunit.client.0.smithi066.stdout:8/200: dwrite d17/d1b/f3b [0,4194304] 0 2024-09-12T22:49:54.313 INFO:tasks.workunit.client.0.smithi066.stdout:9/172: dwrite f8 [0,4194304] 0 2024-09-12T22:49:54.313 INFO:tasks.workunit.client.0.smithi066.stdout:6/193: write d6/d23/f29 [1257970,63925] 0 2024-09-12T22:49:54.313 INFO:tasks.workunit.client.0.smithi066.stdout:7/170: creat d0/d19/d24/d33/f34 x:0 0 0 2024-09-12T22:49:54.314 INFO:tasks.workunit.client.0.smithi066.stdout:9/173: read d9/dc/dd/f11 [1805688,11580] 0 2024-09-12T22:49:54.315 INFO:tasks.workunit.client.0.smithi066.stdout:1/156: symlink d0/d9/d21/l25 0 2024-09-12T22:49:54.316 INFO:tasks.workunit.client.0.smithi066.stdout:6/194: creat d6/d23/f3e x:0 0 0 2024-09-12T22:49:54.316 INFO:tasks.workunit.client.0.smithi066.stdout:7/171: fsync d0/d6/f9 0 2024-09-12T22:49:54.316 INFO:tasks.workunit.client.0.smithi066.stdout:8/201: mknod d17/c3f 0 2024-09-12T22:49:54.317 INFO:tasks.workunit.client.0.smithi066.stdout:5/269: dread d5/de/d50/d42/f48 [0,4194304] 0 2024-09-12T22:49:54.317 INFO:tasks.workunit.client.0.smithi066.stdout:2/200: dread d1/dd/f2c [0,4194304] 0 2024-09-12T22:49:54.318 INFO:tasks.workunit.client.0.smithi066.stdout:0/194: write d1/f7 [1111596,2027] 0 2024-09-12T22:49:54.319 INFO:tasks.workunit.client.0.smithi066.stdout:8/202: fsync d17/f27 0 2024-09-12T22:49:54.319 INFO:tasks.workunit.client.0.smithi066.stdout:6/195: creat d6/d20/d24/d33/f3f x:0 0 0 2024-09-12T22:49:54.319 INFO:tasks.workunit.client.0.smithi066.stdout:6/196: stat d6/d7/ld 0 2024-09-12T22:49:54.320 INFO:tasks.workunit.client.0.smithi066.stdout:7/172: creat d0/d19/d24/d33/d27/f35 x:0 0 0 2024-09-12T22:49:54.321 INFO:tasks.workunit.client.0.smithi066.stdout:8/203: mkdir d17/d40 0 2024-09-12T22:49:54.321 INFO:tasks.workunit.client.0.smithi066.stdout:3/167: dwrite d0/d2/d6/f9 [0,4194304] 0 2024-09-12T22:49:54.322 INFO:tasks.workunit.client.0.smithi066.stdout:2/201: getdents d1/db/d42/d43 0 2024-09-12T22:49:54.322 INFO:tasks.workunit.client.0.smithi066.stdout:6/197: write d6/f17 [1157155,112861] 0 2024-09-12T22:49:54.323 INFO:tasks.workunit.client.0.smithi066.stdout:5/270: truncate d5/de/d50/d42/f44 5635587 0 2024-09-12T22:49:54.324 INFO:tasks.workunit.client.0.smithi066.stdout:4/181: truncate d5/d8/f12 249232 0 2024-09-12T22:49:54.324 INFO:tasks.workunit.client.0.smithi066.stdout:9/174: dwrite d9/dc/f1f [0,4194304] 0 2024-09-12T22:49:54.325 INFO:tasks.workunit.client.0.smithi066.stdout:8/204: write d17/d1b/f23 [86956,106641] 0 2024-09-12T22:49:54.325 INFO:tasks.workunit.client.0.smithi066.stdout:0/195: rename d1/d8/d1c/dd/l11 to d1/d8/d1c/d13/d2f/l49 0 2024-09-12T22:49:54.326 INFO:tasks.workunit.client.0.smithi066.stdout:7/173: mkdir d0/d19/d24/d33/d27/d36 0 2024-09-12T22:49:54.327 INFO:tasks.workunit.client.0.smithi066.stdout:1/157: dwrite d0/dc/f17 [0,4194304] 0 2024-09-12T22:49:54.327 INFO:tasks.workunit.client.0.smithi066.stdout:6/198: unlink d6/d7/le 0 2024-09-12T22:49:54.327 INFO:tasks.workunit.client.0.smithi066.stdout:8/205: mknod d17/d1b/c41 0 2024-09-12T22:49:54.328 INFO:tasks.workunit.client.0.smithi066.stdout:3/168: truncate d0/d2/d1d/f23 495132 0 2024-09-12T22:49:54.329 INFO:tasks.workunit.client.0.smithi066.stdout:8/206: chown d17/l2b 14930 1 2024-09-12T22:49:54.330 INFO:tasks.workunit.client.0.smithi066.stdout:6/199: rmdir d6 39 2024-09-12T22:49:54.330 INFO:tasks.workunit.client.0.smithi066.stdout:0/196: creat d1/d8/d1c/d13/d2f/f4a x:0 0 0 2024-09-12T22:49:54.330 INFO:tasks.workunit.client.0.smithi066.stdout:7/174: rename d0/d19/f1e to d0/d19/d24/f37 0 2024-09-12T22:49:54.331 INFO:tasks.workunit.client.0.smithi066.stdout:7/175: sync 2024-09-12T22:49:54.331 INFO:tasks.workunit.client.0.smithi066.stdout:1/158: mknod d0/c26 0 2024-09-12T22:49:54.331 INFO:tasks.workunit.client.0.smithi066.stdout:6/200: chown d6/d20/f22 0 1 2024-09-12T22:49:54.331 INFO:tasks.workunit.client.0.smithi066.stdout:8/207: creat d17/f42 x:0 0 0 2024-09-12T22:49:54.331 INFO:tasks.workunit.client.0.smithi066.stdout:0/197: dread - d1/d8/d1c/d13/f20 zero size 2024-09-12T22:49:54.332 INFO:tasks.workunit.client.0.smithi066.stdout:7/176: rmdir d0/d19 39 2024-09-12T22:49:54.332 INFO:tasks.workunit.client.0.smithi066.stdout:1/159: creat d0/d9/d21/f27 x:0 0 0 2024-09-12T22:49:54.333 INFO:tasks.workunit.client.0.smithi066.stdout:7/177: symlink d0/l38 0 2024-09-12T22:49:54.333 INFO:tasks.workunit.client.0.smithi066.stdout:8/208: write f11 [1656048,56581] 0 2024-09-12T22:49:54.333 INFO:tasks.workunit.client.0.smithi066.stdout:4/182: dwrite d5/d8/d10/f40 [0,4194304] 0 2024-09-12T22:49:54.334 INFO:tasks.workunit.client.0.smithi066.stdout:0/198: symlink d1/d8/d1f/d47/l4b 0 2024-09-12T22:49:54.335 INFO:tasks.workunit.client.0.smithi066.stdout:9/175: dread d9/dc/fe [0,4194304] 0 2024-09-12T22:49:54.335 INFO:tasks.workunit.client.0.smithi066.stdout:8/209: read d17/d2c/f34 [2128158,124409] 0 2024-09-12T22:49:54.336 INFO:tasks.workunit.client.0.smithi066.stdout:5/271: fsync d5/d15/f17 0 2024-09-12T22:49:54.336 INFO:tasks.workunit.client.0.smithi066.stdout:9/176: readlink d9/dc/l15 0 2024-09-12T22:49:54.336 INFO:tasks.workunit.client.0.smithi066.stdout:8/210: fdatasync d17/d2c/f35 0 2024-09-12T22:49:54.337 INFO:tasks.workunit.client.0.smithi066.stdout:0/199: unlink d1/d8/d1b/c3b 0 2024-09-12T22:49:54.337 INFO:tasks.workunit.client.0.smithi066.stdout:7/178: mknod d0/d19/d26/c39 0 2024-09-12T22:49:54.337 INFO:tasks.workunit.client.0.smithi066.stdout:9/177: unlink d9/f26 0 2024-09-12T22:49:54.338 INFO:tasks.workunit.client.0.smithi066.stdout:4/183: fdatasync d5/d8/d10/de/f14 0 2024-09-12T22:49:54.338 INFO:tasks.workunit.client.0.smithi066.stdout:8/211: rmdir d17/d2c 39 2024-09-12T22:49:54.338 INFO:tasks.workunit.client.0.smithi066.stdout:8/212: sync 2024-09-12T22:49:54.339 INFO:tasks.workunit.client.0.smithi066.stdout:0/200: mknod d1/d8/d1c/d13/d2f/c4c 0 2024-09-12T22:49:54.339 INFO:tasks.workunit.client.0.smithi066.stdout:6/201: dwrite d6/d23/d25/f2e [0,4194304] 0 2024-09-12T22:49:54.340 INFO:tasks.workunit.client.0.smithi066.stdout:1/160: write d0/f7 [673129,91411] 0 2024-09-12T22:49:54.340 INFO:tasks.workunit.client.0.smithi066.stdout:4/184: write d5/f33 [1639299,69004] 0 2024-09-12T22:49:54.340 INFO:tasks.workunit.client.0.smithi066.stdout:3/169: write d0/d2/d1d/f23 [1285220,40331] 0 2024-09-12T22:49:54.341 INFO:tasks.workunit.client.0.smithi066.stdout:9/178: truncate d9/dc/dd/f1d 286760 0 2024-09-12T22:49:54.341 INFO:tasks.workunit.client.0.smithi066.stdout:7/179: rmdir d0/d19/d24/d33/d27/d36 0 2024-09-12T22:49:54.341 INFO:tasks.workunit.client.0.smithi066.stdout:8/213: symlink d17/d2c/l43 0 2024-09-12T22:49:54.342 INFO:tasks.workunit.client.0.smithi066.stdout:0/201: write d1/d8/d1f/f2c [184847,43409] 0 2024-09-12T22:49:54.342 INFO:tasks.workunit.client.0.smithi066.stdout:8/214: chown f16 3 1 2024-09-12T22:49:54.343 INFO:tasks.workunit.client.0.smithi066.stdout:4/185: mknod d5/d3e/c42 0 2024-09-12T22:49:54.343 INFO:tasks.workunit.client.0.smithi066.stdout:6/202: creat d6/d23/d25/d2c/f40 x:0 0 0 2024-09-12T22:49:54.343 INFO:tasks.workunit.client.0.smithi066.stdout:9/179: unlink d9/dc/l2c 0 2024-09-12T22:49:54.344 INFO:tasks.workunit.client.0.smithi066.stdout:8/215: mknod d17/c44 0 2024-09-12T22:49:54.345 INFO:tasks.workunit.client.0.smithi066.stdout:9/180: fdatasync f8 0 2024-09-12T22:49:54.345 INFO:tasks.workunit.client.0.smithi066.stdout:0/202: dread - d1/d8/d1c/d13/d2f/f4a zero size 2024-09-12T22:49:54.346 INFO:tasks.workunit.client.0.smithi066.stdout:6/203: rmdir d6/d20/d24/d33 39 2024-09-12T22:49:54.346 INFO:tasks.workunit.client.0.smithi066.stdout:5/272: dwrite d5/d15/f1a [0,4194304] 0 2024-09-12T22:49:54.346 INFO:tasks.workunit.client.0.smithi066.stdout:8/216: fsync d17/f27 0 2024-09-12T22:49:54.347 INFO:tasks.workunit.client.0.smithi066.stdout:9/181: rmdir d9/dc/d36 39 2024-09-12T22:49:54.347 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:54.348 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:54.349 INFO:tasks.workunit.client.0.smithi066.stdout:5/273: write d5/f3b [930129,49141] 0 2024-09-12T22:49:54.349 INFO:tasks.workunit.client.0.smithi066.stdout:9/182: read d9/fa [2973640,41715] 0 2024-09-12T22:49:54.350 INFO:tasks.workunit.client.0.smithi066.stdout:0/203: link d1/d8/d1c/f17 d1/d8/d1f/d25/f4d 0 2024-09-12T22:49:54.351 INFO:tasks.workunit.client.0.smithi066.stdout:9/183: fdatasync d9/dc/f38 0 2024-09-12T22:49:54.352 INFO:tasks.workunit.client.0.smithi066.stdout:7/180: dwrite d0/d6/f21 [0,4194304] 0 2024-09-12T22:49:54.352 INFO:tasks.workunit.client.0.smithi066.stdout:3/170: dwrite d0/d2/d1d/f23 [0,4194304] 0 2024-09-12T22:49:54.354 INFO:tasks.workunit.client.0.smithi066.stdout:5/274: write d5/d11/f43 [2798326,111229] 0 2024-09-12T22:49:54.354 INFO:tasks.workunit.client.0.smithi066.stdout:0/204: symlink d1/d8/d1f/d25/l4e 0 2024-09-12T22:49:54.355 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:54.354+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:54.355 INFO:tasks.workunit.client.0.smithi066.stdout:7/181: mknod d0/c3a 0 2024-09-12T22:49:54.356 INFO:tasks.workunit.client.0.smithi066.stdout:4/186: dwrite d5/d8/d10/de/f27 [0,4194304] 0 2024-09-12T22:49:54.356 INFO:tasks.workunit.client.0.smithi066.stdout:6/204: dwrite d6/f17 [0,4194304] 0 2024-09-12T22:49:54.356 INFO:tasks.workunit.client.0.smithi066.stdout:5/275: rmdir d5/d14 39 2024-09-12T22:49:54.356 INFO:tasks.workunit.client.0.smithi066.stdout:6/205: sync 2024-09-12T22:49:54.357 INFO:tasks.workunit.client.0.smithi066.stdout:6/206: rmdir d6/d23/d25 39 2024-09-12T22:49:54.358 INFO:tasks.workunit.client.0.smithi066.stdout:0/205: mknod d1/d8/d1b/c4f 0 2024-09-12T22:49:54.358 INFO:tasks.workunit.client.0.smithi066.stdout:7/182: rename d0/d19/d24/f37 to d0/d19/d24/f3b 0 2024-09-12T22:49:54.358 INFO:tasks.workunit.client.0.smithi066.stdout:0/206: fsync d1/d8/d1b/f48 0 2024-09-12T22:49:54.360 INFO:tasks.workunit.client.0.smithi066.stdout:3/171: dread d0/d2/d7/d13/f39 [0,4194304] 0 2024-09-12T22:49:54.360 INFO:tasks.workunit.client.0.smithi066.stdout:5/276: rename d5/d15/l4b to d5/d11/d21/d4d/l53 0 2024-09-12T22:49:54.361 INFO:tasks.workunit.client.0.smithi066.stdout:7/183: write d0/d19/d24/f3b [1487629,80202] 0 2024-09-12T22:49:54.361 INFO:tasks.workunit.client.0.smithi066.stdout:9/184: link d9/dc/dd/c21 d9/dc/c3a 0 2024-09-12T22:49:54.361 INFO:tasks.workunit.client.0.smithi066.stdout:4/187: link d5/l25 d5/d8/d16/d1b/d1e/d38/l43 0 2024-09-12T22:49:54.362 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:54.363 INFO:tasks.workunit.client.0.smithi066.stdout:6/207: unlink d6/d7/dc/f37 0 2024-09-12T22:49:54.364 INFO:tasks.workunit.client.0.smithi066.stdout:3/172: chown d0/d2/d6/c35 37981 1 2024-09-12T22:49:54.364 INFO:tasks.workunit.client.0.smithi066.stdout:5/277: readlink d5/d14/l1c 0 2024-09-12T22:49:54.364 INFO:tasks.workunit.client.0.smithi066.stdout:0/207: truncate d1/d8/d1b/f43 261533 0 2024-09-12T22:49:54.364 INFO:tasks.workunit.client.0.smithi066.stdout:6/208: readlink d6/l10 0 2024-09-12T22:49:54.364 INFO:tasks.workunit.client.0.smithi066.stdout:1/161: dwrite d0/dc/f17 [4194304,4194304] 0 2024-09-12T22:49:54.366 INFO:tasks.workunit.client.0.smithi066.stdout:3/173: getdents d0/d2/d1d 0 2024-09-12T22:49:54.368 INFO:tasks.workunit.client.0.smithi066.stdout:2/202: dread d1/d11/d26/f30 [0,4194304] 0 2024-09-12T22:49:54.368 INFO:tasks.workunit.client.0.smithi066.stdout:3/174: mkdir d0/d2/d6/d33/d40/d44 0 2024-09-12T22:49:54.368 INFO:tasks.workunit.client.0.smithi066.stdout:0/208: dread d1/d8/d1f/f2c [0,4194304] 0 2024-09-12T22:49:54.368 INFO:tasks.workunit.client.0.smithi066.stdout:8/217: getdents d17 0 2024-09-12T22:49:54.369 INFO:tasks.workunit.client.0.smithi066.stdout:7/184: getdents d0 0 2024-09-12T22:49:54.370 INFO:tasks.workunit.client.0.smithi066.stdout:5/278: getdents d5/d15 0 2024-09-12T22:49:54.370 INFO:tasks.workunit.client.0.smithi066.stdout:9/185: write d9/dc/f1f [4114673,126689] 0 2024-09-12T22:49:54.371 INFO:tasks.workunit.client.0.smithi066.stdout:4/188: write d5/d8/d10/f1a [459818,30486] 0 2024-09-12T22:49:54.371 INFO:tasks.workunit.client.0.smithi066.stdout:0/209: mknod d1/d36/c50 0 2024-09-12T22:49:54.371 INFO:tasks.workunit.client.0.smithi066.stdout:8/218: truncate d17/d2c/f35 352808 0 2024-09-12T22:49:54.371 INFO:tasks.workunit.client.0.smithi066.stdout:3/175: write d0/d2/d7/d13/f19 [468970,69935] 0 2024-09-12T22:49:54.371 INFO:tasks.workunit.client.0.smithi066.stdout:9/186: chown d9/dc/d23 0 1 2024-09-12T22:49:54.371 INFO:tasks.workunit.client.0.smithi066.stdout:1/162: dwrite d0/f1c [0,4194304] 0 2024-09-12T22:49:54.372 INFO:tasks.workunit.client.0.smithi066.stdout:7/185: truncate d0/f2f 218462 0 2024-09-12T22:49:54.372 INFO:tasks.workunit.client.0.smithi066.stdout:0/210: dread - d1/d8/d1f/f46 zero size 2024-09-12T22:49:54.373 INFO:tasks.workunit.client.0.smithi066.stdout:2/203: getdents d1/d2a 0 2024-09-12T22:49:54.373 INFO:tasks.workunit.client.0.smithi066.stdout:3/176: write d0/d2/d7/d29/f42 [2776319,70520] 0 2024-09-12T22:49:54.374 INFO:tasks.workunit.client.0.smithi066.stdout:5/279: rename d5/d14/f38 to d5/d11/f54 0 2024-09-12T22:49:54.374 INFO:tasks.workunit.client.0.smithi066.stdout:0/211: write d1/d8/d1f/d30/f3d [217257,45239] 0 2024-09-12T22:49:54.374 INFO:tasks.workunit.client.0.smithi066.stdout:2/204: mkdir d1/d44 0 2024-09-12T22:49:54.375 INFO:tasks.workunit.client.0.smithi066.stdout:4/189: getdents d5/d8/d10/de/d39 0 2024-09-12T22:49:54.375 INFO:tasks.workunit.client.0.smithi066.stdout:9/187: rename d9/dc/f27 to d9/d31/d34/f3b 0 2024-09-12T22:49:54.376 INFO:tasks.workunit.client.0.smithi066.stdout:5/280: creat d5/f55 x:0 0 0 2024-09-12T22:49:54.377 INFO:tasks.workunit.client.0.smithi066.stdout:3/177: creat d0/d1b/f45 x:0 0 0 2024-09-12T22:49:54.377 INFO:tasks.workunit.client.0.smithi066.stdout:4/190: rmdir d5/d8/d10/de 39 2024-09-12T22:49:54.377 INFO:tasks.workunit.client.0.smithi066.stdout:0/212: chown d1/d8/d1f/d25/f34 765 1 2024-09-12T22:49:54.378 INFO:tasks.workunit.client.0.smithi066.stdout:2/205: creat d1/d44/f45 x:0 0 0 2024-09-12T22:49:54.378 INFO:tasks.workunit.client.0.smithi066.stdout:5/281: dread - d5/f36 zero size 2024-09-12T22:49:54.378 INFO:tasks.workunit.client.0.smithi066.stdout:7/186: dwrite d0/d6/f21 [0,4194304] 0 2024-09-12T22:49:54.379 INFO:tasks.workunit.client.0.smithi066.stdout:1/163: dwrite d0/dc/f17 [4194304,4194304] 0 2024-09-12T22:49:54.380 INFO:tasks.workunit.client.0.smithi066.stdout:4/191: write d5/d8/d10/de/f27 [391922,125761] 0 2024-09-12T22:49:54.380 INFO:tasks.workunit.client.0.smithi066.stdout:5/282: truncate d5/f36 939886 0 2024-09-12T22:49:54.382 INFO:tasks.workunit.client.0.smithi066.stdout:0/213: truncate d1/d8/d1c/f17 132857 0 2024-09-12T22:49:54.382 INFO:tasks.workunit.client.0.smithi066.stdout:4/192: unlink d5/d8/d16/d1b/d1e/l3d 0 2024-09-12T22:49:54.382 INFO:tasks.workunit.client.0.smithi066.stdout:1/164: mkdir d0/d28 0 2024-09-12T22:49:54.383 INFO:tasks.workunit.client.0.smithi066.stdout:1/165: fsync d0/d9/d21/f27 0 2024-09-12T22:49:54.384 INFO:tasks.workunit.client.0.smithi066.stdout:4/193: creat d5/d3e/f44 x:0 0 0 2024-09-12T22:49:54.385 INFO:tasks.workunit.client.0.smithi066.stdout:3/178: dwrite d0/d1b/f45 [0,4194304] 0 2024-09-12T22:49:54.385 INFO:tasks.workunit.client.0.smithi066.stdout:0/214: getdents d1/d8/d1b 0 2024-09-12T22:49:54.386 INFO:tasks.workunit.client.0.smithi066.stdout:1/166: mknod d0/dc/c29 0 2024-09-12T22:49:54.386 INFO:tasks.workunit.client.0.smithi066.stdout:4/194: fdatasync d5/d8/d10/de/d39/f3b 0 2024-09-12T22:49:54.387 INFO:tasks.workunit.client.0.smithi066.stdout:2/206: dwrite d1/dd/d12/d1e/f39 [4194304,4194304] 0 2024-09-12T22:49:54.387 INFO:tasks.workunit.client.0.smithi066.stdout:0/215: truncate d1/d8/d1c/d13/f1e 526136 0 2024-09-12T22:49:54.387 INFO:tasks.workunit.client.0.smithi066.stdout:8/219: truncate d17/f22 3436180 0 2024-09-12T22:49:54.388 INFO:tasks.workunit.client.0.smithi066.stdout:3/179: rename d0/d2/d1d/f1f to d0/d2/d6/f46 0 2024-09-12T22:49:54.388 INFO:tasks.workunit.client.0.smithi066.stdout:4/195: mknod d5/d8/d16/c45 0 2024-09-12T22:49:54.388 INFO:tasks.workunit.client.0.smithi066.stdout:5/283: read d5/f3b [741887,88149] 0 2024-09-12T22:49:54.389 INFO:tasks.workunit.client.0.smithi066.stdout:8/220: truncate d17/d2c/f37 295964 0 2024-09-12T22:49:54.389 INFO:tasks.workunit.client.0.smithi066.stdout:4/196: chown d5/d8/d16/c45 10109089 1 2024-09-12T22:49:54.390 INFO:tasks.workunit.client.0.smithi066.stdout:5/284: write d5/d11/d23/f2b [425476,60702] 0 2024-09-12T22:49:54.391 INFO:tasks.workunit.client.0.smithi066.stdout:8/221: creat d17/d1b/f45 x:0 0 0 2024-09-12T22:49:54.392 INFO:tasks.workunit.client.0.smithi066.stdout:3/180: link d0/d2/c4 d0/c47 0 2024-09-12T22:49:54.392 INFO:tasks.workunit.client.0.smithi066.stdout:5/285: dread - d5/f3f zero size 2024-09-12T22:49:54.392 INFO:tasks.workunit.client.0.smithi066.stdout:8/222: rmdir d17 39 2024-09-12T22:49:54.393 INFO:tasks.workunit.client.0.smithi066.stdout:4/197: unlink d5/d8/d16/d1b/d1e/d38/l43 0 2024-09-12T22:49:54.393 INFO:tasks.workunit.client.0.smithi066.stdout:5/286: creat d5/d11/d23/f56 x:0 0 0 2024-09-12T22:49:54.394 INFO:tasks.workunit.client.0.smithi066.stdout:4/198: fsync d5/f33 0 2024-09-12T22:49:54.394 INFO:tasks.workunit.client.0.smithi066.stdout:8/223: write d17/d2c/f32 [2658416,94898] 0 2024-09-12T22:49:54.395 INFO:tasks.workunit.client.0.smithi066.stdout:9/188: dwrite d9/dc/dd/f11 [0,4194304] 0 2024-09-12T22:49:54.395 INFO:tasks.workunit.client.0.smithi066.stdout:0/216: dwrite d1/d8/d1c/dd/f28 [0,4194304] 0 2024-09-12T22:49:54.396 INFO:tasks.workunit.client.0.smithi066.stdout:0/217: stat d1/d8/d1b/c3f 0 2024-09-12T22:49:54.397 INFO:tasks.workunit.client.0.smithi066.stdout:5/287: rmdir d5/de/d50 39 2024-09-12T22:49:54.397 INFO:tasks.workunit.client.0.smithi066.stdout:4/199: rename d5/d8/d16/f35 to d5/f46 0 2024-09-12T22:49:54.398 INFO:tasks.workunit.client.0.smithi066.stdout:9/189: symlink d9/dc/d36/l3c 0 2024-09-12T22:49:54.398 INFO:tasks.workunit.client.0.smithi066.stdout:8/224: write d17/f29 [312887,78144] 0 2024-09-12T22:49:54.398 INFO:tasks.workunit.client.0.smithi066.stdout:3/181: dread d0/d2/d6/f9 [0,4194304] 0 2024-09-12T22:49:54.399 INFO:tasks.workunit.client.0.smithi066.stdout:5/288: dread d5/de/d50/d42/f48 [0,4194304] 0 2024-09-12T22:49:54.399 INFO:tasks.workunit.client.0.smithi066.stdout:9/190: rmdir d9 39 2024-09-12T22:49:54.403 INFO:tasks.workunit.client.0.smithi066.stdout:9/191: fdatasync d9/dc/f38 0 2024-09-12T22:49:54.404 INFO:tasks.workunit.client.0.smithi066.stdout:3/182: dread d0/d2/d6/f9 [0,4194304] 0 2024-09-12T22:49:54.405 INFO:tasks.workunit.client.0.smithi066.stdout:1/167: truncate d0/d9/f14 1631861 0 2024-09-12T22:49:54.405 INFO:tasks.workunit.client.0.smithi066.stdout:4/200: dwrite d5/d8/d10/de/f18 [0,4194304] 0 2024-09-12T22:49:54.405 INFO:tasks.workunit.client.0.smithi066.stdout:7/187: sync 2024-09-12T22:49:54.406 INFO:tasks.workunit.client.0.smithi066.stdout:3/183: chown d0/d2/d7/d13/d31/f37 2 1 2024-09-12T22:49:54.407 INFO:tasks.workunit.client.0.smithi066.stdout:5/289: dwrite d5/de/ff [0,4194304] 0 2024-09-12T22:49:54.408 INFO:tasks.workunit.client.0.smithi066.stdout:7/188: creat d0/d19/d24/d33/d27/d29/f3c x:0 0 0 2024-09-12T22:49:54.408 INFO:tasks.workunit.client.0.smithi066.stdout:5/290: mkdir d5/de/d57 0 2024-09-12T22:49:54.408 INFO:tasks.workunit.client.0.smithi066.stdout:3/184: link d0/d2/d1d/f23 d0/d2/d6/d33/d40/f48 0 2024-09-12T22:49:54.409 INFO:tasks.workunit.client.0.smithi066.stdout:5/291: write d5/d11/d23/f4e [471962,91333] 0 2024-09-12T22:49:54.411 INFO:tasks.workunit.client.0.smithi066.stdout:7/189: rename d0/d19/d24/c11 to d0/d6/c3d 0 2024-09-12T22:49:54.412 INFO:tasks.workunit.client.0.smithi066.stdout:1/168: dwrite d0/ff [4194304,4194304] 0 2024-09-12T22:49:54.413 INFO:tasks.workunit.client.0.smithi066.stdout:7/190: creat d0/d19/d24/f3e x:0 0 0 2024-09-12T22:49:54.414 INFO:tasks.workunit.client.0.smithi066.stdout:1/169: link d0/dc/d1d/c1b d0/d28/c2a 0 2024-09-12T22:49:54.415 INFO:tasks.workunit.client.0.smithi066.stdout:3/185: dwrite d0/d2/d6/f18 [0,4194304] 0 2024-09-12T22:49:54.416 INFO:tasks.workunit.client.0.smithi066.stdout:3/186: mkdir d0/d2/d6/d33/d49 0 2024-09-12T22:49:54.418 INFO:tasks.workunit.client.0.smithi066.stdout:3/187: fsync d0/d2/d7/d29/f42 0 2024-09-12T22:49:54.418 INFO:tasks.workunit.client.0.smithi066.stdout:1/170: dread d0/f1c [0,4194304] 0 2024-09-12T22:49:54.419 INFO:tasks.workunit.client.0.smithi066.stdout:3/188: mknod d0/d2/d7/d13/d43/c4a 0 2024-09-12T22:49:54.419 INFO:tasks.workunit.client.0.smithi066.stdout:1/171: creat d0/d9/d21/f2b x:0 0 0 2024-09-12T22:49:54.420 INFO:tasks.workunit.client.0.smithi066.stdout:1/172: mknod d0/d28/c2c 0 2024-09-12T22:49:54.420 INFO:tasks.workunit.client.0.smithi066.stdout:1/173: write d0/f7 [3764752,32702] 0 2024-09-12T22:49:54.422 INFO:tasks.workunit.client.0.smithi066.stdout:1/174: mknod d0/c2d 0 2024-09-12T22:49:54.425 INFO:tasks.workunit.client.0.smithi066.stdout:3/189: dwrite d0/d2/d1d/f2a [4194304,4194304] 0 2024-09-12T22:49:54.427 INFO:tasks.workunit.client.0.smithi066.stdout:3/190: creat d0/d2/d7/f4b x:0 0 0 2024-09-12T22:49:54.429 INFO:tasks.workunit.client.0.smithi066.stdout:4/201: dread d5/d8/d10/de/f14 [0,4194304] 0 2024-09-12T22:49:54.429 INFO:tasks.workunit.client.0.smithi066.stdout:6/209: dread d6/d7/fa [0,4194304] 0 2024-09-12T22:49:54.429 INFO:tasks.workunit.client.0.smithi066.stdout:4/202: chown d5/d8/d16/d1b/d1e/d38 768180 1 2024-09-12T22:49:54.430 INFO:tasks.workunit.client.0.smithi066.stdout:6/210: mkdir d6/d23/d41 0 2024-09-12T22:49:54.431 INFO:tasks.workunit.client.0.smithi066.stdout:4/203: symlink d5/d8/d10/l47 0 2024-09-12T22:49:54.432 INFO:tasks.workunit.client.0.smithi066.stdout:3/191: dread d0/d2/d6/f18 [0,4194304] 0 2024-09-12T22:49:54.432 INFO:tasks.workunit.client.0.smithi066.stdout:8/225: write d17/f22 [2668702,23210] 0 2024-09-12T22:49:54.433 INFO:tasks.workunit.client.0.smithi066.stdout:4/204: rmdir d5/d8/d16/d1b/d1e 39 2024-09-12T22:49:54.433 INFO:tasks.workunit.client.0.smithi066.stdout:3/192: creat d0/d2/d7/d13/d43/f4c x:0 0 0 2024-09-12T22:49:54.433 INFO:tasks.workunit.client.0.smithi066.stdout:8/226: rename d17/l3c to d17/l46 0 2024-09-12T22:49:54.434 INFO:tasks.workunit.client.0.smithi066.stdout:4/205: readlink d5/d8/d10/lf 0 2024-09-12T22:49:54.434 INFO:tasks.workunit.client.0.smithi066.stdout:8/227: chown d17/d40 2090842255 1 2024-09-12T22:49:54.434 INFO:tasks.workunit.client.0.smithi066.stdout:4/206: mkdir d5/d48 0 2024-09-12T22:49:54.435 INFO:tasks.workunit.client.0.smithi066.stdout:3/193: creat d0/d2/d6/d33/d40/f4d x:0 0 0 2024-09-12T22:49:54.435 INFO:tasks.workunit.client.0.smithi066.stdout:8/228: write d17/d2c/f32 [1408588,56017] 0 2024-09-12T22:49:54.435 INFO:tasks.workunit.client.0.smithi066.stdout:6/211: dwrite d6/d23/f29 [0,4194304] 0 2024-09-12T22:49:54.435 INFO:tasks.workunit.client.0.smithi066.stdout:4/207: write d5/d8/d10/f30 [572473,76299] 0 2024-09-12T22:49:54.436 INFO:tasks.workunit.client.0.smithi066.stdout:3/194: mknod d0/d2/d7/d13/d31/c4e 0 2024-09-12T22:49:54.436 INFO:tasks.workunit.client.0.smithi066.stdout:6/212: rmdir d6/d7/dc 39 2024-09-12T22:49:54.437 INFO:tasks.workunit.client.0.smithi066.stdout:4/208: rename d5/d8/f12 to d5/d8/f49 0 2024-09-12T22:49:54.437 INFO:tasks.workunit.client.0.smithi066.stdout:3/195: mknod d0/d2/d7/d13/c4f 0 2024-09-12T22:49:54.437 INFO:tasks.workunit.client.0.smithi066.stdout:6/213: mkdir d6/d35/d42 0 2024-09-12T22:49:54.438 INFO:tasks.workunit.client.0.smithi066.stdout:6/214: sync 2024-09-12T22:49:54.438 INFO:tasks.workunit.client.0.smithi066.stdout:4/209: rename d5/d8/d16/c21 to d5/d8/d16/d1b/d1e/d1f/c4a 0 2024-09-12T22:49:54.439 INFO:tasks.workunit.client.0.smithi066.stdout:4/210: creat d5/d8/d16/d1b/f4b x:0 0 0 2024-09-12T22:49:54.440 INFO:tasks.workunit.client.0.smithi066.stdout:4/211: symlink d5/d8/d10/de/d39/l4c 0 2024-09-12T22:49:54.441 INFO:tasks.workunit.client.0.smithi066.stdout:5/292: fdatasync d5/de/ff 0 2024-09-12T22:49:54.441 INFO:tasks.workunit.client.0.smithi066.stdout:5/293: fdatasync d5/f24 0 2024-09-12T22:49:54.442 INFO:tasks.workunit.client.0.smithi066.stdout:3/196: dwrite d0/d2/d6/fd [0,4194304] 0 2024-09-12T22:49:54.443 INFO:tasks.workunit.client.0.smithi066.stdout:9/192: truncate d9/dc/dd/f11 4146315 0 2024-09-12T22:49:54.443 INFO:tasks.workunit.client.0.smithi066.stdout:4/212: creat d5/d8/d16/d1b/d1e/d1f/f4d x:0 0 0 2024-09-12T22:49:54.444 INFO:tasks.workunit.client.0.smithi066.stdout:3/197: creat d0/d2/d7/d13/d43/f50 x:0 0 0 2024-09-12T22:49:54.444 INFO:tasks.workunit.client.0.smithi066.stdout:4/213: symlink d5/d8/l4e 0 2024-09-12T22:49:54.445 INFO:tasks.workunit.client.0.smithi066.stdout:9/193: chown d9/dc/d36/f39 6 1 2024-09-12T22:49:54.445 INFO:tasks.workunit.client.0.smithi066.stdout:5/294: rename d5/d15/f4f to d5/d11/f58 0 2024-09-12T22:49:54.445 INFO:tasks.workunit.client.0.smithi066.stdout:1/175: write d0/d9/f14 [1836936,73796] 0 2024-09-12T22:49:54.446 INFO:tasks.workunit.client.0.smithi066.stdout:4/214: readlink d5/d8/d10/l47 0 2024-09-12T22:49:54.446 INFO:tasks.workunit.client.0.smithi066.stdout:8/229: truncate d17/d2c/f32 941542 0 2024-09-12T22:49:54.446 INFO:tasks.workunit.client.0.smithi066.stdout:3/198: symlink d0/d2/d6/d33/d40/d44/l51 0 2024-09-12T22:49:54.447 INFO:tasks.workunit.client.0.smithi066.stdout:4/215: chown f1 429 1 2024-09-12T22:49:54.447 INFO:tasks.workunit.client.0.smithi066.stdout:9/194: write d9/dc/dd/f1d [1238369,59060] 0 2024-09-12T22:49:54.449 INFO:tasks.workunit.client.0.smithi066.stdout:7/191: dwrite d0/d19/d24/f1f [0,4194304] 0 2024-09-12T22:49:54.449 INFO:tasks.workunit.client.0.smithi066.stdout:4/216: write d5/d8/d16/d1b/d1e/d38/f3f [736022,49537] 0 2024-09-12T22:49:54.449 INFO:tasks.workunit.client.0.smithi066.stdout:1/176: creat d0/f2e x:0 0 0 2024-09-12T22:49:54.450 INFO:tasks.workunit.client.0.smithi066.stdout:7/192: write d0/d19/d26/f28 [803831,101829] 0 2024-09-12T22:49:54.450 INFO:tasks.workunit.client.0.smithi066.stdout:1/177: chown d0/dc/f17 0 1 2024-09-12T22:49:54.451 INFO:tasks.workunit.client.0.smithi066.stdout:4/217: write d5/d8/d16/d1b/d1e/d38/f3f [175346,1980] 0 2024-09-12T22:49:54.452 INFO:tasks.workunit.client.0.smithi066.stdout:4/218: stat d5/d8/d10/f36 0 2024-09-12T22:49:54.452 INFO:tasks.workunit.client.0.smithi066.stdout:7/193: mknod d0/d19/d24/d33/d27/c3f 0 2024-09-12T22:49:54.453 INFO:tasks.workunit.client.0.smithi066.stdout:7/194: chown d0/c3a 661002 1 2024-09-12T22:49:54.453 INFO:tasks.workunit.client.0.smithi066.stdout:3/199: dwrite d0/d2/d6/d33/d40/f4d [0,4194304] 0 2024-09-12T22:49:54.454 INFO:tasks.workunit.client.0.smithi066.stdout:1/178: fsync d0/f2e 0 2024-09-12T22:49:54.454 INFO:tasks.workunit.client.0.smithi066.stdout:5/295: truncate d5/d11/d23/f4e 2421568 0 2024-09-12T22:49:54.455 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:54.453+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:54.455 INFO:tasks.workunit.client.0.smithi066.stdout:4/219: unlink d5/d8/d10/f31 0 2024-09-12T22:49:54.457 INFO:tasks.workunit.client.0.smithi066.stdout:4/220: creat d5/f4f x:0 0 0 2024-09-12T22:49:54.457 INFO:tasks.workunit.client.0.smithi066.stdout:5/296: rename d5/d11/d23 to d5/d11/d23/d52/d59 22 2024-09-12T22:49:54.460 INFO:tasks.workunit.client.0.smithi066.stdout:6/215: dwrite d6/d23/f29 [4194304,4194304] 0 2024-09-12T22:49:54.460 INFO:tasks.workunit.client.0.smithi066.stdout:3/200: rename d0/d2/d7/lf to d0/d2/d6/d33/d40/d44/l52 0 2024-09-12T22:49:54.461 INFO:tasks.workunit.client.0.smithi066.stdout:9/195: dread d9/dc/dd/f11 [0,4194304] 0 2024-09-12T22:49:54.465 INFO:tasks.workunit.client.0.smithi066.stdout:6/216: fdatasync d6/f2a 0 2024-09-12T22:49:54.465 INFO:tasks.workunit.client.0.smithi066.stdout:8/230: dwrite d17/d2c/f34 [0,4194304] 0 2024-09-12T22:49:54.465 INFO:tasks.workunit.client.0.smithi066.stdout:4/221: creat d5/d8/d10/de/d2d/f50 x:0 0 0 2024-09-12T22:49:54.465 INFO:tasks.workunit.client.0.smithi066.stdout:5/297: rename d5/d11/d23/f2b to d5/de/d50/f5a 0 2024-09-12T22:49:54.465 INFO:tasks.workunit.client.0.smithi066.stdout:3/201: mknod d0/d1b/c53 0 2024-09-12T22:49:54.466 INFO:tasks.workunit.client.0.smithi066.stdout:7/195: link d0/d19/d24/f1d d0/d19/d24/d33/d27/d29/f40 0 2024-09-12T22:49:54.466 INFO:tasks.workunit.client.0.smithi066.stdout:8/231: stat d17/l28 0 2024-09-12T22:49:54.466 INFO:tasks.workunit.client.0.smithi066.stdout:1/179: dwrite d0/d9/d21/f2b [0,4194304] 0 2024-09-12T22:49:54.466 INFO:tasks.workunit.client.0.smithi066.stdout:2/207: dread d1/d11/f25 [0,4194304] 0 2024-09-12T22:49:54.467 INFO:tasks.workunit.client.0.smithi066.stdout:7/196: rmdir d0/d19 39 2024-09-12T22:49:54.467 INFO:tasks.workunit.client.0.smithi066.stdout:7/197: sync 2024-09-12T22:49:54.467 INFO:tasks.workunit.client.0.smithi066.stdout:8/232: truncate d17/d1b/f1e 5075552 0 2024-09-12T22:49:54.467 INFO:tasks.workunit.client.0.smithi066.stdout:2/208: symlink d1/d2a/l46 0 2024-09-12T22:49:54.467 INFO:tasks.workunit.client.0.smithi066.stdout:4/222: write d5/d8/d10/de/d39/f3b [348310,5460] 0 2024-09-12T22:49:54.467 INFO:tasks.workunit.client.0.smithi066.stdout:3/202: truncate d0/d2/d6/d33/d40/f4d 5104388 0 2024-09-12T22:49:54.467 INFO:tasks.workunit.client.0.smithi066.stdout:1/180: symlink d0/dc/l2f 0 2024-09-12T22:49:54.468 INFO:tasks.workunit.client.0.smithi066.stdout:7/198: readlink d0/l31 0 2024-09-12T22:49:54.468 INFO:tasks.workunit.client.0.smithi066.stdout:5/298: truncate d5/de/d50/f5a 1199757 0 2024-09-12T22:49:54.468 INFO:tasks.workunit.client.0.smithi066.stdout:6/217: link d6/f1f d6/d7/dc/f43 0 2024-09-12T22:49:54.468 INFO:tasks.workunit.client.0.smithi066.stdout:7/199: stat d0/l31 0 2024-09-12T22:49:54.469 INFO:tasks.workunit.client.0.smithi066.stdout:9/196: getdents d9/dc/d23 0 2024-09-12T22:49:54.469 INFO:tasks.workunit.client.0.smithi066.stdout:8/233: mkdir d17/d40/d47 0 2024-09-12T22:49:54.469 INFO:tasks.workunit.client.0.smithi066.stdout:5/299: chown d5/d11/f40 0 1 2024-09-12T22:49:54.469 INFO:tasks.workunit.client.0.smithi066.stdout:2/209: stat d1/dd/d12/d1e/c2f 0 2024-09-12T22:49:54.469 INFO:tasks.workunit.client.0.smithi066.stdout:5/300: sync 2024-09-12T22:49:54.469 INFO:tasks.workunit.client.0.smithi066.stdout:3/203: creat d0/f54 x:0 0 0 2024-09-12T22:49:54.470 INFO:tasks.workunit.client.0.smithi066.stdout:1/181: link d0/dc/c29 d0/d28/c30 0 2024-09-12T22:49:54.470 INFO:tasks.workunit.client.0.smithi066.stdout:2/210: fdatasync d1/d2a/f34 0 2024-09-12T22:49:54.470 INFO:tasks.workunit.client.0.smithi066.stdout:7/200: creat d0/d6/f41 x:0 0 0 2024-09-12T22:49:54.471 INFO:tasks.workunit.client.0.smithi066.stdout:8/234: unlink cd 0 2024-09-12T22:49:54.471 INFO:tasks.workunit.client.0.smithi066.stdout:6/218: symlink d6/d20/d32/d3c/l44 0 2024-09-12T22:49:54.471 INFO:tasks.workunit.client.0.smithi066.stdout:5/301: symlink d5/d15/l5b 0 2024-09-12T22:49:54.473 INFO:tasks.workunit.client.0.smithi066.stdout:9/197: getdents d9/d31/d34 0 2024-09-12T22:49:54.473 INFO:tasks.workunit.client.0.smithi066.stdout:8/235: rmdir d17/d1b 39 2024-09-12T22:49:54.473 INFO:tasks.workunit.client.0.smithi066.stdout:1/182: creat d0/d9/d21/f31 x:0 0 0 2024-09-12T22:49:54.474 INFO:tasks.workunit.client.0.smithi066.stdout:3/204: write d0/d2/d7/d13/f39 [1270397,6360] 0 2024-09-12T22:49:54.474 INFO:tasks.workunit.client.0.smithi066.stdout:4/223: dwrite d5/f24 [4194304,4194304] 0 2024-09-12T22:49:54.474 INFO:tasks.workunit.client.0.smithi066.stdout:0/218: dread d1/d8/fe [0,4194304] 0 2024-09-12T22:49:54.475 INFO:tasks.workunit.client.0.smithi066.stdout:9/198: creat d9/d31/d34/f3d x:0 0 0 2024-09-12T22:49:54.475 INFO:tasks.workunit.client.0.smithi066.stdout:8/236: write d17/f27 [504738,27173] 0 2024-09-12T22:49:54.476 INFO:tasks.workunit.client.0.smithi066.stdout:5/302: read d5/de/d50/f5a [573449,44065] 0 2024-09-12T22:49:54.477 INFO:tasks.workunit.client.0.smithi066.stdout:6/219: rename d6/d7/l1b to d6/d23/l45 0 2024-09-12T22:49:54.478 INFO:tasks.workunit.client.0.smithi066.stdout:3/205: mkdir d0/d2/d6/d33/d40/d44/d55 0 2024-09-12T22:49:54.480 INFO:tasks.workunit.client.0.smithi066.stdout:0/219: creat d1/f51 x:0 0 0 2024-09-12T22:49:54.480 INFO:tasks.workunit.client.0.smithi066.stdout:6/220: mknod d6/c46 0 2024-09-12T22:49:54.481 INFO:tasks.workunit.client.0.smithi066.stdout:7/201: dwrite d0/d19/d24/f3b [0,4194304] 0 2024-09-12T22:49:54.482 INFO:tasks.workunit.client.0.smithi066.stdout:2/211: dwrite d1/d2a/f34 [0,4194304] 0 2024-09-12T22:49:54.484 INFO:tasks.workunit.client.0.smithi066.stdout:6/221: read - d6/d23/f3e zero size 2024-09-12T22:49:54.484 INFO:tasks.workunit.client.0.smithi066.stdout:3/206: write d0/d2/d7/d13/d43/f4c [800385,71376] 0 2024-09-12T22:49:54.485 INFO:tasks.workunit.client.0.smithi066.stdout:8/237: symlink d17/d1b/l48 0 2024-09-12T22:49:54.486 INFO:tasks.workunit.client.0.smithi066.stdout:0/220: getdents d1 0 2024-09-12T22:49:54.487 INFO:tasks.workunit.client.0.smithi066.stdout:8/238: write f11 [4579303,1968] 0 2024-09-12T22:49:54.487 INFO:tasks.workunit.client.0.smithi066.stdout:2/212: write d1/dd/d12/d1e/f35 [853789,1154] 0 2024-09-12T22:49:54.487 INFO:tasks.workunit.client.0.smithi066.stdout:4/224: dwrite d5/d8/d10/de/f2b [0,4194304] 0 2024-09-12T22:49:54.488 INFO:tasks.workunit.client.0.smithi066.stdout:9/199: dwrite d9/dc/fe [0,4194304] 0 2024-09-12T22:49:54.488 INFO:tasks.workunit.client.0.smithi066.stdout:9/200: sync 2024-09-12T22:49:54.488 INFO:tasks.workunit.client.0.smithi066.stdout:1/183: dwrite d0/d9/d21/f27 [0,4194304] 0 2024-09-12T22:49:54.489 INFO:tasks.workunit.client.0.smithi066.stdout:8/239: rmdir d17 39 2024-09-12T22:49:54.489 INFO:tasks.workunit.client.0.smithi066.stdout:5/303: dread d5/d15/f1a [0,4194304] 0 2024-09-12T22:49:54.489 INFO:tasks.workunit.client.0.smithi066.stdout:8/240: sync 2024-09-12T22:49:54.490 INFO:tasks.workunit.client.0.smithi066.stdout:9/201: write d9/fa [3610673,12085] 0 2024-09-12T22:49:54.491 INFO:tasks.workunit.client.0.smithi066.stdout:1/184: readlink d0/l5 0 2024-09-12T22:49:54.493 INFO:tasks.workunit.client.0.smithi066.stdout:6/222: dread d6/d23/d25/f2e [0,4194304] 0 2024-09-12T22:49:54.493 INFO:tasks.workunit.client.0.smithi066.stdout:5/304: creat d5/d11/d23/f5c x:0 0 0 2024-09-12T22:49:54.493 INFO:tasks.workunit.client.0.smithi066.stdout:2/213: mkdir d1/db/d42/d43/d47 0 2024-09-12T22:49:54.494 INFO:tasks.workunit.client.0.smithi066.stdout:6/223: readlink d6/l10 0 2024-09-12T22:49:54.494 INFO:tasks.workunit.client.0.smithi066.stdout:9/202: symlink d9/l3e 0 2024-09-12T22:49:54.494 INFO:tasks.workunit.client.0.smithi066.stdout:2/214: chown d1/dd/d12/d18/f3e 731638 1 2024-09-12T22:49:54.495 INFO:tasks.workunit.client.0.smithi066.stdout:5/305: rmdir d5/d11/d23/d52 0 2024-09-12T22:49:54.495 INFO:tasks.workunit.client.0.smithi066.stdout:9/203: symlink d9/dc/dd/l3f 0 2024-09-12T22:49:54.496 INFO:tasks.workunit.client.0.smithi066.stdout:4/225: dwrite d5/d3e/f44 [0,4194304] 0 2024-09-12T22:49:54.497 INFO:tasks.workunit.client.0.smithi066.stdout:5/306: getdents d5/de/d50/d42/d49 0 2024-09-12T22:49:54.497 INFO:tasks.workunit.client.0.smithi066.stdout:9/204: creat d9/dc/f40 x:0 0 0 2024-09-12T22:49:54.497 INFO:tasks.workunit.client.0.smithi066.stdout:4/226: creat d5/d8/d16/d1b/d1e/f51 x:0 0 0 2024-09-12T22:49:54.498 INFO:tasks.workunit.client.0.smithi066.stdout:1/185: dread d0/d9/d21/f27 [0,4194304] 0 2024-09-12T22:49:54.498 INFO:tasks.workunit.client.0.smithi066.stdout:9/205: chown d9/dc/d23/c33 780367 1 2024-09-12T22:49:54.499 INFO:tasks.workunit.client.0.smithi066.stdout:5/307: dread d5/de/d50/d42/f48 [0,4194304] 0 2024-09-12T22:49:54.499 INFO:tasks.workunit.client.0.smithi066.stdout:1/186: mknod d0/c32 0 2024-09-12T22:49:54.500 INFO:tasks.workunit.client.0.smithi066.stdout:5/308: fsync d5/d11/f54 0 2024-09-12T22:49:54.500 INFO:tasks.workunit.client.0.smithi066.stdout:1/187: chown d0/dc/l1a 19 1 2024-09-12T22:49:54.501 INFO:tasks.workunit.client.0.smithi066.stdout:5/309: dread - d5/d11/d21/f4a zero size 2024-09-12T22:49:54.501 INFO:tasks.workunit.client.0.smithi066.stdout:1/188: mkdir d0/dc/d33 0 2024-09-12T22:49:54.502 INFO:tasks.workunit.client.0.smithi066.stdout:0/221: dread d1/d8/d1b/f43 [0,4194304] 0 2024-09-12T22:49:54.502 INFO:tasks.workunit.client.0.smithi066.stdout:5/310: chown d5/d11/c51 1419174 1 2024-09-12T22:49:54.502 INFO:tasks.workunit.client.0.smithi066.stdout:0/222: write d1/f51 [725705,80141] 0 2024-09-12T22:49:54.503 INFO:tasks.workunit.client.0.smithi066.stdout:0/223: dread - d1/f2a zero size 2024-09-12T22:49:54.504 INFO:tasks.workunit.client.0.smithi066.stdout:9/206: dwrite d9/dc/dd/f1b [0,4194304] 0 2024-09-12T22:49:54.505 INFO:tasks.workunit.client.0.smithi066.stdout:5/311: mkdir d5/d11/d5d 0 2024-09-12T22:49:54.505 INFO:tasks.workunit.client.0.smithi066.stdout:9/207: readlink d9/dc/d36/l3c 0 2024-09-12T22:49:54.505 INFO:tasks.workunit.client.0.smithi066.stdout:0/224: dread - d1/d8/d1c/d13/f20 zero size 2024-09-12T22:49:54.506 INFO:tasks.workunit.client.0.smithi066.stdout:9/208: fsync d9/dc/f1f 0 2024-09-12T22:49:54.506 INFO:tasks.workunit.client.0.smithi066.stdout:5/312: chown d5/d11/d21/l3a 168140412 1 2024-09-12T22:49:54.506 INFO:tasks.workunit.client.0.smithi066.stdout:0/225: creat d1/d8/d1f/f52 x:0 0 0 2024-09-12T22:49:54.509 INFO:tasks.workunit.client.0.smithi066.stdout:1/189: dwrite d0/dc/d1d/f24 [0,4194304] 0 2024-09-12T22:49:54.510 INFO:tasks.workunit.client.0.smithi066.stdout:7/202: dwrite d0/d19/d24/d33/d27/d29/f40 [0,4194304] 0 2024-09-12T22:49:54.510 INFO:tasks.workunit.client.0.smithi066.stdout:5/313: write d5/de/d50/d42/f48 [810266,100703] 0 2024-09-12T22:49:54.510 INFO:tasks.workunit.client.0.smithi066.stdout:1/190: fsync d0/dc/f17 0 2024-09-12T22:49:54.511 INFO:tasks.workunit.client.0.smithi066.stdout:0/226: rename d1/d8/d1c/dd/c18 to d1/d8/d1f/d30/c53 0 2024-09-12T22:49:54.512 INFO:tasks.workunit.client.0.smithi066.stdout:1/191: symlink d0/d9/d21/l34 0 2024-09-12T22:49:54.514 INFO:tasks.workunit.client.0.smithi066.stdout:8/241: truncate f16 3330376 0 2024-09-12T22:49:54.515 INFO:tasks.workunit.client.0.smithi066.stdout:9/209: dwrite d9/dc/dd/f13 [0,4194304] 0 2024-09-12T22:49:54.515 INFO:tasks.workunit.client.0.smithi066.stdout:6/224: truncate d6/d23/f29 2603460 0 2024-09-12T22:49:54.515 INFO:tasks.workunit.client.0.smithi066.stdout:1/192: truncate d0/f2e 824261 0 2024-09-12T22:49:54.515 INFO:tasks.workunit.client.0.smithi066.stdout:2/215: truncate d1/d2a/f34 2735872 0 2024-09-12T22:49:54.516 INFO:tasks.workunit.client.0.smithi066.stdout:8/242: write f15 [3937454,4527] 0 2024-09-12T22:49:54.517 INFO:tasks.workunit.client.0.smithi066.stdout:0/227: mknod d1/d8/d1f/d25/c54 0 2024-09-12T22:49:54.517 INFO:tasks.workunit.client.0.smithi066.stdout:6/225: unlink c4 0 2024-09-12T22:49:54.517 INFO:tasks.workunit.client.0.smithi066.stdout:9/210: creat d9/dc/d23/f41 x:0 0 0 2024-09-12T22:49:54.517 INFO:tasks.workunit.client.0.smithi066.stdout:2/216: creat d1/d2a/f48 x:0 0 0 2024-09-12T22:49:54.518 INFO:tasks.workunit.client.0.smithi066.stdout:1/193: symlink d0/dc/d33/l35 0 2024-09-12T22:49:54.518 INFO:tasks.workunit.client.0.smithi066.stdout:3/207: dwrite d0/d2/d6/d33/d40/f48 [0,4194304] 0 2024-09-12T22:49:54.519 INFO:tasks.workunit.client.0.smithi066.stdout:0/228: creat d1/d8/d1f/d30/f55 x:0 0 0 2024-09-12T22:49:54.519 INFO:tasks.workunit.client.0.smithi066.stdout:6/226: mknod d6/d35/d42/c47 0 2024-09-12T22:49:54.520 INFO:tasks.workunit.client.0.smithi066.stdout:7/203: dwrite d0/d19/d24/f12 [4194304,4194304] 0 2024-09-12T22:49:54.520 INFO:tasks.workunit.client.0.smithi066.stdout:6/227: sync 2024-09-12T22:49:54.521 INFO:tasks.workunit.client.0.smithi066.stdout:6/228: dread - d6/d23/f27 zero size 2024-09-12T22:49:54.521 INFO:tasks.workunit.client.0.smithi066.stdout:2/217: dread d1/dd/f2c [0,4194304] 0 2024-09-12T22:49:54.522 INFO:tasks.workunit.client.0.smithi066.stdout:2/218: fsync d1/d11/f19 0 2024-09-12T22:49:54.525 INFO:tasks.workunit.client.0.smithi066.stdout:2/219: write d1/f6 [3685593,6998] 0 2024-09-12T22:49:54.527 INFO:tasks.workunit.client.0.smithi066.stdout:3/208: dread d0/d2/d1d/f21 [4194304,4194304] 0 2024-09-12T22:49:54.527 INFO:tasks.workunit.client.0.smithi066.stdout:9/211: dwrite d9/dc/dd/f1d [0,4194304] 0 2024-09-12T22:49:54.529 INFO:tasks.workunit.client.0.smithi066.stdout:1/194: dwrite d0/d9/d21/f27 [0,4194304] 0 2024-09-12T22:49:54.530 INFO:tasks.workunit.client.0.smithi066.stdout:7/204: dread d0/d19/d24/f3b [0,4194304] 0 2024-09-12T22:49:54.530 INFO:tasks.workunit.client.0.smithi066.stdout:5/314: dwrite d5/d15/f17 [4194304,4194304] 0 2024-09-12T22:49:54.530 INFO:tasks.workunit.client.0.smithi066.stdout:8/243: truncate f11 2673318 0 2024-09-12T22:49:54.531 INFO:tasks.workunit.client.0.smithi066.stdout:2/220: fsync d1/dd/f14 0 2024-09-12T22:49:54.533 INFO:tasks.workunit.client.0.smithi066.stdout:9/212: write d9/dc/d36/f39 [974831,84263] 0 2024-09-12T22:49:54.533 INFO:tasks.workunit.client.0.smithi066.stdout:6/229: write d6/d7/dc/f43 [586386,102325] 0 2024-09-12T22:49:54.533 INFO:tasks.workunit.client.0.smithi066.stdout:1/195: write d0/dc/f22 [109482,71176] 0 2024-09-12T22:49:54.533 INFO:tasks.workunit.client.0.smithi066.stdout:5/315: write d5/f3e [2093416,12151] 0 2024-09-12T22:49:54.534 INFO:tasks.workunit.client.0.smithi066.stdout:8/244: mkdir d17/d49 0 2024-09-12T22:49:54.534 INFO:tasks.workunit.client.0.smithi066.stdout:2/221: dread - d1/dd/d12/d18/f3e zero size 2024-09-12T22:49:54.535 INFO:tasks.workunit.client.0.smithi066.stdout:2/222: sync 2024-09-12T22:49:54.535 INFO:tasks.workunit.client.0.smithi066.stdout:1/196: mkdir d0/d36 0 2024-09-12T22:49:54.535 INFO:tasks.workunit.client.0.smithi066.stdout:0/229: read d1/d8/d1f/f45 [4726745,56146] 0 2024-09-12T22:49:54.535 INFO:tasks.workunit.client.0.smithi066.stdout:9/213: write d9/fb [127293,93871] 0 2024-09-12T22:49:54.536 INFO:tasks.workunit.client.0.smithi066.stdout:5/316: symlink d5/d15/l5e 0 2024-09-12T22:49:54.536 INFO:tasks.workunit.client.0.smithi066.stdout:2/223: dread - d1/dd/d3d/f3f zero size 2024-09-12T22:49:54.538 INFO:tasks.workunit.client.0.smithi066.stdout:6/230: getdents d6/d20/d32 0 2024-09-12T22:49:54.538 INFO:tasks.workunit.client.0.smithi066.stdout:1/197: rmdir d0/d9/d21 39 2024-09-12T22:49:54.538 INFO:tasks.workunit.client.0.smithi066.stdout:5/317: mkdir d5/d11/d5f 0 2024-09-12T22:49:54.538 INFO:tasks.workunit.client.0.smithi066.stdout:9/214: write d9/dc/f19 [164696,92304] 0 2024-09-12T22:49:54.538 INFO:tasks.workunit.client.0.smithi066.stdout:0/230: mkdir d1/d8/d1c/d56 0 2024-09-12T22:49:54.539 INFO:tasks.workunit.client.0.smithi066.stdout:2/224: mknod d1/d2a/c49 0 2024-09-12T22:49:54.539 INFO:tasks.workunit.client.0.smithi066.stdout:1/198: symlink d0/d28/l37 0 2024-09-12T22:49:54.539 INFO:tasks.workunit.client.0.smithi066.stdout:6/231: stat d6/d23/d25/f2e 0 2024-09-12T22:49:54.540 INFO:tasks.workunit.client.0.smithi066.stdout:5/318: write d5/de/ff [5272295,54031] 0 2024-09-12T22:49:54.540 INFO:tasks.workunit.client.0.smithi066.stdout:0/231: symlink d1/d8/d1c/d13/l57 0 2024-09-12T22:49:54.541 INFO:tasks.workunit.client.0.smithi066.stdout:3/209: dwrite d0/d2/d6/f46 [4194304,4194304] 0 2024-09-12T22:49:54.541 INFO:tasks.workunit.client.0.smithi066.stdout:1/199: mknod d0/d28/c38 0 2024-09-12T22:49:54.542 INFO:tasks.workunit.client.0.smithi066.stdout:2/225: creat d1/dd/d3d/f4a x:0 0 0 2024-09-12T22:49:54.542 INFO:tasks.workunit.client.0.smithi066.stdout:6/232: symlink d6/d20/d32/l48 0 2024-09-12T22:49:54.542 INFO:tasks.workunit.client.0.smithi066.stdout:1/200: stat d0/dc/fe 0 2024-09-12T22:49:54.543 INFO:tasks.workunit.client.0.smithi066.stdout:7/205: dwrite d0/d19/d24/d33/d27/f2a [0,4194304] 0 2024-09-12T22:49:54.543 INFO:tasks.workunit.client.0.smithi066.stdout:3/210: symlink d0/d2/d7/d13/l56 0 2024-09-12T22:49:54.544 INFO:tasks.workunit.client.0.smithi066.stdout:0/232: write d1/d8/d1c/d13/f22 [3126294,47211] 0 2024-09-12T22:49:54.544 INFO:tasks.workunit.client.0.smithi066.stdout:2/226: creat d1/d44/f4b x:0 0 0 2024-09-12T22:49:54.544 INFO:tasks.workunit.client.0.smithi066.stdout:3/211: readlink d0/l10 0 2024-09-12T22:49:54.544 INFO:tasks.workunit.client.0.smithi066.stdout:1/201: creat d0/dc/d1d/f39 x:0 0 0 2024-09-12T22:49:54.546 INFO:tasks.workunit.client.0.smithi066.stdout:6/233: rename d6/d20/d24 to d6/d49 0 2024-09-12T22:49:54.546 INFO:tasks.workunit.client.0.smithi066.stdout:1/202: rmdir d0 39 2024-09-12T22:49:54.546 INFO:tasks.workunit.client.0.smithi066.stdout:7/206: chown d0/d19/d24/d33/d27/d29 778787 1 2024-09-12T22:49:54.546 INFO:tasks.workunit.client.0.smithi066.stdout:0/233: stat d1/d8/d1c/dd/f29 0 2024-09-12T22:49:54.546 INFO:tasks.workunit.client.0.smithi066.stdout:3/212: truncate d0/f38 513406 0 2024-09-12T22:49:54.547 INFO:tasks.workunit.client.0.smithi066.stdout:2/227: truncate d1/dd/d12/f21 1006988 0 2024-09-12T22:49:54.547 INFO:tasks.workunit.client.0.smithi066.stdout:0/234: mknod d1/c58 0 2024-09-12T22:49:54.548 INFO:tasks.workunit.client.0.smithi066.stdout:1/203: truncate d0/f13 967430 0 2024-09-12T22:49:54.548 INFO:tasks.workunit.client.0.smithi066.stdout:0/235: chown d1/d36/c50 1 1 2024-09-12T22:49:54.548 INFO:tasks.workunit.client.0.smithi066.stdout:5/319: dwrite d5/d11/f1b [4194304,4194304] 0 2024-09-12T22:49:54.549 INFO:tasks.workunit.client.0.smithi066.stdout:2/228: read d1/dd/d12/d1e/f39 [4279976,32813] 0 2024-09-12T22:49:54.549 INFO:tasks.workunit.client.0.smithi066.stdout:6/234: getdents d6/d7 0 2024-09-12T22:49:54.549 INFO:tasks.workunit.client.0.smithi066.stdout:7/207: rename d0/d19/d24/l17 to d0/d19/d24/l42 0 2024-09-12T22:49:54.550 INFO:tasks.workunit.client.0.smithi066.stdout:1/204: symlink d0/d9/l3a 0 2024-09-12T22:49:54.551 INFO:tasks.workunit.client.0.smithi066.stdout:6/235: chown d6/c3b 364 1 2024-09-12T22:49:54.551 INFO:tasks.workunit.client.0.smithi066.stdout:6/236: chown d6 4 1 2024-09-12T22:49:54.553 INFO:tasks.workunit.client.0.smithi066.stdout:8/245: write d17/d1b/f2e [592509,26104] 0 2024-09-12T22:49:54.553 INFO:tasks.workunit.client.0.smithi066.stdout:1/205: creat d0/dc/d33/f3b x:0 0 0 2024-09-12T22:49:54.553 INFO:tasks.workunit.client.0.smithi066.stdout:0/236: getdents d1/d8/d1c/dd 0 2024-09-12T22:49:54.553 INFO:tasks.workunit.client.0.smithi066.stdout:3/213: dread d0/d1b/f45 [0,4194304] 0 2024-09-12T22:49:54.554 INFO:tasks.workunit.client.0.smithi066.stdout:7/208: chown d0/d19/d24/d33/d27/f2a 0 1 2024-09-12T22:49:54.554 INFO:tasks.workunit.client.0.smithi066.stdout:1/206: unlink d0/ff 0 2024-09-12T22:49:54.555 INFO:tasks.workunit.client.0.smithi066.stdout:3/214: write d0/f38 [433747,105126] 0 2024-09-12T22:49:54.555 INFO:tasks.workunit.client.0.smithi066.stdout:1/207: rmdir d0/d28 39 2024-09-12T22:49:54.555 INFO:tasks.workunit.client.0.smithi066.stdout:7/209: chown d0/d19/d24/c22 905055 1 2024-09-12T22:49:54.556 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:54.554+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:54.556 INFO:tasks.workunit.client.0.smithi066.stdout:0/237: chown d1/d8/d1c/d13/f22 8629902 1 2024-09-12T22:49:54.556 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:54.556 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:54.558 INFO:tasks.workunit.client.0.smithi066.stdout:2/229: dwrite d1/dd/d12/d18/f3e [0,4194304] 0 2024-09-12T22:49:54.558 INFO:tasks.workunit.client.0.smithi066.stdout:6/237: read d6/d20/f18 [4038706,108543] 0 2024-09-12T22:49:54.559 INFO:tasks.workunit.client.0.smithi066.stdout:0/238: write d1/d8/d1b/f48 [766017,15695] 0 2024-09-12T22:49:54.559 INFO:tasks.workunit.client.0.smithi066.stdout:6/238: mkdir d6/d49/d33/d4a 0 2024-09-12T22:49:54.559 INFO:tasks.workunit.client.0.smithi066.stdout:7/210: getdents d0/d19/d24/d33/d27 0 2024-09-12T22:49:54.561 INFO:tasks.workunit.client.0.smithi066.stdout:8/246: read d17/d1b/f2e [584499,23807] 0 2024-09-12T22:49:54.561 INFO:tasks.workunit.client.0.smithi066.stdout:7/211: write d0/d19/d24/f1f [702288,56931] 0 2024-09-12T22:49:54.561 INFO:tasks.workunit.client.0.smithi066.stdout:6/239: unlink d6/d49/d33/f3d 0 2024-09-12T22:49:54.561 INFO:tasks.workunit.client.0.smithi066.stdout:8/247: chown d17/d2c 755433216 1 2024-09-12T22:49:54.562 INFO:tasks.workunit.client.0.smithi066.stdout:8/248: write d17/d2c/f37 [528656,85345] 0 2024-09-12T22:49:54.562 INFO:tasks.workunit.client.0.smithi066.stdout:7/212: dread - d0/d19/d24/f3e zero size 2024-09-12T22:49:54.562 INFO:tasks.workunit.client.0.smithi066.stdout:8/249: sync 2024-09-12T22:49:54.563 INFO:tasks.workunit.client.0.smithi066.stdout:7/213: symlink d0/d6/l43 0 2024-09-12T22:49:54.563 INFO:tasks.workunit.client.0.smithi066.stdout:8/250: write d17/f21 [439298,53393] 0 2024-09-12T22:49:54.564 INFO:tasks.workunit.client.0.smithi066.stdout:7/214: mknod d0/d6/c44 0 2024-09-12T22:49:54.565 INFO:tasks.workunit.client.0.smithi066.stdout:0/239: dwrite d1/d8/d1f/d30/f3d [0,4194304] 0 2024-09-12T22:49:54.565 INFO:tasks.workunit.client.0.smithi066.stdout:8/251: symlink d17/d1b/l4a 0 2024-09-12T22:49:54.565 INFO:tasks.workunit.client.0.smithi066.stdout:7/215: creat d0/d19/f45 x:0 0 0 2024-09-12T22:49:54.565 INFO:tasks.workunit.client.0.smithi066.stdout:6/240: rmdir d6/d49 39 2024-09-12T22:49:54.565 INFO:tasks.workunit.client.0.smithi066.stdout:0/240: mkdir d1/d8/d1b/d59 0 2024-09-12T22:49:54.566 INFO:tasks.workunit.client.0.smithi066.stdout:0/241: creat d1/d8/f5a x:0 0 0 2024-09-12T22:49:54.567 INFO:tasks.workunit.client.0.smithi066.stdout:7/216: write d0/d19/d24/d33/d27/d29/f3c [16008,73455] 0 2024-09-12T22:49:54.567 INFO:tasks.workunit.client.0.smithi066.stdout:6/241: creat d6/f4b x:0 0 0 2024-09-12T22:49:54.567 INFO:tasks.workunit.client.0.smithi066.stdout:6/242: readlink d6/d20/d32/l38 0 2024-09-12T22:49:54.567 INFO:tasks.workunit.client.0.smithi066.stdout:0/242: mkdir d1/d5b 0 2024-09-12T22:49:54.568 INFO:tasks.workunit.client.0.smithi066.stdout:6/243: fdatasync d6/f4b 0 2024-09-12T22:49:54.571 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:54.571 INFO:tasks.workunit.client.0.smithi066.stdout:0/243: link d1/f2a d1/d8/d1f/d30/f5c 0 2024-09-12T22:49:54.571 INFO:tasks.workunit.client.0.smithi066.stdout:6/244: creat d6/f4c x:0 0 0 2024-09-12T22:49:54.572 INFO:tasks.workunit.client.0.smithi066.stdout:4/227: dread d5/d8/d16/d1b/f28 [0,4194304] 0 2024-09-12T22:49:54.572 INFO:tasks.workunit.client.0.smithi066.stdout:8/252: dwrite d17/d2c/f38 [0,4194304] 0 2024-09-12T22:49:54.572 INFO:tasks.workunit.client.0.smithi066.stdout:5/320: dread d5/d11/f40 [0,4194304] 0 2024-09-12T22:49:54.573 INFO:tasks.workunit.client.0.smithi066.stdout:6/245: truncate d6/d49/d33/f3f 425940 0 2024-09-12T22:49:54.573 INFO:tasks.workunit.client.0.smithi066.stdout:0/244: symlink d1/d36/l5d 0 2024-09-12T22:49:54.574 INFO:tasks.workunit.client.0.smithi066.stdout:5/321: creat d5/de/d50/f60 x:0 0 0 2024-09-12T22:49:54.574 INFO:tasks.workunit.client.0.smithi066.stdout:7/217: dwrite d0/d19/d26/f28 [0,4194304] 0 2024-09-12T22:49:54.575 INFO:tasks.workunit.client.0.smithi066.stdout:8/253: mkdir d17/d49/d4b 0 2024-09-12T22:49:54.575 INFO:tasks.workunit.client.0.smithi066.stdout:0/245: read - d1/d8/d1f/d30/f5c zero size 2024-09-12T22:49:54.576 INFO:tasks.workunit.client.0.smithi066.stdout:8/254: chown d17/l26 30920 1 2024-09-12T22:49:54.576 INFO:tasks.workunit.client.0.smithi066.stdout:5/322: symlink d5/de/l61 0 2024-09-12T22:49:54.576 INFO:tasks.workunit.client.0.smithi066.stdout:0/246: write d1/d8/d1f/f45 [3890563,90949] 0 2024-09-12T22:49:54.576 INFO:tasks.workunit.client.0.smithi066.stdout:7/218: rename d0/l4 to d0/d19/d26/l46 0 2024-09-12T22:49:54.576 INFO:tasks.workunit.client.0.smithi066.stdout:9/215: dread d9/dc/f28 [0,4194304] 0 2024-09-12T22:49:54.577 INFO:tasks.workunit.client.0.smithi066.stdout:5/323: mknod d5/de/d50/d42/c62 0 2024-09-12T22:49:54.577 INFO:tasks.workunit.client.0.smithi066.stdout:7/219: creat d0/d19/d26/f47 x:0 0 0 2024-09-12T22:49:54.578 INFO:tasks.workunit.client.0.smithi066.stdout:5/324: chown d5/d15/l3c 34309254 1 2024-09-12T22:49:54.578 INFO:tasks.workunit.client.0.smithi066.stdout:9/216: creat d9/dc/dd/f42 x:0 0 0 2024-09-12T22:49:54.578 INFO:tasks.workunit.client.0.smithi066.stdout:7/220: mkdir d0/d19/d26/d48 0 2024-09-12T22:49:54.578 INFO:tasks.workunit.client.0.smithi066.stdout:5/325: chown d5/c10 22 1 2024-09-12T22:49:54.578 INFO:tasks.workunit.client.0.smithi066.stdout:7/221: sync 2024-09-12T22:49:54.579 INFO:tasks.workunit.client.0.smithi066.stdout:9/217: write d9/dc/dd/f18 [4758697,129921] 0 2024-09-12T22:49:54.580 INFO:tasks.workunit.client.0.smithi066.stdout:5/326: symlink d5/d11/d5f/l63 0 2024-09-12T22:49:54.580 INFO:tasks.workunit.client.0.smithi066.stdout:9/218: creat d9/dc/d36/f43 x:0 0 0 2024-09-12T22:49:54.582 INFO:tasks.workunit.client.0.smithi066.stdout:4/228: dread d5/d8/d10/de/d39/f3b [0,4194304] 0 2024-09-12T22:49:54.582 INFO:tasks.workunit.client.0.smithi066.stdout:0/247: dwrite d1/d8/d1c/d13/f22 [0,4194304] 0 2024-09-12T22:49:54.583 INFO:tasks.workunit.client.0.smithi066.stdout:0/248: sync 2024-09-12T22:49:54.585 INFO:tasks.workunit.client.0.smithi066.stdout:9/219: rename d9/d31/d34/f3d to d9/dc/d23/f44 0 2024-09-12T22:49:54.585 INFO:tasks.workunit.client.0.smithi066.stdout:5/327: read d5/de/ff [4937679,3282] 0 2024-09-12T22:49:54.586 INFO:tasks.workunit.client.0.smithi066.stdout:6/246: read d6/d20/f12 [3847651,23191] 0 2024-09-12T22:49:54.587 INFO:tasks.workunit.client.0.smithi066.stdout:7/222: dwrite d0/d6/f2e [0,4194304] 0 2024-09-12T22:49:54.587 INFO:tasks.workunit.client.0.smithi066.stdout:5/328: chown d5/de/d50/f5a 1165883444 1 2024-09-12T22:49:54.588 INFO:tasks.workunit.client.0.smithi066.stdout:9/220: write d9/dc/d23/f41 [56289,76576] 0 2024-09-12T22:49:54.589 INFO:tasks.workunit.client.0.smithi066.stdout:6/247: write d6/d7/dc/f43 [3158323,68485] 0 2024-09-12T22:49:54.591 INFO:tasks.workunit.client.0.smithi066.stdout:7/223: write d0/d19/d24/f16 [2140091,87952] 0 2024-09-12T22:49:54.592 INFO:tasks.workunit.client.0.smithi066.stdout:4/229: dwrite d5/d8/f19 [4194304,4194304] 0 2024-09-12T22:49:54.592 INFO:tasks.workunit.client.0.smithi066.stdout:6/248: dread - d6/d23/d25/d2c/f40 zero size 2024-09-12T22:49:54.592 INFO:tasks.workunit.client.0.smithi066.stdout:9/221: truncate d9/dc/dd/f11 5029035 0 2024-09-12T22:49:54.594 INFO:tasks.workunit.client.0.smithi066.stdout:9/222: read d9/dc/f28 [423072,16593] 0 2024-09-12T22:49:54.594 INFO:tasks.workunit.client.0.smithi066.stdout:0/249: dwrite d1/d8/d1f/d30/f3d [0,4194304] 0 2024-09-12T22:49:54.594 INFO:tasks.workunit.client.0.smithi066.stdout:6/249: readlink d6/d20/d32/l48 0 2024-09-12T22:49:54.594 INFO:tasks.workunit.client.0.smithi066.stdout:4/230: fdatasync d5/d8/d16/d1b/d1e/d38/f3f 0 2024-09-12T22:49:54.594 INFO:tasks.workunit.client.0.smithi066.stdout:5/329: dread d5/de/d50/d42/f48 [0,4194304] 0 2024-09-12T22:49:54.594 INFO:tasks.workunit.client.0.smithi066.stdout:0/250: dread - d1/f2a zero size 2024-09-12T22:49:54.596 INFO:tasks.workunit.client.0.smithi066.stdout:4/231: symlink d5/d8/d10/de/d2d/l52 0 2024-09-12T22:49:54.596 INFO:tasks.workunit.client.0.smithi066.stdout:9/223: creat d9/dc/d23/f45 x:0 0 0 2024-09-12T22:49:54.596 INFO:tasks.workunit.client.0.smithi066.stdout:0/251: readlink d1/d8/d1f/d47/l4b 0 2024-09-12T22:49:54.596 INFO:tasks.workunit.client.0.smithi066.stdout:6/250: creat d6/d49/f4d x:0 0 0 2024-09-12T22:49:54.596 INFO:tasks.workunit.client.0.smithi066.stdout:0/252: dread - d1/f2a zero size 2024-09-12T22:49:54.597 INFO:tasks.workunit.client.0.smithi066.stdout:6/251: mkdir d6/d23/d25/d4e 0 2024-09-12T22:49:54.597 INFO:tasks.workunit.client.0.smithi066.stdout:0/253: chown d1/d8/d1f/d47 1399 1 2024-09-12T22:49:54.597 INFO:tasks.workunit.client.0.smithi066.stdout:4/232: truncate d5/d8/d10/f36 984186 0 2024-09-12T22:49:54.597 INFO:tasks.workunit.client.0.smithi066.stdout:5/330: getdents d5/de/d50/d42 0 2024-09-12T22:49:54.597 INFO:tasks.workunit.client.0.smithi066.stdout:9/224: write d9/dc/f28 [333426,42801] 0 2024-09-12T22:49:54.599 INFO:tasks.workunit.client.0.smithi066.stdout:4/233: creat d5/d48/f53 x:0 0 0 2024-09-12T22:49:54.599 INFO:tasks.workunit.client.0.smithi066.stdout:6/252: rename d6/d23/d25/c26 to d6/d23/d25/c4f 0 2024-09-12T22:49:54.599 INFO:tasks.workunit.client.0.smithi066.stdout:9/225: dread - d9/dc/d23/f45 zero size 2024-09-12T22:49:54.600 INFO:tasks.workunit.client.0.smithi066.stdout:0/254: truncate d1/d8/d1f/d25/f34 6564332 0 2024-09-12T22:49:54.600 INFO:tasks.workunit.client.0.smithi066.stdout:9/226: mkdir d9/dc/d46 0 2024-09-12T22:49:54.601 INFO:tasks.workunit.client.0.smithi066.stdout:9/227: unlink d9/dc/d23/f44 0 2024-09-12T22:49:54.602 INFO:tasks.workunit.client.0.smithi066.stdout:9/228: rmdir d9/dc/d23 39 2024-09-12T22:49:54.602 INFO:tasks.workunit.client.0.smithi066.stdout:7/224: truncate d0/d19/d24/d33/d27/f2a 2849052 0 2024-09-12T22:49:54.603 INFO:tasks.workunit.client.0.smithi066.stdout:7/225: chown d0/d6/f21 32020491 1 2024-09-12T22:49:54.603 INFO:tasks.workunit.client.0.smithi066.stdout:9/229: creat d9/dc/dd/f47 x:0 0 0 2024-09-12T22:49:54.604 INFO:tasks.workunit.client.0.smithi066.stdout:6/253: dwrite d6/d7/dc/f21 [0,4194304] 0 2024-09-12T22:49:54.605 INFO:tasks.workunit.client.0.smithi066.stdout:6/254: chown d6/d20 1594 1 2024-09-12T22:49:54.605 INFO:tasks.workunit.client.0.smithi066.stdout:4/234: dwrite d5/d8/d10/f20 [0,4194304] 0 2024-09-12T22:49:54.606 INFO:tasks.workunit.client.0.smithi066.stdout:4/235: readlink d5/d8/d10/de/l15 0 2024-09-12T22:49:54.606 INFO:tasks.workunit.client.0.smithi066.stdout:4/236: fdatasync d5/d8/d16/f41 0 2024-09-12T22:49:54.607 INFO:tasks.workunit.client.0.smithi066.stdout:7/226: creat d0/d19/d26/d48/f49 x:0 0 0 2024-09-12T22:49:54.608 INFO:tasks.workunit.client.0.smithi066.stdout:4/237: fdatasync d5/d8/d16/d1b/d1e/d38/f3f 0 2024-09-12T22:49:54.611 INFO:tasks.workunit.client.0.smithi066.stdout:1/208: dread d0/f7 [0,4194304] 0 2024-09-12T22:49:54.611 INFO:tasks.workunit.client.0.smithi066.stdout:4/238: dread d5/d8/d10/f20 [0,4194304] 0 2024-09-12T22:49:54.612 INFO:tasks.workunit.client.0.smithi066.stdout:1/209: chown d0/d28/c2a 3721497 1 2024-09-12T22:49:54.613 INFO:tasks.workunit.client.0.smithi066.stdout:7/227: dwrite d0/d19/d24/f16 [0,4194304] 0 2024-09-12T22:49:54.614 INFO:tasks.workunit.client.0.smithi066.stdout:7/228: chown d0/d19/d26/d48 149810 1 2024-09-12T22:49:54.614 INFO:tasks.workunit.client.0.smithi066.stdout:1/210: chown d0/f7 890956 1 2024-09-12T22:49:54.615 INFO:tasks.workunit.client.0.smithi066.stdout:9/230: truncate d9/dc/dd/f13 1766574 0 2024-09-12T22:49:54.616 INFO:tasks.workunit.client.0.smithi066.stdout:7/229: symlink d0/d6/l4a 0 2024-09-12T22:49:54.618 INFO:tasks.workunit.client.0.smithi066.stdout:4/239: dwrite d5/d8/f19 [4194304,4194304] 0 2024-09-12T22:49:54.618 INFO:tasks.workunit.client.0.smithi066.stdout:1/211: link d0/d9/c20 d0/dc/d1e/c3c 0 2024-09-12T22:49:54.619 INFO:tasks.workunit.client.0.smithi066.stdout:6/255: read d6/f17 [4055800,76504] 0 2024-09-12T22:49:54.619 INFO:tasks.workunit.client.0.smithi066.stdout:9/231: rename d9/dc/c29 to d9/d31/c48 0 2024-09-12T22:49:54.619 INFO:tasks.workunit.client.0.smithi066.stdout:3/215: dread d0/d2/d7/d29/f3d [0,4194304] 0 2024-09-12T22:49:54.619 INFO:tasks.workunit.client.0.smithi066.stdout:7/230: creat d0/f4b x:0 0 0 2024-09-12T22:49:54.620 INFO:tasks.workunit.client.0.smithi066.stdout:0/255: dwrite d1/d8/d1b/f43 [0,4194304] 0 2024-09-12T22:49:54.621 INFO:tasks.workunit.client.0.smithi066.stdout:2/230: dread d1/dd/d12/d1e/f39 [0,4194304] 0 2024-09-12T22:49:54.623 INFO:tasks.workunit.client.0.smithi066.stdout:1/212: creat d0/d9/d21/f3d x:0 0 0 2024-09-12T22:49:54.623 INFO:tasks.workunit.client.0.smithi066.stdout:0/256: readlink d1/d8/d1c/d13/d2f/l49 0 2024-09-12T22:49:54.623 INFO:tasks.workunit.client.0.smithi066.stdout:2/231: mknod d1/db/d42/d43/c4c 0 2024-09-12T22:49:54.624 INFO:tasks.workunit.client.0.smithi066.stdout:3/216: link d0/d2/c4 d0/d2/d6/d33/d40/d44/d55/c57 0 2024-09-12T22:49:54.624 INFO:tasks.workunit.client.0.smithi066.stdout:1/213: chown d0/c32 49 1 2024-09-12T22:49:54.626 INFO:tasks.workunit.client.0.smithi066.stdout:2/232: unlink d1/dd/d3d/c40 0 2024-09-12T22:49:54.626 INFO:tasks.workunit.client.0.smithi066.stdout:4/240: dwrite d5/d8/d10/de/f27 [0,4194304] 0 2024-09-12T22:49:54.626 INFO:tasks.workunit.client.0.smithi066.stdout:7/231: dwrite d0/d6/f8 [0,4194304] 0 2024-09-12T22:49:54.627 INFO:tasks.workunit.client.0.smithi066.stdout:7/232: dread - d0/f4b zero size 2024-09-12T22:49:54.628 INFO:tasks.workunit.client.0.smithi066.stdout:2/233: mknod d1/db/d42/d43/c4d 0 2024-09-12T22:49:54.629 INFO:tasks.workunit.client.0.smithi066.stdout:4/241: chown d5/d8/d16/d1b/d1e/d38/f3f 315 1 2024-09-12T22:49:54.630 INFO:tasks.workunit.client.0.smithi066.stdout:2/234: chown d1/d11/f19 9467451 1 2024-09-12T22:49:54.631 INFO:tasks.workunit.client.0.smithi066.stdout:3/217: dwrite d0/d2/d6/fd [4194304,4194304] 0 2024-09-12T22:49:54.631 INFO:tasks.workunit.client.0.smithi066.stdout:4/242: write d5/d8/d10/de/f18 [5215478,129217] 0 2024-09-12T22:49:54.632 INFO:tasks.workunit.client.0.smithi066.stdout:3/218: write d0/d2/d7/f1a [2127542,112190] 0 2024-09-12T22:49:54.633 INFO:tasks.workunit.client.0.smithi066.stdout:4/243: mknod d5/d8/c54 0 2024-09-12T22:49:54.633 INFO:tasks.workunit.client.0.smithi066.stdout:3/219: readlink d0/d2/l22 0 2024-09-12T22:49:54.634 INFO:tasks.workunit.client.0.smithi066.stdout:1/214: dwrite d0/d9/d21/f27 [0,4194304] 0 2024-09-12T22:49:54.635 INFO:tasks.workunit.client.0.smithi066.stdout:3/220: unlink d0/l5 0 2024-09-12T22:49:54.636 INFO:tasks.workunit.client.0.smithi066.stdout:4/244: write d5/d8/d10/f30 [925777,68420] 0 2024-09-12T22:49:54.637 INFO:tasks.workunit.client.0.smithi066.stdout:0/257: write d1/d8/d1f/d30/f5c [361002,107122] 0 2024-09-12T22:49:54.637 INFO:tasks.workunit.client.0.smithi066.stdout:1/215: chown d0/dc/d1d/c1b 3707 1 2024-09-12T22:49:54.637 INFO:tasks.workunit.client.0.smithi066.stdout:7/233: truncate d0/d19/d24/f1d 2643258 0 2024-09-12T22:49:54.638 INFO:tasks.workunit.client.0.smithi066.stdout:7/234: chown d0/d6 13692229 1 2024-09-12T22:49:54.639 INFO:tasks.workunit.client.0.smithi066.stdout:9/232: dwrite d9/dc/f2d [0,4194304] 0 2024-09-12T22:49:54.639 INFO:tasks.workunit.client.0.smithi066.stdout:2/235: dwrite d1/dd/d12/f24 [0,4194304] 0 2024-09-12T22:49:54.639 INFO:tasks.workunit.client.0.smithi066.stdout:7/235: fsync d0/d6/f2e 0 2024-09-12T22:49:54.640 INFO:tasks.workunit.client.0.smithi066.stdout:3/221: truncate d0/d2/d7/d13/d31/f37 302663 0 2024-09-12T22:49:54.640 INFO:tasks.workunit.client.0.smithi066.stdout:1/216: readlink d0/d9/d21/l25 0 2024-09-12T22:49:54.640 INFO:tasks.workunit.client.0.smithi066.stdout:1/217: stat d0/d9/d21 0 2024-09-12T22:49:54.641 INFO:tasks.workunit.client.0.smithi066.stdout:2/236: mknod d1/d11/c4e 0 2024-09-12T22:49:54.641 INFO:tasks.workunit.client.0.smithi066.stdout:4/245: creat d5/d8/d16/d1b/d1e/f55 x:0 0 0 2024-09-12T22:49:54.641 INFO:tasks.workunit.client.0.smithi066.stdout:3/222: rmdir d0/d2/d6/d33/d40/d44/d55 39 2024-09-12T22:49:54.642 INFO:tasks.workunit.client.0.smithi066.stdout:1/218: chown d0/d9/c20 39485866 1 2024-09-12T22:49:54.642 INFO:tasks.workunit.client.0.smithi066.stdout:0/258: link d1/f10 d1/d8/d1c/d56/f5e 0 2024-09-12T22:49:54.642 INFO:tasks.workunit.client.0.smithi066.stdout:2/237: stat d1/f3 0 2024-09-12T22:49:54.643 INFO:tasks.workunit.client.0.smithi066.stdout:4/246: dread - d5/d48/f53 zero size 2024-09-12T22:49:54.643 INFO:tasks.workunit.client.0.smithi066.stdout:7/236: link d0/d19/d26/c39 d0/d19/d24/d33/d27/c4c 0 2024-09-12T22:49:54.644 INFO:tasks.workunit.client.0.smithi066.stdout:3/223: mknod d0/d2/d6/d33/d40/c58 0 2024-09-12T22:49:54.645 INFO:tasks.workunit.client.0.smithi066.stdout:1/219: write d0/f16 [1307290,118236] 0 2024-09-12T22:49:54.645 INFO:tasks.workunit.client.0.smithi066.stdout:7/237: dread - d0/d19/d24/f3e zero size 2024-09-12T22:49:54.647 INFO:tasks.workunit.client.0.smithi066.stdout:1/220: stat d0/c3 0 2024-09-12T22:49:54.647 INFO:tasks.workunit.client.0.smithi066.stdout:0/259: getdents d1/d8/d1c/d13 0 2024-09-12T22:49:54.647 INFO:tasks.workunit.client.0.smithi066.stdout:3/224: symlink d0/d2/d6/d33/l59 0 2024-09-12T22:49:54.649 INFO:tasks.workunit.client.0.smithi066.stdout:1/221: creat d0/d9/d21/f3e x:0 0 0 2024-09-12T22:49:54.649 INFO:tasks.workunit.client.0.smithi066.stdout:3/225: read - d0/d2/f2c zero size 2024-09-12T22:49:54.651 INFO:tasks.workunit.client.0.smithi066.stdout:4/247: dwrite d5/d3e/f44 [0,4194304] 0 2024-09-12T22:49:54.651 INFO:tasks.workunit.client.0.smithi066.stdout:9/233: dread d9/d31/d34/f3b [0,4194304] 0 2024-09-12T22:49:54.651 INFO:tasks.workunit.client.0.smithi066.stdout:3/226: fdatasync d0/d2/d7/d29/f3d 0 2024-09-12T22:49:54.653 INFO:tasks.workunit.client.0.smithi066.stdout:7/238: dwrite d0/d19/f45 [0,4194304] 0 2024-09-12T22:49:54.655 INFO:tasks.workunit.client.0.smithi066.stdout:3/227: write d0/d2/d7/d13/f14 [521240,55649] 0 2024-09-12T22:49:54.655 INFO:tasks.workunit.client.0.smithi066.stdout:2/238: dwrite d1/dd/f14 [0,4194304] 0 2024-09-12T22:49:54.656 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:54.655+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:54.657 INFO:tasks.workunit.client.0.smithi066.stdout:4/248: getdents d5/d8/d16/d1b/d1e 0 2024-09-12T22:49:54.657 INFO:tasks.workunit.client.0.smithi066.stdout:8/255: dread f11 [0,4194304] 0 2024-09-12T22:49:54.659 INFO:tasks.workunit.client.0.smithi066.stdout:4/249: chown d5/d8/d10/de/d2d/f50 1 1 2024-09-12T22:49:54.660 INFO:tasks.workunit.client.0.smithi066.stdout:9/234: dwrite d9/dc/f2d [0,4194304] 0 2024-09-12T22:49:54.660 INFO:tasks.workunit.client.0.smithi066.stdout:7/239: dread d0/d6/f2e [0,4194304] 0 2024-09-12T22:49:54.661 INFO:tasks.workunit.client.0.smithi066.stdout:3/228: rename d0/d2/d6/f46 to d0/d2/d6/d33/d49/f5a 0 2024-09-12T22:49:54.661 INFO:tasks.workunit.client.0.smithi066.stdout:7/240: mknod d0/d19/c4d 0 2024-09-12T22:49:54.661 INFO:tasks.workunit.client.0.smithi066.stdout:9/235: write d9/dc/f1f [4141607,59499] 0 2024-09-12T22:49:54.662 INFO:tasks.workunit.client.0.smithi066.stdout:3/229: unlink d0/d2/d7/d13/f14 0 2024-09-12T22:49:54.662 INFO:tasks.workunit.client.0.smithi066.stdout:4/250: link d5/d8/d16/d1b/l2f d5/d8/d16/l56 0 2024-09-12T22:49:54.662 INFO:tasks.workunit.client.0.smithi066.stdout:9/236: rmdir d9/dc/dd 39 2024-09-12T22:49:54.663 INFO:tasks.workunit.client.0.smithi066.stdout:2/239: dwrite d1/dd/d12/d18/f3e [0,4194304] 0 2024-09-12T22:49:54.664 INFO:tasks.workunit.client.0.smithi066.stdout:9/237: rmdir d9/d31 39 2024-09-12T22:49:54.665 INFO:tasks.workunit.client.0.smithi066.stdout:7/241: link d0/d6/l4a d0/d19/d24/d33/d27/l4e 0 2024-09-12T22:49:54.666 INFO:tasks.workunit.client.0.smithi066.stdout:4/251: rename d5/d8/d10/de/c13 to d5/d8/d16/d1b/c57 0 2024-09-12T22:49:54.667 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:49:54.668 INFO:tasks.workunit.client.0.smithi066.stdout:7/242: write d0/d19/d26/f30 [853742,122846] 0 2024-09-12T22:49:54.668 INFO:tasks.workunit.client.0.smithi066.stdout:4/252: write d5/d8/d10/de/f27 [2729800,20851] 0 2024-09-12T22:49:54.671 INFO:tasks.workunit.client.0.smithi066.stdout:5/331: dread f3 [0,4194304] 0 2024-09-12T22:49:54.671 INFO:tasks.workunit.client.0.smithi066.stdout:3/230: dwrite d0/d2/d7/f4b [0,4194304] 0 2024-09-12T22:49:54.672 INFO:tasks.workunit.client.0.smithi066.stdout:9/238: dwrite d9/dc/dd/f1b [0,4194304] 0 2024-09-12T22:49:54.674 INFO:tasks.workunit.client.0.smithi066.stdout:5/332: mkdir d5/d11/d5d/d64 0 2024-09-12T22:49:54.674 INFO:tasks.workunit.client.0.smithi066.stdout:9/239: write d9/dc/d23/f30 [1033459,7797] 0 2024-09-12T22:49:54.674 INFO:tasks.workunit.client.0.smithi066.stdout:5/333: chown d5/de/d50/f35 1 1 2024-09-12T22:49:54.675 INFO:tasks.workunit.client.0.smithi066.stdout:5/334: readlink d5/d15/l5e 0 2024-09-12T22:49:54.675 INFO:tasks.workunit.client.0.smithi066.stdout:7/243: truncate d0/d6/f8 3778691 0 2024-09-12T22:49:54.676 INFO:tasks.workunit.client.0.smithi066.stdout:0/260: dread d1/d8/d1f/d30/f5c [0,4194304] 0 2024-09-12T22:49:54.676 INFO:tasks.workunit.client.0.smithi066.stdout:9/240: symlink d9/dc/dd/l49 0 2024-09-12T22:49:54.676 INFO:tasks.workunit.client.0.smithi066.stdout:2/240: read d1/f2b [1036040,70278] 0 2024-09-12T22:49:54.676 INFO:tasks.workunit.client.0.smithi066.stdout:3/231: link d0/d2/d6/d33/c36 d0/d2/d7/d13/d43/c5b 0 2024-09-12T22:49:54.677 INFO:tasks.workunit.client.0.smithi066.stdout:2/241: stat d1/dd/l10 0 2024-09-12T22:49:54.677 INFO:tasks.workunit.client.0.smithi066.stdout:4/253: dwrite d5/d8/d10/de/f2b [4194304,4194304] 0 2024-09-12T22:49:54.678 INFO:tasks.workunit.client.0.smithi066.stdout:0/261: write d1/d8/d1c/dd/f29 [11900,119349] 0 2024-09-12T22:49:54.679 INFO:tasks.workunit.client.0.smithi066.stdout:9/241: rename l1 to d9/dc/d46/l4a 0 2024-09-12T22:49:54.681 INFO:tasks.workunit.client.0.smithi066.stdout:0/262: readlink d1/d8/d1c/d13/d2f/l49 0 2024-09-12T22:49:54.681 INFO:tasks.workunit.client.0.smithi066.stdout:2/242: fdatasync d1/dd/f2c 0 2024-09-12T22:49:54.681 INFO:tasks.workunit.client.0.smithi066.stdout:4/254: mkdir d5/d8/d10/de/d2d/d58 0 2024-09-12T22:49:54.681 INFO:tasks.workunit.client.0.smithi066.stdout:7/244: getdents d0/d19/d24/d33 0 2024-09-12T22:49:54.681 INFO:tasks.workunit.client.0.smithi066.stdout:0/263: symlink d1/d5b/l5f 0 2024-09-12T22:49:54.681 INFO:tasks.workunit.client.0.smithi066.stdout:2/243: mkdir d1/d11/d26/d4f 0 2024-09-12T22:49:54.681 INFO:tasks.workunit.client.0.smithi066.stdout:4/255: dread - d5/d8/d16/d1b/f4b zero size 2024-09-12T22:49:54.682 INFO:tasks.workunit.client.0.smithi066.stdout:9/242: link d9/dc/d23/f30 d9/dc/d46/f4b 0 2024-09-12T22:49:54.682 INFO:tasks.workunit.client.0.smithi066.stdout:7/245: creat d0/d6/f4f x:0 0 0 2024-09-12T22:49:54.682 INFO:tasks.workunit.client.0.smithi066.stdout:2/244: creat d1/d11/f50 x:0 0 0 2024-09-12T22:49:54.682 INFO:tasks.workunit.client.0.smithi066.stdout:9/243: chown d9/dc/f38 11 1 2024-09-12T22:49:54.683 INFO:tasks.workunit.client.0.smithi066.stdout:2/245: mkdir d1/d44/d51 0 2024-09-12T22:49:54.683 INFO:tasks.workunit.client.0.smithi066.stdout:7/246: symlink d0/d19/d24/d33/d27/l50 0 2024-09-12T22:49:54.684 INFO:tasks.workunit.client.0.smithi066.stdout:9/244: creat d9/d31/f4c x:0 0 0 2024-09-12T22:49:54.684 INFO:tasks.workunit.client.0.smithi066.stdout:7/247: chown d0/d19/d24/f3b 999333718 1 2024-09-12T22:49:54.685 INFO:tasks.workunit.client.0.smithi066.stdout:6/256: dread d6/f17 [0,4194304] 0 2024-09-12T22:49:54.685 INFO:tasks.workunit.client.0.smithi066.stdout:9/245: unlink d9/d31/c48 0 2024-09-12T22:49:54.686 INFO:tasks.workunit.client.0.smithi066.stdout:6/257: mkdir d6/d20/d50 0 2024-09-12T22:49:54.686 INFO:tasks.workunit.client.0.smithi066.stdout:9/246: mkdir d9/d31/d34/d4d 0 2024-09-12T22:49:54.687 INFO:tasks.workunit.client.0.smithi066.stdout:5/335: truncate d5/f3b 20301 0 2024-09-12T22:49:54.687 INFO:tasks.workunit.client.0.smithi066.stdout:6/258: getdents d6/d7 0 2024-09-12T22:49:54.688 INFO:tasks.workunit.client.0.smithi066.stdout:6/259: mkdir d6/d51 0 2024-09-12T22:49:54.689 INFO:tasks.workunit.client.0.smithi066.stdout:5/336: fsync d5/d11/d23/f4e 0 2024-09-12T22:49:54.689 INFO:tasks.workunit.client.0.smithi066.stdout:2/246: read d1/d11/f19 [3806665,14818] 0 2024-09-12T22:49:54.690 INFO:tasks.workunit.client.0.smithi066.stdout:2/247: read - d1/d44/f45 zero size 2024-09-12T22:49:54.690 INFO:tasks.workunit.client.0.smithi066.stdout:5/337: mknod d5/d11/d5d/d64/c65 0 2024-09-12T22:49:54.691 INFO:tasks.workunit.client.0.smithi066.stdout:5/338: chown d5/d11/d5d/d64 16929 1 2024-09-12T22:49:54.691 INFO:tasks.workunit.client.0.smithi066.stdout:2/248: mkdir d1/d11/d26/d4f/d52 0 2024-09-12T22:49:54.692 INFO:tasks.workunit.client.0.smithi066.stdout:7/248: dread d0/d19/d26/f30 [0,4194304] 0 2024-09-12T22:49:54.693 INFO:tasks.workunit.client.0.smithi066.stdout:7/249: creat d0/d19/d24/d33/d27/d29/f51 x:0 0 0 2024-09-12T22:49:54.695 INFO:tasks.workunit.client.0.smithi066.stdout:5/339: dwrite d5/de/d50/f60 [0,4194304] 0 2024-09-12T22:49:54.695 INFO:tasks.workunit.client.0.smithi066.stdout:5/340: dread - d5/d11/f58 zero size 2024-09-12T22:49:54.697 INFO:tasks.workunit.client.0.smithi066.stdout:5/341: creat d5/d11/f66 x:0 0 0 2024-09-12T22:49:54.698 INFO:tasks.workunit.client.0.smithi066.stdout:5/342: fsync f3 0 2024-09-12T22:49:54.699 INFO:tasks.workunit.client.0.smithi066.stdout:9/247: getdents d9/d31/d34 0 2024-09-12T22:49:54.700 INFO:tasks.workunit.client.0.smithi066.stdout:5/343: link d5/de/d50/d42/c62 d5/de/d50/d42/c67 0 2024-09-12T22:49:54.701 INFO:tasks.workunit.client.0.smithi066.stdout:5/344: symlink d5/d11/d21/d4d/l68 0 2024-09-12T22:49:54.702 INFO:tasks.workunit.client.0.smithi066.stdout:5/345: fdatasync d5/d11/d23/f2f 0 2024-09-12T22:49:54.703 INFO:tasks.workunit.client.0.smithi066.stdout:0/264: dwrite d1/d8/d1b/f24 [0,4194304] 0 2024-09-12T22:49:54.703 INFO:tasks.workunit.client.0.smithi066.stdout:5/346: chown d5/ld 14808326 1 2024-09-12T22:49:54.706 INFO:tasks.workunit.client.0.smithi066.stdout:6/260: dwrite d6/d20/f12 [0,4194304] 0 2024-09-12T22:49:54.706 INFO:tasks.workunit.client.0.smithi066.stdout:0/265: symlink d1/d8/d1f/l60 0 2024-09-12T22:49:54.707 INFO:tasks.workunit.client.0.smithi066.stdout:1/222: sync 2024-09-12T22:49:54.707 INFO:tasks.workunit.client.0.smithi066.stdout:9/248: dwrite d9/dc/dd/f11 [0,4194304] 0 2024-09-12T22:49:54.707 INFO:tasks.workunit.client.0.smithi066.stdout:5/347: write d5/de/d50/d42/f48 [1803445,109172] 0 2024-09-12T22:49:54.707 INFO:tasks.workunit.client.0.smithi066.stdout:6/261: chown d6/d20/f12 6612 1 2024-09-12T22:49:54.708 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:54.708 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:54.709 INFO:tasks.workunit.client.0.smithi066.stdout:9/249: mkdir d9/dc/d4e 0 2024-09-12T22:49:54.709 INFO:tasks.workunit.client.0.smithi066.stdout:0/266: write d1/d8/d1c/dd/f29 [604866,89272] 0 2024-09-12T22:49:54.709 INFO:tasks.workunit.client.0.smithi066.stdout:5/348: creat d5/d14/f69 x:0 0 0 2024-09-12T22:49:54.711 INFO:tasks.workunit.client.0.smithi066.stdout:0/267: symlink d1/d8/d1c/dd/l61 0 2024-09-12T22:49:54.711 INFO:tasks.workunit.client.0.smithi066.stdout:5/349: truncate d5/de/d50/f5a 1908231 0 2024-09-12T22:49:54.712 INFO:tasks.workunit.client.0.smithi066.stdout:1/223: dread d0/f7 [0,4194304] 0 2024-09-12T22:49:54.713 INFO:tasks.workunit.client.0.smithi066.stdout:6/262: getdents d6/d23/d25/d2c 0 2024-09-12T22:49:54.714 INFO:tasks.workunit.client.0.smithi066.stdout:6/263: fdatasync d6/d7/f11 0 2024-09-12T22:49:54.714 INFO:tasks.workunit.client.0.smithi066.stdout:1/224: fdatasync d0/f7 0 2024-09-12T22:49:54.714 INFO:tasks.workunit.client.0.smithi066.stdout:0/268: write d1/d8/d1f/f2c [5155211,32576] 0 2024-09-12T22:49:54.715 INFO:tasks.workunit.client.0.smithi066.stdout:6/264: dread - d6/d23/f3e zero size 2024-09-12T22:49:54.716 INFO:tasks.workunit.client.0.smithi066.stdout:1/225: creat d0/d9/d21/f3f x:0 0 0 2024-09-12T22:49:54.716 INFO:tasks.workunit.client.0.smithi066.stdout:9/250: dwrite d9/dc/dd/f42 [0,4194304] 0 2024-09-12T22:49:54.716 INFO:tasks.workunit.client.0.smithi066.stdout:0/269: creat d1/d8/f62 x:0 0 0 2024-09-12T22:49:54.716 INFO:tasks.workunit.client.0.smithi066.stdout:9/251: fdatasync d9/dc/fe 0 2024-09-12T22:49:54.717 INFO:tasks.workunit.client.0.smithi066.stdout:0/270: readlink d1/d8/d1f/l3c 0 2024-09-12T22:49:54.718 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:54.718 INFO:tasks.workunit.client.0.smithi066.stdout:1/226: creat d0/dc/d1e/f40 x:0 0 0 2024-09-12T22:49:54.718 INFO:tasks.workunit.client.0.smithi066.stdout:0/271: unlink d1/f2 0 2024-09-12T22:49:54.719 INFO:tasks.workunit.client.0.smithi066.stdout:1/227: dread - d0/d9/d21/f3f zero size 2024-09-12T22:49:54.719 INFO:tasks.workunit.client.0.smithi066.stdout:0/272: unlink d1/d8/d1f/l42 0 2024-09-12T22:49:54.720 INFO:tasks.workunit.client.0.smithi066.stdout:3/232: dread d0/d2/f24 [0,4194304] 0 2024-09-12T22:49:54.721 INFO:tasks.workunit.client.0.smithi066.stdout:6/265: dwrite d6/d20/f18 [0,4194304] 0 2024-09-12T22:49:54.721 INFO:tasks.workunit.client.0.smithi066.stdout:6/266: fdatasync d6/d7/f11 0 2024-09-12T22:49:54.722 INFO:tasks.workunit.client.0.smithi066.stdout:9/252: read d9/dc/dd/f18 [3023378,18329] 0 2024-09-12T22:49:54.722 INFO:tasks.workunit.client.0.smithi066.stdout:6/267: mknod d6/d23/d41/c52 0 2024-09-12T22:49:54.723 INFO:tasks.workunit.client.0.smithi066.stdout:3/233: rename d0/d2/d7/d13/d31/f37 to d0/d2/d6/d33/d40/d44/d55/f5c 0 2024-09-12T22:49:54.726 INFO:tasks.workunit.client.0.smithi066.stdout:9/253: stat d9/dc/d46 0 2024-09-12T22:49:54.730 INFO:tasks.workunit.client.0.smithi066.stdout:6/268: dwrite d6/d49/f2f [0,4194304] 0 2024-09-12T22:49:54.731 INFO:tasks.workunit.client.0.smithi066.stdout:3/234: dwrite d0/f38 [0,4194304] 0 2024-09-12T22:49:54.731 INFO:tasks.workunit.client.0.smithi066.stdout:6/269: read d6/fb [1501660,60382] 0 2024-09-12T22:49:54.735 INFO:tasks.workunit.client.0.smithi066.stdout:6/270: dread d6/d7/dc/f21 [0,4194304] 0 2024-09-12T22:49:54.736 INFO:tasks.workunit.client.0.smithi066.stdout:4/256: dread d5/d8/d10/de/f14 [0,4194304] 0 2024-09-12T22:49:54.737 INFO:tasks.workunit.client.0.smithi066.stdout:4/257: read d5/d8/d10/de/f27 [3462311,114214] 0 2024-09-12T22:49:54.739 INFO:tasks.workunit.client.0.smithi066.stdout:2/249: sync 2024-09-12T22:49:54.739 INFO:tasks.workunit.client.0.smithi066.stdout:7/250: sync 2024-09-12T22:49:54.739 INFO:tasks.workunit.client.0.smithi066.stdout:8/256: sync 2024-09-12T22:49:54.739 INFO:tasks.workunit.client.0.smithi066.stdout:1/228: sync 2024-09-12T22:49:54.740 INFO:tasks.workunit.client.0.smithi066.stdout:7/251: stat d0/d19/d24/f12 0 2024-09-12T22:49:54.740 INFO:tasks.workunit.client.0.smithi066.stdout:2/250: dread - d1/dd/d3d/f4a zero size 2024-09-12T22:49:54.740 INFO:tasks.workunit.client.0.smithi066.stdout:7/252: dread - d0/d19/d24/d33/d27/f35 zero size 2024-09-12T22:49:54.741 INFO:tasks.workunit.client.0.smithi066.stdout:7/253: write d0/d6/f41 [905017,59167] 0 2024-09-12T22:49:54.743 INFO:tasks.workunit.client.0.smithi066.stdout:1/229: dwrite d0/f2e [0,4194304] 0 2024-09-12T22:49:54.744 INFO:tasks.workunit.client.0.smithi066.stdout:1/230: fdatasync d0/dc/f17 0 2024-09-12T22:49:54.746 INFO:tasks.workunit.client.0.smithi066.stdout:9/254: rmdir d9/d31/d34 39 2024-09-12T22:49:54.746 INFO:tasks.workunit.client.0.smithi066.stdout:3/235: symlink d0/d2/d6/l5d 0 2024-09-12T22:49:54.746 INFO:tasks.workunit.client.0.smithi066.stdout:6/271: symlink d6/d23/d25/d2c/l53 0 2024-09-12T22:49:54.746 INFO:tasks.workunit.client.0.smithi066.stdout:2/251: mkdir d1/d11/d53 0 2024-09-12T22:49:54.746 INFO:tasks.workunit.client.0.smithi066.stdout:9/255: chown d9/dc/dd/f47 293590 1 2024-09-12T22:49:54.747 INFO:tasks.workunit.client.0.smithi066.stdout:6/272: truncate d6/f4c 143956 0 2024-09-12T22:49:54.747 INFO:tasks.workunit.client.0.smithi066.stdout:7/254: rmdir d0/d6 39 2024-09-12T22:49:54.747 INFO:tasks.workunit.client.0.smithi066.stdout:1/231: unlink d0/d9/d21/f31 0 2024-09-12T22:49:54.747 INFO:tasks.workunit.client.0.smithi066.stdout:8/257: write d17/f29 [2760657,59841] 0 2024-09-12T22:49:54.747 INFO:tasks.workunit.client.0.smithi066.stdout:9/256: rmdir d9/dc 39 2024-09-12T22:49:54.747 INFO:tasks.workunit.client.0.smithi066.stdout:4/258: getdents d5/d8/d10/de/d2d 0 2024-09-12T22:49:54.748 INFO:tasks.workunit.client.0.smithi066.stdout:6/273: creat d6/d35/f54 x:0 0 0 2024-09-12T22:49:54.749 INFO:tasks.workunit.client.0.smithi066.stdout:1/232: symlink d0/dc/d1e/l41 0 2024-09-12T22:49:54.750 INFO:tasks.workunit.client.0.smithi066.stdout:8/258: creat d17/d40/f4c x:0 0 0 2024-09-12T22:49:54.751 INFO:tasks.workunit.client.0.smithi066.stdout:4/259: unlink d5/d8/d10/f30 0 2024-09-12T22:49:54.752 INFO:tasks.workunit.client.0.smithi066.stdout:8/259: stat d17/d2c/f38 0 2024-09-12T22:49:54.752 INFO:tasks.workunit.client.0.smithi066.stdout:9/257: write d9/dc/f2d [4932039,11328] 0 2024-09-12T22:49:54.752 INFO:tasks.workunit.client.0.smithi066.stdout:1/233: mknod d0/c42 0 2024-09-12T22:49:54.753 INFO:tasks.workunit.client.0.smithi066.stdout:6/274: creat d6/d20/d32/d3c/f55 x:0 0 0 2024-09-12T22:49:54.753 INFO:tasks.workunit.client.0.smithi066.stdout:7/255: getdents d0/d19/d26 0 2024-09-12T22:49:54.753 INFO:tasks.workunit.client.0.smithi066.stdout:4/260: unlink d5/d8/c2c 0 2024-09-12T22:49:54.754 INFO:tasks.workunit.client.0.smithi066.stdout:9/258: truncate f8 1066719 0 2024-09-12T22:49:54.754 INFO:tasks.workunit.client.0.smithi066.stdout:7/256: read d0/d19/d24/f16 [2164472,3257] 0 2024-09-12T22:49:54.755 INFO:tasks.workunit.client.0.smithi066.stdout:1/234: write d0/d9/d21/f3f [156059,71331] 0 2024-09-12T22:49:54.756 INFO:tasks.workunit.client.0.smithi066.stdout:2/252: dwrite d1/dd/d3d/f4a [0,4194304] 0 2024-09-12T22:49:54.757 INFO:tasks.workunit.client.0.smithi066.stdout:6/275: rename d6/d7/fa to d6/d20/d32/f56 0 2024-09-12T22:49:54.757 INFO:tasks.workunit.client.0.smithi066.stdout:4/261: creat d5/d8/d16/d1b/d1e/f59 x:0 0 0 2024-09-12T22:49:54.757 INFO:tasks.workunit.client.0.smithi066.stdout:9/259: unlink d9/dc/dd/f18 0 2024-09-12T22:49:54.758 INFO:tasks.workunit.client.0.smithi066.stdout:2/253: readlink d1/dd/d12/d1e/l2e 0 2024-09-12T22:49:54.758 INFO:tasks.workunit.client.0.smithi066.stdout:1/235: creat d0/d9/f43 x:0 0 0 2024-09-12T22:49:54.758 INFO:tasks.workunit.client.0.smithi066.stdout:9/260: fdatasync d9/dc/f1f 0 2024-09-12T22:49:54.758 INFO:tasks.workunit.client.0.smithi066.stdout:8/260: read d17/d2c/f32 [919477,101664] 0 2024-09-12T22:49:54.758 INFO:tasks.workunit.client.0.smithi066.stdout:6/276: dread - d6/f2a zero size 2024-09-12T22:49:54.760 INFO:tasks.workunit.client.0.smithi066.stdout:4/262: write d5/d8/d16/d1b/d1e/f55 [653040,121581] 0 2024-09-12T22:49:54.760 INFO:tasks.workunit.client.0.smithi066.stdout:0/273: dread d1/d8/d1f/f45 [0,4194304] 0 2024-09-12T22:49:54.761 INFO:tasks.workunit.client.0.smithi066.stdout:5/350: dread d5/f12 [0,4194304] 0 2024-09-12T22:49:54.762 INFO:tasks.workunit.client.0.smithi066.stdout:7/257: getdents d0/d19/d26/d48 0 2024-09-12T22:49:54.763 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:54.762+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:54.764 INFO:tasks.workunit.client.0.smithi066.stdout:5/351: write d5/d11/d23/f56 [184479,80555] 0 2024-09-12T22:49:54.764 INFO:tasks.workunit.client.0.smithi066.stdout:7/258: chown d0/d19/d26/l2b 12006148 1 2024-09-12T22:49:54.767 INFO:tasks.workunit.client.0.smithi066.stdout:6/277: dwrite d6/f1f [0,4194304] 0 2024-09-12T22:49:54.767 INFO:tasks.workunit.client.0.smithi066.stdout:0/274: dread d1/f10 [0,4194304] 0 2024-09-12T22:49:54.769 INFO:tasks.workunit.client.0.smithi066.stdout:6/278: write d6/d20/f12 [2760595,59687] 0 2024-09-12T22:49:54.770 INFO:tasks.workunit.client.0.smithi066.stdout:6/279: chown d6/fb 116982 1 2024-09-12T22:49:54.773 INFO:tasks.workunit.client.0.smithi066.stdout:4/263: mkdir d5/d8/d16/d1b/d1e/d5a 0 2024-09-12T22:49:54.776 INFO:tasks.workunit.client.0.smithi066.stdout:6/280: dread d6/d7/f11 [0,4194304] 0 2024-09-12T22:49:54.776 INFO:tasks.workunit.client.0.smithi066.stdout:9/261: dwrite d9/d31/d34/f37 [0,4194304] 0 2024-09-12T22:49:54.776 INFO:tasks.workunit.client.0.smithi066.stdout:3/236: dread d0/d2/d7/d29/f42 [0,4194304] 0 2024-09-12T22:49:54.778 INFO:tasks.workunit.client.0.smithi066.stdout:2/254: sync 2024-09-12T22:49:54.778 INFO:tasks.workunit.client.0.smithi066.stdout:9/262: write d9/dc/f38 [876212,51136] 0 2024-09-12T22:49:54.778 INFO:tasks.workunit.client.0.smithi066.stdout:4/264: sync 2024-09-12T22:49:54.778 INFO:tasks.workunit.client.0.smithi066.stdout:5/352: sync 2024-09-12T22:49:54.778 INFO:tasks.workunit.client.0.smithi066.stdout:3/237: write d0/d2/d6/fd [404014,90606] 0 2024-09-12T22:49:54.783 INFO:tasks.workunit.client.0.smithi066.stdout:8/261: dread d17/d1b/f3b [0,4194304] 0 2024-09-12T22:49:54.786 INFO:tasks.workunit.client.0.smithi066.stdout:4/265: dwrite d5/d8/d16/d1b/d1e/f55 [0,4194304] 0 2024-09-12T22:49:54.786 INFO:tasks.workunit.client.0.smithi066.stdout:3/238: dwrite d0/d2/d7/d29/f42 [0,4194304] 0 2024-09-12T22:49:54.790 INFO:tasks.workunit.client.0.smithi066.stdout:1/236: mkdir d0/dc/d44 0 2024-09-12T22:49:54.792 INFO:tasks.workunit.client.0.smithi066.stdout:2/255: symlink d1/d11/l54 0 2024-09-12T22:49:54.792 INFO:tasks.workunit.client.0.smithi066.stdout:8/262: readlink d17/l31 0 2024-09-12T22:49:54.792 INFO:tasks.workunit.client.0.smithi066.stdout:3/239: creat d0/d2/d7/f5e x:0 0 0 2024-09-12T22:49:54.792 INFO:tasks.workunit.client.0.smithi066.stdout:7/259: link d0/d19/f45 d0/d19/d24/d33/d27/d29/f52 0 2024-09-12T22:49:54.793 INFO:tasks.workunit.client.0.smithi066.stdout:8/263: chown d17/d2c/f37 0 1 2024-09-12T22:49:54.794 INFO:tasks.workunit.client.0.smithi066.stdout:6/281: rename d6/d35/f54 to d6/d23/d25/f57 0 2024-09-12T22:49:54.794 INFO:tasks.workunit.client.0.smithi066.stdout:5/353: symlink d5/de/d57/l6a 0 2024-09-12T22:49:54.794 INFO:tasks.workunit.client.0.smithi066.stdout:1/237: truncate d0/f13 759898 0 2024-09-12T22:49:54.794 INFO:tasks.workunit.client.0.smithi066.stdout:5/354: stat d5/f12 0 2024-09-12T22:49:54.795 INFO:tasks.workunit.client.0.smithi066.stdout:5/355: sync 2024-09-12T22:49:54.795 INFO:tasks.workunit.client.0.smithi066.stdout:3/240: write d0/d2/d6/f9 [2232554,8501] 0 2024-09-12T22:49:54.796 INFO:tasks.workunit.client.0.smithi066.stdout:5/356: chown d5/d11/l4c 705143337 1 2024-09-12T22:49:54.797 INFO:tasks.workunit.client.0.smithi066.stdout:3/241: stat d0/d2/d1d/f21 0 2024-09-12T22:49:54.798 INFO:tasks.workunit.client.0.smithi066.stdout:6/282: link d6/c3b d6/d23/c58 0 2024-09-12T22:49:54.799 INFO:tasks.workunit.client.0.smithi066.stdout:5/357: readlink d5/d11/d21/d4d/l53 0 2024-09-12T22:49:54.799 INFO:tasks.workunit.client.0.smithi066.stdout:0/275: rename d1/d8/d1b/f43 to d1/d8/f63 0 2024-09-12T22:49:54.799 INFO:tasks.workunit.client.0.smithi066.stdout:9/263: dwrite d9/d31/d34/f3b [0,4194304] 0 2024-09-12T22:49:54.799 INFO:tasks.workunit.client.0.smithi066.stdout:0/276: sync 2024-09-12T22:49:54.802 INFO:tasks.workunit.client.0.smithi066.stdout:2/256: rename d1/dd/d12/d18/l29 to d1/dd/d12/d1e/l55 0 2024-09-12T22:49:54.803 INFO:tasks.workunit.client.0.smithi066.stdout:8/264: dwrite d17/f27 [0,4194304] 0 2024-09-12T22:49:54.803 INFO:tasks.workunit.client.0.smithi066.stdout:6/283: mkdir d6/d59 0 2024-09-12T22:49:54.804 INFO:tasks.workunit.client.0.smithi066.stdout:2/257: stat d1/dd/d12/d18 0 2024-09-12T22:49:54.804 INFO:tasks.workunit.client.0.smithi066.stdout:9/264: creat d9/dc/dd/f4f x:0 0 0 2024-09-12T22:49:54.805 INFO:tasks.workunit.client.0.smithi066.stdout:1/238: rename d0/d9/d21/l25 to d0/d28/l45 0 2024-09-12T22:49:54.805 INFO:tasks.workunit.client.0.smithi066.stdout:2/258: dread - d1/d11/f50 zero size 2024-09-12T22:49:54.806 INFO:tasks.workunit.client.0.smithi066.stdout:7/260: dwrite d0/d19/f45 [0,4194304] 0 2024-09-12T22:49:54.806 INFO:tasks.workunit.client.0.smithi066.stdout:7/261: sync 2024-09-12T22:49:54.807 INFO:tasks.workunit.client.0.smithi066.stdout:0/277: symlink d1/d8/d1f/l64 0 2024-09-12T22:49:54.807 INFO:tasks.workunit.client.0.smithi066.stdout:5/358: creat d5/de/d50/d42/d49/f6b x:0 0 0 2024-09-12T22:49:54.808 INFO:tasks.workunit.client.0.smithi066.stdout:3/242: dwrite d0/d2/d6/d33/d40/f48 [0,4194304] 0 2024-09-12T22:49:54.808 INFO:tasks.workunit.client.0.smithi066.stdout:6/284: truncate d6/d49/d33/f3f 1026512 0 2024-09-12T22:49:54.808 INFO:tasks.workunit.client.0.smithi066.stdout:8/265: mkdir d17/d40/d47/d4d 0 2024-09-12T22:49:54.809 INFO:tasks.workunit.client.0.smithi066.stdout:7/262: mkdir d0/d19/d24/d33/d27/d29/d53 0 2024-09-12T22:49:54.810 INFO:tasks.workunit.client.0.smithi066.stdout:4/266: dread d5/d8/f19 [0,4194304] 0 2024-09-12T22:49:54.811 INFO:tasks.workunit.client.0.smithi066.stdout:7/263: readlink d0/d19/d24/d33/d27/l50 0 2024-09-12T22:49:54.811 INFO:tasks.workunit.client.0.smithi066.stdout:3/243: write d0/d2/d1d/f2a [1918489,130212] 0 2024-09-12T22:49:54.812 INFO:tasks.workunit.client.0.smithi066.stdout:2/259: unlink d1/dd/d12/d1e/f39 0 2024-09-12T22:49:54.813 INFO:tasks.workunit.client.0.smithi066.stdout:9/265: dwrite d9/dc/f40 [0,4194304] 0 2024-09-12T22:49:54.813 INFO:tasks.workunit.client.0.smithi066.stdout:1/239: rename d0/dc/d1e/f40 to d0/dc/f46 0 2024-09-12T22:49:54.813 INFO:tasks.workunit.client.0.smithi066.stdout:0/278: getdents d1/d5b 0 2024-09-12T22:49:54.814 INFO:tasks.workunit.client.0.smithi066.stdout:6/285: symlink d6/d23/d25/d4e/l5a 0 2024-09-12T22:49:54.815 INFO:tasks.workunit.client.0.smithi066.stdout:2/260: write d1/d11/f25 [2536978,109343] 0 2024-09-12T22:49:54.815 INFO:tasks.workunit.client.0.smithi066.stdout:5/359: getdents d5/d11/d5d/d64 0 2024-09-12T22:49:54.816 INFO:tasks.workunit.client.0.smithi066.stdout:3/244: creat d0/d2/d1d/f5f x:0 0 0 2024-09-12T22:49:54.816 INFO:tasks.workunit.client.0.smithi066.stdout:0/279: truncate d1/d8/d1f/f46 306176 0 2024-09-12T22:49:54.816 INFO:tasks.workunit.client.0.smithi066.stdout:1/240: truncate d0/d9/d21/f3d 275713 0 2024-09-12T22:49:54.816 INFO:tasks.workunit.client.0.smithi066.stdout:2/261: chown d1/d2a/f48 5365748 1 2024-09-12T22:49:54.816 INFO:tasks.workunit.client.0.smithi066.stdout:4/267: rename d5/d3e/f44 to d5/d8/d16/d1b/d1e/f5b 0 2024-09-12T22:49:54.817 INFO:tasks.workunit.client.0.smithi066.stdout:9/266: creat d9/dc/dd/f50 x:0 0 0 2024-09-12T22:49:54.817 INFO:tasks.workunit.client.0.smithi066.stdout:2/262: dread - d1/d44/f45 zero size 2024-09-12T22:49:54.817 INFO:tasks.workunit.client.0.smithi066.stdout:0/280: mkdir d1/d36/d65 0 2024-09-12T22:49:54.818 INFO:tasks.workunit.client.0.smithi066.stdout:1/241: mkdir d0/dc/d1e/d47 0 2024-09-12T22:49:54.818 INFO:tasks.workunit.client.0.smithi066.stdout:7/264: getdents d0/d19/d24 0 2024-09-12T22:49:54.819 INFO:tasks.workunit.client.0.smithi066.stdout:9/267: creat d9/dc/d23/f51 x:0 0 0 2024-09-12T22:49:54.820 INFO:tasks.workunit.client.0.smithi066.stdout:9/268: write d9/dc/f28 [1540135,30340] 0 2024-09-12T22:49:54.820 INFO:tasks.workunit.client.0.smithi066.stdout:5/360: truncate d5/d11/f54 3733965 0 2024-09-12T22:49:54.821 INFO:tasks.workunit.client.0.smithi066.stdout:0/281: creat d1/d8/d1c/dd/f66 x:0 0 0 2024-09-12T22:49:54.821 INFO:tasks.workunit.client.0.smithi066.stdout:7/265: chown d0/l13 381151476 1 2024-09-12T22:49:54.821 INFO:tasks.workunit.client.0.smithi066.stdout:1/242: symlink d0/d36/l48 0 2024-09-12T22:49:54.822 INFO:tasks.workunit.client.0.smithi066.stdout:2/263: truncate d1/dd/f2c 677469 0 2024-09-12T22:49:54.822 INFO:tasks.workunit.client.0.smithi066.stdout:5/361: mknod d5/d14/c6c 0 2024-09-12T22:49:54.822 INFO:tasks.workunit.client.0.smithi066.stdout:6/286: dwrite d6/f4b [0,4194304] 0 2024-09-12T22:49:54.824 INFO:tasks.workunit.client.0.smithi066.stdout:2/264: write d1/dd/d12/d18/f3e [4610341,62605] 0 2024-09-12T22:49:54.824 INFO:tasks.workunit.client.0.smithi066.stdout:5/362: unlink d5/de/d50/f60 0 2024-09-12T22:49:54.824 INFO:tasks.workunit.client.0.smithi066.stdout:6/287: unlink d6/f1f 0 2024-09-12T22:49:54.825 INFO:tasks.workunit.client.0.smithi066.stdout:7/266: creat d0/f54 x:0 0 0 2024-09-12T22:49:54.825 INFO:tasks.workunit.client.0.smithi066.stdout:1/243: truncate d0/f13 240656 0 2024-09-12T22:49:54.825 INFO:tasks.workunit.client.0.smithi066.stdout:9/269: creat d9/dc/f52 x:0 0 0 2024-09-12T22:49:54.827 INFO:tasks.workunit.client.0.smithi066.stdout:4/268: dread d5/d8/d10/f36 [0,4194304] 0 2024-09-12T22:49:54.827 INFO:tasks.workunit.client.0.smithi066.stdout:3/245: truncate d0/d2/d6/f18 404716 0 2024-09-12T22:49:54.827 INFO:tasks.workunit.client.0.smithi066.stdout:1/244: chown d0/dc/d33/l35 46096031 1 2024-09-12T22:49:54.828 INFO:tasks.workunit.client.0.smithi066.stdout:9/270: readlink d9/dc/d46/l4a 0 2024-09-12T22:49:54.828 INFO:tasks.workunit.client.0.smithi066.stdout:1/245: readlink d0/l1 0 2024-09-12T22:49:54.828 INFO:tasks.workunit.client.0.smithi066.stdout:6/288: truncate d6/d23/f3e 128533 0 2024-09-12T22:49:54.828 INFO:tasks.workunit.client.0.smithi066.stdout:5/363: truncate d5/f24 2235655 0 2024-09-12T22:49:54.829 INFO:tasks.workunit.client.0.smithi066.stdout:0/282: dwrite d1/d8/d1f/f2c [0,4194304] 0 2024-09-12T22:49:54.830 INFO:tasks.workunit.client.0.smithi066.stdout:6/289: stat d6/c3b 0 2024-09-12T22:49:54.830 INFO:tasks.workunit.client.0.smithi066.stdout:4/269: chown d5/d8/d10/de/f18 6 1 2024-09-12T22:49:54.830 INFO:tasks.workunit.client.0.smithi066.stdout:3/246: write d0/d2/d1d/f5f [644891,4924] 0 2024-09-12T22:49:54.831 INFO:tasks.workunit.client.0.smithi066.stdout:9/271: unlink d9/c22 0 2024-09-12T22:49:54.832 INFO:tasks.workunit.client.0.smithi066.stdout:1/246: rename d0/d9/l10 to d0/d9/d21/l49 0 2024-09-12T22:49:54.833 INFO:tasks.workunit.client.0.smithi066.stdout:3/247: creat d0/d2/d7/d13/d43/f60 x:0 0 0 2024-09-12T22:49:54.833 INFO:tasks.workunit.client.0.smithi066.stdout:1/247: chown d0/l23 9 1 2024-09-12T22:49:54.834 INFO:tasks.workunit.client.0.smithi066.stdout:6/290: link d6/d23/d25/d2c/l53 d6/d59/l5b 0 2024-09-12T22:49:54.835 INFO:tasks.workunit.client.0.smithi066.stdout:4/270: creat d5/d8/d10/f5c x:0 0 0 2024-09-12T22:49:54.835 INFO:tasks.workunit.client.0.smithi066.stdout:2/265: dread d1/d11/d26/f30 [0,4194304] 0 2024-09-12T22:49:54.835 INFO:tasks.workunit.client.0.smithi066.stdout:7/267: dwrite d0/d6/f2e [0,4194304] 0 2024-09-12T22:49:54.835 INFO:tasks.workunit.client.0.smithi066.stdout:1/248: readlink d0/dc/d1e/l41 0 2024-09-12T22:49:54.837 INFO:tasks.workunit.client.0.smithi066.stdout:1/249: chown d0/l1 90 1 2024-09-12T22:49:54.838 INFO:tasks.workunit.client.0.smithi066.stdout:6/291: creat d6/d7/dc/f5c x:0 0 0 2024-09-12T22:49:54.839 INFO:tasks.workunit.client.0.smithi066.stdout:4/271: dread - d5/d8/d10/de/d2d/f50 zero size 2024-09-12T22:49:54.840 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:54.840 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:54.840 INFO:tasks.workunit.client.0.smithi066.stdout:9/272: dwrite d9/dc/dd/f50 [0,4194304] 0 2024-09-12T22:49:54.841 INFO:tasks.workunit.client.0.smithi066.stdout:6/292: write d6/fb [906225,100780] 0 2024-09-12T22:49:54.842 INFO:tasks.workunit.client.0.smithi066.stdout:3/248: dwrite d0/d2/d1d/f5f [0,4194304] 0 2024-09-12T22:49:54.843 INFO:tasks.workunit.client.0.smithi066.stdout:4/272: readlink d5/d8/d10/de/d2d/l52 0 2024-09-12T22:49:54.843 INFO:tasks.workunit.client.0.smithi066.stdout:6/293: dread - d6/d7/dc/f5c zero size 2024-09-12T22:49:54.844 INFO:tasks.workunit.client.0.smithi066.stdout:9/273: write d9/dc/dd/f1d [2030654,88883] 0 2024-09-12T22:49:54.844 INFO:tasks.workunit.client.0.smithi066.stdout:1/250: link d0/c26 d0/dc/d33/c4a 0 2024-09-12T22:49:54.844 INFO:tasks.workunit.client.0.smithi066.stdout:7/268: dwrite d0/d19/d26/f47 [0,4194304] 0 2024-09-12T22:49:54.845 INFO:tasks.workunit.client.0.smithi066.stdout:3/249: truncate d0/f54 612300 0 2024-09-12T22:49:54.845 INFO:tasks.workunit.client.0.smithi066.stdout:2/266: read d1/d11/f16 [4128746,19845] 0 2024-09-12T22:49:54.846 INFO:tasks.workunit.client.0.smithi066.stdout:8/266: dread d17/d2c/f32 [0,4194304] 0 2024-09-12T22:49:54.847 INFO:tasks.workunit.client.0.smithi066.stdout:2/267: chown d1/d2a/c49 11057607 1 2024-09-12T22:49:54.847 INFO:tasks.workunit.client.0.smithi066.stdout:1/251: rmdir d0/d9/d21 39 2024-09-12T22:49:54.848 INFO:tasks.workunit.client.0.smithi066.stdout:9/274: creat d9/f53 x:0 0 0 2024-09-12T22:49:54.849 INFO:tasks.workunit.client.0.smithi066.stdout:4/273: creat d5/d8/d16/d1b/d1e/d5a/f5d x:0 0 0 2024-09-12T22:49:54.849 INFO:tasks.workunit.client.0.smithi066.stdout:2/268: write d1/d2a/f48 [561074,17626] 0 2024-09-12T22:49:54.852 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:54.852 INFO:tasks.workunit.client.0.smithi066.stdout:7/269: mknod d0/d19/d26/d48/c55 0 2024-09-12T22:49:54.854 INFO:tasks.workunit.client.0.smithi066.stdout:1/252: mknod d0/d28/c4b 0 2024-09-12T22:49:54.855 INFO:tasks.workunit.client.0.smithi066.stdout:4/274: rmdir d5/d8 39 2024-09-12T22:49:54.855 INFO:tasks.workunit.client.0.smithi066.stdout:3/250: dread d0/d2/d6/d33/d40/d44/d55/f5c [0,4194304] 0 2024-09-12T22:49:54.855 INFO:tasks.workunit.client.0.smithi066.stdout:7/270: readlink d0/d19/d24/l15 0 2024-09-12T22:49:54.855 INFO:tasks.workunit.client.0.smithi066.stdout:9/275: creat d9/dc/dd/f54 x:0 0 0 2024-09-12T22:49:54.856 INFO:tasks.workunit.client.0.smithi066.stdout:6/294: dwrite d6/d49/f2f [0,4194304] 0 2024-09-12T22:49:54.857 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:54.856+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:54.857 INFO:tasks.workunit.client.0.smithi066.stdout:3/251: dread - d0/d2/d7/d13/d43/f50 zero size 2024-09-12T22:49:54.858 INFO:tasks.workunit.client.0.smithi066.stdout:0/283: dread d1/f7 [0,4194304] 0 2024-09-12T22:49:54.859 INFO:tasks.workunit.client.0.smithi066.stdout:7/271: mknod d0/d6/c56 0 2024-09-12T22:49:54.860 INFO:tasks.workunit.client.0.smithi066.stdout:2/269: mkdir d1/d11/d26/d4f/d52/d56 0 2024-09-12T22:49:54.860 INFO:tasks.workunit.client.0.smithi066.stdout:8/267: dwrite d17/d1b/f3b [4194304,4194304] 0 2024-09-12T22:49:54.861 INFO:tasks.workunit.client.0.smithi066.stdout:4/275: mknod d5/d8/d10/de/c5e 0 2024-09-12T22:49:54.862 INFO:tasks.workunit.client.0.smithi066.stdout:6/295: creat d6/d20/d50/f5d x:0 0 0 2024-09-12T22:49:54.862 INFO:tasks.workunit.client.0.smithi066.stdout:5/364: dread d5/d11/f1d [0,4194304] 0 2024-09-12T22:49:54.862 INFO:tasks.workunit.client.0.smithi066.stdout:8/268: truncate d17/d1b/f23 713209 0 2024-09-12T22:49:54.863 INFO:tasks.workunit.client.0.smithi066.stdout:0/284: rmdir d1/d8/d1f 39 2024-09-12T22:49:54.864 INFO:tasks.workunit.client.0.smithi066.stdout:9/276: rename d9/dc/dd/l49 to d9/d31/l55 0 2024-09-12T22:49:54.864 INFO:tasks.workunit.client.0.smithi066.stdout:4/276: write d5/d8/d16/d1b/d1e/d1f/f4d [914311,85506] 0 2024-09-12T22:49:54.864 INFO:tasks.workunit.client.0.smithi066.stdout:6/296: rmdir d6/d20/d32/d3c 39 2024-09-12T22:49:54.865 INFO:tasks.workunit.client.0.smithi066.stdout:3/252: dwrite d0/d2/d1d/f23 [0,4194304] 0 2024-09-12T22:49:54.866 INFO:tasks.workunit.client.0.smithi066.stdout:7/272: link d0/d19/d24/d33/d27/d29/f52 d0/d19/d24/d33/d27/f57 0 2024-09-12T22:49:54.866 INFO:tasks.workunit.client.0.smithi066.stdout:8/269: mkdir d17/d49/d4b/d4e 0 2024-09-12T22:49:54.866 INFO:tasks.workunit.client.0.smithi066.stdout:4/277: unlink d5/d8/l4e 0 2024-09-12T22:49:54.867 INFO:tasks.workunit.client.0.smithi066.stdout:6/297: fdatasync d6/d20/f22 0 2024-09-12T22:49:54.867 INFO:tasks.workunit.client.0.smithi066.stdout:0/285: rename d1/d8/d1b/f48 to d1/f67 0 2024-09-12T22:49:54.868 INFO:tasks.workunit.client.0.smithi066.stdout:3/253: rmdir d0/d2/d6/d33/d40/d44 39 2024-09-12T22:49:54.868 INFO:tasks.workunit.client.0.smithi066.stdout:9/277: creat d9/dc/f56 x:0 0 0 2024-09-12T22:49:54.868 INFO:tasks.workunit.client.0.smithi066.stdout:2/270: dwrite d1/d11/f25 [0,4194304] 0 2024-09-12T22:49:54.869 INFO:tasks.workunit.client.0.smithi066.stdout:7/273: rename d0/d19/d26/f30 to d0/d19/d26/d48/f58 0 2024-09-12T22:49:54.873 INFO:tasks.workunit.client.0.smithi066.stdout:6/298: write d6/d49/d33/f3f [670628,110051] 0 2024-09-12T22:49:54.873 INFO:tasks.workunit.client.0.smithi066.stdout:8/270: getdents d17/d40/d47/d4d 0 2024-09-12T22:49:54.873 INFO:tasks.workunit.client.0.smithi066.stdout:3/254: readlink d0/d2/d7/d13/l56 0 2024-09-12T22:49:54.873 INFO:tasks.workunit.client.0.smithi066.stdout:7/274: chown d0/d19/d24/c22 3430036 1 2024-09-12T22:49:54.873 INFO:tasks.workunit.client.0.smithi066.stdout:2/271: mkdir d1/d11/d57 0 2024-09-12T22:49:54.874 INFO:tasks.workunit.client.0.smithi066.stdout:3/255: fdatasync d0/d2/d1d/f2a 0 2024-09-12T22:49:54.874 INFO:tasks.workunit.client.0.smithi066.stdout:8/271: rename d17/d2c/l43 to d17/d40/l4f 0 2024-09-12T22:49:54.874 INFO:tasks.workunit.client.0.smithi066.stdout:7/275: mkdir d0/d19/d26/d48/d59 0 2024-09-12T22:49:54.875 INFO:tasks.workunit.client.0.smithi066.stdout:4/278: dread d5/d8/d10/de/f27 [0,4194304] 0 2024-09-12T22:49:54.877 INFO:tasks.workunit.client.0.smithi066.stdout:6/299: rename d6/d20/d32/d3c/f55 to d6/d23/f5e 0 2024-09-12T22:49:54.877 INFO:tasks.workunit.client.0.smithi066.stdout:0/286: dwrite d1/d8/f5a [0,4194304] 0 2024-09-12T22:49:54.878 INFO:tasks.workunit.client.0.smithi066.stdout:9/278: dwrite d9/dc/f28 [0,4194304] 0 2024-09-12T22:49:54.878 INFO:tasks.workunit.client.0.smithi066.stdout:7/276: mkdir d0/d19/d26/d5a 0 2024-09-12T22:49:54.880 INFO:tasks.workunit.client.0.smithi066.stdout:6/300: truncate d6/d7/f39 639389 0 2024-09-12T22:49:54.882 INFO:tasks.workunit.client.0.smithi066.stdout:8/272: link f16 d17/d40/d47/d4d/f50 0 2024-09-12T22:49:54.882 INFO:tasks.workunit.client.0.smithi066.stdout:7/277: fdatasync d0/d19/d24/f3b 0 2024-09-12T22:49:54.882 INFO:tasks.workunit.client.0.smithi066.stdout:9/279: mknod d9/dc/d4e/c57 0 2024-09-12T22:49:54.882 INFO:tasks.workunit.client.0.smithi066.stdout:0/287: creat d1/f68 x:0 0 0 2024-09-12T22:49:54.882 INFO:tasks.workunit.client.0.smithi066.stdout:8/273: symlink d17/d2c/l51 0 2024-09-12T22:49:54.883 INFO:tasks.workunit.client.0.smithi066.stdout:7/278: write d0/d19/d24/f1f [856413,72216] 0 2024-09-12T22:49:54.883 INFO:tasks.workunit.client.0.smithi066.stdout:3/256: dread d0/d2/d6/d33/d40/f48 [0,4194304] 0 2024-09-12T22:49:54.883 INFO:tasks.workunit.client.0.smithi066.stdout:8/274: fdatasync d17/d2c/f34 0 2024-09-12T22:49:54.884 INFO:tasks.workunit.client.0.smithi066.stdout:0/288: creat d1/d8/d1b/d59/f69 x:0 0 0 2024-09-12T22:49:54.885 INFO:tasks.workunit.client.0.smithi066.stdout:7/279: creat d0/d19/d24/d33/f5b x:0 0 0 2024-09-12T22:49:54.885 INFO:tasks.workunit.client.0.smithi066.stdout:8/275: creat d17/d40/f52 x:0 0 0 2024-09-12T22:49:54.885 INFO:tasks.workunit.client.0.smithi066.stdout:0/289: write d1/d8/f5a [1897969,97765] 0 2024-09-12T22:49:54.887 INFO:tasks.workunit.client.0.smithi066.stdout:7/280: fdatasync d0/ff 0 2024-09-12T22:49:54.887 INFO:tasks.workunit.client.0.smithi066.stdout:8/276: symlink d17/d40/d47/d4d/l53 0 2024-09-12T22:49:54.889 INFO:tasks.workunit.client.0.smithi066.stdout:6/301: truncate d6/d20/d32/f56 225598 0 2024-09-12T22:49:54.889 INFO:tasks.workunit.client.0.smithi066.stdout:7/281: read d0/d19/d26/d48/f58 [840826,36753] 0 2024-09-12T22:49:54.891 INFO:tasks.workunit.client.0.smithi066.stdout:7/282: symlink d0/d6/l5c 0 2024-09-12T22:49:54.891 INFO:tasks.workunit.client.0.smithi066.stdout:6/302: mknod d6/c5f 0 2024-09-12T22:49:54.892 INFO:tasks.workunit.client.0.smithi066.stdout:3/257: dwrite d0/d2/d1d/f2a [0,4194304] 0 2024-09-12T22:49:54.893 INFO:tasks.workunit.client.0.smithi066.stdout:0/290: dread d1/d8/f5a [0,4194304] 0 2024-09-12T22:49:54.897 INFO:tasks.workunit.client.0.smithi066.stdout:3/258: write d0/d2/d6/d33/d40/f4d [4605020,68544] 0 2024-09-12T22:49:54.897 INFO:tasks.workunit.client.0.smithi066.stdout:0/291: symlink d1/l6a 0 2024-09-12T22:49:54.897 INFO:tasks.workunit.client.0.smithi066.stdout:8/277: dwrite d17/d2c/f38 [0,4194304] 0 2024-09-12T22:49:54.898 INFO:tasks.workunit.client.0.smithi066.stdout:7/283: rename d0/f2f to d0/d19/d24/d33/d27/d29/d53/f5d 0 2024-09-12T22:49:54.899 INFO:tasks.workunit.client.0.smithi066.stdout:9/280: dwrite d9/dc/dd/f13 [0,4194304] 0 2024-09-12T22:49:54.899 INFO:tasks.workunit.client.0.smithi066.stdout:7/284: write d0/d6/f21 [2345888,13517] 0 2024-09-12T22:49:54.900 INFO:tasks.workunit.client.0.smithi066.stdout:3/259: truncate d0/d2/d7/d13/d43/f60 17750 0 2024-09-12T22:49:54.901 INFO:tasks.workunit.client.0.smithi066.stdout:0/292: fsync d1/d8/d1f/d30/f55 0 2024-09-12T22:49:54.901 INFO:tasks.workunit.client.0.smithi066.stdout:3/260: write d0/d2/d7/d13/f39 [2283652,126903] 0 2024-09-12T22:49:54.901 INFO:tasks.workunit.client.0.smithi066.stdout:1/253: sync 2024-09-12T22:49:54.902 INFO:tasks.workunit.client.0.smithi066.stdout:8/278: symlink d17/d40/d47/l54 0 2024-09-12T22:49:54.902 INFO:tasks.workunit.client.0.smithi066.stdout:7/285: mknod d0/d19/d24/d33/d27/d29/d53/c5e 0 2024-09-12T22:49:54.903 INFO:tasks.workunit.client.0.smithi066.stdout:9/281: mkdir d9/d31/d58 0 2024-09-12T22:49:54.903 INFO:tasks.workunit.client.0.smithi066.stdout:0/293: creat d1/d8/d1c/d13/d2f/f6b x:0 0 0 2024-09-12T22:49:54.904 INFO:tasks.workunit.client.0.smithi066.stdout:3/261: mknod d0/d2/d6/d33/d40/c61 0 2024-09-12T22:49:54.905 INFO:tasks.workunit.client.0.smithi066.stdout:7/286: creat d0/d19/d24/d33/f5f x:0 0 0 2024-09-12T22:49:54.906 INFO:tasks.workunit.client.0.smithi066.stdout:0/294: creat d1/d8/d1f/f6c x:0 0 0 2024-09-12T22:49:54.908 INFO:tasks.workunit.client.0.smithi066.stdout:6/303: dwrite d6/d7/dc/f43 [0,4194304] 0 2024-09-12T22:49:54.910 INFO:tasks.workunit.client.0.smithi066.stdout:7/287: write d0/d19/d24/f3b [3058690,44986] 0 2024-09-12T22:49:54.911 INFO:tasks.workunit.client.0.smithi066.stdout:6/304: write d6/f17 [4749993,56943] 0 2024-09-12T22:49:54.912 INFO:tasks.workunit.client.0.smithi066.stdout:8/279: dwrite d17/d2c/f37 [0,4194304] 0 2024-09-12T22:49:54.914 INFO:tasks.workunit.client.0.smithi066.stdout:7/288: dread - d0/d6/f4f zero size 2024-09-12T22:49:54.914 INFO:tasks.workunit.client.0.smithi066.stdout:4/279: dread d5/d8/d10/de/f18 [0,4194304] 0 2024-09-12T22:49:54.914 INFO:tasks.workunit.client.0.smithi066.stdout:1/254: dwrite d0/d9/f43 [0,4194304] 0 2024-09-12T22:49:54.914 INFO:tasks.workunit.client.0.smithi066.stdout:3/262: rename d0/d2/d7/d29/f3c to d0/d2/d7/d13/f62 0 2024-09-12T22:49:54.914 INFO:tasks.workunit.client.0.smithi066.stdout:9/282: dwrite d9/fa [0,4194304] 0 2024-09-12T22:49:54.914 INFO:tasks.workunit.client.0.smithi066.stdout:8/280: write f15 [882032,128157] 0 2024-09-12T22:49:54.915 INFO:tasks.workunit.client.0.smithi066.stdout:6/305: mknod d6/d49/d33/c60 0 2024-09-12T22:49:54.915 INFO:tasks.workunit.client.0.smithi066.stdout:4/280: dread - d5/d48/f53 zero size 2024-09-12T22:49:54.916 INFO:tasks.workunit.client.0.smithi066.stdout:3/263: symlink d0/d2/d7/l63 0 2024-09-12T22:49:54.917 INFO:tasks.workunit.client.0.smithi066.stdout:1/255: write d0/f2e [3173421,10217] 0 2024-09-12T22:49:54.917 INFO:tasks.workunit.client.0.smithi066.stdout:8/281: chown d17/f21 7015274 1 2024-09-12T22:49:54.918 INFO:tasks.workunit.client.0.smithi066.stdout:2/272: dread d1/d11/f19 [0,4194304] 0 2024-09-12T22:49:54.918 INFO:tasks.workunit.client.0.smithi066.stdout:6/306: write d6/d23/f3e [703405,72417] 0 2024-09-12T22:49:54.919 INFO:tasks.workunit.client.0.smithi066.stdout:1/256: chown d0/l1 315466981 1 2024-09-12T22:49:54.920 INFO:tasks.workunit.client.0.smithi066.stdout:0/295: dwrite d1/d8/d1b/d59/f69 [0,4194304] 0 2024-09-12T22:49:54.920 INFO:tasks.workunit.client.0.smithi066.stdout:4/281: unlink d5/d8/d16/d1b/d1e/d1f/f4d 0 2024-09-12T22:49:54.920 INFO:tasks.workunit.client.0.smithi066.stdout:8/282: write d17/d40/f4c [917389,94361] 0 2024-09-12T22:49:54.921 INFO:tasks.workunit.client.0.smithi066.stdout:2/273: write d1/dd/d3d/f3f [866723,74288] 0 2024-09-12T22:49:54.921 INFO:tasks.workunit.client.0.smithi066.stdout:0/296: chown d1/d36/l5d 2228925 1 2024-09-12T22:49:54.922 INFO:tasks.workunit.client.0.smithi066.stdout:3/264: symlink d0/d2/d7/d13/d31/l64 0 2024-09-12T22:49:54.922 INFO:tasks.workunit.client.0.smithi066.stdout:1/257: truncate d0/d9/f14 2004644 0 2024-09-12T22:49:54.923 INFO:tasks.workunit.client.0.smithi066.stdout:8/283: rename cc to d17/d40/d47/c55 0 2024-09-12T22:49:54.923 INFO:tasks.workunit.client.0.smithi066.stdout:9/283: dread d9/dc/dd/f42 [0,4194304] 0 2024-09-12T22:49:54.923 INFO:tasks.workunit.client.0.smithi066.stdout:6/307: truncate d6/d20/d50/f5d 819352 0 2024-09-12T22:49:54.924 INFO:tasks.workunit.client.0.smithi066.stdout:2/274: symlink d1/db/l58 0 2024-09-12T22:49:54.924 INFO:tasks.workunit.client.0.smithi066.stdout:0/297: mkdir d1/d5b/d6d 0 2024-09-12T22:49:54.925 INFO:tasks.workunit.client.0.smithi066.stdout:8/284: dread - d17/d1b/f30 zero size 2024-09-12T22:49:54.926 INFO:tasks.workunit.client.0.smithi066.stdout:1/258: stat d0/dc/fe 0 2024-09-12T22:49:54.927 INFO:tasks.workunit.client.0.smithi066.stdout:9/284: fdatasync d9/dc/dd/f47 0 2024-09-12T22:49:54.928 INFO:tasks.workunit.client.0.smithi066.stdout:7/289: dwrite d0/d19/d24/d33/d27/d29/f51 [0,4194304] 0 2024-09-12T22:49:54.928 INFO:tasks.workunit.client.0.smithi066.stdout:2/275: mknod d1/db/d42/c59 0 2024-09-12T22:49:54.929 INFO:tasks.workunit.client.0.smithi066.stdout:0/298: mknod d1/d8/d1b/d59/c6e 0 2024-09-12T22:49:54.930 INFO:tasks.workunit.client.0.smithi066.stdout:8/285: dread d17/d2c/f32 [0,4194304] 0 2024-09-12T22:49:54.930 INFO:tasks.workunit.client.0.smithi066.stdout:2/276: mknod d1/dd/d3d/c5a 0 2024-09-12T22:49:54.930 INFO:tasks.workunit.client.0.smithi066.stdout:7/290: rename d0/d19/d24/d33/d27/d29 to d0/d19/d60 0 2024-09-12T22:49:54.930 INFO:tasks.workunit.client.0.smithi066.stdout:9/285: symlink d9/d31/d34/d4d/l59 0 2024-09-12T22:49:54.931 INFO:tasks.workunit.client.0.smithi066.stdout:0/299: symlink d1/d5b/d6d/l6f 0 2024-09-12T22:49:54.931 INFO:tasks.workunit.client.0.smithi066.stdout:8/286: readlink d17/d40/l4f 0 2024-09-12T22:49:54.931 INFO:tasks.workunit.client.0.smithi066.stdout:6/308: read d6/d49/d33/f3f [968586,126359] 0 2024-09-12T22:49:54.932 INFO:tasks.workunit.client.0.smithi066.stdout:9/286: write d9/fa [1483991,119218] 0 2024-09-12T22:49:54.932 INFO:tasks.workunit.client.0.smithi066.stdout:2/277: write d1/d2a/f34 [1092428,54075] 0 2024-09-12T22:49:54.932 INFO:tasks.workunit.client.0.smithi066.stdout:3/265: dwrite d0/d2/d6/f9 [0,4194304] 0 2024-09-12T22:49:54.932 INFO:tasks.workunit.client.0.smithi066.stdout:7/291: write d0/d19/d60/f51 [3068715,23745] 0 2024-09-12T22:49:54.933 INFO:tasks.workunit.client.0.smithi066.stdout:8/287: mknod d17/d40/d47/d4d/c56 0 2024-09-12T22:49:54.934 INFO:tasks.workunit.client.0.smithi066.stdout:6/309: mknod d6/d51/c61 0 2024-09-12T22:49:54.934 INFO:tasks.workunit.client.0.smithi066.stdout:8/288: readlink d17/d2c/l3e 0 2024-09-12T22:49:54.935 INFO:tasks.workunit.client.0.smithi066.stdout:2/278: symlink d1/d44/d51/l5b 0 2024-09-12T22:49:54.936 INFO:tasks.workunit.client.0.smithi066.stdout:6/310: mkdir d6/d23/d62 0 2024-09-12T22:49:54.936 INFO:tasks.workunit.client.0.smithi066.stdout:1/259: dread d0/dc/fe [0,4194304] 0 2024-09-12T22:49:54.937 INFO:tasks.workunit.client.0.smithi066.stdout:2/279: symlink d1/d2a/l5c 0 2024-09-12T22:49:54.937 INFO:tasks.workunit.client.0.smithi066.stdout:6/311: readlink d6/d7/ld 0 2024-09-12T22:49:54.937 INFO:tasks.workunit.client.0.smithi066.stdout:8/289: fsync d17/d40/d47/d4d/f50 0 2024-09-12T22:49:54.939 INFO:tasks.workunit.client.0.smithi066.stdout:0/300: dwrite d1/d8/d1c/d13/f22 [0,4194304] 0 2024-09-12T22:49:54.939 INFO:tasks.workunit.client.0.smithi066.stdout:8/290: mkdir d17/d49/d4b/d57 0 2024-09-12T22:49:54.939 INFO:tasks.workunit.client.0.smithi066.stdout:2/280: creat d1/db/f5d x:0 0 0 2024-09-12T22:49:54.939 INFO:tasks.workunit.client.0.smithi066.stdout:9/287: dread d9/dc/f40 [0,4194304] 0 2024-09-12T22:49:54.940 INFO:tasks.workunit.client.0.smithi066.stdout:9/288: fdatasync d9/f53 0 2024-09-12T22:49:54.941 INFO:tasks.workunit.client.0.smithi066.stdout:8/291: mknod d17/d49/c58 0 2024-09-12T22:49:54.941 INFO:tasks.workunit.client.0.smithi066.stdout:9/289: symlink d9/dc/d46/l5a 0 2024-09-12T22:49:54.943 INFO:tasks.workunit.client.0.smithi066.stdout:8/292: chown d17/d2c/c2f 188505 1 2024-09-12T22:49:54.943 INFO:tasks.workunit.client.0.smithi066.stdout:1/260: read d0/dc/d1d/f24 [4134268,56946] 0 2024-09-12T22:49:54.943 INFO:tasks.workunit.client.0.smithi066.stdout:8/293: readlink d17/d1b/l2a 0 2024-09-12T22:49:54.945 INFO:tasks.workunit.client.0.smithi066.stdout:6/312: dwrite d6/f4b [0,4194304] 0 2024-09-12T22:49:54.945 INFO:tasks.workunit.client.0.smithi066.stdout:7/292: write d0/d19/f45 [3621563,32447] 0 2024-09-12T22:49:54.945 INFO:tasks.workunit.client.0.smithi066.stdout:2/281: dwrite d1/dd/d3d/f3f [0,4194304] 0 2024-09-12T22:49:54.946 INFO:tasks.workunit.client.0.smithi066.stdout:2/282: chown d1/dd/l10 774409397 1 2024-09-12T22:49:54.946 INFO:tasks.workunit.client.0.smithi066.stdout:7/293: write d0/d19/d24/d33/d27/f35 [239765,97931] 0 2024-09-12T22:49:54.948 INFO:tasks.workunit.client.0.smithi066.stdout:6/313: creat d6/d20/d50/f63 x:0 0 0 2024-09-12T22:49:54.948 INFO:tasks.workunit.client.0.smithi066.stdout:3/266: truncate d0/d2/d6/d33/d49/f5a 1872743 0 2024-09-12T22:49:54.948 INFO:tasks.workunit.client.0.smithi066.stdout:2/283: mknod d1/dd/d12/d18/c5e 0 2024-09-12T22:49:54.948 INFO:tasks.workunit.client.0.smithi066.stdout:8/294: link c14 d17/d49/c59 0 2024-09-12T22:49:54.949 INFO:tasks.workunit.client.0.smithi066.stdout:8/295: creat d17/d1b/f5a x:0 0 0 2024-09-12T22:49:54.949 INFO:tasks.workunit.client.0.smithi066.stdout:2/284: mkdir d1/d11/d26/d4f/d5f 0 2024-09-12T22:49:54.950 INFO:tasks.workunit.client.0.smithi066.stdout:2/285: truncate d1/dd/d12/f21 1585607 0 2024-09-12T22:49:54.950 INFO:tasks.workunit.client.0.smithi066.stdout:8/296: rename d17/l28 to d17/d49/d4b/d4e/l5b 0 2024-09-12T22:49:54.951 INFO:tasks.workunit.client.0.smithi066.stdout:2/286: truncate d1/f3 3259930 0 2024-09-12T22:49:54.953 INFO:tasks.workunit.client.0.smithi066.stdout:8/297: write f16 [3807640,85955] 0 2024-09-12T22:49:54.954 INFO:tasks.workunit.client.0.smithi066.stdout:8/298: mknod d17/d40/d47/c5c 0 2024-09-12T22:49:54.956 INFO:tasks.workunit.client.0.smithi066.stdout:6/314: dread d6/fb [4194304,4194304] 0 2024-09-12T22:49:54.956 INFO:tasks.workunit.client.0.smithi066.stdout:8/299: read d17/d1b/f2e [175441,84094] 0 2024-09-12T22:49:54.957 INFO:tasks.workunit.client.0.smithi066.stdout:2/287: dwrite d1/d11/f16 [0,4194304] 0 2024-09-12T22:49:54.957 INFO:tasks.workunit.client.0.smithi066.stdout:2/288: chown d1/d2a/l37 21433 1 2024-09-12T22:49:54.958 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:54.957+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:54.958 INFO:tasks.workunit.client.0.smithi066.stdout:6/315: getdents d6/d20 0 2024-09-12T22:49:54.958 INFO:tasks.workunit.client.0.smithi066.stdout:8/300: link d17/d1b/l4a d17/d49/l5d 0 2024-09-12T22:49:54.960 INFO:tasks.workunit.client.0.smithi066.stdout:6/316: rename d6/d49/d33 to d6/d51/d64 0 2024-09-12T22:49:54.960 INFO:tasks.workunit.client.0.smithi066.stdout:8/301: chown d17/d2c/c2f 1069528 1 2024-09-12T22:49:54.960 INFO:tasks.workunit.client.0.smithi066.stdout:8/302: readlink l5 0 2024-09-12T22:49:54.961 INFO:tasks.workunit.client.0.smithi066.stdout:6/317: creat d6/d20/f65 x:0 0 0 2024-09-12T22:49:54.961 INFO:tasks.workunit.client.0.smithi066.stdout:6/318: mkdir d6/d7/d66 0 2024-09-12T22:49:54.961 INFO:tasks.workunit.client.0.smithi066.stdout:2/289: dread d1/d11/f25 [0,4194304] 0 2024-09-12T22:49:54.962 INFO:tasks.workunit.client.0.smithi066.stdout:2/290: chown d1/d11/d57 5 1 2024-09-12T22:49:54.962 INFO:tasks.workunit.client.0.smithi066.stdout:2/291: chown d1/dd/d12 361 1 2024-09-12T22:49:54.963 INFO:tasks.workunit.client.0.smithi066.stdout:2/292: creat d1/db/d42/d43/d47/f60 x:0 0 0 2024-09-12T22:49:54.965 INFO:tasks.workunit.client.0.smithi066.stdout:8/303: dwrite d17/d1b/f30 [0,4194304] 0 2024-09-12T22:49:54.966 INFO:tasks.workunit.client.0.smithi066.stdout:6/319: write d6/d23/d25/f57 [613137,92732] 0 2024-09-12T22:49:54.967 INFO:tasks.workunit.client.0.smithi066.stdout:8/304: write d17/d1b/f1e [4110104,53738] 0 2024-09-12T22:49:54.968 INFO:tasks.workunit.client.0.smithi066.stdout:6/320: getdents d6/d51/d64/d4a 0 2024-09-12T22:49:54.969 INFO:tasks.workunit.client.0.smithi066.stdout:8/305: mkdir d17/d49/d4b/d57/d5e 0 2024-09-12T22:49:54.969 INFO:tasks.workunit.client.0.smithi066.stdout:6/321: write d6/d7/dc/f43 [1402794,103588] 0 2024-09-12T22:49:54.970 INFO:tasks.workunit.client.0.smithi066.stdout:2/293: dwrite d1/dd/d12/f21 [0,4194304] 0 2024-09-12T22:49:54.971 INFO:tasks.workunit.client.0.smithi066.stdout:8/306: creat d17/d49/d4b/d57/d5e/f5f x:0 0 0 2024-09-12T22:49:54.973 INFO:tasks.workunit.client.0.smithi066.stdout:8/307: creat d17/d49/d4b/d57/f60 x:0 0 0 2024-09-12T22:49:54.973 INFO:tasks.workunit.client.0.smithi066.stdout:8/308: fsync d17/d1b/f5a 0 2024-09-12T22:49:54.975 INFO:tasks.workunit.client.0.smithi066.stdout:6/322: dread d6/f4b [0,4194304] 0 2024-09-12T22:49:54.975 INFO:tasks.workunit.client.0.smithi066.stdout:9/290: dread f7 [0,4194304] 0 2024-09-12T22:49:54.976 INFO:tasks.workunit.client.0.smithi066.stdout:2/294: dwrite d1/db/f5d [0,4194304] 0 2024-09-12T22:49:54.976 INFO:tasks.workunit.client.0.smithi066.stdout:6/323: symlink d6/d23/d41/l67 0 2024-09-12T22:49:54.978 INFO:tasks.workunit.client.0.smithi066.stdout:8/309: dread d17/d1b/f30 [0,4194304] 0 2024-09-12T22:49:54.978 INFO:tasks.workunit.client.0.smithi066.stdout:9/291: mkdir d9/dc/d36/d5b 0 2024-09-12T22:49:54.978 INFO:tasks.workunit.client.0.smithi066.stdout:2/295: mkdir d1/d11/d26/d4f/d5f/d61 0 2024-09-12T22:49:54.979 INFO:tasks.workunit.client.0.smithi066.stdout:6/324: creat d6/d20/d32/f68 x:0 0 0 2024-09-12T22:49:54.979 INFO:tasks.workunit.client.0.smithi066.stdout:8/310: symlink d17/l61 0 2024-09-12T22:49:54.980 INFO:tasks.workunit.client.0.smithi066.stdout:9/292: symlink d9/d31/d34/l5c 0 2024-09-12T22:49:54.980 INFO:tasks.workunit.client.0.smithi066.stdout:2/296: symlink d1/l62 0 2024-09-12T22:49:54.981 INFO:tasks.workunit.client.0.smithi066.stdout:7/294: dread d0/f5 [0,4194304] 0 2024-09-12T22:49:54.981 INFO:tasks.workunit.client.0.smithi066.stdout:8/311: chown d17/d2c/l3e 0 1 2024-09-12T22:49:54.981 INFO:tasks.workunit.client.0.smithi066.stdout:6/325: mkdir d6/d23/d25/d2c/d69 0 2024-09-12T22:49:54.981 INFO:tasks.workunit.client.0.smithi066.stdout:2/297: rmdir d1/db/d42 39 2024-09-12T22:49:54.981 INFO:tasks.workunit.client.0.smithi066.stdout:3/267: dread d0/d2/d7/f1a [0,4194304] 0 2024-09-12T22:49:54.982 INFO:tasks.workunit.client.0.smithi066.stdout:5/365: sync 2024-09-12T22:49:54.982 INFO:tasks.workunit.client.0.smithi066.stdout:9/293: truncate d9/dc/d36/f43 894334 0 2024-09-12T22:49:54.982 INFO:tasks.workunit.client.0.smithi066.stdout:7/295: read - d0/f4b zero size 2024-09-12T22:49:54.982 INFO:tasks.workunit.client.0.smithi066.stdout:5/366: chown d5/c29 26 1 2024-09-12T22:49:54.983 INFO:tasks.workunit.client.0.smithi066.stdout:9/294: fsync d9/dc/dd/f54 0 2024-09-12T22:49:54.983 INFO:tasks.workunit.client.0.smithi066.stdout:8/312: mkdir d17/d49/d4b/d57/d5e/d62 0 2024-09-12T22:49:54.983 INFO:tasks.workunit.client.0.smithi066.stdout:2/298: creat d1/dd/f63 x:0 0 0 2024-09-12T22:49:54.983 INFO:tasks.workunit.client.0.smithi066.stdout:3/268: creat d0/d2/d6/d33/f65 x:0 0 0 2024-09-12T22:49:54.984 INFO:tasks.workunit.client.0.smithi066.stdout:6/326: rename d6/d20/d32/f56 to d6/d23/d25/d2c/d69/f6a 0 2024-09-12T22:49:54.984 INFO:tasks.workunit.client.0.smithi066.stdout:8/313: mknod d17/d40/c63 0 2024-09-12T22:49:54.984 INFO:tasks.workunit.client.0.smithi066.stdout:5/367: creat d5/d11/d21/d4d/f6d x:0 0 0 2024-09-12T22:49:54.984 INFO:tasks.workunit.client.0.smithi066.stdout:9/295: mknod d9/d31/d34/c5d 0 2024-09-12T22:49:54.984 INFO:tasks.workunit.client.0.smithi066.stdout:3/269: creat d0/d2/d7/f66 x:0 0 0 2024-09-12T22:49:54.984 INFO:tasks.workunit.client.0.smithi066.stdout:7/296: rename d0/d19/d24/d33/f5f to d0/d19/d26/d5a/f61 0 2024-09-12T22:49:54.984 INFO:tasks.workunit.client.0.smithi066.stdout:8/314: fdatasync d17/f27 0 2024-09-12T22:49:54.985 INFO:tasks.workunit.client.0.smithi066.stdout:9/296: creat d9/d31/f5e x:0 0 0 2024-09-12T22:49:54.985 INFO:tasks.workunit.client.0.smithi066.stdout:5/368: truncate d5/d15/f2c 861533 0 2024-09-12T22:49:54.986 INFO:tasks.workunit.client.0.smithi066.stdout:6/327: link d6/d23/c2b d6/d7/d66/c6b 0 2024-09-12T22:49:54.986 INFO:tasks.workunit.client.0.smithi066.stdout:8/315: read d17/d2c/f32 [543790,8789] 0 2024-09-12T22:49:54.986 INFO:tasks.workunit.client.0.smithi066.stdout:5/369: read - d5/f3f zero size 2024-09-12T22:49:54.987 INFO:tasks.workunit.client.0.smithi066.stdout:9/297: creat d9/dc/dd/f5f x:0 0 0 2024-09-12T22:49:54.988 INFO:tasks.workunit.client.0.smithi066.stdout:5/370: write f4 [3831829,115292] 0 2024-09-12T22:49:54.988 INFO:tasks.workunit.client.0.smithi066.stdout:8/316: write d17/d40/d47/d4d/f50 [4914902,2774] 0 2024-09-12T22:49:54.989 INFO:tasks.workunit.client.0.smithi066.stdout:9/298: creat d9/dc/f60 x:0 0 0 2024-09-12T22:49:54.989 INFO:tasks.workunit.client.0.smithi066.stdout:5/371: write d5/d15/f2c [1378016,64374] 0 2024-09-12T22:49:54.990 INFO:tasks.workunit.client.0.smithi066.stdout:3/270: dread d0/d2/d7/d29/f42 [0,4194304] 0 2024-09-12T22:49:54.990 INFO:tasks.workunit.client.0.smithi066.stdout:6/328: truncate d6/d20/f18 2762872 0 2024-09-12T22:49:54.990 INFO:tasks.workunit.client.0.smithi066.stdout:8/317: write d17/d40/d47/d4d/f50 [755508,50405] 0 2024-09-12T22:49:54.990 INFO:tasks.workunit.client.0.smithi066.stdout:5/372: chown d5/c13 53771 1 2024-09-12T22:49:54.991 INFO:tasks.workunit.client.0.smithi066.stdout:7/297: dwrite d0/d6/f21 [0,4194304] 0 2024-09-12T22:49:54.993 INFO:tasks.workunit.client.0.smithi066.stdout:8/318: symlink d17/d49/d4b/d57/l64 0 2024-09-12T22:49:54.993 INFO:tasks.workunit.client.0.smithi066.stdout:7/298: mknod d0/d19/d60/d53/c62 0 2024-09-12T22:49:54.994 INFO:tasks.workunit.client.0.smithi066.stdout:7/299: rmdir d0/d19 39 2024-09-12T22:49:54.997 INFO:tasks.workunit.client.0.smithi066.stdout:5/373: write d5/f24 [388081,14119] 0 2024-09-12T22:49:54.997 INFO:tasks.workunit.client.0.smithi066.stdout:6/329: dwrite d6/f2a [0,4194304] 0 2024-09-12T22:49:54.997 INFO:tasks.workunit.client.0.smithi066.stdout:7/300: write d0/d19/d24/d33/f34 [663413,106492] 0 2024-09-12T22:49:54.997 INFO:tasks.workunit.client.0.smithi066.stdout:3/271: dwrite d0/d2/d7/d13/d43/f4c [0,4194304] 0 2024-09-12T22:49:54.998 INFO:tasks.workunit.client.0.smithi066.stdout:8/319: dread d17/d2c/f37 [0,4194304] 0 2024-09-12T22:49:54.999 INFO:tasks.workunit.client.0.smithi066.stdout:7/301: read d0/d19/d60/f40 [1375155,68428] 0 2024-09-12T22:49:55.002 INFO:tasks.workunit.client.0.smithi066.stdout:5/374: rename d5/d15/l3c to d5/l6e 0 2024-09-12T22:49:55.002 INFO:tasks.workunit.client.0.smithi066.stdout:7/302: symlink d0/d19/d24/d33/l63 0 2024-09-12T22:49:55.002 INFO:tasks.workunit.client.0.smithi066.stdout:6/330: dread d6/d7/f11 [0,4194304] 0 2024-09-12T22:49:55.002 INFO:tasks.workunit.client.0.smithi066.stdout:5/375: unlink d5/d14/f28 0 2024-09-12T22:49:55.003 INFO:tasks.workunit.client.0.smithi066.stdout:6/331: creat d6/d20/d50/f6c x:0 0 0 2024-09-12T22:49:55.003 INFO:tasks.workunit.client.0.smithi066.stdout:3/272: link d0/d2/d7/c17 d0/d2/d6/d33/d40/d44/c67 0 2024-09-12T22:49:55.004 INFO:tasks.workunit.client.0.smithi066.stdout:6/332: symlink d6/d51/d64/d4a/l6d 0 2024-09-12T22:49:55.005 INFO:tasks.workunit.client.0.smithi066.stdout:1/261: sync 2024-09-12T22:49:55.005 INFO:tasks.workunit.client.0.smithi066.stdout:0/301: sync 2024-09-12T22:49:55.005 INFO:tasks.workunit.client.0.smithi066.stdout:4/282: sync 2024-09-12T22:49:55.005 INFO:tasks.workunit.client.0.smithi066.stdout:2/299: sync 2024-09-12T22:49:55.006 INFO:tasks.workunit.client.0.smithi066.stdout:4/283: chown d5/d8/d10 33217 1 2024-09-12T22:49:55.006 INFO:tasks.workunit.client.0.smithi066.stdout:3/273: mkdir d0/d2/d68 0 2024-09-12T22:49:55.006 INFO:tasks.workunit.client.0.smithi066.stdout:6/333: creat d6/d59/f6e x:0 0 0 2024-09-12T22:49:55.006 INFO:tasks.workunit.client.0.smithi066.stdout:2/300: creat d1/d2a/f64 x:0 0 0 2024-09-12T22:49:55.008 INFO:tasks.workunit.client.0.smithi066.stdout:3/274: fdatasync d0/d2/d6/d33/d49/f5a 0 2024-09-12T22:49:55.009 INFO:tasks.workunit.client.0.smithi066.stdout:5/376: dwrite d5/d14/f69 [0,4194304] 0 2024-09-12T22:49:55.009 INFO:tasks.workunit.client.0.smithi066.stdout:4/284: rename d5/c2a to d5/d8/d16/d1b/c5f 0 2024-09-12T22:49:55.012 INFO:tasks.workunit.client.0.smithi066.stdout:6/334: rename d6/d20/d50/f63 to d6/d23/d25/f6f 0 2024-09-12T22:49:55.012 INFO:tasks.workunit.client.0.smithi066.stdout:3/275: symlink d0/d2/d7/d13/d31/l69 0 2024-09-12T22:49:55.012 INFO:tasks.workunit.client.0.smithi066.stdout:4/285: mkdir d5/d8/d60 0 2024-09-12T22:49:55.012 INFO:tasks.workunit.client.0.smithi066.stdout:0/302: dwrite d1/d8/d1f/d30/f55 [0,4194304] 0 2024-09-12T22:49:55.013 INFO:tasks.workunit.client.0.smithi066.stdout:3/276: readlink d0/d2/d7/d13/d31/l69 0 2024-09-12T22:49:55.014 INFO:tasks.workunit.client.0.smithi066.stdout:4/286: mkdir d5/d8/d10/de/d39/d61 0 2024-09-12T22:49:55.014 INFO:tasks.workunit.client.0.smithi066.stdout:0/303: fdatasync d1/d8/d1c/d13/d2f/f4a 0 2024-09-12T22:49:55.017 INFO:tasks.workunit.client.0.smithi066.stdout:3/277: truncate d0/d2/d7/d13/d43/f50 375029 0 2024-09-12T22:49:55.019 INFO:tasks.workunit.client.0.smithi066.stdout:5/377: dwrite d5/d11/d21/f47 [0,4194304] 0 2024-09-12T22:49:55.019 INFO:tasks.workunit.client.0.smithi066.stdout:6/335: dread d6/f4b [0,4194304] 0 2024-09-12T22:49:55.022 INFO:tasks.workunit.client.0.smithi066.stdout:3/278: rename d0/d2/d6/fd to d0/d2/d7/d29/f6a 0 2024-09-12T22:49:55.022 INFO:tasks.workunit.client.0.smithi066.stdout:5/378: mkdir d5/d11/d23/d6f 0 2024-09-12T22:49:55.023 INFO:tasks.workunit.client.0.smithi066.stdout:4/287: dwrite d5/d8/d10/f1a [0,4194304] 0 2024-09-12T22:49:55.024 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:55.024 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:55.025 INFO:tasks.workunit.client.0.smithi066.stdout:8/320: dread f15 [0,4194304] 0 2024-09-12T22:49:55.025 INFO:tasks.workunit.client.0.smithi066.stdout:3/279: mkdir d0/d2/d6/d33/d6b 0 2024-09-12T22:49:55.027 INFO:tasks.workunit.client.0.smithi066.stdout:5/379: truncate d5/d11/d23/f2f 3683986 0 2024-09-12T22:49:55.027 INFO:tasks.workunit.client.0.smithi066.stdout:3/280: mknod d0/d1b/c6c 0 2024-09-12T22:49:55.027 INFO:tasks.workunit.client.0.smithi066.stdout:0/304: dwrite d1/d8/d1f/d30/f3d [4194304,4194304] 0 2024-09-12T22:49:55.028 INFO:tasks.workunit.client.0.smithi066.stdout:8/321: mkdir d17/d49/d4b/d57/d5e/d65 0 2024-09-12T22:49:55.029 INFO:tasks.workunit.client.0.smithi066.stdout:0/305: creat d1/d8/d1f/d30/f70 x:0 0 0 2024-09-12T22:49:55.029 INFO:tasks.workunit.client.0.smithi066.stdout:3/281: mkdir d0/d2/d7/d13/d31/d6d 0 2024-09-12T22:49:55.030 INFO:tasks.workunit.client.0.smithi066.stdout:6/336: dwrite d6/d20/d50/f5d [0,4194304] 0 2024-09-12T22:49:55.030 INFO:tasks.workunit.client.0.smithi066.stdout:4/288: dread d5/d8/d16/d1b/d1e/f55 [0,4194304] 0 2024-09-12T22:49:55.030 INFO:tasks.workunit.client.0.smithi066.stdout:8/322: mkdir d17/d40/d47/d66 0 2024-09-12T22:49:55.032 INFO:tasks.workunit.client.0.smithi066.stdout:4/289: rename d5/d8/d10 to d5/d8/d10/d62 22 2024-09-12T22:49:55.033 INFO:tasks.workunit.client.0.smithi066.stdout:0/306: write d1/f2a [88366,90868] 0 2024-09-12T22:49:55.033 INFO:tasks.workunit.client.0.smithi066.stdout:8/323: truncate d17/d40/f4c 1868166 0 2024-09-12T22:49:55.033 INFO:tasks.workunit.client.0.smithi066.stdout:6/337: truncate d6/d7/dc/f5c 833700 0 2024-09-12T22:49:55.035 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:55.036 INFO:tasks.workunit.client.0.smithi066.stdout:6/338: creat d6/d49/f70 x:0 0 0 2024-09-12T22:49:55.036 INFO:tasks.workunit.client.0.smithi066.stdout:9/299: sync 2024-09-12T22:49:55.036 INFO:tasks.workunit.client.0.smithi066.stdout:5/380: dwrite d5/de/d50/d42/d49/f6b [0,4194304] 0 2024-09-12T22:49:55.037 INFO:tasks.workunit.client.0.smithi066.stdout:4/290: getdents d5/d8/d16/d1b/d1e/d1f 0 2024-09-12T22:49:55.038 INFO:tasks.workunit.client.0.smithi066.stdout:6/339: write d6/d7/f11 [2413046,57332] 0 2024-09-12T22:49:55.039 INFO:tasks.workunit.client.0.smithi066.stdout:5/381: symlink d5/d11/d5d/d64/l70 0 2024-09-12T22:49:55.039 INFO:tasks.workunit.client.0.smithi066.stdout:4/291: mknod d5/d8/c63 0 2024-09-12T22:49:55.039 INFO:tasks.workunit.client.0.smithi066.stdout:9/300: rmdir d9/dc/d36/d5b 0 2024-09-12T22:49:55.040 INFO:tasks.workunit.client.0.smithi066.stdout:8/324: dwrite f16 [4194304,4194304] 0 2024-09-12T22:49:55.040 INFO:tasks.workunit.client.0.smithi066.stdout:6/340: mknod d6/d23/d25/c71 0 2024-09-12T22:49:55.041 INFO:tasks.workunit.client.0.smithi066.stdout:5/382: creat d5/d15/f71 x:0 0 0 2024-09-12T22:49:55.042 INFO:tasks.workunit.client.0.smithi066.stdout:8/325: fdatasync d17/d1b/f1e 0 2024-09-12T22:49:55.042 INFO:tasks.workunit.client.0.smithi066.stdout:0/307: truncate d1/f1a 2072878 0 2024-09-12T22:49:55.042 INFO:tasks.workunit.client.0.smithi066.stdout:4/292: mkdir d5/d8/d10/de/d2d/d64 0 2024-09-12T22:49:55.042 INFO:tasks.workunit.client.0.smithi066.stdout:6/341: fdatasync d6/d51/d64/f3f 0 2024-09-12T22:49:55.042 INFO:tasks.workunit.client.0.smithi066.stdout:8/326: stat d17/d1b/f23 0 2024-09-12T22:49:55.043 INFO:tasks.workunit.client.0.smithi066.stdout:6/342: mknod d6/d23/d25/c72 0 2024-09-12T22:49:55.043 INFO:tasks.workunit.client.0.smithi066.stdout:0/308: creat d1/d8/d1f/d25/f71 x:0 0 0 2024-09-12T22:49:55.043 INFO:tasks.workunit.client.0.smithi066.stdout:4/293: mkdir d5/d3e/d65 0 2024-09-12T22:49:55.044 INFO:tasks.workunit.client.0.smithi066.stdout:4/294: chown d5/d3e/d65 6659369 1 2024-09-12T22:49:55.045 INFO:tasks.workunit.client.0.smithi066.stdout:1/262: dread d0/dc/f17 [4194304,4194304] 0 2024-09-12T22:49:55.045 INFO:tasks.workunit.client.0.smithi066.stdout:6/343: creat d6/d23/d25/d4e/f73 x:0 0 0 2024-09-12T22:49:55.045 INFO:tasks.workunit.client.0.smithi066.stdout:0/309: symlink d1/d8/d1b/d59/l72 0 2024-09-12T22:49:55.045 INFO:tasks.workunit.client.0.smithi066.stdout:9/301: truncate d9/dc/f28 3516897 0 2024-09-12T22:49:55.046 INFO:tasks.workunit.client.0.smithi066.stdout:6/344: symlink d6/d7/dc/l74 0 2024-09-12T22:49:55.047 INFO:tasks.workunit.client.0.smithi066.stdout:5/383: dread d5/de/d50/d42/d49/f6b [0,4194304] 0 2024-09-12T22:49:55.047 INFO:tasks.workunit.client.0.smithi066.stdout:1/263: mknod d0/d9/d21/c4c 0 2024-09-12T22:49:55.047 INFO:tasks.workunit.client.0.smithi066.stdout:9/302: read d9/dc/dd/f50 [1735944,22635] 0 2024-09-12T22:49:55.047 INFO:tasks.workunit.client.0.smithi066.stdout:4/295: rename d5/d8/d10/de/d39/l4c to d5/d3e/d65/l66 0 2024-09-12T22:49:55.048 INFO:tasks.workunit.client.0.smithi066.stdout:6/345: mknod d6/d51/d64/c75 0 2024-09-12T22:49:55.048 INFO:tasks.workunit.client.0.smithi066.stdout:5/384: chown d5/de/d50/d42/f48 15728 1 2024-09-12T22:49:55.048 INFO:tasks.workunit.client.0.smithi066.stdout:9/303: mknod d9/dc/d36/c61 0 2024-09-12T22:49:55.049 INFO:tasks.workunit.client.0.smithi066.stdout:4/296: getdents d5/d8/d60 0 2024-09-12T22:49:55.049 INFO:tasks.workunit.client.0.smithi066.stdout:1/264: rename d0/f2e to d0/d9/f4d 0 2024-09-12T22:49:55.050 INFO:tasks.workunit.client.0.smithi066.stdout:9/304: rmdir d9/dc/dd 39 2024-09-12T22:49:55.051 INFO:tasks.workunit.client.0.smithi066.stdout:9/305: dread - d9/dc/d23/f45 zero size 2024-09-12T22:49:55.052 INFO:tasks.workunit.client.0.smithi066.stdout:0/310: dwrite d1/d8/f62 [0,4194304] 0 2024-09-12T22:49:55.054 INFO:tasks.workunit.client.0.smithi066.stdout:6/346: truncate d6/f4b 1477547 0 2024-09-12T22:49:55.054 INFO:tasks.workunit.client.0.smithi066.stdout:5/385: truncate d5/d11/f1b 4583801 0 2024-09-12T22:49:55.054 INFO:tasks.workunit.client.0.smithi066.stdout:9/306: creat d9/dc/d36/f62 x:0 0 0 2024-09-12T22:49:55.054 INFO:tasks.workunit.client.0.smithi066.stdout:0/311: link d1/d8/d1c/dd/f28 d1/f73 0 2024-09-12T22:49:55.054 INFO:tasks.workunit.client.0.smithi066.stdout:9/307: rmdir d9/d31/d34/d4d 39 2024-09-12T22:49:55.055 INFO:tasks.workunit.client.0.smithi066.stdout:6/347: link d6/l28 d6/d23/d25/l76 0 2024-09-12T22:49:55.055 INFO:tasks.workunit.client.0.smithi066.stdout:6/348: chown d6/d23/d41 704 1 2024-09-12T22:49:55.056 INFO:tasks.workunit.client.0.smithi066.stdout:9/308: creat d9/dc/d36/f63 x:0 0 0 2024-09-12T22:49:55.056 INFO:tasks.workunit.client.0.smithi066.stdout:0/312: truncate d1/d8/d1f/d25/f71 587947 0 2024-09-12T22:49:55.057 INFO:tasks.workunit.client.0.smithi066.stdout:6/349: getdents d6 0 2024-09-12T22:49:55.057 INFO:tasks.workunit.client.0.smithi066.stdout:0/313: getdents d1/d36/d65 0 2024-09-12T22:49:55.057 INFO:tasks.workunit.client.0.smithi066.stdout:3/282: sync 2024-09-12T22:49:55.057 INFO:tasks.workunit.client.0.smithi066.stdout:2/301: sync 2024-09-12T22:49:55.058 INFO:tasks.workunit.client.0.smithi066.stdout:6/350: stat d6/d7/f11 0 2024-09-12T22:49:55.058 INFO:tasks.workunit.client.0.smithi066.stdout:0/314: symlink d1/d8/d1b/d59/l74 0 2024-09-12T22:49:55.059 INFO:tasks.workunit.client.0.smithi066.stdout:6/351: creat d6/d59/f77 x:0 0 0 2024-09-12T22:49:55.059 INFO:tasks.workunit.client.0.smithi066.stdout:3/283: write d0/d1b/f45 [3252378,5985] 0 2024-09-12T22:49:55.060 INFO:tasks.workunit.client.0.smithi066.stdout:0/315: stat d1/d8/d1f/d30/c53 0 2024-09-12T22:49:55.060 INFO:tasks.workunit.client.0.smithi066.stdout:6/352: rename d6/d51/d64 to d6/d78 0 2024-09-12T22:49:55.060 INFO:tasks.workunit.client.0.smithi066.stdout:0/316: fdatasync d1/f10 0 2024-09-12T22:49:55.061 INFO:tasks.workunit.client.0.smithi066.stdout:3/284: write d0/d2/d6/d33/d40/f48 [3244917,67434] 0 2024-09-12T22:49:55.062 INFO:tasks.workunit.client.0.smithi066.stdout:7/303: dread d0/d19/d26/f28 [0,4194304] 0 2024-09-12T22:49:55.062 INFO:tasks.workunit.client.0.smithi066.stdout:3/285: creat d0/d2/f6e x:0 0 0 2024-09-12T22:49:55.066 INFO:tasks.workunit.client.0.smithi066.stdout:3/286: dwrite d0/f38 [0,4194304] 0 2024-09-12T22:49:55.066 INFO:tasks.workunit.client.0.smithi066.stdout:2/302: truncate d1/d2a/f34 2033579 0 2024-09-12T22:49:55.068 INFO:tasks.workunit.client.0.smithi066.stdout:3/287: symlink d0/d2/d7/d13/d31/l6f 0 2024-09-12T22:49:55.068 INFO:tasks.workunit.client.0.smithi066.stdout:6/353: chown d6/d23/c2b 891035 1 2024-09-12T22:49:55.069 INFO:tasks.workunit.client.0.smithi066.stdout:3/288: creat d0/d2/d6/d33/f70 x:0 0 0 2024-09-12T22:49:55.069 INFO:tasks.workunit.client.0.smithi066.stdout:6/354: chown d6/d59/l5b 0 1 2024-09-12T22:49:55.069 INFO:tasks.workunit.client.0.smithi066.stdout:6/355: unlink d6/d23/d25/f57 0 2024-09-12T22:49:55.071 INFO:tasks.workunit.client.0.smithi066.stdout:6/356: stat d6/d7/dc/f21 0 2024-09-12T22:49:55.076 INFO:tasks.workunit.client.0.smithi066.stdout:3/289: dwrite d0/d2/f24 [0,4194304] 0 2024-09-12T22:49:55.076 INFO:tasks.workunit.client.0.smithi066.stdout:8/327: dread d17/d2c/f34 [0,4194304] 0 2024-09-12T22:49:55.077 INFO:tasks.workunit.client.0.smithi066.stdout:5/386: sync 2024-09-12T22:49:55.077 INFO:tasks.workunit.client.0.smithi066.stdout:7/304: sync 2024-09-12T22:49:55.077 INFO:tasks.workunit.client.0.smithi066.stdout:0/317: sync 2024-09-12T22:49:55.078 INFO:tasks.workunit.client.0.smithi066.stdout:2/303: dwrite d1/db/d42/d43/d47/f60 [0,4194304] 0 2024-09-12T22:49:55.078 INFO:tasks.workunit.client.0.smithi066.stdout:6/357: dread d6/f2a [0,4194304] 0 2024-09-12T22:49:55.080 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:55.079+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:55.081 INFO:tasks.workunit.client.0.smithi066.stdout:6/358: chown d6/d7/l14 2 1 2024-09-12T22:49:55.083 INFO:tasks.workunit.client.0.smithi066.stdout:2/304: creat d1/d11/d26/d4f/d52/d56/f65 x:0 0 0 2024-09-12T22:49:55.086 INFO:tasks.workunit.client.0.smithi066.stdout:6/359: mkdir d6/d23/d62/d79 0 2024-09-12T22:49:55.087 INFO:tasks.workunit.client.0.smithi066.stdout:4/297: dread d5/d8/d10/f40 [0,4194304] 0 2024-09-12T22:49:55.090 INFO:tasks.workunit.client.0.smithi066.stdout:8/328: dwrite d17/d1b/f1e [0,4194304] 0 2024-09-12T22:49:55.093 INFO:tasks.workunit.client.0.smithi066.stdout:1/265: dread d0/dc/d1d/f24 [0,4194304] 0 2024-09-12T22:49:55.094 INFO:tasks.workunit.client.0.smithi066.stdout:0/318: dwrite d1/d8/d1b/f24 [0,4194304] 0 2024-09-12T22:49:55.094 INFO:tasks.workunit.client.0.smithi066.stdout:3/290: dwrite d0/d2/d6/f18 [0,4194304] 0 2024-09-12T22:49:55.094 INFO:tasks.workunit.client.0.smithi066.stdout:7/305: dwrite d0/f4b [0,4194304] 0 2024-09-12T22:49:55.094 INFO:tasks.workunit.client.0.smithi066.stdout:8/329: readlink d17/d2c/l51 0 2024-09-12T22:49:55.094 INFO:tasks.workunit.client.0.smithi066.stdout:5/387: dwrite d5/d11/d21/d4d/f6d [0,4194304] 0 2024-09-12T22:49:55.094 INFO:tasks.workunit.client.0.smithi066.stdout:9/309: dread d9/dc/dd/f1d [0,4194304] 0 2024-09-12T22:49:55.094 INFO:tasks.workunit.client.0.smithi066.stdout:4/298: unlink d5/d8/d16/d1b/d1e/f5b 0 2024-09-12T22:49:55.095 INFO:tasks.workunit.client.0.smithi066.stdout:5/388: chown d5/d11/d21/c26 1614 1 2024-09-12T22:49:55.095 INFO:tasks.workunit.client.0.smithi066.stdout:0/319: write d1/d8/d1b/f24 [5033043,27086] 0 2024-09-12T22:49:55.095 INFO:tasks.workunit.client.0.smithi066.stdout:3/291: write d0/d2/d7/f5e [709970,115675] 0 2024-09-12T22:49:55.095 INFO:tasks.workunit.client.0.smithi066.stdout:7/306: mkdir d0/d19/d60/d64 0 2024-09-12T22:49:55.096 INFO:tasks.workunit.client.0.smithi066.stdout:9/310: mknod d9/c64 0 2024-09-12T22:49:55.096 INFO:tasks.workunit.client.0.smithi066.stdout:5/389: chown d5/de/d50/d42/d49 900581 1 2024-09-12T22:49:55.096 INFO:tasks.workunit.client.0.smithi066.stdout:4/299: creat d5/d8/d16/d1b/d1e/d5a/f67 x:0 0 0 2024-09-12T22:49:55.096 INFO:tasks.workunit.client.0.smithi066.stdout:3/292: mknod d0/d2/d68/c71 0 2024-09-12T22:49:55.097 INFO:tasks.workunit.client.0.smithi066.stdout:0/320: chown d1/d8/d1f/d25/c54 1373 1 2024-09-12T22:49:55.097 INFO:tasks.workunit.client.0.smithi066.stdout:2/305: truncate d1/db/f5d 1542948 0 2024-09-12T22:49:55.097 INFO:tasks.workunit.client.0.smithi066.stdout:9/311: creat d9/dc/dd/f65 x:0 0 0 2024-09-12T22:49:55.098 INFO:tasks.workunit.client.0.smithi066.stdout:9/312: sync 2024-09-12T22:49:55.098 INFO:tasks.workunit.client.0.smithi066.stdout:6/360: truncate d6/d23/d25/f2e 25587 0 2024-09-12T22:49:55.098 INFO:tasks.workunit.client.0.smithi066.stdout:5/390: creat d5/d11/d21/d4d/f72 x:0 0 0 2024-09-12T22:49:55.099 INFO:tasks.workunit.client.0.smithi066.stdout:3/293: creat d0/d1b/f72 x:0 0 0 2024-09-12T22:49:55.099 INFO:tasks.workunit.client.0.smithi066.stdout:2/306: dread - d1/d2a/f64 zero size 2024-09-12T22:49:55.101 INFO:tasks.workunit.client.0.smithi066.stdout:0/321: symlink d1/d5b/d6d/l75 0 2024-09-12T22:49:55.101 INFO:tasks.workunit.client.0.smithi066.stdout:9/313: write d9/dc/f52 [344936,39838] 0 2024-09-12T22:49:55.102 INFO:tasks.workunit.client.0.smithi066.stdout:4/300: symlink d5/d8/d10/de/d2d/d64/l68 0 2024-09-12T22:49:55.102 INFO:tasks.workunit.client.0.smithi066.stdout:5/391: chown d5/de/d50/d42/f48 16458553 1 2024-09-12T22:49:55.103 INFO:tasks.workunit.client.0.smithi066.stdout:1/266: dwrite d0/dc/f22 [0,4194304] 0 2024-09-12T22:49:55.103 INFO:tasks.workunit.client.0.smithi066.stdout:6/361: write d6/d7/f11 [2062794,83931] 0 2024-09-12T22:49:55.103 INFO:tasks.workunit.client.0.smithi066.stdout:3/294: stat d0/d2/d6/d33/d6b 0 2024-09-12T22:49:55.104 INFO:tasks.workunit.client.0.smithi066.stdout:4/301: rmdir d5/d8/d10 39 2024-09-12T22:49:55.104 INFO:tasks.workunit.client.0.smithi066.stdout:5/392: write d5/f12 [1837400,46869] 0 2024-09-12T22:49:55.105 INFO:tasks.workunit.client.0.smithi066.stdout:0/322: mknod d1/d8/d1c/d56/c76 0 2024-09-12T22:49:55.105 INFO:tasks.workunit.client.0.smithi066.stdout:9/314: creat d9/dc/d4e/f66 x:0 0 0 2024-09-12T22:49:55.106 INFO:tasks.workunit.client.0.smithi066.stdout:3/295: chown d0/d2/d1d/l1e 0 1 2024-09-12T22:49:55.106 INFO:tasks.workunit.client.0.smithi066.stdout:5/393: chown d5/de/d50/d42/f48 27066196 1 2024-09-12T22:49:55.107 INFO:tasks.workunit.client.0.smithi066.stdout:8/330: read d17/f21 [10012,29954] 0 2024-09-12T22:49:55.107 INFO:tasks.workunit.client.0.smithi066.stdout:9/315: fsync d9/dc/f38 0 2024-09-12T22:49:55.107 INFO:tasks.workunit.client.0.smithi066.stdout:0/323: creat d1/d8/d1c/dd/f77 x:0 0 0 2024-09-12T22:49:55.108 INFO:tasks.workunit.client.0.smithi066.stdout:1/267: getdents d0/dc/d1e/d47 0 2024-09-12T22:49:55.108 INFO:tasks.workunit.client.0.smithi066.stdout:5/394: truncate d5/f24 2873629 0 2024-09-12T22:49:55.108 INFO:tasks.workunit.client.0.smithi066.stdout:7/307: dwrite d0/d19/d24/f1f [0,4194304] 0 2024-09-12T22:49:55.108 INFO:tasks.workunit.client.0.smithi066.stdout:4/302: rename d5/d8/c54 to d5/c69 0 2024-09-12T22:49:55.110 INFO:tasks.workunit.client.0.smithi066.stdout:1/268: mkdir d0/d4e 0 2024-09-12T22:49:55.110 INFO:tasks.workunit.client.0.smithi066.stdout:8/331: dread - d17/d1b/f5a zero size 2024-09-12T22:49:55.110 INFO:tasks.workunit.client.0.smithi066.stdout:3/296: rename d0/d2/d1d/c26 to d0/d2/d68/c73 0 2024-09-12T22:49:55.113 INFO:tasks.workunit.client.0.smithi066.stdout:1/269: write d0/f7 [1208891,35496] 0 2024-09-12T22:49:55.116 INFO:tasks.workunit.client.0.smithi066.stdout:7/308: write d0/d19/d26/f28 [2712008,113129] 0 2024-09-12T22:49:55.116 INFO:tasks.workunit.client.0.smithi066.stdout:6/362: dwrite d6/d20/f3a [4194304,4194304] 0 2024-09-12T22:49:55.117 INFO:tasks.workunit.client.0.smithi066.stdout:0/324: creat d1/d8/d1f/d30/f78 x:0 0 0 2024-09-12T22:49:55.117 INFO:tasks.workunit.client.0.smithi066.stdout:4/303: write d5/d8/d10/f36 [1759160,3573] 0 2024-09-12T22:49:55.119 INFO:tasks.workunit.client.0.smithi066.stdout:3/297: rmdir d0/d2/d7/d13/d31/d6d 0 2024-09-12T22:49:55.119 INFO:tasks.workunit.client.0.smithi066.stdout:2/307: dwrite d1/db/f5d [0,4194304] 0 2024-09-12T22:49:55.122 INFO:tasks.workunit.client.0.smithi066.stdout:6/363: fdatasync d6/f4b 0 2024-09-12T22:49:55.122 INFO:tasks.workunit.client.0.smithi066.stdout:4/304: dread - d5/d8/d16/d1b/d1e/f59 zero size 2024-09-12T22:49:55.123 INFO:tasks.workunit.client.0.smithi066.stdout:9/316: dwrite d9/dc/dd/f50 [0,4194304] 0 2024-09-12T22:49:55.123 INFO:tasks.workunit.client.0.smithi066.stdout:5/395: dwrite d5/de/d50/f5a [0,4194304] 0 2024-09-12T22:49:55.125 INFO:tasks.workunit.client.0.smithi066.stdout:1/270: getdents d0/d9/d21 0 2024-09-12T22:49:55.126 INFO:tasks.workunit.client.0.smithi066.stdout:6/364: dread - d6/d23/d25/d2c/f40 zero size 2024-09-12T22:49:55.127 INFO:tasks.workunit.client.0.smithi066.stdout:1/271: creat d0/d28/f4f x:0 0 0 2024-09-12T22:49:55.127 INFO:tasks.workunit.client.0.smithi066.stdout:2/308: link d1/dd/f2c d1/d11/f66 0 2024-09-12T22:49:55.128 INFO:tasks.workunit.client.0.smithi066.stdout:5/396: creat d5/d11/d23/d6f/f73 x:0 0 0 2024-09-12T22:49:55.129 INFO:tasks.workunit.client.0.smithi066.stdout:6/365: mknod d6/d7/c7a 0 2024-09-12T22:49:55.129 INFO:tasks.workunit.client.0.smithi066.stdout:2/309: dread - d1/d44/f4b zero size 2024-09-12T22:49:55.129 INFO:tasks.workunit.client.0.smithi066.stdout:0/325: dwrite d1/f67 [0,4194304] 0 2024-09-12T22:49:55.130 INFO:tasks.workunit.client.0.smithi066.stdout:7/309: dwrite d0/d19/d24/d33/f34 [0,4194304] 0 2024-09-12T22:49:55.131 INFO:tasks.workunit.client.0.smithi066.stdout:5/397: readlink d5/d11/d23/l2a 0 2024-09-12T22:49:55.131 INFO:tasks.workunit.client.0.smithi066.stdout:1/272: rename d0/dc/d1d/f24 to d0/d9/d21/f50 0 2024-09-12T22:49:55.133 INFO:tasks.workunit.client.0.smithi066.stdout:6/366: chown d6/d23/d25/c4f 223769 1 2024-09-12T22:49:55.133 INFO:tasks.workunit.client.0.smithi066.stdout:2/310: write d1/dd/d12/d1e/f35 [1339121,35954] 0 2024-09-12T22:49:55.134 INFO:tasks.workunit.client.0.smithi066.stdout:0/326: write d1/d8/d1c/dd/f44 [900748,24085] 0 2024-09-12T22:49:55.134 INFO:tasks.workunit.client.0.smithi066.stdout:8/332: dread d17/f21 [0,4194304] 0 2024-09-12T22:49:55.134 INFO:tasks.workunit.client.0.smithi066.stdout:5/398: creat d5/d14/f74 x:0 0 0 2024-09-12T22:49:55.136 INFO:tasks.workunit.client.0.smithi066.stdout:5/399: dread - d5/d11/f66 zero size 2024-09-12T22:49:55.136 INFO:tasks.workunit.client.0.smithi066.stdout:3/298: dwrite d0/d2/d6/d33/d40/d44/d55/f5c [0,4194304] 0 2024-09-12T22:49:55.136 INFO:tasks.workunit.client.0.smithi066.stdout:8/333: fsync d17/f42 0 2024-09-12T22:49:55.136 INFO:tasks.workunit.client.0.smithi066.stdout:2/311: mkdir d1/dd/d12/d67 0 2024-09-12T22:49:55.136 INFO:tasks.workunit.client.0.smithi066.stdout:0/327: fsync d1/d8/d1c/dd/f77 0 2024-09-12T22:49:55.136 INFO:tasks.workunit.client.0.smithi066.stdout:6/367: creat d6/d23/d25/f7b x:0 0 0 2024-09-12T22:49:55.137 INFO:tasks.workunit.client.0.smithi066.stdout:2/312: chown d1/d2a/l5c 2 1 2024-09-12T22:49:55.138 INFO:tasks.workunit.client.0.smithi066.stdout:6/368: write d6/fb [3938,86671] 0 2024-09-12T22:49:55.138 INFO:tasks.workunit.client.0.smithi066.stdout:0/328: fsync d1/d8/d1f/d30/f3d 0 2024-09-12T22:49:55.139 INFO:tasks.workunit.client.0.smithi066.stdout:7/310: write d0/ff [829972,67246] 0 2024-09-12T22:49:55.139 INFO:tasks.workunit.client.0.smithi066.stdout:1/273: write d0/f13 [34827,16073] 0 2024-09-12T22:49:55.139 INFO:tasks.workunit.client.0.smithi066.stdout:3/299: dread - d0/d2/d7/d13/f62 zero size 2024-09-12T22:49:55.140 INFO:tasks.workunit.client.0.smithi066.stdout:6/369: rmdir d6/d7/d66 39 2024-09-12T22:49:55.141 INFO:tasks.workunit.client.0.smithi066.stdout:4/305: dwrite d5/d8/d10/de/f27 [0,4194304] 0 2024-09-12T22:49:55.141 INFO:tasks.workunit.client.0.smithi066.stdout:7/311: unlink d0/d6/f9 0 2024-09-12T22:49:55.141 INFO:tasks.workunit.client.0.smithi066.stdout:5/400: write d5/d15/f17 [5336290,55753] 0 2024-09-12T22:49:55.142 INFO:tasks.workunit.client.0.smithi066.stdout:0/329: truncate d1/d8/f62 4386365 0 2024-09-12T22:49:55.142 INFO:tasks.workunit.client.0.smithi066.stdout:3/300: chown d0/d2/d6/d33/d40/c61 460892014 1 2024-09-12T22:49:55.142 INFO:tasks.workunit.client.0.smithi066.stdout:3/301: sync 2024-09-12T22:49:55.142 INFO:tasks.workunit.client.0.smithi066.stdout:6/370: unlink d6/d7/f11 0 2024-09-12T22:49:55.143 INFO:tasks.workunit.client.0.smithi066.stdout:8/334: dread d17/d2c/f37 [0,4194304] 0 2024-09-12T22:49:55.143 INFO:tasks.workunit.client.0.smithi066.stdout:7/312: rmdir d0/d19/d60/d53 39 2024-09-12T22:49:55.143 INFO:tasks.workunit.client.0.smithi066.stdout:5/401: fdatasync d5/d11/d23/f2f 0 2024-09-12T22:49:55.144 INFO:tasks.workunit.client.0.smithi066.stdout:4/306: link d5/d8/d10/de/d2d/f50 d5/d8/d10/f6a 0 2024-09-12T22:49:55.144 INFO:tasks.workunit.client.0.smithi066.stdout:3/302: mkdir d0/d2/d7/d13/d43/d74 0 2024-09-12T22:49:55.145 INFO:tasks.workunit.client.0.smithi066.stdout:5/402: truncate d5/d15/f71 686831 0 2024-09-12T22:49:55.145 INFO:tasks.workunit.client.0.smithi066.stdout:6/371: creat d6/d20/d32/f7c x:0 0 0 2024-09-12T22:49:55.145 INFO:tasks.workunit.client.0.smithi066.stdout:8/335: link d17/d40/f52 d17/d49/d4b/d57/d5e/d62/f67 0 2024-09-12T22:49:55.145 INFO:tasks.workunit.client.0.smithi066.stdout:4/307: write d5/d8/d10/f6a [3597,74638] 0 2024-09-12T22:49:55.146 INFO:tasks.workunit.client.0.smithi066.stdout:5/403: creat d5/d14/f75 x:0 0 0 2024-09-12T22:49:55.147 INFO:tasks.workunit.client.0.smithi066.stdout:0/330: read d1/d8/fe [819485,3004] 0 2024-09-12T22:49:55.147 INFO:tasks.workunit.client.0.smithi066.stdout:6/372: mknod d6/d20/d32/c7d 0 2024-09-12T22:49:55.148 INFO:tasks.workunit.client.0.smithi066.stdout:7/313: dread d0/d19/d26/f28 [0,4194304] 0 2024-09-12T22:49:55.148 INFO:tasks.workunit.client.0.smithi066.stdout:0/331: readlink d1/d8/d1b/d59/l74 0 2024-09-12T22:49:55.149 INFO:tasks.workunit.client.0.smithi066.stdout:1/274: truncate d0/d9/f43 43029 0 2024-09-12T22:49:55.149 INFO:tasks.workunit.client.0.smithi066.stdout:7/314: truncate d0/f54 543187 0 2024-09-12T22:49:55.150 INFO:tasks.workunit.client.0.smithi066.stdout:4/308: creat d5/d8/d10/f6b x:0 0 0 2024-09-12T22:49:55.151 INFO:tasks.workunit.client.0.smithi066.stdout:0/332: write d1/d8/d1f/f45 [1684992,31200] 0 2024-09-12T22:49:55.151 INFO:tasks.workunit.client.0.smithi066.stdout:6/373: getdents d6/d23/d62/d79 0 2024-09-12T22:49:55.151 INFO:tasks.workunit.client.0.smithi066.stdout:3/303: dwrite d0/d2/d6/f9 [0,4194304] 0 2024-09-12T22:49:55.152 INFO:tasks.workunit.client.0.smithi066.stdout:3/304: dread - d0/d1b/f72 zero size 2024-09-12T22:49:55.152 INFO:tasks.workunit.client.0.smithi066.stdout:4/309: rename d5/d8/d10/f20 to d5/d8/d10/de/d2d/d64/f6c 0 2024-09-12T22:49:55.152 INFO:tasks.workunit.client.0.smithi066.stdout:0/333: truncate d1/d8/d1f/d30/f70 200493 0 2024-09-12T22:49:55.153 INFO:tasks.workunit.client.0.smithi066.stdout:4/310: mknod d5/d8/c6d 0 2024-09-12T22:49:55.154 INFO:tasks.workunit.client.0.smithi066.stdout:4/311: unlink d5/d8/d16/d1b/f4b 0 2024-09-12T22:49:55.155 INFO:tasks.workunit.client.0.smithi066.stdout:3/305: getdents d0/d2/d6/d33/d40/d44/d55 0 2024-09-12T22:49:55.155 INFO:tasks.workunit.client.0.smithi066.stdout:3/306: stat d0 0 2024-09-12T22:49:55.156 INFO:tasks.workunit.client.0.smithi066.stdout:4/312: truncate d5/d8/d10/de/d2d/f50 708689 0 2024-09-12T22:49:55.157 INFO:tasks.workunit.client.0.smithi066.stdout:0/334: dread d1/d8/d1c/d13/f1e [0,4194304] 0 2024-09-12T22:49:55.157 INFO:tasks.workunit.client.0.smithi066.stdout:4/313: write d5/d8/d10/de/f27 [2886276,77450] 0 2024-09-12T22:49:55.159 INFO:tasks.workunit.client.0.smithi066.stdout:2/313: dread d1/d11/d26/f30 [0,4194304] 0 2024-09-12T22:49:55.159 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:55.158+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:55.160 INFO:tasks.workunit.client.0.smithi066.stdout:2/314: mkdir d1/dd/d68 0 2024-09-12T22:49:55.161 INFO:tasks.workunit.client.0.smithi066.stdout:2/315: creat d1/d11/d26/d4f/d52/f69 x:0 0 0 2024-09-12T22:49:55.162 INFO:tasks.workunit.client.0.smithi066.stdout:8/336: truncate d17/d1b/f1e 4736924 0 2024-09-12T22:49:55.162 INFO:tasks.workunit.client.0.smithi066.stdout:4/314: dwrite d5/f4f [0,4194304] 0 2024-09-12T22:49:55.163 INFO:tasks.workunit.client.0.smithi066.stdout:8/337: write d17/d40/d47/d4d/f50 [6827639,11451] 0 2024-09-12T22:49:55.163 INFO:tasks.workunit.client.0.smithi066.stdout:4/315: write d5/d48/f53 [823747,42496] 0 2024-09-12T22:49:55.164 INFO:tasks.workunit.client.0.smithi066.stdout:8/338: truncate d17/d1b/f5a 393786 0 2024-09-12T22:49:55.164 INFO:tasks.workunit.client.0.smithi066.stdout:2/316: creat d1/dd/d12/d67/f6a x:0 0 0 2024-09-12T22:49:55.165 INFO:tasks.workunit.client.0.smithi066.stdout:8/339: stat d17/d40/d47/c5c 0 2024-09-12T22:49:55.165 INFO:tasks.workunit.client.0.smithi066.stdout:2/317: creat d1/f6b x:0 0 0 2024-09-12T22:49:55.165 INFO:tasks.workunit.client.0.smithi066.stdout:4/316: rmdir d5/d8/d10/de/d39/d61 0 2024-09-12T22:49:55.166 INFO:tasks.workunit.client.0.smithi066.stdout:4/317: mkdir d5/d48/d6e 0 2024-09-12T22:49:55.168 INFO:tasks.workunit.client.0.smithi066.stdout:2/318: dwrite d1/d11/f19 [0,4194304] 0 2024-09-12T22:49:55.170 INFO:tasks.workunit.client.0.smithi066.stdout:9/317: dread d9/dc/fe [0,4194304] 0 2024-09-12T22:49:55.170 INFO:tasks.workunit.client.0.smithi066.stdout:8/340: read d17/d1b/f2e [527135,129425] 0 2024-09-12T22:49:55.171 INFO:tasks.workunit.client.0.smithi066.stdout:2/319: dread d1/d11/d26/f30 [0,4194304] 0 2024-09-12T22:49:55.171 INFO:tasks.workunit.client.0.smithi066.stdout:9/318: chown d9/dc/l17 6 1 2024-09-12T22:49:55.171 INFO:tasks.workunit.client.0.smithi066.stdout:8/341: truncate d17/d2c/f35 1212303 0 2024-09-12T22:49:55.173 INFO:tasks.workunit.client.0.smithi066.stdout:7/315: sync 2024-09-12T22:49:55.173 INFO:tasks.workunit.client.0.smithi066.stdout:2/320: rename d1/db/c36 to d1/d11/d26/d4f/c6c 0 2024-09-12T22:49:55.173 INFO:tasks.workunit.client.0.smithi066.stdout:0/335: write d1/f73 [5194006,66834] 0 2024-09-12T22:49:55.173 INFO:tasks.workunit.client.0.smithi066.stdout:1/275: write d0/d9/f43 [935410,94798] 0 2024-09-12T22:49:55.173 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:55.174 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:55.174 INFO:tasks.workunit.client.0.smithi066.stdout:0/336: chown d1/d8/d1c 559478 1 2024-09-12T22:49:55.174 INFO:tasks.workunit.client.0.smithi066.stdout:9/319: link d9/dc/dd/f1b d9/dc/d46/f67 0 2024-09-12T22:49:55.175 INFO:tasks.workunit.client.0.smithi066.stdout:7/316: rmdir d0/d19/d24/d33/d27 39 2024-09-12T22:49:55.175 INFO:tasks.workunit.client.0.smithi066.stdout:2/321: mkdir d1/d11/d26/d4f/d5f/d6d 0 2024-09-12T22:49:55.175 INFO:tasks.workunit.client.0.smithi066.stdout:9/320: fdatasync d9/dc/dd/f11 0 2024-09-12T22:49:55.175 INFO:tasks.workunit.client.0.smithi066.stdout:1/276: write d0/d9/d21/f27 [471293,37293] 0 2024-09-12T22:49:55.175 INFO:tasks.workunit.client.0.smithi066.stdout:1/277: readlink d0/dc/d33/l35 0 2024-09-12T22:49:55.176 INFO:tasks.workunit.client.0.smithi066.stdout:0/337: rename d1/d8/d1f/d25/f4d to d1/d36/f79 0 2024-09-12T22:49:55.176 INFO:tasks.workunit.client.0.smithi066.stdout:9/321: unlink d9/dc/d36/c61 0 2024-09-12T22:49:55.176 INFO:tasks.workunit.client.0.smithi066.stdout:8/342: dread d17/d1b/f23 [0,4194304] 0 2024-09-12T22:49:55.177 INFO:tasks.workunit.client.0.smithi066.stdout:9/322: dread - d9/f53 zero size 2024-09-12T22:49:55.177 INFO:tasks.workunit.client.0.smithi066.stdout:0/338: symlink d1/d8/d1f/d47/l7a 0 2024-09-12T22:49:55.178 INFO:tasks.workunit.client.0.smithi066.stdout:8/343: creat d17/d49/d4b/f68 x:0 0 0 2024-09-12T22:49:55.178 INFO:tasks.workunit.client.0.smithi066.stdout:1/278: getdents d0/dc/d1d 0 2024-09-12T22:49:55.178 INFO:tasks.workunit.client.0.smithi066.stdout:9/323: rename d9/l2a to d9/dc/d4e/l68 0 2024-09-12T22:49:55.178 INFO:tasks.workunit.client.0.smithi066.stdout:8/344: readlink d17/l26 0 2024-09-12T22:49:55.179 INFO:tasks.workunit.client.0.smithi066.stdout:0/339: creat d1/d8/d1f/f7b x:0 0 0 2024-09-12T22:49:55.179 INFO:tasks.workunit.client.0.smithi066.stdout:1/279: mknod d0/dc/d1d/c51 0 2024-09-12T22:49:55.180 INFO:tasks.workunit.client.0.smithi066.stdout:7/317: dwrite d0/d19/d60/f3c [0,4194304] 0 2024-09-12T22:49:55.180 INFO:tasks.workunit.client.0.smithi066.stdout:9/324: truncate d9/dc/dd/f54 794150 0 2024-09-12T22:49:55.180 INFO:tasks.workunit.client.0.smithi066.stdout:6/374: sync 2024-09-12T22:49:55.180 INFO:tasks.workunit.client.0.smithi066.stdout:8/345: dread d17/d2c/f32 [0,4194304] 0 2024-09-12T22:49:55.181 INFO:tasks.workunit.client.0.smithi066.stdout:8/346: fdatasync f16 0 2024-09-12T22:49:55.182 INFO:tasks.workunit.client.0.smithi066.stdout:1/280: mknod d0/dc/c52 0 2024-09-12T22:49:55.184 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:55.185 INFO:tasks.workunit.client.0.smithi066.stdout:9/325: mknod d9/d31/d34/d4d/c69 0 2024-09-12T22:49:55.185 INFO:tasks.workunit.client.0.smithi066.stdout:1/281: fsync d0/d9/f43 0 2024-09-12T22:49:55.185 INFO:tasks.workunit.client.0.smithi066.stdout:1/282: readlink d0/l5 0 2024-09-12T22:49:55.186 INFO:tasks.workunit.client.0.smithi066.stdout:9/326: creat d9/dc/f6a x:0 0 0 2024-09-12T22:49:55.187 INFO:tasks.workunit.client.0.smithi066.stdout:7/318: dwrite d0/d19/d60/f52 [0,4194304] 0 2024-09-12T22:49:55.187 INFO:tasks.workunit.client.0.smithi066.stdout:9/327: read - d9/dc/d4e/f66 zero size 2024-09-12T22:49:55.188 INFO:tasks.workunit.client.0.smithi066.stdout:8/347: dwrite d17/d49/d4b/d57/d5e/f5f [0,4194304] 0 2024-09-12T22:49:55.188 INFO:tasks.workunit.client.0.smithi066.stdout:9/328: readlink d9/dc/d36/l3c 0 2024-09-12T22:49:55.188 INFO:tasks.workunit.client.0.smithi066.stdout:8/348: stat d17/d2c/l3e 0 2024-09-12T22:49:55.190 INFO:tasks.workunit.client.0.smithi066.stdout:8/349: fdatasync d17/d1b/f2e 0 2024-09-12T22:49:55.193 INFO:tasks.workunit.client.0.smithi066.stdout:5/404: dread d5/d11/d23/f2f [0,4194304] 0 2024-09-12T22:49:55.193 INFO:tasks.workunit.client.0.smithi066.stdout:8/350: link f16 d17/d49/d4b/d57/f69 0 2024-09-12T22:49:55.195 INFO:tasks.workunit.client.0.smithi066.stdout:5/405: symlink d5/d11/d5d/l76 0 2024-09-12T22:49:55.196 INFO:tasks.workunit.client.0.smithi066.stdout:9/329: dwrite d9/dc/d23/f51 [0,4194304] 0 2024-09-12T22:49:55.196 INFO:tasks.workunit.client.0.smithi066.stdout:8/351: unlink d17/f22 0 2024-09-12T22:49:55.197 INFO:tasks.workunit.client.0.smithi066.stdout:7/319: dwrite d0/d19/d26/d48/f58 [0,4194304] 0 2024-09-12T22:49:55.198 INFO:tasks.workunit.client.0.smithi066.stdout:9/330: creat d9/dc/d36/f6b x:0 0 0 2024-09-12T22:49:55.198 INFO:tasks.workunit.client.0.smithi066.stdout:1/283: dread d0/d9/f14 [0,4194304] 0 2024-09-12T22:49:55.199 INFO:tasks.workunit.client.0.smithi066.stdout:4/318: sync 2024-09-12T22:49:55.199 INFO:tasks.workunit.client.0.smithi066.stdout:6/375: sync 2024-09-12T22:49:55.199 INFO:tasks.workunit.client.0.smithi066.stdout:0/340: sync 2024-09-12T22:49:55.199 INFO:tasks.workunit.client.0.smithi066.stdout:2/322: dread d1/dd/d12/d18/f3e [0,4194304] 0 2024-09-12T22:49:55.199 INFO:tasks.workunit.client.0.smithi066.stdout:7/320: truncate d0/ff 1450749 0 2024-09-12T22:49:55.200 INFO:tasks.workunit.client.0.smithi066.stdout:9/331: write d9/dc/d4e/f66 [610630,39985] 0 2024-09-12T22:49:55.200 INFO:tasks.workunit.client.0.smithi066.stdout:0/341: chown d1/d8/d1f/d30/f78 44975 1 2024-09-12T22:49:55.202 INFO:tasks.workunit.client.0.smithi066.stdout:9/332: read - d9/dc/dd/f47 zero size 2024-09-12T22:49:55.202 INFO:tasks.workunit.client.0.smithi066.stdout:2/323: symlink d1/db/d42/l6e 0 2024-09-12T22:49:55.202 INFO:tasks.workunit.client.0.smithi066.stdout:4/319: rename d5/d48 to d5/d8/d60/d6f 0 2024-09-12T22:49:55.202 INFO:tasks.workunit.client.0.smithi066.stdout:0/342: creat d1/d8/d1c/d56/f7c x:0 0 0 2024-09-12T22:49:55.202 INFO:tasks.workunit.client.0.smithi066.stdout:8/352: getdents d17/d49/d4b/d57/d5e/d62 0 2024-09-12T22:49:55.203 INFO:tasks.workunit.client.0.smithi066.stdout:6/376: mknod d6/d78/c7e 0 2024-09-12T22:49:55.203 INFO:tasks.workunit.client.0.smithi066.stdout:0/343: rmdir d1/d5b 39 2024-09-12T22:49:55.203 INFO:tasks.workunit.client.0.smithi066.stdout:2/324: chown d1/d11/f19 20 1 2024-09-12T22:49:55.204 INFO:tasks.workunit.client.0.smithi066.stdout:5/406: dwrite d5/f24 [0,4194304] 0 2024-09-12T22:49:55.204 INFO:tasks.workunit.client.0.smithi066.stdout:6/377: chown d6/d23/d41 775522 1 2024-09-12T22:49:55.204 INFO:tasks.workunit.client.0.smithi066.stdout:1/284: rename d0/d9/l3a to d0/dc/d1d/l53 0 2024-09-12T22:49:55.205 INFO:tasks.workunit.client.0.smithi066.stdout:4/320: write d5/d8/d10/f5c [562898,10596] 0 2024-09-12T22:49:55.205 INFO:tasks.workunit.client.0.smithi066.stdout:0/344: readlink d1/d36/l5d 0 2024-09-12T22:49:55.205 INFO:tasks.workunit.client.0.smithi066.stdout:9/333: dread d9/dc/fe [0,4194304] 0 2024-09-12T22:49:55.205 INFO:tasks.workunit.client.0.smithi066.stdout:8/353: chown d17/d49/c59 104 1 2024-09-12T22:49:55.206 INFO:tasks.workunit.client.0.smithi066.stdout:1/285: write d0/f13 [553801,35830] 0 2024-09-12T22:49:55.207 INFO:tasks.workunit.client.0.smithi066.stdout:9/334: write d9/f53 [216158,41722] 0 2024-09-12T22:49:55.208 INFO:tasks.workunit.client.0.smithi066.stdout:8/354: stat d17/d49/d4b/d57/d5e/d62/f67 0 2024-09-12T22:49:55.208 INFO:tasks.workunit.client.0.smithi066.stdout:7/321: rename d0/d19/d26/d48/c55 to d0/d19/d26/c65 0 2024-09-12T22:49:55.208 INFO:tasks.workunit.client.0.smithi066.stdout:6/378: chown d6/l15 5868367 1 2024-09-12T22:49:55.208 INFO:tasks.workunit.client.0.smithi066.stdout:1/286: fdatasync d0/d9/d21/f3d 0 2024-09-12T22:49:55.209 INFO:tasks.workunit.client.0.smithi066.stdout:3/307: dread d0/d2/fa [0,4194304] 0 2024-09-12T22:49:55.210 INFO:tasks.workunit.client.0.smithi066.stdout:5/407: write d5/de/d50/d42/d49/f6b [2029724,119445] 0 2024-09-12T22:49:55.210 INFO:tasks.workunit.client.0.smithi066.stdout:9/335: creat d9/dc/d4e/f6c x:0 0 0 2024-09-12T22:49:55.210 INFO:tasks.workunit.client.0.smithi066.stdout:7/322: dread - d0/d19/d24/d33/f5b zero size 2024-09-12T22:49:55.210 INFO:tasks.workunit.client.0.smithi066.stdout:0/345: getdents d1/d8/d1f 0 2024-09-12T22:49:55.211 INFO:tasks.workunit.client.0.smithi066.stdout:8/355: stat d17/d40/d47/d4d/c56 0 2024-09-12T22:49:55.211 INFO:tasks.workunit.client.0.smithi066.stdout:1/287: creat d0/dc/d44/f54 x:0 0 0 2024-09-12T22:49:55.212 INFO:tasks.workunit.client.0.smithi066.stdout:5/408: fdatasync d5/d11/d21/f4a 0 2024-09-12T22:49:55.212 INFO:tasks.workunit.client.0.smithi066.stdout:2/325: dwrite d1/d11/f19 [0,4194304] 0 2024-09-12T22:49:55.212 INFO:tasks.workunit.client.0.smithi066.stdout:3/308: readlink d0/d2/d6/d33/d40/d44/l52 0 2024-09-12T22:49:55.213 INFO:tasks.workunit.client.0.smithi066.stdout:0/346: creat d1/d8/d1f/d25/f7d x:0 0 0 2024-09-12T22:49:55.213 INFO:tasks.workunit.client.0.smithi066.stdout:6/379: dread d6/f4c [0,4194304] 0 2024-09-12T22:49:55.213 INFO:tasks.workunit.client.0.smithi066.stdout:1/288: write d0/dc/d44/f54 [67599,83922] 0 2024-09-12T22:49:55.213 INFO:tasks.workunit.client.0.smithi066.stdout:5/409: dread - d5/de/d50/f35 zero size 2024-09-12T22:49:55.214 INFO:tasks.workunit.client.0.smithi066.stdout:7/323: unlink d0/d19/d60/f40 0 2024-09-12T22:49:55.214 INFO:tasks.workunit.client.0.smithi066.stdout:4/321: dread d5/f46 [0,4194304] 0 2024-09-12T22:49:55.214 INFO:tasks.workunit.client.0.smithi066.stdout:3/309: unlink d0/d2/d7/d29/f6a 0 2024-09-12T22:49:55.214 INFO:tasks.workunit.client.0.smithi066.stdout:9/336: rename d9/c64 to d9/c6d 0 2024-09-12T22:49:55.215 INFO:tasks.workunit.client.0.smithi066.stdout:1/289: write d0/f13 [691789,76969] 0 2024-09-12T22:49:55.215 INFO:tasks.workunit.client.0.smithi066.stdout:2/326: rename d1/dd/d3d/f3f to d1/d11/d26/f6f 0 2024-09-12T22:49:55.216 INFO:tasks.workunit.client.0.smithi066.stdout:0/347: read - d1/d8/f41 zero size 2024-09-12T22:49:55.216 INFO:tasks.workunit.client.0.smithi066.stdout:4/322: chown d5/d8/d10 151 1 2024-09-12T22:49:55.216 INFO:tasks.workunit.client.0.smithi066.stdout:8/356: link d17/l2b d17/d49/d4b/l6a 0 2024-09-12T22:49:55.216 INFO:tasks.workunit.client.0.smithi066.stdout:6/380: rename d6/d20/d32/l38 to d6/d78/l7f 0 2024-09-12T22:49:55.216 INFO:tasks.workunit.client.0.smithi066.stdout:4/323: readlink d5/l29 0 2024-09-12T22:49:55.217 INFO:tasks.workunit.client.0.smithi066.stdout:1/290: creat d0/dc/d1d/f55 x:0 0 0 2024-09-12T22:49:55.217 INFO:tasks.workunit.client.0.smithi066.stdout:2/327: write d1/dd/d3d/f4a [1216821,110288] 0 2024-09-12T22:49:55.217 INFO:tasks.workunit.client.0.smithi066.stdout:9/337: chown d9/dc/d4e/l68 28787 1 2024-09-12T22:49:55.218 INFO:tasks.workunit.client.0.smithi066.stdout:7/324: rename d0/d19/c4d to d0/d19/d60/d64/c66 0 2024-09-12T22:49:55.218 INFO:tasks.workunit.client.0.smithi066.stdout:8/357: mknod d17/d49/d4b/d4e/c6b 0 2024-09-12T22:49:55.218 INFO:tasks.workunit.client.0.smithi066.stdout:4/324: write d5/d8/d10/f5c [1124254,5280] 0 2024-09-12T22:49:55.218 INFO:tasks.workunit.client.0.smithi066.stdout:0/348: read d1/d8/d1c/d56/f5e [4694461,48040] 0 2024-09-12T22:49:55.219 INFO:tasks.workunit.client.0.smithi066.stdout:2/328: stat d1/d11/d26/c3a 0 2024-09-12T22:49:55.219 INFO:tasks.workunit.client.0.smithi066.stdout:1/291: mknod d0/d4e/c56 0 2024-09-12T22:49:55.219 INFO:tasks.workunit.client.0.smithi066.stdout:1/292: fdatasync d0/f16 0 2024-09-12T22:49:55.220 INFO:tasks.workunit.client.0.smithi066.stdout:7/325: creat d0/d19/d60/d53/f67 x:0 0 0 2024-09-12T22:49:55.220 INFO:tasks.workunit.client.0.smithi066.stdout:0/349: mknod d1/d8/d1f/d47/c7e 0 2024-09-12T22:49:55.220 INFO:tasks.workunit.client.0.smithi066.stdout:9/338: creat d9/f6e x:0 0 0 2024-09-12T22:49:55.220 INFO:tasks.workunit.client.0.smithi066.stdout:6/381: sync 2024-09-12T22:49:55.220 INFO:tasks.workunit.client.0.smithi066.stdout:2/329: mkdir d1/d44/d51/d70 0 2024-09-12T22:49:55.221 INFO:tasks.workunit.client.0.smithi066.stdout:4/325: creat d5/d8/d10/de/d2d/d64/f70 x:0 0 0 2024-09-12T22:49:55.221 INFO:tasks.workunit.client.0.smithi066.stdout:2/330: fsync d1/f6b 0 2024-09-12T22:49:55.222 INFO:tasks.workunit.client.0.smithi066.stdout:8/358: link c10 d17/c6c 0 2024-09-12T22:49:55.223 INFO:tasks.workunit.client.0.smithi066.stdout:3/310: truncate d0/d2/d6/f18 1788600 0 2024-09-12T22:49:55.223 INFO:tasks.workunit.client.0.smithi066.stdout:0/350: write d1/d8/f35 [847674,125899] 0 2024-09-12T22:49:55.223 INFO:tasks.workunit.client.0.smithi066.stdout:3/311: chown d0 3743605 1 2024-09-12T22:49:55.224 INFO:tasks.workunit.client.0.smithi066.stdout:6/382: unlink d6/d23/d25/c4f 0 2024-09-12T22:49:55.224 INFO:tasks.workunit.client.0.smithi066.stdout:9/339: dread d9/dc/f52 [0,4194304] 0 2024-09-12T22:49:55.227 INFO:tasks.workunit.client.0.smithi066.stdout:7/326: write d0/d19/d24/f1d [3192501,9164] 0 2024-09-12T22:49:55.227 INFO:tasks.workunit.client.0.smithi066.stdout:6/383: creat d6/f80 x:0 0 0 2024-09-12T22:49:55.227 INFO:tasks.workunit.client.0.smithi066.stdout:9/340: read d9/dc/d4e/f66 [142918,280] 0 2024-09-12T22:49:55.228 INFO:tasks.workunit.client.0.smithi066.stdout:3/312: symlink d0/d2/d7/d13/l75 0 2024-09-12T22:49:55.228 INFO:tasks.workunit.client.0.smithi066.stdout:8/359: link d17/d49/c58 d17/d40/d47/d4d/c6d 0 2024-09-12T22:49:55.228 INFO:tasks.workunit.client.0.smithi066.stdout:1/293: dwrite d0/f7 [0,4194304] 0 2024-09-12T22:49:55.229 INFO:tasks.workunit.client.0.smithi066.stdout:4/326: dread d5/f33 [0,4194304] 0 2024-09-12T22:49:55.230 INFO:tasks.workunit.client.0.smithi066.stdout:5/410: dread d5/d15/f17 [4194304,4194304] 0 2024-09-12T22:49:55.230 INFO:tasks.workunit.client.0.smithi066.stdout:6/384: symlink d6/d20/d50/l81 0 2024-09-12T22:49:55.232 INFO:tasks.workunit.client.0.smithi066.stdout:2/331: dwrite d1/d44/f45 [0,4194304] 0 2024-09-12T22:49:55.232 INFO:tasks.workunit.client.0.smithi066.stdout:9/341: creat d9/d31/f6f x:0 0 0 2024-09-12T22:49:55.232 INFO:tasks.workunit.client.0.smithi066.stdout:4/327: rmdir d5/d8/d16 39 2024-09-12T22:49:55.233 INFO:tasks.workunit.client.0.smithi066.stdout:8/360: dread d17/f21 [0,4194304] 0 2024-09-12T22:49:55.233 INFO:tasks.workunit.client.0.smithi066.stdout:4/328: stat d5/f24 0 2024-09-12T22:49:55.234 INFO:tasks.workunit.client.0.smithi066.stdout:5/411: chown d5/d11/d21/f4a 12541 1 2024-09-12T22:49:55.234 INFO:tasks.workunit.client.0.smithi066.stdout:7/327: rename d0/d19/d60/d53/f5d to d0/d19/d26/d48/d59/f68 0 2024-09-12T22:49:55.234 INFO:tasks.workunit.client.0.smithi066.stdout:3/313: creat d0/d2/d7/d13/d43/d74/f76 x:0 0 0 2024-09-12T22:49:55.234 INFO:tasks.workunit.client.0.smithi066.stdout:6/385: mknod d6/d23/d41/c82 0 2024-09-12T22:49:55.235 INFO:tasks.workunit.client.0.smithi066.stdout:4/329: chown d5/d8/d10/f6a 0 1 2024-09-12T22:49:55.235 INFO:tasks.workunit.client.0.smithi066.stdout:3/314: sync 2024-09-12T22:49:55.235 INFO:tasks.workunit.client.0.smithi066.stdout:0/351: dwrite d1/d8/f35 [0,4194304] 0 2024-09-12T22:49:55.235 INFO:tasks.workunit.client.0.smithi066.stdout:9/342: creat d9/d31/d58/f70 x:0 0 0 2024-09-12T22:49:55.237 INFO:tasks.workunit.client.0.smithi066.stdout:4/330: chown d5/d8/d60/d6f 6793 1 2024-09-12T22:49:55.237 INFO:tasks.workunit.client.0.smithi066.stdout:5/412: write d5/d14/f69 [2717532,36219] 0 2024-09-12T22:49:55.237 INFO:tasks.workunit.client.0.smithi066.stdout:2/332: creat d1/dd/f71 x:0 0 0 2024-09-12T22:49:55.238 INFO:tasks.workunit.client.0.smithi066.stdout:3/315: dread - d0/d2/d7/d13/d43/d74/f76 zero size 2024-09-12T22:49:55.238 INFO:tasks.workunit.client.0.smithi066.stdout:1/294: truncate d0/dc/fe 673598 0 2024-09-12T22:49:55.238 INFO:tasks.workunit.client.0.smithi066.stdout:1/295: sync 2024-09-12T22:49:55.239 INFO:tasks.workunit.client.0.smithi066.stdout:9/343: link d9/dc/f2d d9/dc/d36/f71 0 2024-09-12T22:49:55.239 INFO:tasks.workunit.client.0.smithi066.stdout:2/333: fsync d1/d11/d26/f6f 0 2024-09-12T22:49:55.239 INFO:tasks.workunit.client.0.smithi066.stdout:7/328: creat d0/d19/d24/d33/f69 x:0 0 0 2024-09-12T22:49:55.240 INFO:tasks.workunit.client.0.smithi066.stdout:3/316: write d0/d2/d7/d29/f3d [2847180,104787] 0 2024-09-12T22:49:55.241 INFO:tasks.workunit.client.0.smithi066.stdout:7/329: read - d0/d6/f4f zero size 2024-09-12T22:49:55.241 INFO:tasks.workunit.client.0.smithi066.stdout:8/361: truncate d17/d2c/f32 465949 0 2024-09-12T22:49:55.241 INFO:tasks.workunit.client.0.smithi066.stdout:6/386: rename d6/d20/f22 to d6/d23/d25/d2c/d69/f83 0 2024-09-12T22:49:55.241 INFO:tasks.workunit.client.0.smithi066.stdout:2/334: write d1/dd/d12/f21 [4929152,28576] 0 2024-09-12T22:49:55.241 INFO:tasks.workunit.client.0.smithi066.stdout:8/362: chown d17/d40/d47 12586 1 2024-09-12T22:49:55.241 INFO:tasks.workunit.client.0.smithi066.stdout:3/317: mknod d0/d2/d7/c77 0 2024-09-12T22:49:55.242 INFO:tasks.workunit.client.0.smithi066.stdout:5/413: rename d5/de/ff to d5/de/d50/d42/d49/f77 0 2024-09-12T22:49:55.242 INFO:tasks.workunit.client.0.smithi066.stdout:7/330: creat d0/d19/d26/f6a x:0 0 0 2024-09-12T22:49:55.242 INFO:tasks.workunit.client.0.smithi066.stdout:3/318: mknod d0/d2/d6/c78 0 2024-09-12T22:49:55.243 INFO:tasks.workunit.client.0.smithi066.stdout:1/296: rename d0/d9/d21 to d0/d36/d57 0 2024-09-12T22:49:55.243 INFO:tasks.workunit.client.0.smithi066.stdout:8/363: unlink d17/l31 0 2024-09-12T22:49:55.243 INFO:tasks.workunit.client.0.smithi066.stdout:5/414: chown d5/d14/c6c 31369816 1 2024-09-12T22:49:55.243 INFO:tasks.workunit.client.0.smithi066.stdout:2/335: mkdir d1/d11/d26/d4f/d5f/d61/d72 0 2024-09-12T22:49:55.244 INFO:tasks.workunit.client.0.smithi066.stdout:4/331: rename d5/d8/d10/de/cc to d5/d8/d60/d6f/c71 0 2024-09-12T22:49:55.245 INFO:tasks.workunit.client.0.smithi066.stdout:4/332: stat d5/f4f 0 2024-09-12T22:49:55.245 INFO:tasks.workunit.client.0.smithi066.stdout:2/336: read d1/d44/f45 [2981501,66320] 0 2024-09-12T22:49:55.246 INFO:tasks.workunit.client.0.smithi066.stdout:6/387: write d6/f4c [520005,26502] 0 2024-09-12T22:49:55.246 INFO:tasks.workunit.client.0.smithi066.stdout:5/415: mkdir d5/d11/d21/d78 0 2024-09-12T22:49:55.246 INFO:tasks.workunit.client.0.smithi066.stdout:1/297: link d0/f16 d0/d4e/f58 0 2024-09-12T22:49:55.247 INFO:tasks.workunit.client.0.smithi066.stdout:8/364: write d17/d1b/f30 [4418120,79322] 0 2024-09-12T22:49:55.247 INFO:tasks.workunit.client.0.smithi066.stdout:7/331: getdents d0/d19 0 2024-09-12T22:49:55.248 INFO:tasks.workunit.client.0.smithi066.stdout:9/344: dwrite f8 [0,4194304] 0 2024-09-12T22:49:55.248 INFO:tasks.workunit.client.0.smithi066.stdout:2/337: truncate d1/dd/f63 108829 0 2024-09-12T22:49:55.249 INFO:tasks.workunit.client.0.smithi066.stdout:3/319: dread d0/d2/d7/f5e [0,4194304] 0 2024-09-12T22:49:55.250 INFO:tasks.workunit.client.0.smithi066.stdout:4/333: mkdir d5/d8/d16/d1b/d72 0 2024-09-12T22:49:55.250 INFO:tasks.workunit.client.0.smithi066.stdout:1/298: unlink d0/dc/d33/f3b 0 2024-09-12T22:49:55.250 INFO:tasks.workunit.client.0.smithi066.stdout:2/338: truncate d1/dd/d12/d67/f6a 875113 0 2024-09-12T22:49:55.252 INFO:tasks.workunit.client.0.smithi066.stdout:7/332: creat d0/d19/d24/f6b x:0 0 0 2024-09-12T22:49:55.252 INFO:tasks.workunit.client.0.smithi066.stdout:6/388: creat d6/d51/f84 x:0 0 0 2024-09-12T22:49:55.252 INFO:tasks.workunit.client.0.smithi066.stdout:3/320: dread d0/d2/d7/f5e [0,4194304] 0 2024-09-12T22:49:55.252 INFO:tasks.workunit.client.0.smithi066.stdout:9/345: unlink d9/dc/d36/f43 0 2024-09-12T22:49:55.252 INFO:tasks.workunit.client.0.smithi066.stdout:8/365: truncate f16 1808247 0 2024-09-12T22:49:55.253 INFO:tasks.workunit.client.0.smithi066.stdout:4/334: readlink d5/d8/d10/de/d2d/d64/l68 0 2024-09-12T22:49:55.253 INFO:tasks.workunit.client.0.smithi066.stdout:6/389: mkdir d6/d23/d25/d2c/d85 0 2024-09-12T22:49:55.254 INFO:tasks.workunit.client.0.smithi066.stdout:8/366: creat d17/d40/d47/d66/f6e x:0 0 0 2024-09-12T22:49:55.255 INFO:tasks.workunit.client.0.smithi066.stdout:5/416: dwrite d5/d11/f43 [0,4194304] 0 2024-09-12T22:49:55.255 INFO:tasks.workunit.client.0.smithi066.stdout:3/321: creat d0/d2/d7/d13/d43/d74/f79 x:0 0 0 2024-09-12T22:49:55.256 INFO:tasks.workunit.client.0.smithi066.stdout:2/339: write d1/d2a/f34 [1445832,122244] 0 2024-09-12T22:49:55.262 INFO:tasks.workunit.client.0.smithi066.stdout:0/352: dread d1/d8/fe [0,4194304] 0 2024-09-12T22:49:55.262 INFO:tasks.workunit.client.0.smithi066.stdout:3/322: mkdir d0/d2/d6/d7a 0 2024-09-12T22:49:55.262 INFO:tasks.workunit.client.0.smithi066.stdout:8/367: mknod d17/d40/d47/d66/c6f 0 2024-09-12T22:49:55.262 INFO:tasks.workunit.client.0.smithi066.stdout:5/417: mknod d5/d11/d21/d78/c79 0 2024-09-12T22:49:55.262 INFO:tasks.workunit.client.0.smithi066.stdout:2/340: symlink d1/d44/d51/d70/l73 0 2024-09-12T22:49:55.262 INFO:tasks.workunit.client.0.smithi066.stdout:6/390: truncate d6/d49/f70 39451 0 2024-09-12T22:49:55.262 INFO:tasks.workunit.client.0.smithi066.stdout:0/353: write d1/f67 [1912814,106340] 0 2024-09-12T22:49:55.262 INFO:tasks.workunit.client.0.smithi066.stdout:8/368: write d17/d2c/f38 [4214143,104608] 0 2024-09-12T22:49:55.263 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:55.259+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:55.263 INFO:tasks.workunit.client.0.smithi066.stdout:9/346: dwrite d9/fb [4194304,4194304] 0 2024-09-12T22:49:55.264 INFO:tasks.workunit.client.0.smithi066.stdout:3/323: mknod d0/d2/d6/d33/d40/d44/c7b 0 2024-09-12T22:49:55.264 INFO:tasks.workunit.client.0.smithi066.stdout:5/418: dread d5/d15/f71 [0,4194304] 0 2024-09-12T22:49:55.264 INFO:tasks.workunit.client.0.smithi066.stdout:6/391: fsync d6/d23/d25/d4e/f73 0 2024-09-12T22:49:55.265 INFO:tasks.workunit.client.0.smithi066.stdout:4/335: dwrite d5/d8/d10/de/d2d/f50 [0,4194304] 0 2024-09-12T22:49:55.265 INFO:tasks.workunit.client.0.smithi066.stdout:3/324: chown d0/d2/d6/f18 61740 1 2024-09-12T22:49:55.268 INFO:tasks.workunit.client.0.smithi066.stdout:8/369: truncate d17/d49/d4b/d57/f69 209091 0 2024-09-12T22:49:55.268 INFO:tasks.workunit.client.0.smithi066.stdout:4/336: mkdir d5/d8/d16/d1b/d73 0 2024-09-12T22:49:55.269 INFO:tasks.workunit.client.0.smithi066.stdout:8/370: chown d17/d1b/c41 457403126 1 2024-09-12T22:49:55.269 INFO:tasks.workunit.client.0.smithi066.stdout:0/354: write d1/f1a [1892360,20172] 0 2024-09-12T22:49:55.271 INFO:tasks.workunit.client.0.smithi066.stdout:6/392: dwrite d6/d49/f4d [0,4194304] 0 2024-09-12T22:49:55.272 INFO:tasks.workunit.client.0.smithi066.stdout:5/419: dwrite d5/d11/f58 [0,4194304] 0 2024-09-12T22:49:55.273 INFO:tasks.workunit.client.0.smithi066.stdout:5/420: truncate d5/de/d50/f35 642930 0 2024-09-12T22:49:55.273 INFO:tasks.workunit.client.0.smithi066.stdout:8/371: rename d17/d49/d4b/d57/d5e/f5f to d17/f70 0 2024-09-12T22:49:55.274 INFO:tasks.workunit.client.0.smithi066.stdout:5/421: write d5/d14/f69 [4897382,27581] 0 2024-09-12T22:49:55.274 INFO:tasks.workunit.client.0.smithi066.stdout:0/355: rename d1/d8/f41 to d1/d8/f7f 0 2024-09-12T22:49:55.275 INFO:tasks.workunit.client.0.smithi066.stdout:8/372: mknod d17/d49/d4b/d57/c71 0 2024-09-12T22:49:55.275 INFO:tasks.workunit.client.0.smithi066.stdout:6/393: mknod d6/d78/d4a/c86 0 2024-09-12T22:49:55.275 INFO:tasks.workunit.client.0.smithi066.stdout:0/356: rmdir d1/d8 39 2024-09-12T22:49:55.276 INFO:tasks.workunit.client.0.smithi066.stdout:5/422: creat d5/d11/d21/d4d/f7a x:0 0 0 2024-09-12T22:49:55.276 INFO:tasks.workunit.client.0.smithi066.stdout:0/357: readlink d1/d8/d1c/dd/l1d 0 2024-09-12T22:49:55.277 INFO:tasks.workunit.client.0.smithi066.stdout:6/394: rename d6/d23/d25/c72 to d6/d20/d32/d3c/c87 0 2024-09-12T22:49:55.278 INFO:tasks.workunit.client.0.smithi066.stdout:0/358: mkdir d1/d80 0 2024-09-12T22:49:55.278 INFO:tasks.workunit.client.0.smithi066.stdout:6/395: mkdir d6/d23/d25/d88 0 2024-09-12T22:49:55.278 INFO:tasks.workunit.client.0.smithi066.stdout:6/396: dread - d6/d20/d50/f6c zero size 2024-09-12T22:49:55.279 INFO:tasks.workunit.client.0.smithi066.stdout:0/359: creat d1/d8/f81 x:0 0 0 2024-09-12T22:49:55.279 INFO:tasks.workunit.client.0.smithi066.stdout:6/397: symlink d6/d23/d25/d2c/l89 0 2024-09-12T22:49:55.280 INFO:tasks.workunit.client.0.smithi066.stdout:1/299: dread d0/d9/f4d [0,4194304] 0 2024-09-12T22:49:55.280 INFO:tasks.workunit.client.0.smithi066.stdout:6/398: rmdir d6/d59 39 2024-09-12T22:49:55.283 INFO:tasks.workunit.client.0.smithi066.stdout:6/399: link d6/d51/c61 d6/d7/c8a 0 2024-09-12T22:49:55.284 INFO:tasks.workunit.client.0.smithi066.stdout:2/341: dread d1/d2a/f34 [0,4194304] 0 2024-09-12T22:49:55.284 INFO:tasks.workunit.client.0.smithi066.stdout:0/360: dwrite d1/f67 [0,4194304] 0 2024-09-12T22:49:55.284 INFO:tasks.workunit.client.0.smithi066.stdout:6/400: creat d6/f8b x:0 0 0 2024-09-12T22:49:55.285 INFO:tasks.workunit.client.0.smithi066.stdout:2/342: symlink d1/db/d42/d43/l74 0 2024-09-12T22:49:55.285 INFO:tasks.workunit.client.0.smithi066.stdout:6/401: rmdir d6/d20/d32 39 2024-09-12T22:49:55.285 INFO:tasks.workunit.client.0.smithi066.stdout:8/373: dread d17/d1b/f2e [0,4194304] 0 2024-09-12T22:49:55.286 INFO:tasks.workunit.client.0.smithi066.stdout:0/361: write d1/d8/d1f/f33 [3030260,119083] 0 2024-09-12T22:49:55.287 INFO:tasks.workunit.client.0.smithi066.stdout:6/402: rename d6/d23/c2b to d6/d78/d4a/c8c 0 2024-09-12T22:49:55.288 INFO:tasks.workunit.client.0.smithi066.stdout:8/374: creat d17/d49/d4b/d57/d5e/f72 x:0 0 0 2024-09-12T22:49:55.289 INFO:tasks.workunit.client.0.smithi066.stdout:6/403: symlink d6/d23/d62/l8d 0 2024-09-12T22:49:55.289 INFO:tasks.workunit.client.0.smithi066.stdout:0/362: rename d1/f68 to d1/d8/d1c/d13/d2f/f82 0 2024-09-12T22:49:55.290 INFO:tasks.workunit.client.0.smithi066.stdout:0/363: symlink d1/d8/d1c/dd/l83 0 2024-09-12T22:49:55.291 INFO:tasks.workunit.client.0.smithi066.stdout:6/404: rename d6/d78/d4a/l6d to d6/d23/d25/l8e 0 2024-09-12T22:49:55.293 INFO:tasks.workunit.client.0.smithi066.stdout:6/405: creat d6/d23/d25/f8f x:0 0 0 2024-09-12T22:49:55.293 INFO:tasks.workunit.client.0.smithi066.stdout:2/343: dwrite d1/d11/f66 [0,4194304] 0 2024-09-12T22:49:55.293 INFO:tasks.workunit.client.0.smithi066.stdout:6/406: dread - d6/d51/f84 zero size 2024-09-12T22:49:55.295 INFO:tasks.workunit.client.0.smithi066.stdout:2/344: chown d1/dd/d12/d18/f3e 446 1 2024-09-12T22:49:55.295 INFO:tasks.workunit.client.0.smithi066.stdout:8/375: dwrite d17/d2c/f37 [0,4194304] 0 2024-09-12T22:49:55.297 INFO:tasks.workunit.client.0.smithi066.stdout:8/376: creat d17/d40/d47/d4d/f73 x:0 0 0 2024-09-12T22:49:55.298 INFO:tasks.workunit.client.0.smithi066.stdout:2/345: write d1/dd/d12/d18/f3e [4417757,42344] 0 2024-09-12T22:49:55.298 INFO:tasks.workunit.client.0.smithi066.stdout:8/377: stat d17/d1b/f23 0 2024-09-12T22:49:55.298 INFO:tasks.workunit.client.0.smithi066.stdout:0/364: dwrite d1/d8/d1c/d13/f22 [0,4194304] 0 2024-09-12T22:49:55.299 INFO:tasks.workunit.client.0.smithi066.stdout:3/325: dread d0/d2/d7/f4b [0,4194304] 0 2024-09-12T22:49:55.300 INFO:tasks.workunit.client.0.smithi066.stdout:0/365: chown d1/d8/d1f/d25/l4e 495045306 1 2024-09-12T22:49:55.300 INFO:tasks.workunit.client.0.smithi066.stdout:4/337: sync 2024-09-12T22:49:55.300 INFO:tasks.workunit.client.0.smithi066.stdout:8/378: mkdir d17/d40/d74 0 2024-09-12T22:49:55.302 INFO:tasks.workunit.client.0.smithi066.stdout:3/326: getdents d0/d2/d7/d13/d43/d74 0 2024-09-12T22:49:55.303 INFO:tasks.workunit.client.0.smithi066.stdout:9/347: dread d9/d31/d34/f3b [0,4194304] 0 2024-09-12T22:49:55.303 INFO:tasks.workunit.client.0.smithi066.stdout:7/333: dread d0/d19/d60/f51 [0,4194304] 0 2024-09-12T22:49:55.303 INFO:tasks.workunit.client.0.smithi066.stdout:0/366: truncate d1/d8/d1c/d13/f23 142170 0 2024-09-12T22:49:55.303 INFO:tasks.workunit.client.0.smithi066.stdout:4/338: dread d5/f33 [0,4194304] 0 2024-09-12T22:49:55.304 INFO:tasks.workunit.client.0.smithi066.stdout:6/407: write d6/d23/d25/f2e [363523,16356] 0 2024-09-12T22:49:55.305 INFO:tasks.workunit.client.0.smithi066.stdout:3/327: dread - d0/d2/d7/d13/d43/d74/f76 zero size 2024-09-12T22:49:55.305 INFO:tasks.workunit.client.0.smithi066.stdout:2/346: dwrite d1/dd/d12/f24 [0,4194304] 0 2024-09-12T22:49:55.306 INFO:tasks.workunit.client.0.smithi066.stdout:7/334: chown d0/d19/d26/c39 38891361 1 2024-09-12T22:49:55.306 INFO:tasks.workunit.client.0.smithi066.stdout:8/379: truncate d17/d49/d4b/d57/f69 633924 0 2024-09-12T22:49:55.306 INFO:tasks.workunit.client.0.smithi066.stdout:6/408: truncate d6/d7/f39 757224 0 2024-09-12T22:49:55.308 INFO:tasks.workunit.client.0.smithi066.stdout:7/335: chown d0/d19/d24/l15 20505632 1 2024-09-12T22:49:55.308 INFO:tasks.workunit.client.0.smithi066.stdout:8/380: write d17/d1b/f30 [1554203,13513] 0 2024-09-12T22:49:55.308 INFO:tasks.workunit.client.0.smithi066.stdout:6/409: rmdir d6/d23/d25/d2c/d69 39 2024-09-12T22:49:55.310 INFO:tasks.workunit.client.0.smithi066.stdout:2/347: write d1/d11/d26/d4f/d52/d56/f65 [464461,16090] 0 2024-09-12T22:49:55.310 INFO:tasks.workunit.client.0.smithi066.stdout:7/336: truncate d0/f54 897378 0 2024-09-12T22:49:55.310 INFO:tasks.workunit.client.0.smithi066.stdout:9/348: dread d9/d31/d34/f3b [0,4194304] 0 2024-09-12T22:49:55.310 INFO:tasks.workunit.client.0.smithi066.stdout:8/381: symlink d17/d49/l75 0 2024-09-12T22:49:55.310 INFO:tasks.workunit.client.0.smithi066.stdout:7/337: creat d0/d19/f6c x:0 0 0 2024-09-12T22:49:55.310 INFO:tasks.workunit.client.0.smithi066.stdout:6/410: creat d6/d35/d42/f90 x:0 0 0 2024-09-12T22:49:55.311 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:55.311 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:55.311 INFO:tasks.workunit.client.0.smithi066.stdout:8/382: write d17/f29 [662964,93638] 0 2024-09-12T22:49:55.311 INFO:tasks.workunit.client.0.smithi066.stdout:2/348: creat d1/dd/d12/d18/f75 x:0 0 0 2024-09-12T22:49:55.311 INFO:tasks.workunit.client.0.smithi066.stdout:7/338: rmdir d0/d19/d26 39 2024-09-12T22:49:55.311 INFO:tasks.workunit.client.0.smithi066.stdout:5/423: dread d5/d11/f54 [0,4194304] 0 2024-09-12T22:49:55.312 INFO:tasks.workunit.client.0.smithi066.stdout:4/339: truncate d5/d8/d10/f40 1981723 0 2024-09-12T22:49:55.312 INFO:tasks.workunit.client.0.smithi066.stdout:5/424: dread - d5/f3f zero size 2024-09-12T22:49:55.313 INFO:tasks.workunit.client.0.smithi066.stdout:0/367: truncate d1/d8/d1c/dd/f28 1262437 0 2024-09-12T22:49:55.313 INFO:tasks.workunit.client.0.smithi066.stdout:2/349: truncate d1/d2a/f48 1022165 0 2024-09-12T22:49:55.313 INFO:tasks.workunit.client.0.smithi066.stdout:5/425: chown d5/d11 457284 1 2024-09-12T22:49:55.313 INFO:tasks.workunit.client.0.smithi066.stdout:0/368: symlink d1/d8/d1b/l84 0 2024-09-12T22:49:55.313 INFO:tasks.workunit.client.0.smithi066.stdout:9/349: creat d9/d31/f72 x:0 0 0 2024-09-12T22:49:55.314 INFO:tasks.workunit.client.0.smithi066.stdout:8/383: fdatasync d17/d49/d4b/d57/f69 0 2024-09-12T22:49:55.315 INFO:tasks.workunit.client.0.smithi066.stdout:5/426: chown d5/d11/d21/d4d/f72 389 1 2024-09-12T22:49:55.315 INFO:tasks.workunit.client.0.smithi066.stdout:6/411: link d6/d20/d32/d3c/l44 d6/d35/d42/l91 0 2024-09-12T22:49:55.315 INFO:tasks.workunit.client.0.smithi066.stdout:4/340: getdents d5/d8/d60/d6f/d6e 0 2024-09-12T22:49:55.315 INFO:tasks.workunit.client.0.smithi066.stdout:7/339: link d0/f4b d0/d19/d26/d5a/f6d 0 2024-09-12T22:49:55.315 INFO:tasks.workunit.client.0.smithi066.stdout:9/350: rmdir d9/d31/d34 39 2024-09-12T22:49:55.315 INFO:tasks.workunit.client.0.smithi066.stdout:0/369: stat d1/f73 0 2024-09-12T22:49:55.315 INFO:tasks.workunit.client.0.smithi066.stdout:6/412: unlink d6/d7/l14 0 2024-09-12T22:49:55.316 INFO:tasks.workunit.client.0.smithi066.stdout:5/427: creat d5/d11/d21/d78/f7b x:0 0 0 2024-09-12T22:49:55.316 INFO:tasks.workunit.client.0.smithi066.stdout:7/340: symlink d0/d19/d24/l6e 0 2024-09-12T22:49:55.317 INFO:tasks.workunit.client.0.smithi066.stdout:3/328: truncate d0/d2/d6/d33/d40/d44/d55/f5c 3266663 0 2024-09-12T22:49:55.317 INFO:tasks.workunit.client.0.smithi066.stdout:9/351: creat d9/d31/f73 x:0 0 0 2024-09-12T22:49:55.317 INFO:tasks.workunit.client.0.smithi066.stdout:7/341: write d0/ff [1626792,118018] 0 2024-09-12T22:49:55.318 INFO:tasks.workunit.client.0.smithi066.stdout:0/370: truncate d1/d8/d1f/f6c 714595 0 2024-09-12T22:49:55.318 INFO:tasks.workunit.client.0.smithi066.stdout:6/413: mknod d6/d7/c92 0 2024-09-12T22:49:55.319 INFO:tasks.workunit.client.0.smithi066.stdout:2/350: dwrite d1/d44/f4b [0,4194304] 0 2024-09-12T22:49:55.319 INFO:tasks.workunit.client.0.smithi066.stdout:5/428: chown d5/de/d50/d42/c62 19 1 2024-09-12T22:49:55.319 INFO:tasks.workunit.client.0.smithi066.stdout:3/329: mknod d0/c7c 0 2024-09-12T22:49:55.320 INFO:tasks.workunit.client.0.smithi066.stdout:4/341: truncate d5/d8/d16/d1b/d1e/d38/f3f 360251 0 2024-09-12T22:49:55.320 INFO:tasks.workunit.client.0.smithi066.stdout:9/352: rename d9/dc/f52 to d9/dc/d4e/f74 0 2024-09-12T22:49:55.321 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:55.322 INFO:tasks.workunit.client.0.smithi066.stdout:3/330: creat d0/d2/d6/f7d x:0 0 0 2024-09-12T22:49:55.322 INFO:tasks.workunit.client.0.smithi066.stdout:2/351: mkdir d1/db/d42/d43/d47/d76 0 2024-09-12T22:49:55.322 INFO:tasks.workunit.client.0.smithi066.stdout:2/352: fdatasync d1/db/f5d 0 2024-09-12T22:49:55.323 INFO:tasks.workunit.client.0.smithi066.stdout:9/353: write d9/dc/d23/f41 [180928,94803] 0 2024-09-12T22:49:55.323 INFO:tasks.workunit.client.0.smithi066.stdout:8/384: dwrite d17/d49/d4b/d57/f69 [0,4194304] 0 2024-09-12T22:49:55.323 INFO:tasks.workunit.client.0.smithi066.stdout:4/342: creat d5/d8/d16/d1b/d72/f74 x:0 0 0 2024-09-12T22:49:55.323 INFO:tasks.workunit.client.0.smithi066.stdout:3/331: chown d0/d2/d7/d13/d31/l69 1608374 1 2024-09-12T22:49:55.324 INFO:tasks.workunit.client.0.smithi066.stdout:2/353: write d1/f6b [417638,27880] 0 2024-09-12T22:49:55.325 INFO:tasks.workunit.client.0.smithi066.stdout:3/332: write d0/d2/d7/d13/d43/f4c [3274182,100650] 0 2024-09-12T22:49:55.325 INFO:tasks.workunit.client.0.smithi066.stdout:2/354: write d1/d2a/f64 [409295,129147] 0 2024-09-12T22:49:55.326 INFO:tasks.workunit.client.0.smithi066.stdout:2/355: truncate d1/d11/f19 4548830 0 2024-09-12T22:49:55.326 INFO:tasks.workunit.client.0.smithi066.stdout:9/354: dread d9/f53 [0,4194304] 0 2024-09-12T22:49:55.327 INFO:tasks.workunit.client.0.smithi066.stdout:9/355: dread - d9/dc/d36/f63 zero size 2024-09-12T22:49:55.328 INFO:tasks.workunit.client.0.smithi066.stdout:9/356: readlink d9/dc/d4e/l68 0 2024-09-12T22:49:55.329 INFO:tasks.workunit.client.0.smithi066.stdout:9/357: dread - d9/dc/dd/f65 zero size 2024-09-12T22:49:55.329 INFO:tasks.workunit.client.0.smithi066.stdout:4/343: dwrite d5/d8/d10/de/f18 [4194304,4194304] 0 2024-09-12T22:49:55.329 INFO:tasks.workunit.client.0.smithi066.stdout:9/358: write d9/dc/d36/f63 [861164,44778] 0 2024-09-12T22:49:55.330 INFO:tasks.workunit.client.0.smithi066.stdout:4/344: mkdir d5/d8/d10/de/d75 0 2024-09-12T22:49:55.331 INFO:tasks.workunit.client.0.smithi066.stdout:4/345: creat d5/d8/d16/d1b/d73/f76 x:0 0 0 2024-09-12T22:49:55.332 INFO:tasks.workunit.client.0.smithi066.stdout:4/346: read - d5/d8/d10/f6b zero size 2024-09-12T22:49:55.333 INFO:tasks.workunit.client.0.smithi066.stdout:9/359: fsync d9/dc/d36/f63 0 2024-09-12T22:49:55.334 INFO:tasks.workunit.client.0.smithi066.stdout:5/429: truncate d5/d15/f2c 242658 0 2024-09-12T22:49:55.334 INFO:tasks.workunit.client.0.smithi066.stdout:3/333: truncate d0/d2/d6/d33/d40/f48 2469699 0 2024-09-12T22:49:55.335 INFO:tasks.workunit.client.0.smithi066.stdout:2/356: truncate d1/db/d42/d43/d47/f60 2529236 0 2024-09-12T22:49:55.335 INFO:tasks.workunit.client.0.smithi066.stdout:8/385: write d17/d1b/f23 [1645536,76505] 0 2024-09-12T22:49:55.335 INFO:tasks.workunit.client.0.smithi066.stdout:9/360: mkdir d9/dc/dd/d75 0 2024-09-12T22:49:55.337 INFO:tasks.workunit.client.0.smithi066.stdout:8/386: chown d17/f29 2 1 2024-09-12T22:49:55.337 INFO:tasks.workunit.client.0.smithi066.stdout:9/361: dread - d9/d31/f6f zero size 2024-09-12T22:49:55.337 INFO:tasks.workunit.client.0.smithi066.stdout:0/371: truncate d1/d8/d1c/dd/f28 1233943 0 2024-09-12T22:49:55.337 INFO:tasks.workunit.client.0.smithi066.stdout:2/357: write d1/dd/f63 [482578,124791] 0 2024-09-12T22:49:55.338 INFO:tasks.workunit.client.0.smithi066.stdout:8/387: write f16 [4026974,20261] 0 2024-09-12T22:49:55.338 INFO:tasks.workunit.client.0.smithi066.stdout:4/347: dwrite d5/d8/d10/de/f2b [4194304,4194304] 0 2024-09-12T22:49:55.339 INFO:tasks.workunit.client.0.smithi066.stdout:2/358: write d1/dd/d12/d67/f6a [1289024,97179] 0 2024-09-12T22:49:55.339 INFO:tasks.workunit.client.0.smithi066.stdout:4/348: dread - d5/d8/d10/f6b zero size 2024-09-12T22:49:55.340 INFO:tasks.workunit.client.0.smithi066.stdout:8/388: truncate d17/d49/d4b/d57/f60 343660 0 2024-09-12T22:49:55.340 INFO:tasks.workunit.client.0.smithi066.stdout:3/334: rename d0/d2/d6/d33/d40/c61 to d0/d2/c7e 0 2024-09-12T22:49:55.340 INFO:tasks.workunit.client.0.smithi066.stdout:0/372: rmdir d1/d80 0 2024-09-12T22:49:55.340 INFO:tasks.workunit.client.0.smithi066.stdout:1/300: sync 2024-09-12T22:49:55.340 INFO:tasks.workunit.client.0.smithi066.stdout:4/349: sync 2024-09-12T22:49:55.340 INFO:tasks.workunit.client.0.smithi066.stdout:2/359: creat d1/d11/d26/f77 x:0 0 0 2024-09-12T22:49:55.341 INFO:tasks.workunit.client.0.smithi066.stdout:1/301: read - d0/dc/d1d/f55 zero size 2024-09-12T22:49:55.341 INFO:tasks.workunit.client.0.smithi066.stdout:2/360: fsync d1/d11/f66 0 2024-09-12T22:49:55.341 INFO:tasks.workunit.client.0.smithi066.stdout:3/335: stat d0/d2/d1d/f23 0 2024-09-12T22:49:55.341 INFO:tasks.workunit.client.0.smithi066.stdout:8/389: link d17/f42 d17/d49/d4b/f76 0 2024-09-12T22:49:55.342 INFO:tasks.workunit.client.0.smithi066.stdout:1/302: unlink d0/c3 0 2024-09-12T22:49:55.342 INFO:tasks.workunit.client.0.smithi066.stdout:2/361: symlink d1/d11/d26/d4f/l78 0 2024-09-12T22:49:55.343 INFO:tasks.workunit.client.0.smithi066.stdout:1/303: mknod d0/dc/d33/c59 0 2024-09-12T22:49:55.343 INFO:tasks.workunit.client.0.smithi066.stdout:8/390: mknod d17/d49/d4b/d57/d5e/c77 0 2024-09-12T22:49:55.344 INFO:tasks.workunit.client.0.smithi066.stdout:2/362: dread - d1/dd/f71 zero size 2024-09-12T22:49:55.344 INFO:tasks.workunit.client.0.smithi066.stdout:0/373: sync 2024-09-12T22:49:55.346 INFO:tasks.workunit.client.0.smithi066.stdout:1/304: creat d0/d4e/f5a x:0 0 0 2024-09-12T22:49:55.346 INFO:tasks.workunit.client.0.smithi066.stdout:2/363: rmdir d1/d11/d26/d4f/d52 39 2024-09-12T22:49:55.347 INFO:tasks.workunit.client.0.smithi066.stdout:8/391: creat d17/d40/d47/d66/f78 x:0 0 0 2024-09-12T22:49:55.347 INFO:tasks.workunit.client.0.smithi066.stdout:4/350: dwrite d5/f4f [0,4194304] 0 2024-09-12T22:49:55.349 INFO:tasks.workunit.client.0.smithi066.stdout:3/336: dwrite d0/d2/d7/f1a [0,4194304] 0 2024-09-12T22:49:55.350 INFO:tasks.workunit.client.0.smithi066.stdout:3/337: write d0/d2/d7/f66 [833971,109409] 0 2024-09-12T22:49:55.351 INFO:tasks.workunit.client.0.smithi066.stdout:0/374: creat d1/f85 x:0 0 0 2024-09-12T22:49:55.351 INFO:tasks.workunit.client.0.smithi066.stdout:2/364: creat d1/dd/d12/d1e/f79 x:0 0 0 2024-09-12T22:49:55.351 INFO:tasks.workunit.client.0.smithi066.stdout:8/392: mkdir d17/d49/d4b/d57/d5e/d62/d79 0 2024-09-12T22:49:55.352 INFO:tasks.workunit.client.0.smithi066.stdout:4/351: creat d5/d8/d16/d1b/f77 x:0 0 0 2024-09-12T22:49:55.352 INFO:tasks.workunit.client.0.smithi066.stdout:0/375: write d1/d8/f35 [1717355,127200] 0 2024-09-12T22:49:55.352 INFO:tasks.workunit.client.0.smithi066.stdout:3/338: creat d0/d2/d7/d13/d31/f7f x:0 0 0 2024-09-12T22:49:55.352 INFO:tasks.workunit.client.0.smithi066.stdout:8/393: creat d17/d40/d47/d4d/f7a x:0 0 0 2024-09-12T22:49:55.353 INFO:tasks.workunit.client.0.smithi066.stdout:8/394: dread d17/d1b/f2e [0,4194304] 0 2024-09-12T22:49:55.353 INFO:tasks.workunit.client.0.smithi066.stdout:0/376: mknod d1/d8/c86 0 2024-09-12T22:49:55.354 INFO:tasks.workunit.client.0.smithi066.stdout:4/352: creat d5/d8/f78 x:0 0 0 2024-09-12T22:49:55.355 INFO:tasks.workunit.client.0.smithi066.stdout:6/414: dread d6/f2a [0,4194304] 0 2024-09-12T22:49:55.355 INFO:tasks.workunit.client.0.smithi066.stdout:3/339: link d0/d2/f24 d0/d2/d6/d33/d6b/f80 0 2024-09-12T22:49:55.355 INFO:tasks.workunit.client.0.smithi066.stdout:8/395: mknod d17/d1b/c7b 0 2024-09-12T22:49:55.355 INFO:tasks.workunit.client.0.smithi066.stdout:7/342: dread d0/d19/d26/f47 [0,4194304] 0 2024-09-12T22:49:55.356 INFO:tasks.workunit.client.0.smithi066.stdout:4/353: symlink d5/d8/d16/l79 0 2024-09-12T22:49:55.356 INFO:tasks.workunit.client.0.smithi066.stdout:6/415: symlink d6/d7/l93 0 2024-09-12T22:49:55.356 INFO:tasks.workunit.client.0.smithi066.stdout:8/396: dread - d17/d40/d47/d4d/f73 zero size 2024-09-12T22:49:55.356 INFO:tasks.workunit.client.0.smithi066.stdout:6/416: readlink d6/l28 0 2024-09-12T22:49:55.357 INFO:tasks.workunit.client.0.smithi066.stdout:3/340: symlink d0/d2/d6/d33/d40/d44/l81 0 2024-09-12T22:49:55.357 INFO:tasks.workunit.client.0.smithi066.stdout:0/377: rename d1/d8/d1c/d13/d2f/l49 to d1/d8/d1b/d59/l87 0 2024-09-12T22:49:55.357 INFO:tasks.workunit.client.0.smithi066.stdout:8/397: truncate d17/f21 1230656 0 2024-09-12T22:49:55.357 INFO:tasks.workunit.client.0.smithi066.stdout:7/343: unlink d0/d19/d26/c65 0 2024-09-12T22:49:55.358 INFO:tasks.workunit.client.0.smithi066.stdout:4/354: creat d5/d8/d16/d1b/d1e/d1f/f7a x:0 0 0 2024-09-12T22:49:55.359 INFO:tasks.workunit.client.0.smithi066.stdout:8/398: creat d17/d2c/f7c x:0 0 0 2024-09-12T22:49:55.359 INFO:tasks.workunit.client.0.smithi066.stdout:7/344: mknod d0/d19/d60/c6f 0 2024-09-12T22:49:55.360 INFO:tasks.workunit.client.0.smithi066.stdout:7/345: fdatasync d0/d19/d60/f51 0 2024-09-12T22:49:55.361 INFO:tasks.workunit.client.0.smithi066.stdout:4/355: rename d5/d8/d16/l56 to d5/d8/d16/d1b/l7b 0 2024-09-12T22:49:55.362 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:55.361+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:55.364 INFO:tasks.workunit.client.0.smithi066.stdout:3/341: dwrite d0/d2/d1d/f2a [4194304,4194304] 0 2024-09-12T22:49:55.365 INFO:tasks.workunit.client.0.smithi066.stdout:9/362: dread d9/dc/f40 [0,4194304] 0 2024-09-12T22:49:55.366 INFO:tasks.workunit.client.0.smithi066.stdout:8/399: dwrite f15 [0,4194304] 0 2024-09-12T22:49:55.367 INFO:tasks.workunit.client.0.smithi066.stdout:4/356: mkdir d5/d8/d16/d1b/d1e/d1f/d7c 0 2024-09-12T22:49:55.367 INFO:tasks.workunit.client.0.smithi066.stdout:9/363: mknod d9/d31/d58/c76 0 2024-09-12T22:49:55.370 INFO:tasks.workunit.client.0.smithi066.stdout:9/364: rmdir d9 39 2024-09-12T22:49:55.370 INFO:tasks.workunit.client.0.smithi066.stdout:3/342: link d0/d2/d68/c71 d0/d2/d6/c82 0 2024-09-12T22:49:55.371 INFO:tasks.workunit.client.0.smithi066.stdout:6/417: dwrite d6/f4b [0,4194304] 0 2024-09-12T22:49:55.371 INFO:tasks.workunit.client.0.smithi066.stdout:5/430: dread d5/d14/f69 [0,4194304] 0 2024-09-12T22:49:55.371 INFO:tasks.workunit.client.0.smithi066.stdout:4/357: getdents d5/d8/d10/de/d2d 0 2024-09-12T22:49:55.371 INFO:tasks.workunit.client.0.smithi066.stdout:3/343: creat d0/d2/d7/d13/d31/f83 x:0 0 0 2024-09-12T22:49:55.371 INFO:tasks.workunit.client.0.smithi066.stdout:5/431: chown d5/d11/d23/f56 19409 1 2024-09-12T22:49:55.372 INFO:tasks.workunit.client.0.smithi066.stdout:6/418: rmdir d6/d23/d25/d2c/d69 39 2024-09-12T22:49:55.372 INFO:tasks.workunit.client.0.smithi066.stdout:5/432: chown d5/c29 7 1 2024-09-12T22:49:55.372 INFO:tasks.workunit.client.0.smithi066.stdout:6/419: symlink d6/d7/d66/l94 0 2024-09-12T22:49:55.373 INFO:tasks.workunit.client.0.smithi066.stdout:4/358: dread d5/f33 [0,4194304] 0 2024-09-12T22:49:55.373 INFO:tasks.workunit.client.0.smithi066.stdout:5/433: rmdir d5/d11/d5d 39 2024-09-12T22:49:55.373 INFO:tasks.workunit.client.0.smithi066.stdout:6/420: creat d6/d51/f95 x:0 0 0 2024-09-12T22:49:55.375 INFO:tasks.workunit.client.0.smithi066.stdout:5/434: mkdir d5/d11/d7c 0 2024-09-12T22:49:55.375 INFO:tasks.workunit.client.0.smithi066.stdout:6/421: fdatasync d6/d23/f29 0 2024-09-12T22:49:55.376 INFO:tasks.workunit.client.0.smithi066.stdout:5/435: chown d5/d15/f1a 51092 1 2024-09-12T22:49:55.376 INFO:tasks.workunit.client.0.smithi066.stdout:6/422: write d6/d49/f70 [1051049,76327] 0 2024-09-12T22:49:55.377 INFO:tasks.workunit.client.0.smithi066.stdout:3/344: dwrite d0/d2/d7/d13/d43/f50 [0,4194304] 0 2024-09-12T22:49:55.379 INFO:tasks.workunit.client.0.smithi066.stdout:6/423: creat d6/f96 x:0 0 0 2024-09-12T22:49:55.379 INFO:tasks.workunit.client.0.smithi066.stdout:3/345: truncate d0/d2/d6/d33/d6b/f80 138191 0 2024-09-12T22:49:55.381 INFO:tasks.workunit.client.0.smithi066.stdout:5/436: dwrite d5/d11/f1d [0,4194304] 0 2024-09-12T22:49:55.381 INFO:tasks.workunit.client.0.smithi066.stdout:6/424: write d6/d23/d25/f2e [544391,130687] 0 2024-09-12T22:49:55.382 INFO:tasks.workunit.client.0.smithi066.stdout:3/346: rename d0/d2/c4 to d0/d2/d7/d13/d43/d74/c84 0 2024-09-12T22:49:55.382 INFO:tasks.workunit.client.0.smithi066.stdout:6/425: unlink d6/d20/d32/l48 0 2024-09-12T22:49:55.383 INFO:tasks.workunit.client.0.smithi066.stdout:4/359: truncate d5/d8/d10/de/f27 794996 0 2024-09-12T22:49:55.383 INFO:tasks.workunit.client.0.smithi066.stdout:5/437: symlink d5/d11/d21/l7d 0 2024-09-12T22:49:55.384 INFO:tasks.workunit.client.0.smithi066.stdout:5/438: creat d5/d11/d23/d6f/f7e x:0 0 0 2024-09-12T22:49:55.385 INFO:tasks.workunit.client.0.smithi066.stdout:3/347: rename d0/d2/d6/d33/d40/d44/d55/f5c to d0/d2/d1d/f85 0 2024-09-12T22:49:55.385 INFO:tasks.workunit.client.0.smithi066.stdout:4/360: mkdir d5/d8/d10/de/d2d/d64/d7d 0 2024-09-12T22:49:55.387 INFO:tasks.workunit.client.0.smithi066.stdout:3/348: creat d0/d2/d7/d13/d43/d74/f86 x:0 0 0 2024-09-12T22:49:55.389 INFO:tasks.workunit.client.0.smithi066.stdout:6/426: dwrite d6/d23/d25/f6f [0,4194304] 0 2024-09-12T22:49:55.391 INFO:tasks.workunit.client.0.smithi066.stdout:5/439: dwrite d5/f36 [0,4194304] 0 2024-09-12T22:49:55.393 INFO:tasks.workunit.client.0.smithi066.stdout:6/427: rename d6/d7/dc/f21 to d6/d23/d25/f97 0 2024-09-12T22:49:55.394 INFO:tasks.workunit.client.0.smithi066.stdout:6/428: chown d6/d35/d42/f90 3253 1 2024-09-12T22:49:55.394 INFO:tasks.workunit.client.0.smithi066.stdout:6/429: fsync d6/d49/f2f 0 2024-09-12T22:49:55.395 INFO:tasks.workunit.client.0.smithi066.stdout:6/430: write d6/d59/f77 [902342,75424] 0 2024-09-12T22:49:55.396 INFO:tasks.workunit.client.0.smithi066.stdout:5/440: dwrite d5/d11/d21/f47 [4194304,4194304] 0 2024-09-12T22:49:55.399 INFO:tasks.workunit.client.0.smithi066.stdout:4/361: dread d5/d8/d16/d1b/d1e/d38/f3f [0,4194304] 0 2024-09-12T22:49:55.399 INFO:tasks.workunit.client.0.smithi066.stdout:6/431: symlink d6/d78/d4a/l98 0 2024-09-12T22:49:55.400 INFO:tasks.workunit.client.0.smithi066.stdout:6/432: read - d6/d23/d25/f8f zero size 2024-09-12T22:49:55.400 INFO:tasks.workunit.client.0.smithi066.stdout:0/378: dread d1/d8/f63 [0,4194304] 0 2024-09-12T22:49:55.400 INFO:tasks.workunit.client.0.smithi066.stdout:4/362: chown d5/d8/d16/l79 110 1 2024-09-12T22:49:55.400 INFO:tasks.workunit.client.0.smithi066.stdout:1/305: dread d0/d4e/f58 [4194304,4194304] 0 2024-09-12T22:49:55.401 INFO:tasks.workunit.client.0.smithi066.stdout:0/379: mkdir d1/d8/d1b/d88 0 2024-09-12T22:49:55.401 INFO:tasks.workunit.client.0.smithi066.stdout:1/306: rmdir d0/dc/d33 39 2024-09-12T22:49:55.401 INFO:tasks.workunit.client.0.smithi066.stdout:6/433: rename d6/d35/d42 to d6/d20/d99 0 2024-09-12T22:49:55.402 INFO:tasks.workunit.client.0.smithi066.stdout:0/380: chown d1/d8/d1f/f45 85758 1 2024-09-12T22:49:55.403 INFO:tasks.workunit.client.0.smithi066.stdout:6/434: mknod d6/d20/d32/c9a 0 2024-09-12T22:49:55.403 INFO:tasks.workunit.client.0.smithi066.stdout:4/363: rename d5/d8/d60/d6f/c71 to d5/d8/d16/c7e 0 2024-09-12T22:49:55.403 INFO:tasks.workunit.client.0.smithi066.stdout:6/435: write d6/f96 [415486,10637] 0 2024-09-12T22:49:55.404 INFO:tasks.workunit.client.0.smithi066.stdout:6/436: dread - d6/d23/f27 zero size 2024-09-12T22:49:55.405 INFO:tasks.workunit.client.0.smithi066.stdout:4/364: truncate d5/d8/d16/d1b/d1e/f59 372192 0 2024-09-12T22:49:55.406 INFO:tasks.workunit.client.0.smithi066.stdout:5/441: write d5/f3b [91267,21134] 0 2024-09-12T22:49:55.406 INFO:tasks.workunit.client.0.smithi066.stdout:4/365: fsync d5/f24 0 2024-09-12T22:49:55.406 INFO:tasks.workunit.client.0.smithi066.stdout:6/437: getdents d6/d20/d32/d3c 0 2024-09-12T22:49:55.407 INFO:tasks.workunit.client.0.smithi066.stdout:6/438: creat d6/d78/f9b x:0 0 0 2024-09-12T22:49:55.407 INFO:tasks.workunit.client.0.smithi066.stdout:5/442: write d5/d11/d23/d6f/f7e [817134,10525] 0 2024-09-12T22:49:55.408 INFO:tasks.workunit.client.0.smithi066.stdout:0/381: dwrite d1/d8/f81 [0,4194304] 0 2024-09-12T22:49:55.408 INFO:tasks.workunit.client.0.smithi066.stdout:4/366: getdents d5/d8/d10 0 2024-09-12T22:49:55.409 INFO:tasks.workunit.client.0.smithi066.stdout:0/382: dread - d1/d8/d1c/dd/f77 zero size 2024-09-12T22:49:55.409 INFO:tasks.workunit.client.0.smithi066.stdout:6/439: mkdir d6/d23/d62/d79/d9c 0 2024-09-12T22:49:55.409 INFO:tasks.workunit.client.0.smithi066.stdout:5/443: write d5/f55 [583050,52885] 0 2024-09-12T22:49:55.409 INFO:tasks.workunit.client.0.smithi066.stdout:4/367: chown d5/d8/d16/d1b/d72/f74 103 1 2024-09-12T22:49:55.409 INFO:tasks.workunit.client.0.smithi066.stdout:5/444: stat d5/de/d50/d42/f48 0 2024-09-12T22:49:55.410 INFO:tasks.workunit.client.0.smithi066.stdout:6/440: write d6/d51/f84 [98562,122716] 0 2024-09-12T22:49:55.410 INFO:tasks.workunit.client.0.smithi066.stdout:5/445: chown d5/d11/d23/l2d 114535 1 2024-09-12T22:49:55.410 INFO:tasks.workunit.client.0.smithi066.stdout:4/368: symlink d5/d8/d16/d1b/d72/l7f 0 2024-09-12T22:49:55.411 INFO:tasks.workunit.client.0.smithi066.stdout:6/441: chown d6/d20/d99/l91 67067 1 2024-09-12T22:49:55.412 INFO:tasks.workunit.client.0.smithi066.stdout:5/446: truncate d5/d14/f74 865047 0 2024-09-12T22:49:55.412 INFO:tasks.workunit.client.0.smithi066.stdout:7/346: dread d0/d6/f8 [0,4194304] 0 2024-09-12T22:49:55.412 INFO:tasks.workunit.client.0.smithi066.stdout:4/369: mknod d5/d8/d16/d1b/d1e/d1f/c80 0 2024-09-12T22:49:55.412 INFO:tasks.workunit.client.0.smithi066.stdout:6/442: dread - d6/d23/d25/f8f zero size 2024-09-12T22:49:55.414 INFO:tasks.workunit.client.0.smithi066.stdout:6/443: creat d6/d23/d25/d88/f9d x:0 0 0 2024-09-12T22:49:55.415 INFO:tasks.workunit.client.0.smithi066.stdout:0/383: dwrite d1/d8/f63 [4194304,4194304] 0 2024-09-12T22:49:55.416 INFO:tasks.workunit.client.0.smithi066.stdout:7/347: truncate d0/d19/d60/f51 2321656 0 2024-09-12T22:49:55.419 INFO:tasks.workunit.client.0.smithi066.stdout:2/365: dread d1/dd/d12/f21 [0,4194304] 0 2024-09-12T22:49:55.421 INFO:tasks.workunit.client.0.smithi066.stdout:2/366: mknod d1/dd/d12/d1e/c7a 0 2024-09-12T22:49:55.422 INFO:tasks.workunit.client.0.smithi066.stdout:6/444: dwrite d6/d20/f3a [4194304,4194304] 0 2024-09-12T22:49:55.422 INFO:tasks.workunit.client.0.smithi066.stdout:4/370: dwrite d5/d8/d16/d1b/f28 [0,4194304] 0 2024-09-12T22:49:55.422 INFO:tasks.workunit.client.0.smithi066.stdout:2/367: chown d1/d11/f16 14 1 2024-09-12T22:49:55.423 INFO:tasks.workunit.client.0.smithi066.stdout:7/348: dread d0/f54 [0,4194304] 0 2024-09-12T22:49:55.424 INFO:tasks.workunit.client.0.smithi066.stdout:7/349: fdatasync d0/d19/f6c 0 2024-09-12T22:49:55.426 INFO:tasks.workunit.client.0.smithi066.stdout:2/368: truncate d1/f3 1379826 0 2024-09-12T22:49:55.426 INFO:tasks.workunit.client.0.smithi066.stdout:6/445: getdents d6/d20/d32/d3c 0 2024-09-12T22:49:55.426 INFO:tasks.workunit.client.0.smithi066.stdout:4/371: fdatasync d5/d8/f49 0 2024-09-12T22:49:55.426 INFO:tasks.workunit.client.0.smithi066.stdout:7/350: mkdir d0/d19/d24/d33/d27/d70 0 2024-09-12T22:49:55.426 INFO:tasks.workunit.client.0.smithi066.stdout:2/369: write d1/d2a/f64 [95929,73010] 0 2024-09-12T22:49:55.427 INFO:tasks.workunit.client.0.smithi066.stdout:7/351: stat d0/d6/c44 0 2024-09-12T22:49:55.427 INFO:tasks.workunit.client.0.smithi066.stdout:6/446: creat d6/d49/f9e x:0 0 0 2024-09-12T22:49:55.427 INFO:tasks.workunit.client.0.smithi066.stdout:2/370: write d1/f6 [2524658,63092] 0 2024-09-12T22:49:55.427 INFO:tasks.workunit.client.0.smithi066.stdout:7/352: stat d0/d19/d60 0 2024-09-12T22:49:55.427 INFO:tasks.workunit.client.0.smithi066.stdout:6/447: fsync d6/d20/d50/f5d 0 2024-09-12T22:49:55.430 INFO:tasks.workunit.client.0.smithi066.stdout:2/371: dread d1/d44/f45 [0,4194304] 0 2024-09-12T22:49:55.430 INFO:tasks.workunit.client.0.smithi066.stdout:4/372: link d5/d8/d16/d1b/l7b d5/d8/d10/de/d2d/d64/d7d/l81 0 2024-09-12T22:49:55.431 INFO:tasks.workunit.client.0.smithi066.stdout:0/384: fdatasync d1/d8/f81 0 2024-09-12T22:49:55.431 INFO:tasks.workunit.client.0.smithi066.stdout:6/448: dread d6/f2a [0,4194304] 0 2024-09-12T22:49:55.432 INFO:tasks.workunit.client.0.smithi066.stdout:3/349: dread d0/d2/d7/d13/d43/f4c [0,4194304] 0 2024-09-12T22:49:55.432 INFO:tasks.workunit.client.0.smithi066.stdout:4/373: chown d5/d8/d10/de/d2d/d64/f70 178 1 2024-09-12T22:49:55.432 INFO:tasks.workunit.client.0.smithi066.stdout:9/365: dread d9/dc/dd/f42 [0,4194304] 0 2024-09-12T22:49:55.432 INFO:tasks.workunit.client.0.smithi066.stdout:6/449: unlink d6/f4c 0 2024-09-12T22:49:55.434 INFO:tasks.workunit.client.0.smithi066.stdout:3/350: rename d0/d2/d6/d33 to d0/d2/d1d/d87 0 2024-09-12T22:49:55.434 INFO:tasks.workunit.client.0.smithi066.stdout:9/366: write d9/dc/d23/f51 [427951,80217] 0 2024-09-12T22:49:55.434 INFO:tasks.workunit.client.0.smithi066.stdout:6/450: creat d6/d23/d25/f9f x:0 0 0 2024-09-12T22:49:55.434 INFO:tasks.workunit.client.0.smithi066.stdout:2/372: link d1/dd/d12/l3c d1/db/d42/d43/l7b 0 2024-09-12T22:49:55.435 INFO:tasks.workunit.client.0.smithi066.stdout:4/374: getdents d5/d8/d16/d1b 0 2024-09-12T22:49:55.435 INFO:tasks.workunit.client.0.smithi066.stdout:6/451: fsync d6/d20/d99/f90 0 2024-09-12T22:49:55.435 INFO:tasks.workunit.client.0.smithi066.stdout:9/367: mkdir d9/d31/d77 0 2024-09-12T22:49:55.436 INFO:tasks.workunit.client.0.smithi066.stdout:1/307: dread d0/dc/fe [0,4194304] 0 2024-09-12T22:49:55.436 INFO:tasks.workunit.client.0.smithi066.stdout:4/375: rmdir d5/d8 39 2024-09-12T22:49:55.436 INFO:tasks.workunit.client.0.smithi066.stdout:3/351: creat d0/d2/d7/d13/d43/d74/f88 x:0 0 0 2024-09-12T22:49:55.437 INFO:tasks.workunit.client.0.smithi066.stdout:6/452: readlink d6/d20/d32/d3c/l44 0 2024-09-12T22:49:55.437 INFO:tasks.workunit.client.0.smithi066.stdout:1/308: write d0/d4e/f5a [975650,41069] 0 2024-09-12T22:49:55.438 INFO:tasks.workunit.client.0.smithi066.stdout:0/385: dwrite d1/d8/f63 [0,4194304] 0 2024-09-12T22:49:55.438 INFO:tasks.workunit.client.0.smithi066.stdout:4/376: read - d5/d8/d16/d1b/d73/f76 zero size 2024-09-12T22:49:55.439 INFO:tasks.workunit.client.0.smithi066.stdout:1/309: chown d0/d4e/f5a 3 1 2024-09-12T22:49:55.439 INFO:tasks.workunit.client.0.smithi066.stdout:9/368: dread d9/dc/dd/f54 [0,4194304] 0 2024-09-12T22:49:55.440 INFO:tasks.workunit.client.0.smithi066.stdout:1/310: truncate d0/dc/d1d/f39 992342 0 2024-09-12T22:49:55.440 INFO:tasks.workunit.client.0.smithi066.stdout:6/453: creat d6/d20/d99/fa0 x:0 0 0 2024-09-12T22:49:55.440 INFO:tasks.workunit.client.0.smithi066.stdout:4/377: unlink d5/d8/d16/d1b/d1e/f55 0 2024-09-12T22:49:55.440 INFO:tasks.workunit.client.0.smithi066.stdout:2/373: rename d1/d11/d26/d4f/d5f/d6d to d1/d11/d26/d4f/d7c 0 2024-09-12T22:49:55.441 INFO:tasks.workunit.client.0.smithi066.stdout:1/311: dread - d0/d36/d57/f3e zero size 2024-09-12T22:49:55.441 INFO:tasks.workunit.client.0.smithi066.stdout:0/386: dread d1/f1a [0,4194304] 0 2024-09-12T22:49:55.441 INFO:tasks.workunit.client.0.smithi066.stdout:9/369: chown d9/dc/c20 113112867 1 2024-09-12T22:49:55.443 INFO:tasks.workunit.client.0.smithi066.stdout:3/352: rename d0/d2/d1d/d87/d40/d44/d55/c57 to d0/d2/d7/d13/c89 0 2024-09-12T22:49:55.443 INFO:tasks.workunit.client.0.smithi066.stdout:4/378: mknod d5/d8/d16/d1b/d1e/d5a/c82 0 2024-09-12T22:49:55.443 INFO:tasks.workunit.client.0.smithi066.stdout:0/387: creat d1/d8/d1c/dd/f89 x:0 0 0 2024-09-12T22:49:55.443 INFO:tasks.workunit.client.0.smithi066.stdout:9/370: readlink d9/d31/d34/l5c 0 2024-09-12T22:49:55.443 INFO:tasks.workunit.client.0.smithi066.stdout:6/454: rmdir d6/d23/d62/d79/d9c 0 2024-09-12T22:49:55.444 INFO:tasks.workunit.client.0.smithi066.stdout:9/371: mknod d9/d31/d58/c78 0 2024-09-12T22:49:55.444 INFO:tasks.workunit.client.0.smithi066.stdout:3/353: rename d0/c7c to d0/d2/c8a 0 2024-09-12T22:49:55.445 INFO:tasks.workunit.client.0.smithi066.stdout:0/388: mkdir d1/d8/d1c/d13/d2f/d8a 0 2024-09-12T22:49:55.445 INFO:tasks.workunit.client.0.smithi066.stdout:3/354: fdatasync d0/f38 0 2024-09-12T22:49:55.445 INFO:tasks.workunit.client.0.smithi066.stdout:4/379: write d5/d8/d16/d1b/d1e/d5a/f67 [451037,84529] 0 2024-09-12T22:49:55.445 INFO:tasks.workunit.client.0.smithi066.stdout:6/455: rename d6/d51/f84 to d6/d23/d25/d4e/fa1 0 2024-09-12T22:49:55.445 INFO:tasks.workunit.client.0.smithi066.stdout:8/400: dread d17/d1b/f3b [4194304,4194304] 0 2024-09-12T22:49:55.446 INFO:tasks.workunit.client.0.smithi066.stdout:6/456: symlink d6/d7/la2 0 2024-09-12T22:49:55.446 INFO:tasks.workunit.client.0.smithi066.stdout:0/389: write d1/d8/d1f/d30/f70 [13854,65179] 0 2024-09-12T22:49:55.446 INFO:tasks.workunit.client.0.smithi066.stdout:4/380: unlink d5/d3e/d65/l66 0 2024-09-12T22:49:55.447 INFO:tasks.workunit.client.0.smithi066.stdout:8/401: chown d17/d40/d47/d4d/c6d 3 1 2024-09-12T22:49:55.447 INFO:tasks.workunit.client.0.smithi066.stdout:3/355: mknod d0/d2/d1d/d87/d40/d44/c8b 0 2024-09-12T22:49:55.447 INFO:tasks.workunit.client.0.smithi066.stdout:0/390: stat d1/d8/d1f/d30/c53 0 2024-09-12T22:49:55.447 INFO:tasks.workunit.client.0.smithi066.stdout:6/457: rename d6/d59/f6e to d6/d20/d99/fa3 0 2024-09-12T22:49:55.448 INFO:tasks.workunit.client.0.smithi066.stdout:3/356: chown d0/d2/d7/d13/d43/f50 3788 1 2024-09-12T22:49:55.448 INFO:tasks.workunit.client.0.smithi066.stdout:4/381: write d5/d8/d16/d1b/d1e/d5a/f67 [1019494,59526] 0 2024-09-12T22:49:55.448 INFO:tasks.workunit.client.0.smithi066.stdout:6/458: chown d6/d20/d99/l91 30762309 1 2024-09-12T22:49:55.450 INFO:tasks.workunit.client.0.smithi066.stdout:6/459: fsync d6/d49/f70 0 2024-09-12T22:49:55.450 INFO:tasks.workunit.client.0.smithi066.stdout:3/357: write d0/d2/d7/d13/d43/d74/f86 [132461,34881] 0 2024-09-12T22:49:55.450 INFO:tasks.workunit.client.0.smithi066.stdout:6/460: chown d6/d51 4380 1 2024-09-12T22:49:55.450 INFO:tasks.workunit.client.0.smithi066.stdout:6/461: fdatasync d6/d20/d50/f6c 0 2024-09-12T22:49:55.451 INFO:tasks.workunit.client.0.smithi066.stdout:3/358: mknod d0/d2/d1d/d87/d6b/c8c 0 2024-09-12T22:49:55.452 INFO:tasks.workunit.client.0.smithi066.stdout:8/402: dread d17/d2c/f32 [0,4194304] 0 2024-09-12T22:49:55.452 INFO:tasks.workunit.client.0.smithi066.stdout:6/462: dread - d6/d20/d50/f6c zero size 2024-09-12T22:49:55.453 INFO:tasks.workunit.client.0.smithi066.stdout:4/382: dread d5/f4f [0,4194304] 0 2024-09-12T22:49:55.453 INFO:tasks.workunit.client.0.smithi066.stdout:5/447: dread d5/d15/f17 [0,4194304] 0 2024-09-12T22:49:55.453 INFO:tasks.workunit.client.0.smithi066.stdout:3/359: fdatasync d0/d2/d7/d13/f19 0 2024-09-12T22:49:55.455 INFO:tasks.workunit.client.0.smithi066.stdout:7/353: dread d0/f5 [0,4194304] 0 2024-09-12T22:49:55.455 INFO:tasks.workunit.client.0.smithi066.stdout:9/372: write d9/dc/d36/f71 [3620644,94185] 0 2024-09-12T22:49:55.455 INFO:tasks.workunit.client.0.smithi066.stdout:6/463: mknod d6/d20/ca4 0 2024-09-12T22:49:55.456 INFO:tasks.workunit.client.0.smithi066.stdout:4/383: unlink d5/d8/d16/d1b/d1e/d5a/c82 0 2024-09-12T22:49:55.456 INFO:tasks.workunit.client.0.smithi066.stdout:0/391: write d1/d36/f79 [640873,124597] 0 2024-09-12T22:49:55.456 INFO:tasks.workunit.client.0.smithi066.stdout:5/448: creat d5/d11/d21/f7f x:0 0 0 2024-09-12T22:49:55.456 INFO:tasks.workunit.client.0.smithi066.stdout:7/354: creat d0/d19/d26/d48/f71 x:0 0 0 2024-09-12T22:49:55.457 INFO:tasks.workunit.client.0.smithi066.stdout:9/373: creat d9/dc/d23/f79 x:0 0 0 2024-09-12T22:49:55.459 INFO:tasks.workunit.client.0.smithi066.stdout:4/384: creat d5/d8/d16/d1b/d1e/d1f/d7c/f83 x:0 0 0 2024-09-12T22:49:55.461 INFO:tasks.workunit.client.0.smithi066.stdout:6/464: dread d6/d7/f39 [0,4194304] 0 2024-09-12T22:49:55.462 INFO:tasks.workunit.client.0.smithi066.stdout:3/360: truncate d0/d2/d7/d13/d43/f50 1930750 0 2024-09-12T22:49:55.463 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:55.461+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:55.463 INFO:tasks.workunit.client.0.smithi066.stdout:9/374: truncate d9/dc/d36/f63 243837 0 2024-09-12T22:49:55.463 INFO:tasks.workunit.client.0.smithi066.stdout:5/449: dread d5/d11/f43 [0,4194304] 0 2024-09-12T22:49:55.463 INFO:tasks.workunit.client.0.smithi066.stdout:4/385: fsync d5/d8/d10/de/d2d/d64/f6c 0 2024-09-12T22:49:55.464 INFO:tasks.workunit.client.0.smithi066.stdout:9/375: symlink d9/dc/l7a 0 2024-09-12T22:49:55.464 INFO:tasks.workunit.client.0.smithi066.stdout:5/450: dread - d5/d11/d21/f4a zero size 2024-09-12T22:49:55.464 INFO:tasks.workunit.client.0.smithi066.stdout:3/361: truncate d0/d2/d7/d29/f3d 4355981 0 2024-09-12T22:49:55.465 INFO:tasks.workunit.client.0.smithi066.stdout:0/392: dwrite d1/d8/d1c/dd/f44 [0,4194304] 0 2024-09-12T22:49:55.465 INFO:tasks.workunit.client.0.smithi066.stdout:9/376: chown f8 0 1 2024-09-12T22:49:55.465 INFO:tasks.workunit.client.0.smithi066.stdout:9/377: stat d9/fa 0 2024-09-12T22:49:55.465 INFO:tasks.workunit.client.0.smithi066.stdout:5/451: chown d5/d11/d21/f47 5 1 2024-09-12T22:49:55.467 INFO:tasks.workunit.client.0.smithi066.stdout:6/465: dread d6/f4b [0,4194304] 0 2024-09-12T22:49:55.467 INFO:tasks.workunit.client.0.smithi066.stdout:4/386: rename d5/d8/d60 to d5/d8/d16/d1b/d1e/d38/d84 0 2024-09-12T22:49:55.467 INFO:tasks.workunit.client.0.smithi066.stdout:3/362: creat d0/d2/d1d/d87/f8d x:0 0 0 2024-09-12T22:49:55.467 INFO:tasks.workunit.client.0.smithi066.stdout:0/393: stat d1/d5b/d6d/l6f 0 2024-09-12T22:49:55.469 INFO:tasks.workunit.client.0.smithi066.stdout:1/312: dread d0/dc/f17 [0,4194304] 0 2024-09-12T22:49:55.470 INFO:tasks.workunit.client.0.smithi066.stdout:9/378: truncate d9/dc/f38 591715 0 2024-09-12T22:49:55.470 INFO:tasks.workunit.client.0.smithi066.stdout:6/466: fdatasync d6/d7/dc/f43 0 2024-09-12T22:49:55.471 INFO:tasks.workunit.client.0.smithi066.stdout:0/394: rename d1/d8/d1c/d56/f7c to d1/d36/f8b 0 2024-09-12T22:49:55.471 INFO:tasks.workunit.client.0.smithi066.stdout:1/313: mknod d0/dc/d44/c5b 0 2024-09-12T22:49:55.472 INFO:tasks.workunit.client.0.smithi066.stdout:3/363: rename d0/d2/d1d/d87/d40/d44/l81 to d0/d2/d1d/d87/d40/d44/l8e 0 2024-09-12T22:49:55.472 INFO:tasks.workunit.client.0.smithi066.stdout:0/395: read - d1/d8/d1c/d13/d2f/f4a zero size 2024-09-12T22:49:55.473 INFO:tasks.workunit.client.0.smithi066.stdout:1/314: write d0/d36/d57/f50 [3086828,37308] 0 2024-09-12T22:49:55.473 INFO:tasks.workunit.client.0.smithi066.stdout:6/467: link d6/d23/d25/d4e/l5a d6/d20/d32/d3c/la5 0 2024-09-12T22:49:55.473 INFO:tasks.workunit.client.0.smithi066.stdout:5/452: truncate d5/d11/f1b 4880892 0 2024-09-12T22:49:55.474 INFO:tasks.workunit.client.0.smithi066.stdout:3/364: symlink d0/d2/d1d/d87/l8f 0 2024-09-12T22:49:55.475 INFO:tasks.workunit.client.0.smithi066.stdout:2/374: dread d1/f6 [0,4194304] 0 2024-09-12T22:49:55.475 INFO:tasks.workunit.client.0.smithi066.stdout:0/396: mkdir d1/d5b/d6d/d8c 0 2024-09-12T22:49:55.476 INFO:tasks.workunit.client.0.smithi066.stdout:5/453: chown d5/d11/d23 18241760 1 2024-09-12T22:49:55.476 INFO:tasks.workunit.client.0.smithi066.stdout:7/355: dread d0/f4b [0,4194304] 0 2024-09-12T22:49:55.477 INFO:tasks.workunit.client.0.smithi066.stdout:9/379: dwrite d9/d31/f72 [0,4194304] 0 2024-09-12T22:49:55.477 INFO:tasks.workunit.client.0.smithi066.stdout:6/468: link d6/d23/d25/d4e/f73 d6/d20/d32/d3c/fa6 0 2024-09-12T22:49:55.477 INFO:tasks.workunit.client.0.smithi066.stdout:0/397: write d1/d8/d1f/d30/f55 [3164760,14454] 0 2024-09-12T22:49:55.478 INFO:tasks.workunit.client.0.smithi066.stdout:7/356: sync 2024-09-12T22:49:55.479 INFO:tasks.workunit.client.0.smithi066.stdout:9/380: fdatasync d9/f6e 0 2024-09-12T22:49:55.479 INFO:tasks.workunit.client.0.smithi066.stdout:2/375: rename d1/d11/l22 to d1/d44/d51/d70/l7d 0 2024-09-12T22:49:55.480 INFO:tasks.workunit.client.0.smithi066.stdout:6/469: readlink d6/l10 0 2024-09-12T22:49:55.481 INFO:tasks.workunit.client.0.smithi066.stdout:0/398: symlink d1/d8/d1c/d13/d2f/l8d 0 2024-09-12T22:49:55.481 INFO:tasks.workunit.client.0.smithi066.stdout:9/381: mkdir d9/d31/d58/d7b 0 2024-09-12T22:49:55.482 INFO:tasks.workunit.client.0.smithi066.stdout:1/315: truncate d0/f16 2743361 0 2024-09-12T22:49:55.482 INFO:tasks.workunit.client.0.smithi066.stdout:8/403: dread d17/d2c/f34 [0,4194304] 0 2024-09-12T22:49:55.482 INFO:tasks.workunit.client.0.smithi066.stdout:6/470: readlink d6/d23/d25/d2c/l53 0 2024-09-12T22:49:55.483 INFO:tasks.workunit.client.0.smithi066.stdout:5/454: dread d5/f36 [0,4194304] 0 2024-09-12T22:49:55.485 INFO:tasks.workunit.client.0.smithi066.stdout:3/365: dwrite d0/d2/d7/d13/d31/f83 [0,4194304] 0 2024-09-12T22:49:55.485 INFO:tasks.workunit.client.0.smithi066.stdout:6/471: write d6/d49/f2f [3806208,130596] 0 2024-09-12T22:49:55.485 INFO:tasks.workunit.client.0.smithi066.stdout:1/316: symlink d0/d28/l5c 0 2024-09-12T22:49:55.485 INFO:tasks.workunit.client.0.smithi066.stdout:5/455: stat d5/d11/f54 0 2024-09-12T22:49:55.485 INFO:tasks.workunit.client.0.smithi066.stdout:9/382: truncate d9/dc/dd/f5f 499111 0 2024-09-12T22:49:55.485 INFO:tasks.workunit.client.0.smithi066.stdout:0/399: rmdir d1/d5b/d6d/d8c 0 2024-09-12T22:49:55.488 INFO:tasks.workunit.client.0.smithi066.stdout:8/404: readlink d17/d49/l5d 0 2024-09-12T22:49:55.488 INFO:tasks.workunit.client.0.smithi066.stdout:6/472: write d6/d78/f3f [2015399,95940] 0 2024-09-12T22:49:55.489 INFO:tasks.workunit.client.0.smithi066.stdout:3/366: symlink d0/d2/d68/l90 0 2024-09-12T22:49:55.489 INFO:tasks.workunit.client.0.smithi066.stdout:5/456: creat d5/d11/d5f/f80 x:0 0 0 2024-09-12T22:49:55.489 INFO:tasks.workunit.client.0.smithi066.stdout:1/317: rename d0/dc/l2f to d0/dc/l5d 0 2024-09-12T22:49:55.489 INFO:tasks.workunit.client.0.smithi066.stdout:7/357: dwrite d0/d19/d24/d33/d27/f57 [4194304,4194304] 0 2024-09-12T22:49:55.489 INFO:tasks.workunit.client.0.smithi066.stdout:3/367: mkdir d0/d2/d1d/d87/d40/d44/d55/d91 0 2024-09-12T22:49:55.490 INFO:tasks.workunit.client.0.smithi066.stdout:2/376: read d1/dd/d3d/f4a [1486975,42575] 0 2024-09-12T22:49:55.491 INFO:tasks.workunit.client.0.smithi066.stdout:3/368: mkdir d0/d2/d7/d92 0 2024-09-12T22:49:55.492 INFO:tasks.workunit.client.0.smithi066.stdout:9/383: dread d9/dc/f40 [0,4194304] 0 2024-09-12T22:49:55.493 INFO:tasks.workunit.client.0.smithi066.stdout:6/473: rename d6/d7/dc/f5c to d6/d20/d32/d3c/fa7 0 2024-09-12T22:49:55.493 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:55.493 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:55.494 INFO:tasks.workunit.client.0.smithi066.stdout:1/318: symlink d0/dc/l5e 0 2024-09-12T22:49:55.494 INFO:tasks.workunit.client.0.smithi066.stdout:3/369: mknod d0/d2/d1d/d87/d6b/c93 0 2024-09-12T22:49:55.495 INFO:tasks.workunit.client.0.smithi066.stdout:0/400: dwrite d1/d8/d1f/d30/f5c [0,4194304] 0 2024-09-12T22:49:55.495 INFO:tasks.workunit.client.0.smithi066.stdout:6/474: creat d6/d23/d25/d88/fa8 x:0 0 0 2024-09-12T22:49:55.496 INFO:tasks.workunit.client.0.smithi066.stdout:7/358: dread d0/d6/f8 [0,4194304] 0 2024-09-12T22:49:55.497 INFO:tasks.workunit.client.0.smithi066.stdout:8/405: dwrite d17/f27 [0,4194304] 0 2024-09-12T22:49:55.498 INFO:tasks.workunit.client.0.smithi066.stdout:3/370: write d0/d2/fa [118415,36782] 0 2024-09-12T22:49:55.499 INFO:tasks.workunit.client.0.smithi066.stdout:8/406: symlink d17/d40/d47/d66/l7d 0 2024-09-12T22:49:55.500 INFO:tasks.workunit.client.0.smithi066.stdout:8/407: write d17/d1b/f2e [1128138,87557] 0 2024-09-12T22:49:55.501 INFO:tasks.workunit.client.0.smithi066.stdout:6/475: link d6/d20/d99/fa3 d6/d23/d62/d79/fa9 0 2024-09-12T22:49:55.501 INFO:tasks.workunit.client.0.smithi066.stdout:7/359: mknod d0/d19/d24/d33/c72 0 2024-09-12T22:49:55.503 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:55.504 INFO:tasks.workunit.client.0.smithi066.stdout:7/360: symlink d0/d19/d60/d64/l73 0 2024-09-12T22:49:55.504 INFO:tasks.workunit.client.0.smithi066.stdout:3/371: link d0/d2/d1d/l32 d0/d2/d6/l94 0 2024-09-12T22:49:55.504 INFO:tasks.workunit.client.0.smithi066.stdout:8/408: rename d17/l46 to d17/d40/d74/l7e 0 2024-09-12T22:49:55.504 INFO:tasks.workunit.client.0.smithi066.stdout:0/401: getdents d1/d8/d1f 0 2024-09-12T22:49:55.504 INFO:tasks.workunit.client.0.smithi066.stdout:8/409: symlink d17/d49/l7f 0 2024-09-12T22:49:55.505 INFO:tasks.workunit.client.0.smithi066.stdout:3/372: chown d0/d1b/c6c 1779001 1 2024-09-12T22:49:55.505 INFO:tasks.workunit.client.0.smithi066.stdout:7/361: mkdir d0/d19/d74 0 2024-09-12T22:49:55.505 INFO:tasks.workunit.client.0.smithi066.stdout:2/377: truncate d1/d2a/f34 624457 0 2024-09-12T22:49:55.505 INFO:tasks.workunit.client.0.smithi066.stdout:5/457: dread d5/d11/d23/f56 [0,4194304] 0 2024-09-12T22:49:55.505 INFO:tasks.workunit.client.0.smithi066.stdout:0/402: rename d1/d8/f7f to d1/d36/f8e 0 2024-09-12T22:49:55.506 INFO:tasks.workunit.client.0.smithi066.stdout:4/387: dread d5/f24 [0,4194304] 0 2024-09-12T22:49:55.506 INFO:tasks.workunit.client.0.smithi066.stdout:4/388: sync 2024-09-12T22:49:55.506 INFO:tasks.workunit.client.0.smithi066.stdout:2/378: fdatasync d1/f6 0 2024-09-12T22:49:55.506 INFO:tasks.workunit.client.0.smithi066.stdout:3/373: creat d0/d2/d1d/d87/d40/f95 x:0 0 0 2024-09-12T22:49:55.506 INFO:tasks.workunit.client.0.smithi066.stdout:5/458: truncate d5/f12 5003734 0 2024-09-12T22:49:55.506 INFO:tasks.workunit.client.0.smithi066.stdout:7/362: rename d0/d6/c44 to d0/d19/d24/d33/d27/c75 0 2024-09-12T22:49:55.507 INFO:tasks.workunit.client.0.smithi066.stdout:4/389: write d5/d8/d10/f1a [484410,26098] 0 2024-09-12T22:49:55.508 INFO:tasks.workunit.client.0.smithi066.stdout:2/379: getdents d1/d44 0 2024-09-12T22:49:55.509 INFO:tasks.workunit.client.0.smithi066.stdout:5/459: write d5/d11/d21/d4d/f6d [2789567,123570] 0 2024-09-12T22:49:55.509 INFO:tasks.workunit.client.0.smithi066.stdout:3/374: creat d0/d2/d1d/d87/d40/f96 x:0 0 0 2024-09-12T22:49:55.510 INFO:tasks.workunit.client.0.smithi066.stdout:1/319: dwrite d0/f16 [0,4194304] 0 2024-09-12T22:49:55.511 INFO:tasks.workunit.client.0.smithi066.stdout:4/390: write d5/d8/d16/d1b/d73/f76 [640214,123771] 0 2024-09-12T22:49:55.512 INFO:tasks.workunit.client.0.smithi066.stdout:0/403: dwrite d1/d8/d1f/f46 [0,4194304] 0 2024-09-12T22:49:55.512 INFO:tasks.workunit.client.0.smithi066.stdout:4/391: fdatasync d5/d8/d10/f1a 0 2024-09-12T22:49:55.514 INFO:tasks.workunit.client.0.smithi066.stdout:8/410: write d17/f42 [312997,82337] 0 2024-09-12T22:49:55.515 INFO:tasks.workunit.client.0.smithi066.stdout:8/411: fdatasync d17/d40/f4c 0 2024-09-12T22:49:55.515 INFO:tasks.workunit.client.0.smithi066.stdout:2/380: dwrite d1/d44/f4b [0,4194304] 0 2024-09-12T22:49:55.516 INFO:tasks.workunit.client.0.smithi066.stdout:3/375: creat d0/d2/d7/f97 x:0 0 0 2024-09-12T22:49:55.516 INFO:tasks.workunit.client.0.smithi066.stdout:0/404: mkdir d1/d36/d8f 0 2024-09-12T22:49:55.517 INFO:tasks.workunit.client.0.smithi066.stdout:3/376: write d0/d1b/f72 [638302,66050] 0 2024-09-12T22:49:55.519 INFO:tasks.workunit.client.0.smithi066.stdout:2/381: dread d1/d44/f45 [0,4194304] 0 2024-09-12T22:49:55.519 INFO:tasks.workunit.client.0.smithi066.stdout:9/384: dread d9/dc/f1f [0,4194304] 0 2024-09-12T22:49:55.520 INFO:tasks.workunit.client.0.smithi066.stdout:1/320: truncate d0/dc/f17 1327341 0 2024-09-12T22:49:55.522 INFO:tasks.workunit.client.0.smithi066.stdout:8/412: truncate d17/d1b/f1e 4957532 0 2024-09-12T22:49:55.522 INFO:tasks.workunit.client.0.smithi066.stdout:5/460: link c0 d5/de/d57/c81 0 2024-09-12T22:49:55.522 INFO:tasks.workunit.client.0.smithi066.stdout:9/385: mknod d9/dc/dd/c7c 0 2024-09-12T22:49:55.522 INFO:tasks.workunit.client.0.smithi066.stdout:0/405: creat d1/d8/d1c/d13/d2f/d8a/f90 x:0 0 0 2024-09-12T22:49:55.522 INFO:tasks.workunit.client.0.smithi066.stdout:1/321: stat d0/d28/f4f 0 2024-09-12T22:49:55.522 INFO:tasks.workunit.client.0.smithi066.stdout:3/377: chown d0/d2/d7/d13/c89 25 1 2024-09-12T22:49:55.522 INFO:tasks.workunit.client.0.smithi066.stdout:4/392: getdents d5/d8/d16/d1b/d1e/d5a 0 2024-09-12T22:49:55.523 INFO:tasks.workunit.client.0.smithi066.stdout:2/382: rename d1/d2a to d1/d11/d26/d4f/d5f/d61/d7e 0 2024-09-12T22:49:55.523 INFO:tasks.workunit.client.0.smithi066.stdout:0/406: mknod d1/c91 0 2024-09-12T22:49:55.523 INFO:tasks.workunit.client.0.smithi066.stdout:8/413: creat d17/d49/d4b/d57/f80 x:0 0 0 2024-09-12T22:49:55.523 INFO:tasks.workunit.client.0.smithi066.stdout:5/461: symlink d5/d11/l82 0 2024-09-12T22:49:55.524 INFO:tasks.workunit.client.0.smithi066.stdout:9/386: rename d9/dc/dd/f1d to d9/d31/d77/f7d 0 2024-09-12T22:49:55.524 INFO:tasks.workunit.client.0.smithi066.stdout:5/462: read d5/d11/f54 [1216853,107913] 0 2024-09-12T22:49:55.524 INFO:tasks.workunit.client.0.smithi066.stdout:2/383: creat d1/d11/d53/f7f x:0 0 0 2024-09-12T22:49:55.524 INFO:tasks.workunit.client.0.smithi066.stdout:1/322: truncate d0/d36/d57/f3e 609587 0 2024-09-12T22:49:55.524 INFO:tasks.workunit.client.0.smithi066.stdout:8/414: readlink d17/d49/d4b/l6a 0 2024-09-12T22:49:55.525 INFO:tasks.workunit.client.0.smithi066.stdout:0/407: fsync d1/d8/d1c/dd/f28 0 2024-09-12T22:49:55.525 INFO:tasks.workunit.client.0.smithi066.stdout:6/476: dread d6/d23/d25/f2e [0,4194304] 0 2024-09-12T22:49:55.525 INFO:tasks.workunit.client.0.smithi066.stdout:2/384: rmdir d1 39 2024-09-12T22:49:55.526 INFO:tasks.workunit.client.0.smithi066.stdout:8/415: unlink d17/d49/c58 0 2024-09-12T22:49:55.526 INFO:tasks.workunit.client.0.smithi066.stdout:6/477: chown d6/c3b 17196484 1 2024-09-12T22:49:55.527 INFO:tasks.workunit.client.0.smithi066.stdout:6/478: sync 2024-09-12T22:49:55.529 INFO:tasks.workunit.client.0.smithi066.stdout:4/393: dwrite d5/d8/d10/f36 [0,4194304] 0 2024-09-12T22:49:55.533 INFO:tasks.workunit.client.0.smithi066.stdout:9/387: truncate d9/dc/d36/f39 25293 0 2024-09-12T22:49:55.533 INFO:tasks.workunit.client.0.smithi066.stdout:0/408: truncate d1/d8/f62 838827 0 2024-09-12T22:49:55.533 INFO:tasks.workunit.client.0.smithi066.stdout:8/416: dwrite d17/d1b/f5a [0,4194304] 0 2024-09-12T22:49:55.534 INFO:tasks.workunit.client.0.smithi066.stdout:1/323: truncate d0/d36/d57/f27 336821 0 2024-09-12T22:49:55.534 INFO:tasks.workunit.client.0.smithi066.stdout:9/388: rmdir d9 39 2024-09-12T22:49:55.534 INFO:tasks.workunit.client.0.smithi066.stdout:8/417: fsync d17/d2c/f38 0 2024-09-12T22:49:55.536 INFO:tasks.workunit.client.0.smithi066.stdout:4/394: rename d5/d8/d16/d1b/f77 to d5/d8/d16/d1b/d1e/d5a/f85 0 2024-09-12T22:49:55.537 INFO:tasks.workunit.client.0.smithi066.stdout:9/389: write d9/dc/f56 [584343,95688] 0 2024-09-12T22:49:55.538 INFO:tasks.workunit.client.0.smithi066.stdout:9/390: readlink d9/d31/d34/d4d/l59 0 2024-09-12T22:49:55.538 INFO:tasks.workunit.client.0.smithi066.stdout:3/378: dwrite d0/d2/f24 [0,4194304] 0 2024-09-12T22:49:55.540 INFO:tasks.workunit.client.0.smithi066.stdout:0/409: dwrite d1/d8/d1f/d30/f78 [0,4194304] 0 2024-09-12T22:49:55.542 INFO:tasks.workunit.client.0.smithi066.stdout:4/395: mkdir d5/d8/d16/d1b/d1e/d38/d84/d6f/d6e/d86 0 2024-09-12T22:49:55.544 INFO:tasks.workunit.client.0.smithi066.stdout:0/410: truncate d1/d8/d1c/dd/f89 40047 0 2024-09-12T22:49:55.546 INFO:tasks.workunit.client.0.smithi066.stdout:0/411: creat d1/d8/d1c/d13/d2f/f92 x:0 0 0 2024-09-12T22:49:55.546 INFO:tasks.workunit.client.0.smithi066.stdout:3/379: dwrite d0/d2/d7/f1a [0,4194304] 0 2024-09-12T22:49:55.547 INFO:tasks.workunit.client.0.smithi066.stdout:9/391: dwrite d9/dc/d23/f30 [0,4194304] 0 2024-09-12T22:49:55.548 INFO:tasks.workunit.client.0.smithi066.stdout:3/380: creat d0/d2/f98 x:0 0 0 2024-09-12T22:49:55.548 INFO:tasks.workunit.client.0.smithi066.stdout:9/392: stat d9/dc/dd/f50 0 2024-09-12T22:49:55.548 INFO:tasks.workunit.client.0.smithi066.stdout:3/381: chown d0/d2/d7/d13/d31 9 1 2024-09-12T22:49:55.549 INFO:tasks.workunit.client.0.smithi066.stdout:3/382: readlink d0/d2/d7/d13/l75 0 2024-09-12T22:49:55.549 INFO:tasks.workunit.client.0.smithi066.stdout:3/383: dread - d0/d2/d7/f97 zero size 2024-09-12T22:49:55.550 INFO:tasks.workunit.client.0.smithi066.stdout:3/384: truncate d0/f38 4639486 0 2024-09-12T22:49:55.551 INFO:tasks.workunit.client.0.smithi066.stdout:4/396: dread d5/d8/d16/d1b/d1e/d5a/f67 [0,4194304] 0 2024-09-12T22:49:55.553 INFO:tasks.workunit.client.0.smithi066.stdout:4/397: readlink d5/l25 0 2024-09-12T22:49:55.554 INFO:tasks.workunit.client.0.smithi066.stdout:9/393: dwrite d9/dc/d23/f30 [0,4194304] 0 2024-09-12T22:49:55.554 INFO:tasks.workunit.client.0.smithi066.stdout:0/412: truncate d1/d8/d1c/d56/f5e 4838694 0 2024-09-12T22:49:55.555 INFO:tasks.workunit.client.0.smithi066.stdout:9/394: read - d9/dc/dd/f65 zero size 2024-09-12T22:49:55.555 INFO:tasks.workunit.client.0.smithi066.stdout:7/363: dread d0/d6/f21 [0,4194304] 0 2024-09-12T22:49:55.556 INFO:tasks.workunit.client.0.smithi066.stdout:0/413: symlink d1/d8/d1f/d47/l93 0 2024-09-12T22:49:55.556 INFO:tasks.workunit.client.0.smithi066.stdout:9/395: dread - d9/d31/d58/f70 zero size 2024-09-12T22:49:55.556 INFO:tasks.workunit.client.0.smithi066.stdout:4/398: truncate d5/d8/d16/d1b/d1e/d38/f3f 243109 0 2024-09-12T22:49:55.558 INFO:tasks.workunit.client.0.smithi066.stdout:9/396: mknod d9/dc/c7e 0 2024-09-12T22:49:55.559 INFO:tasks.workunit.client.0.smithi066.stdout:6/479: dread d6/d20/f18 [0,4194304] 0 2024-09-12T22:49:55.559 INFO:tasks.workunit.client.0.smithi066.stdout:9/397: sync 2024-09-12T22:49:55.559 INFO:tasks.workunit.client.0.smithi066.stdout:9/398: mkdir d9/d31/d58/d7f 0 2024-09-12T22:49:55.560 INFO:tasks.workunit.client.0.smithi066.stdout:1/324: dread d0/d9/f43 [0,4194304] 0 2024-09-12T22:49:55.560 INFO:tasks.workunit.client.0.smithi066.stdout:6/480: write d6/d20/d50/f6c [114831,62137] 0 2024-09-12T22:49:55.560 INFO:tasks.workunit.client.0.smithi066.stdout:4/399: truncate d5/d8/d10/de/f18 6667963 0 2024-09-12T22:49:55.561 INFO:tasks.workunit.client.0.smithi066.stdout:9/399: write d9/dc/d36/f6b [623588,127473] 0 2024-09-12T22:49:55.561 INFO:tasks.workunit.client.0.smithi066.stdout:1/325: fdatasync d0/d36/d57/f2b 0 2024-09-12T22:49:55.562 INFO:tasks.workunit.client.0.smithi066.stdout:6/481: chown d6/d20/d32/c9a 39146482 1 2024-09-12T22:49:55.562 INFO:tasks.workunit.client.0.smithi066.stdout:7/364: dwrite d0/d19/d26/d48/f58 [0,4194304] 0 2024-09-12T22:49:55.562 INFO:tasks.workunit.client.0.smithi066.stdout:4/400: mkdir d5/d87 0 2024-09-12T22:49:55.563 INFO:tasks.workunit.client.0.smithi066.stdout:6/482: stat d6/d23/d62/l8d 0 2024-09-12T22:49:55.563 INFO:tasks.workunit.client.0.smithi066.stdout:1/326: write d0/dc/d44/f54 [826760,43462] 0 2024-09-12T22:49:55.567 INFO:tasks.workunit.client.0.smithi066.stdout:4/401: fsync d5/d8/d16/d1b/d1e/d5a/f85 0 2024-09-12T22:49:55.567 INFO:tasks.workunit.client.0.smithi066.stdout:8/418: dread d17/d1b/f23 [0,4194304] 0 2024-09-12T22:49:55.568 INFO:tasks.workunit.client.0.smithi066.stdout:1/327: getdents d0/d36/d57 0 2024-09-12T22:49:55.568 INFO:tasks.workunit.client.0.smithi066.stdout:4/402: chown d5/d8/c63 39198143 1 2024-09-12T22:49:55.569 INFO:tasks.workunit.client.0.smithi066.stdout:8/419: fsync d17/f70 0 2024-09-12T22:49:55.569 INFO:tasks.workunit.client.0.smithi066.stdout:5/463: dread d5/f24 [0,4194304] 0 2024-09-12T22:49:55.569 INFO:tasks.workunit.client.0.smithi066.stdout:1/328: creat d0/d28/f5f x:0 0 0 2024-09-12T22:49:55.570 INFO:tasks.workunit.client.0.smithi066.stdout:8/420: write d17/d2c/f38 [2743400,37698] 0 2024-09-12T22:49:55.571 INFO:tasks.workunit.client.0.smithi066.stdout:4/403: creat d5/d8/d16/d1b/f88 x:0 0 0 2024-09-12T22:49:55.572 INFO:tasks.workunit.client.0.smithi066.stdout:8/421: mkdir d17/d40/d47/d81 0 2024-09-12T22:49:55.572 INFO:tasks.workunit.client.0.smithi066.stdout:6/483: dwrite d6/f4b [0,4194304] 0 2024-09-12T22:49:55.574 INFO:tasks.workunit.client.0.smithi066.stdout:4/404: creat d5/d8/d10/de/d2d/d64/f89 x:0 0 0 2024-09-12T22:49:55.574 INFO:tasks.workunit.client.0.smithi066.stdout:3/385: dread d0/d2/d7/d29/f42 [0,4194304] 0 2024-09-12T22:49:55.574 INFO:tasks.workunit.client.0.smithi066.stdout:8/422: read - d17/d49/d4b/d57/d5e/d62/f67 zero size 2024-09-12T22:49:55.575 INFO:tasks.workunit.client.0.smithi066.stdout:6/484: link d6/d23/d25/f9f d6/d7/faa 0 2024-09-12T22:49:55.576 INFO:tasks.workunit.client.0.smithi066.stdout:9/400: fsync d9/dc/d36/f6b 0 2024-09-12T22:49:55.576 INFO:tasks.workunit.client.0.smithi066.stdout:3/386: symlink d0/d2/d6/d7a/l99 0 2024-09-12T22:49:55.576 INFO:tasks.workunit.client.0.smithi066.stdout:4/405: write d5/d8/d10/f36 [1690454,121968] 0 2024-09-12T22:49:55.577 INFO:tasks.workunit.client.0.smithi066.stdout:5/464: dwrite d5/d14/f69 [0,4194304] 0 2024-09-12T22:49:55.577 INFO:tasks.workunit.client.0.smithi066.stdout:8/423: rename c7 to d17/d49/d4b/d57/c82 0 2024-09-12T22:49:55.578 INFO:tasks.workunit.client.0.smithi066.stdout:2/385: dread d1/d11/f25 [0,4194304] 0 2024-09-12T22:49:55.579 INFO:tasks.workunit.client.0.smithi066.stdout:1/329: write d0/dc/fe [1068800,102545] 0 2024-09-12T22:49:55.579 INFO:tasks.workunit.client.0.smithi066.stdout:3/387: rmdir d0/d2/d1d/d87/d40/d44 39 2024-09-12T22:49:55.580 INFO:tasks.workunit.client.0.smithi066.stdout:5/465: unlink d5/de/d50/d42/f48 0 2024-09-12T22:49:55.580 INFO:tasks.workunit.client.0.smithi066.stdout:9/401: creat d9/dc/d46/f80 x:0 0 0 2024-09-12T22:49:55.581 INFO:tasks.workunit.client.0.smithi066.stdout:8/424: creat d17/d49/d4b/d57/d5e/d62/f83 x:0 0 0 2024-09-12T22:49:55.581 INFO:tasks.workunit.client.0.smithi066.stdout:1/330: truncate d0/f13 2088649 0 2024-09-12T22:49:55.581 INFO:tasks.workunit.client.0.smithi066.stdout:2/386: truncate d1/dd/f2c 4760701 0 2024-09-12T22:49:55.582 INFO:tasks.workunit.client.0.smithi066.stdout:4/406: rename d5/l29 to d5/d8/d16/d1b/d1e/d38/d84/d6f/l8a 0 2024-09-12T22:49:55.582 INFO:tasks.workunit.client.0.smithi066.stdout:3/388: symlink d0/d2/d1d/d87/l9a 0 2024-09-12T22:49:55.582 INFO:tasks.workunit.client.0.smithi066.stdout:9/402: mknod d9/dc/d46/c81 0 2024-09-12T22:49:55.582 INFO:tasks.workunit.client.0.smithi066.stdout:8/425: chown d17/d40/d47/c5c 9196707 1 2024-09-12T22:49:55.583 INFO:tasks.workunit.client.0.smithi066.stdout:2/387: write d1/f6b [378647,29581] 0 2024-09-12T22:49:55.583 INFO:tasks.workunit.client.0.smithi066.stdout:4/407: write d5/f46 [139936,52776] 0 2024-09-12T22:49:55.585 INFO:tasks.workunit.client.0.smithi066.stdout:6/485: dwrite d6/d20/d99/fa3 [0,4194304] 0 2024-09-12T22:49:55.585 INFO:tasks.workunit.client.0.smithi066.stdout:3/389: creat d0/d2/d7/d13/d43/d74/f9b x:0 0 0 2024-09-12T22:49:55.585 INFO:tasks.workunit.client.0.smithi066.stdout:0/414: dread d1/d8/d1f/d25/f34 [0,4194304] 0 2024-09-12T22:49:55.586 INFO:tasks.workunit.client.0.smithi066.stdout:8/426: symlink d17/d49/d4b/d4e/l84 0 2024-09-12T22:49:55.586 INFO:tasks.workunit.client.0.smithi066.stdout:6/486: dread - d6/d20/d99/f90 zero size 2024-09-12T22:49:55.587 INFO:tasks.workunit.client.0.smithi066.stdout:2/388: creat d1/dd/d12/d18/f80 x:0 0 0 2024-09-12T22:49:55.587 INFO:tasks.workunit.client.0.smithi066.stdout:0/415: fdatasync d1/d8/d1f/f7b 0 2024-09-12T22:49:55.587 INFO:tasks.workunit.client.0.smithi066.stdout:9/403: link d9/dc/dd/f5f d9/d31/d58/f82 0 2024-09-12T22:49:55.589 INFO:tasks.workunit.client.0.smithi066.stdout:3/390: write d0/d2/d1d/d87/f8d [256548,84182] 0 2024-09-12T22:49:55.589 INFO:tasks.workunit.client.0.smithi066.stdout:2/389: read - d1/d11/d53/f7f zero size 2024-09-12T22:49:55.589 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:55.588+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:55.590 INFO:tasks.workunit.client.0.smithi066.stdout:6/487: write d6/d23/d25/d88/fa8 [1019306,80664] 0 2024-09-12T22:49:55.590 INFO:tasks.workunit.client.0.smithi066.stdout:9/404: write f8 [3802221,126658] 0 2024-09-12T22:49:55.590 INFO:tasks.workunit.client.0.smithi066.stdout:1/331: dwrite d0/d36/d57/f3d [0,4194304] 0 2024-09-12T22:49:55.591 INFO:tasks.workunit.client.0.smithi066.stdout:8/427: link d17/f29 d17/d40/d47/d66/f85 0 2024-09-12T22:49:55.593 INFO:tasks.workunit.client.0.smithi066.stdout:9/405: creat d9/dc/d23/f83 x:0 0 0 2024-09-12T22:49:55.593 INFO:tasks.workunit.client.0.smithi066.stdout:0/416: link d1/d5b/l5f d1/d8/d1f/d47/l94 0 2024-09-12T22:49:55.593 INFO:tasks.workunit.client.0.smithi066.stdout:7/365: dread d0/d19/d60/f3c [0,4194304] 0 2024-09-12T22:49:55.595 INFO:tasks.workunit.client.0.smithi066.stdout:7/366: stat d0/d19/d24/d33/d27/f57 0 2024-09-12T22:49:55.596 INFO:tasks.workunit.client.0.smithi066.stdout:4/408: dwrite d5/d8/d16/d1b/d1e/d38/f3f [0,4194304] 0 2024-09-12T22:49:55.596 INFO:tasks.workunit.client.0.smithi066.stdout:0/417: symlink d1/d8/d1c/d13/d2f/l95 0 2024-09-12T22:49:55.597 INFO:tasks.workunit.client.0.smithi066.stdout:3/391: creat d0/d2/d1d/d87/d40/d44/f9c x:0 0 0 2024-09-12T22:49:55.597 INFO:tasks.workunit.client.0.smithi066.stdout:9/406: write d9/d31/d34/f3b [3018334,79661] 0 2024-09-12T22:49:55.598 INFO:tasks.workunit.client.0.smithi066.stdout:7/367: chown d0/d19/d24/d33/c72 7 1 2024-09-12T22:49:55.598 INFO:tasks.workunit.client.0.smithi066.stdout:6/488: dwrite d6/d23/f3e [0,4194304] 0 2024-09-12T22:49:55.599 INFO:tasks.workunit.client.0.smithi066.stdout:1/332: truncate d0/d36/d57/f50 2235362 0 2024-09-12T22:49:55.599 INFO:tasks.workunit.client.0.smithi066.stdout:8/428: rename d17/d40/d47/d4d/f73 to d17/d1b/f86 0 2024-09-12T22:49:55.599 INFO:tasks.workunit.client.0.smithi066.stdout:9/407: unlink d9/dc/c7e 0 2024-09-12T22:49:55.599 INFO:tasks.workunit.client.0.smithi066.stdout:3/392: chown d0/d2/d1d/f85 161910705 1 2024-09-12T22:49:55.600 INFO:tasks.workunit.client.0.smithi066.stdout:6/489: mknod d6/d23/d62/cab 0 2024-09-12T22:49:55.600 INFO:tasks.workunit.client.0.smithi066.stdout:1/333: fsync d0/d9/f14 0 2024-09-12T22:49:55.600 INFO:tasks.workunit.client.0.smithi066.stdout:8/429: unlink d17/f21 0 2024-09-12T22:49:55.600 INFO:tasks.workunit.client.0.smithi066.stdout:1/334: chown d0/d28 0 1 2024-09-12T22:49:55.601 INFO:tasks.workunit.client.0.smithi066.stdout:1/335: write d0/f13 [430190,81004] 0 2024-09-12T22:49:55.603 INFO:tasks.workunit.client.0.smithi066.stdout:0/418: truncate d1/f7 1662943 0 2024-09-12T22:49:55.604 INFO:tasks.workunit.client.0.smithi066.stdout:7/368: truncate d0/d19/d60/f52 1761446 0 2024-09-12T22:49:55.604 INFO:tasks.workunit.client.0.smithi066.stdout:3/393: mknod d0/d2/d6/d7a/c9d 0 2024-09-12T22:49:55.604 INFO:tasks.workunit.client.0.smithi066.stdout:6/490: symlink d6/d23/d25/d2c/d85/lac 0 2024-09-12T22:49:55.605 INFO:tasks.workunit.client.0.smithi066.stdout:1/336: stat d0/dc/d33 0 2024-09-12T22:49:55.605 INFO:tasks.workunit.client.0.smithi066.stdout:8/430: mkdir d17/d40/d47/d4d/d87 0 2024-09-12T22:49:55.605 INFO:tasks.workunit.client.0.smithi066.stdout:0/419: dread - d1/d8/d1c/d13/f20 zero size 2024-09-12T22:49:55.605 INFO:tasks.workunit.client.0.smithi066.stdout:8/431: rmdir d17/d49 39 2024-09-12T22:49:55.605 INFO:tasks.workunit.client.0.smithi066.stdout:9/408: dread d9/dc/d36/f39 [0,4194304] 0 2024-09-12T22:49:55.605 INFO:tasks.workunit.client.0.smithi066.stdout:0/420: fdatasync d1/f7 0 2024-09-12T22:49:55.606 INFO:tasks.workunit.client.0.smithi066.stdout:6/491: creat d6/d20/d32/d3c/fad x:0 0 0 2024-09-12T22:49:55.606 INFO:tasks.workunit.client.0.smithi066.stdout:3/394: getdents d0/d2/d6 0 2024-09-12T22:49:55.606 INFO:tasks.workunit.client.0.smithi066.stdout:7/369: getdents d0/d19/d24/d33/d27 0 2024-09-12T22:49:55.607 INFO:tasks.workunit.client.0.smithi066.stdout:0/421: creat d1/d8/d1c/d56/f96 x:0 0 0 2024-09-12T22:49:55.608 INFO:tasks.workunit.client.0.smithi066.stdout:7/370: stat d0/d19/d26/f47 0 2024-09-12T22:49:55.611 INFO:tasks.workunit.client.0.smithi066.stdout:3/395: write d0/d2/d7/d13/d43/d74/f88 [582451,36530] 0 2024-09-12T22:49:55.611 INFO:tasks.workunit.client.0.smithi066.stdout:0/422: fdatasync d1/d8/d1c/d13/f20 0 2024-09-12T22:49:55.611 INFO:tasks.workunit.client.0.smithi066.stdout:7/371: mknod d0/d19/d24/c76 0 2024-09-12T22:49:55.612 INFO:tasks.workunit.client.0.smithi066.stdout:1/337: dwrite d0/dc/d1d/f39 [0,4194304] 0 2024-09-12T22:49:55.613 INFO:tasks.workunit.client.0.smithi066.stdout:3/396: write d0/d1b/f72 [446014,130042] 0 2024-09-12T22:49:55.614 INFO:tasks.workunit.client.0.smithi066.stdout:2/390: dread d1/d11/f19 [0,4194304] 0 2024-09-12T22:49:55.614 INFO:tasks.workunit.client.0.smithi066.stdout:9/409: dwrite d9/f53 [0,4194304] 0 2024-09-12T22:49:55.614 INFO:tasks.workunit.client.0.smithi066.stdout:1/338: creat d0/dc/d1d/f60 x:0 0 0 2024-09-12T22:49:55.615 INFO:tasks.workunit.client.0.smithi066.stdout:7/372: chown d0/d19/d24/d33/d27/c4c 1838 1 2024-09-12T22:49:55.616 INFO:tasks.workunit.client.0.smithi066.stdout:6/492: write d6/d23/d25/d4e/f73 [177467,73765] 0 2024-09-12T22:49:55.616 INFO:tasks.workunit.client.0.smithi066.stdout:8/432: dwrite d17/d40/d47/d66/f78 [0,4194304] 0 2024-09-12T22:49:55.616 INFO:tasks.workunit.client.0.smithi066.stdout:7/373: sync 2024-09-12T22:49:55.616 INFO:tasks.workunit.client.0.smithi066.stdout:2/391: rmdir d1/d11/d26/d4f/d5f/d61/d7e 39 2024-09-12T22:49:55.616 INFO:tasks.workunit.client.0.smithi066.stdout:3/397: mkdir d0/d2/d7/d92/d9e 0 2024-09-12T22:49:55.617 INFO:tasks.workunit.client.0.smithi066.stdout:8/433: fsync f11 0 2024-09-12T22:49:55.617 INFO:tasks.workunit.client.0.smithi066.stdout:4/409: dread d5/d8/d10/f5c [0,4194304] 0 2024-09-12T22:49:55.617 INFO:tasks.workunit.client.0.smithi066.stdout:0/423: getdents d1/d8/d1c/d13/d2f 0 2024-09-12T22:49:55.617 INFO:tasks.workunit.client.0.smithi066.stdout:9/410: symlink d9/d31/d77/l84 0 2024-09-12T22:49:55.617 INFO:tasks.workunit.client.0.smithi066.stdout:7/374: symlink d0/d19/d26/d48/l77 0 2024-09-12T22:49:55.618 INFO:tasks.workunit.client.0.smithi066.stdout:6/493: truncate d6/d20/d32/f7c 429703 0 2024-09-12T22:49:55.618 INFO:tasks.workunit.client.0.smithi066.stdout:3/398: chown d0/d2/d1d/d87 77261 1 2024-09-12T22:49:55.618 INFO:tasks.workunit.client.0.smithi066.stdout:4/410: rmdir d5/d3e 39 2024-09-12T22:49:55.618 INFO:tasks.workunit.client.0.smithi066.stdout:1/339: getdents d0/d28 0 2024-09-12T22:49:55.619 INFO:tasks.workunit.client.0.smithi066.stdout:9/411: chown d9/d31/d77/f7d 620475 1 2024-09-12T22:49:55.619 INFO:tasks.workunit.client.0.smithi066.stdout:9/412: stat d9/d31/d58/d7f 0 2024-09-12T22:49:55.620 INFO:tasks.workunit.client.0.smithi066.stdout:4/411: write d5/d8/d10/de/d2d/d64/f6c [540879,56497] 0 2024-09-12T22:49:55.620 INFO:tasks.workunit.client.0.smithi066.stdout:2/392: unlink d1/dd/d12/l3c 0 2024-09-12T22:49:55.620 INFO:tasks.workunit.client.0.smithi066.stdout:1/340: truncate d0/dc/d1d/f55 818893 0 2024-09-12T22:49:55.620 INFO:tasks.workunit.client.0.smithi066.stdout:3/399: rmdir d0/d1b 39 2024-09-12T22:49:55.621 INFO:tasks.workunit.client.0.smithi066.stdout:1/341: fsync d0/d9/f4d 0 2024-09-12T22:49:55.621 INFO:tasks.workunit.client.0.smithi066.stdout:8/434: rename d17/d40/c63 to d17/d49/d4b/c88 0 2024-09-12T22:49:55.621 INFO:tasks.workunit.client.0.smithi066.stdout:6/494: creat d6/d7/fae x:0 0 0 2024-09-12T22:49:55.622 INFO:tasks.workunit.client.0.smithi066.stdout:8/435: sync 2024-09-12T22:49:55.622 INFO:tasks.workunit.client.0.smithi066.stdout:7/375: link d0/d19/d26/f6a d0/d19/d24/d33/f78 0 2024-09-12T22:49:55.622 INFO:tasks.workunit.client.0.smithi066.stdout:7/376: sync 2024-09-12T22:49:55.622 INFO:tasks.workunit.client.0.smithi066.stdout:4/412: write d5/d8/d10/f5c [1693880,28176] 0 2024-09-12T22:49:55.623 INFO:tasks.workunit.client.0.smithi066.stdout:8/436: write f15 [1075278,2372] 0 2024-09-12T22:49:55.623 INFO:tasks.workunit.client.0.smithi066.stdout:1/342: chown d0/d28/c4b 23827 1 2024-09-12T22:49:55.623 INFO:tasks.workunit.client.0.smithi066.stdout:1/343: sync 2024-09-12T22:49:55.623 INFO:tasks.workunit.client.0.smithi066.stdout:6/495: fdatasync d6/d23/d25/d88/f9d 0 2024-09-12T22:49:55.623 INFO:tasks.workunit.client.0.smithi066.stdout:9/413: link d9/d31/d58/c78 d9/d31/d34/c85 0 2024-09-12T22:49:55.624 INFO:tasks.workunit.client.0.smithi066.stdout:8/437: unlink d17/d40/d47/d66/l7d 0 2024-09-12T22:49:55.624 INFO:tasks.workunit.client.0.smithi066.stdout:7/377: creat d0/d19/d60/f79 x:0 0 0 2024-09-12T22:49:55.625 INFO:tasks.workunit.client.0.smithi066.stdout:6/496: read d6/d49/f4d [481760,15056] 0 2024-09-12T22:49:55.625 INFO:tasks.workunit.client.0.smithi066.stdout:2/393: truncate d1/d11/d26/d4f/d5f/d61/d7e/f48 2069875 0 2024-09-12T22:49:55.625 INFO:tasks.workunit.client.0.smithi066.stdout:7/378: rename d0/d19/d24/l6e to d0/d19/d26/l7a 0 2024-09-12T22:49:55.626 INFO:tasks.workunit.client.0.smithi066.stdout:6/497: fsync d6/d51/f95 0 2024-09-12T22:49:55.626 INFO:tasks.workunit.client.0.smithi066.stdout:8/438: link d17/d1b/f3b d17/d40/d47/d4d/d87/f89 0 2024-09-12T22:49:55.626 INFO:tasks.workunit.client.0.smithi066.stdout:4/413: rename d5/d8/d16/d1b/d1e/d38/d84/d6f/d6e to d5/d8/d10/de/d2d/d64/d7d/d8b 0 2024-09-12T22:49:55.626 INFO:tasks.workunit.client.0.smithi066.stdout:4/414: sync 2024-09-12T22:49:55.626 INFO:tasks.workunit.client.0.smithi066.stdout:2/394: readlink d1/d44/d51/d70/l73 0 2024-09-12T22:49:55.627 INFO:tasks.workunit.client.0.smithi066.stdout:7/379: write d0/d19/d24/f1d [4234916,50338] 0 2024-09-12T22:49:55.627 INFO:tasks.workunit.client.0.smithi066.stdout:4/415: readlink d5/d8/d10/lf 0 2024-09-12T22:49:55.627 INFO:tasks.workunit.client.0.smithi066.stdout:6/498: creat d6/d23/d62/faf x:0 0 0 2024-09-12T22:49:55.627 INFO:tasks.workunit.client.0.smithi066.stdout:2/395: symlink d1/d11/d26/d4f/d7c/l81 0 2024-09-12T22:49:55.628 INFO:tasks.workunit.client.0.smithi066.stdout:4/416: fdatasync d5/d8/d16/d1b/d1e/f51 0 2024-09-12T22:49:55.628 INFO:tasks.workunit.client.0.smithi066.stdout:2/396: read d1/f6 [2009842,3435] 0 2024-09-12T22:49:55.628 INFO:tasks.workunit.client.0.smithi066.stdout:8/439: creat d17/d40/d47/d4d/f8a x:0 0 0 2024-09-12T22:49:55.628 INFO:tasks.workunit.client.0.smithi066.stdout:6/499: creat d6/d35/fb0 x:0 0 0 2024-09-12T22:49:55.629 INFO:tasks.workunit.client.0.smithi066.stdout:4/417: chown d5/d8/d10/l47 4638 1 2024-09-12T22:49:55.629 INFO:tasks.workunit.client.0.smithi066.stdout:2/397: chown d1/db/d42/d43/c4d 1 1 2024-09-12T22:49:55.630 INFO:tasks.workunit.client.0.smithi066.stdout:8/440: getdents d17/d40/d47/d81 0 2024-09-12T22:49:55.631 INFO:tasks.workunit.client.0.smithi066.stdout:4/418: mkdir d5/d8/d16/d1b/d1e/d1f/d8c 0 2024-09-12T22:49:55.631 INFO:tasks.workunit.client.0.smithi066.stdout:6/500: link d6/d20/ca4 d6/d20/d32/d3c/cb1 0 2024-09-12T22:49:55.631 INFO:tasks.workunit.client.0.smithi066.stdout:4/419: sync 2024-09-12T22:49:55.631 INFO:tasks.workunit.client.0.smithi066.stdout:2/398: fdatasync d1/dd/d3d/f4a 0 2024-09-12T22:49:55.631 INFO:tasks.workunit.client.0.smithi066.stdout:8/441: unlink d17/l25 0 2024-09-12T22:49:55.631 INFO:tasks.workunit.client.0.smithi066.stdout:9/414: read d9/dc/f2d [4654926,35186] 0 2024-09-12T22:49:55.631 INFO:tasks.workunit.client.0.smithi066.stdout:6/501: readlink d6/d23/d25/d2c/l53 0 2024-09-12T22:49:55.631 INFO:tasks.workunit.client.0.smithi066.stdout:8/442: write d17/d2c/f37 [2734461,109590] 0 2024-09-12T22:49:55.632 INFO:tasks.workunit.client.0.smithi066.stdout:6/502: dread - d6/d23/f27 zero size 2024-09-12T22:49:55.632 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:49:55.633 INFO:tasks.workunit.client.0.smithi066.stdout:8/443: mknod d17/d1b/c8b 0 2024-09-12T22:49:55.633 INFO:tasks.workunit.client.0.smithi066.stdout:9/415: rename d9/d31/f4c to d9/dc/f86 0 2024-09-12T22:49:55.635 INFO:tasks.workunit.client.0.smithi066.stdout:6/503: truncate d6/d23/d25/d4e/fa1 903940 0 2024-09-12T22:49:55.636 INFO:tasks.workunit.client.0.smithi066.stdout:2/399: truncate d1/dd/f63 404195 0 2024-09-12T22:49:55.637 INFO:tasks.workunit.client.0.smithi066.stdout:8/444: link d17/d49/d4b/c88 d17/d2c/c8c 0 2024-09-12T22:49:55.637 INFO:tasks.workunit.client.0.smithi066.stdout:6/504: creat d6/d78/d4a/fb2 x:0 0 0 2024-09-12T22:49:55.637 INFO:tasks.workunit.client.0.smithi066.stdout:4/420: dwrite d5/d8/d10/de/f2b [4194304,4194304] 0 2024-09-12T22:49:55.638 INFO:tasks.workunit.client.0.smithi066.stdout:0/424: dread d1/d8/f5a [0,4194304] 0 2024-09-12T22:49:55.643 INFO:tasks.workunit.client.0.smithi066.stdout:8/445: truncate d17/d49/d4b/d57/d5e/d62/f83 300922 0 2024-09-12T22:49:55.643 INFO:tasks.workunit.client.0.smithi066.stdout:9/416: dwrite d9/dc/dd/f42 [0,4194304] 0 2024-09-12T22:49:55.646 INFO:tasks.workunit.client.0.smithi066.stdout:5/466: dread d5/d11/f1d [0,4194304] 0 2024-09-12T22:49:55.647 INFO:tasks.workunit.client.0.smithi066.stdout:9/417: chown f7 13154 1 2024-09-12T22:49:55.647 INFO:tasks.workunit.client.0.smithi066.stdout:0/425: truncate d1/d8/d1c/d13/f23 111159 0 2024-09-12T22:49:55.647 INFO:tasks.workunit.client.0.smithi066.stdout:7/380: dread d0/d19/d24/d33/d27/f57 [0,4194304] 0 2024-09-12T22:49:55.647 INFO:tasks.workunit.client.0.smithi066.stdout:4/421: rename d5/d8/d16/d1b/d1e/d38/d84/d6f to d5/d3e/d8d 0 2024-09-12T22:49:55.647 INFO:tasks.workunit.client.0.smithi066.stdout:2/400: dwrite d1/dd/f71 [0,4194304] 0 2024-09-12T22:49:55.648 INFO:tasks.workunit.client.0.smithi066.stdout:8/446: truncate d17/d49/d4b/f76 1377548 0 2024-09-12T22:49:55.648 INFO:tasks.workunit.client.0.smithi066.stdout:0/426: dread - d1/d8/d1c/d13/d2f/f92 zero size 2024-09-12T22:49:55.649 INFO:tasks.workunit.client.0.smithi066.stdout:7/381: write d0/f5 [2031937,1065] 0 2024-09-12T22:49:55.649 INFO:tasks.workunit.client.0.smithi066.stdout:5/467: read d5/de/d50/f35 [339816,80034] 0 2024-09-12T22:49:55.650 INFO:tasks.workunit.client.0.smithi066.stdout:8/447: rmdir d17/d2c 39 2024-09-12T22:49:55.650 INFO:tasks.workunit.client.0.smithi066.stdout:4/422: chown d5/d8/d16/d1b/d1e/d38/d84 1 1 2024-09-12T22:49:55.651 INFO:tasks.workunit.client.0.smithi066.stdout:6/505: dwrite d6/d23/f29 [0,4194304] 0 2024-09-12T22:49:55.651 INFO:tasks.workunit.client.0.smithi066.stdout:9/418: truncate d9/dc/d23/f83 333022 0 2024-09-12T22:49:55.651 INFO:tasks.workunit.client.0.smithi066.stdout:2/401: creat d1/d11/d57/f82 x:0 0 0 2024-09-12T22:49:55.652 INFO:tasks.workunit.client.0.smithi066.stdout:0/427: readlink d1/l3e 0 2024-09-12T22:49:55.652 INFO:teuthology.orchestra.run.smithi066.stderr:nodeep-scrub is unset 2024-09-12T22:49:55.652 INFO:tasks.workunit.client.0.smithi066.stdout:6/506: readlink d6/d20/d32/d3c/l44 0 2024-09-12T22:49:55.653 INFO:tasks.workunit.client.0.smithi066.stdout:5/468: creat d5/d11/d5d/f83 x:0 0 0 2024-09-12T22:49:55.653 INFO:tasks.workunit.client.0.smithi066.stdout:2/402: creat d1/dd/d68/f83 x:0 0 0 2024-09-12T22:49:55.653 INFO:tasks.workunit.client.0.smithi066.stdout:4/423: chown d5/d8/d16/d1b/d73/f76 64401 1 2024-09-12T22:49:55.654 INFO:tasks.workunit.client.0.smithi066.stdout:7/382: link d0/ff d0/d19/d26/d48/d59/f7b 0 2024-09-12T22:49:55.654 INFO:tasks.workunit.client.0.smithi066.stdout:6/507: symlink d6/d23/d62/d79/lb3 0 2024-09-12T22:49:55.655 INFO:tasks.workunit.client.0.smithi066.stdout:8/448: write f11 [1541133,19460] 0 2024-09-12T22:49:55.655 INFO:tasks.workunit.client.0.smithi066.stdout:0/428: creat d1/d8/d1b/f97 x:0 0 0 2024-09-12T22:49:55.656 INFO:tasks.workunit.client.0.smithi066.stdout:9/419: creat d9/f87 x:0 0 0 2024-09-12T22:49:55.658 INFO:tasks.workunit.client.0.smithi066.stdout:4/424: write d5/d8/f19 [2354857,43446] 0 2024-09-12T22:49:55.658 INFO:tasks.workunit.client.0.smithi066.stdout:6/508: mkdir d6/d23/d62/d79/db4 0 2024-09-12T22:49:55.658 INFO:tasks.workunit.client.0.smithi066.stdout:3/400: dread d0/d2/d7/f4b [0,4194304] 0 2024-09-12T22:49:55.660 INFO:tasks.workunit.client.0.smithi066.stdout:5/469: chown d5/d11/f1b 2290 1 2024-09-12T22:49:55.661 INFO:tasks.workunit.client.0.smithi066.stdout:8/449: write d17/d2c/f34 [2645917,20453] 0 2024-09-12T22:49:55.663 INFO:tasks.workunit.client.0.smithi066.stdout:1/344: dread d0/f7 [0,4194304] 0 2024-09-12T22:49:55.663 INFO:tasks.workunit.client.0.smithi066.stdout:6/509: dread - d6/d20/f65 zero size 2024-09-12T22:49:55.663 INFO:tasks.workunit.client.0.smithi066.stdout:4/425: rmdir d5/d8/d10/de/d2d/d64 39 2024-09-12T22:49:55.664 INFO:tasks.workunit.client.0.smithi066.stdout:2/403: write d1/dd/f63 [1395802,95724] 0 2024-09-12T22:49:55.664 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:55.662+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:55.664 INFO:tasks.workunit.client.0.smithi066.stdout:6/510: chown d6/d23/d41 228444999 1 2024-09-12T22:49:55.665 INFO:tasks.workunit.client.0.smithi066.stdout:8/450: creat d17/d49/f8d x:0 0 0 2024-09-12T22:49:55.666 INFO:tasks.workunit.client.0.smithi066.stdout:5/470: rename d5/d11/d23/l2a to d5/d15/l84 0 2024-09-12T22:49:55.667 INFO:tasks.workunit.client.0.smithi066.stdout:0/429: dwrite d1/d8/d1c/dd/f77 [0,4194304] 0 2024-09-12T22:49:55.667 INFO:tasks.workunit.client.0.smithi066.stdout:1/345: mknod d0/dc/d1e/c61 0 2024-09-12T22:49:55.669 INFO:tasks.workunit.client.0.smithi066.stdout:9/420: dwrite d9/d31/f6f [0,4194304] 0 2024-09-12T22:49:55.670 INFO:tasks.workunit.client.0.smithi066.stdout:0/430: readlink d1/d8/d1f/d30/l38 0 2024-09-12T22:49:55.671 INFO:tasks.workunit.client.0.smithi066.stdout:5/471: mknod d5/d11/d7c/c85 0 2024-09-12T22:49:55.674 INFO:tasks.workunit.client.0.smithi066.stdout:3/401: truncate d0/d2/d7/d13/d43/f4c 3702081 0 2024-09-12T22:49:55.675 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:55.675 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:55.675 INFO:tasks.workunit.client.0.smithi066.stdout:1/346: chown d0/dc/f17 244131047 1 2024-09-12T22:49:55.676 INFO:tasks.workunit.client.0.smithi066.stdout:6/511: rename d6/d23/d25/l8e to d6/d7/lb5 0 2024-09-12T22:49:55.676 INFO:tasks.workunit.client.0.smithi066.stdout:9/421: fsync d9/dc/d36/f39 0 2024-09-12T22:49:55.676 INFO:tasks.workunit.client.0.smithi066.stdout:2/404: getdents d1/d11/d26/d4f/d52 0 2024-09-12T22:49:55.678 INFO:tasks.workunit.client.0.smithi066.stdout:3/402: fdatasync d0/d2/d1d/f21 0 2024-09-12T22:49:55.678 INFO:tasks.workunit.client.0.smithi066.stdout:1/347: creat d0/d36/f62 x:0 0 0 2024-09-12T22:49:55.678 INFO:tasks.workunit.client.0.smithi066.stdout:8/451: dwrite d17/d2c/f7c [0,4194304] 0 2024-09-12T22:49:55.678 INFO:tasks.workunit.client.0.smithi066.stdout:9/422: chown d9/d31/d34/l5c 3 1 2024-09-12T22:49:55.679 INFO:tasks.workunit.client.0.smithi066.stdout:4/426: truncate d5/d8/d16/d1b/f28 695849 0 2024-09-12T22:49:55.679 INFO:tasks.workunit.client.0.smithi066.stdout:6/512: write d6/d23/d25/d4e/f73 [51868,114670] 0 2024-09-12T22:49:55.679 INFO:tasks.workunit.client.0.smithi066.stdout:2/405: chown d1/dd/d12/d1e/f79 84321 1 2024-09-12T22:49:55.679 INFO:tasks.workunit.client.0.smithi066.stdout:3/403: chown d0/d2/d7/d13/c2f 30371 1 2024-09-12T22:49:55.680 INFO:tasks.workunit.client.0.smithi066.stdout:1/348: write d0/f13 [2539841,264] 0 2024-09-12T22:49:55.680 INFO:tasks.workunit.client.0.smithi066.stdout:5/472: rename d5/d11/l82 to d5/d11/l86 0 2024-09-12T22:49:55.682 INFO:tasks.workunit.client.0.smithi066.stdout:8/452: creat d17/d40/d47/f8e x:0 0 0 2024-09-12T22:49:55.683 INFO:tasks.workunit.client.0.smithi066.stdout:0/431: dwrite d1/d8/d1f/d30/f78 [0,4194304] 0 2024-09-12T22:49:55.683 INFO:tasks.workunit.client.0.smithi066.stdout:1/349: write d0/d28/f4f [191100,41406] 0 2024-09-12T22:49:55.683 INFO:tasks.workunit.client.0.smithi066.stdout:6/513: mkdir d6/d23/d41/db6 0 2024-09-12T22:49:55.684 INFO:tasks.workunit.client.0.smithi066.stdout:6/514: read d6/d20/d99/fa3 [920752,33429] 0 2024-09-12T22:49:55.685 INFO:tasks.workunit.client.0.smithi066.stdout:9/423: getdents d9/dc/d46 0 2024-09-12T22:49:55.685 INFO:tasks.workunit.client.0.smithi066.stdout:0/432: creat d1/d8/d1c/f98 x:0 0 0 2024-09-12T22:49:55.685 INFO:tasks.workunit.client.0.smithi066.stdout:5/473: write d5/d11/d23/f2f [358974,94657] 0 2024-09-12T22:49:55.686 INFO:tasks.workunit.client.0.smithi066.stdout:8/453: symlink d17/d49/d4b/d57/d5e/d65/l8f 0 2024-09-12T22:49:55.686 INFO:tasks.workunit.client.0.smithi066.stdout:4/427: creat d5/d8/d10/de/d2d/d64/d7d/d8b/d86/f8e x:0 0 0 2024-09-12T22:49:55.686 INFO:tasks.workunit.client.0.smithi066.stdout:2/406: rename d1/d11/d26/d4f/c6c to d1/d11/d26/d4f/d52/c84 0 2024-09-12T22:49:55.686 INFO:tasks.workunit.client.0.smithi066.stdout:6/515: fsync d6/d7/dc/f43 0 2024-09-12T22:49:55.686 INFO:tasks.workunit.client.0.smithi066.stdout:0/433: symlink d1/d8/d1f/d47/l99 0 2024-09-12T22:49:55.687 INFO:tasks.workunit.client.0.smithi066.stdout:9/424: creat d9/dc/f88 x:0 0 0 2024-09-12T22:49:55.688 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:55.689 INFO:tasks.workunit.client.0.smithi066.stdout:2/407: dread - d1/d11/d53/f7f zero size 2024-09-12T22:49:55.689 INFO:tasks.workunit.client.0.smithi066.stdout:8/454: write d17/d40/d47/d66/f78 [1835366,51206] 0 2024-09-12T22:49:55.689 INFO:tasks.workunit.client.0.smithi066.stdout:4/428: creat d5/d3e/d65/f8f x:0 0 0 2024-09-12T22:49:55.689 INFO:tasks.workunit.client.0.smithi066.stdout:9/425: write f7 [3915682,129711] 0 2024-09-12T22:49:55.690 INFO:tasks.workunit.client.0.smithi066.stdout:0/434: rename d1/d8/d1c/c32 to d1/d8/d1c/c9a 0 2024-09-12T22:49:55.690 INFO:tasks.workunit.client.0.smithi066.stdout:8/455: creat d17/d2c/f90 x:0 0 0 2024-09-12T22:49:55.690 INFO:tasks.workunit.client.0.smithi066.stdout:9/426: unlink f8 0 2024-09-12T22:49:55.690 INFO:tasks.workunit.client.0.smithi066.stdout:1/350: read d0/d36/d57/f3f [212667,35010] 0 2024-09-12T22:49:55.692 INFO:tasks.workunit.client.0.smithi066.stdout:4/429: symlink d5/d8/d16/d1b/d1e/d38/d84/l90 0 2024-09-12T22:49:55.692 INFO:tasks.workunit.client.0.smithi066.stdout:2/408: creat d1/db/d42/d43/f85 x:0 0 0 2024-09-12T22:49:55.693 INFO:tasks.workunit.client.0.smithi066.stdout:9/427: fdatasync d9/dc/d46/f4b 0 2024-09-12T22:49:55.693 INFO:tasks.workunit.client.0.smithi066.stdout:1/351: rmdir d0/d28 39 2024-09-12T22:49:55.693 INFO:tasks.workunit.client.0.smithi066.stdout:0/435: mknod d1/d8/c9b 0 2024-09-12T22:49:55.694 INFO:tasks.workunit.client.0.smithi066.stdout:2/409: symlink d1/d11/d26/l86 0 2024-09-12T22:49:55.695 INFO:tasks.workunit.client.0.smithi066.stdout:4/430: symlink d5/d8/d10/de/d2d/d64/l91 0 2024-09-12T22:49:55.695 INFO:tasks.workunit.client.0.smithi066.stdout:6/516: dwrite d6/d78/d4a/fb2 [0,4194304] 0 2024-09-12T22:49:55.695 INFO:tasks.workunit.client.0.smithi066.stdout:0/436: unlink d1/f85 0 2024-09-12T22:49:55.697 INFO:tasks.workunit.client.0.smithi066.stdout:5/474: dwrite d5/de/d50/d42/d49/f6b [0,4194304] 0 2024-09-12T22:49:55.698 INFO:tasks.workunit.client.0.smithi066.stdout:2/410: symlink d1/d11/d26/d4f/d7c/l87 0 2024-09-12T22:49:55.699 INFO:tasks.workunit.client.0.smithi066.stdout:4/431: dread - d5/d8/d10/de/d2d/d64/f70 zero size 2024-09-12T22:49:55.699 INFO:tasks.workunit.client.0.smithi066.stdout:0/437: mkdir d1/d8/d1f/d25/d9c 0 2024-09-12T22:49:55.699 INFO:tasks.workunit.client.0.smithi066.stdout:6/517: getdents d6/d49 0 2024-09-12T22:49:55.702 INFO:tasks.workunit.client.0.smithi066.stdout:6/518: chown d6/d23/d25 390255 1 2024-09-12T22:49:55.703 INFO:tasks.workunit.client.0.smithi066.stdout:0/438: chown d1/d8/d1c/d13/d2f/c4c 58 1 2024-09-12T22:49:55.704 INFO:tasks.workunit.client.0.smithi066.stdout:6/519: mknod d6/d23/d62/cb7 0 2024-09-12T22:49:55.705 INFO:tasks.workunit.client.0.smithi066.stdout:7/383: dread d0/d19/d24/f3b [0,4194304] 0 2024-09-12T22:49:55.705 INFO:tasks.workunit.client.0.smithi066.stdout:4/432: write d5/d8/d16/d1b/d1e/d1f/d7c/f83 [128838,32273] 0 2024-09-12T22:49:55.705 INFO:tasks.workunit.client.0.smithi066.stdout:9/428: dread d9/dc/dd/f42 [0,4194304] 0 2024-09-12T22:49:55.706 INFO:tasks.workunit.client.0.smithi066.stdout:6/520: chown d6/d23/f3e 13 1 2024-09-12T22:49:55.708 INFO:tasks.workunit.client.0.smithi066.stdout:5/475: dwrite d5/f55 [0,4194304] 0 2024-09-12T22:49:55.708 INFO:tasks.workunit.client.0.smithi066.stdout:6/521: write d6/d20/d32/f68 [352526,76302] 0 2024-09-12T22:49:55.709 INFO:tasks.workunit.client.0.smithi066.stdout:4/433: read - d5/d8/d16/d1b/d72/f74 zero size 2024-09-12T22:49:55.712 INFO:tasks.workunit.client.0.smithi066.stdout:9/429: creat d9/d31/d34/f89 x:0 0 0 2024-09-12T22:49:55.713 INFO:tasks.workunit.client.0.smithi066.stdout:2/411: dwrite d1/dd/f71 [0,4194304] 0 2024-09-12T22:49:55.713 INFO:tasks.workunit.client.0.smithi066.stdout:4/434: rmdir d5/d8/d16/d1b/d1e 39 2024-09-12T22:49:55.713 INFO:tasks.workunit.client.0.smithi066.stdout:9/430: stat d9/d31/d77/l84 0 2024-09-12T22:49:55.715 INFO:tasks.workunit.client.0.smithi066.stdout:9/431: mkdir d9/dc/d46/d8a 0 2024-09-12T22:49:55.716 INFO:tasks.workunit.client.0.smithi066.stdout:6/522: link d6/c46 d6/d20/d32/cb8 0 2024-09-12T22:49:55.716 INFO:tasks.workunit.client.0.smithi066.stdout:0/439: dwrite d1/d8/d1c/d13/d2f/f6b [0,4194304] 0 2024-09-12T22:49:55.717 INFO:tasks.workunit.client.0.smithi066.stdout:9/432: unlink d9/f6e 0 2024-09-12T22:49:55.718 INFO:tasks.workunit.client.0.smithi066.stdout:4/435: rename d5/d8/d10/de/d2d/f50 to d5/d8/d16/d1b/d73/f92 0 2024-09-12T22:49:55.718 INFO:tasks.workunit.client.0.smithi066.stdout:2/412: link d1/dd/d12/d18/f3e d1/d11/d57/f88 0 2024-09-12T22:49:55.719 INFO:tasks.workunit.client.0.smithi066.stdout:6/523: mknod d6/d78/cb9 0 2024-09-12T22:49:55.719 INFO:tasks.workunit.client.0.smithi066.stdout:3/404: dread d0/d2/d6/f9 [0,4194304] 0 2024-09-12T22:49:55.719 INFO:tasks.workunit.client.0.smithi066.stdout:5/476: dwrite d5/f3e [0,4194304] 0 2024-09-12T22:49:55.720 INFO:tasks.workunit.client.0.smithi066.stdout:7/384: dwrite d0/d19/d26/d5a/f6d [4194304,4194304] 0 2024-09-12T22:49:55.720 INFO:tasks.workunit.client.0.smithi066.stdout:9/433: stat d9/c6d 0 2024-09-12T22:49:55.721 INFO:tasks.workunit.client.0.smithi066.stdout:6/524: write d6/d20/d32/d3c/fad [760874,98158] 0 2024-09-12T22:49:55.722 INFO:tasks.workunit.client.0.smithi066.stdout:0/440: link d1/f7 d1/d36/d65/f9d 0 2024-09-12T22:49:55.723 INFO:tasks.workunit.client.0.smithi066.stdout:4/436: mkdir d5/d8/d16/d93 0 2024-09-12T22:49:55.723 INFO:tasks.workunit.client.0.smithi066.stdout:3/405: fdatasync d0/d2/d7/d13/f62 0 2024-09-12T22:49:55.723 INFO:tasks.workunit.client.0.smithi066.stdout:5/477: creat d5/de/d50/d42/d49/f87 x:0 0 0 2024-09-12T22:49:55.723 INFO:tasks.workunit.client.0.smithi066.stdout:0/441: symlink d1/l9e 0 2024-09-12T22:49:55.724 INFO:tasks.workunit.client.0.smithi066.stdout:5/478: chown d5/l6e 140383215 1 2024-09-12T22:49:55.724 INFO:tasks.workunit.client.0.smithi066.stdout:0/442: readlink d1/d8/d1c/d13/d2f/l95 0 2024-09-12T22:49:55.729 INFO:tasks.workunit.client.0.smithi066.stdout:2/413: getdents d1/d11/d57 0 2024-09-12T22:49:55.729 INFO:tasks.workunit.client.0.smithi066.stdout:0/443: creat d1/d36/d65/f9f x:0 0 0 2024-09-12T22:49:55.731 INFO:tasks.workunit.client.0.smithi066.stdout:2/414: chown d1/dd/c31 523476693 1 2024-09-12T22:49:55.731 INFO:tasks.workunit.client.0.smithi066.stdout:0/444: write d1/d8/d1b/f97 [312942,85694] 0 2024-09-12T22:49:55.732 INFO:tasks.workunit.client.0.smithi066.stdout:2/415: write d1/db/f5d [2573884,32617] 0 2024-09-12T22:49:55.734 INFO:tasks.workunit.client.0.smithi066.stdout:3/406: dwrite d0/d2/d7/d13/d31/f83 [0,4194304] 0 2024-09-12T22:49:55.737 INFO:tasks.workunit.client.0.smithi066.stdout:4/437: link d5/d8/d10/de/f18 d5/d8/d10/de/d2d/d64/d7d/d8b/d86/f94 0 2024-09-12T22:49:55.739 INFO:tasks.workunit.client.0.smithi066.stdout:4/438: stat d5/d8/d10/f36 0 2024-09-12T22:49:55.741 INFO:tasks.workunit.client.0.smithi066.stdout:2/416: dwrite d1/dd/d3d/f4a [0,4194304] 0 2024-09-12T22:49:55.745 INFO:tasks.workunit.client.0.smithi066.stdout:8/456: dread d17/d40/d47/d4d/f50 [0,4194304] 0 2024-09-12T22:49:55.746 INFO:tasks.workunit.client.0.smithi066.stdout:9/434: dwrite d9/dc/f38 [0,4194304] 0 2024-09-12T22:49:55.747 INFO:tasks.workunit.client.0.smithi066.stdout:5/479: dwrite d5/d11/f54 [0,4194304] 0 2024-09-12T22:49:55.751 INFO:tasks.workunit.client.0.smithi066.stdout:3/407: dwrite d0/d2/d7/f97 [0,4194304] 0 2024-09-12T22:49:55.751 INFO:tasks.workunit.client.0.smithi066.stdout:8/457: unlink d17/d49/d4b/d57/f60 0 2024-09-12T22:49:55.752 INFO:tasks.workunit.client.0.smithi066.stdout:7/385: dread d0/d6/f41 [0,4194304] 0 2024-09-12T22:49:55.753 INFO:tasks.workunit.client.0.smithi066.stdout:7/386: chown d0/d19/d24/d33/f78 3 1 2024-09-12T22:49:55.754 INFO:tasks.workunit.client.0.smithi066.stdout:9/435: dwrite d9/dc/f1f [0,4194304] 0 2024-09-12T22:49:55.755 INFO:tasks.workunit.client.0.smithi066.stdout:7/387: creat d0/d19/d60/d53/f7c x:0 0 0 2024-09-12T22:49:55.755 INFO:tasks.workunit.client.0.smithi066.stdout:3/408: symlink d0/d2/d1d/d87/d40/d44/l9f 0 2024-09-12T22:49:55.756 INFO:tasks.workunit.client.0.smithi066.stdout:7/388: mknod d0/d19/c7d 0 2024-09-12T22:49:55.757 INFO:tasks.workunit.client.0.smithi066.stdout:7/389: creat d0/d6/f7e x:0 0 0 2024-09-12T22:49:55.758 INFO:tasks.workunit.client.0.smithi066.stdout:3/409: rename d0/d2/d1d/d87/l9a to d0/d2/d7/d13/la0 0 2024-09-12T22:49:55.764 INFO:tasks.workunit.client.0.smithi066.stdout:0/445: dread d1/d8/d1c/d13/f1e [0,4194304] 0 2024-09-12T22:49:55.764 INFO:tasks.workunit.client.0.smithi066.stdout:1/352: dread d0/d36/d57/f2b [0,4194304] 0 2024-09-12T22:49:55.764 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:55.763+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:55.765 INFO:tasks.workunit.client.0.smithi066.stdout:1/353: creat d0/d4e/f63 x:0 0 0 2024-09-12T22:49:55.765 INFO:tasks.workunit.client.0.smithi066.stdout:0/446: getdents d1 0 2024-09-12T22:49:55.765 INFO:tasks.workunit.client.0.smithi066.stdout:0/447: mkdir d1/d8/d1f/d30/da0 0 2024-09-12T22:49:55.766 INFO:tasks.workunit.client.0.smithi066.stdout:0/448: stat d1/d8/d1b/l84 0 2024-09-12T22:49:55.769 INFO:tasks.workunit.client.0.smithi066.stdout:0/449: read d1/f1a [1049247,31446] 0 2024-09-12T22:49:55.781 INFO:tasks.workunit.client.0.smithi066.stdout:4/439: truncate d5/d8/d16/d1b/d73/f92 1791423 0 2024-09-12T22:49:55.781 INFO:tasks.workunit.client.0.smithi066.stdout:5/480: write d5/d11/d23/f4e [3104556,56315] 0 2024-09-12T22:49:55.781 INFO:tasks.workunit.client.0.smithi066.stdout:8/458: truncate f11 2282498 0 2024-09-12T22:49:55.781 INFO:tasks.workunit.client.0.smithi066.stdout:7/390: write d0/d19/d60/f51 [357962,84230] 0 2024-09-12T22:49:55.782 INFO:tasks.workunit.client.0.smithi066.stdout:1/354: truncate d0/d4e/f58 626606 0 2024-09-12T22:49:55.782 INFO:tasks.workunit.client.0.smithi066.stdout:0/450: creat d1/d8/d1b/d59/fa1 x:0 0 0 2024-09-12T22:49:55.782 INFO:tasks.workunit.client.0.smithi066.stdout:5/481: truncate d5/f3f 434834 0 2024-09-12T22:49:55.783 INFO:tasks.workunit.client.0.smithi066.stdout:0/451: stat d1/d8/d1c/dd 0 2024-09-12T22:49:55.783 INFO:tasks.workunit.client.0.smithi066.stdout:7/391: mkdir d0/d19/d7f 0 2024-09-12T22:49:55.783 INFO:tasks.workunit.client.0.smithi066.stdout:5/482: fsync d5/d11/f66 0 2024-09-12T22:49:55.785 INFO:tasks.workunit.client.0.smithi066.stdout:4/440: rename d5/d8/d16/d1b/d1e/d1f/c4a to d5/d8/d16/d1b/d72/c95 0 2024-09-12T22:49:55.786 INFO:tasks.workunit.client.0.smithi066.stdout:5/483: creat d5/d14/f88 x:0 0 0 2024-09-12T22:49:55.786 INFO:tasks.workunit.client.0.smithi066.stdout:3/410: dwrite d0/d2/d1d/d87/d40/f48 [0,4194304] 0 2024-09-12T22:49:55.786 INFO:tasks.workunit.client.0.smithi066.stdout:7/392: mknod d0/d19/d24/d33/c80 0 2024-09-12T22:49:55.786 INFO:tasks.workunit.client.0.smithi066.stdout:4/441: fsync d5/d8/f49 0 2024-09-12T22:49:55.787 INFO:tasks.workunit.client.0.smithi066.stdout:5/484: unlink d5/de/l18 0 2024-09-12T22:49:55.787 INFO:tasks.workunit.client.0.smithi066.stdout:7/393: symlink d0/d19/d74/l81 0 2024-09-12T22:49:55.788 INFO:tasks.workunit.client.0.smithi066.stdout:5/485: symlink d5/d11/d7c/l89 0 2024-09-12T22:49:55.788 INFO:tasks.workunit.client.0.smithi066.stdout:8/459: dwrite d17/d2c/f38 [4194304,4194304] 0 2024-09-12T22:49:55.789 INFO:tasks.workunit.client.0.smithi066.stdout:7/394: write d0/d19/d26/d48/f71 [998197,32026] 0 2024-09-12T22:49:55.790 INFO:tasks.workunit.client.0.smithi066.stdout:8/460: mkdir d17/d49/d4b/d57/d5e/d65/d91 0 2024-09-12T22:49:55.792 INFO:tasks.workunit.client.0.smithi066.stdout:3/411: sync 2024-09-12T22:49:55.792 INFO:tasks.workunit.client.0.smithi066.stdout:2/417: sync 2024-09-12T22:49:55.792 INFO:tasks.workunit.client.0.smithi066.stdout:7/395: mknod d0/d19/d60/c82 0 2024-09-12T22:49:55.793 INFO:tasks.workunit.client.0.smithi066.stdout:8/461: chown d17/d40/d47/c55 36766 1 2024-09-12T22:49:55.793 INFO:tasks.workunit.client.0.smithi066.stdout:7/396: mkdir d0/d6/d83 0 2024-09-12T22:49:55.794 INFO:tasks.workunit.client.0.smithi066.stdout:4/442: dwrite d5/d8/d10/de/d2d/d64/f89 [0,4194304] 0 2024-09-12T22:49:55.795 INFO:tasks.workunit.client.0.smithi066.stdout:3/412: write d0/d2/d7/d13/d43/f50 [2208502,75325] 0 2024-09-12T22:49:55.798 INFO:tasks.workunit.client.0.smithi066.stdout:5/486: dwrite d5/d14/f88 [0,4194304] 0 2024-09-12T22:49:55.799 INFO:tasks.workunit.client.0.smithi066.stdout:2/418: dwrite d1/d11/f66 [0,4194304] 0 2024-09-12T22:49:55.801 INFO:tasks.workunit.client.0.smithi066.stdout:1/355: dread d0/dc/fe [0,4194304] 0 2024-09-12T22:49:55.801 INFO:tasks.workunit.client.0.smithi066.stdout:3/413: rename d0/d2/d1d/d87/c36 to d0/d2/d7/d92/d9e/ca1 0 2024-09-12T22:49:55.804 INFO:tasks.workunit.client.0.smithi066.stdout:2/419: truncate d1/f6 1632902 0 2024-09-12T22:49:55.804 INFO:tasks.workunit.client.0.smithi066.stdout:4/443: link d5/d8/d10/de/d2d/d64/d7d/l81 d5/d8/d16/d1b/d1e/d1f/d7c/l96 0 2024-09-12T22:49:55.805 INFO:tasks.workunit.client.0.smithi066.stdout:8/462: dwrite d17/d49/d4b/d57/f69 [0,4194304] 0 2024-09-12T22:49:55.805 INFO:tasks.workunit.client.0.smithi066.stdout:7/397: dwrite d0/d19/d60/f79 [0,4194304] 0 2024-09-12T22:49:55.805 INFO:tasks.workunit.client.0.smithi066.stdout:1/356: write d0/d28/f5f [192595,12165] 0 2024-09-12T22:49:55.805 INFO:tasks.workunit.client.0.smithi066.stdout:3/414: chown d0/d2/d7/d13/d31/c41 1694904 1 2024-09-12T22:49:55.807 INFO:tasks.workunit.client.0.smithi066.stdout:7/398: mkdir d0/d19/d26/d48/d84 0 2024-09-12T22:49:55.807 INFO:tasks.workunit.client.0.smithi066.stdout:4/444: chown d5/d8/d10/de/c5e 19 1 2024-09-12T22:49:55.807 INFO:tasks.workunit.client.0.smithi066.stdout:2/420: chown d1/dd/d12/d67/f6a 80 1 2024-09-12T22:49:55.807 INFO:tasks.workunit.client.0.smithi066.stdout:8/463: chown d17/d40/d47/d66/f78 9319558 1 2024-09-12T22:49:55.807 INFO:tasks.workunit.client.0.smithi066.stdout:3/415: fdatasync d0/d2/d7/d13/d43/d74/f9b 0 2024-09-12T22:49:55.809 INFO:tasks.workunit.client.0.smithi066.stdout:4/445: read - d5/d8/d10/de/d2d/d64/f70 zero size 2024-09-12T22:49:55.809 INFO:tasks.workunit.client.0.smithi066.stdout:7/399: mkdir d0/d19/d60/d85 0 2024-09-12T22:49:55.809 INFO:tasks.workunit.client.0.smithi066.stdout:5/487: dwrite d5/d11/d21/d4d/f72 [0,4194304] 0 2024-09-12T22:49:55.809 INFO:tasks.workunit.client.0.smithi066.stdout:3/416: chown d0/d2/d1d/l1e 1 1 2024-09-12T22:49:55.810 INFO:tasks.workunit.client.0.smithi066.stdout:3/417: fdatasync d0/d2/d1d/d87/f70 0 2024-09-12T22:49:55.810 INFO:tasks.workunit.client.0.smithi066.stdout:5/488: mkdir d5/d11/d5d/d8a 0 2024-09-12T22:49:55.810 INFO:tasks.workunit.client.0.smithi066.stdout:2/421: mkdir d1/dd/d12/d89 0 2024-09-12T22:49:55.810 INFO:tasks.workunit.client.0.smithi066.stdout:2/422: readlink d1/d44/d51/l5b 0 2024-09-12T22:49:55.811 INFO:tasks.workunit.client.0.smithi066.stdout:7/400: truncate d0/d19/d24/f3b 4651894 0 2024-09-12T22:49:55.811 INFO:tasks.workunit.client.0.smithi066.stdout:2/423: write d1/d11/f16 [3259019,92996] 0 2024-09-12T22:49:55.812 INFO:tasks.workunit.client.0.smithi066.stdout:4/446: link d5/d8/d16/d1b/d73/f92 d5/d8/d10/de/d2d/d64/d7d/d8b/f97 0 2024-09-12T22:49:55.812 INFO:tasks.workunit.client.0.smithi066.stdout:7/401: readlink d0/d19/d24/d33/d27/l4e 0 2024-09-12T22:49:55.813 INFO:tasks.workunit.client.0.smithi066.stdout:2/424: creat d1/d11/d26/d4f/d52/d56/f8a x:0 0 0 2024-09-12T22:49:55.813 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:55.813 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:55.814 INFO:tasks.workunit.client.0.smithi066.stdout:2/425: unlink d1/dd/ce 0 2024-09-12T22:49:55.816 INFO:tasks.workunit.client.0.smithi066.stdout:2/426: dread d1/d11/f19 [0,4194304] 0 2024-09-12T22:49:55.816 INFO:tasks.workunit.client.0.smithi066.stdout:2/427: chown d1/db/f5d 33265892 1 2024-09-12T22:49:55.817 INFO:tasks.workunit.client.0.smithi066.stdout:2/428: truncate d1/dd/d12/f21 5922785 0 2024-09-12T22:49:55.817 INFO:tasks.workunit.client.0.smithi066.stdout:2/429: stat d1/d11/d26/d4f/d52/d56/f65 0 2024-09-12T22:49:55.818 INFO:tasks.workunit.client.0.smithi066.stdout:2/430: symlink d1/d11/d53/l8b 0 2024-09-12T22:49:55.819 INFO:tasks.workunit.client.0.smithi066.stdout:5/489: write d5/de/d50/d42/f44 [3711556,43181] 0 2024-09-12T22:49:55.819 INFO:tasks.workunit.client.0.smithi066.stdout:4/447: rename d5/d8/d10/de/d2d/d64/d7d to d5/d8/d10/de/d75/d98 0 2024-09-12T22:49:55.823 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:55.824 INFO:tasks.workunit.client.0.smithi066.stdout:7/402: dwrite d0/d19/d26/d48/d59/f7b [0,4194304] 0 2024-09-12T22:49:55.829 INFO:tasks.workunit.client.0.smithi066.stdout:4/448: dwrite d5/d8/d10/de/d2d/d64/f89 [0,4194304] 0 2024-09-12T22:49:55.829 INFO:tasks.workunit.client.0.smithi066.stdout:5/490: dwrite d5/de/d50/d42/f44 [4194304,4194304] 0 2024-09-12T22:49:55.830 INFO:tasks.workunit.client.0.smithi066.stdout:4/449: creat d5/d8/d16/d1b/d1e/d1f/d7c/f99 x:0 0 0 2024-09-12T22:49:55.830 INFO:tasks.workunit.client.0.smithi066.stdout:5/491: write d5/de/d50/d42/d49/f87 [433524,125172] 0 2024-09-12T22:49:55.830 INFO:tasks.workunit.client.0.smithi066.stdout:4/450: write d5/d8/d16/d1b/d72/f74 [245905,12522] 0 2024-09-12T22:49:55.831 INFO:tasks.workunit.client.0.smithi066.stdout:5/492: truncate d5/d11/d21/d78/f7b 364060 0 2024-09-12T22:49:55.832 INFO:tasks.workunit.client.0.smithi066.stdout:5/493: mkdir d5/de/d50/d8b 0 2024-09-12T22:49:55.832 INFO:tasks.workunit.client.0.smithi066.stdout:4/451: rename d5/d8/d10/de/d2d/d58 to d5/d8/d10/de/d2d/d64/d9a 0 2024-09-12T22:49:55.833 INFO:tasks.workunit.client.0.smithi066.stdout:5/494: chown d5/d11/d21/d4d/l68 53 1 2024-09-12T22:49:55.834 INFO:tasks.workunit.client.0.smithi066.stdout:5/495: mknod d5/d11/d23/d6f/c8c 0 2024-09-12T22:49:55.834 INFO:tasks.workunit.client.0.smithi066.stdout:5/496: stat d5/d11/d21/c41 0 2024-09-12T22:49:55.837 INFO:tasks.workunit.client.0.smithi066.stdout:4/452: dwrite d5/d3e/d65/f8f [0,4194304] 0 2024-09-12T22:49:55.838 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:49:55.838 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:49:55.839 INFO:tasks.workunit.client.0.smithi066.stdout:4/453: creat d5/d8/d16/f9b x:0 0 0 2024-09-12T22:49:55.839 INFO:tasks.workunit.client.0.smithi066.stdout:5/497: dwrite d5/d14/f69 [0,4194304] 0 2024-09-12T22:49:55.840 INFO:tasks.workunit.client.0.smithi066.stdout:4/454: write d5/d8/d16/d1b/d1e/d1f/f7a [998294,83306] 0 2024-09-12T22:49:55.840 INFO:tasks.workunit.client.0.smithi066.stdout:5/498: symlink d5/d15/l8d 0 2024-09-12T22:49:55.841 INFO:tasks.workunit.client.0.smithi066.stdout:5/499: creat d5/de/d50/d42/d49/f8e x:0 0 0 2024-09-12T22:49:55.841 INFO:tasks.workunit.client.0.smithi066.stdout:4/455: write d5/d8/d16/d1b/d1e/d1f/d7c/f99 [579934,110688] 0 2024-09-12T22:49:55.844 INFO:tasks.workunit.client.0.smithi066.stdout:4/456: dread d5/d8/d10/de/d39/f3b [0,4194304] 0 2024-09-12T22:49:55.844 INFO:tasks.workunit.client.0.smithi066.stdout:4/457: chown d5/d3e/d65/f8f 44 1 2024-09-12T22:49:55.846 INFO:tasks.workunit.client.0.smithi066.stdout:4/458: rename d5/d8/d10/de/d75 to d5/d8/d16/d93/d9c 0 2024-09-12T22:49:55.847 INFO:tasks.workunit.client.0.smithi066.stdout:4/459: symlink d5/d8/d16/d1b/d1e/d1f/d8c/l9d 0 2024-09-12T22:49:55.848 INFO:tasks.workunit.client.0.smithi066.stdout:2/431: dread d1/d44/f4b [0,4194304] 0 2024-09-12T22:49:55.850 INFO:tasks.workunit.client.0.smithi066.stdout:2/432: write d1/f6 [2110308,116182] 0 2024-09-12T22:49:55.852 INFO:tasks.workunit.client.0.smithi066.stdout:2/433: truncate d1/dd/d12/d67/f6a 2315308 0 2024-09-12T22:49:55.853 INFO:tasks.workunit.client.0.smithi066.stdout:4/460: dwrite d5/d8/d10/f6a [0,4194304] 0 2024-09-12T22:49:55.853 INFO:tasks.workunit.client.0.smithi066.stdout:2/434: getdents d1/dd/d12/d1e 0 2024-09-12T22:49:55.854 INFO:tasks.workunit.client.0.smithi066.stdout:2/435: stat d1/d11/d26/d4f/d7c/l87 0 2024-09-12T22:49:55.854 INFO:tasks.workunit.client.0.smithi066.stdout:4/461: creat d5/d3e/d65/f9e x:0 0 0 2024-09-12T22:49:55.858 INFO:tasks.workunit.client.0.smithi066.stdout:2/436: dwrite d1/d11/d53/f7f [0,4194304] 0 2024-09-12T22:49:55.860 INFO:tasks.workunit.client.0.smithi066.stdout:2/437: write d1/d11/d26/f30 [1281936,124328] 0 2024-09-12T22:49:55.861 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:49:55.861 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:49:55.862 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:49:55.862 INFO:tasks.workunit.client.0.smithi066.stdout:2/438: dread d1/d44/f4b [0,4194304] 0 2024-09-12T22:49:55.864 INFO:tasks.workunit.client.0.smithi066.stdout:2/439: dread - d1/d11/d26/d4f/d52/d56/f8a zero size 2024-09-12T22:49:55.865 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:49:55.866 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:49:55.866 INFO:tasks.workunit.client.0.smithi066.stdout:2/440: getdents d1/d11/d26/d4f/d5f/d61/d7e 0 2024-09-12T22:49:55.866 INFO:tasks.workunit.client.0.smithi066.stdout:2/441: creat d1/d11/d26/d4f/d5f/d61/d7e/f8c x:0 0 0 2024-09-12T22:49:55.867 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:55.865+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:55.870 INFO:tasks.workunit.client.0.smithi066.stdout:4/462: dread d5/d8/d10/de/d2d/d64/f6c [0,4194304] 0 2024-09-12T22:49:55.870 INFO:tasks.workunit.client.0.smithi066.stdout:4/463: fdatasync d5/f46 0 2024-09-12T22:49:55.870 INFO:tasks.workunit.client.0.smithi066.stdout:2/442: dwrite d1/d44/f45 [0,4194304] 0 2024-09-12T22:49:55.870 INFO:tasks.workunit.client.0.smithi066.stdout:4/464: unlink d5/l25 0 2024-09-12T22:49:55.871 INFO:tasks.workunit.client.0.smithi066.stdout:2/443: mknod d1/d11/d26/d4f/d5f/c8d 0 2024-09-12T22:49:55.872 INFO:tasks.workunit.client.0.smithi066.stdout:2/444: write d1/f6 [2848316,71351] 0 2024-09-12T22:49:55.872 INFO:tasks.workunit.client.0.smithi066.stdout:2/445: write d1/f6 [2677561,54397] 0 2024-09-12T22:49:55.877 INFO:tasks.workunit.client.0.smithi066.stdout:2/446: dwrite d1/d11/d26/d4f/d52/f69 [0,4194304] 0 2024-09-12T22:49:55.878 INFO:tasks.workunit.client.0.smithi066.stdout:2/447: creat d1/d44/d51/f8e x:0 0 0 2024-09-12T22:49:55.882 INFO:tasks.workunit.client.0.smithi066.stdout:2/448: truncate d1/dd/d12/d1e/f35 2549927 0 2024-09-12T22:49:55.883 INFO:tasks.workunit.client.0.smithi066.stdout:2/449: dread - d1/d11/d26/d4f/d52/d56/f8a zero size 2024-09-12T22:49:55.884 INFO:tasks.workunit.client.0.smithi066.stdout:2/450: write d1/dd/f2c [1188274,15756] 0 2024-09-12T22:49:55.888 INFO:tasks.workunit.client.0.smithi066.stdout:2/451: dwrite d1/d11/d26/d4f/d5f/d61/d7e/f64 [0,4194304] 0 2024-09-12T22:49:55.888 INFO:tasks.workunit.client.0.smithi066.stdout:2/452: read d1/dd/f2c [204283,1556] 0 2024-09-12T22:49:55.893 INFO:tasks.workunit.client.0.smithi066.stdout:2/453: write d1/dd/d12/d1e/f35 [2821771,75599] 0 2024-09-12T22:49:55.894 INFO:tasks.workunit.client.0.smithi066.stdout:2/454: rename d1/dd/d12/d89 to d1/d11/d26/d8f 0 2024-09-12T22:49:55.897 INFO:tasks.workunit.client.0.smithi066.stdout:4/465: dread d5/d8/d10/de/f18 [0,4194304] 0 2024-09-12T22:49:55.926 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:55.926 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:55.926 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:49:55.926 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:49:55.926 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:55.935 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:55.965 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:55.964+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:55.991 INFO:tasks.workunit.client.0.smithi066.stdout:8/464: sync 2024-09-12T22:49:55.991 INFO:tasks.workunit.client.0.smithi066.stdout:8/465: readlink d17/d1b/l4a 0 2024-09-12T22:49:55.993 INFO:tasks.workunit.client.0.smithi066.stdout:8/466: link d17/d40/d47/d66/c6f d17/d49/d4b/d57/d5e/d65/d91/c92 0 2024-09-12T22:49:55.997 INFO:tasks.workunit.client.0.smithi066.stdout:4/466: fdatasync d5/d8/d16/d1b/d72/f74 0 2024-09-12T22:49:55.999 INFO:tasks.workunit.client.0.smithi066.stdout:4/467: mknod d5/d8/d16/d93/d9c/d98/c9f 0 2024-09-12T22:49:56.000 INFO:tasks.workunit.client.0.smithi066.stdout:4/468: creat d5/d8/d16/fa0 x:0 0 0 2024-09-12T22:49:56.000 INFO:tasks.workunit.client.0.smithi066.stdout:4/469: chown d5/d8/d10/de/l3a 37577026 1 2024-09-12T22:49:56.001 INFO:tasks.workunit.client.0.smithi066.stdout:4/470: write d5/d8/d16/d1b/d1e/d5a/f5d [509212,58311] 0 2024-09-12T22:49:56.004 INFO:tasks.workunit.client.0.smithi066.stdout:4/471: dwrite f1 [0,4194304] 0 2024-09-12T22:49:56.006 INFO:tasks.workunit.client.0.smithi066.stdout:4/472: creat d5/d8/d10/de/d2d/fa1 x:0 0 0 2024-09-12T22:49:56.007 INFO:tasks.workunit.client.0.smithi066.stdout:4/473: fdatasync d5/d8/d16/d1b/d1e/d5a/f85 0 2024-09-12T22:49:56.008 INFO:tasks.workunit.client.0.smithi066.stdout:4/474: creat d5/d8/d16/d93/d9c/d98/fa2 x:0 0 0 2024-09-12T22:49:56.009 INFO:tasks.workunit.client.0.smithi066.stdout:4/475: creat d5/d8/d16/d1b/d1e/fa3 x:0 0 0 2024-09-12T22:49:56.010 INFO:tasks.workunit.client.0.smithi066.stdout:4/476: write d5/d8/d16/d1b/d1e/d38/f3f [3138252,74083] 0 2024-09-12T22:49:56.011 INFO:tasks.workunit.client.0.smithi066.stdout:4/477: link d5/d3e/d8d/f53 d5/d8/d16/fa4 0 2024-09-12T22:49:56.016 INFO:tasks.workunit.client.0.smithi066.stdout:0/452: dread d1/f51 [0,4194304] 0 2024-09-12T22:49:56.018 INFO:tasks.workunit.client.0.smithi066.stdout:6/525: dread d6/f2a [0,4194304] 0 2024-09-12T22:49:56.018 INFO:tasks.workunit.client.0.smithi066.stdout:6/526: write d6/d23/d25/f2e [951707,68430] 0 2024-09-12T22:49:56.019 INFO:tasks.workunit.client.0.smithi066.stdout:6/527: link d6/d23/d62/cb7 d6/d49/cba 0 2024-09-12T22:49:56.019 INFO:tasks.workunit.client.0.smithi066.stdout:5/500: fsync d5/d14/f69 0 2024-09-12T22:49:56.019 INFO:tasks.workunit.client.0.smithi066.stdout:9/436: dread d9/dc/d4e/f66 [0,4194304] 0 2024-09-12T22:49:56.020 INFO:tasks.workunit.client.0.smithi066.stdout:0/453: dwrite d1/d8/d1c/dd/f44 [0,4194304] 0 2024-09-12T22:49:56.020 INFO:tasks.workunit.client.0.smithi066.stdout:6/528: fsync d6/d23/d25/d2c/d69/f83 0 2024-09-12T22:49:56.023 INFO:tasks.workunit.client.0.smithi066.stdout:0/454: write d1/f51 [290757,35877] 0 2024-09-12T22:49:56.023 INFO:tasks.workunit.client.0.smithi066.stdout:0/455: chown d1/d8/d1f/l3c 246 1 2024-09-12T22:49:56.024 INFO:tasks.workunit.client.0.smithi066.stdout:5/501: mkdir d5/d11/d5d/d64/d8f 0 2024-09-12T22:49:56.024 INFO:tasks.workunit.client.0.smithi066.stdout:6/529: dread d6/d23/d25/d2c/d69/f83 [0,4194304] 0 2024-09-12T22:49:56.025 INFO:tasks.workunit.client.0.smithi066.stdout:0/456: readlink d1/d8/d1c/d13/d2f/l8d 0 2024-09-12T22:49:56.025 INFO:tasks.workunit.client.0.smithi066.stdout:9/437: dwrite d9/dc/f60 [0,4194304] 0 2024-09-12T22:49:56.026 INFO:tasks.workunit.client.0.smithi066.stdout:4/478: write d5/d8/d10/de/f27 [1362557,100253] 0 2024-09-12T22:49:56.028 INFO:tasks.workunit.client.0.smithi066.stdout:5/502: chown d5/d11/l3d 124225 1 2024-09-12T22:49:56.028 INFO:tasks.workunit.client.0.smithi066.stdout:9/438: symlink d9/dc/d46/l8b 0 2024-09-12T22:49:56.028 INFO:tasks.workunit.client.0.smithi066.stdout:0/457: mknod d1/d8/d1b/d59/ca2 0 2024-09-12T22:49:56.028 INFO:tasks.workunit.client.0.smithi066.stdout:5/503: chown d5/ld 15 1 2024-09-12T22:49:56.030 INFO:tasks.workunit.client.0.smithi066.stdout:8/467: dwrite d17/d40/f52 [0,4194304] 0 2024-09-12T22:49:56.030 INFO:tasks.workunit.client.0.smithi066.stdout:9/439: mkdir d9/d31/d34/d4d/d8c 0 2024-09-12T22:49:56.031 INFO:tasks.workunit.client.0.smithi066.stdout:6/530: dwrite d6/d20/f3a [4194304,4194304] 0 2024-09-12T22:49:56.033 INFO:tasks.workunit.client.0.smithi066.stdout:0/458: symlink d1/d8/d1b/d59/la3 0 2024-09-12T22:49:56.033 INFO:tasks.workunit.client.0.smithi066.stdout:0/459: dread - d1/d8/d1b/d59/fa1 zero size 2024-09-12T22:49:56.033 INFO:tasks.workunit.client.0.smithi066.stdout:6/531: creat d6/d23/d25/d2c/d85/fbb x:0 0 0 2024-09-12T22:49:56.035 INFO:tasks.workunit.client.0.smithi066.stdout:5/504: getdents d5/d11/d5d/d64 0 2024-09-12T22:49:56.035 INFO:tasks.workunit.client.0.smithi066.stdout:8/468: creat d17/d40/d47/d4d/f93 x:0 0 0 2024-09-12T22:49:56.035 INFO:tasks.workunit.client.0.smithi066.stdout:6/532: rmdir d6/d23/d25/d2c 39 2024-09-12T22:49:56.035 INFO:tasks.workunit.client.0.smithi066.stdout:9/440: dread d9/d31/f6f [0,4194304] 0 2024-09-12T22:49:56.035 INFO:tasks.workunit.client.0.smithi066.stdout:0/460: fsync d1/d8/d1f/f45 0 2024-09-12T22:49:56.035 INFO:tasks.workunit.client.0.smithi066.stdout:6/533: dread - d6/d23/d25/f9f zero size 2024-09-12T22:49:56.037 INFO:tasks.workunit.client.0.smithi066.stdout:9/441: mkdir d9/d31/d34/d4d/d8c/d8d 0 2024-09-12T22:49:56.037 INFO:tasks.workunit.client.0.smithi066.stdout:6/534: write d6/fb [5226014,83541] 0 2024-09-12T22:49:56.037 INFO:tasks.workunit.client.0.smithi066.stdout:0/461: link d1/l6a d1/d8/d1c/dd/la4 0 2024-09-12T22:49:56.038 INFO:tasks.workunit.client.0.smithi066.stdout:9/442: write d9/dc/f1f [5251696,111100] 0 2024-09-12T22:49:56.038 INFO:tasks.workunit.client.0.smithi066.stdout:5/505: dread d5/f55 [0,4194304] 0 2024-09-12T22:49:56.039 INFO:tasks.workunit.client.0.smithi066.stdout:0/462: getdents d1/d36/d8f 0 2024-09-12T22:49:56.039 INFO:tasks.workunit.client.0.smithi066.stdout:9/443: mkdir d9/dc/d8e 0 2024-09-12T22:49:56.041 INFO:tasks.workunit.client.0.smithi066.stdout:0/463: write d1/f1a [812802,77522] 0 2024-09-12T22:49:56.041 INFO:tasks.workunit.client.0.smithi066.stdout:4/479: write d5/d8/f49 [1206749,43724] 0 2024-09-12T22:49:56.041 INFO:tasks.workunit.client.0.smithi066.stdout:8/469: truncate d17/d40/d47/d4d/f50 1048389 0 2024-09-12T22:49:56.041 INFO:tasks.workunit.client.0.smithi066.stdout:2/455: sync 2024-09-12T22:49:56.041 INFO:tasks.workunit.client.0.smithi066.stdout:3/418: sync 2024-09-12T22:49:56.043 INFO:tasks.workunit.client.0.smithi066.stdout:8/470: creat d17/d40/d74/f94 x:0 0 0 2024-09-12T22:49:56.043 INFO:tasks.workunit.client.0.smithi066.stdout:0/464: rename d1/d8/d1c/d13/l57 to d1/d8/d1b/d88/la5 0 2024-09-12T22:49:56.044 INFO:tasks.workunit.client.0.smithi066.stdout:5/506: dwrite f4 [0,4194304] 0 2024-09-12T22:49:56.044 INFO:tasks.workunit.client.0.smithi066.stdout:6/535: dwrite d6/d7/f39 [0,4194304] 0 2024-09-12T22:49:56.045 INFO:tasks.workunit.client.0.smithi066.stdout:0/465: readlink d1/d8/d1f/l60 0 2024-09-12T22:49:56.045 INFO:tasks.workunit.client.0.smithi066.stdout:0/466: readlink d1/d36/l5d 0 2024-09-12T22:49:56.045 INFO:tasks.workunit.client.0.smithi066.stdout:3/419: truncate d0/d2/d1d/d87/d40/d44/f9c 336404 0 2024-09-12T22:49:56.047 INFO:tasks.workunit.client.0.smithi066.stdout:8/471: symlink d17/d40/d47/l95 0 2024-09-12T22:49:56.047 INFO:tasks.workunit.client.0.smithi066.stdout:4/480: dread d5/d8/d10/f6a [0,4194304] 0 2024-09-12T22:49:56.047 INFO:tasks.workunit.client.0.smithi066.stdout:0/467: rename d1/d8/d1f/d47/l4b to d1/d8/d1c/d13/la6 0 2024-09-12T22:49:56.047 INFO:tasks.workunit.client.0.smithi066.stdout:5/507: creat d5/de/d50/f90 x:0 0 0 2024-09-12T22:49:56.047 INFO:tasks.workunit.client.0.smithi066.stdout:3/420: fsync d0/d2/d7/d13/d43/f4c 0 2024-09-12T22:49:56.048 INFO:tasks.workunit.client.0.smithi066.stdout:8/472: creat d17/d49/d4b/d4e/f96 x:0 0 0 2024-09-12T22:49:56.048 INFO:tasks.workunit.client.0.smithi066.stdout:6/536: creat d6/d23/fbc x:0 0 0 2024-09-12T22:49:56.050 INFO:tasks.workunit.client.0.smithi066.stdout:4/481: truncate d5/d8/d10/de/d2d/d64/f70 147555 0 2024-09-12T22:49:56.053 INFO:tasks.workunit.client.0.smithi066.stdout:4/482: mkdir d5/d8/d16/d93/da5 0 2024-09-12T22:49:56.055 INFO:tasks.workunit.client.0.smithi066.stdout:5/508: dread d5/d14/f69 [0,4194304] 0 2024-09-12T22:49:56.055 INFO:tasks.workunit.client.0.smithi066.stdout:7/403: dread d0/d6/f21 [0,4194304] 0 2024-09-12T22:49:56.056 INFO:tasks.workunit.client.0.smithi066.stdout:0/468: dwrite d1/d8/d1f/d25/f7d [0,4194304] 0 2024-09-12T22:49:56.056 INFO:tasks.workunit.client.0.smithi066.stdout:3/421: dwrite d0/d2/d7/d13/d43/f50 [0,4194304] 0 2024-09-12T22:49:56.058 INFO:tasks.workunit.client.0.smithi066.stdout:0/469: symlink d1/d8/d1f/d30/la7 0 2024-09-12T22:49:56.059 INFO:tasks.workunit.client.0.smithi066.stdout:5/509: symlink d5/de/l91 0 2024-09-12T22:49:56.059 INFO:tasks.workunit.client.0.smithi066.stdout:7/404: mkdir d0/d86 0 2024-09-12T22:49:56.059 INFO:tasks.workunit.client.0.smithi066.stdout:4/483: write d5/d8/d16/d93/d9c/d98/d8b/f97 [1773376,82764] 0 2024-09-12T22:49:56.059 INFO:tasks.workunit.client.0.smithi066.stdout:1/357: dread d0/d9/f4d [0,4194304] 0 2024-09-12T22:49:56.060 INFO:tasks.workunit.client.0.smithi066.stdout:5/510: write d5/d14/f74 [994044,7117] 0 2024-09-12T22:49:56.060 INFO:tasks.workunit.client.0.smithi066.stdout:7/405: fdatasync d0/d19/d26/d48/f49 0 2024-09-12T22:49:56.060 INFO:tasks.workunit.client.0.smithi066.stdout:0/470: readlink d1/d8/d1f/d47/l94 0 2024-09-12T22:49:56.060 INFO:tasks.workunit.client.0.smithi066.stdout:4/484: mkdir d5/d8/d16/d93/da6 0 2024-09-12T22:49:56.061 INFO:tasks.workunit.client.0.smithi066.stdout:1/358: creat d0/f64 x:0 0 0 2024-09-12T22:49:56.062 INFO:tasks.workunit.client.0.smithi066.stdout:1/359: chown d0/dc/c18 102290 1 2024-09-12T22:49:56.062 INFO:tasks.workunit.client.0.smithi066.stdout:5/511: rename d5/de/d50/d42/d49/f8e to d5/de/d50/f92 0 2024-09-12T22:49:56.062 INFO:tasks.workunit.client.0.smithi066.stdout:7/406: link d0/d19/d24/c22 d0/d19/c87 0 2024-09-12T22:49:56.063 INFO:tasks.workunit.client.0.smithi066.stdout:5/512: write d5/d14/f88 [625954,51236] 0 2024-09-12T22:49:56.063 INFO:tasks.workunit.client.0.smithi066.stdout:4/485: symlink d5/d8/d16/d1b/d1e/d38/d84/la7 0 2024-09-12T22:49:56.064 INFO:tasks.workunit.client.0.smithi066.stdout:1/360: getdents d0/dc/d1e 0 2024-09-12T22:49:56.064 INFO:tasks.workunit.client.0.smithi066.stdout:7/407: symlink d0/d6/d83/l88 0 2024-09-12T22:49:56.065 INFO:tasks.workunit.client.0.smithi066.stdout:5/513: write d5/d11/d5f/f80 [727765,88065] 0 2024-09-12T22:49:56.065 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:56.064+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:56.066 INFO:tasks.workunit.client.0.smithi066.stdout:4/486: getdents d5/d8/d10/de/d2d/d64/d9a 0 2024-09-12T22:49:56.066 INFO:tasks.workunit.client.0.smithi066.stdout:0/471: dwrite d1/d8/d1f/d30/f70 [0,4194304] 0 2024-09-12T22:49:56.066 INFO:tasks.workunit.client.0.smithi066.stdout:7/408: write d0/d19/d26/d48/d59/f68 [2605067,19533] 0 2024-09-12T22:49:56.067 INFO:tasks.workunit.client.0.smithi066.stdout:5/514: dread d5/f3f [0,4194304] 0 2024-09-12T22:49:56.067 INFO:tasks.workunit.client.0.smithi066.stdout:4/487: stat d5/d8/d10/de/l15 0 2024-09-12T22:49:56.067 INFO:tasks.workunit.client.0.smithi066.stdout:5/515: chown d5/d11/l3d 78 1 2024-09-12T22:49:56.068 INFO:tasks.workunit.client.0.smithi066.stdout:0/472: symlink d1/d36/la8 0 2024-09-12T22:49:56.069 INFO:tasks.workunit.client.0.smithi066.stdout:5/516: write d5/d11/d23/f5c [198184,68514] 0 2024-09-12T22:49:56.069 INFO:tasks.workunit.client.0.smithi066.stdout:4/488: mknod d5/d87/ca8 0 2024-09-12T22:49:56.069 INFO:tasks.workunit.client.0.smithi066.stdout:7/409: write d0/d19/d24/f3b [1344493,42027] 0 2024-09-12T22:49:56.069 INFO:tasks.workunit.client.0.smithi066.stdout:0/473: rmdir d1/d8/d1f 39 2024-09-12T22:49:56.070 INFO:tasks.workunit.client.0.smithi066.stdout:4/489: creat d5/d8/d16/d1b/d1e/d1f/fa9 x:0 0 0 2024-09-12T22:49:56.071 INFO:tasks.workunit.client.0.smithi066.stdout:0/474: creat d1/d8/d1c/fa9 x:0 0 0 2024-09-12T22:49:56.072 INFO:tasks.workunit.client.0.smithi066.stdout:4/490: creat d5/d8/d10/de/d2d/faa x:0 0 0 2024-09-12T22:49:56.072 INFO:tasks.workunit.client.0.smithi066.stdout:5/517: dread d5/d11/d21/d4d/f72 [0,4194304] 0 2024-09-12T22:49:56.073 INFO:tasks.workunit.client.0.smithi066.stdout:4/491: mkdir d5/d8/d16/d93/d9c/d98/dab 0 2024-09-12T22:49:56.073 INFO:tasks.workunit.client.0.smithi066.stdout:5/518: rename d5/de/d50/d42/f44 to d5/de/d50/d42/d49/f93 0 2024-09-12T22:49:56.074 INFO:tasks.workunit.client.0.smithi066.stdout:9/444: sync 2024-09-12T22:49:56.074 INFO:tasks.workunit.client.0.smithi066.stdout:3/422: sync 2024-09-12T22:49:56.074 INFO:tasks.workunit.client.0.smithi066.stdout:4/492: fdatasync d5/d8/d16/d93/d9c/d98/d8b/d86/f94 0 2024-09-12T22:49:56.074 INFO:tasks.workunit.client.0.smithi066.stdout:5/519: unlink d5/d14/l1c 0 2024-09-12T22:49:56.075 INFO:tasks.workunit.client.0.smithi066.stdout:4/493: fsync d5/d8/d16/d1b/d1e/fa3 0 2024-09-12T22:49:56.075 INFO:tasks.workunit.client.0.smithi066.stdout:5/520: creat d5/d11/d5d/d8a/f94 x:0 0 0 2024-09-12T22:49:56.075 INFO:tasks.workunit.client.0.smithi066.stdout:3/423: mkdir d0/d2/d1d/d87/d40/da2 0 2024-09-12T22:49:56.076 INFO:tasks.workunit.client.0.smithi066.stdout:4/494: mkdir d5/d3e/d65/dac 0 2024-09-12T22:49:56.076 INFO:tasks.workunit.client.0.smithi066.stdout:5/521: fdatasync d5/d11/d21/d4d/f7a 0 2024-09-12T22:49:56.077 INFO:tasks.workunit.client.0.smithi066.stdout:3/424: write d0/d2/d1d/d87/d40/f95 [840044,53253] 0 2024-09-12T22:49:56.077 INFO:tasks.workunit.client.0.smithi066.stdout:5/522: dread - d5/d11/d21/f4a zero size 2024-09-12T22:49:56.077 INFO:tasks.workunit.client.0.smithi066.stdout:4/495: stat d5/d8/d16/d1b/d72/c95 0 2024-09-12T22:49:56.077 INFO:tasks.workunit.client.0.smithi066.stdout:5/523: readlink d5/ld 0 2024-09-12T22:49:56.077 INFO:tasks.workunit.client.0.smithi066.stdout:9/445: read d9/f53 [3789177,106249] 0 2024-09-12T22:49:56.078 INFO:tasks.workunit.client.0.smithi066.stdout:3/425: write d0/d2/d1d/d87/d40/f95 [1778841,63819] 0 2024-09-12T22:49:56.078 INFO:tasks.workunit.client.0.smithi066.stdout:4/496: truncate d5/f33 2294206 0 2024-09-12T22:49:56.078 INFO:tasks.workunit.client.0.smithi066.stdout:3/426: creat d0/d2/d68/fa3 x:0 0 0 2024-09-12T22:49:56.078 INFO:tasks.workunit.client.0.smithi066.stdout:5/524: rename d5/d15/f1a to d5/de/f95 0 2024-09-12T22:49:56.079 INFO:tasks.workunit.client.0.smithi066.stdout:3/427: chown d0/d2/d7/d13/d31/c41 283 1 2024-09-12T22:49:56.079 INFO:tasks.workunit.client.0.smithi066.stdout:5/525: mknod d5/d11/d23/d6f/c96 0 2024-09-12T22:49:56.080 INFO:tasks.workunit.client.0.smithi066.stdout:3/428: creat d0/d2/d1d/d87/d49/fa4 x:0 0 0 2024-09-12T22:49:56.081 INFO:tasks.workunit.client.0.smithi066.stdout:3/429: readlink d0/d2/d7/d13/l75 0 2024-09-12T22:49:56.082 INFO:tasks.workunit.client.0.smithi066.stdout:4/497: dwrite d5/f4f [0,4194304] 0 2024-09-12T22:49:56.083 INFO:tasks.workunit.client.0.smithi066.stdout:4/498: write d5/d8/d10/f6b [412133,60006] 0 2024-09-12T22:49:56.084 INFO:tasks.workunit.client.0.smithi066.stdout:8/473: getdents d17/d40/d47 0 2024-09-12T22:49:56.084 INFO:tasks.workunit.client.0.smithi066.stdout:3/430: creat d0/d2/d7/d13/d43/fa5 x:0 0 0 2024-09-12T22:49:56.086 INFO:tasks.workunit.client.0.smithi066.stdout:3/431: write d0/d2/fa [1172800,40633] 0 2024-09-12T22:49:56.086 INFO:tasks.workunit.client.0.smithi066.stdout:8/474: unlink d17/d40/d47/d4d/l53 0 2024-09-12T22:49:56.086 INFO:tasks.workunit.client.0.smithi066.stdout:3/432: symlink d0/d2/d68/la6 0 2024-09-12T22:49:56.087 INFO:tasks.workunit.client.0.smithi066.stdout:8/475: creat d17/d49/d4b/d57/d5e/d65/d91/f97 x:0 0 0 2024-09-12T22:49:56.088 INFO:tasks.workunit.client.0.smithi066.stdout:2/456: dread d1/dd/d12/d67/f6a [0,4194304] 0 2024-09-12T22:49:56.089 INFO:tasks.workunit.client.0.smithi066.stdout:8/476: mknod d17/c98 0 2024-09-12T22:49:56.089 INFO:tasks.workunit.client.0.smithi066.stdout:3/433: write d0/d2/d7/d13/d43/f50 [844808,95753] 0 2024-09-12T22:49:56.089 INFO:tasks.workunit.client.0.smithi066.stdout:4/499: dwrite d5/d8/d16/d1b/d1e/d5a/f85 [0,4194304] 0 2024-09-12T22:49:56.091 INFO:tasks.workunit.client.0.smithi066.stdout:1/361: dread d0/dc/f17 [0,4194304] 0 2024-09-12T22:49:56.093 INFO:tasks.workunit.client.0.smithi066.stdout:8/477: truncate d17/d1b/f5a 4798623 0 2024-09-12T22:49:56.097 INFO:tasks.workunit.client.0.smithi066.stdout:3/434: unlink d0/d2/d1d/f5f 0 2024-09-12T22:49:56.097 INFO:tasks.workunit.client.0.smithi066.stdout:8/478: rmdir d17 39 2024-09-12T22:49:56.098 INFO:tasks.workunit.client.0.smithi066.stdout:1/362: readlink d0/dc/l5d 0 2024-09-12T22:49:56.098 INFO:tasks.workunit.client.0.smithi066.stdout:7/410: dwrite d0/d19/d26/f6a [0,4194304] 0 2024-09-12T22:49:56.098 INFO:tasks.workunit.client.0.smithi066.stdout:4/500: rename d5/d8/d16/l79 to d5/d8/d10/de/d2d/lad 0 2024-09-12T22:49:56.098 INFO:tasks.workunit.client.0.smithi066.stdout:0/475: dwrite d1/f10 [0,4194304] 0 2024-09-12T22:49:56.098 INFO:tasks.workunit.client.0.smithi066.stdout:1/363: fdatasync d0/d28/f5f 0 2024-09-12T22:49:56.098 INFO:tasks.workunit.client.0.smithi066.stdout:7/411: mknod d0/d19/d24/c89 0 2024-09-12T22:49:56.098 INFO:tasks.workunit.client.0.smithi066.stdout:1/364: fsync d0/dc/d1d/f39 0 2024-09-12T22:49:56.098 INFO:tasks.workunit.client.0.smithi066.stdout:0/476: symlink d1/d8/d1b/d59/laa 0 2024-09-12T22:49:56.099 INFO:tasks.workunit.client.0.smithi066.stdout:1/365: symlink d0/dc/d1d/l65 0 2024-09-12T22:49:56.099 INFO:tasks.workunit.client.0.smithi066.stdout:7/412: rename d0/d19/d24/f3e to d0/d6/f8a 0 2024-09-12T22:49:56.099 INFO:tasks.workunit.client.0.smithi066.stdout:1/366: chown d0/d28 1653712 1 2024-09-12T22:49:56.100 INFO:tasks.workunit.client.0.smithi066.stdout:7/413: dread - d0/d19/d24/f6b zero size 2024-09-12T22:49:56.102 INFO:tasks.workunit.client.0.smithi066.stdout:1/367: creat d0/dc/d1d/f66 x:0 0 0 2024-09-12T22:49:56.103 INFO:tasks.workunit.client.0.smithi066.stdout:5/526: sync 2024-09-12T22:49:56.104 INFO:tasks.workunit.client.0.smithi066.stdout:3/435: read d0/d2/d7/d13/f19 [499996,127121] 0 2024-09-12T22:49:56.105 INFO:tasks.workunit.client.0.smithi066.stdout:1/368: fsync d0/f64 0 2024-09-12T22:49:56.105 INFO:tasks.workunit.client.0.smithi066.stdout:4/501: dwrite d5/d8/d16/d1b/d73/f92 [0,4194304] 0 2024-09-12T22:49:56.107 INFO:tasks.workunit.client.0.smithi066.stdout:0/477: dwrite d1/d8/d1c/fa9 [0,4194304] 0 2024-09-12T22:49:56.107 INFO:tasks.workunit.client.0.smithi066.stdout:8/479: dwrite d17/d49/f8d [0,4194304] 0 2024-09-12T22:49:56.108 INFO:tasks.workunit.client.0.smithi066.stdout:1/369: chown d0/dc/d33/c59 3466946 1 2024-09-12T22:49:56.108 INFO:tasks.workunit.client.0.smithi066.stdout:8/480: chown d17/d2c 4066623 1 2024-09-12T22:49:56.108 INFO:tasks.workunit.client.0.smithi066.stdout:0/478: chown d1/d8/f35 0 1 2024-09-12T22:49:56.108 INFO:tasks.workunit.client.0.smithi066.stdout:1/370: chown d0/dc/c52 287438 1 2024-09-12T22:49:56.109 INFO:tasks.workunit.client.0.smithi066.stdout:8/481: fdatasync d17/d40/d47/f8e 0 2024-09-12T22:49:56.109 INFO:tasks.workunit.client.0.smithi066.stdout:0/479: mknod d1/d5b/d6d/cab 0 2024-09-12T22:49:56.109 INFO:tasks.workunit.client.0.smithi066.stdout:3/436: mknod d0/ca7 0 2024-09-12T22:49:56.110 INFO:tasks.workunit.client.0.smithi066.stdout:8/482: mkdir d17/d40/d74/d99 0 2024-09-12T22:49:56.110 INFO:tasks.workunit.client.0.smithi066.stdout:5/527: write d5/d11/d21/d4d/f7a [359998,31936] 0 2024-09-12T22:49:56.111 INFO:tasks.workunit.client.0.smithi066.stdout:0/480: mkdir d1/d8/d1b/dac 0 2024-09-12T22:49:56.111 INFO:tasks.workunit.client.0.smithi066.stdout:3/437: readlink d0/d2/d1d/d87/d40/d44/l51 0 2024-09-12T22:49:56.112 INFO:tasks.workunit.client.0.smithi066.stdout:8/483: fsync d17/d49/d4b/d57/f80 0 2024-09-12T22:49:56.113 INFO:tasks.workunit.client.0.smithi066.stdout:5/528: rmdir d5/de/d50/d42/d49 39 2024-09-12T22:49:56.114 INFO:tasks.workunit.client.0.smithi066.stdout:9/446: dread d9/dc/d36/f71 [0,4194304] 0 2024-09-12T22:49:56.115 INFO:tasks.workunit.client.0.smithi066.stdout:0/481: creat d1/d8/d1b/dac/fad x:0 0 0 2024-09-12T22:49:56.115 INFO:tasks.workunit.client.0.smithi066.stdout:9/447: rename d9/dc/dd/d75 to d9/d31/d77/d8f 0 2024-09-12T22:49:56.116 INFO:tasks.workunit.client.0.smithi066.stdout:5/529: write d5/d11/d23/f56 [378730,16813] 0 2024-09-12T22:49:56.116 INFO:tasks.workunit.client.0.smithi066.stdout:6/537: dread d6/d23/d25/f6f [0,4194304] 0 2024-09-12T22:49:56.117 INFO:tasks.workunit.client.0.smithi066.stdout:9/448: write d9/dc/f40 [4537825,88030] 0 2024-09-12T22:49:56.119 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:56.119 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:49:56.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:49:56.119 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:49:56.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.119 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:10660 4.23 4:c5bf0e37:::100000030bf.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:49:56.119 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:51.530144+0000", 2024-09-12T22:49:56.119 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.5870621109999998, 2024-09-12T22:49:56.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026397501, 2024-09-12T22:49:56.120 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:56.120 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:56.120 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.120 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:56.120 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:56.120 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:56.120 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 10660 2024-09-12T22:49:56.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.121 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:56.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:56.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.530144+0000", 2024-09-12T22:49:56.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:56.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.530144+0000", 2024-09-12T22:49:56.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:56.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.530145+0000", 2024-09-12T22:49:56.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:49:56.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:56.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.537338+0000", 2024-09-12T22:49:56.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071928679999999998 2024-09-12T22:49:56.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:56.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.537357+0000", 2024-09-12T22:49:56.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8804000000000002e-05 2024-09-12T22:49:56.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.537382+0000", 2024-09-12T22:49:56.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5055e-05 2024-09-12T22:49:56.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:56.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.537432+0000", 2024-09-12T22:49:56.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0562999999999997e-05 2024-09-12T22:49:56.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:56.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.537546+0000", 2024-09-12T22:49:56.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114088 2024-09-12T22:49:56.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:56.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.537665+0000", 2024-09-12T22:49:56.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000118171 2024-09-12T22:49:56.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:56.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.541897+0000", 2024-09-12T22:49:56.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042323739999999997 2024-09-12T22:49:56.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:56.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.556413+0000", 2024-09-12T22:49:56.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014515689999999999 2024-09-12T22:49:56.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:56.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.556475+0000", 2024-09-12T22:49:56.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2045999999999995e-05 2024-09-12T22:49:56.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:56.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.556542+0000", 2024-09-12T22:49:56.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7216000000000002e-05 2024-09-12T22:49:56.126 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.126 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:56.126 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.126 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:10687 4.1e 4:7aad8e66:::100000030cb.00000001:head [write 0~4194304 [2@0]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:49:56.126 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:51.585194+0000", 2024-09-12T22:49:56.126 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.532012731, 2024-09-12T22:49:56.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026355747999999998, 2024-09-12T22:49:56.126 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:56.126 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:56.127 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.127 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:56.127 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:56.127 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:56.127 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 10687 2024-09-12T22:49:56.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.127 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:56.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:56.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.585194+0000", 2024-09-12T22:49:56.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:56.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.585194+0000", 2024-09-12T22:49:56.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:56.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.585195+0000", 2024-09-12T22:49:56.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6750000000000001e-06 2024-09-12T22:49:56.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:56.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.594769+0000", 2024-09-12T22:49:56.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0095737649999999997 2024-09-12T22:49:56.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:56.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.594784+0000", 2024-09-12T22:49:56.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5075999999999999e-05 2024-09-12T22:49:56.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.594792+0000", 2024-09-12T22:49:56.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2370000000000003e-06 2024-09-12T22:49:56.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:56.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.594859+0000", 2024-09-12T22:49:56.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7792000000000004e-05 2024-09-12T22:49:56.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:56.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.595018+0000", 2024-09-12T22:49:56.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000158846 2024-09-12T22:49:56.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:56.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.611397+0000", 2024-09-12T22:49:56.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0163786 2024-09-12T22:49:56.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:56.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.611461+0000", 2024-09-12T22:49:56.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4090999999999993e-05 2024-09-12T22:49:56.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:56.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:51.611550+0000", 2024-09-12T22:49:56.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8665999999999994e-05 2024-09-12T22:49:56.132 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.132 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:56.132 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.132 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:326 3.13 3:ceffbd45:::200.0000000a:head [write 1757992~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:49:56.132 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:52.152235+0000", 2024-09-12T22:49:56.132 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.9649715790000002, 2024-09-12T22:49:56.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027255317000000001, 2024-09-12T22:49:56.132 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:56.132 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:56.133 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.133 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:56.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:56.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152235+0000", 2024-09-12T22:49:56.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:56.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152235+0000", 2024-09-12T22:49:56.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:56.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152235+0000", 2024-09-12T22:49:56.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4000000000000002e-07 2024-09-12T22:49:56.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:56.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152239+0000", 2024-09-12T22:49:56.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1520000000000001e-06 2024-09-12T22:49:56.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:56.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152245+0000", 2024-09-12T22:49:56.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7610000000000002e-06 2024-09-12T22:49:56.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152250+0000", 2024-09-12T22:49:56.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8380000000000001e-06 2024-09-12T22:49:56.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:56.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.173288+0000", 2024-09-12T22:49:56.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021038333999999999 2024-09-12T22:49:56.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:56.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.173365+0000", 2024-09-12T22:49:56.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6501999999999994e-05 2024-09-12T22:49:56.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:56.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.179397+0000", 2024-09-12T22:49:56.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0060320110000000003 2024-09-12T22:49:56.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:56.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.179428+0000", 2024-09-12T22:49:56.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0973000000000003e-05 2024-09-12T22:49:56.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:56.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.179490+0000", 2024-09-12T22:49:56.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2305999999999996e-05 2024-09-12T22:49:56.137 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.137 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:56.137 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.137 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:327 3.13 3:ceffbd45:::200.0000000a:head [write 1759390~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:49:56.137 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:52.152270+0000", 2024-09-12T22:49:56.137 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.96493663, 2024-09-12T22:49:56.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.028205562, 2024-09-12T22:49:56.137 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:56.138 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:56.138 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.138 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:56.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:56.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152270+0000", 2024-09-12T22:49:56.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:56.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152270+0000", 2024-09-12T22:49:56.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:56.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152270+0000", 2024-09-12T22:49:56.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.34e-07 2024-09-12T22:49:56.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:56.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152277+0000", 2024-09-12T22:49:56.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3219999999999998e-06 2024-09-12T22:49:56.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:56.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152283+0000", 2024-09-12T22:49:56.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5989999999999998e-06 2024-09-12T22:49:56.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152288+0000", 2024-09-12T22:49:56.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1970000000000004e-06 2024-09-12T22:49:56.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:56.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.173749+0000", 2024-09-12T22:49:56.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021460374000000001 2024-09-12T22:49:56.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:56.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.173794+0000", 2024-09-12T22:49:56.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5631999999999999e-05 2024-09-12T22:49:56.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:56.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.180389+0000", 2024-09-12T22:49:56.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065943219999999997 2024-09-12T22:49:56.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:56.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.180417+0000", 2024-09-12T22:49:56.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8319000000000001e-05 2024-09-12T22:49:56.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:56.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.180475+0000", 2024-09-12T22:49:56.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8362999999999997e-05 2024-09-12T22:49:56.142 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.142 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:56.142 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.142 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:328 3.13 3:ceffbd45:::200.0000000a:head [write 1760803~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:49:56.142 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:52.152298+0000", 2024-09-12T22:49:56.142 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.9649085290000001, 2024-09-12T22:49:56.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.028261623, 2024-09-12T22:49:56.143 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:56.143 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:56.143 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.143 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:56.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:56.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152298+0000", 2024-09-12T22:49:56.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:56.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152298+0000", 2024-09-12T22:49:56.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:56.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152299+0000", 2024-09-12T22:49:56.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0999999999999999e-07 2024-09-12T22:49:56.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:56.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152301+0000", 2024-09-12T22:49:56.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4449999999999999e-06 2024-09-12T22:49:56.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:56.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152307+0000", 2024-09-12T22:49:56.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.728e-06 2024-09-12T22:49:56.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152312+0000", 2024-09-12T22:49:56.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9509999999999997e-06 2024-09-12T22:49:56.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:56.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.174167+0000", 2024-09-12T22:49:56.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021855001999999998 2024-09-12T22:49:56.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:56.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.174244+0000", 2024-09-12T22:49:56.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6921000000000004e-05 2024-09-12T22:49:56.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:56.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.180481+0000", 2024-09-12T22:49:56.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.006237584 2024-09-12T22:49:56.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:56.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.180509+0000", 2024-09-12T22:49:56.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7894000000000001e-05 2024-09-12T22:49:56.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:56.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.180560+0000", 2024-09-12T22:49:56.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0587999999999997e-05 2024-09-12T22:49:56.147 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.147 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:56.147 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.147 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:329 3.13 3:ceffbd45:::200.0000000a:head [write 1762211~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:49:56.147 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:52.152317+0000", 2024-09-12T22:49:56.147 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.9648892289999997, 2024-09-12T22:49:56.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.028327268999999999, 2024-09-12T22:49:56.148 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:56.148 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:56.148 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.148 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:56.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:56.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152317+0000", 2024-09-12T22:49:56.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:56.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152317+0000", 2024-09-12T22:49:56.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:56.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152318+0000", 2024-09-12T22:49:56.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:49:56.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:56.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152323+0000", 2024-09-12T22:49:56.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6380000000000001e-06 2024-09-12T22:49:56.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:56.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152329+0000", 2024-09-12T22:49:56.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9669999999999998e-06 2024-09-12T22:49:56.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152334+0000", 2024-09-12T22:49:56.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7169999999999999e-06 2024-09-12T22:49:56.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:56.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.174735+0000", 2024-09-12T22:49:56.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022400663000000001 2024-09-12T22:49:56.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:56.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.174808+0000", 2024-09-12T22:49:56.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3536999999999997e-05 2024-09-12T22:49:56.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:56.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.180564+0000", 2024-09-12T22:49:56.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005756176 2024-09-12T22:49:56.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:56.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.180590+0000", 2024-09-12T22:49:56.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5432999999999999e-05 2024-09-12T22:49:56.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:56.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.180645+0000", 2024-09-12T22:49:56.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4744999999999998e-05 2024-09-12T22:49:56.152 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.152 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:56.152 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.152 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:330 3.13 3:ceffbd45:::200.0000000a:head [write 1763614~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:49:56.152 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:52.152340+0000", 2024-09-12T22:49:56.153 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.9648666600000002, 2024-09-12T22:49:56.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.028391953000000001, 2024-09-12T22:49:56.153 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:56.153 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:56.153 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.153 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:56.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:56.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152340+0000", 2024-09-12T22:49:56.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:56.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152340+0000", 2024-09-12T22:49:56.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:56.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152340+0000", 2024-09-12T22:49:56.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7500000000000001e-07 2024-09-12T22:49:56.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:56.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152346+0000", 2024-09-12T22:49:56.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5500000000000002e-06 2024-09-12T22:49:56.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:56.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152352+0000", 2024-09-12T22:49:56.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7899999999999996e-06 2024-09-12T22:49:56.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.152356+0000", 2024-09-12T22:49:56.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6040000000000003e-06 2024-09-12T22:49:56.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:56.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.175226+0000", 2024-09-12T22:49:56.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022870214999999999 2024-09-12T22:49:56.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:56.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.175303+0000", 2024-09-12T22:49:56.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6361999999999998e-05 2024-09-12T22:49:56.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:56.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.180650+0000", 2024-09-12T22:49:56.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053471880000000001 2024-09-12T22:49:56.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:56.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.180684+0000", 2024-09-12T22:49:56.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3847999999999998e-05 2024-09-12T22:49:56.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:56.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.180732+0000", 2024-09-12T22:49:56.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8021e-05 2024-09-12T22:49:56.157 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.157 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:56.157 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.158 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:331 3.13 3:ceffbd45:::200.0000000a:head [write 1765014~4322 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:49:56.158 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:52.154070+0000", 2024-09-12T22:49:56.158 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.9631362480000001, 2024-09-12T22:49:56.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026747646999999999, 2024-09-12T22:49:56.158 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:56.158 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:56.158 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.158 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:56.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:56.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.154070+0000", 2024-09-12T22:49:56.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:56.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.154070+0000", 2024-09-12T22:49:56.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:56.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.154071+0000", 2024-09-12T22:49:56.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8999999999999995e-07 2024-09-12T22:49:56.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:56.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.154079+0000", 2024-09-12T22:49:56.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8739999999999995e-06 2024-09-12T22:49:56.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:56.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.154089+0000", 2024-09-12T22:49:56.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0139000000000001e-05 2024-09-12T22:49:56.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.154096+0000", 2024-09-12T22:49:56.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1679999999999998e-06 2024-09-12T22:49:56.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.161 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:56.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.175715+0000", 2024-09-12T22:49:56.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021618663999999999 2024-09-12T22:49:56.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.161 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:56.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.175765+0000", 2024-09-12T22:49:56.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9990000000000001e-05 2024-09-12T22:49:56.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.161 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:56.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.180737+0000", 2024-09-12T22:49:56.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049722029999999997 2024-09-12T22:49:56.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.162 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:56.162 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.180771+0000", 2024-09-12T22:49:56.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3929e-05 2024-09-12T22:49:56.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.162 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:56.162 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:52.180818+0000", 2024-09-12T22:49:56.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.689e-05 2024-09-12T22:49:56.162 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.162 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:56.162 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.163 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12403 4.0 4:0146e0d0:::100000031d4.00000000:head [write 0~4194304 [2@3733965]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:56.163 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:55.747692+0000", 2024-09-12T22:49:56.163 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.36951425700000001, 2024-09-12T22:49:56.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.22362137500000001, 2024-09-12T22:49:56.163 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:56.163 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:56.163 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.164 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:56.164 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:56.164 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:56.164 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12403 2024-09-12T22:49:56.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.164 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:56.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:56.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.747692+0000", 2024-09-12T22:49:56.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:56.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.747692+0000", 2024-09-12T22:49:56.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:56.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.747693+0000", 2024-09-12T22:49:56.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3799999999999996e-07 2024-09-12T22:49:56.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:56.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959640+0000", 2024-09-12T22:49:56.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.21194702000000001 2024-09-12T22:49:56.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:56.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959660+0000", 2024-09-12T22:49:56.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9939e-05 2024-09-12T22:49:56.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959668+0000", 2024-09-12T22:49:56.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1669999999999999e-06 2024-09-12T22:49:56.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:56.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959764+0000", 2024-09-12T22:49:56.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5315000000000005e-05 2024-09-12T22:49:56.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.167 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:56.167 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959865+0000", 2024-09-12T22:49:56.167 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101618 2024-09-12T22:49:56.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.167 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:56.167 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.971224+0000", 2024-09-12T22:49:56.167 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011358541999999999 2024-09-12T22:49:56.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.167 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:56.167 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.971261+0000", 2024-09-12T22:49:56.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7092999999999999e-05 2024-09-12T22:49:56.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.168 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:56.168 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.971314+0000", 2024-09-12T22:49:56.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2843000000000002e-05 2024-09-12T22:49:56.168 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.168 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:56.168 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.168 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:12503 4.15 e56/17 4:ab29d13f:::100000033b1.00000000:head v 56'161, mlcod=55'159)", 2024-09-12T22:49:56.168 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:49:56.169 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.086600780000000002, 2024-09-12T22:49:56.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.043668640000000002, 2024-09-12T22:49:56.169 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:56.169 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:56.169 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.169 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:56.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:56.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:49:56.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:56.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:49:56.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:56.170 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:49:56.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:49:56.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:56.170 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039768+0000", 2024-09-12T22:49:56.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0091617190000000005 2024-09-12T22:49:56.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:56.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039781+0000", 2024-09-12T22:49:56.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2829e-05 2024-09-12T22:49:56.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039789+0000", 2024-09-12T22:49:56.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9340000000000006e-06 2024-09-12T22:49:56.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:56.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039846+0000", 2024-09-12T22:49:56.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6762999999999998e-05 2024-09-12T22:49:56.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:56.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039897+0000", 2024-09-12T22:49:56.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1517000000000002e-05 2024-09-12T22:49:56.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:56.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074225+0000", 2024-09-12T22:49:56.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034328138000000001 2024-09-12T22:49:56.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:56.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074274+0000", 2024-09-12T22:49:56.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9255999999999997e-05 2024-09-12T22:49:56.173 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.173 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:56.173 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.173 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12507 4.29 4:94839381:::10000003376.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:56.173 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.031300+0000", 2024-09-12T22:49:56.173 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.085906652999999999, 2024-09-12T22:49:56.173 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027256488999999998, 2024-09-12T22:49:56.173 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:56.173 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:56.173 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.173 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:56.173 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:56.174 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:56.174 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12507 2024-09-12T22:49:56.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.174 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:56.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.174 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:56.174 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.031300+0000", 2024-09-12T22:49:56.174 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.174 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:56.174 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.031300+0000", 2024-09-12T22:49:56.174 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:56.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.031301+0000", 2024-09-12T22:49:56.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.22e-06 2024-09-12T22:49:56.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:56.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037259+0000", 2024-09-12T22:49:56.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059580609999999997 2024-09-12T22:49:56.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:56.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037270+0000", 2024-09-12T22:49:56.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0535e-05 2024-09-12T22:49:56.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037277+0000", 2024-09-12T22:49:56.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9539999999999998e-06 2024-09-12T22:49:56.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:56.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037327+0000", 2024-09-12T22:49:56.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0695999999999997e-05 2024-09-12T22:49:56.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:56.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037442+0000", 2024-09-12T22:49:56.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011499 2024-09-12T22:49:56.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:56.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.058360+0000", 2024-09-12T22:49:56.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020917722 2024-09-12T22:49:56.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:56.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.058411+0000", 2024-09-12T22:49:56.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1334e-05 2024-09-12T22:49:56.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.178 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:56.178 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.058556+0000", 2024-09-12T22:49:56.178 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014497699999999999 2024-09-12T22:49:56.178 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.178 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:56.178 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.178 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12508 4.2d 4:b7b19b64:::10000003230.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:56.179 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.037293+0000", 2024-09-12T22:49:56.179 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.079913604999999999, 2024-09-12T22:49:56.179 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.037399772999999997, 2024-09-12T22:49:56.179 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:56.179 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:56.179 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.179 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:56.179 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:56.179 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:56.180 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12508 2024-09-12T22:49:56.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.180 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:56.180 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.180 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:56.180 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037293+0000", 2024-09-12T22:49:56.180 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.180 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.180 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:56.180 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037293+0000", 2024-09-12T22:49:56.180 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.181 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:56.181 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037294+0000", 2024-09-12T22:49:56.181 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4899999999999995e-07 2024-09-12T22:49:56.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.181 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:56.181 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042701+0000", 2024-09-12T22:49:56.181 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054069419999999997 2024-09-12T22:49:56.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.181 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:56.181 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042712+0000", 2024-09-12T22:49:56.181 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.171e-05 2024-09-12T22:49:56.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042719+0000", 2024-09-12T22:49:56.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1189999999999999e-06 2024-09-12T22:49:56.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:56.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042759+0000", 2024-09-12T22:49:56.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9478999999999999e-05 2024-09-12T22:49:56.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:56.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042827+0000", 2024-09-12T22:49:56.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8435999999999993e-05 2024-09-12T22:49:56.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.183 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:56.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042965+0000", 2024-09-12T22:49:56.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000137723 2024-09-12T22:49:56.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.183 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:56.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.058351+0000", 2024-09-12T22:49:56.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015385902 2024-09-12T22:49:56.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.184 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:56.184 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074620+0000", 2024-09-12T22:49:56.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016269018 2024-09-12T22:49:56.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.184 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:56.184 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074657+0000", 2024-09-12T22:49:56.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6619999999999998e-05 2024-09-12T22:49:56.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.184 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:56.185 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074693+0000", 2024-09-12T22:49:56.185 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6174999999999998e-05 2024-09-12T22:49:56.185 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.185 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:56.185 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.185 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.185 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.185 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1351 3.18 3:1e8917d7:::200.0000000e:head [write 477822~10288 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:49:56.185 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.041966+0000", 2024-09-12T22:49:56.185 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.075240539999999995, 2024-09-12T22:49:56.185 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026510480999999999, 2024-09-12T22:49:56.185 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:56.185 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:56.185 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.186 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:56.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.186 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:56.186 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.041966+0000", 2024-09-12T22:49:56.186 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.186 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:56.186 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.041966+0000", 2024-09-12T22:49:56.186 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.186 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:56.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.041967+0000", 2024-09-12T22:49:56.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4529999999999999e-06 2024-09-12T22:49:56.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:56.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.041977+0000", 2024-09-12T22:49:56.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0018e-05 2024-09-12T22:49:56.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:56.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.041986+0000", 2024-09-12T22:49:56.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7779999999999996e-06 2024-09-12T22:49:56.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.188 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.188 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.041993+0000", 2024-09-12T22:49:56.188 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6309999999999997e-06 2024-09-12T22:49:56.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.188 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:56.188 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042057+0000", 2024-09-12T22:49:56.188 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3966000000000004e-05 2024-09-12T22:49:56.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:56.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042119+0000", 2024-09-12T22:49:56.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2590999999999998e-05 2024-09-12T22:49:56.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:56.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042201+0000", 2024-09-12T22:49:56.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1768999999999996e-05 2024-09-12T22:49:56.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:56.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.044117+0000", 2024-09-12T22:49:56.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019153 2024-09-12T22:49:56.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:56.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.068354+0000", 2024-09-12T22:49:56.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024237910000000001 2024-09-12T22:49:56.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:56.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.068420+0000", 2024-09-12T22:49:56.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5349000000000001e-05 2024-09-12T22:49:56.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.191 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:56.191 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.068476+0000", 2024-09-12T22:49:56.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6715999999999997e-05 2024-09-12T22:49:56.191 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.191 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:56.191 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.191 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12516 4.21 4:858ae08d:::100000030eb.00000000:head [write 0~4194304 [3@1582458]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:56.191 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.045143+0000", 2024-09-12T22:49:56.191 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.072063317000000002, 2024-09-12T22:49:56.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.039721657, 2024-09-12T22:49:56.191 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:56.192 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:56.192 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.192 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:56.192 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:56.192 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:56.192 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12516 2024-09-12T22:49:56.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.192 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:56.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:56.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.045143+0000", 2024-09-12T22:49:56.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:56.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.045143+0000", 2024-09-12T22:49:56.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:56.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.045144+0000", 2024-09-12T22:49:56.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2900000000000002e-07 2024-09-12T22:49:56.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:56.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049506+0000", 2024-09-12T22:49:56.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043620280000000004 2024-09-12T22:49:56.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:56.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049517+0000", 2024-09-12T22:49:56.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0726e-05 2024-09-12T22:49:56.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049522+0000", 2024-09-12T22:49:56.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3730000000000001e-06 2024-09-12T22:49:56.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:56.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049583+0000", 2024-09-12T22:49:56.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1254999999999995e-05 2024-09-12T22:49:56.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:56.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049645+0000", 2024-09-12T22:49:56.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1988000000000003e-05 2024-09-12T22:49:56.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:56.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049731+0000", 2024-09-12T22:49:56.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6040999999999998e-05 2024-09-12T22:49:56.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:56.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.064126+0000", 2024-09-12T22:49:56.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01439497 2024-09-12T22:49:56.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:56.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.084785+0000", 2024-09-12T22:49:56.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020658972000000001 2024-09-12T22:49:56.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:56.197 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.084829+0000", 2024-09-12T22:49:56.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3869000000000003e-05 2024-09-12T22:49:56.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:56.197 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.084865+0000", 2024-09-12T22:49:56.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5605999999999998e-05 2024-09-12T22:49:56.197 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.197 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:56.197 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.198 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1354 3.18 3:1e8917d7:::200.0000000e:head [write 498872~14494 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:49:56.198 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.048337+0000", 2024-09-12T22:49:56.198 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.068869397999999998, 2024-09-12T22:49:56.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034292491000000001, 2024-09-12T22:49:56.198 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:56.198 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:56.198 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.198 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:56.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:56.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048337+0000", 2024-09-12T22:49:56.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:56.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048337+0000", 2024-09-12T22:49:56.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:56.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048339+0000", 2024-09-12T22:49:56.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.409e-06 2024-09-12T22:49:56.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:56.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048360+0000", 2024-09-12T22:49:56.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1659999999999999e-05 2024-09-12T22:49:56.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:56.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048370+0000", 2024-09-12T22:49:56.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.611e-06 2024-09-12T22:49:56.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048376+0000", 2024-09-12T22:49:56.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5479999999999998e-06 2024-09-12T22:49:56.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:56.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048440+0000", 2024-09-12T22:49:56.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3367000000000005e-05 2024-09-12T22:49:56.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:56.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048557+0000", 2024-09-12T22:49:56.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116983 2024-09-12T22:49:56.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:56.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048719+0000", 2024-09-12T22:49:56.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016250499999999999 2024-09-12T22:49:56.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:56.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.058763+0000", 2024-09-12T22:49:56.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010043948 2024-09-12T22:49:56.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:56.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082499+0000", 2024-09-12T22:49:56.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023735320000000001 2024-09-12T22:49:56.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.203 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:56.203 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082561+0000", 2024-09-12T22:49:56.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2490000000000006e-05 2024-09-12T22:49:56.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.203 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:56.203 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082630+0000", 2024-09-12T22:49:56.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8650000000000002e-05 2024-09-12T22:49:56.203 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.203 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:56.203 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.204 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12517 4.1a 4:5a8c04dd:::10000003276.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:56.204 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.049539+0000", 2024-09-12T22:49:56.204 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.067667636000000003, 2024-09-12T22:49:56.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.036068957999999998, 2024-09-12T22:49:56.204 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:56.204 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:56.204 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.204 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:56.204 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:56.204 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:56.204 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12517 2024-09-12T22:49:56.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.204 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:56.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:56.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049539+0000", 2024-09-12T22:49:56.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:56.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049539+0000", 2024-09-12T22:49:56.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:56.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049540+0000", 2024-09-12T22:49:56.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1299999999999999e-07 2024-09-12T22:49:56.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:56.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054581+0000", 2024-09-12T22:49:56.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005041167 2024-09-12T22:49:56.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:56.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054593+0000", 2024-09-12T22:49:56.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1943000000000001e-05 2024-09-12T22:49:56.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054598+0000", 2024-09-12T22:49:56.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6500000000000001e-06 2024-09-12T22:49:56.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:56.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054658+0000", 2024-09-12T22:49:56.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9898999999999997e-05 2024-09-12T22:49:56.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:56.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054800+0000", 2024-09-12T22:49:56.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014187100000000001 2024-09-12T22:49:56.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:56.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.085456+0000", 2024-09-12T22:49:56.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.030655452 2024-09-12T22:49:56.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:56.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.085533+0000", 2024-09-12T22:49:56.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7478999999999995e-05 2024-09-12T22:49:56.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.209 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:56.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.085608+0000", 2024-09-12T22:49:56.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4684000000000005e-05 2024-09-12T22:49:56.209 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.209 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:56.209 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.210 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1355 3.18 3:1e8917d7:::200.0000000e:head [write 513366~7763 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:49:56.210 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.051378+0000", 2024-09-12T22:49:56.210 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.065828734, 2024-09-12T22:49:56.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031342464, 2024-09-12T22:49:56.210 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:56.210 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:56.210 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.210 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:56.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:56.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.051378+0000", 2024-09-12T22:49:56.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:56.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.051378+0000", 2024-09-12T22:49:56.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:56.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.051380+0000", 2024-09-12T22:49:56.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8679999999999999e-06 2024-09-12T22:49:56.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:56.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.051391+0000", 2024-09-12T22:49:56.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1364e-05 2024-09-12T22:49:56.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:56.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.051407+0000", 2024-09-12T22:49:56.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5574e-05 2024-09-12T22:49:56.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.051416+0000", 2024-09-12T22:49:56.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1190000000000003e-06 2024-09-12T22:49:56.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:56.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.057996+0000", 2024-09-12T22:49:56.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065801109999999996 2024-09-12T22:49:56.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:56.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.058095+0000", 2024-09-12T22:49:56.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9244000000000001e-05 2024-09-12T22:49:56.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:56.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.058236+0000", 2024-09-12T22:49:56.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014110699999999999 2024-09-12T22:49:56.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:56.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.061742+0000", 2024-09-12T22:49:56.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0035056050000000002 2024-09-12T22:49:56.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:56.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082638+0000", 2024-09-12T22:49:56.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020896076 2024-09-12T22:49:56.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:56.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082687+0000", 2024-09-12T22:49:56.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8943000000000002e-05 2024-09-12T22:49:56.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.215 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:56.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082720+0000", 2024-09-12T22:49:56.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3453e-05 2024-09-12T22:49:56.215 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.215 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:56.215 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.215 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1356 3.18 3:1e8917d7:::200.0000000e:head [write 521129~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:49:56.215 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.051437+0000", 2024-09-12T22:49:56.215 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.065769181999999995, 2024-09-12T22:49:56.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031373360000000003, 2024-09-12T22:49:56.215 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:56.216 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:56.216 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.216 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:56.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:56.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.051437+0000", 2024-09-12T22:49:56.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:56.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.051437+0000", 2024-09-12T22:49:56.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:56.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.051438+0000", 2024-09-12T22:49:56.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.34e-07 2024-09-12T22:49:56.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:56.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.051443+0000", 2024-09-12T22:49:56.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3449999999999996e-06 2024-09-12T22:49:56.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:56.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.051448+0000", 2024-09-12T22:49:56.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0880000000000002e-06 2024-09-12T22:49:56.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.051451+0000", 2024-09-12T22:49:56.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3270000000000001e-06 2024-09-12T22:49:56.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:56.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.058791+0000", 2024-09-12T22:49:56.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073400640000000003 2024-09-12T22:49:56.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:56.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.058844+0000", 2024-09-12T22:49:56.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2887999999999999e-05 2024-09-12T22:49:56.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:56.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.058937+0000", 2024-09-12T22:49:56.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2639000000000005e-05 2024-09-12T22:49:56.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:56.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.064399+0000", 2024-09-12T22:49:56.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054619689999999997 2024-09-12T22:49:56.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:56.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082728+0000", 2024-09-12T22:49:56.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018328728999999998 2024-09-12T22:49:56.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:56.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082768+0000", 2024-09-12T22:49:56.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0194999999999997e-05 2024-09-12T22:49:56.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:56.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082811+0000", 2024-09-12T22:49:56.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2882e-05 2024-09-12T22:49:56.220 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.220 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:56.221 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.221 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1357 3.18 3:1e8917d7:::200.0000000e:head [write 523088~4215 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:49:56.221 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.052742+0000", 2024-09-12T22:49:56.221 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.064465026999999994, 2024-09-12T22:49:56.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.030152152000000002, 2024-09-12T22:49:56.221 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:56.221 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:56.221 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.221 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:56.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.221 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:56.221 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.052742+0000", 2024-09-12T22:49:56.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:56.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.052742+0000", 2024-09-12T22:49:56.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:56.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.052743+0000", 2024-09-12T22:49:56.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.243e-06 2024-09-12T22:49:56.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:56.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.052751+0000", 2024-09-12T22:49:56.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1829999999999994e-06 2024-09-12T22:49:56.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:56.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.052763+0000", 2024-09-12T22:49:56.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2303000000000001e-05 2024-09-12T22:49:56.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.052770+0000", 2024-09-12T22:49:56.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8859999999999998e-06 2024-09-12T22:49:56.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:56.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.059160+0000", 2024-09-12T22:49:56.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0063895999999999996 2024-09-12T22:49:56.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:56.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.059223+0000", 2024-09-12T22:49:56.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3645999999999993e-05 2024-09-12T22:49:56.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:56.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.059315+0000", 2024-09-12T22:49:56.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1546999999999996e-05 2024-09-12T22:49:56.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:56.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.064870+0000", 2024-09-12T22:49:56.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055547950000000004 2024-09-12T22:49:56.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:56.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082818+0000", 2024-09-12T22:49:56.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017947851000000001 2024-09-12T22:49:56.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:56.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082858+0000", 2024-09-12T22:49:56.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0871000000000002e-05 2024-09-12T22:49:56.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:56.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082894+0000", 2024-09-12T22:49:56.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5227e-05 2024-09-12T22:49:56.226 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.226 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:56.226 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.227 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12521 4.10 4:089893dd:::100000032c7.00000000:head [write 0~4194304 [2@1930750]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:56.227 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.056458+0000", 2024-09-12T22:49:56.227 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.060748599, 2024-09-12T22:49:56.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027119628999999999, 2024-09-12T22:49:56.227 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:56.227 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:56.227 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.227 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:56.227 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:56.227 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:56.227 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12521 2024-09-12T22:49:56.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.227 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:56.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:56.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.056458+0000", 2024-09-12T22:49:56.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:56.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.056458+0000", 2024-09-12T22:49:56.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:56.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:56.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.056459+0000", 2024-09-12T22:49:56.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3500000000000005e-07 2024-09-12T22:49:56.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:56.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.061093+0000", 2024-09-12T22:49:56.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0046339800000000002 2024-09-12T22:49:56.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:56.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.061108+0000", 2024-09-12T22:49:56.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4948e-05 2024-09-12T22:49:56.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.061130+0000", 2024-09-12T22:49:56.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1817000000000001e-05 2024-09-12T22:49:56.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:56.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.061778+0000", 2024-09-12T22:49:56.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00064787899999999997 2024-09-12T22:49:56.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:56.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.061874+0000", 2024-09-12T22:49:56.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6286999999999995e-05 2024-09-12T22:49:56.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:56.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.062022+0000", 2024-09-12T22:49:56.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014858499999999999 2024-09-12T22:49:56.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:56.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.077349+0000", 2024-09-12T22:49:56.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015326774 2024-09-12T22:49:56.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:56.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.083509+0000", 2024-09-12T22:49:56.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061598449999999997 2024-09-12T22:49:56.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:56.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.083547+0000", 2024-09-12T22:49:56.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8006000000000002e-05 2024-09-12T22:49:56.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:56.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:56.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:56.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.083578+0000", 2024-09-12T22:49:56.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0573e-05 2024-09-12T22:49:56.232 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.232 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:56.232 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.233 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:56.233 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:56.233 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:56.234 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:56.233+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:56.235 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:56.253 INFO:tasks.workunit.client.0.smithi066.stdout:6/538: truncate d6/d20/d50/f5d 883879 0 2024-09-12T22:49:56.253 INFO:tasks.workunit.client.0.smithi066.stdout:6/539: mknod d6/d7/cbd 0 2024-09-12T22:49:56.253 INFO:tasks.workunit.client.0.smithi066.stdout:7/414: write d0/d19/d24/d33/d27/f57 [1941034,92606] 0 2024-09-12T22:49:56.253 INFO:tasks.workunit.client.0.smithi066.stdout:4/502: write d5/d3e/d8d/f53 [956916,130871] 0 2024-09-12T22:49:56.253 INFO:tasks.workunit.client.0.smithi066.stdout:7/415: readlink d0/d19/d26/l2b 0 2024-09-12T22:49:56.253 INFO:tasks.workunit.client.0.smithi066.stdout:1/371: dread d0/f16 [0,4194304] 0 2024-09-12T22:49:56.253 INFO:tasks.workunit.client.0.smithi066.stdout:8/484: write d17/d2c/f32 [992264,19944] 0 2024-09-12T22:49:56.253 INFO:tasks.workunit.client.0.smithi066.stdout:0/482: dwrite d1/d8/d1f/d25/f71 [0,4194304] 0 2024-09-12T22:49:56.253 INFO:tasks.workunit.client.0.smithi066.stdout:5/530: dwrite d5/d11/f43 [0,4194304] 0 2024-09-12T22:49:56.253 INFO:tasks.workunit.client.0.smithi066.stdout:7/416: fsync d0/d19/d26/d48/f49 0 2024-09-12T22:49:56.253 INFO:tasks.workunit.client.0.smithi066.stdout:5/531: mkdir d5/d11/d5d/d97 0 2024-09-12T22:49:56.253 INFO:tasks.workunit.client.0.smithi066.stdout:9/449: dwrite d9/d31/f73 [0,4194304] 0 2024-09-12T22:49:56.254 INFO:tasks.workunit.client.0.smithi066.stdout:2/457: dread d1/dd/d12/d1e/f35 [0,4194304] 0 2024-09-12T22:49:56.254 INFO:tasks.workunit.client.0.smithi066.stdout:5/532: write d5/f3e [462798,47371] 0 2024-09-12T22:49:56.254 INFO:tasks.workunit.client.0.smithi066.stdout:8/485: symlink d17/d40/d74/d99/l9a 0 2024-09-12T22:49:56.254 INFO:tasks.workunit.client.0.smithi066.stdout:4/503: creat d5/d8/d10/de/d2d/fae x:0 0 0 2024-09-12T22:49:56.254 INFO:tasks.workunit.client.0.smithi066.stdout:1/372: link d0/d36/d57/f3e d0/dc/d1d/f67 0 2024-09-12T22:49:56.254 INFO:tasks.workunit.client.0.smithi066.stdout:3/438: dwrite d0/d2/d6/f18 [0,4194304] 0 2024-09-12T22:49:56.254 INFO:tasks.workunit.client.0.smithi066.stdout:5/533: fdatasync d5/de/d50/f90 0 2024-09-12T22:49:56.254 INFO:tasks.workunit.client.0.smithi066.stdout:7/417: mkdir d0/d19/d60/d85/d8b 0 2024-09-12T22:49:56.254 INFO:tasks.workunit.client.0.smithi066.stdout:9/450: rename d9/dc/l17 to d9/dc/d46/d8a/l90 0 2024-09-12T22:49:56.254 INFO:tasks.workunit.client.0.smithi066.stdout:4/504: mknod d5/d8/d10/de/d2d/d64/caf 0 2024-09-12T22:49:56.254 INFO:tasks.workunit.client.0.smithi066.stdout:1/373: unlink d0/c26 0 2024-09-12T22:49:56.254 INFO:tasks.workunit.client.0.smithi066.stdout:3/439: write d0/d2/d7/d13/f62 [539513,60034] 0 2024-09-12T22:49:56.254 INFO:tasks.workunit.client.0.smithi066.stdout:5/534: mkdir d5/d11/d7c/d98 0 2024-09-12T22:49:56.254 INFO:tasks.workunit.client.0.smithi066.stdout:1/374: chown d0/d9 0 1 2024-09-12T22:49:56.255 INFO:tasks.workunit.client.0.smithi066.stdout:9/451: link d9/dc/d36/f39 d9/d31/d77/f91 0 2024-09-12T22:49:56.255 INFO:tasks.workunit.client.0.smithi066.stdout:3/440: stat d0/d2/d1d/f21 0 2024-09-12T22:49:56.255 INFO:tasks.workunit.client.0.smithi066.stdout:9/452: chown d9/d31/d34/d4d/d8c 1 1 2024-09-12T22:49:56.255 INFO:tasks.workunit.client.0.smithi066.stdout:4/505: symlink d5/d8/d16/d1b/d1e/d1f/lb0 0 2024-09-12T22:49:56.255 INFO:tasks.workunit.client.0.smithi066.stdout:1/375: mknod d0/d9/c68 0 2024-09-12T22:49:56.255 INFO:tasks.workunit.client.0.smithi066.stdout:0/483: truncate d1/d8/f35 1614544 0 2024-09-12T22:49:56.255 INFO:tasks.workunit.client.0.smithi066.stdout:3/441: chown d0/d1b/c53 3938 1 2024-09-12T22:49:56.255 INFO:tasks.workunit.client.0.smithi066.stdout:8/486: dwrite d17/d49/f8d [4194304,4194304] 0 2024-09-12T22:49:56.255 INFO:tasks.workunit.client.0.smithi066.stdout:9/453: creat d9/dc/d46/d8a/f92 x:0 0 0 2024-09-12T22:49:56.255 INFO:tasks.workunit.client.0.smithi066.stdout:5/535: fdatasync d5/d11/d21/d4d/f6d 0 2024-09-12T22:49:56.255 INFO:tasks.workunit.client.0.smithi066.stdout:3/442: read - d0/d2/d7/d13/d43/d74/f9b zero size 2024-09-12T22:49:56.255 INFO:tasks.workunit.client.0.smithi066.stdout:7/418: dwrite d0/d19/d60/f79 [4194304,4194304] 0 2024-09-12T22:49:56.255 INFO:tasks.workunit.client.0.smithi066.stdout:9/454: readlink d9/d31/d34/d4d/l59 0 2024-09-12T22:49:56.255 INFO:tasks.workunit.client.0.smithi066.stdout:4/506: creat d5/d8/d16/d1b/d1e/d1f/fb1 x:0 0 0 2024-09-12T22:49:56.256 INFO:tasks.workunit.client.0.smithi066.stdout:8/487: symlink d17/d40/d47/d81/l9b 0 2024-09-12T22:49:56.256 INFO:tasks.workunit.client.0.smithi066.stdout:4/507: stat d5/d8/d16/f9b 0 2024-09-12T22:49:56.256 INFO:tasks.workunit.client.0.smithi066.stdout:3/443: write d0/d2/d7/f1a [3989477,69333] 0 2024-09-12T22:49:56.256 INFO:tasks.workunit.client.0.smithi066.stdout:9/455: rmdir d9/dc 39 2024-09-12T22:49:56.256 INFO:tasks.workunit.client.0.smithi066.stdout:8/488: chown d17/l33 5273 1 2024-09-12T22:49:56.256 INFO:tasks.workunit.client.0.smithi066.stdout:7/419: getdents d0/d19/d60/d85/d8b 0 2024-09-12T22:49:56.256 INFO:tasks.workunit.client.0.smithi066.stdout:5/536: getdents d5/d11/d21/d4d 0 2024-09-12T22:49:56.256 INFO:tasks.workunit.client.0.smithi066.stdout:1/376: dread d0/d36/d57/f2b [0,4194304] 0 2024-09-12T22:49:56.256 INFO:tasks.workunit.client.0.smithi066.stdout:4/508: rename d5/d8/c23 to d5/cb2 0 2024-09-12T22:49:56.256 INFO:tasks.workunit.client.0.smithi066.stdout:9/456: link d9/d31/d34/f89 d9/d31/d58/d7f/f93 0 2024-09-12T22:49:56.256 INFO:tasks.workunit.client.0.smithi066.stdout:1/377: fsync d0/d36/f62 0 2024-09-12T22:49:56.256 INFO:tasks.workunit.client.0.smithi066.stdout:7/420: creat d0/d19/d60/d53/f8c x:0 0 0 2024-09-12T22:49:56.256 INFO:tasks.workunit.client.0.smithi066.stdout:5/537: link d5/d11/f54 d5/d11/d21/d78/f99 0 2024-09-12T22:49:56.257 INFO:tasks.workunit.client.0.smithi066.stdout:9/457: write d9/d31/f6f [450855,35713] 0 2024-09-12T22:49:56.257 INFO:tasks.workunit.client.0.smithi066.stdout:4/509: rename d5/d8/d16/d93/da5 to d5/d8/d16/d93/d9c/d98/dab/db3 0 2024-09-12T22:49:56.257 INFO:tasks.workunit.client.0.smithi066.stdout:9/458: fsync d9/dc/f6a 0 2024-09-12T22:49:56.257 INFO:tasks.workunit.client.0.smithi066.stdout:1/378: link d0/dc/fe d0/dc/f69 0 2024-09-12T22:49:56.257 INFO:tasks.workunit.client.0.smithi066.stdout:3/444: dwrite d0/d2/f24 [0,4194304] 0 2024-09-12T22:49:56.257 INFO:tasks.workunit.client.0.smithi066.stdout:8/489: dwrite d17/d49/d4b/d57/d5e/d62/f83 [0,4194304] 0 2024-09-12T22:49:56.257 INFO:tasks.workunit.client.0.smithi066.stdout:8/490: chown d17/d1b/c8b 3131044 1 2024-09-12T22:49:56.257 INFO:tasks.workunit.client.0.smithi066.stdout:7/421: dwrite d0/d19/d26/d48/d59/f68 [0,4194304] 0 2024-09-12T22:49:56.257 INFO:tasks.workunit.client.0.smithi066.stdout:3/445: dread d0/d2/f24 [0,4194304] 0 2024-09-12T22:49:56.258 INFO:tasks.workunit.client.0.smithi066.stdout:3/446: link d0/d2/d7/d13/f19 d0/d2/d1d/fa8 0 2024-09-12T22:49:56.258 INFO:tasks.workunit.client.0.smithi066.stdout:1/379: dwrite d0/d36/d57/f3e [0,4194304] 0 2024-09-12T22:49:56.258 INFO:tasks.workunit.client.0.smithi066.stdout:3/447: fsync d0/d2/d6/f18 0 2024-09-12T22:49:56.258 INFO:tasks.workunit.client.0.smithi066.stdout:2/458: dread d1/dd/d12/f21 [0,4194304] 0 2024-09-12T22:49:56.258 INFO:tasks.workunit.client.0.smithi066.stdout:3/448: chown d0/d2/d1d/d87/d40/d44/l9f 111 1 2024-09-12T22:49:56.258 INFO:tasks.workunit.client.0.smithi066.stdout:2/459: mkdir d1/dd/d12/d18/d90 0 2024-09-12T22:49:56.258 INFO:tasks.workunit.client.0.smithi066.stdout:2/460: write d1/dd/d12/d18/f75 [642503,84589] 0 2024-09-12T22:49:56.258 INFO:tasks.workunit.client.0.smithi066.stdout:2/461: unlink d1/d11/l54 0 2024-09-12T22:49:56.258 INFO:tasks.workunit.client.0.smithi066.stdout:4/510: truncate d5/d8/d16/d1b/d1e/d1f/f7a 987544 0 2024-09-12T22:49:56.258 INFO:tasks.workunit.client.0.smithi066.stdout:2/462: truncate d1/dd/f2c 2270642 0 2024-09-12T22:49:56.258 INFO:tasks.workunit.client.0.smithi066.stdout:2/463: chown d1/dd/d12/f24 0 1 2024-09-12T22:49:56.258 INFO:tasks.workunit.client.0.smithi066.stdout:2/464: mkdir d1/d11/d26/d4f/d5f/d61/d7e/d91 0 2024-09-12T22:49:56.258 INFO:tasks.workunit.client.0.smithi066.stdout:0/484: dread d1/d8/d1f/d30/f5c [0,4194304] 0 2024-09-12T22:49:56.258 INFO:tasks.workunit.client.0.smithi066.stdout:0/485: write d1/d8/d1f/d30/f5c [997968,26630] 0 2024-09-12T22:49:56.259 INFO:tasks.workunit.client.0.smithi066.stdout:6/540: dread d6/d20/f12 [0,4194304] 0 2024-09-12T22:49:56.259 INFO:tasks.workunit.client.0.smithi066.stdout:0/486: symlink d1/d8/d1b/d59/lae 0 2024-09-12T22:49:56.259 INFO:tasks.workunit.client.0.smithi066.stdout:0/487: fdatasync d1/f67 0 2024-09-12T22:49:56.259 INFO:tasks.workunit.client.0.smithi066.stdout:6/541: truncate d6/d59/f77 1612008 0 2024-09-12T22:49:56.259 INFO:tasks.workunit.client.0.smithi066.stdout:0/488: write d1/d8/d1c/dd/f77 [4396799,49784] 0 2024-09-12T22:49:56.259 INFO:tasks.workunit.client.0.smithi066.stdout:7/422: dread d0/d19/d26/f47 [0,4194304] 0 2024-09-12T22:49:56.259 INFO:tasks.workunit.client.0.smithi066.stdout:6/542: creat d6/d7/dc/fbe x:0 0 0 2024-09-12T22:49:56.259 INFO:tasks.workunit.client.0.smithi066.stdout:0/489: getdents d1/d8/d1f/d47 0 2024-09-12T22:49:56.259 INFO:tasks.workunit.client.0.smithi066.stdout:6/543: symlink d6/d23/d25/lbf 0 2024-09-12T22:49:56.259 INFO:tasks.workunit.client.0.smithi066.stdout:1/380: dread d0/d9/f14 [0,4194304] 0 2024-09-12T22:49:56.259 INFO:tasks.workunit.client.0.smithi066.stdout:5/538: dread d5/d14/f88 [0,4194304] 0 2024-09-12T22:49:56.259 INFO:tasks.workunit.client.0.smithi066.stdout:9/459: sync 2024-09-12T22:49:56.259 INFO:tasks.workunit.client.0.smithi066.stdout:4/511: dread d5/d8/d16/fa4 [0,4194304] 0 2024-09-12T22:49:56.260 INFO:tasks.workunit.client.0.smithi066.stdout:0/490: chown d1/d8/d1f/l3c 459 1 2024-09-12T22:49:56.260 INFO:tasks.workunit.client.0.smithi066.stdout:7/423: rename d0/d19/d60/f79 to d0/d19/d60/f8d 0 2024-09-12T22:49:56.260 INFO:tasks.workunit.client.0.smithi066.stdout:9/460: chown d9/d31/d77 74 1 2024-09-12T22:49:56.260 INFO:tasks.workunit.client.0.smithi066.stdout:5/539: write d5/d11/f1b [4295655,23357] 0 2024-09-12T22:49:56.260 INFO:tasks.workunit.client.0.smithi066.stdout:9/461: mknod d9/d31/d77/c94 0 2024-09-12T22:49:56.260 INFO:tasks.workunit.client.0.smithi066.stdout:4/512: symlink d5/d8/d16/lb4 0 2024-09-12T22:49:56.260 INFO:tasks.workunit.client.0.smithi066.stdout:7/424: fdatasync d0/d19/d24/d33/d27/f35 0 2024-09-12T22:49:56.260 INFO:tasks.workunit.client.0.smithi066.stdout:0/491: creat d1/d8/d1b/d59/faf x:0 0 0 2024-09-12T22:49:56.260 INFO:tasks.workunit.client.0.smithi066.stdout:1/381: dread d0/dc/f17 [0,4194304] 0 2024-09-12T22:49:56.260 INFO:tasks.workunit.client.0.smithi066.stdout:6/544: rename d6/d20/d32/d3c/cb1 to d6/d23/d41/db6/cc0 0 2024-09-12T22:49:56.260 INFO:tasks.workunit.client.0.smithi066.stdout:2/465: dread d1/d11/d26/f30 [0,4194304] 0 2024-09-12T22:49:56.260 INFO:tasks.workunit.client.0.smithi066.stdout:5/540: dread d5/f3f [0,4194304] 0 2024-09-12T22:49:56.260 INFO:tasks.workunit.client.0.smithi066.stdout:0/492: creat d1/d36/fb0 x:0 0 0 2024-09-12T22:49:56.260 INFO:tasks.workunit.client.0.smithi066.stdout:1/382: unlink d0/l5 0 2024-09-12T22:49:56.261 INFO:tasks.workunit.client.0.smithi066.stdout:9/462: unlink d9/dc/dd/l3f 0 2024-09-12T22:49:56.261 INFO:tasks.workunit.client.0.smithi066.stdout:7/425: symlink d0/d19/d24/d33/d27/l8e 0 2024-09-12T22:49:56.261 INFO:tasks.workunit.client.0.smithi066.stdout:6/545: rmdir d6/d23/d62/d79 39 2024-09-12T22:49:56.261 INFO:tasks.workunit.client.0.smithi066.stdout:7/426: unlink d0/d19/f45 0 2024-09-12T22:49:56.261 INFO:tasks.workunit.client.0.smithi066.stdout:1/383: creat d0/d9/f6a x:0 0 0 2024-09-12T22:49:56.261 INFO:tasks.workunit.client.0.smithi066.stdout:6/546: mkdir d6/d7/dc1 0 2024-09-12T22:49:56.261 INFO:tasks.workunit.client.0.smithi066.stdout:7/427: truncate d0/d19/d26/d5a/f61 608305 0 2024-09-12T22:49:56.261 INFO:tasks.workunit.client.0.smithi066.stdout:1/384: dread d0/d4e/f58 [0,4194304] 0 2024-09-12T22:49:56.261 INFO:tasks.workunit.client.0.smithi066.stdout:1/385: mkdir d0/d36/d6b 0 2024-09-12T22:49:56.261 INFO:tasks.workunit.client.0.smithi066.stdout:2/466: truncate d1/dd/d12/f21 3094503 0 2024-09-12T22:49:56.261 INFO:tasks.workunit.client.0.smithi066.stdout:1/386: link d0/d9/f4d d0/dc/d33/f6c 0 2024-09-12T22:49:56.261 INFO:tasks.workunit.client.0.smithi066.stdout:9/463: dwrite d9/dc/dd/f5f [0,4194304] 0 2024-09-12T22:49:56.261 INFO:tasks.workunit.client.0.smithi066.stdout:7/428: dwrite d0/d19/d60/d53/f7c [0,4194304] 0 2024-09-12T22:49:56.262 INFO:tasks.workunit.client.0.smithi066.stdout:2/467: dread d1/d11/f66 [0,4194304] 0 2024-09-12T22:49:56.262 INFO:tasks.workunit.client.0.smithi066.stdout:9/464: creat d9/dc/d46/d8a/f95 x:0 0 0 2024-09-12T22:49:56.262 INFO:tasks.workunit.client.0.smithi066.stdout:7/429: getdents d0/d19/d26/d5a 0 2024-09-12T22:49:56.262 INFO:tasks.workunit.client.0.smithi066.stdout:2/468: truncate d1/dd/d12/d18/f80 1044183 0 2024-09-12T22:49:56.262 INFO:tasks.workunit.client.0.smithi066.stdout:9/465: rmdir d9/d31/d58/d7b 0 2024-09-12T22:49:56.262 INFO:tasks.workunit.client.0.smithi066.stdout:1/387: creat d0/dc/d33/f6d x:0 0 0 2024-09-12T22:49:56.262 INFO:tasks.workunit.client.0.smithi066.stdout:2/469: stat d1/d11/l1c 0 2024-09-12T22:49:56.262 INFO:tasks.workunit.client.0.smithi066.stdout:9/466: creat d9/dc/d4e/f96 x:0 0 0 2024-09-12T22:49:56.262 INFO:tasks.workunit.client.0.smithi066.stdout:9/467: rename d9/dc/f86 to d9/dc/d46/d8a/f97 0 2024-09-12T22:49:56.262 INFO:tasks.workunit.client.0.smithi066.stdout:9/468: mknod d9/d31/d77/d8f/c98 0 2024-09-12T22:49:56.262 INFO:tasks.workunit.client.0.smithi066.stdout:9/469: fdatasync d9/dc/d4e/f74 0 2024-09-12T22:49:56.262 INFO:tasks.workunit.client.0.smithi066.stdout:9/470: truncate d9/dc/fe 6068317 0 2024-09-12T22:49:56.262 INFO:tasks.workunit.client.0.smithi066.stdout:9/471: dread d9/dc/f60 [0,4194304] 0 2024-09-12T22:49:56.262 INFO:tasks.workunit.client.0.smithi066.stdout:5/541: dread d5/f3e [0,4194304] 0 2024-09-12T22:49:56.263 INFO:tasks.workunit.client.0.smithi066.stdout:7/430: truncate d0/d19/d24/f1f 3823518 0 2024-09-12T22:49:56.263 INFO:tasks.workunit.client.0.smithi066.stdout:5/542: mknod d5/d11/d7c/d98/c9a 0 2024-09-12T22:49:56.263 INFO:tasks.workunit.client.0.smithi066.stdout:9/472: read d9/dc/dd/f50 [2990262,57267] 0 2024-09-12T22:49:56.263 INFO:tasks.workunit.client.0.smithi066.stdout:4/513: dread d5/d8/d16/d1b/d1e/d38/f3f [0,4194304] 0 2024-09-12T22:49:56.263 INFO:tasks.workunit.client.0.smithi066.stdout:3/449: sync 2024-09-12T22:49:56.263 INFO:tasks.workunit.client.0.smithi066.stdout:8/491: sync 2024-09-12T22:49:56.263 INFO:tasks.workunit.client.0.smithi066.stdout:1/388: truncate d0/d36/d57/f3d 1580164 0 2024-09-12T22:49:56.263 INFO:tasks.workunit.client.0.smithi066.stdout:9/473: symlink d9/dc/l99 0 2024-09-12T22:49:56.263 INFO:tasks.workunit.client.0.smithi066.stdout:4/514: write d5/d8/d10/f6a [4370187,49470] 0 2024-09-12T22:49:56.263 INFO:tasks.workunit.client.0.smithi066.stdout:3/450: stat d0/d2/d1d/l32 0 2024-09-12T22:49:56.263 INFO:tasks.workunit.client.0.smithi066.stdout:8/492: mknod d17/d49/d4b/d57/d5e/c9c 0 2024-09-12T22:49:56.263 INFO:tasks.workunit.client.0.smithi066.stdout:3/451: rmdir d0/d2/d7/d13 39 2024-09-12T22:49:56.263 INFO:tasks.workunit.client.0.smithi066.stdout:9/474: creat d9/d31/d77/f9a x:0 0 0 2024-09-12T22:49:56.264 INFO:tasks.workunit.client.0.smithi066.stdout:9/475: fdatasync d9/dc/f2d 0 2024-09-12T22:49:56.264 INFO:tasks.workunit.client.0.smithi066.stdout:1/389: dread d0/d28/f4f [0,4194304] 0 2024-09-12T22:49:56.264 INFO:tasks.workunit.client.0.smithi066.stdout:8/493: creat d17/d40/d74/d99/f9d x:0 0 0 2024-09-12T22:49:56.264 INFO:tasks.workunit.client.0.smithi066.stdout:8/494: chown d17/d40/d47/l54 243 1 2024-09-12T22:49:56.264 INFO:tasks.workunit.client.0.smithi066.stdout:5/543: dwrite d5/de/d50/f92 [0,4194304] 0 2024-09-12T22:49:56.264 INFO:tasks.workunit.client.0.smithi066.stdout:7/431: truncate d0/d19/d60/f51 1126134 0 2024-09-12T22:49:56.264 INFO:tasks.workunit.client.0.smithi066.stdout:9/476: read d9/dc/f38 [4168990,50781] 0 2024-09-12T22:49:56.264 INFO:tasks.workunit.client.0.smithi066.stdout:5/544: truncate d5/f3b 755178 0 2024-09-12T22:49:56.264 INFO:tasks.workunit.client.0.smithi066.stdout:4/515: dwrite d5/d8/d16/d1b/f88 [0,4194304] 0 2024-09-12T22:49:56.264 INFO:tasks.workunit.client.0.smithi066.stdout:8/495: write d17/d49/d4b/d57/f69 [1015198,56944] 0 2024-09-12T22:49:56.264 INFO:tasks.workunit.client.0.smithi066.stdout:3/452: dwrite d0/d2/d7/d13/d31/f7f [0,4194304] 0 2024-09-12T22:49:56.264 INFO:tasks.workunit.client.0.smithi066.stdout:7/432: mknod d0/d19/d26/d5a/c8f 0 2024-09-12T22:49:56.264 INFO:tasks.workunit.client.0.smithi066.stdout:5/545: mknod d5/de/c9b 0 2024-09-12T22:49:56.265 INFO:tasks.workunit.client.0.smithi066.stdout:8/496: mknod d17/d1b/c9e 0 2024-09-12T22:49:56.265 INFO:tasks.workunit.client.0.smithi066.stdout:1/390: dwrite d0/f13 [0,4194304] 0 2024-09-12T22:49:56.265 INFO:tasks.workunit.client.0.smithi066.stdout:7/433: rename d0/d19/d60/d64 to d0/d19/d24/d33/d27/d70/d90 0 2024-09-12T22:49:56.265 INFO:tasks.workunit.client.0.smithi066.stdout:7/434: chown d0/f54 2005659654 1 2024-09-12T22:49:56.265 INFO:tasks.workunit.client.0.smithi066.stdout:3/453: rename d0/d2/d7/l63 to d0/d2/d1d/d87/d40/da2/la9 0 2024-09-12T22:49:56.265 INFO:tasks.workunit.client.0.smithi066.stdout:1/391: fdatasync d0/d36/d57/f27 0 2024-09-12T22:49:56.265 INFO:tasks.workunit.client.0.smithi066.stdout:7/435: stat d0/l13 0 2024-09-12T22:49:56.265 INFO:tasks.workunit.client.0.smithi066.stdout:9/477: dwrite d9/d31/f73 [0,4194304] 0 2024-09-12T22:49:56.265 INFO:tasks.workunit.client.0.smithi066.stdout:3/454: creat d0/d2/d7/d92/faa x:0 0 0 2024-09-12T22:49:56.265 INFO:tasks.workunit.client.0.smithi066.stdout:5/546: dwrite d5/de/d50/f90 [0,4194304] 0 2024-09-12T22:49:56.265 INFO:tasks.workunit.client.0.smithi066.stdout:5/547: fsync d5/f12 0 2024-09-12T22:49:56.265 INFO:tasks.workunit.client.0.smithi066.stdout:7/436: rmdir d0/d19/d24/d33/d27 39 2024-09-12T22:49:56.265 INFO:tasks.workunit.client.0.smithi066.stdout:9/478: creat d9/d31/d58/f9b x:0 0 0 2024-09-12T22:49:56.265 INFO:tasks.workunit.client.0.smithi066.stdout:3/455: creat d0/d2/d7/d13/d43/fab x:0 0 0 2024-09-12T22:49:56.266 INFO:tasks.workunit.client.0.smithi066.stdout:3/456: fdatasync d0/d2/d1d/d87/d40/f48 0 2024-09-12T22:49:56.266 INFO:tasks.workunit.client.0.smithi066.stdout:3/457: rmdir d0/d2 39 2024-09-12T22:49:56.266 INFO:tasks.workunit.client.0.smithi066.stdout:5/548: rename d5/d11/f40 to d5/d11/f9c 0 2024-09-12T22:49:56.266 INFO:tasks.workunit.client.0.smithi066.stdout:9/479: link d9/d31/d34/d4d/c69 d9/d31/c9c 0 2024-09-12T22:49:56.266 INFO:tasks.workunit.client.0.smithi066.stdout:7/437: read d0/d19/d24/f3b [3229734,80267] 0 2024-09-12T22:49:56.266 INFO:tasks.workunit.client.0.smithi066.stdout:5/549: write d5/d11/d21/d78/f7b [358839,34080] 0 2024-09-12T22:49:56.266 INFO:tasks.workunit.client.0.smithi066.stdout:3/458: chown d0/d2/d1d/d87/d40/d44/c8b 1780312661 1 2024-09-12T22:49:56.266 INFO:tasks.workunit.client.0.smithi066.stdout:5/550: chown d5/de 29 1 2024-09-12T22:49:56.266 INFO:tasks.workunit.client.0.smithi066.stdout:3/459: mknod d0/d2/d1d/cac 0 2024-09-12T22:49:56.266 INFO:tasks.workunit.client.0.smithi066.stdout:7/438: creat d0/d19/d26/d48/d84/f91 x:0 0 0 2024-09-12T22:49:56.266 INFO:tasks.workunit.client.0.smithi066.stdout:3/460: chown d0/d2/d68/fa3 5543 1 2024-09-12T22:49:56.266 INFO:tasks.workunit.client.0.smithi066.stdout:7/439: rename d0/d19/d24/l2c to d0/d19/d60/d85/l92 0 2024-09-12T22:49:56.266 INFO:tasks.workunit.client.0.smithi066.stdout:3/461: stat d0/d2/d6/d7a/c9d 0 2024-09-12T22:49:56.266 INFO:tasks.workunit.client.0.smithi066.stdout:9/480: dwrite d9/d31/d58/f82 [0,4194304] 0 2024-09-12T22:49:56.267 INFO:tasks.workunit.client.0.smithi066.stdout:3/462: dread - d0/d2/d1d/d87/f70 zero size 2024-09-12T22:49:56.267 INFO:tasks.workunit.client.0.smithi066.stdout:8/497: truncate d17/d1b/f2e 458103 0 2024-09-12T22:49:56.267 INFO:tasks.workunit.client.0.smithi066.stdout:1/392: write d0/d4e/f58 [1538425,59684] 0 2024-09-12T22:49:56.267 INFO:tasks.workunit.client.0.smithi066.stdout:3/463: mknod d0/d2/d1d/cad 0 2024-09-12T22:49:56.267 INFO:tasks.workunit.client.0.smithi066.stdout:1/393: getdents d0/d28 0 2024-09-12T22:49:56.267 INFO:tasks.workunit.client.0.smithi066.stdout:2/470: dread d1/d11/f25 [0,4194304] 0 2024-09-12T22:49:56.267 INFO:tasks.workunit.client.0.smithi066.stdout:2/471: fsync d1/dd/d12/d1e/f35 0 2024-09-12T22:49:56.267 INFO:tasks.workunit.client.0.smithi066.stdout:1/394: dread d0/f13 [0,4194304] 0 2024-09-12T22:49:56.267 INFO:tasks.workunit.client.0.smithi066.stdout:2/472: creat d1/d44/d51/d70/f92 x:0 0 0 2024-09-12T22:49:56.267 INFO:tasks.workunit.client.0.smithi066.stdout:1/395: fsync d0/d36/d57/f27 0 2024-09-12T22:49:56.270 INFO:tasks.workunit.client.0.smithi066.stdout:0/493: sync 2024-09-12T22:49:56.270 INFO:tasks.workunit.client.0.smithi066.stdout:1/396: symlink d0/d36/d6b/l6e 0 2024-09-12T22:49:56.270 INFO:tasks.workunit.client.0.smithi066.stdout:6/547: sync 2024-09-12T22:49:56.270 INFO:tasks.workunit.client.0.smithi066.stdout:4/516: sync 2024-09-12T22:49:56.270 INFO:tasks.workunit.client.0.smithi066.stdout:0/494: rmdir d1 39 2024-09-12T22:49:56.271 INFO:tasks.workunit.client.0.smithi066.stdout:4/517: truncate d5/d8/f78 574245 0 2024-09-12T22:49:56.271 INFO:tasks.workunit.client.0.smithi066.stdout:0/495: mkdir d1/d36/d65/db1 0 2024-09-12T22:49:56.271 INFO:tasks.workunit.client.0.smithi066.stdout:6/548: truncate d6/d20/d99/f90 158021 0 2024-09-12T22:49:56.271 INFO:tasks.workunit.client.0.smithi066.stdout:6/549: stat d6/d23/d25/d2c/l53 0 2024-09-12T22:49:56.271 INFO:tasks.workunit.client.0.smithi066.stdout:4/518: fsync d5/d8/d10/de/f18 0 2024-09-12T22:49:56.271 INFO:tasks.workunit.client.0.smithi066.stdout:3/464: getdents d0/d2/d7/d92 0 2024-09-12T22:49:56.271 INFO:tasks.workunit.client.0.smithi066.stdout:0/496: creat d1/d8/d1f/d25/d9c/fb2 x:0 0 0 2024-09-12T22:49:56.271 INFO:tasks.workunit.client.0.smithi066.stdout:6/550: mknod d6/d51/cc2 0 2024-09-12T22:49:56.271 INFO:tasks.workunit.client.0.smithi066.stdout:8/498: truncate d17/d2c/f38 7905264 0 2024-09-12T22:49:56.271 INFO:tasks.workunit.client.0.smithi066.stdout:6/551: stat d6/d59/f77 0 2024-09-12T22:49:56.271 INFO:tasks.workunit.client.0.smithi066.stdout:4/519: symlink d5/d8/d10/de/lb5 0 2024-09-12T22:49:56.271 INFO:tasks.workunit.client.0.smithi066.stdout:8/499: chown d17/d1b/l20 226812255 1 2024-09-12T22:49:56.271 INFO:tasks.workunit.client.0.smithi066.stdout:1/397: dwrite d0/f13 [0,4194304] 0 2024-09-12T22:49:56.272 INFO:tasks.workunit.client.0.smithi066.stdout:1/398: rmdir d0/dc/d33 39 2024-09-12T22:49:56.272 INFO:tasks.workunit.client.0.smithi066.stdout:8/500: creat d17/d1b/f9f x:0 0 0 2024-09-12T22:49:56.272 INFO:tasks.workunit.client.0.smithi066.stdout:4/520: getdents d5/d8/d16/d93/d9c/d98/dab/db3 0 2024-09-12T22:49:56.272 INFO:tasks.workunit.client.0.smithi066.stdout:6/552: dread d6/d20/f12 [0,4194304] 0 2024-09-12T22:49:56.272 INFO:tasks.workunit.client.0.smithi066.stdout:4/521: chown d5/d87/ca8 4 1 2024-09-12T22:49:56.272 INFO:tasks.workunit.client.0.smithi066.stdout:1/399: write d0/dc/d33/f6d [714818,87461] 0 2024-09-12T22:49:56.272 INFO:tasks.workunit.client.0.smithi066.stdout:4/522: sync 2024-09-12T22:49:56.272 INFO:tasks.workunit.client.0.smithi066.stdout:3/465: dwrite d0/d2/d1d/f21 [0,4194304] 0 2024-09-12T22:49:56.272 INFO:tasks.workunit.client.0.smithi066.stdout:0/497: dwrite d1/d8/d1c/d56/f96 [0,4194304] 0 2024-09-12T22:49:56.272 INFO:tasks.workunit.client.0.smithi066.stdout:1/400: truncate d0/dc/f69 4393795 0 2024-09-12T22:49:56.272 INFO:tasks.workunit.client.0.smithi066.stdout:4/523: write d5/d8/d10/de/f14 [353628,37155] 0 2024-09-12T22:49:56.272 INFO:tasks.workunit.client.0.smithi066.stdout:1/401: write d0/d4e/f63 [411395,120864] 0 2024-09-12T22:49:56.272 INFO:tasks.workunit.client.0.smithi066.stdout:6/553: creat d6/d51/fc3 x:0 0 0 2024-09-12T22:49:56.273 INFO:tasks.workunit.client.0.smithi066.stdout:2/473: dwrite d1/d11/d26/d4f/d5f/d61/d7e/f34 [0,4194304] 0 2024-09-12T22:49:56.273 INFO:tasks.workunit.client.0.smithi066.stdout:4/524: mkdir d5/d8/d16/d93/d9c/d98/d8b/db6 0 2024-09-12T22:49:56.273 INFO:tasks.workunit.client.0.smithi066.stdout:2/474: fdatasync d1/d11/d53/f7f 0 2024-09-12T22:49:56.273 INFO:tasks.workunit.client.0.smithi066.stdout:6/554: rename d6/d20 to d6/d23/d25/d4e/dc4 0 2024-09-12T22:49:56.273 INFO:tasks.workunit.client.0.smithi066.stdout:2/475: rename d1/dd/d12/d18/f75 to d1/d11/d26/d4f/d52/f93 0 2024-09-12T22:49:56.274 INFO:tasks.workunit.client.0.smithi066.stdout:1/402: dread d0/dc/f69 [0,4194304] 0 2024-09-12T22:49:56.274 INFO:tasks.workunit.client.0.smithi066.stdout:2/476: dread - d1/d11/f50 zero size 2024-09-12T22:49:56.275 INFO:tasks.workunit.client.0.smithi066.stdout:1/403: dread d0/d28/f4f [0,4194304] 0 2024-09-12T22:49:56.276 INFO:tasks.workunit.client.0.smithi066.stdout:1/404: mkdir d0/dc/d1e/d47/d6f 0 2024-09-12T22:49:56.276 INFO:tasks.workunit.client.0.smithi066.stdout:1/405: chown d0/d9 15279 1 2024-09-12T22:49:56.276 INFO:tasks.workunit.client.0.smithi066.stdout:1/406: creat d0/d36/d57/f70 x:0 0 0 2024-09-12T22:49:56.277 INFO:tasks.workunit.client.0.smithi066.stdout:1/407: fsync d0/dc/d1d/f67 0 2024-09-12T22:49:56.277 INFO:tasks.workunit.client.0.smithi066.stdout:8/501: write d17/d1b/f1e [2533940,68811] 0 2024-09-12T22:49:56.278 INFO:tasks.workunit.client.0.smithi066.stdout:1/408: stat d0/dc/d1d/c1f 0 2024-09-12T22:49:56.278 INFO:tasks.workunit.client.0.smithi066.stdout:8/502: chown d17/d49/d4b/d4e/l84 18294 1 2024-09-12T22:49:56.279 INFO:tasks.workunit.client.0.smithi066.stdout:1/409: link d0/d36/d57/l49 d0/dc/d44/l71 0 2024-09-12T22:49:56.284 INFO:tasks.workunit.client.0.smithi066.stdout:8/503: dwrite d17/d49/f8d [8388608,4194304] 0 2024-09-12T22:49:56.284 INFO:tasks.workunit.client.0.smithi066.stdout:6/555: dwrite d6/d23/d25/d4e/dc4/d99/fa3 [0,4194304] 0 2024-09-12T22:49:56.284 INFO:tasks.workunit.client.0.smithi066.stdout:2/477: dwrite d1/dd/f2c [0,4194304] 0 2024-09-12T22:49:56.285 INFO:tasks.workunit.client.0.smithi066.stdout:6/556: chown d6 2046858 1 2024-09-12T22:49:56.288 INFO:tasks.workunit.client.0.smithi066.stdout:8/504: truncate d17/d1b/f3b 892068 0 2024-09-12T22:49:56.288 INFO:tasks.workunit.client.0.smithi066.stdout:6/557: rename d6/d23/d25/d4e/dc4/d32/f7c to d6/d23/d25/d4e/dc4/fc5 0 2024-09-12T22:49:56.290 INFO:tasks.workunit.client.0.smithi066.stdout:8/505: write d17/d40/d74/f94 [1025699,114042] 0 2024-09-12T22:49:56.292 INFO:tasks.workunit.client.0.smithi066.stdout:2/478: dwrite d1/d11/d26/d4f/d52/f69 [0,4194304] 0 2024-09-12T22:49:56.292 INFO:tasks.workunit.client.0.smithi066.stdout:5/551: dread d5/de/d50/d42/d49/f6b [0,4194304] 0 2024-09-12T22:49:56.292 INFO:tasks.workunit.client.0.smithi066.stdout:6/558: mkdir d6/d7/dc6 0 2024-09-12T22:49:56.293 INFO:tasks.workunit.client.0.smithi066.stdout:9/481: dread d9/dc/dd/f13 [0,4194304] 0 2024-09-12T22:49:56.293 INFO:tasks.workunit.client.0.smithi066.stdout:5/552: write d5/d11/f58 [3176662,14224] 0 2024-09-12T22:49:56.293 INFO:tasks.workunit.client.0.smithi066.stdout:8/506: creat d17/d40/d47/d4d/fa0 x:0 0 0 2024-09-12T22:49:56.294 INFO:tasks.workunit.client.0.smithi066.stdout:9/482: chown d9/dc/dd/f54 12530607 1 2024-09-12T22:49:56.294 INFO:tasks.workunit.client.0.smithi066.stdout:6/559: dread - d6/d7/faa zero size 2024-09-12T22:49:56.294 INFO:tasks.workunit.client.0.smithi066.stdout:8/507: rmdir d17/d1b 39 2024-09-12T22:49:56.297 INFO:tasks.workunit.client.0.smithi066.stdout:6/560: readlink d6/d7/la2 0 2024-09-12T22:49:56.300 INFO:tasks.workunit.client.0.smithi066.stdout:2/479: getdents d1/d11/d26/d4f/d52 0 2024-09-12T22:49:56.300 INFO:tasks.workunit.client.0.smithi066.stdout:9/483: mkdir d9/dc/d4e/d9d 0 2024-09-12T22:49:56.300 INFO:tasks.workunit.client.0.smithi066.stdout:5/553: mkdir d5/de/d50/d42/d9d 0 2024-09-12T22:49:56.300 INFO:tasks.workunit.client.0.smithi066.stdout:2/480: write d1/dd/f63 [151909,2326] 0 2024-09-12T22:49:56.300 INFO:tasks.workunit.client.0.smithi066.stdout:8/508: link d17/d49/l75 d17/d40/la1 0 2024-09-12T22:49:56.301 INFO:tasks.workunit.client.0.smithi066.stdout:6/561: chown d6/d23/d25/d4e/dc4/d32/c9a 7666949 1 2024-09-12T22:49:56.301 INFO:tasks.workunit.client.0.smithi066.stdout:9/484: symlink d9/d31/d58/d7f/l9e 0 2024-09-12T22:49:56.302 INFO:tasks.workunit.client.0.smithi066.stdout:8/509: write d17/f27 [888702,79499] 0 2024-09-12T22:49:56.302 INFO:tasks.workunit.client.0.smithi066.stdout:9/485: stat d9/dc/d46/l5a 0 2024-09-12T22:49:56.302 INFO:tasks.workunit.client.0.smithi066.stdout:7/440: dread d0/d19/d24/f16 [0,4194304] 0 2024-09-12T22:49:56.302 INFO:tasks.workunit.client.0.smithi066.stdout:5/554: dread d5/d14/f88 [0,4194304] 0 2024-09-12T22:49:56.302 INFO:tasks.workunit.client.0.smithi066.stdout:2/481: getdents d1 0 2024-09-12T22:49:56.302 INFO:tasks.workunit.client.0.smithi066.stdout:6/562: chown d6/d23/d25/d4e/dc4/ca4 0 1 2024-09-12T22:49:56.302 INFO:tasks.workunit.client.0.smithi066.stdout:8/510: write d17/d40/d47/d4d/f7a [809965,72940] 0 2024-09-12T22:49:56.302 INFO:tasks.workunit.client.0.smithi066.stdout:5/555: mknod d5/de/c9e 0 2024-09-12T22:49:56.302 INFO:tasks.workunit.client.0.smithi066.stdout:2/482: rmdir d1/d11/d26 39 2024-09-12T22:49:56.303 INFO:tasks.workunit.client.0.smithi066.stdout:5/556: creat d5/d11/d5d/d8a/f9f x:0 0 0 2024-09-12T22:49:56.303 INFO:tasks.workunit.client.0.smithi066.stdout:2/483: mknod d1/dd/d12/d67/c94 0 2024-09-12T22:49:56.303 INFO:tasks.workunit.client.0.smithi066.stdout:8/511: symlink d17/d1b/la2 0 2024-09-12T22:49:56.303 INFO:tasks.workunit.client.0.smithi066.stdout:9/486: dwrite d9/dc/d4e/f96 [0,4194304] 0 2024-09-12T22:49:56.305 INFO:tasks.workunit.client.0.smithi066.stdout:8/512: truncate d17/d40/d47/d4d/f93 737729 0 2024-09-12T22:49:56.306 INFO:tasks.workunit.client.0.smithi066.stdout:6/563: dread d6/d23/d25/d4e/dc4/d99/fa3 [0,4194304] 0 2024-09-12T22:49:56.307 INFO:tasks.workunit.client.0.smithi066.stdout:9/487: mkdir d9/dc/dd/d9f 0 2024-09-12T22:49:56.307 INFO:tasks.workunit.client.0.smithi066.stdout:2/484: creat d1/db/d42/d43/d47/d76/f95 x:0 0 0 2024-09-12T22:49:56.307 INFO:tasks.workunit.client.0.smithi066.stdout:8/513: truncate d17/d1b/f86 199913 0 2024-09-12T22:49:56.307 INFO:tasks.workunit.client.0.smithi066.stdout:1/410: sync 2024-09-12T22:49:56.308 INFO:tasks.workunit.client.0.smithi066.stdout:1/411: readlink d0/dc/d1d/l65 0 2024-09-12T22:49:56.308 INFO:tasks.workunit.client.0.smithi066.stdout:3/466: dread d0/d1b/f45 [0,4194304] 0 2024-09-12T22:49:56.308 INFO:tasks.workunit.client.0.smithi066.stdout:9/488: creat d9/dc/d8e/fa0 x:0 0 0 2024-09-12T22:49:56.309 INFO:tasks.workunit.client.0.smithi066.stdout:8/514: mkdir d17/d40/d74/da3 0 2024-09-12T22:49:56.310 INFO:tasks.workunit.client.0.smithi066.stdout:5/557: dwrite d5/f12 [0,4194304] 0 2024-09-12T22:49:56.310 INFO:tasks.workunit.client.0.smithi066.stdout:0/498: dread d1/d36/d65/f9d [0,4194304] 0 2024-09-12T22:49:56.310 INFO:tasks.workunit.client.0.smithi066.stdout:5/558: dread - d5/d11/d5d/f83 zero size 2024-09-12T22:49:56.311 INFO:tasks.workunit.client.0.smithi066.stdout:3/467: truncate d0/d2/d1d/d87/d40/f96 427611 0 2024-09-12T22:49:56.311 INFO:tasks.workunit.client.0.smithi066.stdout:3/468: stat d0/d2/d1d/d87 0 2024-09-12T22:49:56.312 INFO:tasks.workunit.client.0.smithi066.stdout:1/412: creat d0/dc/d1e/d47/d6f/f72 x:0 0 0 2024-09-12T22:49:56.312 INFO:tasks.workunit.client.0.smithi066.stdout:7/441: truncate d0/d19/d24/d33/f78 1704124 0 2024-09-12T22:49:56.312 INFO:tasks.workunit.client.0.smithi066.stdout:2/485: symlink d1/d11/d26/d4f/d5f/d61/d7e/l96 0 2024-09-12T22:49:56.313 INFO:tasks.workunit.client.0.smithi066.stdout:0/499: rmdir d1/d8/d1c/d13 39 2024-09-12T22:49:56.313 INFO:tasks.workunit.client.0.smithi066.stdout:9/489: fdatasync d9/dc/d46/f67 0 2024-09-12T22:49:56.313 INFO:tasks.workunit.client.0.smithi066.stdout:5/559: mkdir d5/de/d50/da0 0 2024-09-12T22:49:56.313 INFO:tasks.workunit.client.0.smithi066.stdout:8/515: symlink d17/d40/d74/da3/la4 0 2024-09-12T22:49:56.314 INFO:tasks.workunit.client.0.smithi066.stdout:2/486: readlink d1/d11/d26/d4f/l78 0 2024-09-12T22:49:56.314 INFO:tasks.workunit.client.0.smithi066.stdout:3/469: rename d0/d2/d68/c71 to d0/d2/d7/d13/cae 0 2024-09-12T22:49:56.314 INFO:tasks.workunit.client.0.smithi066.stdout:5/560: chown d5/c10 431620657 1 2024-09-12T22:49:56.314 INFO:tasks.workunit.client.0.smithi066.stdout:4/525: dread d5/f24 [0,4194304] 0 2024-09-12T22:49:56.315 INFO:tasks.workunit.client.0.smithi066.stdout:1/413: chown d0/dc/d44/l71 301750 1 2024-09-12T22:49:56.315 INFO:tasks.workunit.client.0.smithi066.stdout:9/490: dread - d9/d31/d34/f89 zero size 2024-09-12T22:49:56.316 INFO:tasks.workunit.client.0.smithi066.stdout:5/561: creat d5/de/d50/d8b/fa1 x:0 0 0 2024-09-12T22:49:56.316 INFO:tasks.workunit.client.0.smithi066.stdout:1/414: mknod d0/dc/d33/c73 0 2024-09-12T22:49:56.316 INFO:tasks.workunit.client.0.smithi066.stdout:9/491: fsync d9/dc/d23/f51 0 2024-09-12T22:49:56.316 INFO:tasks.workunit.client.0.smithi066.stdout:2/487: symlink d1/d11/d26/d4f/d5f/d61/d7e/l97 0 2024-09-12T22:49:56.317 INFO:tasks.workunit.client.0.smithi066.stdout:4/526: mknod d5/d8/d16/d93/d9c/d98/dab/cb7 0 2024-09-12T22:49:56.317 INFO:tasks.workunit.client.0.smithi066.stdout:9/492: stat d9/dc/d23/f41 0 2024-09-12T22:49:56.318 INFO:tasks.workunit.client.0.smithi066.stdout:8/516: link d17/d2c/c8c d17/d49/d4b/d57/d5e/d65/ca5 0 2024-09-12T22:49:56.318 INFO:tasks.workunit.client.0.smithi066.stdout:1/415: symlink d0/dc/d44/l74 0 2024-09-12T22:49:56.318 INFO:tasks.workunit.client.0.smithi066.stdout:2/488: write d1/f3 [2385070,10822] 0 2024-09-12T22:49:56.319 INFO:tasks.workunit.client.0.smithi066.stdout:9/493: chown d9/dc/d23/f51 1175 1 2024-09-12T22:49:56.320 INFO:tasks.workunit.client.0.smithi066.stdout:1/416: symlink d0/dc/d1e/d47/l75 0 2024-09-12T22:49:56.320 INFO:tasks.workunit.client.0.smithi066.stdout:0/500: dwrite d1/d8/d1b/f24 [4194304,4194304] 0 2024-09-12T22:49:56.322 INFO:tasks.workunit.client.0.smithi066.stdout:2/489: truncate d1/d11/d57/f82 960025 0 2024-09-12T22:49:56.322 INFO:tasks.workunit.client.0.smithi066.stdout:4/527: mknod d5/d8/d16/d93/d9c/d98/d8b/db6/cb8 0 2024-09-12T22:49:56.325 INFO:tasks.workunit.client.0.smithi066.stdout:1/417: symlink d0/dc/d1e/d47/l76 0 2024-09-12T22:49:56.326 INFO:tasks.workunit.client.0.smithi066.stdout:5/562: dwrite f3 [8388608,4194304] 0 2024-09-12T22:49:56.326 INFO:tasks.workunit.client.0.smithi066.stdout:4/528: creat d5/d8/d16/d1b/d73/fb9 x:0 0 0 2024-09-12T22:49:56.327 INFO:tasks.workunit.client.0.smithi066.stdout:4/529: sync 2024-09-12T22:49:56.327 INFO:tasks.workunit.client.0.smithi066.stdout:1/418: write d0/dc/f46 [561402,1132] 0 2024-09-12T22:49:56.328 INFO:tasks.workunit.client.0.smithi066.stdout:8/517: dwrite d17/d40/d47/f8e [0,4194304] 0 2024-09-12T22:49:56.328 INFO:tasks.workunit.client.0.smithi066.stdout:5/563: unlink d5/d11/d5f/f80 0 2024-09-12T22:49:56.329 INFO:tasks.workunit.client.0.smithi066.stdout:0/501: dread d1/f51 [0,4194304] 0 2024-09-12T22:49:56.329 INFO:tasks.workunit.client.0.smithi066.stdout:3/470: rename d0/d2/d68 to d0/d2/d7/d29/daf 0 2024-09-12T22:49:56.329 INFO:tasks.workunit.client.0.smithi066.stdout:5/564: readlink d5/d11/d5d/l76 0 2024-09-12T22:49:56.331 INFO:tasks.workunit.client.0.smithi066.stdout:5/565: chown d5/d11/d21/f4a 14602 1 2024-09-12T22:49:56.331 INFO:tasks.workunit.client.0.smithi066.stdout:4/530: truncate d5/d8/d16/d1b/d1e/d38/f3f 4729761 0 2024-09-12T22:49:56.332 INFO:tasks.workunit.client.0.smithi066.stdout:8/518: dread d17/d40/d47/d4d/f93 [0,4194304] 0 2024-09-12T22:49:56.332 INFO:tasks.workunit.client.0.smithi066.stdout:2/490: dwrite d1/d11/f25 [0,4194304] 0 2024-09-12T22:49:56.333 INFO:tasks.workunit.client.0.smithi066.stdout:7/442: truncate d0/d19/d26/d48/d59/f7b 3584344 0 2024-09-12T22:49:56.333 INFO:tasks.workunit.client.0.smithi066.stdout:0/502: unlink d1/d8/d1c/d56/f96 0 2024-09-12T22:49:56.333 INFO:tasks.workunit.client.0.smithi066.stdout:2/491: chown d1/dd 1 1 2024-09-12T22:49:56.333 INFO:tasks.workunit.client.0.smithi066.stdout:2/492: sync 2024-09-12T22:49:56.334 INFO:tasks.workunit.client.0.smithi066.stdout:4/531: write d5/f24 [3614033,41919] 0 2024-09-12T22:49:56.334 INFO:tasks.workunit.client.0.smithi066.stdout:8/519: creat d17/d49/d4b/d57/fa6 x:0 0 0 2024-09-12T22:49:56.334 INFO:tasks.workunit.client.0.smithi066.stdout:7/443: write d0/d19/d24/f6b [811061,48401] 0 2024-09-12T22:49:56.335 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:56.334+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:56.336 INFO:tasks.workunit.client.0.smithi066.stdout:3/471: dread d0/d1b/f45 [0,4194304] 0 2024-09-12T22:49:56.337 INFO:tasks.workunit.client.0.smithi066.stdout:2/493: write d1/d44/f4b [695833,1511] 0 2024-09-12T22:49:56.337 INFO:tasks.workunit.client.0.smithi066.stdout:8/520: write d17/d1b/f9f [424284,118476] 0 2024-09-12T22:49:56.337 INFO:tasks.workunit.client.0.smithi066.stdout:8/521: chown d17/d49/l7f 1972035 1 2024-09-12T22:49:56.338 INFO:tasks.workunit.client.0.smithi066.stdout:0/503: creat d1/d8/d1c/fb3 x:0 0 0 2024-09-12T22:49:56.338 INFO:tasks.workunit.client.0.smithi066.stdout:2/494: unlink d1/f2b 0 2024-09-12T22:49:56.338 INFO:tasks.workunit.client.0.smithi066.stdout:8/522: creat d17/d40/d74/d99/fa7 x:0 0 0 2024-09-12T22:49:56.339 INFO:tasks.workunit.client.0.smithi066.stdout:9/494: write d9/d31/d77/f91 [166147,110134] 0 2024-09-12T22:49:56.340 INFO:tasks.workunit.client.0.smithi066.stdout:3/472: creat d0/d2/d1d/d87/d40/d44/d55/d91/fb0 x:0 0 0 2024-09-12T22:49:56.340 INFO:tasks.workunit.client.0.smithi066.stdout:8/523: fdatasync d17/d40/f4c 0 2024-09-12T22:49:56.340 INFO:tasks.workunit.client.0.smithi066.stdout:0/504: link d1/d8/d1f/f45 d1/d8/d1f/fb4 0 2024-09-12T22:49:56.341 INFO:tasks.workunit.client.0.smithi066.stdout:7/444: dread d0/d6/f41 [0,4194304] 0 2024-09-12T22:49:56.341 INFO:tasks.workunit.client.0.smithi066.stdout:4/532: dwrite d5/d8/d10/de/d2d/fae [0,4194304] 0 2024-09-12T22:49:56.341 INFO:tasks.workunit.client.0.smithi066.stdout:9/495: write d9/dc/d36/f71 [314634,61476] 0 2024-09-12T22:49:56.341 INFO:tasks.workunit.client.0.smithi066.stdout:8/524: mkdir d17/d40/da8 0 2024-09-12T22:49:56.342 INFO:tasks.workunit.client.0.smithi066.stdout:3/473: mknod d0/d2/d7/d92/d9e/cb1 0 2024-09-12T22:49:56.343 INFO:tasks.workunit.client.0.smithi066.stdout:7/445: rmdir d0/d19/d26/d48 39 2024-09-12T22:49:56.344 INFO:tasks.workunit.client.0.smithi066.stdout:8/525: creat d17/d40/d47/d4d/d87/fa9 x:0 0 0 2024-09-12T22:49:56.344 INFO:tasks.workunit.client.0.smithi066.stdout:4/533: rename d5/d8/d16/fa4 to d5/fba 0 2024-09-12T22:49:56.345 INFO:tasks.workunit.client.0.smithi066.stdout:2/495: dwrite d1/d44/f45 [0,4194304] 0 2024-09-12T22:49:56.345 INFO:tasks.workunit.client.0.smithi066.stdout:3/474: rename d0/d1b to d0/d2/d1d/d87/d6b/db2 0 2024-09-12T22:49:56.346 INFO:tasks.workunit.client.0.smithi066.stdout:4/534: fsync d5/d8/d16/d1b/d72/f74 0 2024-09-12T22:49:56.347 INFO:tasks.workunit.client.0.smithi066.stdout:2/496: creat d1/d11/f98 x:0 0 0 2024-09-12T22:49:56.347 INFO:tasks.workunit.client.0.smithi066.stdout:3/475: write d0/d2/d7/d13/d43/fab [829271,110037] 0 2024-09-12T22:49:56.348 INFO:tasks.workunit.client.0.smithi066.stdout:3/476: chown d0/d2/d7/d13/d31 87 1 2024-09-12T22:49:56.348 INFO:tasks.workunit.client.0.smithi066.stdout:4/535: link d5/d8/d16/d1b/f88 d5/d8/d16/d93/fbb 0 2024-09-12T22:49:56.349 INFO:tasks.workunit.client.0.smithi066.stdout:7/446: rename d0/ff to d0/d19/d24/f93 0 2024-09-12T22:49:56.349 INFO:tasks.workunit.client.0.smithi066.stdout:7/447: chown d0 18 1 2024-09-12T22:49:56.350 INFO:tasks.workunit.client.0.smithi066.stdout:5/566: truncate d5/d11/f58 3928582 0 2024-09-12T22:49:56.350 INFO:tasks.workunit.client.0.smithi066.stdout:5/567: chown d5/d14 3 1 2024-09-12T22:49:56.350 INFO:tasks.workunit.client.0.smithi066.stdout:5/568: readlink d5/d11/d21/l7d 0 2024-09-12T22:49:56.351 INFO:tasks.workunit.client.0.smithi066.stdout:3/477: truncate d0/d2/d7/d13/d43/d74/f88 1427006 0 2024-09-12T22:49:56.351 INFO:tasks.workunit.client.0.smithi066.stdout:4/536: link d5/d8/d10/de/d2d/d64/caf d5/d87/cbc 0 2024-09-12T22:49:56.352 INFO:tasks.workunit.client.0.smithi066.stdout:8/526: read d17/d40/d47/d4d/f7a [530678,89038] 0 2024-09-12T22:49:56.352 INFO:tasks.workunit.client.0.smithi066.stdout:2/497: dread d1/d11/d26/d4f/d52/f69 [0,4194304] 0 2024-09-12T22:49:56.353 INFO:tasks.workunit.client.0.smithi066.stdout:4/537: chown d5/d8/d10/de/d2d/d64/l68 17977 1 2024-09-12T22:49:56.355 INFO:tasks.workunit.client.0.smithi066.stdout:8/527: link d17/d49/d4b/c88 d17/d40/d47/d81/caa 0 2024-09-12T22:49:56.355 INFO:tasks.workunit.client.0.smithi066.stdout:9/496: dread d9/dc/d36/f6b [0,4194304] 0 2024-09-12T22:49:56.355 INFO:tasks.workunit.client.0.smithi066.stdout:4/538: write d5/d8/d16/d1b/d1e/d5a/f85 [3129516,105433] 0 2024-09-12T22:49:56.358 INFO:tasks.workunit.client.0.smithi066.stdout:6/564: dread d6/f17 [0,4194304] 0 2024-09-12T22:49:56.358 INFO:tasks.workunit.client.0.smithi066.stdout:9/497: creat d9/fa1 x:0 0 0 2024-09-12T22:49:56.358 INFO:tasks.workunit.client.0.smithi066.stdout:5/569: dwrite d5/de/f95 [0,4194304] 0 2024-09-12T22:49:56.361 INFO:tasks.workunit.client.0.smithi066.stdout:9/498: unlink d9/dc/d4e/f6c 0 2024-09-12T22:49:56.362 INFO:tasks.workunit.client.0.smithi066.stdout:5/570: creat d5/d11/d23/fa2 x:0 0 0 2024-09-12T22:49:56.362 INFO:tasks.workunit.client.0.smithi066.stdout:2/498: dwrite d1/d11/d26/d4f/d52/f93 [0,4194304] 0 2024-09-12T22:49:56.363 INFO:tasks.workunit.client.0.smithi066.stdout:3/478: dwrite d0/d2/d1d/d87/d6b/db2/f45 [4194304,4194304] 0 2024-09-12T22:49:56.366 INFO:tasks.workunit.client.0.smithi066.stdout:5/571: dread - d5/d11/d23/fa2 zero size 2024-09-12T22:49:56.367 INFO:tasks.workunit.client.0.smithi066.stdout:3/479: mkdir d0/db3 0 2024-09-12T22:49:56.367 INFO:tasks.workunit.client.0.smithi066.stdout:3/480: dread - d0/d2/d1d/d87/f65 zero size 2024-09-12T22:49:56.368 INFO:tasks.workunit.client.0.smithi066.stdout:5/572: creat d5/d11/d21/d4d/fa3 x:0 0 0 2024-09-12T22:49:56.368 INFO:tasks.workunit.client.0.smithi066.stdout:4/539: dwrite d5/d8/d16/d1b/d73/fb9 [0,4194304] 0 2024-09-12T22:49:56.369 INFO:tasks.workunit.client.0.smithi066.stdout:2/499: link d1/dd/d12/d1e/l2e d1/d11/d26/d4f/l99 0 2024-09-12T22:49:56.370 INFO:tasks.workunit.client.0.smithi066.stdout:4/540: symlink d5/d8/d10/lbd 0 2024-09-12T22:49:56.370 INFO:tasks.workunit.client.0.smithi066.stdout:6/565: dwrite d6/d7/dc/fbe [0,4194304] 0 2024-09-12T22:49:56.370 INFO:tasks.workunit.client.0.smithi066.stdout:3/481: rmdir d0/d2/d7/d13/d43/d74 39 2024-09-12T22:49:56.371 INFO:tasks.workunit.client.0.smithi066.stdout:2/500: fdatasync d1/dd/d68/f83 0 2024-09-12T22:49:56.371 INFO:tasks.workunit.client.0.smithi066.stdout:3/482: write d0/f54 [941907,13576] 0 2024-09-12T22:49:56.371 INFO:tasks.workunit.client.0.smithi066.stdout:9/499: dwrite d9/f87 [0,4194304] 0 2024-09-12T22:49:56.373 INFO:tasks.workunit.client.0.smithi066.stdout:7/448: read d0/d19/d24/f93 [1487095,59617] 0 2024-09-12T22:49:56.373 INFO:tasks.workunit.client.0.smithi066.stdout:9/500: dread - d9/dc/d23/f45 zero size 2024-09-12T22:49:56.374 INFO:tasks.workunit.client.0.smithi066.stdout:4/541: rmdir d5/d8/d16/d1b 39 2024-09-12T22:49:56.375 INFO:tasks.workunit.client.0.smithi066.stdout:2/501: mkdir d1/db/d42/d43/d9a 0 2024-09-12T22:49:56.375 INFO:tasks.workunit.client.0.smithi066.stdout:5/573: creat d5/de/fa4 x:0 0 0 2024-09-12T22:49:56.375 INFO:tasks.workunit.client.0.smithi066.stdout:6/566: truncate d6/d49/f4d 4419050 0 2024-09-12T22:49:56.375 INFO:tasks.workunit.client.0.smithi066.stdout:9/501: fsync d9/dc/dd/f42 0 2024-09-12T22:49:56.376 INFO:tasks.workunit.client.0.smithi066.stdout:6/567: read - d6/d7/faa zero size 2024-09-12T22:49:56.378 INFO:tasks.workunit.client.0.smithi066.stdout:4/542: truncate d5/d8/d10/f1a 3236726 0 2024-09-12T22:49:56.378 INFO:tasks.workunit.client.0.smithi066.stdout:2/502: write d1/d11/d26/f77 [575762,73114] 0 2024-09-12T22:49:56.378 INFO:tasks.workunit.client.0.smithi066.stdout:5/574: mknod d5/d11/d21/d4d/ca5 0 2024-09-12T22:49:56.378 INFO:tasks.workunit.client.0.smithi066.stdout:5/575: sync 2024-09-12T22:49:56.380 INFO:tasks.workunit.client.0.smithi066.stdout:9/502: rename d9/dc/dd/f13 to d9/d31/d34/d4d/d8c/d8d/fa2 0 2024-09-12T22:49:56.380 INFO:tasks.workunit.client.0.smithi066.stdout:3/483: dwrite d0/d2/d7/d13/d43/f60 [0,4194304] 0 2024-09-12T22:49:56.380 INFO:tasks.workunit.client.0.smithi066.stdout:7/449: getdents d0/d19/d24/d33/d27/d70 0 2024-09-12T22:49:56.381 INFO:tasks.workunit.client.0.smithi066.stdout:5/576: symlink d5/la6 0 2024-09-12T22:49:56.381 INFO:tasks.workunit.client.0.smithi066.stdout:4/543: mkdir d5/d8/d10/de/d2d/dbe 0 2024-09-12T22:49:56.382 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:56.382 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:49:56.382 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.382 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:12800 4.36 4:6f5a1eb9:::10000003597.00000000:head [write 0~4063232 in=4063232b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:56.382 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:56.371552+0000", 2024-09-12T22:49:56.382 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0090497419999999995, 2024-09-12T22:49:56.382 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090769419999999993, 2024-09-12T22:49:56.382 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:56.382 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:56.382 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:49:56.383 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:56.383 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:56.383 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:56.383 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 12800 2024-09-12T22:49:56.383 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.383 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:56.383 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.383 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:56.383 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.371552+0000", 2024-09-12T22:49:56.383 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.383 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.383 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.383 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:56.384 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.371552+0000", 2024-09-12T22:49:56.384 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.384 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.384 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.384 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:56.384 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.371553+0000", 2024-09-12T22:49:56.384 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6599999999999996e-07 2024-09-12T22:49:56.384 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.384 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.384 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:56.384 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.376413+0000", 2024-09-12T22:49:56.384 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048596840000000004 2024-09-12T22:49:56.385 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.385 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.385 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:56.385 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.376426+0000", 2024-09-12T22:49:56.385 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3268000000000001e-05 2024-09-12T22:49:56.385 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.385 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.385 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.385 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.376434+0000", 2024-09-12T22:49:56.385 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1620000000000008e-06 2024-09-12T22:49:56.385 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.385 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.385 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:56.386 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.376496+0000", 2024-09-12T22:49:56.386 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2020999999999995e-05 2024-09-12T22:49:56.386 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.386 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.386 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:56.386 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.376642+0000", 2024-09-12T22:49:56.386 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014632600000000001 2024-09-12T22:49:56.386 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.386 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.386 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:56.386 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.376789+0000", 2024-09-12T22:49:56.386 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014668799999999999 2024-09-12T22:49:56.386 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.387 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:56.387 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.387 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.387 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.387 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:12801 4.36 4:6f5a1eb9:::10000003597.00000000:head [write 4063232~131072 in=131072b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:56.387 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:56.376462+0000", 2024-09-12T22:49:56.387 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0041399779999999999, 2024-09-12T22:49:56.387 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042328510000000001, 2024-09-12T22:49:56.388 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:56.388 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:56.388 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:49:56.388 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:56.388 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:56.388 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:56.388 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 12801 2024-09-12T22:49:56.388 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.388 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:56.388 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.388 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:56.388 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.376462+0000", 2024-09-12T22:49:56.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:56.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.376462+0000", 2024-09-12T22:49:56.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:56.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.376463+0000", 2024-09-12T22:49:56.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.319e-06 2024-09-12T22:49:56.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:56.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.376507+0000", 2024-09-12T22:49:56.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3464999999999998e-05 2024-09-12T22:49:56.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:56.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.376515+0000", 2024-09-12T22:49:56.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0020000000000006e-06 2024-09-12T22:49:56.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.376520+0000", 2024-09-12T22:49:56.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2809999999999999e-06 2024-09-12T22:49:56.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.391 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.391 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:56.391 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.379483+0000", 2024-09-12T22:49:56.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0029625609999999998 2024-09-12T22:49:56.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.391 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.391 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:56.391 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.379550+0000", 2024-09-12T22:49:56.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7441999999999996e-05 2024-09-12T22:49:56.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:56.392 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.379645+0000", 2024-09-12T22:49:56.392 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4425999999999993e-05 2024-09-12T22:49:56.392 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.392 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:56.392 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.392 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:12803 4.1d 4:b92e2122:::100000032fa.00000000:head [read 2097152~2097152] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:56.392 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:56.376536+0000", 2024-09-12T22:49:56.392 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0040658140000000001, 2024-09-12T22:49:56.393 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042391069999999998, 2024-09-12T22:49:56.393 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:56.393 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:56.393 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:56.393 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:56.393 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:56.393 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:56.393 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 12803 2024-09-12T22:49:56.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.393 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:56.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.393 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:56.393 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.376536+0000", 2024-09-12T22:49:56.394 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.394 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.394 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.394 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:56.394 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.376536+0000", 2024-09-12T22:49:56.394 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.394 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.394 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.394 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:56.394 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.376537+0000", 2024-09-12T22:49:56.394 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6000000000000004e-07 2024-09-12T22:49:56.394 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.394 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.395 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:56.395 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.376539+0000", 2024-09-12T22:49:56.395 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4439999999999998e-06 2024-09-12T22:49:56.395 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.395 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.395 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:56.395 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.376546+0000", 2024-09-12T22:49:56.395 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8750000000000002e-06 2024-09-12T22:49:56.395 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.395 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.395 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.395 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.376551+0000", 2024-09-12T22:49:56.395 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6450000000000004e-06 2024-09-12T22:49:56.395 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.396 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:56.396 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.376618+0000", 2024-09-12T22:49:56.396 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7173000000000002e-05 2024-09-12T22:49:56.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.396 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:56.396 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.376698+0000", 2024-09-12T22:49:56.396 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0230999999999998e-05 2024-09-12T22:49:56.396 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.396 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:56.396 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.397 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.397 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:12804 4.15 4:a8974b0e:::100000032d2.00000000:head [write 941907~13576 in=13576b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:56.397 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:56.376561+0000", 2024-09-12T22:49:56.397 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0040414229999999997, 2024-09-12T22:49:56.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042787299999999997, 2024-09-12T22:49:56.397 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:56.397 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:56.397 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:49:56.397 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:56.397 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:56.397 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:56.397 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 12804 2024-09-12T22:49:56.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.398 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:56.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:56.398 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.376561+0000", 2024-09-12T22:49:56.398 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:56.399 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.376561+0000", 2024-09-12T22:49:56.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.399 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:56.399 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.376561+0000", 2024-09-12T22:49:56.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5900000000000003e-07 2024-09-12T22:49:56.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.399 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:56.399 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.376572+0000", 2024-09-12T22:49:56.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1301000000000001e-05 2024-09-12T22:49:56.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:56.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.376580+0000", 2024-09-12T22:49:56.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5270000000000001e-06 2024-09-12T22:49:56.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.376585+0000", 2024-09-12T22:49:56.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2889999999999997e-06 2024-09-12T22:49:56.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:56.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.376625+0000", 2024-09-12T22:49:56.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9360999999999998e-05 2024-09-12T22:49:56.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.401 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:56.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.376700+0000", 2024-09-12T22:49:56.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5139e-05 2024-09-12T22:49:56.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.401 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:56.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.376776+0000", 2024-09-12T22:49:56.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6215000000000001e-05 2024-09-12T22:49:56.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.401 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:56.402 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.380403+0000", 2024-09-12T22:49:56.402 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036270439999999998 2024-09-12T22:49:56.402 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.402 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:56.402 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.402 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.402 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:1541 3.18 e56/16 3:1e8917d7:::200.0000000e:head v 56'173, mlcod=56'171)", 2024-09-12T22:49:56.402 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:56.378380+0000", 2024-09-12T22:49:56.402 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0022224800000000002, 2024-09-12T22:49:56.402 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0025397340000000001, 2024-09-12T22:49:56.402 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:56.402 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:56.403 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:56.403 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:56.403 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.403 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:56.403 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.378380+0000", 2024-09-12T22:49:56.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.403 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.403 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:56.403 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.378380+0000", 2024-09-12T22:49:56.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.403 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.404 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:56.404 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.378381+0000", 2024-09-12T22:49:56.404 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.575e-06 2024-09-12T22:49:56.404 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.404 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.404 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:56.404 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.378402+0000", 2024-09-12T22:49:56.404 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1098e-05 2024-09-12T22:49:56.404 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.404 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.404 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:56.404 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.378415+0000", 2024-09-12T22:49:56.404 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3159999999999999e-05 2024-09-12T22:49:56.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.405 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.405 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.378423+0000", 2024-09-12T22:49:56.405 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0809999999999996e-06 2024-09-12T22:49:56.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.405 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:56.405 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.378498+0000", 2024-09-12T22:49:56.405 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5167999999999996e-05 2024-09-12T22:49:56.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.405 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:56.406 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.378516+0000", 2024-09-12T22:49:56.406 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7910999999999998e-05 2024-09-12T22:49:56.406 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.406 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:56.406 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.406 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.406 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.406 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4459.0:12808 4.21 e56/17 4:8714e74b:::1000000344d.00000000:head v 56'201, mlcod=56'199)", 2024-09-12T22:49:56.406 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:56.380351+0000", 2024-09-12T22:49:56.406 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.000251494, 2024-09-12T22:49:56.406 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00062280699999999996, 2024-09-12T22:49:56.406 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:56.406 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:56.407 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:56.407 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:56.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.407 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:56.407 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.380351+0000", 2024-09-12T22:49:56.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.407 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:56.407 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.380351+0000", 2024-09-12T22:49:56.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:56.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.380351+0000", 2024-09-12T22:49:56.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1899999999999999e-07 2024-09-12T22:49:56.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:56.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.380478+0000", 2024-09-12T22:49:56.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012672399999999999 2024-09-12T22:49:56.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.409 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:56.409 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.380493+0000", 2024-09-12T22:49:56.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4973e-05 2024-09-12T22:49:56.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.409 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.409 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.380497+0000", 2024-09-12T22:49:56.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.921e-06 2024-09-12T22:49:56.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.409 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:56.410 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.380550+0000", 2024-09-12T22:49:56.410 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2258e-05 2024-09-12T22:49:56.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.410 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:56.410 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.380565+0000", 2024-09-12T22:49:56.410 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.535e-05 2024-09-12T22:49:56.410 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.410 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:56.410 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.410 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:1542 3.18 e56/16 3:1e8917d7:::200.0000000e:head v 56'174, mlcod=56'171)", 2024-09-12T22:49:56.410 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:56.380582+0000", 2024-09-12T22:49:56.411 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 2.0353e-05, 2024-09-12T22:49:56.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00043983100000000001, 2024-09-12T22:49:56.411 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:56.411 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:56.411 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:56.411 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:56.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.411 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:56.411 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.380582+0000", 2024-09-12T22:49:56.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.411 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:56.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.380582+0000", 2024-09-12T22:49:56.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.412 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:56.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.380582+0000", 2024-09-12T22:49:56.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:49:56.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.412 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:56.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.380591+0000", 2024-09-12T22:49:56.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5909999999999996e-06 2024-09-12T22:49:56.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:56.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.380612+0000", 2024-09-12T22:49:56.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1396e-05 2024-09-12T22:49:56.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.380618+0000", 2024-09-12T22:49:56.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6690000000000003e-06 2024-09-12T22:49:56.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:56.414 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.380670+0000", 2024-09-12T22:49:56.414 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1915e-05 2024-09-12T22:49:56.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.414 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.414 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:56.414 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.380681+0000", 2024-09-12T22:49:56.414 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1313e-05 2024-09-12T22:49:56.414 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.414 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:56.414 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.414 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.414 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-12T22:49:56.414 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 7 2024-09-12T22:49:56.415 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:56.417 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:56.423 INFO:tasks.workunit.client.0.smithi066.stdout:6/568: rename d6/d78/c75 to d6/d23/d25/d4e/dc4/d99/cc7 0 2024-09-12T22:49:56.423 INFO:tasks.workunit.client.0.smithi066.stdout:5/577: chown d5/de/d57/c81 118889051 1 2024-09-12T22:49:56.423 INFO:tasks.workunit.client.0.smithi066.stdout:4/544: stat d5/d8/d16/d1b/d1e/d1f/fa9 0 2024-09-12T22:49:56.423 INFO:tasks.workunit.client.0.smithi066.stdout:2/503: read d1/d11/f16 [3121580,59235] 0 2024-09-12T22:49:56.423 INFO:tasks.workunit.client.0.smithi066.stdout:7/450: symlink d0/d19/d26/d48/d84/l94 0 2024-09-12T22:49:56.424 INFO:tasks.workunit.client.0.smithi066.stdout:6/569: getdents d6/d35 0 2024-09-12T22:49:56.424 INFO:tasks.workunit.client.0.smithi066.stdout:2/504: write d1/f6b [465800,35176] 0 2024-09-12T22:49:56.424 INFO:tasks.workunit.client.0.smithi066.stdout:4/545: creat d5/d8/d10/de/fbf x:0 0 0 2024-09-12T22:49:56.424 INFO:tasks.workunit.client.0.smithi066.stdout:3/484: truncate d0/d2/d1d/d87/d40/d44/d55/d91/fb0 759210 0 2024-09-12T22:49:56.424 INFO:tasks.workunit.client.0.smithi066.stdout:1/419: dread d0/dc/d1d/f39 [0,4194304] 0 2024-09-12T22:49:56.424 INFO:tasks.workunit.client.0.smithi066.stdout:9/503: dwrite d9/d31/f73 [0,4194304] 0 2024-09-12T22:49:56.424 INFO:tasks.workunit.client.0.smithi066.stdout:9/504: write d9/dc/f88 [402967,21376] 0 2024-09-12T22:49:56.424 INFO:tasks.workunit.client.0.smithi066.stdout:0/505: dread d1/d8/d1c/dd/f44 [0,4194304] 0 2024-09-12T22:49:56.424 INFO:tasks.workunit.client.0.smithi066.stdout:1/420: rmdir d0/dc/d1d 39 2024-09-12T22:49:56.424 INFO:tasks.workunit.client.0.smithi066.stdout:3/485: symlink d0/d2/d7/d29/daf/lb4 0 2024-09-12T22:49:56.424 INFO:tasks.workunit.client.0.smithi066.stdout:0/506: creat d1/d8/d1f/fb5 x:0 0 0 2024-09-12T22:49:56.424 INFO:tasks.workunit.client.0.smithi066.stdout:4/546: getdents d5/d8/d10/de/d2d/d64 0 2024-09-12T22:49:56.425 INFO:tasks.workunit.client.0.smithi066.stdout:7/451: dwrite d0/d6/f4f [0,4194304] 0 2024-09-12T22:49:56.425 INFO:tasks.workunit.client.0.smithi066.stdout:1/421: fdatasync d0/d36/d57/f50 0 2024-09-12T22:49:56.425 INFO:tasks.workunit.client.0.smithi066.stdout:3/486: fsync d0/d2/d1d/f85 0 2024-09-12T22:49:56.425 INFO:tasks.workunit.client.0.smithi066.stdout:0/507: creat d1/d36/d65/fb6 x:0 0 0 2024-09-12T22:49:56.425 INFO:tasks.workunit.client.0.smithi066.stdout:4/547: write d5/d3e/d65/f9e [325515,4643] 0 2024-09-12T22:49:56.425 INFO:tasks.workunit.client.0.smithi066.stdout:1/422: creat d0/dc/d44/f77 x:0 0 0 2024-09-12T22:49:56.425 INFO:tasks.workunit.client.0.smithi066.stdout:8/528: dread f11 [0,4194304] 0 2024-09-12T22:49:56.425 INFO:tasks.workunit.client.0.smithi066.stdout:7/452: fsync d0/d19/d26/d48/f49 0 2024-09-12T22:49:56.425 INFO:tasks.workunit.client.0.smithi066.stdout:3/487: fsync d0/d2/d7/f4b 0 2024-09-12T22:49:56.425 INFO:tasks.workunit.client.0.smithi066.stdout:0/508: chown d1/d8/d1c/dd/f66 28 1 2024-09-12T22:49:56.425 INFO:tasks.workunit.client.0.smithi066.stdout:5/578: truncate d5/f55 4190372 0 2024-09-12T22:49:56.425 INFO:tasks.workunit.client.0.smithi066.stdout:1/423: mknod d0/d36/d57/c78 0 2024-09-12T22:49:56.425 INFO:tasks.workunit.client.0.smithi066.stdout:9/505: dwrite d9/dc/d23/f79 [0,4194304] 0 2024-09-12T22:49:56.426 INFO:tasks.workunit.client.0.smithi066.stdout:0/509: chown d1/d8/d1f/d25/f34 501 1 2024-09-12T22:49:56.426 INFO:tasks.workunit.client.0.smithi066.stdout:2/505: truncate d1/dd/d12/d18/f80 292856 0 2024-09-12T22:49:56.426 INFO:tasks.workunit.client.0.smithi066.stdout:3/488: fsync d0/d2/d7/d29/f3d 0 2024-09-12T22:49:56.426 INFO:tasks.workunit.client.0.smithi066.stdout:7/453: creat d0/d86/f95 x:0 0 0 2024-09-12T22:49:56.426 INFO:tasks.workunit.client.0.smithi066.stdout:0/510: stat d1/d8/f81 0 2024-09-12T22:49:56.426 INFO:tasks.workunit.client.0.smithi066.stdout:1/424: mkdir d0/d4e/d79 0 2024-09-12T22:49:56.426 INFO:tasks.workunit.client.0.smithi066.stdout:5/579: mknod d5/de/d57/ca7 0 2024-09-12T22:49:56.426 INFO:tasks.workunit.client.0.smithi066.stdout:8/529: write d17/d49/d4b/d57/d5e/d65/d91/f97 [296084,99678] 0 2024-09-12T22:49:56.426 INFO:tasks.workunit.client.0.smithi066.stdout:7/454: mknod d0/d19/d60/d53/c96 0 2024-09-12T22:49:56.426 INFO:tasks.workunit.client.0.smithi066.stdout:9/506: creat d9/d31/d77/d8f/fa3 x:0 0 0 2024-09-12T22:49:56.426 INFO:tasks.workunit.client.0.smithi066.stdout:8/530: read - d17/d40/d47/d66/f6e zero size 2024-09-12T22:49:56.426 INFO:tasks.workunit.client.0.smithi066.stdout:0/511: mkdir d1/d8/d1c/d56/db7 0 2024-09-12T22:49:56.426 INFO:tasks.workunit.client.0.smithi066.stdout:5/580: write d5/d11/f66 [129131,26605] 0 2024-09-12T22:49:56.427 INFO:tasks.workunit.client.0.smithi066.stdout:2/506: symlink d1/dd/d12/d1e/l9b 0 2024-09-12T22:49:56.427 INFO:tasks.workunit.client.0.smithi066.stdout:7/455: symlink d0/d19/d26/d48/l97 0 2024-09-12T22:49:56.427 INFO:tasks.workunit.client.0.smithi066.stdout:8/531: mkdir d17/d2c/dab 0 2024-09-12T22:49:56.427 INFO:tasks.workunit.client.0.smithi066.stdout:9/507: mkdir d9/d31/d58/da4 0 2024-09-12T22:49:56.427 INFO:tasks.workunit.client.0.smithi066.stdout:2/507: mkdir d1/d11/d26/d4f/d5f/d61/d9c 0 2024-09-12T22:49:56.427 INFO:tasks.workunit.client.0.smithi066.stdout:3/489: truncate d0/d2/d7/d13/d43/d74/f86 558904 0 2024-09-12T22:49:56.427 INFO:tasks.workunit.client.0.smithi066.stdout:7/456: creat d0/d19/d60/d85/d8b/f98 x:0 0 0 2024-09-12T22:49:56.427 INFO:tasks.workunit.client.0.smithi066.stdout:9/508: mkdir d9/dc/da5 0 2024-09-12T22:49:56.427 INFO:tasks.workunit.client.0.smithi066.stdout:4/548: dread d5/f46 [0,4194304] 0 2024-09-12T22:49:56.427 INFO:tasks.workunit.client.0.smithi066.stdout:8/532: mkdir d17/d40/d74/da3/dac 0 2024-09-12T22:49:56.427 INFO:tasks.workunit.client.0.smithi066.stdout:2/508: creat d1/d11/d57/f9d x:0 0 0 2024-09-12T22:49:56.427 INFO:tasks.workunit.client.0.smithi066.stdout:9/509: mknod d9/dc/d4e/d9d/ca6 0 2024-09-12T22:49:56.427 INFO:tasks.workunit.client.0.smithi066.stdout:3/490: creat d0/d2/d7/fb5 x:0 0 0 2024-09-12T22:49:56.427 INFO:tasks.workunit.client.0.smithi066.stdout:2/509: fsync d1/db/d42/d43/d47/f60 0 2024-09-12T22:49:56.428 INFO:tasks.workunit.client.0.smithi066.stdout:4/549: rename d5/d8/d16/d1b/d1e/d38/d84 to d5/d8/d10/de/d39/dc0 0 2024-09-12T22:49:56.428 INFO:tasks.workunit.client.0.smithi066.stdout:3/491: write d0/d2/d7/d29/daf/fa3 [137677,45956] 0 2024-09-12T22:49:56.428 INFO:tasks.workunit.client.0.smithi066.stdout:7/457: dwrite d0/d19/d24/f6b [0,4194304] 0 2024-09-12T22:49:56.428 INFO:tasks.workunit.client.0.smithi066.stdout:3/492: creat d0/d2/d7/d92/fb6 x:0 0 0 2024-09-12T22:49:56.428 INFO:tasks.workunit.client.0.smithi066.stdout:4/550: getdents d5/d8/d16/d93 0 2024-09-12T22:49:56.428 INFO:tasks.workunit.client.0.smithi066.stdout:7/458: symlink d0/d19/d26/d5a/l99 0 2024-09-12T22:49:56.428 INFO:tasks.workunit.client.0.smithi066.stdout:8/533: dwrite d17/d49/d4b/d57/d5e/f72 [0,4194304] 0 2024-09-12T22:49:56.428 INFO:tasks.workunit.client.0.smithi066.stdout:7/459: sync 2024-09-12T22:49:56.428 INFO:tasks.workunit.client.0.smithi066.stdout:0/512: write d1/f10 [106582,99055] 0 2024-09-12T22:49:56.428 INFO:tasks.workunit.client.0.smithi066.stdout:0/513: chown d1/d8/d1f/d25/f7d 1179361 1 2024-09-12T22:49:56.428 INFO:tasks.workunit.client.0.smithi066.stdout:2/510: dwrite d1/d11/d26/f77 [0,4194304] 0 2024-09-12T22:49:56.428 INFO:tasks.workunit.client.0.smithi066.stdout:3/493: mkdir d0/db3/db7 0 2024-09-12T22:49:56.428 INFO:tasks.workunit.client.0.smithi066.stdout:8/534: symlink d17/d40/d47/d81/lad 0 2024-09-12T22:49:56.429 INFO:tasks.workunit.client.0.smithi066.stdout:0/514: mkdir d1/d8/d1c/d56/db8 0 2024-09-12T22:49:56.429 INFO:tasks.workunit.client.0.smithi066.stdout:2/511: mknod d1/dd/d12/d1e/c9e 0 2024-09-12T22:49:56.429 INFO:tasks.workunit.client.0.smithi066.stdout:8/535: mknod d17/d40/d47/d81/cae 0 2024-09-12T22:49:56.429 INFO:tasks.workunit.client.0.smithi066.stdout:3/494: read d0/f38 [4133039,37074] 0 2024-09-12T22:49:56.429 INFO:tasks.workunit.client.0.smithi066.stdout:0/515: mknod d1/d8/d1f/d25/d9c/cb9 0 2024-09-12T22:49:56.429 INFO:tasks.workunit.client.0.smithi066.stdout:5/581: dwrite d5/d11/f58 [0,4194304] 0 2024-09-12T22:49:56.429 INFO:tasks.workunit.client.0.smithi066.stdout:9/510: dwrite d9/dc/dd/f1b [0,4194304] 0 2024-09-12T22:49:56.429 INFO:tasks.workunit.client.0.smithi066.stdout:6/570: dread d6/d23/d25/f97 [0,4194304] 0 2024-09-12T22:49:56.430 INFO:tasks.workunit.client.0.smithi066.stdout:3/495: rename d0/d2/d1d/f21 to d0/d2/d7/d13/d31/fb8 0 2024-09-12T22:49:56.430 INFO:tasks.workunit.client.0.smithi066.stdout:6/571: stat d6/f2a 0 2024-09-12T22:49:56.430 INFO:tasks.workunit.client.0.smithi066.stdout:9/511: dread - d9/dc/dd/f4f zero size 2024-09-12T22:49:56.430 INFO:tasks.workunit.client.0.smithi066.stdout:5/582: creat d5/de/d50/d42/d9d/fa8 x:0 0 0 2024-09-12T22:49:56.430 INFO:tasks.workunit.client.0.smithi066.stdout:3/496: mknod d0/d2/d1d/cb9 0 2024-09-12T22:49:56.430 INFO:tasks.workunit.client.0.smithi066.stdout:6/572: chown d6/l15 55 1 2024-09-12T22:49:56.431 INFO:tasks.workunit.client.0.smithi066.stdout:2/512: dwrite d1/d11/d53/f7f [0,4194304] 0 2024-09-12T22:49:56.431 INFO:tasks.workunit.client.0.smithi066.stdout:3/497: rmdir d0/db3 39 2024-09-12T22:49:56.431 INFO:tasks.workunit.client.0.smithi066.stdout:9/512: rename d9/dc/d36/l3c to d9/dc/d46/la7 0 2024-09-12T22:49:56.431 INFO:tasks.workunit.client.0.smithi066.stdout:3/498: write d0/d2/d1d/d87/f70 [423841,114695] 0 2024-09-12T22:49:56.431 INFO:tasks.workunit.client.0.smithi066.stdout:9/513: write d9/dc/d23/f51 [4086033,8634] 0 2024-09-12T22:49:56.432 INFO:tasks.workunit.client.0.smithi066.stdout:0/516: dwrite d1/d8/d1f/d30/f5c [0,4194304] 0 2024-09-12T22:49:56.432 INFO:tasks.workunit.client.0.smithi066.stdout:3/499: stat d0/d2/c2e 0 2024-09-12T22:49:56.432 INFO:tasks.workunit.client.0.smithi066.stdout:2/513: truncate d1/d11/d26/d4f/d52/d56/f8a 275709 0 2024-09-12T22:49:56.433 INFO:tasks.workunit.client.0.smithi066.stdout:9/514: readlink d9/dc/l7a 0 2024-09-12T22:49:56.433 INFO:tasks.workunit.client.0.smithi066.stdout:3/500: readlink d0/d2/d1d/l1e 0 2024-09-12T22:49:56.434 INFO:tasks.workunit.client.0.smithi066.stdout:8/536: dwrite d17/f29 [0,4194304] 0 2024-09-12T22:49:56.434 INFO:tasks.workunit.client.0.smithi066.stdout:0/517: mkdir d1/d5b/dba 0 2024-09-12T22:49:56.434 INFO:tasks.workunit.client.0.smithi066.stdout:4/551: dwrite d5/d8/d16/d1b/f28 [0,4194304] 0 2024-09-12T22:49:56.435 INFO:tasks.workunit.client.0.smithi066.stdout:9/515: mkdir d9/dc/d4e/da8 0 2024-09-12T22:49:56.435 INFO:tasks.workunit.client.0.smithi066.stdout:2/514: chown d1/dd/d3d/c5a 6 1 2024-09-12T22:49:56.435 INFO:tasks.workunit.client.0.smithi066.stdout:9/516: read - d9/dc/dd/f47 zero size 2024-09-12T22:49:56.435 INFO:tasks.workunit.client.0.smithi066.stdout:3/501: symlink d0/db3/db7/lba 0 2024-09-12T22:49:56.436 INFO:tasks.workunit.client.0.smithi066.stdout:2/515: write d1/d11/d53/f7f [4210687,130186] 0 2024-09-12T22:49:56.436 INFO:tasks.workunit.client.0.smithi066.stdout:4/552: unlink d5/d8/d10/de/d2d/l52 0 2024-09-12T22:49:56.436 INFO:tasks.workunit.client.0.smithi066.stdout:0/518: creat d1/d8/d1f/d30/fbb x:0 0 0 2024-09-12T22:49:56.437 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:56.435+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:56.438 INFO:tasks.workunit.client.0.smithi066.stdout:2/516: creat d1/d11/d26/d4f/d7c/f9f x:0 0 0 2024-09-12T22:49:56.438 INFO:tasks.workunit.client.0.smithi066.stdout:4/553: unlink d5/c69 0 2024-09-12T22:49:56.438 INFO:tasks.workunit.client.0.smithi066.stdout:0/519: creat d1/d8/d1b/dac/fbc x:0 0 0 2024-09-12T22:49:56.438 INFO:tasks.workunit.client.0.smithi066.stdout:3/502: chown d0/d2/d1d/c30 3603 1 2024-09-12T22:49:56.438 INFO:tasks.workunit.client.0.smithi066.stdout:2/517: creat d1/db/d42/fa0 x:0 0 0 2024-09-12T22:49:56.439 INFO:tasks.workunit.client.0.smithi066.stdout:0/520: mknod d1/d8/d1f/d30/da0/cbd 0 2024-09-12T22:49:56.439 INFO:tasks.workunit.client.0.smithi066.stdout:4/554: creat d5/d8/d10/de/d2d/fc1 x:0 0 0 2024-09-12T22:49:56.440 INFO:tasks.workunit.client.0.smithi066.stdout:0/521: creat d1/fbe x:0 0 0 2024-09-12T22:49:56.440 INFO:tasks.workunit.client.0.smithi066.stdout:3/503: getdents d0/d2/d1d/d87/d40 0 2024-09-12T22:49:56.440 INFO:tasks.workunit.client.0.smithi066.stdout:9/517: dread d9/dc/d4e/f96 [0,4194304] 0 2024-09-12T22:49:56.442 INFO:tasks.workunit.client.0.smithi066.stdout:4/555: mkdir d5/d8/d16/dc2 0 2024-09-12T22:49:56.443 INFO:tasks.workunit.client.0.smithi066.stdout:9/518: dread - d9/dc/d8e/fa0 zero size 2024-09-12T22:49:56.443 INFO:tasks.workunit.client.0.smithi066.stdout:3/504: fdatasync d0/d2/d1d/fa8 0 2024-09-12T22:49:56.443 INFO:tasks.workunit.client.0.smithi066.stdout:9/519: write d9/dc/f19 [1184642,12179] 0 2024-09-12T22:49:56.443 INFO:tasks.workunit.client.0.smithi066.stdout:3/505: mknod d0/d2/d1d/d87/d40/d44/cbb 0 2024-09-12T22:49:56.443 INFO:tasks.workunit.client.0.smithi066.stdout:9/520: mknod d9/d31/d34/d4d/d8c/d8d/ca9 0 2024-09-12T22:49:56.445 INFO:tasks.workunit.client.0.smithi066.stdout:3/506: write d0/d2/d7/d13/d43/d74/f79 [194898,4658] 0 2024-09-12T22:49:56.445 INFO:tasks.workunit.client.0.smithi066.stdout:5/583: dread d5/d15/f71 [0,4194304] 0 2024-09-12T22:49:56.445 INFO:tasks.workunit.client.0.smithi066.stdout:9/521: write d9/d31/f6f [2352422,31226] 0 2024-09-12T22:49:56.447 INFO:tasks.workunit.client.0.smithi066.stdout:1/425: dread d0/f1c [0,4194304] 0 2024-09-12T22:49:56.447 INFO:tasks.workunit.client.0.smithi066.stdout:4/556: dread d5/d8/d10/de/d2d/fae [0,4194304] 0 2024-09-12T22:49:56.447 INFO:tasks.workunit.client.0.smithi066.stdout:5/584: rename d5/d11/d5d/d8a/f9f to d5/de/d50/d8b/fa9 0 2024-09-12T22:49:56.447 INFO:tasks.workunit.client.0.smithi066.stdout:9/522: getdents d9 0 2024-09-12T22:49:56.448 INFO:tasks.workunit.client.0.smithi066.stdout:5/585: mkdir d5/d11/d23/d6f/daa 0 2024-09-12T22:49:56.448 INFO:tasks.workunit.client.0.smithi066.stdout:9/523: creat d9/d31/d77/faa x:0 0 0 2024-09-12T22:49:56.448 INFO:tasks.workunit.client.0.smithi066.stdout:4/557: truncate d5/d8/d16/d1b/d73/f76 1436290 0 2024-09-12T22:49:56.449 INFO:tasks.workunit.client.0.smithi066.stdout:9/524: unlink d9/dc/d46/f80 0 2024-09-12T22:49:56.449 INFO:tasks.workunit.client.0.smithi066.stdout:5/586: getdents d5/d11/d5d/d97 0 2024-09-12T22:49:56.449 INFO:tasks.workunit.client.0.smithi066.stdout:4/558: symlink d5/d8/d16/d1b/d1e/d38/lc3 0 2024-09-12T22:49:56.450 INFO:tasks.workunit.client.0.smithi066.stdout:5/587: fsync d5/d11/d5d/f83 0 2024-09-12T22:49:56.450 INFO:tasks.workunit.client.0.smithi066.stdout:9/525: write d9/dc/d46/f4b [4511247,66408] 0 2024-09-12T22:49:56.450 INFO:tasks.workunit.client.0.smithi066.stdout:4/559: stat d5/d8/d16/fa0 0 2024-09-12T22:49:56.451 INFO:tasks.workunit.client.0.smithi066.stdout:4/560: sync 2024-09-12T22:49:56.451 INFO:tasks.workunit.client.0.smithi066.stdout:9/526: dread - d9/d31/d34/f89 zero size 2024-09-12T22:49:56.451 INFO:tasks.workunit.client.0.smithi066.stdout:1/426: dwrite d0/dc/d1d/f39 [0,4194304] 0 2024-09-12T22:49:56.452 INFO:tasks.workunit.client.0.smithi066.stdout:1/427: mknod d0/dc/d44/c7a 0 2024-09-12T22:49:56.453 INFO:tasks.workunit.client.0.smithi066.stdout:4/561: mkdir d5/d8/d16/d1b/d1e/d1f/d8c/dc4 0 2024-09-12T22:49:56.453 INFO:tasks.workunit.client.0.smithi066.stdout:9/527: truncate d9/dc/dd/f5f 4743039 0 2024-09-12T22:49:56.453 INFO:tasks.workunit.client.0.smithi066.stdout:1/428: mknod d0/d36/d6b/c7b 0 2024-09-12T22:49:56.454 INFO:tasks.workunit.client.0.smithi066.stdout:9/528: mknod d9/dc/d4e/cab 0 2024-09-12T22:49:56.455 INFO:tasks.workunit.client.0.smithi066.stdout:1/429: chown d0/d36/d57/l34 4170601 1 2024-09-12T22:49:56.455 INFO:tasks.workunit.client.0.smithi066.stdout:4/562: truncate d5/d8/d10/de/fbf 277045 0 2024-09-12T22:49:56.455 INFO:tasks.workunit.client.0.smithi066.stdout:9/529: creat d9/dc/d23/fac x:0 0 0 2024-09-12T22:49:56.455 INFO:tasks.workunit.client.0.smithi066.stdout:5/588: dwrite d5/f12 [0,4194304] 0 2024-09-12T22:49:56.456 INFO:tasks.workunit.client.0.smithi066.stdout:5/589: sync 2024-09-12T22:49:56.459 INFO:tasks.workunit.client.0.smithi066.stdout:6/573: write d6/d7/dc/f43 [4524584,94106] 0 2024-09-12T22:49:56.460 INFO:tasks.workunit.client.0.smithi066.stdout:1/430: link d0/d36/d57/l34 d0/d28/l7c 0 2024-09-12T22:49:56.460 INFO:tasks.workunit.client.0.smithi066.stdout:4/563: rename d5/d8/d10/f1a to d5/d8/d16/d93/d9c/d98/dab/fc5 0 2024-09-12T22:49:56.460 INFO:tasks.workunit.client.0.smithi066.stdout:6/574: mknod d6/d7/dc6/cc8 0 2024-09-12T22:49:56.461 INFO:tasks.workunit.client.0.smithi066.stdout:0/522: fdatasync d1/d8/d1b/dac/fad 0 2024-09-12T22:49:56.462 INFO:tasks.workunit.client.0.smithi066.stdout:1/431: creat d0/f7d x:0 0 0 2024-09-12T22:49:56.462 INFO:tasks.workunit.client.0.smithi066.stdout:4/564: mkdir d5/d8/d10/de/d39/dc6 0 2024-09-12T22:49:56.462 INFO:tasks.workunit.client.0.smithi066.stdout:6/575: mknod d6/d23/d25/d2c/d69/cc9 0 2024-09-12T22:49:56.462 INFO:tasks.workunit.client.0.smithi066.stdout:1/432: creat d0/d36/d57/f7e x:0 0 0 2024-09-12T22:49:56.463 INFO:tasks.workunit.client.0.smithi066.stdout:6/576: creat d6/d7/d66/fca x:0 0 0 2024-09-12T22:49:56.463 INFO:tasks.workunit.client.0.smithi066.stdout:8/537: dwrite d17/d2c/f38 [8388608,4194304] 0 2024-09-12T22:49:56.463 INFO:tasks.workunit.client.0.smithi066.stdout:0/523: rename d1/d36/d65/db1 to d1/dbf 0 2024-09-12T22:49:56.464 INFO:tasks.workunit.client.0.smithi066.stdout:3/507: dread d0/d2/d7/d13/f39 [0,4194304] 0 2024-09-12T22:49:56.465 INFO:tasks.workunit.client.0.smithi066.stdout:4/565: rename d5/d8/d16/d1b/d1e/d1f/d7c to d5/d3e/d8d/dc7 0 2024-09-12T22:49:56.465 INFO:tasks.workunit.client.0.smithi066.stdout:0/524: readlink d1/d8/d1c/dd/l83 0 2024-09-12T22:49:56.465 INFO:tasks.workunit.client.0.smithi066.stdout:8/538: mkdir d17/d49/d4b/d4e/daf 0 2024-09-12T22:49:56.465 INFO:tasks.workunit.client.0.smithi066.stdout:6/577: mkdir d6/d23/d25/d4e/dc4/d99/dcb 0 2024-09-12T22:49:56.467 INFO:tasks.workunit.client.0.smithi066.stdout:0/525: mkdir d1/d8/d1c/d13/d2f/d8a/dc0 0 2024-09-12T22:49:56.467 INFO:tasks.workunit.client.0.smithi066.stdout:6/578: dread - d6/d23/d25/d4e/dc4/d99/fa0 zero size 2024-09-12T22:49:56.468 INFO:tasks.workunit.client.0.smithi066.stdout:6/579: mknod d6/d23/d25/d4e/ccc 0 2024-09-12T22:49:56.469 INFO:tasks.workunit.client.0.smithi066.stdout:0/526: write d1/d8/d1c/d13/d2f/f82 [94982,17191] 0 2024-09-12T22:49:56.470 INFO:tasks.workunit.client.0.smithi066.stdout:3/508: dwrite d0/d2/d7/fb5 [0,4194304] 0 2024-09-12T22:49:56.471 INFO:tasks.workunit.client.0.smithi066.stdout:0/527: chown d1/d8 4 1 2024-09-12T22:49:56.471 INFO:tasks.workunit.client.0.smithi066.stdout:0/528: sync 2024-09-12T22:49:56.472 INFO:tasks.workunit.client.0.smithi066.stdout:1/433: write d0/d36/d57/f3d [2097230,690] 0 2024-09-12T22:49:56.473 INFO:tasks.workunit.client.0.smithi066.stdout:8/539: dwrite d17/d49/d4b/d4e/f96 [0,4194304] 0 2024-09-12T22:49:56.474 INFO:tasks.workunit.client.0.smithi066.stdout:4/566: truncate f1 2074085 0 2024-09-12T22:49:56.474 INFO:tasks.workunit.client.0.smithi066.stdout:6/580: truncate d6/d7/faa 979286 0 2024-09-12T22:49:56.474 INFO:tasks.workunit.client.0.smithi066.stdout:1/434: rmdir d0/dc/d1d 39 2024-09-12T22:49:56.475 INFO:tasks.workunit.client.0.smithi066.stdout:0/529: creat d1/d5b/dba/fc1 x:0 0 0 2024-09-12T22:49:56.475 INFO:tasks.workunit.client.0.smithi066.stdout:8/540: link d17/d49/c59 d17/d1b/cb0 0 2024-09-12T22:49:56.475 INFO:tasks.workunit.client.0.smithi066.stdout:1/435: mknod d0/dc/d1e/c7f 0 2024-09-12T22:49:56.475 INFO:tasks.workunit.client.0.smithi066.stdout:3/509: getdents d0/d2/d1d/d87/d40 0 2024-09-12T22:49:56.477 INFO:tasks.workunit.client.0.smithi066.stdout:4/567: truncate d5/d8/d10/de/d2d/fc1 794911 0 2024-09-12T22:49:56.477 INFO:tasks.workunit.client.0.smithi066.stdout:1/436: creat d0/d36/d6b/f80 x:0 0 0 2024-09-12T22:49:56.477 INFO:tasks.workunit.client.0.smithi066.stdout:0/530: write d1/d8/d1b/d59/f69 [3006197,71741] 0 2024-09-12T22:49:56.477 INFO:tasks.workunit.client.0.smithi066.stdout:8/541: creat d17/d40/da8/fb1 x:0 0 0 2024-09-12T22:49:56.478 INFO:tasks.workunit.client.0.smithi066.stdout:1/437: dread - d0/dc/d1d/f60 zero size 2024-09-12T22:49:56.478 INFO:tasks.workunit.client.0.smithi066.stdout:4/568: mknod d5/d8/d16/d1b/d1e/d38/cc8 0 2024-09-12T22:49:56.478 INFO:tasks.workunit.client.0.smithi066.stdout:4/569: sync 2024-09-12T22:49:56.478 INFO:tasks.workunit.client.0.smithi066.stdout:0/531: mkdir d1/d36/d65/dc2 0 2024-09-12T22:49:56.479 INFO:tasks.workunit.client.0.smithi066.stdout:1/438: dread - d0/dc/d1d/f60 zero size 2024-09-12T22:49:56.479 INFO:tasks.workunit.client.0.smithi066.stdout:2/518: dread d1/db/d42/d43/d47/f60 [0,4194304] 0 2024-09-12T22:49:56.479 INFO:tasks.workunit.client.0.smithi066.stdout:8/542: truncate d17/d49/d4b/d57/d5e/d65/d91/f97 1151844 0 2024-09-12T22:49:56.480 INFO:tasks.workunit.client.0.smithi066.stdout:1/439: mkdir d0/d36/d57/d81 0 2024-09-12T22:49:56.480 INFO:tasks.workunit.client.0.smithi066.stdout:2/519: creat d1/d44/fa1 x:0 0 0 2024-09-12T22:49:56.480 INFO:tasks.workunit.client.0.smithi066.stdout:4/570: creat d5/d3e/d8d/dc7/fc9 x:0 0 0 2024-09-12T22:49:56.480 INFO:tasks.workunit.client.0.smithi066.stdout:0/532: symlink d1/d8/d1c/d56/db8/lc3 0 2024-09-12T22:49:56.481 INFO:tasks.workunit.client.0.smithi066.stdout:1/440: symlink d0/dc/d1e/l82 0 2024-09-12T22:49:56.481 INFO:tasks.workunit.client.0.smithi066.stdout:8/543: creat d17/fb2 x:0 0 0 2024-09-12T22:49:56.481 INFO:tasks.workunit.client.0.smithi066.stdout:0/533: creat d1/dbf/fc4 x:0 0 0 2024-09-12T22:49:56.481 INFO:tasks.workunit.client.0.smithi066.stdout:4/571: read - d5/d8/d16/d1b/d1e/fa3 zero size 2024-09-12T22:49:56.482 INFO:tasks.workunit.client.0.smithi066.stdout:7/460: dread d0/d6/f21 [0,4194304] 0 2024-09-12T22:49:56.482 INFO:tasks.workunit.client.0.smithi066.stdout:2/520: creat d1/db/d42/d43/fa2 x:0 0 0 2024-09-12T22:49:56.482 INFO:tasks.workunit.client.0.smithi066.stdout:7/461: readlink d0/l31 0 2024-09-12T22:49:56.482 INFO:tasks.workunit.client.0.smithi066.stdout:7/462: chown d0/f5 7761789 1 2024-09-12T22:49:56.483 INFO:tasks.workunit.client.0.smithi066.stdout:1/441: link d0/l23 d0/dc/d1d/l83 0 2024-09-12T22:49:56.483 INFO:tasks.workunit.client.0.smithi066.stdout:8/544: rename d17/d40/d47/l54 to d17/d49/d4b/d4e/lb3 0 2024-09-12T22:49:56.483 INFO:tasks.workunit.client.0.smithi066.stdout:3/510: dread d0/d2/d7/f5e [0,4194304] 0 2024-09-12T22:49:56.483 INFO:tasks.workunit.client.0.smithi066.stdout:4/572: stat d5/d8/d16/d93/d9c/d98/l81 0 2024-09-12T22:49:56.484 INFO:tasks.workunit.client.0.smithi066.stdout:3/511: sync 2024-09-12T22:49:56.484 INFO:tasks.workunit.client.0.smithi066.stdout:1/442: rmdir d0/dc/d1e 39 2024-09-12T22:49:56.484 INFO:tasks.workunit.client.0.smithi066.stdout:2/521: write d1/d11/d26/d4f/d52/d56/f8a [861000,127454] 0 2024-09-12T22:49:56.484 INFO:tasks.workunit.client.0.smithi066.stdout:7/463: write d0/f4b [9422476,48608] 0 2024-09-12T22:49:56.484 INFO:tasks.workunit.client.0.smithi066.stdout:0/534: rename d1/d8/d1f/d30/f78 to d1/dbf/fc5 0 2024-09-12T22:49:56.484 INFO:tasks.workunit.client.0.smithi066.stdout:8/545: write d17/d2c/f90 [440044,79254] 0 2024-09-12T22:49:56.486 INFO:tasks.workunit.client.0.smithi066.stdout:3/512: creat d0/d2/d7/d13/d31/fbc x:0 0 0 2024-09-12T22:49:56.486 INFO:tasks.workunit.client.0.smithi066.stdout:1/443: unlink d0/dc/d33/l35 0 2024-09-12T22:49:56.486 INFO:tasks.workunit.client.0.smithi066.stdout:0/535: creat d1/d36/fc6 x:0 0 0 2024-09-12T22:49:56.486 INFO:tasks.workunit.client.0.smithi066.stdout:4/573: mkdir d5/d8/d16/d1b/d1e/d38/dca 0 2024-09-12T22:49:56.486 INFO:tasks.workunit.client.0.smithi066.stdout:7/464: write d0/d19/d60/d53/f67 [932489,115973] 0 2024-09-12T22:49:56.487 INFO:tasks.workunit.client.0.smithi066.stdout:2/522: write d1/d11/d26/d4f/d5f/d61/d7e/f8c [824153,8210] 0 2024-09-12T22:49:56.487 INFO:tasks.workunit.client.0.smithi066.stdout:3/513: readlink d0/d2/d6/l94 0 2024-09-12T22:49:56.487 INFO:tasks.workunit.client.0.smithi066.stdout:0/536: read - d1/d8/d1c/d13/d2f/f4a zero size 2024-09-12T22:49:56.487 INFO:tasks.workunit.client.0.smithi066.stdout:2/523: unlink d1/d44/f45 0 2024-09-12T22:49:56.488 INFO:tasks.workunit.client.0.smithi066.stdout:3/514: chown d0/d2/d7/d92/d9e 7505 1 2024-09-12T22:49:56.488 INFO:tasks.workunit.client.0.smithi066.stdout:1/444: creat d0/dc/d44/f84 x:0 0 0 2024-09-12T22:49:56.488 INFO:tasks.workunit.client.0.smithi066.stdout:4/574: creat d5/d3e/d65/dac/fcb x:0 0 0 2024-09-12T22:49:56.488 INFO:tasks.workunit.client.0.smithi066.stdout:4/575: fsync d5/fba 0 2024-09-12T22:49:56.488 INFO:tasks.workunit.client.0.smithi066.stdout:4/576: sync 2024-09-12T22:49:56.489 INFO:tasks.workunit.client.0.smithi066.stdout:7/465: read d0/d19/d60/d53/f7c [1925801,9081] 0 2024-09-12T22:49:56.489 INFO:tasks.workunit.client.0.smithi066.stdout:5/590: dread d5/f36 [0,4194304] 0 2024-09-12T22:49:56.489 INFO:tasks.workunit.client.0.smithi066.stdout:3/515: rename d0/d2/d7/d13/d43 to d0/d2/d1d/d87/d40/dbd 0 2024-09-12T22:49:56.490 INFO:tasks.workunit.client.0.smithi066.stdout:4/577: chown d5/d8/d16/f9b 6451530 1 2024-09-12T22:49:56.490 INFO:tasks.workunit.client.0.smithi066.stdout:5/591: chown d5/d14/f88 766530 1 2024-09-12T22:49:56.491 INFO:tasks.workunit.client.0.smithi066.stdout:3/516: rmdir d0/d2/d7/d92/d9e 39 2024-09-12T22:49:56.494 INFO:tasks.workunit.client.0.smithi066.stdout:5/592: link d5/de/d50/f90 d5/d11/d5d/d97/fab 0 2024-09-12T22:49:56.496 INFO:tasks.workunit.client.0.smithi066.stdout:2/524: dwrite d1/d11/d26/d4f/d5f/d61/d7e/f48 [0,4194304] 0 2024-09-12T22:49:56.496 INFO:tasks.workunit.client.0.smithi066.stdout:5/593: chown d5/d15/f71 65 1 2024-09-12T22:49:56.497 INFO:tasks.workunit.client.0.smithi066.stdout:0/537: getdents d1/d36/d65 0 2024-09-12T22:49:56.499 INFO:tasks.workunit.client.0.smithi066.stdout:7/466: dwrite d0/d19/d26/f47 [0,4194304] 0 2024-09-12T22:49:56.506 INFO:tasks.workunit.client.0.smithi066.stdout:3/517: dwrite d0/f54 [0,4194304] 0 2024-09-12T22:49:56.506 INFO:tasks.workunit.client.0.smithi066.stdout:9/530: dread d9/d31/d34/f37 [0,4194304] 0 2024-09-12T22:49:56.506 INFO:tasks.workunit.client.0.smithi066.stdout:2/525: symlink d1/la3 0 2024-09-12T22:49:56.506 INFO:tasks.workunit.client.0.smithi066.stdout:4/578: dwrite d5/d8/d16/d1b/f28 [0,4194304] 0 2024-09-12T22:49:56.506 INFO:tasks.workunit.client.0.smithi066.stdout:9/531: sync 2024-09-12T22:49:56.506 INFO:tasks.workunit.client.0.smithi066.stdout:7/467: mknod d0/d19/c9a 0 2024-09-12T22:49:56.506 INFO:tasks.workunit.client.0.smithi066.stdout:2/526: unlink d1/dd/l10 0 2024-09-12T22:49:56.507 INFO:tasks.workunit.client.0.smithi066.stdout:3/518: write d0/d2/d7/d29/f3d [2540122,79338] 0 2024-09-12T22:49:56.507 INFO:tasks.workunit.client.0.smithi066.stdout:2/527: truncate d1/f6b 509601 0 2024-09-12T22:49:56.507 INFO:tasks.workunit.client.0.smithi066.stdout:9/532: mknod d9/dc/d36/cad 0 2024-09-12T22:49:56.507 INFO:tasks.workunit.client.0.smithi066.stdout:4/579: creat d5/d8/d16/d1b/d1e/d1f/d8c/fcc x:0 0 0 2024-09-12T22:49:56.507 INFO:tasks.workunit.client.0.smithi066.stdout:5/594: link d5/d11/l86 d5/d11/d23/d6f/daa/lac 0 2024-09-12T22:49:56.508 INFO:tasks.workunit.client.0.smithi066.stdout:3/519: creat d0/d2/d1d/d87/d6b/fbe x:0 0 0 2024-09-12T22:49:56.508 INFO:tasks.workunit.client.0.smithi066.stdout:2/528: mknod d1/dd/d12/ca4 0 2024-09-12T22:49:56.508 INFO:tasks.workunit.client.0.smithi066.stdout:9/533: symlink d9/d31/d34/lae 0 2024-09-12T22:49:56.508 INFO:tasks.workunit.client.0.smithi066.stdout:0/538: dwrite d1/d8/d1b/d59/faf [0,4194304] 0 2024-09-12T22:49:56.508 INFO:tasks.workunit.client.0.smithi066.stdout:3/520: dread - d0/d2/f6e zero size 2024-09-12T22:49:56.509 INFO:tasks.workunit.client.0.smithi066.stdout:5/595: write d5/de/d50/d8b/fa9 [717300,72029] 0 2024-09-12T22:49:56.509 INFO:tasks.workunit.client.0.smithi066.stdout:9/534: write d9/fa [2619063,72758] 0 2024-09-12T22:49:56.510 INFO:tasks.workunit.client.0.smithi066.stdout:2/529: chown d1/d11/d26/d4f/d5f/d61/d7e/l32 28 1 2024-09-12T22:49:56.510 INFO:tasks.workunit.client.0.smithi066.stdout:4/580: truncate d5/d3e/d8d/f53 912033 0 2024-09-12T22:49:56.510 INFO:tasks.workunit.client.0.smithi066.stdout:3/521: symlink d0/lbf 0 2024-09-12T22:49:56.511 INFO:tasks.workunit.client.0.smithi066.stdout:0/539: symlink d1/d8/d1b/d88/lc7 0 2024-09-12T22:49:56.511 INFO:tasks.workunit.client.0.smithi066.stdout:6/581: dread d6/d23/d25/f6f [0,4194304] 0 2024-09-12T22:49:56.511 INFO:tasks.workunit.client.0.smithi066.stdout:9/535: dread - d9/d31/d58/f9b zero size 2024-09-12T22:49:56.512 INFO:tasks.workunit.client.0.smithi066.stdout:4/581: write d5/d8/d16/d1b/d1e/fa3 [237691,121737] 0 2024-09-12T22:49:56.513 INFO:tasks.workunit.client.0.smithi066.stdout:2/530: creat d1/d11/d26/d4f/fa5 x:0 0 0 2024-09-12T22:49:56.513 INFO:tasks.workunit.client.0.smithi066.stdout:8/546: dread d17/d1b/f30 [0,4194304] 0 2024-09-12T22:49:56.514 INFO:tasks.workunit.client.0.smithi066.stdout:0/540: write d1/d8/d1f/d30/f70 [794289,61099] 0 2024-09-12T22:49:56.515 INFO:tasks.workunit.client.0.smithi066.stdout:6/582: mkdir d6/d7/dcd 0 2024-09-12T22:49:56.515 INFO:tasks.workunit.client.0.smithi066.stdout:9/536: write d9/dc/d46/d8a/f97 [121010,38201] 0 2024-09-12T22:49:56.517 INFO:tasks.workunit.client.0.smithi066.stdout:5/596: dread d5/d11/d21/d4d/f7a [0,4194304] 0 2024-09-12T22:49:56.517 INFO:tasks.workunit.client.0.smithi066.stdout:0/541: creat d1/d5b/d6d/fc8 x:0 0 0 2024-09-12T22:49:56.517 INFO:tasks.workunit.client.0.smithi066.stdout:4/582: creat d5/d8/d16/d1b/fcd x:0 0 0 2024-09-12T22:49:56.518 INFO:tasks.workunit.client.0.smithi066.stdout:9/537: creat d9/d31/d34/d4d/faf x:0 0 0 2024-09-12T22:49:56.518 INFO:tasks.workunit.client.0.smithi066.stdout:6/583: write d6/d23/d25/d2c/d69/f83 [4719475,82327] 0 2024-09-12T22:49:56.518 INFO:tasks.workunit.client.0.smithi066.stdout:0/542: chown d1/d8/d1f/d30/c53 1 1 2024-09-12T22:49:56.519 INFO:tasks.workunit.client.0.smithi066.stdout:3/522: dwrite d0/d2/d7/f1a [0,4194304] 0 2024-09-12T22:49:56.520 INFO:tasks.workunit.client.0.smithi066.stdout:5/597: creat d5/d11/d5d/d8a/fad x:0 0 0 2024-09-12T22:49:56.521 INFO:tasks.workunit.client.0.smithi066.stdout:0/543: chown d1/d8/d1c/fa9 509948 1 2024-09-12T22:49:56.521 INFO:tasks.workunit.client.0.smithi066.stdout:6/584: unlink d6/d23/d25/d2c/l89 0 2024-09-12T22:49:56.521 INFO:tasks.workunit.client.0.smithi066.stdout:6/585: sync 2024-09-12T22:49:56.521 INFO:tasks.workunit.client.0.smithi066.stdout:3/523: chown d0/d2/d7/d13/d31/l64 653 1 2024-09-12T22:49:56.521 INFO:tasks.workunit.client.0.smithi066.stdout:4/583: getdents d5/d8/d16/d93/d9c/d98 0 2024-09-12T22:49:56.522 INFO:tasks.workunit.client.0.smithi066.stdout:8/547: dread d17/d49/d4b/d4e/f96 [0,4194304] 0 2024-09-12T22:49:56.523 INFO:tasks.workunit.client.0.smithi066.stdout:5/598: truncate d5/d11/d21/d4d/f6d 1326356 0 2024-09-12T22:49:56.523 INFO:tasks.workunit.client.0.smithi066.stdout:3/524: readlink d0/d2/d1d/d87/d40/da2/la9 0 2024-09-12T22:49:56.523 INFO:tasks.workunit.client.0.smithi066.stdout:8/548: mkdir d17/d40/d74/da3/dac/db4 0 2024-09-12T22:49:56.524 INFO:tasks.workunit.client.0.smithi066.stdout:4/584: write d5/d8/d16/d1b/d1e/d1f/fb1 [921785,124612] 0 2024-09-12T22:49:56.525 INFO:tasks.workunit.client.0.smithi066.stdout:5/599: rename d5/de/d50/c39 to d5/d11/d5d/cae 0 2024-09-12T22:49:56.525 INFO:tasks.workunit.client.0.smithi066.stdout:8/549: mkdir d17/d49/d4b/db5 0 2024-09-12T22:49:56.527 INFO:tasks.workunit.client.0.smithi066.stdout:5/600: creat d5/d11/d21/faf x:0 0 0 2024-09-12T22:49:56.527 INFO:tasks.workunit.client.0.smithi066.stdout:8/550: dread - d17/d40/d47/d66/f6e zero size 2024-09-12T22:49:56.527 INFO:tasks.workunit.client.0.smithi066.stdout:1/445: dread d0/d36/d57/f2b [0,4194304] 0 2024-09-12T22:49:56.529 INFO:tasks.workunit.client.0.smithi066.stdout:5/601: creat d5/d11/d21/fb0 x:0 0 0 2024-09-12T22:49:56.529 INFO:tasks.workunit.client.0.smithi066.stdout:1/446: fsync d0/d9/f6a 0 2024-09-12T22:49:56.530 INFO:tasks.workunit.client.0.smithi066.stdout:3/525: dwrite d0/d2/d1d/d87/f70 [0,4194304] 0 2024-09-12T22:49:56.530 INFO:tasks.workunit.client.0.smithi066.stdout:5/602: chown d5/d11/d21/c31 158124747 1 2024-09-12T22:49:56.531 INFO:tasks.workunit.client.0.smithi066.stdout:4/585: dwrite d5/d8/d16/d1b/d1e/d1f/fa9 [0,4194304] 0 2024-09-12T22:49:56.531 INFO:tasks.workunit.client.0.smithi066.stdout:3/526: chown d0/d2/d7/f66 0 1 2024-09-12T22:49:56.534 INFO:tasks.workunit.client.0.smithi066.stdout:1/447: unlink d0/d4e/f63 0 2024-09-12T22:49:56.534 INFO:tasks.workunit.client.0.smithi066.stdout:8/551: link d17/d40/d74/d99/l9a d17/d2c/lb6 0 2024-09-12T22:49:56.534 INFO:tasks.workunit.client.0.smithi066.stdout:4/586: rename d5/d8/d16/d1b/d1e/d38 to d5/d3e/d8d/dce 0 2024-09-12T22:49:56.536 INFO:tasks.workunit.client.0.smithi066.stdout:7/468: dread d0/d19/d24/d33/f34 [0,4194304] 0 2024-09-12T22:49:56.536 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:56.535+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:56.536 INFO:tasks.workunit.client.0.smithi066.stdout:8/552: dread - d17/d49/d4b/f68 zero size 2024-09-12T22:49:56.537 INFO:tasks.workunit.client.0.smithi066.stdout:1/448: symlink d0/d9/l85 0 2024-09-12T22:49:56.538 INFO:tasks.workunit.client.0.smithi066.stdout:6/586: dread d6/d23/d25/f2e [0,4194304] 0 2024-09-12T22:49:56.538 INFO:tasks.workunit.client.0.smithi066.stdout:7/469: symlink d0/d19/d26/d5a/l9b 0 2024-09-12T22:49:56.538 INFO:tasks.workunit.client.0.smithi066.stdout:4/587: write d5/d8/d16/d1b/d72/f74 [859236,38090] 0 2024-09-12T22:49:56.539 INFO:tasks.workunit.client.0.smithi066.stdout:1/449: chown d0/dc/l5d 502746754 1 2024-09-12T22:49:56.540 INFO:tasks.workunit.client.0.smithi066.stdout:3/527: read d0/d2/d7/f4b [2296584,33192] 0 2024-09-12T22:49:56.540 INFO:tasks.workunit.client.0.smithi066.stdout:5/603: dwrite d5/d11/d21/faf [0,4194304] 0 2024-09-12T22:49:56.540 INFO:tasks.workunit.client.0.smithi066.stdout:9/538: dwrite d9/dc/d36/f63 [0,4194304] 0 2024-09-12T22:49:56.542 INFO:tasks.workunit.client.0.smithi066.stdout:7/470: write d0/d19/d26/d48/f71 [49337,98006] 0 2024-09-12T22:49:56.542 INFO:tasks.workunit.client.0.smithi066.stdout:8/553: creat d17/d49/d4b/db5/fb7 x:0 0 0 2024-09-12T22:49:56.542 INFO:tasks.workunit.client.0.smithi066.stdout:0/544: dwrite d1/d8/f35 [0,4194304] 0 2024-09-12T22:49:56.543 INFO:tasks.workunit.client.0.smithi066.stdout:1/450: truncate d0/d9/f43 1277195 0 2024-09-12T22:49:56.543 INFO:tasks.workunit.client.0.smithi066.stdout:5/604: chown d5/d11/d23/f2f 8068998 1 2024-09-12T22:49:56.543 INFO:tasks.workunit.client.0.smithi066.stdout:9/539: mkdir d9/d31/db0 0 2024-09-12T22:49:56.544 INFO:tasks.workunit.client.0.smithi066.stdout:7/471: unlink d0/d6/f2e 0 2024-09-12T22:49:56.544 INFO:tasks.workunit.client.0.smithi066.stdout:3/528: symlink d0/d2/d1d/d87/d40/d44/lc0 0 2024-09-12T22:49:56.544 INFO:tasks.workunit.client.0.smithi066.stdout:9/540: fsync d9/fa 0 2024-09-12T22:49:56.545 INFO:tasks.workunit.client.0.smithi066.stdout:1/451: mkdir d0/d4e/d79/d86 0 2024-09-12T22:49:56.546 INFO:tasks.workunit.client.0.smithi066.stdout:5/605: creat d5/de/d57/fb1 x:0 0 0 2024-09-12T22:49:56.546 INFO:tasks.workunit.client.0.smithi066.stdout:5/606: sync 2024-09-12T22:49:56.546 INFO:tasks.workunit.client.0.smithi066.stdout:4/588: truncate d5/d8/d16/d1b/d1e/d1f/f7a 1577972 0 2024-09-12T22:49:56.547 INFO:tasks.workunit.client.0.smithi066.stdout:3/529: dread - d0/d2/d7/d92/fb6 zero size 2024-09-12T22:49:56.547 INFO:tasks.workunit.client.0.smithi066.stdout:1/452: symlink d0/dc/d44/l87 0 2024-09-12T22:49:56.549 INFO:tasks.workunit.client.0.smithi066.stdout:6/587: dwrite d6/d23/d25/f2e [0,4194304] 0 2024-09-12T22:49:56.554 INFO:tasks.workunit.client.0.smithi066.stdout:8/554: dwrite d17/f70 [0,4194304] 0 2024-09-12T22:49:56.556 INFO:tasks.workunit.client.0.smithi066.stdout:0/545: dwrite d1/d36/f8b [0,4194304] 0 2024-09-12T22:49:56.556 INFO:tasks.workunit.client.0.smithi066.stdout:4/589: rmdir d5/d8/d10/de/d2d/dbe 0 2024-09-12T22:49:56.556 INFO:tasks.workunit.client.0.smithi066.stdout:6/588: truncate d6/d7/f39 4301375 0 2024-09-12T22:49:56.557 INFO:tasks.workunit.client.0.smithi066.stdout:8/555: fdatasync d17/d49/f8d 0 2024-09-12T22:49:56.557 INFO:tasks.workunit.client.0.smithi066.stdout:9/541: dwrite d9/dc/dd/f1b [4194304,4194304] 0 2024-09-12T22:49:56.557 INFO:tasks.workunit.client.0.smithi066.stdout:8/556: mknod d17/cb8 0 2024-09-12T22:49:56.558 INFO:tasks.workunit.client.0.smithi066.stdout:6/589: chown d6/d23/d25/f8f 1297389302 1 2024-09-12T22:49:56.558 INFO:tasks.workunit.client.0.smithi066.stdout:0/546: creat d1/d8/d1b/d88/fc9 x:0 0 0 2024-09-12T22:49:56.559 INFO:tasks.workunit.client.0.smithi066.stdout:6/590: fsync d6/d23/d25/f7b 0 2024-09-12T22:49:56.561 INFO:tasks.workunit.client.0.smithi066.stdout:3/530: dwrite d0/d2/d1d/d87/d40/f48 [0,4194304] 0 2024-09-12T22:49:56.561 INFO:tasks.workunit.client.0.smithi066.stdout:9/542: mkdir d9/d31/d58/db1 0 2024-09-12T22:49:56.562 INFO:tasks.workunit.client.0.smithi066.stdout:6/591: chown d6/d23/f29 8696 1 2024-09-12T22:49:56.562 INFO:tasks.workunit.client.0.smithi066.stdout:9/543: dread - d9/dc/f6a zero size 2024-09-12T22:49:56.564 INFO:tasks.workunit.client.0.smithi066.stdout:8/557: creat d17/d49/d4b/d57/fb9 x:0 0 0 2024-09-12T22:49:56.564 INFO:tasks.workunit.client.0.smithi066.stdout:6/592: dread - d6/d35/fb0 zero size 2024-09-12T22:49:56.564 INFO:tasks.workunit.client.0.smithi066.stdout:3/531: getdents d0/db3/db7 0 2024-09-12T22:49:56.564 INFO:tasks.workunit.client.0.smithi066.stdout:8/558: write d17/d40/d47/f8e [5113392,1960] 0 2024-09-12T22:49:56.564 INFO:tasks.workunit.client.0.smithi066.stdout:8/559: symlink d17/d49/d4b/d57/d5e/lba 0 2024-09-12T22:49:56.564 INFO:tasks.workunit.client.0.smithi066.stdout:3/532: write d0/d2/d1d/d87/d40/dbd/d74/f76 [80277,33103] 0 2024-09-12T22:49:56.565 INFO:tasks.workunit.client.0.smithi066.stdout:3/533: mkdir d0/d2/d7/d13/dc1 0 2024-09-12T22:49:56.567 INFO:tasks.workunit.client.0.smithi066.stdout:8/560: mkdir d17/d40/d74/da3/dac/dbb 0 2024-09-12T22:49:56.568 INFO:tasks.workunit.client.0.smithi066.stdout:3/534: chown d0/d2/d7/d29/daf/fa3 8319800 1 2024-09-12T22:49:56.568 INFO:tasks.workunit.client.0.smithi066.stdout:6/593: dwrite d6/f2a [4194304,4194304] 0 2024-09-12T22:49:56.568 INFO:tasks.workunit.client.0.smithi066.stdout:3/535: read d0/d2/d1d/d87/f70 [1936790,109255] 0 2024-09-12T22:49:56.569 INFO:tasks.workunit.client.0.smithi066.stdout:3/536: unlink d0/ca7 0 2024-09-12T22:49:56.569 INFO:tasks.workunit.client.0.smithi066.stdout:6/594: fsync d6/d23/d62/d79/fa9 0 2024-09-12T22:49:56.571 INFO:tasks.workunit.client.0.smithi066.stdout:6/595: mkdir d6/d23/d25/d4e/dc4/d32/dce 0 2024-09-12T22:49:56.571 INFO:tasks.workunit.client.0.smithi066.stdout:2/531: dread d1/dd/d12/d18/f3e [0,4194304] 0 2024-09-12T22:49:56.572 INFO:tasks.workunit.client.0.smithi066.stdout:2/532: chown d1/db/l58 52696289 1 2024-09-12T22:49:56.572 INFO:tasks.workunit.client.0.smithi066.stdout:6/596: read - d6/d49/f9e zero size 2024-09-12T22:49:56.573 INFO:tasks.workunit.client.0.smithi066.stdout:2/533: getdents d1/db/d42/d43/d47 0 2024-09-12T22:49:56.574 INFO:tasks.workunit.client.0.smithi066.stdout:9/544: read d9/dc/f60 [3994140,5538] 0 2024-09-12T22:49:56.574 INFO:tasks.workunit.client.0.smithi066.stdout:4/590: truncate d5/d8/d16/d1b/d73/f92 3425752 0 2024-09-12T22:49:56.575 INFO:tasks.workunit.client.0.smithi066.stdout:2/534: write d1/db/d42/d43/d47/d76/f95 [421477,13872] 0 2024-09-12T22:49:56.575 INFO:tasks.workunit.client.0.smithi066.stdout:9/545: write d9/dc/d23/fac [533098,48403] 0 2024-09-12T22:49:56.576 INFO:tasks.workunit.client.0.smithi066.stdout:8/561: truncate d17/d2c/f7c 770315 0 2024-09-12T22:49:56.578 INFO:tasks.workunit.client.0.smithi066.stdout:9/546: link d9/d31/d34/lae d9/d31/lb2 0 2024-09-12T22:49:56.578 INFO:tasks.workunit.client.0.smithi066.stdout:6/597: dwrite d6/d23/d25/f6f [0,4194304] 0 2024-09-12T22:49:56.580 INFO:tasks.workunit.client.0.smithi066.stdout:8/562: creat d17/d49/d4b/d57/d5e/d62/fbc x:0 0 0 2024-09-12T22:49:56.580 INFO:tasks.workunit.client.0.smithi066.stdout:9/547: link d9/dc/d23/f83 d9/d31/d77/d8f/fb3 0 2024-09-12T22:49:56.583 INFO:tasks.workunit.client.0.smithi066.stdout:3/537: write d0/d2/d1d/fa8 [140002,9873] 0 2024-09-12T22:49:56.584 INFO:tasks.workunit.client.0.smithi066.stdout:8/563: dread d17/d40/d47/d4d/f93 [0,4194304] 0 2024-09-12T22:49:56.586 INFO:tasks.workunit.client.0.smithi066.stdout:9/548: dwrite d9/d31/f72 [0,4194304] 0 2024-09-12T22:49:56.587 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:56.587 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:56.587 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:49:56.588 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:49:56.588 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:56.588 INFO:tasks.workunit.client.0.smithi066.stdout:0/547: dread d1/d8/d1f/d25/f34 [4194304,4194304] 0 2024-09-12T22:49:56.588 INFO:tasks.workunit.client.0.smithi066.stdout:8/564: rename d17/d49/d4b/f68 to d17/d49/d4b/d4e/fbd 0 2024-09-12T22:49:56.589 INFO:tasks.workunit.client.0.smithi066.stdout:9/549: rename d9/dc/dd/f11 to d9/d31/d58/da4/fb4 0 2024-09-12T22:49:56.590 INFO:tasks.workunit.client.0.smithi066.stdout:0/548: creat d1/d8/d1c/d56/fca x:0 0 0 2024-09-12T22:49:56.590 INFO:tasks.workunit.client.0.smithi066.stdout:8/565: symlink d17/d40/d74/da3/dac/dbb/lbe 0 2024-09-12T22:49:56.590 INFO:tasks.workunit.client.0.smithi066.stdout:3/538: dwrite d0/d2/d7/d13/f39 [0,4194304] 0 2024-09-12T22:49:56.591 INFO:tasks.workunit.client.0.smithi066.stdout:0/549: write d1/d8/d1c/dd/f29 [1633359,85361] 0 2024-09-12T22:49:56.592 INFO:tasks.workunit.client.0.smithi066.stdout:4/591: dwrite d5/d8/d16/d93/d9c/d98/dab/fc5 [0,4194304] 0 2024-09-12T22:49:56.592 INFO:tasks.workunit.client.0.smithi066.stdout:3/539: read d0/d2/d7/f5e [674008,2366] 0 2024-09-12T22:49:56.593 INFO:tasks.workunit.client.0.smithi066.stdout:3/540: sync 2024-09-12T22:49:56.593 INFO:tasks.workunit.client.0.smithi066.stdout:9/550: rename d9/d31/d77/c94 to d9/d31/d77/d8f/cb5 0 2024-09-12T22:49:56.593 INFO:tasks.workunit.client.0.smithi066.stdout:1/453: dread d0/d4e/f58 [0,4194304] 0 2024-09-12T22:49:56.593 INFO:tasks.workunit.client.0.smithi066.stdout:0/550: chown d1/d8/d1c/d56/db7 43922 1 2024-09-12T22:49:56.594 INFO:tasks.workunit.client.0.smithi066.stdout:9/551: unlink d9/dc/dd/f42 0 2024-09-12T22:49:56.594 INFO:tasks.workunit.client.0.smithi066.stdout:0/551: stat d1/d8/f81 0 2024-09-12T22:49:56.595 INFO:tasks.workunit.client.0.smithi066.stdout:4/592: rename d5/d3e/c42 to d5/d8/d10/ccf 0 2024-09-12T22:49:56.595 INFO:tasks.workunit.client.0.smithi066.stdout:0/552: fdatasync d1/d36/d65/fb6 0 2024-09-12T22:49:56.595 INFO:tasks.workunit.client.0.smithi066.stdout:1/454: creat d0/d4e/d79/d86/f88 x:0 0 0 2024-09-12T22:49:56.596 INFO:tasks.workunit.client.0.smithi066.stdout:2/535: truncate d1/d11/d57/f82 208467 0 2024-09-12T22:49:56.596 INFO:tasks.workunit.client.0.smithi066.stdout:9/552: rename d9/dc/da5 to d9/dc/d4e/db6 0 2024-09-12T22:49:56.597 INFO:tasks.workunit.client.0.smithi066.stdout:4/593: chown d5/d8/d10/de/f18 228963 1 2024-09-12T22:49:56.597 INFO:tasks.workunit.client.0.smithi066.stdout:0/553: chown d1/d8/d1c/d13/d2f/l8d 271265062 1 2024-09-12T22:49:56.598 INFO:tasks.workunit.client.0.smithi066.stdout:7/472: dread d0/d19/d60/f8d [0,4194304] 0 2024-09-12T22:49:56.599 INFO:tasks.workunit.client.0.smithi066.stdout:9/553: mknod d9/d31/d58/da4/cb7 0 2024-09-12T22:49:56.599 INFO:tasks.workunit.client.0.smithi066.stdout:2/536: chown d1/dd/d12/d1e/c9e 739 1 2024-09-12T22:49:56.599 INFO:tasks.workunit.client.0.smithi066.stdout:8/566: dwrite d17/d49/d4b/d57/d5e/d62/f83 [0,4194304] 0 2024-09-12T22:49:56.600 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:56.600 INFO:tasks.workunit.client.0.smithi066.stdout:7/473: dread - d0/d19/d24/d33/f5b zero size 2024-09-12T22:49:56.601 INFO:tasks.workunit.client.0.smithi066.stdout:0/554: write d1/d8/d1f/d25/f71 [2989033,95164] 0 2024-09-12T22:49:56.603 INFO:tasks.workunit.client.0.smithi066.stdout:0/555: creat d1/d36/fcb x:0 0 0 2024-09-12T22:49:56.603 INFO:tasks.workunit.client.0.smithi066.stdout:4/594: truncate d5/d8/d16/d1b/d1e/d5a/f85 4302977 0 2024-09-12T22:49:56.604 INFO:tasks.workunit.client.0.smithi066.stdout:7/474: write d0/d19/d60/d85/d8b/f98 [1039807,121446] 0 2024-09-12T22:49:56.605 INFO:tasks.workunit.client.0.smithi066.stdout:9/554: dread d9/dc/dd/f54 [0,4194304] 0 2024-09-12T22:49:56.605 INFO:tasks.workunit.client.0.smithi066.stdout:1/455: dwrite d0/d36/d57/f2b [4194304,4194304] 0 2024-09-12T22:49:56.605 INFO:tasks.workunit.client.0.smithi066.stdout:0/556: write d1/d36/fb0 [612002,21597] 0 2024-09-12T22:49:56.606 INFO:tasks.workunit.client.0.smithi066.stdout:0/557: dread - d1/d36/d65/f9f zero size 2024-09-12T22:49:56.608 INFO:tasks.workunit.client.0.smithi066.stdout:4/595: symlink d5/d8/d16/d93/ld0 0 2024-09-12T22:49:56.608 INFO:tasks.workunit.client.0.smithi066.stdout:2/537: dwrite d1/db/f5d [4194304,4194304] 0 2024-09-12T22:49:56.608 INFO:tasks.workunit.client.0.smithi066.stdout:2/538: sync 2024-09-12T22:49:56.608 INFO:tasks.workunit.client.0.smithi066.stdout:7/475: fdatasync d0/d19/d24/f16 0 2024-09-12T22:49:56.608 INFO:tasks.workunit.client.0.smithi066.stdout:8/567: dwrite d17/d40/d47/d4d/d87/fa9 [0,4194304] 0 2024-09-12T22:49:56.610 INFO:tasks.workunit.client.0.smithi066.stdout:1/456: truncate d0/d9/f14 1193018 0 2024-09-12T22:49:56.610 INFO:tasks.workunit.client.0.smithi066.stdout:7/476: creat d0/d19/d60/d85/d8b/f9c x:0 0 0 2024-09-12T22:49:56.612 INFO:tasks.workunit.client.0.smithi066.stdout:1/457: readlink d0/dc/d1d/l65 0 2024-09-12T22:49:56.617 INFO:tasks.workunit.client.0.smithi066.stdout:8/568: dwrite d17/d2c/f35 [0,4194304] 0 2024-09-12T22:49:56.617 INFO:tasks.workunit.client.0.smithi066.stdout:0/558: dwrite d1/d5b/d6d/fc8 [0,4194304] 0 2024-09-12T22:49:56.618 INFO:tasks.workunit.client.0.smithi066.stdout:4/596: dwrite d5/d3e/d8d/dc7/fc9 [0,4194304] 0 2024-09-12T22:49:56.620 INFO:tasks.workunit.client.0.smithi066.stdout:8/569: write d17/d49/d4b/d4e/fbd [991149,84625] 0 2024-09-12T22:49:56.622 INFO:tasks.workunit.client.0.smithi066.stdout:5/607: dread f3 [4194304,4194304] 0 2024-09-12T22:49:56.622 INFO:tasks.workunit.client.0.smithi066.stdout:1/458: dwrite d0/f7d [0,4194304] 0 2024-09-12T22:49:56.622 INFO:tasks.workunit.client.0.smithi066.stdout:8/570: mknod d17/d1b/cbf 0 2024-09-12T22:49:56.624 INFO:tasks.workunit.client.0.smithi066.stdout:5/608: symlink d5/de/d50/da0/lb2 0 2024-09-12T22:49:56.624 INFO:tasks.workunit.client.0.smithi066.stdout:4/597: dread d5/d3e/d8d/dc7/fc9 [0,4194304] 0 2024-09-12T22:49:56.625 INFO:tasks.workunit.client.0.smithi066.stdout:5/609: chown d5/d11/d23/f2f 102535 1 2024-09-12T22:49:56.625 INFO:tasks.workunit.client.0.smithi066.stdout:4/598: fdatasync d5/d8/d16/d1b/f28 0 2024-09-12T22:49:56.625 INFO:tasks.workunit.client.0.smithi066.stdout:8/571: rename d17/d40/d47/d4d/d87/f89 to d17/d40/d74/da3/dac/dbb/fc0 0 2024-09-12T22:49:56.626 INFO:tasks.workunit.client.0.smithi066.stdout:5/610: chown d5/d11/d21/f7f 5252943 1 2024-09-12T22:49:56.627 INFO:tasks.workunit.client.0.smithi066.stdout:4/599: fdatasync d5/d8/d16/d1b/d1e/f59 0 2024-09-12T22:49:56.627 INFO:tasks.workunit.client.0.smithi066.stdout:4/600: fdatasync d5/d3e/d65/dac/fcb 0 2024-09-12T22:49:56.628 INFO:tasks.workunit.client.0.smithi066.stdout:1/459: dwrite d0/d9/f43 [0,4194304] 0 2024-09-12T22:49:56.629 INFO:tasks.workunit.client.0.smithi066.stdout:1/460: chown d0/d9/c20 45135 1 2024-09-12T22:49:56.630 INFO:tasks.workunit.client.0.smithi066.stdout:5/611: rename d5/de/d57/ca7 to d5/de/d50/d42/d9d/cb3 0 2024-09-12T22:49:56.630 INFO:tasks.workunit.client.0.smithi066.stdout:1/461: mkdir d0/d89 0 2024-09-12T22:49:56.631 INFO:tasks.workunit.client.0.smithi066.stdout:4/601: symlink d5/d8/d10/de/d39/ld1 0 2024-09-12T22:49:56.631 INFO:tasks.workunit.client.0.smithi066.stdout:5/612: read - d5/d11/d23/fa2 zero size 2024-09-12T22:49:56.635 INFO:tasks.workunit.client.0.smithi066.stdout:9/555: dwrite d9/dc/fe [0,4194304] 0 2024-09-12T22:49:56.636 INFO:tasks.workunit.client.0.smithi066.stdout:6/598: dread d6/d23/d25/d4e/dc4/f18 [0,4194304] 0 2024-09-12T22:49:56.637 INFO:tasks.workunit.client.0.smithi066.stdout:9/556: fsync d9/dc/d36/f71 0 2024-09-12T22:49:56.637 INFO:tasks.workunit.client.0.smithi066.stdout:4/602: creat d5/d8/d16/d1b/d1e/d5a/fd2 x:0 0 0 2024-09-12T22:49:56.637 INFO:tasks.workunit.client.0.smithi066.stdout:8/572: dwrite d17/d49/d4b/d57/d5e/d62/f67 [0,4194304] 0 2024-09-12T22:49:56.638 INFO:tasks.workunit.client.0.smithi066.stdout:6/599: getdents d6/d23/d25/d4e/dc4/d32 0 2024-09-12T22:49:56.638 INFO:tasks.workunit.client.0.smithi066.stdout:4/603: unlink d5/d8/d16/c7e 0 2024-09-12T22:49:56.640 INFO:tasks.workunit.client.0.smithi066.stdout:4/604: link d5/d8/d16/d1b/c57 d5/d8/d10/de/d2d/d64/cd3 0 2024-09-12T22:49:56.641 INFO:tasks.workunit.client.0.smithi066.stdout:4/605: stat d5/d8/d10/de/fbf 0 2024-09-12T22:49:56.642 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:56.641+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:56.642 INFO:tasks.workunit.client.0.smithi066.stdout:4/606: mknod d5/d8/d10/de/d39/dc6/cd4 0 2024-09-12T22:49:56.642 INFO:tasks.workunit.client.0.smithi066.stdout:5/613: read d5/d15/f17 [8143514,79174] 0 2024-09-12T22:49:56.643 INFO:tasks.workunit.client.0.smithi066.stdout:2/539: dread d1/d11/d57/f82 [0,4194304] 0 2024-09-12T22:49:56.644 INFO:tasks.workunit.client.0.smithi066.stdout:2/540: stat d1/db 0 2024-09-12T22:49:56.644 INFO:tasks.workunit.client.0.smithi066.stdout:4/607: write d5/d3e/d65/f8f [3923263,64132] 0 2024-09-12T22:49:56.644 INFO:tasks.workunit.client.0.smithi066.stdout:5/614: readlink d5/d11/d21/d4d/l53 0 2024-09-12T22:49:56.644 INFO:tasks.workunit.client.0.smithi066.stdout:0/559: truncate d1/d8/d1f/d25/f34 4849909 0 2024-09-12T22:49:56.644 INFO:tasks.workunit.client.0.smithi066.stdout:6/600: dread d6/d23/d25/d4e/dc4/d32/f68 [0,4194304] 0 2024-09-12T22:49:56.644 INFO:tasks.workunit.client.0.smithi066.stdout:2/541: fdatasync d1/d11/d53/f7f 0 2024-09-12T22:49:56.645 INFO:tasks.workunit.client.0.smithi066.stdout:4/608: chown d5/d8/d10/de/d2d/fc1 847 1 2024-09-12T22:49:56.646 INFO:tasks.workunit.client.0.smithi066.stdout:5/615: mknod d5/d14/cb4 0 2024-09-12T22:49:56.646 INFO:tasks.workunit.client.0.smithi066.stdout:2/542: mkdir d1/d11/d26/d4f/d7c/da6 0 2024-09-12T22:49:56.647 INFO:tasks.workunit.client.0.smithi066.stdout:5/616: chown d5/d15/l5e 13093293 1 2024-09-12T22:49:56.648 INFO:tasks.workunit.client.0.smithi066.stdout:2/543: mknod d1/d11/d26/d4f/d5f/d61/ca7 0 2024-09-12T22:49:56.649 INFO:tasks.workunit.client.0.smithi066.stdout:5/617: truncate d5/d11/d23/fa2 797742 0 2024-09-12T22:49:56.649 INFO:tasks.workunit.client.0.smithi066.stdout:6/601: dread d6/f2a [4194304,4194304] 0 2024-09-12T22:49:56.649 INFO:tasks.workunit.client.0.smithi066.stdout:0/560: dwrite d1/d8/d1b/f24 [0,4194304] 0 2024-09-12T22:49:56.650 INFO:tasks.workunit.client.0.smithi066.stdout:5/618: truncate d5/d11/f66 757597 0 2024-09-12T22:49:56.652 INFO:tasks.workunit.client.0.smithi066.stdout:6/602: getdents d6/d23/d41/db6 0 2024-09-12T22:49:56.652 INFO:tasks.workunit.client.0.smithi066.stdout:6/603: sync 2024-09-12T22:49:56.652 INFO:tasks.workunit.client.0.smithi066.stdout:5/619: rename d5/d11/f1d to d5/d11/d21/fb5 0 2024-09-12T22:49:56.653 INFO:tasks.workunit.client.0.smithi066.stdout:6/604: getdents d6/d7/dcd 0 2024-09-12T22:49:56.653 INFO:tasks.workunit.client.0.smithi066.stdout:7/477: dread d0/d19/d26/d48/d59/f7b [0,4194304] 0 2024-09-12T22:49:56.654 INFO:tasks.workunit.client.0.smithi066.stdout:6/605: symlink d6/d23/d25/d4e/dc4/d32/lcf 0 2024-09-12T22:49:56.657 INFO:tasks.workunit.client.0.smithi066.stdout:5/620: dwrite d5/de/d50/d8b/fa9 [0,4194304] 0 2024-09-12T22:49:56.660 INFO:tasks.workunit.client.0.smithi066.stdout:5/621: getdents d5/d11/d5d/d97 0 2024-09-12T22:49:56.661 INFO:tasks.workunit.client.0.smithi066.stdout:3/541: dread d0/d2/fa [0,4194304] 0 2024-09-12T22:49:56.662 INFO:tasks.workunit.client.0.smithi066.stdout:5/622: creat d5/d11/d5d/fb6 x:0 0 0 2024-09-12T22:49:56.663 INFO:tasks.workunit.client.0.smithi066.stdout:3/542: rename d0/d2/f98 to d0/d2/d1d/fc2 0 2024-09-12T22:49:56.663 INFO:tasks.workunit.client.0.smithi066.stdout:5/623: chown d5/de/d50/d8b/fa9 1612 1 2024-09-12T22:49:56.663 INFO:tasks.workunit.client.0.smithi066.stdout:3/543: readlink d0/d2/d7/d29/daf/lb4 0 2024-09-12T22:49:56.664 INFO:tasks.workunit.client.0.smithi066.stdout:2/544: dread d1/dd/d12/d1e/f35 [0,4194304] 0 2024-09-12T22:49:56.664 INFO:tasks.workunit.client.0.smithi066.stdout:8/573: dread f15 [0,4194304] 0 2024-09-12T22:49:56.664 INFO:tasks.workunit.client.0.smithi066.stdout:4/609: fsync d5/d3e/d65/f8f 0 2024-09-12T22:49:56.664 INFO:tasks.workunit.client.0.smithi066.stdout:9/557: dread d9/dc/d4e/f74 [0,4194304] 0 2024-09-12T22:49:56.665 INFO:tasks.workunit.client.0.smithi066.stdout:6/606: truncate d6/d23/d25/d2c/d69/f83 4329063 0 2024-09-12T22:49:56.665 INFO:tasks.workunit.client.0.smithi066.stdout:4/610: readlink d5/d8/d10/lbd 0 2024-09-12T22:49:56.666 INFO:tasks.workunit.client.0.smithi066.stdout:9/558: write d9/d31/d34/f37 [4212024,35319] 0 2024-09-12T22:49:56.667 INFO:tasks.workunit.client.0.smithi066.stdout:5/624: rename d5/d15/l84 to d5/d11/d5d/d64/d8f/lb7 0 2024-09-12T22:49:56.668 INFO:tasks.workunit.client.0.smithi066.stdout:9/559: rmdir d9 39 2024-09-12T22:49:56.668 INFO:tasks.workunit.client.0.smithi066.stdout:4/611: symlink d5/d8/d16/d1b/d73/ld5 0 2024-09-12T22:49:56.668 INFO:tasks.workunit.client.0.smithi066.stdout:6/607: rename d6/d7/dc/c1c to d6/d23/d25/d4e/dc4/d50/cd0 0 2024-09-12T22:49:56.669 INFO:tasks.workunit.client.0.smithi066.stdout:5/625: getdents d5/d14 0 2024-09-12T22:49:56.670 INFO:tasks.workunit.client.0.smithi066.stdout:3/544: fsync d0/d2/d1d/fc2 0 2024-09-12T22:49:56.670 INFO:tasks.workunit.client.0.smithi066.stdout:4/612: creat d5/d8/d16/d93/d9c/d98/d8b/fd6 x:0 0 0 2024-09-12T22:49:56.671 INFO:tasks.workunit.client.0.smithi066.stdout:6/608: getdents d6/d7/dc1 0 2024-09-12T22:49:56.671 INFO:tasks.workunit.client.0.smithi066.stdout:5/626: mknod d5/d11/d21/d78/cb8 0 2024-09-12T22:49:56.672 INFO:tasks.workunit.client.0.smithi066.stdout:0/561: dwrite d1/d8/d1c/d13/f22 [4194304,4194304] 0 2024-09-12T22:49:56.672 INFO:tasks.workunit.client.0.smithi066.stdout:9/560: getdents d9/dc/d46 0 2024-09-12T22:49:56.674 INFO:tasks.workunit.client.0.smithi066.stdout:4/613: write d5/d8/f78 [1339248,77211] 0 2024-09-12T22:49:56.675 INFO:tasks.workunit.client.0.smithi066.stdout:5/627: write d5/d11/d21/faf [2894753,14164] 0 2024-09-12T22:49:56.675 INFO:tasks.workunit.client.0.smithi066.stdout:0/562: creat d1/d8/d1b/d88/fcc x:0 0 0 2024-09-12T22:49:56.676 INFO:tasks.workunit.client.0.smithi066.stdout:9/561: chown d9/dc/l99 9735 1 2024-09-12T22:49:56.678 INFO:tasks.workunit.client.0.smithi066.stdout:5/628: chown d5/d15/l5e 0 1 2024-09-12T22:49:56.678 INFO:tasks.workunit.client.0.smithi066.stdout:9/562: chown d9/dc/f56 2700635 1 2024-09-12T22:49:56.679 INFO:tasks.workunit.client.0.smithi066.stdout:4/614: write d5/d8/d16/d1b/f28 [2261257,46867] 0 2024-09-12T22:49:56.679 INFO:tasks.workunit.client.0.smithi066.stdout:0/563: link d1/dbf/fc4 d1/d36/d65/dc2/fcd 0 2024-09-12T22:49:56.680 INFO:tasks.workunit.client.0.smithi066.stdout:3/545: dwrite d0/d2/d7/d92/faa [0,4194304] 0 2024-09-12T22:49:56.681 INFO:tasks.workunit.client.0.smithi066.stdout:4/615: fdatasync f1 0 2024-09-12T22:49:56.683 INFO:tasks.workunit.client.0.smithi066.stdout:6/609: dwrite d6/d23/f5e [0,4194304] 0 2024-09-12T22:49:56.683 INFO:tasks.workunit.client.0.smithi066.stdout:9/563: link d9/dc/f40 d9/d31/d34/d4d/fb8 0 2024-09-12T22:49:56.686 INFO:tasks.workunit.client.0.smithi066.stdout:0/564: creat d1/d36/d65/dc2/fce x:0 0 0 2024-09-12T22:49:56.686 INFO:tasks.workunit.client.0.smithi066.stdout:9/564: creat d9/d31/d77/fb9 x:0 0 0 2024-09-12T22:49:56.689 INFO:tasks.workunit.client.0.smithi066.stdout:1/462: dread d0/d36/d57/f3e [0,4194304] 0 2024-09-12T22:49:56.689 INFO:tasks.workunit.client.0.smithi066.stdout:9/565: mkdir d9/dc/d4e/d9d/dba 0 2024-09-12T22:49:56.689 INFO:tasks.workunit.client.0.smithi066.stdout:0/565: write d1/d8/d1c/fa9 [3088901,73007] 0 2024-09-12T22:49:56.689 INFO:tasks.workunit.client.0.smithi066.stdout:4/616: getdents d5/d3e/d8d/dce 0 2024-09-12T22:49:56.690 INFO:tasks.workunit.client.0.smithi066.stdout:3/546: dwrite d0/d2/d1d/d87/d6b/fbe [0,4194304] 0 2024-09-12T22:49:56.690 INFO:tasks.workunit.client.0.smithi066.stdout:5/629: dwrite d5/de/d50/d42/d49/f93 [8388608,4194304] 0 2024-09-12T22:49:56.691 INFO:tasks.workunit.client.0.smithi066.stdout:7/478: dread d0/d19/d60/f52 [0,4194304] 0 2024-09-12T22:49:56.693 INFO:tasks.workunit.client.0.smithi066.stdout:0/566: mknod d1/d8/d1c/d56/db8/ccf 0 2024-09-12T22:49:56.693 INFO:tasks.workunit.client.0.smithi066.stdout:9/566: rename d9/dc/dd/f1b to d9/dc/dd/d9f/fbb 0 2024-09-12T22:49:56.693 INFO:tasks.workunit.client.0.smithi066.stdout:4/617: creat d5/d3e/d65/dac/fd7 x:0 0 0 2024-09-12T22:49:56.693 INFO:tasks.workunit.client.0.smithi066.stdout:5/630: mkdir d5/d15/db9 0 2024-09-12T22:49:56.694 INFO:tasks.workunit.client.0.smithi066.stdout:7/479: creat d0/d19/d24/d33/d27/d70/f9d x:0 0 0 2024-09-12T22:49:56.695 INFO:tasks.workunit.client.0.smithi066.stdout:7/480: creat d0/d19/d26/d48/f9e x:0 0 0 2024-09-12T22:49:56.695 INFO:tasks.workunit.client.0.smithi066.stdout:9/567: dread - d9/d31/d77/d8f/fa3 zero size 2024-09-12T22:49:56.697 INFO:tasks.workunit.client.0.smithi066.stdout:3/547: dwrite d0/d2/d1d/d87/d40/d44/f9c [0,4194304] 0 2024-09-12T22:49:56.697 INFO:tasks.workunit.client.0.smithi066.stdout:7/481: stat d0/d19/d24/d33/f69 0 2024-09-12T22:49:56.698 INFO:tasks.workunit.client.0.smithi066.stdout:3/548: chown d0/d2/d7/d92 1584 1 2024-09-12T22:49:56.698 INFO:tasks.workunit.client.0.smithi066.stdout:7/482: readlink d0/d19/d26/d48/l77 0 2024-09-12T22:49:56.699 INFO:tasks.workunit.client.0.smithi066.stdout:3/549: write d0/d2/f24 [2499729,15014] 0 2024-09-12T22:49:56.699 INFO:tasks.workunit.client.0.smithi066.stdout:8/574: dread d17/d2c/f38 [8388608,4194304] 0 2024-09-12T22:49:56.700 INFO:tasks.workunit.client.0.smithi066.stdout:7/483: truncate d0/d19/d60/d85/d8b/f9c 816768 0 2024-09-12T22:49:56.700 INFO:tasks.workunit.client.0.smithi066.stdout:3/550: creat d0/d2/d1d/fc3 x:0 0 0 2024-09-12T22:49:56.701 INFO:tasks.workunit.client.0.smithi066.stdout:3/551: mkdir d0/d2/d7/dc4 0 2024-09-12T22:49:56.701 INFO:tasks.workunit.client.0.smithi066.stdout:2/545: dread d1/d44/f4b [0,4194304] 0 2024-09-12T22:49:56.702 INFO:tasks.workunit.client.0.smithi066.stdout:3/552: write d0/d2/d1d/d87/d40/dbd/f60 [2549829,40501] 0 2024-09-12T22:49:56.702 INFO:tasks.workunit.client.0.smithi066.stdout:9/568: rename d9/dc/d4e to d9/d31/d58/dbc 0 2024-09-12T22:49:56.703 INFO:tasks.workunit.client.0.smithi066.stdout:6/610: truncate d6/d23/d25/d4e/dc4/d32/d3c/fa6 198944 0 2024-09-12T22:49:56.703 INFO:tasks.workunit.client.0.smithi066.stdout:2/546: rename d1/d11/d57 to d1/dd/d12/d18/da8 0 2024-09-12T22:49:56.703 INFO:tasks.workunit.client.0.smithi066.stdout:4/618: read d5/d8/d16/d1b/d73/f92 [75302,52882] 0 2024-09-12T22:49:56.704 INFO:tasks.workunit.client.0.smithi066.stdout:6/611: chown d6/d23/d25/f9f 38 1 2024-09-12T22:49:56.704 INFO:tasks.workunit.client.0.smithi066.stdout:9/569: truncate d9/d31/d77/d8f/fa3 661456 0 2024-09-12T22:49:56.704 INFO:tasks.workunit.client.0.smithi066.stdout:3/553: rename d0/d2/d1d/d87/d40/dbd/d74/f79 to d0/d2/d7/d29/fc5 0 2024-09-12T22:49:56.710 INFO:tasks.workunit.client.0.smithi066.stdout:3/554: chown d0/d2/d7/d13/d31/fbc 50133270 1 2024-09-12T22:49:56.710 INFO:tasks.workunit.client.0.smithi066.stdout:3/555: readlink d0/d2/d7/d13/l75 0 2024-09-12T22:49:56.710 INFO:tasks.workunit.client.0.smithi066.stdout:3/556: creat d0/d2/d6/fc6 x:0 0 0 2024-09-12T22:49:56.710 INFO:tasks.workunit.client.0.smithi066.stdout:2/547: dwrite d1/d44/d51/f8e [0,4194304] 0 2024-09-12T22:49:56.710 INFO:tasks.workunit.client.0.smithi066.stdout:6/612: dwrite d6/fb [0,4194304] 0 2024-09-12T22:49:56.710 INFO:tasks.workunit.client.0.smithi066.stdout:3/557: symlink d0/d2/lc7 0 2024-09-12T22:49:56.710 INFO:tasks.workunit.client.0.smithi066.stdout:2/548: mkdir d1/d11/d26/d4f/d5f/da9 0 2024-09-12T22:49:56.710 INFO:tasks.workunit.client.0.smithi066.stdout:6/613: chown d6/d51 412 1 2024-09-12T22:49:56.711 INFO:tasks.workunit.client.0.smithi066.stdout:6/614: write d6/f96 [1028561,95654] 0 2024-09-12T22:49:56.712 INFO:tasks.workunit.client.0.smithi066.stdout:6/615: write d6/d51/f95 [643716,120553] 0 2024-09-12T22:49:56.713 INFO:tasks.workunit.client.0.smithi066.stdout:4/619: dread d5/d8/d16/d1b/d1e/d5a/f5d [0,4194304] 0 2024-09-12T22:49:56.713 INFO:tasks.workunit.client.0.smithi066.stdout:6/616: write d6/fb [4192378,118800] 0 2024-09-12T22:49:56.714 INFO:tasks.workunit.client.0.smithi066.stdout:4/620: write d5/d8/d10/de/d2d/d64/f89 [851804,123464] 0 2024-09-12T22:49:56.717 INFO:tasks.workunit.client.0.smithi066.stdout:2/549: dread d1/d44/f4b [0,4194304] 0 2024-09-12T22:49:56.717 INFO:tasks.workunit.client.0.smithi066.stdout:4/621: symlink d5/d8/d16/d1b/d1e/d5a/ld8 0 2024-09-12T22:49:56.717 INFO:tasks.workunit.client.0.smithi066.stdout:2/550: creat d1/d11/d26/d4f/d7c/faa x:0 0 0 2024-09-12T22:49:56.718 INFO:tasks.workunit.client.0.smithi066.stdout:6/617: dwrite d6/d23/d25/f6f [0,4194304] 0 2024-09-12T22:49:56.720 INFO:tasks.workunit.client.0.smithi066.stdout:6/618: getdents d6/d23/d25/d88 0 2024-09-12T22:49:56.723 INFO:tasks.workunit.client.0.smithi066.stdout:2/551: dwrite d1/dd/d12/d67/f6a [0,4194304] 0 2024-09-12T22:49:56.724 INFO:tasks.workunit.client.0.smithi066.stdout:1/463: sync 2024-09-12T22:49:56.724 INFO:tasks.workunit.client.0.smithi066.stdout:7/484: sync 2024-09-12T22:49:56.724 INFO:tasks.workunit.client.0.smithi066.stdout:8/575: sync 2024-09-12T22:49:56.725 INFO:tasks.workunit.client.0.smithi066.stdout:2/552: mkdir d1/d11/d26/d4f/d7c/da6/dab 0 2024-09-12T22:49:56.726 INFO:tasks.workunit.client.0.smithi066.stdout:4/622: dread d5/d3e/d8d/dc7/f83 [0,4194304] 0 2024-09-12T22:49:56.726 INFO:tasks.workunit.client.0.smithi066.stdout:2/553: symlink d1/d11/d26/d8f/lac 0 2024-09-12T22:49:56.727 INFO:tasks.workunit.client.0.smithi066.stdout:2/554: rename d1/db/d42/d43/d47 to d1/d11/d26/d4f/d5f/d61/d72/dad 0 2024-09-12T22:49:56.728 INFO:tasks.workunit.client.0.smithi066.stdout:2/555: stat d1/dd/d12/d18/c5e 0 2024-09-12T22:49:56.730 INFO:tasks.workunit.client.0.smithi066.stdout:2/556: dread - d1/dd/d68/f83 zero size 2024-09-12T22:49:56.733 INFO:tasks.workunit.client.0.smithi066.stdout:6/619: write d6/d23/d25/d4e/dc4/f18 [2965717,100780] 0 2024-09-12T22:49:56.737 INFO:tasks.workunit.client.0.smithi066.stdout:2/557: dwrite d1/d11/d26/d4f/d5f/d61/d7e/f34 [4194304,4194304] 0 2024-09-12T22:49:56.737 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:56.736+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:56.738 INFO:tasks.workunit.client.0.smithi066.stdout:9/570: dread d9/f53 [0,4194304] 0 2024-09-12T22:49:56.739 INFO:tasks.workunit.client.0.smithi066.stdout:9/571: chown d9/dc/d36 0 1 2024-09-12T22:49:56.740 INFO:tasks.workunit.client.0.smithi066.stdout:9/572: symlink d9/d31/d77/lbd 0 2024-09-12T22:49:56.740 INFO:tasks.workunit.client.0.smithi066.stdout:8/576: dread d17/d49/d4b/d4e/fbd [0,4194304] 0 2024-09-12T22:49:56.741 INFO:tasks.workunit.client.0.smithi066.stdout:3/558: dread d0/d2/d1d/d87/d40/dbd/f50 [0,4194304] 0 2024-09-12T22:49:56.741 INFO:tasks.workunit.client.0.smithi066.stdout:6/620: rename d6/d7/lb5 to d6/d23/d25/d4e/dc4/d32/ld1 0 2024-09-12T22:49:56.742 INFO:tasks.workunit.client.0.smithi066.stdout:8/577: read d17/d2c/f35 [3406432,98079] 0 2024-09-12T22:49:56.742 INFO:tasks.workunit.client.0.smithi066.stdout:6/621: readlink d6/d59/l5b 0 2024-09-12T22:49:56.743 INFO:tasks.workunit.client.0.smithi066.stdout:8/578: mkdir d17/d49/d4b/d57/d5e/d62/dc1 0 2024-09-12T22:49:56.743 INFO:tasks.workunit.client.0.smithi066.stdout:3/559: write d0/d2/d7/d29/f42 [4338778,84861] 0 2024-09-12T22:49:56.744 INFO:tasks.workunit.client.0.smithi066.stdout:3/560: write d0/d2/d1d/d87/d40/d44/f9c [521928,108658] 0 2024-09-12T22:49:56.744 INFO:tasks.workunit.client.0.smithi066.stdout:8/579: mknod d17/d49/d4b/d57/d5e/d65/cc2 0 2024-09-12T22:49:56.744 INFO:tasks.workunit.client.0.smithi066.stdout:2/558: read d1/dd/d3d/f4a [2388879,117486] 0 2024-09-12T22:49:56.745 INFO:tasks.workunit.client.0.smithi066.stdout:7/485: dread d0/d19/d24/d33/d27/f35 [0,4194304] 0 2024-09-12T22:49:56.745 INFO:tasks.workunit.client.0.smithi066.stdout:2/559: dread - d1/dd/d12/d1e/f79 zero size 2024-09-12T22:49:56.746 INFO:tasks.workunit.client.0.smithi066.stdout:7/486: mkdir d0/d19/d26/d5a/d9f 0 2024-09-12T22:49:56.746 INFO:tasks.workunit.client.0.smithi066.stdout:8/580: truncate d17/d40/d74/da3/dac/dbb/fc0 1470718 0 2024-09-12T22:49:56.747 INFO:tasks.workunit.client.0.smithi066.stdout:7/487: chown d0/d19/d26/d48/l97 246 1 2024-09-12T22:49:56.747 INFO:tasks.workunit.client.0.smithi066.stdout:2/560: link d1/d11/c4e d1/d11/d26/d4f/d5f/da9/cae 0 2024-09-12T22:49:56.747 INFO:tasks.workunit.client.0.smithi066.stdout:8/581: fsync d17/d40/da8/fb1 0 2024-09-12T22:49:56.748 INFO:tasks.workunit.client.0.smithi066.stdout:7/488: creat d0/d19/d24/fa0 x:0 0 0 2024-09-12T22:49:56.750 INFO:tasks.workunit.client.0.smithi066.stdout:3/561: dwrite d0/d2/d7/d13/d31/f83 [0,4194304] 0 2024-09-12T22:49:56.751 INFO:tasks.workunit.client.0.smithi066.stdout:0/567: dread d1/d8/d1f/d25/f7d [0,4194304] 0 2024-09-12T22:49:56.752 INFO:tasks.workunit.client.0.smithi066.stdout:1/464: dread d0/dc/fe [0,4194304] 0 2024-09-12T22:49:56.752 INFO:tasks.workunit.client.0.smithi066.stdout:1/465: readlink d0/l1 0 2024-09-12T22:49:56.753 INFO:tasks.workunit.client.0.smithi066.stdout:7/489: mknod d0/d19/d24/d33/d27/d70/ca1 0 2024-09-12T22:49:56.753 INFO:tasks.workunit.client.0.smithi066.stdout:8/582: link d17/d40/d47/d66/f78 d17/d49/d4b/d57/d5e/fc3 0 2024-09-12T22:49:56.754 INFO:tasks.workunit.client.0.smithi066.stdout:2/561: dwrite d1/d11/d26/d4f/d5f/d61/d7e/f8c [0,4194304] 0 2024-09-12T22:49:56.755 INFO:tasks.workunit.client.0.smithi066.stdout:5/631: dread d5/d11/d21/f47 [0,4194304] 0 2024-09-12T22:49:56.755 INFO:tasks.workunit.client.0.smithi066.stdout:3/562: mkdir d0/d2/d1d/d87/d49/dc8 0 2024-09-12T22:49:56.755 INFO:tasks.workunit.client.0.smithi066.stdout:8/583: read d17/d49/d4b/d57/d5e/d62/f67 [1498401,14005] 0 2024-09-12T22:49:56.755 INFO:tasks.workunit.client.0.smithi066.stdout:0/568: rmdir d1/d8/d1c/d13 39 2024-09-12T22:49:56.757 INFO:tasks.workunit.client.0.smithi066.stdout:5/632: chown d5/d11/d21/c41 9 1 2024-09-12T22:49:56.757 INFO:tasks.workunit.client.0.smithi066.stdout:3/563: dread - d0/d2/d1d/d87/d40/dbd/fa5 zero size 2024-09-12T22:49:56.761 INFO:tasks.workunit.client.0.smithi066.stdout:4/623: sync 2024-09-12T22:49:56.761 INFO:tasks.workunit.client.0.smithi066.stdout:2/562: sync 2024-09-12T22:49:56.762 INFO:tasks.workunit.client.0.smithi066.stdout:8/584: mkdir d17/d40/dc4 0 2024-09-12T22:49:56.762 INFO:tasks.workunit.client.0.smithi066.stdout:9/573: write d9/dc/d23/f83 [380518,96927] 0 2024-09-12T22:49:56.762 INFO:tasks.workunit.client.0.smithi066.stdout:5/633: mkdir d5/d14/dba 0 2024-09-12T22:49:56.763 INFO:tasks.workunit.client.0.smithi066.stdout:3/564: mknod d0/d2/d1d/d87/d6b/cc9 0 2024-09-12T22:49:56.763 INFO:tasks.workunit.client.0.smithi066.stdout:1/466: truncate d0/dc/f22 1022874 0 2024-09-12T22:49:56.764 INFO:tasks.workunit.client.0.smithi066.stdout:5/634: unlink d5/d11/d21/d4d/f7a 0 2024-09-12T22:49:56.764 INFO:tasks.workunit.client.0.smithi066.stdout:8/585: write d17/d40/d47/d66/f85 [3793426,4252] 0 2024-09-12T22:49:56.765 INFO:tasks.workunit.client.0.smithi066.stdout:3/565: mknod d0/d2/d1d/d87/d49/dc8/cca 0 2024-09-12T22:49:56.765 INFO:tasks.workunit.client.0.smithi066.stdout:6/622: truncate d6/d23/d25/d4e/dc4/d32/d3c/fa6 1165447 0 2024-09-12T22:49:56.765 INFO:tasks.workunit.client.0.smithi066.stdout:9/574: read d9/dc/f40 [3762911,58091] 0 2024-09-12T22:49:56.767 INFO:tasks.workunit.client.0.smithi066.stdout:6/623: truncate d6/f4b 4708511 0 2024-09-12T22:49:56.767 INFO:tasks.workunit.client.0.smithi066.stdout:8/586: creat d17/d49/d4b/d57/d5e/fc5 x:0 0 0 2024-09-12T22:49:56.769 INFO:tasks.workunit.client.0.smithi066.stdout:8/587: dread - d17/d49/d4b/d57/d5e/fc5 zero size 2024-09-12T22:49:56.770 INFO:tasks.workunit.client.0.smithi066.stdout:9/575: rename d9/dc/dd/f4f to d9/d31/d58/fbe 0 2024-09-12T22:49:56.771 INFO:tasks.workunit.client.0.smithi066.stdout:6/624: rename d6/d49/f70 to d6/d23/d25/d4e/fd2 0 2024-09-12T22:49:56.771 INFO:tasks.workunit.client.0.smithi066.stdout:1/467: dwrite d0/dc/d1d/f67 [4194304,4194304] 0 2024-09-12T22:49:56.771 INFO:tasks.workunit.client.0.smithi066.stdout:5/635: dwrite d5/d11/d23/f56 [0,4194304] 0 2024-09-12T22:49:56.772 INFO:tasks.workunit.client.0.smithi066.stdout:1/468: chown d0/dc/d1d/c51 22 1 2024-09-12T22:49:56.775 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:56.775 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:49:56.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:49:56.775 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:49:56.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.775 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:10686 4.33 4:cf068428:::100000030d3.00000000:head [write 0~4194304 [2@1769906]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:49:56.776 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:51.586622+0000", 2024-09-12T22:49:56.776 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.1859839829999999, 2024-09-12T22:49:56.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.027146674999999999, 2024-09-12T22:49:56.776 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:56.776 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:56.776 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.776 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:56.776 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:56.776 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:56.776 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 10686 2024-09-12T22:49:56.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.776 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.586622+0000", 2024-09-12T22:49:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.586622+0000", 2024-09-12T22:49:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:56.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.586624+0000", 2024-09-12T22:49:56.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3400000000000001e-06 2024-09-12T22:49:56.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:56.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.593104+0000", 2024-09-12T22:49:56.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0064806489999999998 2024-09-12T22:49:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.593115+0000", 2024-09-12T22:49:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.115e-05 2024-09-12T22:49:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.593122+0000", 2024-09-12T22:49:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1659999999999997e-06 2024-09-12T22:49:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.593186+0000", 2024-09-12T22:49:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3349999999999995e-05 2024-09-12T22:49:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.593282+0000", 2024-09-12T22:49:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6434999999999994e-05 2024-09-12T22:49:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.593433+0000", 2024-09-12T22:49:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015100899999999999 2024-09-12T22:49:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.599785+0000", 2024-09-12T22:49:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063515230000000004 2024-09-12T22:49:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.613682+0000", 2024-09-12T22:49:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013897197999999999 2024-09-12T22:49:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.613722+0000", 2024-09-12T22:49:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.032e-05 2024-09-12T22:49:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:51.613769+0000", 2024-09-12T22:49:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6535000000000001e-05 2024-09-12T22:49:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:10744 4.19 4:9b10085a:::100000030cd.00000000:head [write 0~4194304 [2@139751]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:49:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:53.515313+0000", 2024-09-12T22:49:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 3.2572933050000001, 2024-09-12T22:49:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.027541945000000002, 2024-09-12T22:49:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 10744 2024-09-12T22:49:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:53.515313+0000", 2024-09-12T22:49:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:53.515313+0000", 2024-09-12T22:49:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:53.515315+0000", 2024-09-12T22:49:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7600000000000001e-06 2024-09-12T22:49:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:53.522020+0000", 2024-09-12T22:49:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0067053900000000003 2024-09-12T22:49:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:53.522038+0000", 2024-09-12T22:49:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7526000000000001e-05 2024-09-12T22:49:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:53.522046+0000", 2024-09-12T22:49:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9269999999999994e-06 2024-09-12T22:49:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:53.522103+0000", 2024-09-12T22:49:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6440999999999997e-05 2024-09-12T22:49:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:53.522205+0000", 2024-09-12T22:49:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000101838 2024-09-12T22:49:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:53.522354+0000", 2024-09-12T22:49:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014889600000000001 2024-09-12T22:49:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:53.528639+0000", 2024-09-12T22:49:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062849220000000001 2024-09-12T22:49:56.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:56.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:53.542796+0000", 2024-09-12T22:49:56.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014157289 2024-09-12T22:49:56.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:56.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:53.542828+0000", 2024-09-12T22:49:56.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2178000000000003e-05 2024-09-12T22:49:56.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:56.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:53.542855+0000", 2024-09-12T22:49:56.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6778e-05 2024-09-12T22:49:56.789 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.789 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:56.789 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.789 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:12503 4.15 4:ab29d13f:::100000033b1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:56.789 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:56.025973+0000", 2024-09-12T22:49:56.789 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.74663300099999996, 2024-09-12T22:49:56.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.048573847000000003, 2024-09-12T22:49:56.789 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:56.790 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:56.790 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.790 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:56.790 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:56.790 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:56.790 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 12503 2024-09-12T22:49:56.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.790 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:56.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:56.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.025973+0000", 2024-09-12T22:49:56.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.025973+0000", 2024-09-12T22:49:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.025974+0000", 2024-09-12T22:49:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8599999999999997e-07 2024-09-12T22:49:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.030236+0000", 2024-09-12T22:49:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042620449999999999 2024-09-12T22:49:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.030248+0000", 2024-09-12T22:49:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1606999999999999e-05 2024-09-12T22:49:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.030254+0000", 2024-09-12T22:49:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1120000000000001e-06 2024-09-12T22:49:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.030315+0000", 2024-09-12T22:49:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1241000000000005e-05 2024-09-12T22:49:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.030413+0000", 2024-09-12T22:49:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7837000000000005e-05 2024-09-12T22:49:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.030495+0000", 2024-09-12T22:49:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2144999999999994e-05 2024-09-12T22:49:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.036476+0000", 2024-09-12T22:49:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0059809889999999999 2024-09-12T22:49:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.074452+0000", 2024-09-12T22:49:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.037975751000000002 2024-09-12T22:49:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.074506+0000", 2024-09-12T22:49:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4521999999999997e-05 2024-09-12T22:49:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.074547+0000", 2024-09-12T22:49:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0812000000000002e-05 2024-09-12T22:49:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:12592 4.28 4:15369129:::100000031a9.00000000:head [write 0~4194304 [3@1788600]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:56.132369+0000", 2024-09-12T22:49:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.64023710899999997, 2024-09-12T22:49:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.034376701000000003, 2024-09-12T22:49:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 12592 2024-09-12T22:49:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.132369+0000", 2024-09-12T22:49:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.132369+0000", 2024-09-12T22:49:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.132370+0000", 2024-09-12T22:49:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1200000000000002e-07 2024-09-12T22:49:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.138975+0000", 2024-09-12T22:49:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0066049560000000004 2024-09-12T22:49:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.138988+0000", 2024-09-12T22:49:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.359e-05 2024-09-12T22:49:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.138995+0000", 2024-09-12T22:49:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.28e-06 2024-09-12T22:49:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.139037+0000", 2024-09-12T22:49:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2608999999999998e-05 2024-09-12T22:49:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.139106+0000", 2024-09-12T22:49:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8789999999999997e-05 2024-09-12T22:49:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.139193+0000", 2024-09-12T22:49:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7217000000000002e-05 2024-09-12T22:49:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.148817+0000", 2024-09-12T22:49:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0096241450000000006 2024-09-12T22:49:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:56.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.166651+0000", 2024-09-12T22:49:56.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.017833900999999999 2024-09-12T22:49:56.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:56.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.166708+0000", 2024-09-12T22:49:56.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7033000000000001e-05 2024-09-12T22:49:56.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:56.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.166746+0000", 2024-09-12T22:49:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7367999999999999e-05 2024-09-12T22:49:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:12614 4.1c 4:38b085a0:::1000000320b.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:56.156821+0000", 2024-09-12T22:49:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.61578492799999995, 2024-09-12T22:49:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.030451549000000001, 2024-09-12T22:49:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 12614 2024-09-12T22:49:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.156821+0000", 2024-09-12T22:49:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.156821+0000", 2024-09-12T22:49:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.156822+0000", 2024-09-12T22:49:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5900000000000003e-07 2024-09-12T22:49:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.163648+0000", 2024-09-12T22:49:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.006826515 2024-09-12T22:49:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.163665+0000", 2024-09-12T22:49:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6952e-05 2024-09-12T22:49:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.163675+0000", 2024-09-12T22:49:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6909999999999992e-06 2024-09-12T22:49:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.163734+0000", 2024-09-12T22:49:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9710000000000003e-05 2024-09-12T22:49:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.163797+0000", 2024-09-12T22:49:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2421000000000004e-05 2024-09-12T22:49:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.163903+0000", 2024-09-12T22:49:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010632300000000001 2024-09-12T22:49:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.175822+0000", 2024-09-12T22:49:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011919137999999999 2024-09-12T22:49:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.187204+0000", 2024-09-12T22:49:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011381775 2024-09-12T22:49:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.187238+0000", 2024-09-12T22:49:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3893000000000002e-05 2024-09-12T22:49:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.187273+0000", 2024-09-12T22:49:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4771999999999998e-05 2024-09-12T22:49:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:12675 4.19 4:9a36ba9a:::100000034ae.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:56.227713+0000", 2024-09-12T22:49:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.54489354099999998, 2024-09-12T22:49:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.028365207999999999, 2024-09-12T22:49:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 12675 2024-09-12T22:49:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.227713+0000", 2024-09-12T22:49:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.227713+0000", 2024-09-12T22:49:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.227713+0000", 2024-09-12T22:49:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.63e-07 2024-09-12T22:49:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.233190+0000", 2024-09-12T22:49:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0054770519999999996 2024-09-12T22:49:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.233205+0000", 2024-09-12T22:49:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4800000000000001e-05 2024-09-12T22:49:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.233212+0000", 2024-09-12T22:49:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8619999999999997e-06 2024-09-12T22:49:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.233286+0000", 2024-09-12T22:49:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3727999999999996e-05 2024-09-12T22:49:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.233392+0000", 2024-09-12T22:49:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010680599999999999 2024-09-12T22:49:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.233498+0000", 2024-09-12T22:49:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105575 2024-09-12T22:49:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.243737+0000", 2024-09-12T22:49:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01023903 2024-09-12T22:49:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.255981+0000", 2024-09-12T22:49:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012244214 2024-09-12T22:49:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.256037+0000", 2024-09-12T22:49:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5676e-05 2024-09-12T22:49:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.256078+0000", 2024-09-12T22:49:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1001999999999998e-05 2024-09-12T22:49:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:12753 4.36 4:6e9c06fb:::100000030cb.00000002:head [write 0~4194304 [5@0]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:56.326775+0000", 2024-09-12T22:49:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.44583157699999998, 2024-09-12T22:49:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.025815657999999998, 2024-09-12T22:49:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 12753 2024-09-12T22:49:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:56.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.326775+0000", 2024-09-12T22:49:56.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:56.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.326775+0000", 2024-09-12T22:49:56.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:56.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.326776+0000", 2024-09-12T22:49:56.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.59e-06 2024-09-12T22:49:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.331477+0000", 2024-09-12T22:49:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047005750000000002 2024-09-12T22:49:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.331490+0000", 2024-09-12T22:49:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2938e-05 2024-09-12T22:49:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.331500+0000", 2024-09-12T22:49:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0774999999999999e-05 2024-09-12T22:49:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.331617+0000", 2024-09-12T22:49:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000116079 2024-09-12T22:49:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.331758+0000", 2024-09-12T22:49:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000141884 2024-09-12T22:49:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.331946+0000", 2024-09-12T22:49:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00018799499999999999 2024-09-12T22:49:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.346047+0000", 2024-09-12T22:49:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014100635 2024-09-12T22:49:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.352484+0000", 2024-09-12T22:49:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0064369659999999997 2024-09-12T22:49:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.352544+0000", 2024-09-12T22:49:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9818999999999998e-05 2024-09-12T22:49:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.352590+0000", 2024-09-12T22:49:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6402000000000001e-05 2024-09-12T22:49:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:12761 4.3e 4:7ff183a7:::100000031a6.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:56.335744+0000", 2024-09-12T22:49:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.43686206599999999, 2024-09-12T22:49:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.025871128, 2024-09-12T22:49:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 12761 2024-09-12T22:49:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.335744+0000", 2024-09-12T22:49:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.335744+0000", 2024-09-12T22:49:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.335745+0000", 2024-09-12T22:49:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.51e-07 2024-09-12T22:49:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.340022+0000", 2024-09-12T22:49:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042771199999999997 2024-09-12T22:49:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.340035+0000", 2024-09-12T22:49:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3205e-05 2024-09-12T22:49:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.340042+0000", 2024-09-12T22:49:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7730000000000002e-06 2024-09-12T22:49:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.340088+0000", 2024-09-12T22:49:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6576000000000003e-05 2024-09-12T22:49:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.340173+0000", 2024-09-12T22:49:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5154000000000005e-05 2024-09-12T22:49:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.340267+0000", 2024-09-12T22:49:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3312000000000004e-05 2024-09-12T22:49:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.352603+0000", 2024-09-12T22:49:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012336315 2024-09-12T22:49:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.361547+0000", 2024-09-12T22:49:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0089439729999999992 2024-09-12T22:49:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.361582+0000", 2024-09-12T22:49:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5079000000000001e-05 2024-09-12T22:49:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.361615+0000", 2024-09-12T22:49:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.307e-05 2024-09-12T22:49:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:12845 4.6 4:6201c6e2:::100000031a0.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:56.422988+0000", 2024-09-12T22:49:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.34961784299999998, 2024-09-12T22:49:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.040522962000000003, 2024-09-12T22:49:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 12845 2024-09-12T22:49:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.422988+0000", 2024-09-12T22:49:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.422988+0000", 2024-09-12T22:49:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.422990+0000", 2024-09-12T22:49:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1939999999999999e-06 2024-09-12T22:49:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.431561+0000", 2024-09-12T22:49:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085716760000000003 2024-09-12T22:49:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.431581+0000", 2024-09-12T22:49:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9899e-05 2024-09-12T22:49:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.431591+0000", 2024-09-12T22:49:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7610000000000002e-06 2024-09-12T22:49:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.431661+0000", 2024-09-12T22:49:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0506999999999994e-05 2024-09-12T22:49:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.431746+0000", 2024-09-12T22:49:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4282000000000004e-05 2024-09-12T22:49:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.431861+0000", 2024-09-12T22:49:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011511299999999999 2024-09-12T22:49:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.446625+0000", 2024-09-12T22:49:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014764736000000001 2024-09-12T22:49:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.463416+0000", 2024-09-12T22:49:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016790418000000001 2024-09-12T22:49:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.463471+0000", 2024-09-12T22:49:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4775999999999999e-05 2024-09-12T22:49:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.463511+0000", 2024-09-12T22:49:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0599999999999998e-05 2024-09-12T22:49:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:12855 4.28 4:148cf116:::10000003175.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:56.434974+0000", 2024-09-12T22:49:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.33763231599999999, 2024-09-12T22:49:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.035541932999999998, 2024-09-12T22:49:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 12855 2024-09-12T22:49:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:56.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:56.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.434974+0000", 2024-09-12T22:49:56.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:56.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.434974+0000", 2024-09-12T22:49:56.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:56.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.434976+0000", 2024-09-12T22:49:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9690000000000001e-06 2024-09-12T22:49:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.442818+0000", 2024-09-12T22:49:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078419779999999994 2024-09-12T22:49:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.442831+0000", 2024-09-12T22:49:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2962000000000001e-05 2024-09-12T22:49:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.442836+0000", 2024-09-12T22:49:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6860000000000003e-06 2024-09-12T22:49:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.442956+0000", 2024-09-12T22:49:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011929 2024-09-12T22:49:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.443051+0000", 2024-09-12T22:49:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5721000000000001e-05 2024-09-12T22:49:56.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:56.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.443187+0000", 2024-09-12T22:49:56.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013542299999999999 2024-09-12T22:49:56.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:56.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.465191+0000", 2024-09-12T22:49:56.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022003671999999998 2024-09-12T22:49:56.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.470387+0000", 2024-09-12T22:49:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051966130000000001 2024-09-12T22:49:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.470438+0000", 2024-09-12T22:49:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0909999999999999e-05 2024-09-12T22:49:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.470516+0000", 2024-09-12T22:49:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7708999999999997e-05 2024-09-12T22:49:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:12856 4.14 4:2aaf9aa8:::100000031d6.00000000:head [write 0~4194304 [2@695849]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:56.442850+0000", 2024-09-12T22:49:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.32975568599999999, 2024-09-12T22:49:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.027062618, 2024-09-12T22:49:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:56.841 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:56.841 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 12856 2024-09-12T22:49:56.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.841 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:56.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:56.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.442850+0000", 2024-09-12T22:49:56.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:56.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.442850+0000", 2024-09-12T22:49:56.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:56.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.442857+0000", 2024-09-12T22:49:56.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.815e-06 2024-09-12T22:49:56.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:56.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.448376+0000", 2024-09-12T22:49:56.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0055184680000000003 2024-09-12T22:49:56.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:56.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.448388+0000", 2024-09-12T22:49:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2024e-05 2024-09-12T22:49:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.448393+0000", 2024-09-12T22:49:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3689999999999998e-06 2024-09-12T22:49:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.448439+0000", 2024-09-12T22:49:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6196999999999998e-05 2024-09-12T22:49:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.448526+0000", 2024-09-12T22:49:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6712999999999995e-05 2024-09-12T22:49:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.448635+0000", 2024-09-12T22:49:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000108618 2024-09-12T22:49:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.465422+0000", 2024-09-12T22:49:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016787783000000001 2024-09-12T22:49:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.469822+0000", 2024-09-12T22:49:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043999410000000001 2024-09-12T22:49:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.469870+0000", 2024-09-12T22:49:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7163000000000002e-05 2024-09-12T22:49:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.469913+0000", 2024-09-12T22:49:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3526999999999998e-05 2024-09-12T22:49:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:12927 4.14 4:2aaf9aa8:::100000031d6.00000000:head [write 0~4194304 [2@695849]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:56.505122+0000", 2024-09-12T22:49:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.26748430699999998, 2024-09-12T22:49:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.027819033, 2024-09-12T22:49:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 12927 2024-09-12T22:49:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.505122+0000", 2024-09-12T22:49:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.505122+0000", 2024-09-12T22:49:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.505123+0000", 2024-09-12T22:49:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8700000000000004e-07 2024-09-12T22:49:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.509566+0000", 2024-09-12T22:49:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044429329999999996 2024-09-12T22:49:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.509578+0000", 2024-09-12T22:49:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2194e-05 2024-09-12T22:49:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.509584+0000", 2024-09-12T22:49:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1890000000000004e-06 2024-09-12T22:49:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.509631+0000", 2024-09-12T22:49:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6678999999999998e-05 2024-09-12T22:49:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.509737+0000", 2024-09-12T22:49:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010629 2024-09-12T22:49:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.509957+0000", 2024-09-12T22:49:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00022000200000000001 2024-09-12T22:49:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.527433+0000", 2024-09-12T22:49:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.017475688 2024-09-12T22:49:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.532881+0000", 2024-09-12T22:49:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0054482150000000002 2024-09-12T22:49:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.532915+0000", 2024-09-12T22:49:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3864e-05 2024-09-12T22:49:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.532941+0000", 2024-09-12T22:49:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6092e-05 2024-09-12T22:49:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:12960 4.14 4:2ad110e9:::10000003530.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:56.531618+0000", 2024-09-12T22:49:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.24098789800000001, 2024-09-12T22:49:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.030052255999999999, 2024-09-12T22:49:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 12960 2024-09-12T22:49:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.531618+0000", 2024-09-12T22:49:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.531618+0000", 2024-09-12T22:49:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.531624+0000", 2024-09-12T22:49:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9549999999999997e-06 2024-09-12T22:49:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.538958+0000", 2024-09-12T22:49:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0073339909999999998 2024-09-12T22:49:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.538969+0000", 2024-09-12T22:49:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0584999999999999e-05 2024-09-12T22:49:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.538974+0000", 2024-09-12T22:49:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0819999999999998e-06 2024-09-12T22:49:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.539044+0000", 2024-09-12T22:49:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0436000000000001e-05 2024-09-12T22:49:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.539141+0000", 2024-09-12T22:49:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6342999999999996e-05 2024-09-12T22:49:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.539221+0000", 2024-09-12T22:49:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0253999999999994e-05 2024-09-12T22:49:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.548150+0000", 2024-09-12T22:49:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0089292759999999999 2024-09-12T22:49:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.561520+0000", 2024-09-12T22:49:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013369616000000001 2024-09-12T22:49:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.561607+0000", 2024-09-12T22:49:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7588000000000002e-05 2024-09-12T22:49:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.561671+0000", 2024-09-12T22:49:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.313e-05 2024-09-12T22:49:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.859 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:12973 4.32 4:4f3042f2:::1000000322e.00000000:head [write 0~4194304 [2@25587]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:56.859 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:56.549994+0000", 2024-09-12T22:49:56.859 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.22261210200000001, 2024-09-12T22:49:56.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.026833991000000001, 2024-09-12T22:49:56.859 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:56.859 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:56.859 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.859 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:56.859 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:56.859 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:56.859 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 12973 2024-09-12T22:49:56.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.859 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:56.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:56.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.549994+0000", 2024-09-12T22:49:56.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:56.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.549994+0000", 2024-09-12T22:49:56.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:56.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.549995+0000", 2024-09-12T22:49:56.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1999999999999999e-07 2024-09-12T22:49:56.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:56.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.559060+0000", 2024-09-12T22:49:56.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090652200000000006 2024-09-12T22:49:56.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:56.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.559071+0000", 2024-09-12T22:49:56.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0837e-05 2024-09-12T22:49:56.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.559076+0000", 2024-09-12T22:49:56.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9919999999999998e-06 2024-09-12T22:49:56.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:56.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.559127+0000", 2024-09-12T22:49:56.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1366000000000003e-05 2024-09-12T22:49:56.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:56.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.559236+0000", 2024-09-12T22:49:56.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000108767 2024-09-12T22:49:56.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:56.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.576697+0000", 2024-09-12T22:49:56.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.017460795000000001 2024-09-12T22:49:56.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:56.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.576750+0000", 2024-09-12T22:49:56.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3063999999999999e-05 2024-09-12T22:49:56.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:56.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.576828+0000", 2024-09-12T22:49:56.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8230000000000001e-05 2024-09-12T22:49:56.864 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.864 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:56.864 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.864 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:13017 4.3b 4:deb39c3c:::1000000315d.00000000:head [write 0~4194304 [3@3236726]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:56.864 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:56.596328+0000", 2024-09-12T22:49:56.865 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.176278135, 2024-09-12T22:49:56.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.043494172999999997, 2024-09-12T22:49:56.865 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:56.865 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:56.865 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.865 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:56.865 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:56.865 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:56.865 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 13017 2024-09-12T22:49:56.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.865 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:56.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:56.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.596328+0000", 2024-09-12T22:49:56.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:56.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.596328+0000", 2024-09-12T22:49:56.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:56.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.596329+0000", 2024-09-12T22:49:56.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.06e-07 2024-09-12T22:49:56.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:56.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.600217+0000", 2024-09-12T22:49:56.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038880609999999999 2024-09-12T22:49:56.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:56.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.600229+0000", 2024-09-12T22:49:56.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2764e-05 2024-09-12T22:49:56.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.600239+0000", 2024-09-12T22:49:56.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7950000000000002e-06 2024-09-12T22:49:56.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:56.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.600299+0000", 2024-09-12T22:49:56.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0217000000000003e-05 2024-09-12T22:49:56.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:56.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.600370+0000", 2024-09-12T22:49:56.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0594999999999997e-05 2024-09-12T22:49:56.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:56.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.600461+0000", 2024-09-12T22:49:56.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0963000000000003e-05 2024-09-12T22:49:56.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:56.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.613999+0000", 2024-09-12T22:49:56.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013538011000000001 2024-09-12T22:49:56.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:56.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.639757+0000", 2024-09-12T22:49:56.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.025757912000000001 2024-09-12T22:49:56.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:56.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.639791+0000", 2024-09-12T22:49:56.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3974999999999999e-05 2024-09-12T22:49:56.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:56.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.639822+0000", 2024-09-12T22:49:56.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1273999999999999e-05 2024-09-12T22:49:56.870 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.870 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:56.871 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.871 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:13025 4.28 4:14c990c1:::100000033ca.00000000:head [write 2989033~95164] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:56.871 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:56.601537+0000", 2024-09-12T22:49:56.871 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.171068678, 2024-09-12T22:49:56.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.036635528000000001, 2024-09-12T22:49:56.871 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:56.871 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:56.871 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.871 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:56.871 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:56.871 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:56.871 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 13025 2024-09-12T22:49:56.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.872 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:56.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:56.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.601537+0000", 2024-09-12T22:49:56.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:56.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.601537+0000", 2024-09-12T22:49:56.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:56.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.601539+0000", 2024-09-12T22:49:56.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.562e-06 2024-09-12T22:49:56.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:56.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.601724+0000", 2024-09-12T22:49:56.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00018537299999999999 2024-09-12T22:49:56.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:56.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.601737+0000", 2024-09-12T22:49:56.874 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2508e-05 2024-09-12T22:49:56.874 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.874 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.874 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.874 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.601744+0000", 2024-09-12T22:49:56.874 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1579999999999999e-06 2024-09-12T22:49:56.874 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.874 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.874 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:56.874 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.601813+0000", 2024-09-12T22:49:56.874 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8882999999999998e-05 2024-09-12T22:49:56.874 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.874 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.874 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:56.875 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.601910+0000", 2024-09-12T22:49:56.875 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7332999999999998e-05 2024-09-12T22:49:56.875 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.875 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:56.875 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.602080+0000", 2024-09-12T22:49:56.875 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016952800000000001 2024-09-12T22:49:56.875 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.875 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:56.875 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.610756+0000", 2024-09-12T22:49:56.875 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086765049999999993 2024-09-12T22:49:56.875 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.876 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:56.876 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.638072+0000", 2024-09-12T22:49:56.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.02731608 2024-09-12T22:49:56.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.876 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:56.876 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.638127+0000", 2024-09-12T22:49:56.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4369000000000001e-05 2024-09-12T22:49:56.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.876 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:56.876 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.638173+0000", 2024-09-12T22:49:56.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6229000000000001e-05 2024-09-12T22:49:56.877 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.877 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:56.877 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.877 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.877 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:13030 4.2e 4:77f85201:::1000000355c.00000000:head [write 612002~21597] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:56.877 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:56.606254+0000", 2024-09-12T22:49:56.877 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.16635245900000001, 2024-09-12T22:49:56.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.028646660000000001, 2024-09-12T22:49:56.877 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:56.877 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:56.877 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.877 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:56.878 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:56.878 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:56.878 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 13030 2024-09-12T22:49:56.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.878 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:56.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.878 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:56.878 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.606254+0000", 2024-09-12T22:49:56.878 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.878 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:56.878 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.606254+0000", 2024-09-12T22:49:56.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.879 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.879 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:56.879 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.606254+0000", 2024-09-12T22:49:56.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1600000000000001e-07 2024-09-12T22:49:56.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.879 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.879 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:56.879 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.606276+0000", 2024-09-12T22:49:56.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2013000000000001e-05 2024-09-12T22:49:56.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.879 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.879 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:56.880 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.606284+0000", 2024-09-12T22:49:56.880 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9729999999999997e-06 2024-09-12T22:49:56.880 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.880 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.880 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.606289+0000", 2024-09-12T22:49:56.880 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1010000000000002e-06 2024-09-12T22:49:56.880 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.880 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:56.880 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.611106+0000", 2024-09-12T22:49:56.880 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004817605 2024-09-12T22:49:56.881 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.881 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.881 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:56.881 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.611225+0000", 2024-09-12T22:49:56.881 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000118628 2024-09-12T22:49:56.881 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.881 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.881 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:56.881 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.611342+0000", 2024-09-12T22:49:56.881 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000117329 2024-09-12T22:49:56.881 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.881 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.881 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:56.881 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.614461+0000", 2024-09-12T22:49:56.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031186220000000001 2024-09-12T22:49:56.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.882 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:56.882 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.634800+0000", 2024-09-12T22:49:56.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.020338846000000001 2024-09-12T22:49:56.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.882 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:56.882 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.634849+0000", 2024-09-12T22:49:56.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9653e-05 2024-09-12T22:49:56.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.883 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:56.883 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.634900+0000", 2024-09-12T22:49:56.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1174000000000002e-05 2024-09-12T22:49:56.883 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.883 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:56.883 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.883 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:13045 4.15 4:aae4abeb:::100000035e2.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:56.883 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:56.622986+0000", 2024-09-12T22:49:56.883 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.149620591, 2024-09-12T22:49:56.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.032966747999999997, 2024-09-12T22:49:56.883 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:56.884 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:56.884 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.884 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:56.884 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:56.884 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:56.884 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 13045 2024-09-12T22:49:56.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.884 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:56.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:56.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.622986+0000", 2024-09-12T22:49:56.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:56.885 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.622986+0000", 2024-09-12T22:49:56.885 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:56.885 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.622988+0000", 2024-09-12T22:49:56.885 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2060000000000001e-06 2024-09-12T22:49:56.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:56.885 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.631697+0000", 2024-09-12T22:49:56.885 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087093780000000003 2024-09-12T22:49:56.886 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.886 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.886 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:56.886 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.631712+0000", 2024-09-12T22:49:56.886 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4941e-05 2024-09-12T22:49:56.886 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.886 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.886 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.886 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.631720+0000", 2024-09-12T22:49:56.886 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7160000000000003e-06 2024-09-12T22:49:56.886 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.886 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.886 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:56.887 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.631777+0000", 2024-09-12T22:49:56.887 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6876999999999998e-05 2024-09-12T22:49:56.887 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.887 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.887 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:56.887 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.631963+0000", 2024-09-12T22:49:56.887 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00018617699999999999 2024-09-12T22:49:56.887 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.887 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.887 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:56.887 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.632113+0000", 2024-09-12T22:49:56.887 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000150173 2024-09-12T22:49:56.888 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.888 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.888 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:56.888 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.648963+0000", 2024-09-12T22:49:56.888 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016849666999999999 2024-09-12T22:49:56.888 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.888 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.888 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:56.888 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.655861+0000", 2024-09-12T22:49:56.888 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0068984340000000002 2024-09-12T22:49:56.888 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.888 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.888 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:56.889 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.655917+0000", 2024-09-12T22:49:56.889 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6094999999999997e-05 2024-09-12T22:49:56.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.889 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.889 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:56.889 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.655952+0000", 2024-09-12T22:49:56.889 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5083999999999998e-05 2024-09-12T22:49:56.889 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.889 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:56.889 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.889 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.889 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:13103 4.19 4:98b6094a:::1000000356d.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:56.890 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:56.680851+0000", 2024-09-12T22:49:56.890 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.091754766000000001, 2024-09-12T22:49:56.890 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.026620036, 2024-09-12T22:49:56.890 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:56.890 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:56.890 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.890 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:56.890 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:56.890 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:56.890 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 13103 2024-09-12T22:49:56.890 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.890 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:56.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.890 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:56.891 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.680851+0000", 2024-09-12T22:49:56.891 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.891 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.891 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:56.891 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.680851+0000", 2024-09-12T22:49:56.891 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.891 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.891 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:56.891 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.680853+0000", 2024-09-12T22:49:56.891 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4699999999999999e-06 2024-09-12T22:49:56.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.892 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.892 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:56.892 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.687092+0000", 2024-09-12T22:49:56.892 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062389139999999999 2024-09-12T22:49:56.892 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.892 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.892 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:56.892 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.687108+0000", 2024-09-12T22:49:56.892 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5787e-05 2024-09-12T22:49:56.892 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.892 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.892 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.892 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.687117+0000", 2024-09-12T22:49:56.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9979999999999992e-06 2024-09-12T22:49:56.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.893 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:56.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.687174+0000", 2024-09-12T22:49:56.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7853000000000003e-05 2024-09-12T22:49:56.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.893 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:56.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.687315+0000", 2024-09-12T22:49:56.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000140836 2024-09-12T22:49:56.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.893 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:56.894 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.687494+0000", 2024-09-12T22:49:56.894 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017847499999999999 2024-09-12T22:49:56.894 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.894 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.894 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:56.894 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.701222+0000", 2024-09-12T22:49:56.894 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013728496999999999 2024-09-12T22:49:56.894 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.894 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.894 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:56.894 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.707412+0000", 2024-09-12T22:49:56.894 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0061897599999999999 2024-09-12T22:49:56.894 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.895 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.895 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:56.895 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.707446+0000", 2024-09-12T22:49:56.895 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4177999999999997e-05 2024-09-12T22:49:56.895 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.895 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.895 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:56.895 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.707471+0000", 2024-09-12T22:49:56.895 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5267999999999999e-05 2024-09-12T22:49:56.895 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.895 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:56.895 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.895 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.896 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.896 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:13126 4.2e 4:74a1dfe1:::1000000311e.00000000:head [write 0~4194304 [2@2001555]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:56.896 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:56.713978+0000", 2024-09-12T22:49:56.896 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.058628270000000003, 2024-09-12T22:49:56.896 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.028810738999999998, 2024-09-12T22:49:56.896 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:56.896 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:56.896 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:56.896 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:56.896 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:56.896 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:56.896 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 13126 2024-09-12T22:49:56.896 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.897 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:56.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.897 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:56.897 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.713978+0000", 2024-09-12T22:49:56.897 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.897 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:56.897 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.713978+0000", 2024-09-12T22:49:56.897 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:56.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.897 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:56.898 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.713979+0000", 2024-09-12T22:49:56.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1349999999999999e-06 2024-09-12T22:49:56.898 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.898 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.898 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:56.898 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.717915+0000", 2024-09-12T22:49:56.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003935956 2024-09-12T22:49:56.898 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.898 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.898 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:56.898 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.717928+0000", 2024-09-12T22:49:56.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.295e-05 2024-09-12T22:49:56.898 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.898 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.899 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:56.899 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.717935+0000", 2024-09-12T22:49:56.899 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6309999999999997e-06 2024-09-12T22:49:56.899 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.899 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:56.899 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.717989+0000", 2024-09-12T22:49:56.899 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4249999999999997e-05 2024-09-12T22:49:56.899 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.899 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:56.899 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.718070+0000", 2024-09-12T22:49:56.899 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0755999999999997e-05 2024-09-12T22:49:56.900 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.900 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.900 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:56.900 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.718177+0000", 2024-09-12T22:49:56.900 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010772600000000001 2024-09-12T22:49:56.900 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.900 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.900 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:56.900 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.728063+0000", 2024-09-12T22:49:56.900 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0098858049999999992 2024-09-12T22:49:56.900 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.900 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.900 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:56.901 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.742682+0000", 2024-09-12T22:49:56.901 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014619210000000001 2024-09-12T22:49:56.901 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.901 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.901 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:56.901 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.742740+0000", 2024-09-12T22:49:56.901 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7734e-05 2024-09-12T22:49:56.901 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:56.901 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:56.901 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:56.901 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:56.742789+0000", 2024-09-12T22:49:56.901 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8585999999999999e-05 2024-09-12T22:49:56.901 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.902 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:56.902 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.902 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:56.902 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:56.902 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:56.904 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:56.905 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:56.902+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:56.934 INFO:tasks.workunit.client.0.smithi066.stdout:3/566: truncate d0/d2/d7/f97 3461078 0 2024-09-12T22:49:56.934 INFO:tasks.workunit.client.0.smithi066.stdout:8/588: mkdir d17/d49/d4b/d57/d5e/d62/dc6 0 2024-09-12T22:49:56.934 INFO:tasks.workunit.client.0.smithi066.stdout:9/576: getdents d9/dc/d8e 0 2024-09-12T22:49:56.934 INFO:tasks.workunit.client.0.smithi066.stdout:1/469: getdents d0/d36/d6b 0 2024-09-12T22:49:56.934 INFO:tasks.workunit.client.0.smithi066.stdout:8/589: mknod d17/d40/d47/d66/cc7 0 2024-09-12T22:49:56.934 INFO:tasks.workunit.client.0.smithi066.stdout:5/636: getdents d5/de/d50/d42/d49 0 2024-09-12T22:49:56.935 INFO:tasks.workunit.client.0.smithi066.stdout:3/567: mkdir d0/d2/d1d/d87/d40/d44/d55/d91/dcb 0 2024-09-12T22:49:56.935 INFO:tasks.workunit.client.0.smithi066.stdout:9/577: symlink d9/d31/d34/d4d/lbf 0 2024-09-12T22:49:56.935 INFO:tasks.workunit.client.0.smithi066.stdout:3/568: stat d0/d2/d6/l5d 0 2024-09-12T22:49:56.935 INFO:tasks.workunit.client.0.smithi066.stdout:1/470: creat d0/dc/d1e/f8a x:0 0 0 2024-09-12T22:49:56.935 INFO:tasks.workunit.client.0.smithi066.stdout:9/578: fdatasync d9/dc/d46/d8a/f95 0 2024-09-12T22:49:56.935 INFO:tasks.workunit.client.0.smithi066.stdout:1/471: fsync d0/d36/d6b/f80 0 2024-09-12T22:49:56.935 INFO:tasks.workunit.client.0.smithi066.stdout:3/569: dread - d0/d2/d7/d92/fb6 zero size 2024-09-12T22:49:56.935 INFO:tasks.workunit.client.0.smithi066.stdout:5/637: truncate d5/d14/f69 3192687 0 2024-09-12T22:49:56.935 INFO:tasks.workunit.client.0.smithi066.stdout:8/590: truncate d17/d49/d4b/db5/fb7 164578 0 2024-09-12T22:49:56.935 INFO:tasks.workunit.client.0.smithi066.stdout:1/472: unlink d0/d36/f62 0 2024-09-12T22:49:56.935 INFO:tasks.workunit.client.0.smithi066.stdout:9/579: symlink d9/d31/d34/d4d/lc0 0 2024-09-12T22:49:56.935 INFO:tasks.workunit.client.0.smithi066.stdout:5/638: mkdir d5/d11/d23/d6f/daa/dbb 0 2024-09-12T22:49:56.936 INFO:tasks.workunit.client.0.smithi066.stdout:8/591: mkdir d17/d40/d74/da3/dac/dc8 0 2024-09-12T22:49:56.936 INFO:tasks.workunit.client.0.smithi066.stdout:8/592: mknod d17/d40/dc4/cc9 0 2024-09-12T22:49:56.936 INFO:tasks.workunit.client.0.smithi066.stdout:5/639: rename d5/d14/f75 to d5/de/d50/d42/d9d/fbc 0 2024-09-12T22:49:56.936 INFO:tasks.workunit.client.0.smithi066.stdout:5/640: write d5/d11/f43 [4954001,127183] 0 2024-09-12T22:49:56.936 INFO:tasks.workunit.client.0.smithi066.stdout:8/593: creat d17/d40/d47/d4d/fca x:0 0 0 2024-09-12T22:49:56.936 INFO:tasks.workunit.client.0.smithi066.stdout:3/570: dwrite d0/d2/d1d/d87/d40/dbd/d74/f86 [0,4194304] 0 2024-09-12T22:49:56.936 INFO:tasks.workunit.client.0.smithi066.stdout:5/641: creat d5/d11/d5d/d8a/fbd x:0 0 0 2024-09-12T22:49:56.936 INFO:tasks.workunit.client.0.smithi066.stdout:8/594: mkdir d17/d49/d4b/d4e/daf/dcb 0 2024-09-12T22:49:56.936 INFO:tasks.workunit.client.0.smithi066.stdout:9/580: dwrite d9/d31/d58/da4/fb4 [0,4194304] 0 2024-09-12T22:49:56.936 INFO:tasks.workunit.client.0.smithi066.stdout:9/581: chown d9/dc/d46 1 1 2024-09-12T22:49:56.936 INFO:tasks.workunit.client.0.smithi066.stdout:2/563: dread d1/f6 [0,4194304] 0 2024-09-12T22:49:56.936 INFO:tasks.workunit.client.0.smithi066.stdout:7/490: dread d0/d6/f8 [0,4194304] 0 2024-09-12T22:49:56.936 INFO:tasks.workunit.client.0.smithi066.stdout:2/564: readlink d1/db/l58 0 2024-09-12T22:49:56.937 INFO:tasks.workunit.client.0.smithi066.stdout:8/595: creat d17/d49/d4b/d57/fcc x:0 0 0 2024-09-12T22:49:56.937 INFO:tasks.workunit.client.0.smithi066.stdout:3/571: rename d0/d2/d1d/d87/d49/fa4 to d0/db3/fcc 0 2024-09-12T22:49:56.937 INFO:tasks.workunit.client.0.smithi066.stdout:9/582: creat d9/d31/d58/fc1 x:0 0 0 2024-09-12T22:49:56.937 INFO:tasks.workunit.client.0.smithi066.stdout:7/491: fsync d0/d19/d24/d33/d27/f35 0 2024-09-12T22:49:56.937 INFO:tasks.workunit.client.0.smithi066.stdout:8/596: mknod d17/d40/d74/ccd 0 2024-09-12T22:49:56.937 INFO:tasks.workunit.client.0.smithi066.stdout:7/492: fsync d0/f54 0 2024-09-12T22:49:56.937 INFO:tasks.workunit.client.0.smithi066.stdout:9/583: mkdir d9/d31/d77/dc2 0 2024-09-12T22:49:56.937 INFO:tasks.workunit.client.0.smithi066.stdout:3/572: rmdir d0/d2/d1d/d87/d49/dc8 39 2024-09-12T22:49:56.937 INFO:tasks.workunit.client.0.smithi066.stdout:4/624: dread d5/d8/d16/d93/d9c/d98/d8b/f97 [0,4194304] 0 2024-09-12T22:49:56.937 INFO:tasks.workunit.client.0.smithi066.stdout:8/597: mknod d17/d40/d47/cce 0 2024-09-12T22:49:56.937 INFO:tasks.workunit.client.0.smithi066.stdout:7/493: write d0/d19/d24/fa0 [401970,40784] 0 2024-09-12T22:49:56.937 INFO:tasks.workunit.client.0.smithi066.stdout:3/573: chown d0/d2/d1d/d87/d49/dc8 1571322668 1 2024-09-12T22:49:56.937 INFO:tasks.workunit.client.0.smithi066.stdout:8/598: write f16 [754546,89240] 0 2024-09-12T22:49:56.938 INFO:tasks.workunit.client.0.smithi066.stdout:9/584: write d9/d31/d58/dbc/f74 [1038116,78490] 0 2024-09-12T22:49:56.938 INFO:tasks.workunit.client.0.smithi066.stdout:4/625: fdatasync d5/d8/d16/d93/d9c/d98/fa2 0 2024-09-12T22:49:56.938 INFO:tasks.workunit.client.0.smithi066.stdout:7/494: fdatasync d0/d19/d26/f28 0 2024-09-12T22:49:56.938 INFO:tasks.workunit.client.0.smithi066.stdout:9/585: creat d9/d31/d77/fc3 x:0 0 0 2024-09-12T22:49:56.938 INFO:tasks.workunit.client.0.smithi066.stdout:8/599: read - d17/d49/d4b/d57/d5e/d62/fbc zero size 2024-09-12T22:49:56.938 INFO:tasks.workunit.client.0.smithi066.stdout:7/495: write d0/d19/d26/d5a/f6d [4185553,43877] 0 2024-09-12T22:49:56.938 INFO:tasks.workunit.client.0.smithi066.stdout:9/586: link d9/d31/d77/d8f/fb3 d9/dc/fc4 0 2024-09-12T22:49:56.938 INFO:tasks.workunit.client.0.smithi066.stdout:8/600: truncate d17/d49/d4b/d57/fb9 7864 0 2024-09-12T22:49:56.938 INFO:tasks.workunit.client.0.smithi066.stdout:2/565: dwrite d1/d11/d26/f30 [0,4194304] 0 2024-09-12T22:49:56.938 INFO:tasks.workunit.client.0.smithi066.stdout:7/496: creat d0/d19/d7f/fa2 x:0 0 0 2024-09-12T22:49:56.938 INFO:tasks.workunit.client.0.smithi066.stdout:9/587: dread - d9/dc/f6a zero size 2024-09-12T22:49:56.938 INFO:tasks.workunit.client.0.smithi066.stdout:7/497: chown d0/d6 95457283 1 2024-09-12T22:49:56.938 INFO:tasks.workunit.client.0.smithi066.stdout:8/601: write d17/d40/f4c [468443,64548] 0 2024-09-12T22:49:56.939 INFO:tasks.workunit.client.0.smithi066.stdout:2/566: creat d1/d11/faf x:0 0 0 2024-09-12T22:49:56.939 INFO:tasks.workunit.client.0.smithi066.stdout:1/473: write d0/f13 [1625673,36547] 0 2024-09-12T22:49:56.939 INFO:tasks.workunit.client.0.smithi066.stdout:0/569: dread d1/d8/d1b/d59/faf [0,4194304] 0 2024-09-12T22:49:56.939 INFO:tasks.workunit.client.0.smithi066.stdout:3/574: dwrite d0/d2/d1d/d87/d40/dbd/f60 [4194304,4194304] 0 2024-09-12T22:49:56.939 INFO:tasks.workunit.client.0.smithi066.stdout:2/567: fdatasync d1/d11/d53/f7f 0 2024-09-12T22:49:56.939 INFO:tasks.workunit.client.0.smithi066.stdout:3/575: write d0/d2/f6e [936950,19196] 0 2024-09-12T22:49:56.939 INFO:tasks.workunit.client.0.smithi066.stdout:5/642: write d5/d11/d21/d78/f99 [5067223,122511] 0 2024-09-12T22:49:56.939 INFO:tasks.workunit.client.0.smithi066.stdout:9/588: mknod d9/d31/d58/dbc/cc5 0 2024-09-12T22:49:56.939 INFO:tasks.workunit.client.0.smithi066.stdout:4/626: write d5/d8/d10/f6a [3280968,88546] 0 2024-09-12T22:49:56.939 INFO:tasks.workunit.client.0.smithi066.stdout:7/498: creat d0/d19/d24/fa3 x:0 0 0 2024-09-12T22:49:56.939 INFO:tasks.workunit.client.0.smithi066.stdout:0/570: creat d1/d36/d65/dc2/fd0 x:0 0 0 2024-09-12T22:49:56.939 INFO:tasks.workunit.client.0.smithi066.stdout:1/474: rename d0/d36/d57/l49 to d0/d4e/l8b 0 2024-09-12T22:49:56.939 INFO:tasks.workunit.client.0.smithi066.stdout:2/568: creat d1/dd/d68/fb0 x:0 0 0 2024-09-12T22:49:56.940 INFO:tasks.workunit.client.0.smithi066.stdout:8/602: mknod d17/d2c/dab/ccf 0 2024-09-12T22:49:56.940 INFO:tasks.workunit.client.0.smithi066.stdout:3/576: creat d0/d2/d7/d29/fcd x:0 0 0 2024-09-12T22:49:56.940 INFO:tasks.workunit.client.0.smithi066.stdout:1/475: chown d0/d36 4381 1 2024-09-12T22:49:56.940 INFO:tasks.workunit.client.0.smithi066.stdout:7/499: creat d0/d6/d83/fa4 x:0 0 0 2024-09-12T22:49:56.940 INFO:tasks.workunit.client.0.smithi066.stdout:4/627: chown d5/d3e/d8d/dce/f3f 2610 1 2024-09-12T22:49:56.940 INFO:tasks.workunit.client.0.smithi066.stdout:5/643: read - d5/d11/d21/f7f zero size 2024-09-12T22:49:56.940 INFO:tasks.workunit.client.0.smithi066.stdout:8/603: chown d17/d1b/l48 240 1 2024-09-12T22:49:56.940 INFO:tasks.workunit.client.0.smithi066.stdout:9/589: rename d9/d31/d34/d4d/d8c/d8d to d9/dc6 0 2024-09-12T22:49:56.940 INFO:tasks.workunit.client.0.smithi066.stdout:2/569: readlink d1/d11/d26/d4f/d5f/d61/d7e/l46 0 2024-09-12T22:49:56.940 INFO:tasks.workunit.client.0.smithi066.stdout:8/604: rmdir d17/d40/d74/d99 39 2024-09-12T22:49:56.940 INFO:tasks.workunit.client.0.smithi066.stdout:5/644: truncate d5/d11/d21/f47 8666833 0 2024-09-12T22:49:56.940 INFO:tasks.workunit.client.0.smithi066.stdout:4/628: write d5/d8/d16/d1b/d1e/d5a/f85 [4272978,60860] 0 2024-09-12T22:49:56.940 INFO:tasks.workunit.client.0.smithi066.stdout:7/500: rename d0/d19/d24/d33/d27/f2a to d0/d19/d24/d33/d27/d70/d90/fa5 0 2024-09-12T22:49:56.941 INFO:tasks.workunit.client.0.smithi066.stdout:8/605: mknod d17/d40/d47/d66/cd0 0 2024-09-12T22:49:56.941 INFO:tasks.workunit.client.0.smithi066.stdout:5/645: mknod d5/de/cbe 0 2024-09-12T22:49:56.941 INFO:tasks.workunit.client.0.smithi066.stdout:5/646: readlink d5/d11/d7c/l89 0 2024-09-12T22:49:56.941 INFO:tasks.workunit.client.0.smithi066.stdout:7/501: mknod d0/d19/d60/d53/ca6 0 2024-09-12T22:49:56.941 INFO:tasks.workunit.client.0.smithi066.stdout:3/577: dread d0/d2/d1d/d87/d40/dbd/d74/f86 [0,4194304] 0 2024-09-12T22:49:56.941 INFO:tasks.workunit.client.0.smithi066.stdout:2/570: dwrite d1/dd/f71 [0,4194304] 0 2024-09-12T22:49:56.941 INFO:tasks.workunit.client.0.smithi066.stdout:0/571: dread d1/d8/d1c/f17 [0,4194304] 0 2024-09-12T22:49:56.941 INFO:tasks.workunit.client.0.smithi066.stdout:7/502: dread d0/f54 [0,4194304] 0 2024-09-12T22:49:56.941 INFO:tasks.workunit.client.0.smithi066.stdout:4/629: dread d5/d8/d16/d1b/d1e/d5a/f67 [0,4194304] 0 2024-09-12T22:49:56.941 INFO:tasks.workunit.client.0.smithi066.stdout:2/571: symlink d1/d11/d26/d4f/d7c/lb1 0 2024-09-12T22:49:56.941 INFO:tasks.workunit.client.0.smithi066.stdout:6/625: dread d6/d23/d25/f2e [0,4194304] 0 2024-09-12T22:49:56.941 INFO:tasks.workunit.client.0.smithi066.stdout:8/606: dwrite d17/d49/d4b/d57/f80 [0,4194304] 0 2024-09-12T22:49:56.941 INFO:tasks.workunit.client.0.smithi066.stdout:0/572: truncate d1/d8/fe 2085951 0 2024-09-12T22:49:56.942 INFO:tasks.workunit.client.0.smithi066.stdout:2/572: fsync d1/dd/f14 0 2024-09-12T22:49:56.942 INFO:tasks.workunit.client.0.smithi066.stdout:1/476: write d0/dc/d33/f6c [3775875,4805] 0 2024-09-12T22:49:56.942 INFO:tasks.workunit.client.0.smithi066.stdout:5/647: dwrite d5/de/d50/d8b/fa9 [0,4194304] 0 2024-09-12T22:49:56.942 INFO:tasks.workunit.client.0.smithi066.stdout:4/630: write d5/d8/d10/de/f14 [2426335,58669] 0 2024-09-12T22:49:56.942 INFO:tasks.workunit.client.0.smithi066.stdout:7/503: symlink d0/d19/d26/d5a/la7 0 2024-09-12T22:49:56.942 INFO:tasks.workunit.client.0.smithi066.stdout:0/573: symlink d1/d8/d1b/dac/ld1 0 2024-09-12T22:49:56.942 INFO:tasks.workunit.client.0.smithi066.stdout:3/578: dwrite d0/d2/fa [4194304,4194304] 0 2024-09-12T22:49:56.942 INFO:tasks.workunit.client.0.smithi066.stdout:6/626: mkdir d6/d23/d41/db6/dd3 0 2024-09-12T22:49:56.942 INFO:tasks.workunit.client.0.smithi066.stdout:6/627: dread - d6/d23/f27 zero size 2024-09-12T22:49:56.942 INFO:tasks.workunit.client.0.smithi066.stdout:9/590: fdatasync d9/d31/d77/f91 0 2024-09-12T22:49:56.942 INFO:tasks.workunit.client.0.smithi066.stdout:2/573: chown d1/d11/d26/d4f/d5f/d61/d7e/f48 0 1 2024-09-12T22:49:56.942 INFO:tasks.workunit.client.0.smithi066.stdout:0/574: chown d1/d36/c50 5 1 2024-09-12T22:49:56.942 INFO:tasks.workunit.client.0.smithi066.stdout:0/575: fdatasync d1/d8/f35 0 2024-09-12T22:49:56.942 INFO:tasks.workunit.client.0.smithi066.stdout:3/579: mknod d0/d2/d7/d13/cce 0 2024-09-12T22:49:56.943 INFO:tasks.workunit.client.0.smithi066.stdout:8/607: mkdir d17/d49/d4b/d57/d5e/d62/dc1/dd1 0 2024-09-12T22:49:56.943 INFO:tasks.workunit.client.0.smithi066.stdout:5/648: symlink d5/de/d50/d42/lbf 0 2024-09-12T22:49:56.943 INFO:tasks.workunit.client.0.smithi066.stdout:7/504: link d0/d19/d24/d33/f5b d0/d19/d60/d85/d8b/fa8 0 2024-09-12T22:49:56.943 INFO:tasks.workunit.client.0.smithi066.stdout:0/576: creat d1/d36/fd2 x:0 0 0 2024-09-12T22:49:56.943 INFO:tasks.workunit.client.0.smithi066.stdout:2/574: dread d1/dd/d12/d18/da8/f82 [0,4194304] 0 2024-09-12T22:49:56.943 INFO:tasks.workunit.client.0.smithi066.stdout:3/580: fdatasync d0/d2/d7/f5e 0 2024-09-12T22:49:56.943 INFO:tasks.workunit.client.0.smithi066.stdout:5/649: stat d5/d11/d5d/d97 0 2024-09-12T22:49:56.943 INFO:tasks.workunit.client.0.smithi066.stdout:1/477: dread d0/d28/f4f [0,4194304] 0 2024-09-12T22:49:56.943 INFO:tasks.workunit.client.0.smithi066.stdout:9/591: link d9/d31/l55 d9/dc/d46/lc7 0 2024-09-12T22:49:56.943 INFO:tasks.workunit.client.0.smithi066.stdout:7/505: creat d0/d19/d26/d48/fa9 x:0 0 0 2024-09-12T22:49:56.943 INFO:tasks.workunit.client.0.smithi066.stdout:1/478: unlink d0/l11 0 2024-09-12T22:49:56.943 INFO:tasks.workunit.client.0.smithi066.stdout:9/592: stat d9/f53 0 2024-09-12T22:49:56.943 INFO:tasks.workunit.client.0.smithi066.stdout:2/575: chown d1/d11/d26/d4f/d5f/d61/d7e/f8c 1925 1 2024-09-12T22:49:56.944 INFO:tasks.workunit.client.0.smithi066.stdout:7/506: stat d0/d19/d24/d33/d27/d70/d90 0 2024-09-12T22:49:56.944 INFO:tasks.workunit.client.0.smithi066.stdout:4/631: dwrite d5/d3e/d8d/dc7/f83 [0,4194304] 0 2024-09-12T22:49:56.944 INFO:tasks.workunit.client.0.smithi066.stdout:3/581: dread d0/d2/d1d/d87/d40/f96 [0,4194304] 0 2024-09-12T22:49:56.944 INFO:tasks.workunit.client.0.smithi066.stdout:5/650: write d5/d11/d23/f2f [1910565,22817] 0 2024-09-12T22:49:56.944 INFO:tasks.workunit.client.0.smithi066.stdout:5/651: fdatasync d5/de/fa4 0 2024-09-12T22:49:56.944 INFO:tasks.workunit.client.0.smithi066.stdout:4/632: write d5/d8/d10/de/d2d/fa1 [681699,5062] 0 2024-09-12T22:49:56.944 INFO:tasks.workunit.client.0.smithi066.stdout:2/576: creat d1/d11/d53/fb2 x:0 0 0 2024-09-12T22:49:56.944 INFO:tasks.workunit.client.0.smithi066.stdout:7/507: mknod d0/d6/d83/caa 0 2024-09-12T22:49:56.944 INFO:tasks.workunit.client.0.smithi066.stdout:0/577: dwrite d1/d8/d1f/f52 [0,4194304] 0 2024-09-12T22:49:56.944 INFO:tasks.workunit.client.0.smithi066.stdout:9/593: truncate d9/dc/d36/f71 439783 0 2024-09-12T22:49:56.944 INFO:tasks.workunit.client.0.smithi066.stdout:5/652: creat d5/d11/d7c/fc0 x:0 0 0 2024-09-12T22:49:56.944 INFO:tasks.workunit.client.0.smithi066.stdout:2/577: dread - d1/d11/d26/d4f/d7c/faa zero size 2024-09-12T22:49:56.945 INFO:tasks.workunit.client.0.smithi066.stdout:1/479: dwrite d0/f1c [0,4194304] 0 2024-09-12T22:49:56.945 INFO:tasks.workunit.client.0.smithi066.stdout:0/578: fdatasync d1/d8/d1b/d88/fc9 0 2024-09-12T22:49:56.945 INFO:tasks.workunit.client.0.smithi066.stdout:5/653: truncate d5/f3e 4221072 0 2024-09-12T22:49:56.945 INFO:tasks.workunit.client.0.smithi066.stdout:2/578: fdatasync d1/d11/d26/d4f/d5f/d61/d7e/f48 0 2024-09-12T22:49:56.945 INFO:tasks.workunit.client.0.smithi066.stdout:0/579: creat d1/d8/d1f/d25/d9c/fd3 x:0 0 0 2024-09-12T22:49:56.945 INFO:tasks.workunit.client.0.smithi066.stdout:5/654: unlink d5/d11/d23/d6f/f73 0 2024-09-12T22:49:56.945 INFO:tasks.workunit.client.0.smithi066.stdout:4/633: dwrite d5/d8/d16/d1b/d1e/d1f/fb1 [0,4194304] 0 2024-09-12T22:49:56.945 INFO:tasks.workunit.client.0.smithi066.stdout:1/480: dread d0/d36/d57/f3e [0,4194304] 0 2024-09-12T22:49:56.945 INFO:tasks.workunit.client.0.smithi066.stdout:9/594: dwrite d9/dc/f19 [0,4194304] 0 2024-09-12T22:49:56.945 INFO:tasks.workunit.client.0.smithi066.stdout:4/634: unlink d5/d8/d16/d1b/fcd 0 2024-09-12T22:49:56.945 INFO:tasks.workunit.client.0.smithi066.stdout:2/579: link d1/d11/d26/d4f/d5f/d61/d7e/f48 d1/dd/d12/d67/fb3 0 2024-09-12T22:49:56.945 INFO:tasks.workunit.client.0.smithi066.stdout:1/481: symlink d0/d89/l8c 0 2024-09-12T22:49:56.945 INFO:tasks.workunit.client.0.smithi066.stdout:0/580: dwrite d1/d8/d1f/f6c [0,4194304] 0 2024-09-12T22:49:56.946 INFO:tasks.workunit.client.0.smithi066.stdout:2/580: dread - d1/d11/d26/d4f/fa5 zero size 2024-09-12T22:49:56.946 INFO:tasks.workunit.client.0.smithi066.stdout:9/595: mkdir d9/d31/d58/d7f/dc8 0 2024-09-12T22:49:56.946 INFO:tasks.workunit.client.0.smithi066.stdout:4/635: mknod d5/d8/d10/cd9 0 2024-09-12T22:49:56.946 INFO:tasks.workunit.client.0.smithi066.stdout:1/482: symlink d0/dc/d1d/l8d 0 2024-09-12T22:49:56.946 INFO:tasks.workunit.client.0.smithi066.stdout:3/582: dread d0/d2/d7/d29/fc5 [0,4194304] 0 2024-09-12T22:49:56.946 INFO:tasks.workunit.client.0.smithi066.stdout:5/655: dwrite d5/de/d50/d42/d49/f93 [0,4194304] 0 2024-09-12T22:49:56.946 INFO:tasks.workunit.client.0.smithi066.stdout:0/581: symlink d1/d8/d1f/d47/ld4 0 2024-09-12T22:49:56.946 INFO:tasks.workunit.client.0.smithi066.stdout:4/636: chown d5/d8/d16/d1b/d72 2849 1 2024-09-12T22:49:56.946 INFO:tasks.workunit.client.0.smithi066.stdout:1/483: write d0/dc/d44/f84 [185805,10237] 0 2024-09-12T22:49:56.946 INFO:tasks.workunit.client.0.smithi066.stdout:5/656: chown d5/de/d50/d42/d49/f87 293 1 2024-09-12T22:49:56.946 INFO:tasks.workunit.client.0.smithi066.stdout:0/582: creat d1/d8/d1f/fd5 x:0 0 0 2024-09-12T22:49:56.946 INFO:tasks.workunit.client.0.smithi066.stdout:4/637: unlink d5/d8/c22 0 2024-09-12T22:49:56.946 INFO:tasks.workunit.client.0.smithi066.stdout:1/484: write d0/d9/f4d [2001533,60635] 0 2024-09-12T22:49:56.947 INFO:tasks.workunit.client.0.smithi066.stdout:0/583: chown d1/d8/d1f 1017 1 2024-09-12T22:49:56.947 INFO:tasks.workunit.client.0.smithi066.stdout:7/508: write d0/d19/d60/f52 [1530004,99416] 0 2024-09-12T22:49:56.947 INFO:tasks.workunit.client.0.smithi066.stdout:1/485: mkdir d0/d36/d8e 0 2024-09-12T22:49:56.947 INFO:tasks.workunit.client.0.smithi066.stdout:5/657: chown d5/d11/d5d/cae 109588531 1 2024-09-12T22:49:56.947 INFO:tasks.workunit.client.0.smithi066.stdout:4/638: creat d5/d8/d16/d1b/d72/fda x:0 0 0 2024-09-12T22:49:56.947 INFO:tasks.workunit.client.0.smithi066.stdout:1/486: write d0/d28/f5f [538979,4890] 0 2024-09-12T22:49:56.947 INFO:tasks.workunit.client.0.smithi066.stdout:4/639: fdatasync d5/d8/d16/d1b/d1e/d1f/fa9 0 2024-09-12T22:49:56.947 INFO:tasks.workunit.client.0.smithi066.stdout:6/628: dread d6/d78/d4a/fb2 [0,4194304] 0 2024-09-12T22:49:56.947 INFO:tasks.workunit.client.0.smithi066.stdout:7/509: unlink d0/d19/d26/d5a/f6d 0 2024-09-12T22:49:56.947 INFO:tasks.workunit.client.0.smithi066.stdout:1/487: dread d0/d28/f4f [0,4194304] 0 2024-09-12T22:49:56.947 INFO:tasks.workunit.client.0.smithi066.stdout:6/629: mknod d6/d59/cd4 0 2024-09-12T22:49:56.947 INFO:tasks.workunit.client.0.smithi066.stdout:0/584: rename d1/d8/d1b/d88/fcc to d1/d8/d1c/d13/fd6 0 2024-09-12T22:49:56.947 INFO:tasks.workunit.client.0.smithi066.stdout:3/583: dwrite d0/d2/d1d/d87/d40/dbd/d74/f86 [0,4194304] 0 2024-09-12T22:49:56.948 INFO:tasks.workunit.client.0.smithi066.stdout:4/640: rename d5/d8/d10/lf to d5/d8/d10/de/d39/dc0/ldb 0 2024-09-12T22:49:56.948 INFO:tasks.workunit.client.0.smithi066.stdout:0/585: write d1/f7 [2519462,26816] 0 2024-09-12T22:49:56.948 INFO:tasks.workunit.client.0.smithi066.stdout:3/584: unlink d0/d2/d6/c82 0 2024-09-12T22:49:56.948 INFO:tasks.workunit.client.0.smithi066.stdout:6/630: link d6/d7/dc/l74 d6/d23/d25/d4e/dc4/ld5 0 2024-09-12T22:49:56.948 INFO:tasks.workunit.client.0.smithi066.stdout:4/641: mkdir d5/d8/d16/d93/d9c/d98/ddc 0 2024-09-12T22:49:56.948 INFO:tasks.workunit.client.0.smithi066.stdout:3/585: dread - d0/d2/d1d/d87/f65 zero size 2024-09-12T22:49:56.948 INFO:tasks.workunit.client.0.smithi066.stdout:6/631: dread - d6/d51/fc3 zero size 2024-09-12T22:49:56.948 INFO:tasks.workunit.client.0.smithi066.stdout:6/632: chown d6/fb 0 1 2024-09-12T22:49:56.948 INFO:tasks.workunit.client.0.smithi066.stdout:1/488: dwrite d0/f7 [0,4194304] 0 2024-09-12T22:49:56.948 INFO:tasks.workunit.client.0.smithi066.stdout:4/642: rename d5/d8/d10/de/d2d/d64/l68 to d5/d8/d16/dc2/ldd 0 2024-09-12T22:49:56.948 INFO:tasks.workunit.client.0.smithi066.stdout:2/581: truncate d1/d11/d26/d4f/d52/f93 1175605 0 2024-09-12T22:49:56.948 INFO:tasks.workunit.client.0.smithi066.stdout:3/586: rename d0/d2/d7/d92 to d0/d2/d7/dc4/dcf 0 2024-09-12T22:49:56.948 INFO:tasks.workunit.client.0.smithi066.stdout:6/633: rmdir d6/d23/d62/d79/db4 0 2024-09-12T22:49:56.949 INFO:tasks.workunit.client.0.smithi066.stdout:1/489: mkdir d0/dc/d8f 0 2024-09-12T22:49:56.949 INFO:tasks.workunit.client.0.smithi066.stdout:4/643: mknod d5/d8/d16/cde 0 2024-09-12T22:49:56.949 INFO:tasks.workunit.client.0.smithi066.stdout:7/510: write d0/d19/d26/d48/d59/f7b [2921359,130810] 0 2024-09-12T22:49:56.949 INFO:tasks.workunit.client.0.smithi066.stdout:5/658: read d5/d11/f54 [750378,56157] 0 2024-09-12T22:49:56.949 INFO:tasks.workunit.client.0.smithi066.stdout:3/587: stat d0/d2/d7/d13/l56 0 2024-09-12T22:49:56.949 INFO:tasks.workunit.client.0.smithi066.stdout:0/586: dwrite d1/d8/d1f/d30/f55 [4194304,4194304] 0 2024-09-12T22:49:56.949 INFO:tasks.workunit.client.0.smithi066.stdout:2/582: write d1/d11/d26/d4f/d52/d56/f65 [453538,14370] 0 2024-09-12T22:49:56.949 INFO:tasks.workunit.client.0.smithi066.stdout:1/490: chown d0/d28/f4f 961 1 2024-09-12T22:49:56.949 INFO:tasks.workunit.client.0.smithi066.stdout:0/587: write d1/d36/d65/dc2/fce [589115,17600] 0 2024-09-12T22:49:56.949 INFO:tasks.workunit.client.0.smithi066.stdout:3/588: write d0/d2/d1d/d87/f8d [132519,55590] 0 2024-09-12T22:49:56.949 INFO:tasks.workunit.client.0.smithi066.stdout:6/634: truncate d6/d23/f29 482977 0 2024-09-12T22:49:56.949 INFO:tasks.workunit.client.0.smithi066.stdout:7/511: mknod d0/cab 0 2024-09-12T22:49:56.949 INFO:tasks.workunit.client.0.smithi066.stdout:0/588: stat d1/c58 0 2024-09-12T22:49:56.950 INFO:tasks.workunit.client.0.smithi066.stdout:2/583: stat d1/d11/d26/d4f/d52/f69 0 2024-09-12T22:49:56.950 INFO:tasks.workunit.client.0.smithi066.stdout:2/584: dread - d1/dd/d68/fb0 zero size 2024-09-12T22:49:56.950 INFO:tasks.workunit.client.0.smithi066.stdout:4/644: rename d5/d8/d16/d93/d9c/d98/dab/fc5 to d5/d8/d16/d93/d9c/d98/fdf 0 2024-09-12T22:49:56.950 INFO:tasks.workunit.client.0.smithi066.stdout:0/589: fdatasync d1/d5b/dba/fc1 0 2024-09-12T22:49:56.950 INFO:tasks.workunit.client.0.smithi066.stdout:7/512: symlink d0/d19/d74/lac 0 2024-09-12T22:49:56.950 INFO:tasks.workunit.client.0.smithi066.stdout:2/585: mknod d1/d11/d26/cb4 0 2024-09-12T22:49:56.950 INFO:tasks.workunit.client.0.smithi066.stdout:4/645: chown d5/d8/d10/de/d2d/fae 14 1 2024-09-12T22:49:56.950 INFO:tasks.workunit.client.0.smithi066.stdout:0/590: write d1/d36/fd2 [554904,79895] 0 2024-09-12T22:49:56.950 INFO:tasks.workunit.client.0.smithi066.stdout:5/659: dwrite d5/d11/d21/fb0 [0,4194304] 0 2024-09-12T22:49:56.950 INFO:tasks.workunit.client.0.smithi066.stdout:6/635: dwrite d6/d7/dc/fbe [0,4194304] 0 2024-09-12T22:49:56.951 INFO:tasks.workunit.client.0.smithi066.stdout:6/636: read - d6/d78/f9b zero size 2024-09-12T22:49:56.951 INFO:tasks.workunit.client.0.smithi066.stdout:3/589: dwrite d0/d2/d1d/d87/d6b/fbe [4194304,4194304] 0 2024-09-12T22:49:56.951 INFO:tasks.workunit.client.0.smithi066.stdout:6/637: fsync d6/d23/d62/d79/fa9 0 2024-09-12T22:49:56.951 INFO:tasks.workunit.client.0.smithi066.stdout:4/646: mkdir d5/d8/d16/d93/de0 0 2024-09-12T22:49:56.951 INFO:tasks.workunit.client.0.smithi066.stdout:0/591: mkdir d1/d36/d65/dc2/dd7 0 2024-09-12T22:49:56.951 INFO:tasks.workunit.client.0.smithi066.stdout:7/513: link d0/d19/d24/f93 d0/d19/d26/fad 0 2024-09-12T22:49:56.951 INFO:tasks.workunit.client.0.smithi066.stdout:5/660: mknod d5/d14/dba/cc1 0 2024-09-12T22:49:56.951 INFO:tasks.workunit.client.0.smithi066.stdout:7/514: chown d0/d19/d60/d85/d8b/fa8 341579 1 2024-09-12T22:49:56.951 INFO:tasks.workunit.client.0.smithi066.stdout:4/647: write d5/d3e/d65/dac/fcb [874708,66760] 0 2024-09-12T22:49:56.951 INFO:tasks.workunit.client.0.smithi066.stdout:6/638: mkdir d6/d23/d25/d4e/dc4/d50/dd6 0 2024-09-12T22:49:56.951 INFO:tasks.workunit.client.0.smithi066.stdout:0/592: rename d1/d8/d1c/dd to d1/d8/d1c/d13/d2f/dd8 0 2024-09-12T22:49:56.951 INFO:tasks.workunit.client.0.smithi066.stdout:3/590: dread d0/d2/d1d/d87/d40/f96 [0,4194304] 0 2024-09-12T22:49:56.951 INFO:tasks.workunit.client.0.smithi066.stdout:1/491: dwrite d0/d9/f14 [0,4194304] 0 2024-09-12T22:49:56.952 INFO:tasks.workunit.client.0.smithi066.stdout:7/515: fsync d0/d19/d26/d48/f49 0 2024-09-12T22:49:56.952 INFO:tasks.workunit.client.0.smithi066.stdout:4/648: chown d5/d8/d10/f6a 3869 1 2024-09-12T22:49:56.952 INFO:tasks.workunit.client.0.smithi066.stdout:1/492: write d0/dc/d44/f77 [819754,30459] 0 2024-09-12T22:49:56.952 INFO:tasks.workunit.client.0.smithi066.stdout:0/593: stat d1/d8/d1c/d13/la6 0 2024-09-12T22:49:56.952 INFO:tasks.workunit.client.0.smithi066.stdout:6/639: write d6/d7/dc/f43 [4065141,3575] 0 2024-09-12T22:49:56.952 INFO:tasks.workunit.client.0.smithi066.stdout:5/661: creat d5/d11/d21/d4d/fc2 x:0 0 0 2024-09-12T22:49:56.952 INFO:tasks.workunit.client.0.smithi066.stdout:2/586: dwrite d1/dd/d12/d18/da8/f88 [0,4194304] 0 2024-09-12T22:49:56.952 INFO:tasks.workunit.client.0.smithi066.stdout:3/591: chown d0/d2/d1d/d87/d6b/db2/c53 10156 1 2024-09-12T22:49:56.952 INFO:tasks.workunit.client.0.smithi066.stdout:1/493: chown d0/d9/c20 1683764 1 2024-09-12T22:49:56.952 INFO:tasks.workunit.client.0.smithi066.stdout:0/594: creat d1/d5b/dba/fd9 x:0 0 0 2024-09-12T22:49:56.952 INFO:tasks.workunit.client.0.smithi066.stdout:0/595: chown d1/d8/f35 228422074 1 2024-09-12T22:49:56.952 INFO:tasks.workunit.client.0.smithi066.stdout:2/587: write d1/d44/d51/d70/f92 [61483,73521] 0 2024-09-12T22:49:56.953 INFO:tasks.workunit.client.0.smithi066.stdout:4/649: rmdir d5/d8/d10/de/d2d/d64 39 2024-09-12T22:49:56.953 INFO:tasks.workunit.client.0.smithi066.stdout:5/662: getdents d5/d11/d23/d6f 0 2024-09-12T22:49:56.953 INFO:tasks.workunit.client.0.smithi066.stdout:4/650: write d5/f46 [644458,43712] 0 2024-09-12T22:49:56.953 INFO:tasks.workunit.client.0.smithi066.stdout:6/640: link d6/d23/d25/d4e/dc4/ca4 d6/d23/d25/d2c/d85/cd7 0 2024-09-12T22:49:56.953 INFO:tasks.workunit.client.0.smithi066.stdout:0/596: link d1/d8/d1f/d30/da0/cbd d1/d8/cda 0 2024-09-12T22:49:56.953 INFO:tasks.workunit.client.0.smithi066.stdout:5/663: getdents d5/d11/d7c/d98 0 2024-09-12T22:49:56.953 INFO:tasks.workunit.client.0.smithi066.stdout:6/641: fdatasync d6/d23/d25/d4e/dc4/f12 0 2024-09-12T22:49:56.953 INFO:tasks.workunit.client.0.smithi066.stdout:8/608: dread d17/d40/d47/d4d/d87/fa9 [0,4194304] 0 2024-09-12T22:49:56.953 INFO:tasks.workunit.client.0.smithi066.stdout:1/494: dwrite d0/dc/d33/f6c [0,4194304] 0 2024-09-12T22:49:56.953 INFO:tasks.workunit.client.0.smithi066.stdout:5/664: write d5/d11/d23/f4e [2327636,73115] 0 2024-09-12T22:49:56.953 INFO:tasks.workunit.client.0.smithi066.stdout:6/642: unlink d6/d23/d62/d79/fa9 0 2024-09-12T22:49:56.953 INFO:tasks.workunit.client.0.smithi066.stdout:8/609: symlink d17/d40/d74/da3/ld2 0 2024-09-12T22:49:56.953 INFO:tasks.workunit.client.0.smithi066.stdout:5/665: mkdir d5/d11/d7c/dc3 0 2024-09-12T22:49:56.954 INFO:tasks.workunit.client.0.smithi066.stdout:1/495: rename d0/d28/f5f to d0/dc/d33/f90 0 2024-09-12T22:49:56.954 INFO:tasks.workunit.client.0.smithi066.stdout:2/588: dwrite d1/d11/d26/d4f/d5f/d61/d72/dad/d76/f95 [0,4194304] 0 2024-09-12T22:49:56.954 INFO:tasks.workunit.client.0.smithi066.stdout:5/666: rmdir d5/d14 39 2024-09-12T22:49:56.954 INFO:tasks.workunit.client.0.smithi066.stdout:4/651: dwrite d5/d8/d16/d1b/d1e/d5a/f5d [0,4194304] 0 2024-09-12T22:49:56.954 INFO:tasks.workunit.client.0.smithi066.stdout:1/496: write d0/f16 [1537051,50672] 0 2024-09-12T22:49:56.954 INFO:tasks.workunit.client.0.smithi066.stdout:5/667: dread - d5/d11/d21/d4d/fa3 zero size 2024-09-12T22:49:56.954 INFO:tasks.workunit.client.0.smithi066.stdout:4/652: write d5/f4f [1718440,36825] 0 2024-09-12T22:49:56.954 INFO:tasks.workunit.client.0.smithi066.stdout:8/610: rename d17/l39 to d17/d40/d47/d4d/ld3 0 2024-09-12T22:49:56.954 INFO:tasks.workunit.client.0.smithi066.stdout:2/589: symlink d1/d11/d26/d4f/d52/d56/lb5 0 2024-09-12T22:49:56.954 INFO:tasks.workunit.client.0.smithi066.stdout:1/497: creat d0/dc/d8f/f91 x:0 0 0 2024-09-12T22:49:56.954 INFO:tasks.workunit.client.0.smithi066.stdout:7/516: dwrite d0/d19/d26/d48/d59/f7b [0,4194304] 0 2024-09-12T22:49:56.954 INFO:tasks.workunit.client.0.smithi066.stdout:8/611: chown d17/c6c 13170544 1 2024-09-12T22:49:56.954 INFO:tasks.workunit.client.0.smithi066.stdout:9/596: dread d9/dc/d46/f67 [0,4194304] 0 2024-09-12T22:49:56.954 INFO:tasks.workunit.client.0.smithi066.stdout:2/590: write d1/dd/d12/d1e/f79 [402599,36150] 0 2024-09-12T22:49:56.955 INFO:tasks.workunit.client.0.smithi066.stdout:3/592: truncate d0/d2/d1d/d87/d6b/db2/f45 1335616 0 2024-09-12T22:49:56.955 INFO:tasks.workunit.client.0.smithi066.stdout:1/498: unlink d0/d28/f4f 0 2024-09-12T22:49:56.955 INFO:tasks.workunit.client.0.smithi066.stdout:2/591: readlink d1/db/d42/l6e 0 2024-09-12T22:49:56.955 INFO:tasks.workunit.client.0.smithi066.stdout:6/643: dwrite d6/d7/fae [0,4194304] 0 2024-09-12T22:49:56.955 INFO:tasks.workunit.client.0.smithi066.stdout:4/653: getdents d5/d8/d16/d93/d9c/d98/d8b 0 2024-09-12T22:49:56.955 INFO:tasks.workunit.client.0.smithi066.stdout:7/517: symlink d0/d19/d60/d53/lae 0 2024-09-12T22:49:56.955 INFO:tasks.workunit.client.0.smithi066.stdout:9/597: creat d9/d31/d58/fc9 x:0 0 0 2024-09-12T22:49:56.955 INFO:tasks.workunit.client.0.smithi066.stdout:5/668: dread d5/d11/d21/f47 [4194304,4194304] 0 2024-09-12T22:49:56.955 INFO:tasks.workunit.client.0.smithi066.stdout:6/644: dread - d6/d51/fc3 zero size 2024-09-12T22:49:56.955 INFO:tasks.workunit.client.0.smithi066.stdout:1/499: write d0/dc/d1d/f66 [588740,106525] 0 2024-09-12T22:49:56.955 INFO:tasks.workunit.client.0.smithi066.stdout:7/518: rmdir d0/d19/d24/d33/d27 39 2024-09-12T22:49:56.955 INFO:tasks.workunit.client.0.smithi066.stdout:4/654: getdents d5/d3e/d8d 0 2024-09-12T22:49:56.956 INFO:tasks.workunit.client.0.smithi066.stdout:9/598: mknod d9/cca 0 2024-09-12T22:49:56.956 INFO:tasks.workunit.client.0.smithi066.stdout:6/645: mknod d6/d51/cd8 0 2024-09-12T22:49:56.956 INFO:tasks.workunit.client.0.smithi066.stdout:5/669: creat d5/de/d50/d42/d9d/fc4 x:0 0 0 2024-09-12T22:49:56.956 INFO:tasks.workunit.client.0.smithi066.stdout:8/612: dread d17/d40/d47/d4d/d87/fa9 [0,4194304] 0 2024-09-12T22:49:56.956 INFO:tasks.workunit.client.0.smithi066.stdout:4/655: chown d5/d8/d10/de/d2d/fa1 1292051015 1 2024-09-12T22:49:56.956 INFO:tasks.workunit.client.0.smithi066.stdout:6/646: creat d6/d7/dc/fd9 x:0 0 0 2024-09-12T22:49:56.956 INFO:tasks.workunit.client.0.smithi066.stdout:3/593: dwrite d0/d2/d7/d29/f3d [0,4194304] 0 2024-09-12T22:49:56.956 INFO:tasks.workunit.client.0.smithi066.stdout:9/599: rename d9/dc/d36 to d9/d31/d77/dc2/dcb 0 2024-09-12T22:49:56.956 INFO:tasks.workunit.client.0.smithi066.stdout:6/647: creat d6/d23/d41/db6/fda x:0 0 0 2024-09-12T22:49:56.956 INFO:tasks.workunit.client.0.smithi066.stdout:8/613: read d17/d40/d47/d4d/f93 [701841,128978] 0 2024-09-12T22:49:56.956 INFO:tasks.workunit.client.0.smithi066.stdout:3/594: stat d0/d2/d1d/d87/d40/dbd/c5b 0 2024-09-12T22:49:56.956 INFO:tasks.workunit.client.0.smithi066.stdout:2/592: dwrite d1/d11/d26/d4f/d5f/d61/d7e/f8c [0,4194304] 0 2024-09-12T22:49:56.956 INFO:tasks.workunit.client.0.smithi066.stdout:8/614: stat d17/c24 0 2024-09-12T22:49:56.957 INFO:tasks.workunit.client.0.smithi066.stdout:5/670: dwrite d5/d11/d23/f4e [0,4194304] 0 2024-09-12T22:49:56.957 INFO:tasks.workunit.client.0.smithi066.stdout:9/600: dread d9/dc/fc4 [0,4194304] 0 2024-09-12T22:49:56.957 INFO:tasks.workunit.client.0.smithi066.stdout:3/595: getdents d0/d2/d7/d13/d31 0 2024-09-12T22:49:56.957 INFO:tasks.workunit.client.0.smithi066.stdout:8/615: write d17/d49/d4b/db5/fb7 [121601,49109] 0 2024-09-12T22:49:56.957 INFO:tasks.workunit.client.0.smithi066.stdout:9/601: rmdir d9/d31/d34 39 2024-09-12T22:49:56.957 INFO:tasks.workunit.client.0.smithi066.stdout:8/616: fsync d17/d40/da8/fb1 0 2024-09-12T22:49:56.957 INFO:tasks.workunit.client.0.smithi066.stdout:3/596: mkdir d0/d2/d1d/d87/d40/dd0 0 2024-09-12T22:49:56.957 INFO:tasks.workunit.client.0.smithi066.stdout:5/671: rename d5/de/fa4 to d5/d11/d23/d6f/fc5 0 2024-09-12T22:49:56.957 INFO:tasks.workunit.client.0.smithi066.stdout:4/656: dwrite d5/d8/d10/de/d2d/d64/f6c [0,4194304] 0 2024-09-12T22:49:56.961 INFO:tasks.workunit.client.0.smithi066.stdout:8/617: creat d17/d40/da8/fd4 x:0 0 0 2024-09-12T22:49:56.961 INFO:tasks.workunit.client.0.smithi066.stdout:1/500: truncate d0/dc/d44/f77 391413 0 2024-09-12T22:49:56.961 INFO:tasks.workunit.client.0.smithi066.stdout:4/657: write d5/d8/d16/d1b/f28 [2128471,25119] 0 2024-09-12T22:49:56.961 INFO:tasks.workunit.client.0.smithi066.stdout:4/658: chown d5/d3e 1245 1 2024-09-12T22:49:56.961 INFO:tasks.workunit.client.0.smithi066.stdout:8/618: write d17/d49/d4b/d57/fa6 [869817,57321] 0 2024-09-12T22:49:56.961 INFO:tasks.workunit.client.0.smithi066.stdout:9/602: link d9/d31/d34/d4d/lbf d9/d31/d58/dbc/d9d/lcc 0 2024-09-12T22:49:56.961 INFO:tasks.workunit.client.0.smithi066.stdout:6/648: dwrite d6/d23/d25/d4e/dc4/f18 [0,4194304] 0 2024-09-12T22:49:56.961 INFO:tasks.workunit.client.0.smithi066.stdout:6/649: write d6/d78/f9b [460512,90850] 0 2024-09-12T22:49:56.961 INFO:tasks.workunit.client.0.smithi066.stdout:4/659: truncate d5/d8/d16/fa0 223869 0 2024-09-12T22:49:56.961 INFO:tasks.workunit.client.0.smithi066.stdout:6/650: write d6/f80 [808774,36506] 0 2024-09-12T22:49:56.962 INFO:tasks.workunit.client.0.smithi066.stdout:8/619: truncate d17/d40/d47/d4d/d87/fa9 5127479 0 2024-09-12T22:49:56.962 INFO:tasks.workunit.client.0.smithi066.stdout:8/620: creat d17/d1b/fd5 x:0 0 0 2024-09-12T22:49:56.962 INFO:tasks.workunit.client.0.smithi066.stdout:4/660: getdents d5/d3e/d8d/dc7 0 2024-09-12T22:49:56.962 INFO:tasks.workunit.client.0.smithi066.stdout:8/621: creat d17/d40/d74/da3/dac/db4/fd6 x:0 0 0 2024-09-12T22:49:56.962 INFO:tasks.workunit.client.0.smithi066.stdout:7/519: sync 2024-09-12T22:49:56.962 INFO:tasks.workunit.client.0.smithi066.stdout:7/520: chown d0/d19/d24/l42 30 1 2024-09-12T22:49:56.962 INFO:tasks.workunit.client.0.smithi066.stdout:8/622: write d17/d40/d47/d4d/fa0 [113681,123246] 0 2024-09-12T22:49:56.962 INFO:tasks.workunit.client.0.smithi066.stdout:6/651: dwrite d6/d23/d41/db6/fda [0,4194304] 0 2024-09-12T22:49:56.962 INFO:tasks.workunit.client.0.smithi066.stdout:8/623: fdatasync d17/d49/d4b/d57/f80 0 2024-09-12T22:49:56.962 INFO:tasks.workunit.client.0.smithi066.stdout:8/624: symlink d17/d40/d74/ld7 0 2024-09-12T22:49:56.962 INFO:tasks.workunit.client.0.smithi066.stdout:0/597: dread d1/d8/d1f/d30/f70 [0,4194304] 0 2024-09-12T22:49:56.962 INFO:tasks.workunit.client.0.smithi066.stdout:8/625: write d17/d40/f4c [1290593,9327] 0 2024-09-12T22:49:56.962 INFO:tasks.workunit.client.0.smithi066.stdout:0/598: chown d1/d8/d1f/d47/l99 1055428671 1 2024-09-12T22:49:56.962 INFO:tasks.workunit.client.0.smithi066.stdout:9/603: read d9/dc/d23/f79 [2395048,67923] 0 2024-09-12T22:49:56.963 INFO:tasks.workunit.client.0.smithi066.stdout:7/521: dwrite d0/d19/d60/d53/f8c [0,4194304] 0 2024-09-12T22:49:56.963 INFO:tasks.workunit.client.0.smithi066.stdout:8/626: truncate d17/d40/d74/d99/f9d 608636 0 2024-09-12T22:49:56.963 INFO:tasks.workunit.client.0.smithi066.stdout:9/604: chown d9/d31/d58/d7f/f93 171 1 2024-09-12T22:49:56.963 INFO:tasks.workunit.client.0.smithi066.stdout:8/627: link d17/d2c/c8c d17/d40/d74/d99/cd8 0 2024-09-12T22:49:56.963 INFO:tasks.workunit.client.0.smithi066.stdout:4/661: dwrite d5/d8/d16/d93/d9c/d98/d8b/d86/f94 [0,4194304] 0 2024-09-12T22:49:56.963 INFO:tasks.workunit.client.0.smithi066.stdout:8/628: creat d17/d40/d74/da3/dac/fd9 x:0 0 0 2024-09-12T22:49:56.963 INFO:tasks.workunit.client.0.smithi066.stdout:9/605: dwrite d9/dc/dd/d9f/fbb [8388608,4194304] 0 2024-09-12T22:49:56.963 INFO:tasks.workunit.client.0.smithi066.stdout:4/662: fsync d5/d3e/d65/f9e 0 2024-09-12T22:49:56.963 INFO:tasks.workunit.client.0.smithi066.stdout:8/629: creat d17/d49/d4b/d57/d5e/d62/d79/fda x:0 0 0 2024-09-12T22:49:56.963 INFO:tasks.workunit.client.0.smithi066.stdout:8/630: fdatasync d17/d40/d47/d4d/fca 0 2024-09-12T22:49:56.963 INFO:tasks.workunit.client.0.smithi066.stdout:4/663: link d5/d8/d16/d1b/d72/l7f d5/d8/d10/de/le1 0 2024-09-12T22:49:56.963 INFO:tasks.workunit.client.0.smithi066.stdout:4/664: getdents d5/d8/d16/d1b/d1e/d1f 0 2024-09-12T22:49:56.964 INFO:tasks.workunit.client.0.smithi066.stdout:4/665: write d5/d8/d16/d1b/d72/fda [660027,47436] 0 2024-09-12T22:49:56.964 INFO:tasks.workunit.client.0.smithi066.stdout:4/666: write d5/d8/d10/de/f14 [589900,58639] 0 2024-09-12T22:49:56.964 INFO:tasks.workunit.client.0.smithi066.stdout:4/667: creat d5/d8/d16/d93/d9c/d98/ddc/fe2 x:0 0 0 2024-09-12T22:49:56.965 INFO:tasks.workunit.client.0.smithi066.stdout:9/606: write d9/d31/d58/d7f/f93 [154907,62804] 0 2024-09-12T22:49:56.966 INFO:tasks.workunit.client.0.smithi066.stdout:4/668: link d5/d8/d16/d1b/d1e/f51 d5/d8/d16/d1b/d72/fe3 0 2024-09-12T22:49:56.966 INFO:tasks.workunit.client.0.smithi066.stdout:9/607: creat d9/fcd x:0 0 0 2024-09-12T22:49:56.966 INFO:tasks.workunit.client.0.smithi066.stdout:7/522: dwrite d0/d19/d60/f51 [0,4194304] 0 2024-09-12T22:49:56.967 INFO:tasks.workunit.client.0.smithi066.stdout:4/669: fsync d5/d8/d16/d93/fbb 0 2024-09-12T22:49:56.968 INFO:tasks.workunit.client.0.smithi066.stdout:3/597: dread d0/d2/d1d/d87/d6b/db2/f72 [0,4194304] 0 2024-09-12T22:49:56.968 INFO:tasks.workunit.client.0.smithi066.stdout:7/523: chown d0/d19/d24/d33/l63 782 1 2024-09-12T22:49:56.968 INFO:tasks.workunit.client.0.smithi066.stdout:9/608: unlink d9/fb 0 2024-09-12T22:49:56.969 INFO:tasks.workunit.client.0.smithi066.stdout:7/524: symlink d0/d19/d26/d48/d84/laf 0 2024-09-12T22:49:56.969 INFO:tasks.workunit.client.0.smithi066.stdout:3/598: mkdir d0/d2/d1d/d87/d40/dd1 0 2024-09-12T22:49:56.969 INFO:tasks.workunit.client.0.smithi066.stdout:9/609: truncate d9/d31/d58/fc9 235260 0 2024-09-12T22:49:56.971 INFO:tasks.workunit.client.0.smithi066.stdout:9/610: creat d9/d31/d34/d4d/d8c/fce x:0 0 0 2024-09-12T22:49:56.971 INFO:tasks.workunit.client.0.smithi066.stdout:3/599: chown d0/d2/d7/d13/la0 4278905 1 2024-09-12T22:49:56.972 INFO:tasks.workunit.client.0.smithi066.stdout:5/672: dread d5/f12 [0,4194304] 0 2024-09-12T22:49:56.972 INFO:tasks.workunit.client.0.smithi066.stdout:9/611: creat d9/d31/d58/d7f/fcf x:0 0 0 2024-09-12T22:49:56.973 INFO:tasks.workunit.client.0.smithi066.stdout:4/670: write d5/d8/d16/d1b/f88 [3910617,112565] 0 2024-09-12T22:49:56.973 INFO:tasks.workunit.client.0.smithi066.stdout:3/600: creat d0/d2/d1d/d87/d49/fd2 x:0 0 0 2024-09-12T22:49:56.974 INFO:tasks.workunit.client.0.smithi066.stdout:5/673: mkdir d5/d11/d23/d6f/daa/dbb/dc6 0 2024-09-12T22:49:56.975 INFO:tasks.workunit.client.0.smithi066.stdout:7/525: dwrite d0/d19/d26/f28 [0,4194304] 0 2024-09-12T22:49:56.975 INFO:tasks.workunit.client.0.smithi066.stdout:4/671: unlink d5/d8/d16/d1b/d1e/f59 0 2024-09-12T22:49:56.976 INFO:tasks.workunit.client.0.smithi066.stdout:5/674: fdatasync d5/de/f95 0 2024-09-12T22:49:56.977 INFO:tasks.workunit.client.0.smithi066.stdout:5/675: chown d5/d11/d21/f47 33117776 1 2024-09-12T22:49:56.977 INFO:tasks.workunit.client.0.smithi066.stdout:7/526: rename d0/d6/f8a to d0/d19/d60/d85/d8b/fb0 0 2024-09-12T22:49:56.978 INFO:tasks.workunit.client.0.smithi066.stdout:5/676: mkdir d5/d11/d7c/dc3/dc7 0 2024-09-12T22:49:56.979 INFO:tasks.workunit.client.0.smithi066.stdout:4/672: creat d5/fe4 x:0 0 0 2024-09-12T22:49:56.979 INFO:tasks.workunit.client.0.smithi066.stdout:9/612: dwrite d9/d31/d77/f91 [0,4194304] 0 2024-09-12T22:49:56.979 INFO:tasks.workunit.client.0.smithi066.stdout:5/677: chown d5/lb 2998 1 2024-09-12T22:49:56.981 INFO:tasks.workunit.client.0.smithi066.stdout:4/673: mknod d5/d3e/d8d/ce5 0 2024-09-12T22:49:56.981 INFO:tasks.workunit.client.0.smithi066.stdout:2/593: dread d1/d11/d26/d4f/d5f/d61/d7e/f48 [0,4194304] 0 2024-09-12T22:49:56.982 INFO:tasks.workunit.client.0.smithi066.stdout:7/527: getdents d0/d19/d26/d48 0 2024-09-12T22:49:56.982 INFO:tasks.workunit.client.0.smithi066.stdout:9/613: truncate d9/f32 773088 0 2024-09-12T22:49:56.982 INFO:tasks.workunit.client.0.smithi066.stdout:1/501: sync 2024-09-12T22:49:56.982 INFO:tasks.workunit.client.0.smithi066.stdout:6/652: sync 2024-09-12T22:49:56.984 INFO:tasks.workunit.client.0.smithi066.stdout:4/674: chown d5/d8/d16/d1b/d1e/d1f/f7a 21151542 1 2024-09-12T22:49:56.985 INFO:tasks.workunit.client.0.smithi066.stdout:6/653: mknod d6/d23/d62/cdb 0 2024-09-12T22:49:56.985 INFO:tasks.workunit.client.0.smithi066.stdout:2/594: write d1/dd/d12/d1e/f79 [1442777,103920] 0 2024-09-12T22:49:56.987 INFO:tasks.workunit.client.0.smithi066.stdout:6/654: readlink d6/d78/l7f 0 2024-09-12T22:49:56.987 INFO:tasks.workunit.client.0.smithi066.stdout:5/678: dwrite d5/de/d50/d8b/fa9 [0,4194304] 0 2024-09-12T22:49:56.987 INFO:tasks.workunit.client.0.smithi066.stdout:7/528: link d0/d19/d26/f28 d0/d19/d24/d33/d27/d70/fb1 0 2024-09-12T22:49:56.988 INFO:tasks.workunit.client.0.smithi066.stdout:2/595: write d1/d11/d26/f77 [1919149,72840] 0 2024-09-12T22:49:56.990 INFO:tasks.workunit.client.0.smithi066.stdout:9/614: rename d9/dc/d46/d8a/l90 to d9/d31/d77/d8f/ld0 0 2024-09-12T22:49:56.991 INFO:tasks.workunit.client.0.smithi066.stdout:6/655: readlink d6/d23/d25/d4e/l5a 0 2024-09-12T22:49:56.991 INFO:tasks.workunit.client.0.smithi066.stdout:8/631: dread d17/d49/d4b/d57/d5e/fc3 [0,4194304] 0 2024-09-12T22:49:56.991 INFO:tasks.workunit.client.0.smithi066.stdout:1/502: dread d0/dc/d1d/f67 [0,4194304] 0 2024-09-12T22:49:56.991 INFO:tasks.workunit.client.0.smithi066.stdout:2/596: stat d1/dd/d12/f24 0 2024-09-12T22:49:56.991 INFO:tasks.workunit.client.0.smithi066.stdout:3/601: dwrite d0/f38 [0,4194304] 0 2024-09-12T22:49:56.992 INFO:tasks.workunit.client.0.smithi066.stdout:5/679: fsync d5/d11/d21/d4d/f6d 0 2024-09-12T22:49:56.992 INFO:tasks.workunit.client.0.smithi066.stdout:9/615: chown d9/dc/d8e 992 1 2024-09-12T22:49:56.992 INFO:tasks.workunit.client.0.smithi066.stdout:6/656: mknod d6/d49/cdc 0 2024-09-12T22:49:56.993 INFO:tasks.workunit.client.0.smithi066.stdout:1/503: rename d0/f7d to d0/d4e/d79/d86/f92 0 2024-09-12T22:49:56.994 INFO:tasks.workunit.client.0.smithi066.stdout:4/675: dread d5/d8/d10/de/d39/f3b [0,4194304] 0 2024-09-12T22:49:56.994 INFO:tasks.workunit.client.0.smithi066.stdout:3/602: mknod d0/d2/d1d/d87/d6b/db2/cd3 0 2024-09-12T22:49:56.994 INFO:tasks.workunit.client.0.smithi066.stdout:9/616: unlink d9/d31/d58/d7f/f93 0 2024-09-12T22:49:56.994 INFO:tasks.workunit.client.0.smithi066.stdout:8/632: symlink d17/d49/d4b/d57/d5e/d65/ldb 0 2024-09-12T22:49:56.995 INFO:tasks.workunit.client.0.smithi066.stdout:0/599: sync 2024-09-12T22:49:56.995 INFO:tasks.workunit.client.0.smithi066.stdout:5/680: mknod d5/d14/cc8 0 2024-09-12T22:49:56.995 INFO:tasks.workunit.client.0.smithi066.stdout:6/657: chown d6/d23/d25/f2e 1392539 1 2024-09-12T22:49:56.995 INFO:tasks.workunit.client.0.smithi066.stdout:6/658: sync 2024-09-12T22:49:56.996 INFO:tasks.workunit.client.0.smithi066.stdout:9/617: stat d9/d31/d58/dbc/cab 0 2024-09-12T22:49:56.996 INFO:tasks.workunit.client.0.smithi066.stdout:4/676: creat d5/d8/d10/de/d2d/d64/d9a/fe6 x:0 0 0 2024-09-12T22:49:56.997 INFO:tasks.workunit.client.0.smithi066.stdout:6/659: fdatasync d6/d23/d25/d4e/dc4/f3a 0 2024-09-12T22:49:56.998 INFO:tasks.workunit.client.0.smithi066.stdout:0/600: write d1/d5b/dba/fd9 [804739,115953] 0 2024-09-12T22:49:56.998 INFO:tasks.workunit.client.0.smithi066.stdout:7/529: dwrite d0/d19/d26/d48/fa9 [0,4194304] 0 2024-09-12T22:49:56.999 INFO:tasks.workunit.client.0.smithi066.stdout:8/633: dread d17/d40/d74/d99/f9d [0,4194304] 0 2024-09-12T22:49:57.000 INFO:tasks.workunit.client.0.smithi066.stdout:5/681: rename d5/d14/f88 to d5/d11/d7c/dc3/fc9 0 2024-09-12T22:49:57.000 INFO:tasks.workunit.client.0.smithi066.stdout:9/618: mknod d9/d31/d58/da4/cd1 0 2024-09-12T22:49:57.000 INFO:tasks.workunit.client.0.smithi066.stdout:6/660: creat d6/d51/fdd x:0 0 0 2024-09-12T22:49:57.001 INFO:tasks.workunit.client.0.smithi066.stdout:7/530: unlink d0/d6/c56 0 2024-09-12T22:49:57.001 INFO:tasks.workunit.client.0.smithi066.stdout:2/597: dwrite d1/d11/d26/d4f/fa5 [0,4194304] 0 2024-09-12T22:49:57.003 INFO:tasks.workunit.client.0.smithi066.stdout:7/531: fdatasync d0/d6/f7e 0 2024-09-12T22:49:57.003 INFO:tasks.workunit.client.0.smithi066.stdout:5/682: read d5/f3f [381594,86597] 0 2024-09-12T22:49:57.004 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:57.003+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:57.004 INFO:tasks.workunit.client.0.smithi066.stdout:8/634: unlink d17/d1b/f3b 0 2024-09-12T22:49:57.005 INFO:tasks.workunit.client.0.smithi066.stdout:1/504: dwrite d0/f13 [0,4194304] 0 2024-09-12T22:49:57.005 INFO:tasks.workunit.client.0.smithi066.stdout:3/603: rename d0/d2/d6/l5d to d0/d2/d1d/d87/d40/da2/ld4 0 2024-09-12T22:49:57.005 INFO:tasks.workunit.client.0.smithi066.stdout:9/619: mkdir d9/dc/dd2 0 2024-09-12T22:49:57.005 INFO:tasks.workunit.client.0.smithi066.stdout:6/661: unlink d6/d23/d25/d4e/fa1 0 2024-09-12T22:49:57.007 INFO:tasks.workunit.client.0.smithi066.stdout:2/598: unlink d1/d11/d26/d4f/d5f/d61/d7e/c49 0 2024-09-12T22:49:57.007 INFO:tasks.workunit.client.0.smithi066.stdout:3/604: fdatasync d0/d2/d7/f5e 0 2024-09-12T22:49:57.008 INFO:tasks.workunit.client.0.smithi066.stdout:6/662: write d6/f96 [2141881,72013] 0 2024-09-12T22:49:57.009 INFO:tasks.workunit.client.0.smithi066.stdout:4/677: dwrite d5/d3e/d8d/dc7/f83 [0,4194304] 0 2024-09-12T22:49:57.010 INFO:tasks.workunit.client.0.smithi066.stdout:1/505: creat d0/dc/f93 x:0 0 0 2024-09-12T22:49:57.010 INFO:tasks.workunit.client.0.smithi066.stdout:0/601: dwrite d1/d36/f79 [0,4194304] 0 2024-09-12T22:49:57.012 INFO:tasks.workunit.client.0.smithi066.stdout:6/663: chown d6/d23/f3e 782351 1 2024-09-12T22:49:57.013 INFO:tasks.workunit.client.0.smithi066.stdout:4/678: write d5/d8/d10/de/f14 [404031,25681] 0 2024-09-12T22:49:57.014 INFO:tasks.workunit.client.0.smithi066.stdout:5/683: dread d5/f12 [0,4194304] 0 2024-09-12T22:49:57.014 INFO:tasks.workunit.client.0.smithi066.stdout:2/599: symlink d1/d11/lb6 0 2024-09-12T22:49:57.015 INFO:tasks.workunit.client.0.smithi066.stdout:6/664: write d6/d23/d25/d88/f9d [340294,86458] 0 2024-09-12T22:49:57.016 INFO:tasks.workunit.client.0.smithi066.stdout:8/635: link d17/d40/d47/d4d/c56 d17/d49/d4b/d57/d5e/d62/d79/cdc 0 2024-09-12T22:49:57.016 INFO:tasks.workunit.client.0.smithi066.stdout:7/532: dwrite d0/d19/d26/d48/d59/f7b [0,4194304] 0 2024-09-12T22:49:57.016 INFO:tasks.workunit.client.0.smithi066.stdout:0/602: creat d1/d8/d1c/d56/db7/fdb x:0 0 0 2024-09-12T22:49:57.017 INFO:tasks.workunit.client.0.smithi066.stdout:3/605: link d0/d2/d1d/cb9 d0/d2/d1d/d87/d40/dd1/cd5 0 2024-09-12T22:49:57.017 INFO:tasks.workunit.client.0.smithi066.stdout:2/600: chown d1/dd/d12/l38 15 1 2024-09-12T22:49:57.018 INFO:tasks.workunit.client.0.smithi066.stdout:0/603: chown d1/d8 99 1 2024-09-12T22:49:57.018 INFO:tasks.workunit.client.0.smithi066.stdout:7/533: unlink d0/d6/f4f 0 2024-09-12T22:49:57.018 INFO:tasks.workunit.client.0.smithi066.stdout:5/684: creat d5/d11/fca x:0 0 0 2024-09-12T22:49:57.019 INFO:tasks.workunit.client.0.smithi066.stdout:8/636: chown d17/d49/c59 1366 1 2024-09-12T22:49:57.020 INFO:tasks.workunit.client.0.smithi066.stdout:9/620: dwrite d9/d31/d77/dc2/dcb/f39 [0,4194304] 0 2024-09-12T22:49:57.020 INFO:tasks.workunit.client.0.smithi066.stdout:3/606: creat d0/db3/db7/fd6 x:0 0 0 2024-09-12T22:49:57.023 INFO:tasks.workunit.client.0.smithi066.stdout:9/621: stat d9/d31/d34 0 2024-09-12T22:49:57.023 INFO:tasks.workunit.client.0.smithi066.stdout:8/637: chown d17/d40/d47/d4d/f8a 64 1 2024-09-12T22:49:57.023 INFO:tasks.workunit.client.0.smithi066.stdout:5/685: creat d5/d11/d5d/d8a/fcb x:0 0 0 2024-09-12T22:49:57.024 INFO:tasks.workunit.client.0.smithi066.stdout:1/506: dwrite d0/d36/d6b/f80 [0,4194304] 0 2024-09-12T22:49:57.025 INFO:tasks.workunit.client.0.smithi066.stdout:5/686: dread - d5/d11/d5d/d8a/fbd zero size 2024-09-12T22:49:57.026 INFO:tasks.workunit.client.0.smithi066.stdout:1/507: mkdir d0/d4e/d79/d94 0 2024-09-12T22:49:57.026 INFO:tasks.workunit.client.0.smithi066.stdout:6/665: dwrite d6/d59/f77 [0,4194304] 0 2024-09-12T22:49:57.026 INFO:tasks.workunit.client.0.smithi066.stdout:9/622: getdents d9/d31/d58/d7f/dc8 0 2024-09-12T22:49:57.027 INFO:tasks.workunit.client.0.smithi066.stdout:1/508: chown d0/dc/d1d/f67 1024030 1 2024-09-12T22:49:57.027 INFO:tasks.workunit.client.0.smithi066.stdout:4/679: dread d5/d8/d16/d93/d9c/d98/d8b/d86/f94 [0,4194304] 0 2024-09-12T22:49:57.027 INFO:tasks.workunit.client.0.smithi066.stdout:6/666: symlink d6/d23/d25/d4e/lde 0 2024-09-12T22:49:57.028 INFO:tasks.workunit.client.0.smithi066.stdout:5/687: truncate d5/de/d50/f90 1758046 0 2024-09-12T22:49:57.028 INFO:tasks.workunit.client.0.smithi066.stdout:9/623: write d9/d31/d77/fc3 [896523,127446] 0 2024-09-12T22:49:57.028 INFO:tasks.workunit.client.0.smithi066.stdout:4/680: dread - d5/d3e/d65/dac/fd7 zero size 2024-09-12T22:49:57.029 INFO:tasks.workunit.client.0.smithi066.stdout:1/509: rename d0/d9 to d0/dc/d1e/d95 0 2024-09-12T22:49:57.029 INFO:tasks.workunit.client.0.smithi066.stdout:6/667: unlink d6/d7/dc/fd9 0 2024-09-12T22:49:57.030 INFO:tasks.workunit.client.0.smithi066.stdout:5/688: rename c0 to d5/d11/d23/d6f/ccc 0 2024-09-12T22:49:57.030 INFO:tasks.workunit.client.0.smithi066.stdout:6/668: read - d6/d23/d25/d4e/dc4/f65 zero size 2024-09-12T22:49:57.030 INFO:tasks.workunit.client.0.smithi066.stdout:1/510: getdents d0/d36/d57/d81 0 2024-09-12T22:49:57.031 INFO:tasks.workunit.client.0.smithi066.stdout:1/511: read d0/d36/d57/f3f [189532,41755] 0 2024-09-12T22:49:57.032 INFO:tasks.workunit.client.0.smithi066.stdout:5/689: creat d5/d11/d23/d6f/daa/dbb/dc6/fcd x:0 0 0 2024-09-12T22:49:57.032 INFO:tasks.workunit.client.0.smithi066.stdout:1/512: read - d0/f64 zero size 2024-09-12T22:49:57.032 INFO:tasks.workunit.client.0.smithi066.stdout:6/669: creat d6/d23/d41/db6/dd3/fdf x:0 0 0 2024-09-12T22:49:57.032 INFO:tasks.workunit.client.0.smithi066.stdout:1/513: fsync d0/dc/d44/f54 0 2024-09-12T22:49:57.032 INFO:tasks.workunit.client.0.smithi066.stdout:6/670: chown d6/d7/dc/l19 0 1 2024-09-12T22:49:57.033 INFO:tasks.workunit.client.0.smithi066.stdout:6/671: read - d6/d23/d25/f8f zero size 2024-09-12T22:49:57.033 INFO:tasks.workunit.client.0.smithi066.stdout:1/514: creat d0/dc/d33/f96 x:0 0 0 2024-09-12T22:49:57.034 INFO:tasks.workunit.client.0.smithi066.stdout:6/672: dread - d6/d23/d25/f8f zero size 2024-09-12T22:49:57.034 INFO:tasks.workunit.client.0.smithi066.stdout:1/515: write d0/dc/d1e/d95/f43 [558214,112233] 0 2024-09-12T22:49:57.035 INFO:tasks.workunit.client.0.smithi066.stdout:1/516: write d0/dc/f69 [2448870,50664] 0 2024-09-12T22:49:57.035 INFO:tasks.workunit.client.0.smithi066.stdout:4/681: dread d5/d8/d10/de/d2d/fa1 [0,4194304] 0 2024-09-12T22:49:57.036 INFO:tasks.workunit.client.0.smithi066.stdout:1/517: write d0/dc/d33/f6c [4625228,101216] 0 2024-09-12T22:49:57.037 INFO:tasks.workunit.client.0.smithi066.stdout:7/534: truncate d0/d19/d24/d33/f34 2099930 0 2024-09-12T22:49:57.037 INFO:tasks.workunit.client.0.smithi066.stdout:3/607: truncate d0/d2/d1d/d87/d40/dbd/d74/f86 3872054 0 2024-09-12T22:49:57.037 INFO:tasks.workunit.client.0.smithi066.stdout:8/638: truncate d17/d40/d47/d4d/f7a 790273 0 2024-09-12T22:49:57.037 INFO:tasks.workunit.client.0.smithi066.stdout:9/624: write d9/d31/d34/d4d/fb8 [1959616,96274] 0 2024-09-12T22:49:57.038 INFO:tasks.workunit.client.0.smithi066.stdout:1/518: readlink d0/dc/d1d/l83 0 2024-09-12T22:49:57.038 INFO:tasks.workunit.client.0.smithi066.stdout:5/690: chown d5/d11/d23/d6f/ccc 1 1 2024-09-12T22:49:57.038 INFO:tasks.workunit.client.0.smithi066.stdout:1/519: rmdir d0/d28 39 2024-09-12T22:49:57.039 INFO:tasks.workunit.client.0.smithi066.stdout:9/625: write d9/fcd [887552,103478] 0 2024-09-12T22:49:57.040 INFO:tasks.workunit.client.0.smithi066.stdout:8/639: rename d17/d1b/c7b to d17/d49/d4b/d57/d5e/cdd 0 2024-09-12T22:49:57.040 INFO:tasks.workunit.client.0.smithi066.stdout:1/520: write d0/dc/d44/f54 [452456,57259] 0 2024-09-12T22:49:57.040 INFO:tasks.workunit.client.0.smithi066.stdout:3/608: getdents d0/d2/d1d/d87/d40/d44/d55/d91/dcb 0 2024-09-12T22:49:57.042 INFO:tasks.workunit.client.0.smithi066.stdout:1/521: mknod d0/d89/c97 0 2024-09-12T22:49:57.042 INFO:tasks.workunit.client.0.smithi066.stdout:8/640: unlink d17/d1b/f1e 0 2024-09-12T22:49:57.043 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:57.043 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:49:57.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.043 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:13404 4.2e e56/17 4:757fd8bc:::100000032e0.00000000:head v 56'203, mlcod=56'201)", 2024-09-12T22:49:57.043 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.038292+0000", 2024-09-12T22:49:57.044 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.0040467819999999996, 2024-09-12T22:49:57.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.004068271, 2024-09-12T22:49:57.044 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:57.044 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:57.044 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:57.044 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:57.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:57.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038292+0000", 2024-09-12T22:49:57.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:57.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038292+0000", 2024-09-12T22:49:57.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:57.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038292+0000", 2024-09-12T22:49:57.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8700000000000002e-07 2024-09-12T22:49:57.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:57.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038397+0000", 2024-09-12T22:49:57.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000104997 2024-09-12T22:49:57.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:57.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038407+0000", 2024-09-12T22:49:57.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2539999999999998e-06 2024-09-12T22:49:57.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:57.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038412+0000", 2024-09-12T22:49:57.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6960000000000002e-06 2024-09-12T22:49:57.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:57.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038459+0000", 2024-09-12T22:49:57.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6443999999999998e-05 2024-09-12T22:49:57.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:57.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038478+0000", 2024-09-12T22:49:57.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9494e-05 2024-09-12T22:49:57.047 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.047 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:57.047 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.048 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13405 4.2c 4:37f6ffa3:::100000036a8.00000000:head [write 887552~103478 in=103478b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:57.048 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.039136+0000", 2024-09-12T22:49:57.048 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.003202473, 2024-09-12T22:49:57.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032634449999999998, 2024-09-12T22:49:57.048 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:57.048 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:57.048 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:57.048 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:57.048 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:57.048 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:57.048 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13405 2024-09-12T22:49:57.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.049 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:57.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:57.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.039136+0000", 2024-09-12T22:49:57.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:57.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.039136+0000", 2024-09-12T22:49:57.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:57.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.039137+0000", 2024-09-12T22:49:57.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3399999999999997e-07 2024-09-12T22:49:57.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:57.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.039242+0000", 2024-09-12T22:49:57.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000104634 2024-09-12T22:49:57.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:57.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.039256+0000", 2024-09-12T22:49:57.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3647e-05 2024-09-12T22:49:57.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:57.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.039264+0000", 2024-09-12T22:49:57.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4959999999999996e-06 2024-09-12T22:49:57.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:57.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.039316+0000", 2024-09-12T22:49:57.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2204999999999999e-05 2024-09-12T22:49:57.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:57.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.039419+0000", 2024-09-12T22:49:57.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000103 2024-09-12T22:49:57.052 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.052 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:57.052 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.052 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:13406 4.1c e56/17 4:3bf60182:::10000003409.00000000:head v 56'179, mlcod=56'177)", 2024-09-12T22:49:57.052 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.040948+0000", 2024-09-12T22:49:57.052 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.001391275, 2024-09-12T22:49:57.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001488489, 2024-09-12T22:49:57.053 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:57.053 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:57.053 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:57.053 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:57.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:57.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.040948+0000", 2024-09-12T22:49:57.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:57.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.040948+0000", 2024-09-12T22:49:57.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:57.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.040948+0000", 2024-09-12T22:49:57.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4499999999999997e-07 2024-09-12T22:49:57.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:57.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.040975+0000", 2024-09-12T22:49:57.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7370000000000001e-05 2024-09-12T22:49:57.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:57.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.040987+0000", 2024-09-12T22:49:57.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1854e-05 2024-09-12T22:49:57.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:57.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.040994+0000", 2024-09-12T22:49:57.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2009999999999996e-06 2024-09-12T22:49:57.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:57.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.041040+0000", 2024-09-12T22:49:57.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6711000000000001e-05 2024-09-12T22:49:57.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:57.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.041053+0000", 2024-09-12T22:49:57.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3006999999999999e-05 2024-09-12T22:49:57.056 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.056 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:57.056 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.056 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13388 4.f 4:f3c39866:::1000000328b.00000000:head [write 0~4194304 [2@25293] in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:57.056 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.020820+0000", 2024-09-12T22:49:57.056 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.021518874, 2024-09-12T22:49:57.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021650300000000001, 2024-09-12T22:49:57.057 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:57.057 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:57.057 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:49:57.057 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:57.057 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:57.057 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:57.057 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13388 2024-09-12T22:49:57.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.057 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:57.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:57.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.020820+0000", 2024-09-12T22:49:57.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:57.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.020820+0000", 2024-09-12T22:49:57.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:57.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.020821+0000", 2024-09-12T22:49:57.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4399999999999999e-07 2024-09-12T22:49:57.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:57.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.027263+0000", 2024-09-12T22:49:57.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0064420140000000002 2024-09-12T22:49:57.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:57.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.027280+0000", 2024-09-12T22:49:57.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6923e-05 2024-09-12T22:49:57.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:57.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.027290+0000", 2024-09-12T22:49:57.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0339e-05 2024-09-12T22:49:57.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:57.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.027338+0000", 2024-09-12T22:49:57.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7920999999999997e-05 2024-09-12T22:49:57.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:57.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.027408+0000", 2024-09-12T22:49:57.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9837000000000002e-05 2024-09-12T22:49:57.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:57.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.027491+0000", 2024-09-12T22:49:57.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3535000000000006e-05 2024-09-12T22:49:57.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:57.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.034211+0000", 2024-09-12T22:49:57.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0067196260000000002 2024-09-12T22:49:57.061 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.061 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:57.061 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.061 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13391 4.1e 4:7aa36f33:::100000035ed.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:57.061 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.027390+0000", 2024-09-12T22:49:57.061 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.014949334999999999, 2024-09-12T22:49:57.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015122468, 2024-09-12T22:49:57.062 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:57.062 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:57.062 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:57.062 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:57.062 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:57.062 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:57.062 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13391 2024-09-12T22:49:57.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.062 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:57.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:57.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.027390+0000", 2024-09-12T22:49:57.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:57.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.027390+0000", 2024-09-12T22:49:57.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:57.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.027390+0000", 2024-09-12T22:49:57.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6100000000000001e-07 2024-09-12T22:49:57.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:57.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.033211+0000", 2024-09-12T22:49:57.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058205330000000001 2024-09-12T22:49:57.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:57.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.033232+0000", 2024-09-12T22:49:57.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1489999999999999e-05 2024-09-12T22:49:57.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:57.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.033244+0000", 2024-09-12T22:49:57.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1725999999999999e-05 2024-09-12T22:49:57.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:57.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.033306+0000", 2024-09-12T22:49:57.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2180000000000004e-05 2024-09-12T22:49:57.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:57.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.033422+0000", 2024-09-12T22:49:57.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116288 2024-09-12T22:49:57.065 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.065 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:57.065 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.066 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:13387 4.28 e56/17 4:17d5e0d8:::10000003169.00000000:head v 56'235, mlcod=56'233)", 2024-09-12T22:49:57.066 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.024610+0000", 2024-09-12T22:49:57.066 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.017728674, 2024-09-12T22:49:57.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017934523000000001, 2024-09-12T22:49:57.066 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:57.066 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:57.066 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:57.066 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:57.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:57.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.024610+0000", 2024-09-12T22:49:57.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:57.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.024610+0000", 2024-09-12T22:49:57.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:57.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.024611+0000", 2024-09-12T22:49:57.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0800000000000004e-07 2024-09-12T22:49:57.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:57.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.033876+0000", 2024-09-12T22:49:57.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0092648149999999992 2024-09-12T22:49:57.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:57.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.033897+0000", 2024-09-12T22:49:57.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1233000000000002e-05 2024-09-12T22:49:57.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:57.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.033906+0000", 2024-09-12T22:49:57.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6999999999999997e-06 2024-09-12T22:49:57.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:57.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.033968+0000", 2024-09-12T22:49:57.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2266000000000003e-05 2024-09-12T22:49:57.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:57.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.033992+0000", 2024-09-12T22:49:57.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4042000000000001e-05 2024-09-12T22:49:57.069 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.069 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:57.070 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.070 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13393 4.18 4:1bd2c6d6:::100000033d6.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:57.070 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.033276+0000", 2024-09-12T22:49:57.070 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.0090632309999999997, 2024-09-12T22:49:57.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0092999659999999998, 2024-09-12T22:49:57.070 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:57.070 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:57.070 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:57.070 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:57.070 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:57.070 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:57.071 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13393 2024-09-12T22:49:57.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.071 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:57.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:57.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.033276+0000", 2024-09-12T22:49:57.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:57.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.033276+0000", 2024-09-12T22:49:57.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:57.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.033277+0000", 2024-09-12T22:49:57.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.694e-06 2024-09-12T22:49:57.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:57.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.037932+0000", 2024-09-12T22:49:57.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0046550189999999998 2024-09-12T22:49:57.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:57.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.037953+0000", 2024-09-12T22:49:57.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0880999999999999e-05 2024-09-12T22:49:57.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:57.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.037964+0000", 2024-09-12T22:49:57.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1207e-05 2024-09-12T22:49:57.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:57.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038021+0000", 2024-09-12T22:49:57.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6162999999999997e-05 2024-09-12T22:49:57.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:57.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038091+0000", 2024-09-12T22:49:57.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0616000000000003e-05 2024-09-12T22:49:57.074 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.074 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:57.074 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.074 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13394 4.18 4.6ca88598 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:57.074 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.037991+0000", 2024-09-12T22:49:57.074 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.004347526, 2024-09-12T22:49:57.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0046180459999999998, 2024-09-12T22:49:57.074 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:57.075 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:57.075 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-09-12T22:49:57.075 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:57.075 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:57.075 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:57.075 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13394 2024-09-12T22:49:57.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.075 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:57.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:57.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.037991+0000", 2024-09-12T22:49:57.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:57.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.037991+0000", 2024-09-12T22:49:57.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:57.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.037993+0000", 2024-09-12T22:49:57.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4169999999999999e-06 2024-09-12T22:49:57.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:57.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038052+0000", 2024-09-12T22:49:57.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9128e-05 2024-09-12T22:49:57.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:57.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038062+0000", 2024-09-12T22:49:57.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0404999999999999e-05 2024-09-12T22:49:57.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:57.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038068+0000", 2024-09-12T22:49:57.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1430000000000003e-06 2024-09-12T22:49:57.077 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.077 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:57.078 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.078 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13396 4.18 4.81003798 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:57.078 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.038111+0000", 2024-09-12T22:49:57.078 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.0042278769999999997, 2024-09-12T22:49:57.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045257600000000002, 2024-09-12T22:49:57.078 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:57.078 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:57.078 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-09-12T22:49:57.078 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:57.078 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:57.078 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:57.078 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13396 2024-09-12T22:49:57.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.079 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:57.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:57.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038111+0000", 2024-09-12T22:49:57.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:57.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038111+0000", 2024-09-12T22:49:57.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:57.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038111+0000", 2024-09-12T22:49:57.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0800000000000005e-07 2024-09-12T22:49:57.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:57.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038114+0000", 2024-09-12T22:49:57.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5349999999999999e-06 2024-09-12T22:49:57.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:57.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038121+0000", 2024-09-12T22:49:57.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9840000000000004e-06 2024-09-12T22:49:57.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:57.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038127+0000", 2024-09-12T22:49:57.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1020000000000002e-06 2024-09-12T22:49:57.081 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.081 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:57.081 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.081 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13403 4.3c 4:3f3cde90:::100000032ca.00000001:head [write 430924~101216 in=101216b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:57.082 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.038135+0000", 2024-09-12T22:49:57.082 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.0042039740000000001, 2024-09-12T22:49:57.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045302270000000004, 2024-09-12T22:49:57.082 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:57.082 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:57.082 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:57.082 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:57.082 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:57.082 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:57.082 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13403 2024-09-12T22:49:57.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.082 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:57.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:57.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038135+0000", 2024-09-12T22:49:57.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:57.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038135+0000", 2024-09-12T22:49:57.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:57.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038135+0000", 2024-09-12T22:49:57.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9599999999999999e-07 2024-09-12T22:49:57.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:57.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038182+0000", 2024-09-12T22:49:57.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6987999999999998e-05 2024-09-12T22:49:57.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:57.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038190+0000", 2024-09-12T22:49:57.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1200000000000002e-06 2024-09-12T22:49:57.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:57.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038196+0000", 2024-09-12T22:49:57.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7799999999999997e-06 2024-09-12T22:49:57.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:57.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038241+0000", 2024-09-12T22:49:57.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4925000000000001e-05 2024-09-12T22:49:57.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:57.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038369+0000", 2024-09-12T22:49:57.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012737100000000001 2024-09-12T22:49:57.086 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.086 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:57.086 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.086 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:1761 3.8 e56/16 3:17051619:::200.0000000f:head v 56'36, mlcod=56'34)", 2024-09-12T22:49:57.086 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.038229+0000", 2024-09-12T22:49:57.086 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.0041095929999999999, 2024-09-12T22:49:57.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044686960000000003, 2024-09-12T22:49:57.086 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:57.086 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:57.087 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:57.087 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:57.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:57.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038229+0000", 2024-09-12T22:49:57.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:57.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038229+0000", 2024-09-12T22:49:57.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:57.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038230+0000", 2024-09-12T22:49:57.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5000000000000002e-07 2024-09-12T22:49:57.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:57.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038241+0000", 2024-09-12T22:49:57.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1182999999999999e-05 2024-09-12T22:49:57.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:57.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038250+0000", 2024-09-12T22:49:57.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2040000000000003e-06 2024-09-12T22:49:57.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:57.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038256+0000", 2024-09-12T22:49:57.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3530000000000002e-06 2024-09-12T22:49:57.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:57.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.039291+0000", 2024-09-12T22:49:57.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010357890000000001 2024-09-12T22:49:57.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:57.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.039318+0000", 2024-09-12T22:49:57.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6676e-05 2024-09-12T22:49:57.090 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.090 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:57.090 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.090 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:1762 3.8 e56/16 3:17051619:::200.0000000f:head v 56'37, mlcod=56'34)", 2024-09-12T22:49:57.090 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.038266+0000", 2024-09-12T22:49:57.090 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.004072974, 2024-09-12T22:49:57.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044698050000000003, 2024-09-12T22:49:57.090 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:57.091 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:57.091 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-12T22:49:57.091 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:57.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:57.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038266+0000", 2024-09-12T22:49:57.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:57.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038266+0000", 2024-09-12T22:49:57.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:57.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038266+0000", 2024-09-12T22:49:57.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2000000000000001e-07 2024-09-12T22:49:57.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:57.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038270+0000", 2024-09-12T22:49:57.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.839e-06 2024-09-12T22:49:57.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:57.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038276+0000", 2024-09-12T22:49:57.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.874e-06 2024-09-12T22:49:57.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:57.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038280+0000", 2024-09-12T22:49:57.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:49:57.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:57.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.039752+0000", 2024-09-12T22:49:57.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001471679 2024-09-12T22:49:57.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:57.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.039770+0000", 2024-09-12T22:49:57.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8334000000000001e-05 2024-09-12T22:49:57.094 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.094 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:57.094 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.094 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1760 4.0 4.cdf2dfc0 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:49:57.094 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.038305+0000", 2024-09-12T22:49:57.094 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.0040342640000000001, 2024-09-12T22:49:57.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044810819999999999, 2024-09-12T22:49:57.094 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:57.095 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:57.095 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "queued for pg", 2024-09-12T22:49:57.095 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:57.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:57.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038305+0000", 2024-09-12T22:49:57.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:57.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038305+0000", 2024-09-12T22:49:57.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:57.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038305+0000", 2024-09-12T22:49:57.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2900000000000004e-07 2024-09-12T22:49:57.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:57.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038308+0000", 2024-09-12T22:49:57.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8679999999999999e-06 2024-09-12T22:49:57.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:57.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038318+0000", 2024-09-12T22:49:57.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9219999999999992e-06 2024-09-12T22:49:57.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:57.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.038324+0000", 2024-09-12T22:49:57.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5629999999999997e-06 2024-09-12T22:49:57.097 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.097 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:57.097 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.097 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.097 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-12T22:49:57.097 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 13 2024-09-12T22:49:57.097 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:57.100 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:57.111 INFO:tasks.workunit.client.0.smithi066.stdout:1/522: unlink d0/dc/c52 0 2024-09-12T22:49:57.111 INFO:tasks.workunit.client.0.smithi066.stdout:4/682: dwrite d5/d8/d16/d1b/d73/fb9 [0,4194304] 0 2024-09-12T22:49:57.111 INFO:tasks.workunit.client.0.smithi066.stdout:7/535: dwrite d0/d19/d60/d85/d8b/fb0 [0,4194304] 0 2024-09-12T22:49:57.111 INFO:tasks.workunit.client.0.smithi066.stdout:5/691: dwrite d5/d11/d5d/d8a/fcb [0,4194304] 0 2024-09-12T22:49:57.111 INFO:tasks.workunit.client.0.smithi066.stdout:5/692: chown d5/d11 26 1 2024-09-12T22:49:57.111 INFO:tasks.workunit.client.0.smithi066.stdout:1/523: creat d0/dc/d1e/d47/d6f/f98 x:0 0 0 2024-09-12T22:49:57.111 INFO:tasks.workunit.client.0.smithi066.stdout:7/536: symlink d0/d19/d74/lb2 0 2024-09-12T22:49:57.111 INFO:tasks.workunit.client.0.smithi066.stdout:5/693: dread - d5/de/d57/fb1 zero size 2024-09-12T22:49:57.111 INFO:tasks.workunit.client.0.smithi066.stdout:2/601: dread d1/dd/f63 [0,4194304] 0 2024-09-12T22:49:57.111 INFO:tasks.workunit.client.0.smithi066.stdout:9/626: dread d9/dc/f56 [0,4194304] 0 2024-09-12T22:49:57.112 INFO:tasks.workunit.client.0.smithi066.stdout:5/694: write d5/de/d50/f92 [3624028,34574] 0 2024-09-12T22:49:57.112 INFO:tasks.workunit.client.0.smithi066.stdout:6/673: write d6/d23/d25/d4e/dc4/d50/f5d [191719,25713] 0 2024-09-12T22:49:57.112 INFO:tasks.workunit.client.0.smithi066.stdout:7/537: dread d0/d19/d26/d5a/f61 [0,4194304] 0 2024-09-12T22:49:57.112 INFO:tasks.workunit.client.0.smithi066.stdout:9/627: creat d9/d31/d34/d4d/fd3 x:0 0 0 2024-09-12T22:49:57.112 INFO:tasks.workunit.client.0.smithi066.stdout:8/641: write d17/d40/d47/d4d/f93 [685901,60488] 0 2024-09-12T22:49:57.112 INFO:tasks.workunit.client.0.smithi066.stdout:6/674: creat d6/fe0 x:0 0 0 2024-09-12T22:49:57.112 INFO:tasks.workunit.client.0.smithi066.stdout:5/695: write d5/d11/d5d/d8a/fcb [3033298,42753] 0 2024-09-12T22:49:57.112 INFO:tasks.workunit.client.0.smithi066.stdout:9/628: creat d9/fd4 x:0 0 0 2024-09-12T22:49:57.112 INFO:tasks.workunit.client.0.smithi066.stdout:8/642: mkdir d17/d40/d47/dde 0 2024-09-12T22:49:57.112 INFO:tasks.workunit.client.0.smithi066.stdout:7/538: chown d0/d6/l43 93 1 2024-09-12T22:49:57.112 INFO:tasks.workunit.client.0.smithi066.stdout:4/683: dwrite d5/d8/d16/d1b/d1e/d1f/fb1 [0,4194304] 0 2024-09-12T22:49:57.112 INFO:tasks.workunit.client.0.smithi066.stdout:6/675: fsync d6/d23/d25/d2c/d85/fbb 0 2024-09-12T22:49:57.113 INFO:tasks.workunit.client.0.smithi066.stdout:2/602: rename d1/d11/d26/d4f/d5f/d61/d7e/d91 to d1/d11/d26/d4f/d5f/d61/d72/dad/d76/db7 0 2024-09-12T22:49:57.113 INFO:tasks.workunit.client.0.smithi066.stdout:9/629: mknod d9/dc6/cd5 0 2024-09-12T22:49:57.113 INFO:tasks.workunit.client.0.smithi066.stdout:5/696: mkdir d5/de/d57/dce 0 2024-09-12T22:49:57.113 INFO:tasks.workunit.client.0.smithi066.stdout:4/684: creat d5/d3e/d8d/dc7/fe7 x:0 0 0 2024-09-12T22:49:57.113 INFO:tasks.workunit.client.0.smithi066.stdout:8/643: write d17/d1b/f86 [149832,124967] 0 2024-09-12T22:49:57.113 INFO:tasks.workunit.client.0.smithi066.stdout:6/676: getdents d6/d23/d25/d88 0 2024-09-12T22:49:57.116 INFO:tasks.workunit.client.0.smithi066.stdout:9/630: symlink d9/dc/dd2/ld6 0 2024-09-12T22:49:57.116 INFO:tasks.workunit.client.0.smithi066.stdout:8/644: sync 2024-09-12T22:49:57.116 INFO:tasks.workunit.client.0.smithi066.stdout:5/697: rename d5/d11/d23/f2f to d5/d11/d21/fcf 0 2024-09-12T22:49:57.116 INFO:tasks.workunit.client.0.smithi066.stdout:4/685: rmdir d5/d8/d16/d1b/d1e/d1f/d8c/dc4 0 2024-09-12T22:49:57.117 INFO:tasks.workunit.client.0.smithi066.stdout:5/698: rmdir d5 39 2024-09-12T22:49:57.117 INFO:tasks.workunit.client.0.smithi066.stdout:9/631: dread - d9/dc/d46/d8a/f95 zero size 2024-09-12T22:49:57.117 INFO:tasks.workunit.client.0.smithi066.stdout:8/645: symlink d17/d40/d47/dde/ldf 0 2024-09-12T22:49:57.117 INFO:tasks.workunit.client.0.smithi066.stdout:6/677: link d6/d23/d25/d4e/dc4/d99/c47 d6/d23/d25/d2c/d69/ce1 0 2024-09-12T22:49:57.117 INFO:tasks.workunit.client.0.smithi066.stdout:4/686: write d5/d8/d16/d93/d9c/d98/fdf [2481286,42807] 0 2024-09-12T22:49:57.117 INFO:tasks.workunit.client.0.smithi066.stdout:1/524: truncate d0/f1c 2355998 0 2024-09-12T22:49:57.117 INFO:tasks.workunit.client.0.smithi066.stdout:5/699: truncate d5/d11/fca 543108 0 2024-09-12T22:49:57.117 INFO:tasks.workunit.client.0.smithi066.stdout:9/632: chown d9/d31/d34/d4d/faf 16 1 2024-09-12T22:49:57.117 INFO:tasks.workunit.client.0.smithi066.stdout:2/603: dwrite d1/d11/f50 [0,4194304] 0 2024-09-12T22:49:57.117 INFO:tasks.workunit.client.0.smithi066.stdout:6/678: write d6/d7/dc/fbe [1601817,104046] 0 2024-09-12T22:49:57.117 INFO:tasks.workunit.client.0.smithi066.stdout:7/539: dwrite d0/d19/d24/d33/d27/d70/fb1 [4194304,4194304] 0 2024-09-12T22:49:57.117 INFO:tasks.workunit.client.0.smithi066.stdout:9/633: readlink d9/dc/d46/l5a 0 2024-09-12T22:49:57.117 INFO:tasks.workunit.client.0.smithi066.stdout:8/646: write d17/d49/d4b/d4e/fbd [841894,31188] 0 2024-09-12T22:49:57.117 INFO:tasks.workunit.client.0.smithi066.stdout:4/687: write d5/d8/d16/d1b/f28 [2844587,31933] 0 2024-09-12T22:49:57.118 INFO:tasks.workunit.client.0.smithi066.stdout:0/604: dread d1/d5b/dba/fd9 [0,4194304] 0 2024-09-12T22:49:57.118 INFO:tasks.workunit.client.0.smithi066.stdout:8/647: rmdir d17/d40/d74 39 2024-09-12T22:49:57.118 INFO:tasks.workunit.client.0.smithi066.stdout:2/604: getdents d1/dd/d12/d18/d90 0 2024-09-12T22:49:57.118 INFO:tasks.workunit.client.0.smithi066.stdout:5/700: mknod d5/de/d50/d42/d49/cd0 0 2024-09-12T22:49:57.118 INFO:tasks.workunit.client.0.smithi066.stdout:6/679: symlink d6/d23/d25/d4e/dc4/d50/le2 0 2024-09-12T22:49:57.118 INFO:tasks.workunit.client.0.smithi066.stdout:5/701: stat d5/d11/f66 0 2024-09-12T22:49:57.118 INFO:tasks.workunit.client.0.smithi066.stdout:9/634: rmdir d9/d31/d58/dbc/d9d/dba 0 2024-09-12T22:49:57.118 INFO:tasks.workunit.client.0.smithi066.stdout:3/609: dwrite d0/d2/d1d/d87/d40/dbd/d74/f86 [0,4194304] 0 2024-09-12T22:49:57.118 INFO:tasks.workunit.client.0.smithi066.stdout:3/610: fsync d0/d2/d7/f4b 0 2024-09-12T22:49:57.118 INFO:tasks.workunit.client.0.smithi066.stdout:8/648: mknod d17/d49/d4b/d57/d5e/d62/d79/ce0 0 2024-09-12T22:49:57.118 INFO:tasks.workunit.client.0.smithi066.stdout:3/611: chown d0/d2 28 1 2024-09-12T22:49:57.118 INFO:tasks.workunit.client.0.smithi066.stdout:7/540: rename d0/d19/d26/d5a/la7 to d0/d19/d26/d48/d84/lb3 0 2024-09-12T22:49:57.118 INFO:tasks.workunit.client.0.smithi066.stdout:5/702: creat d5/de/d50/d8b/fd1 x:0 0 0 2024-09-12T22:49:57.119 INFO:tasks.workunit.client.0.smithi066.stdout:9/635: unlink d9/d31/d58/da4/fb4 0 2024-09-12T22:49:57.119 INFO:tasks.workunit.client.0.smithi066.stdout:8/649: chown d17/d2c/f7c 21865035 1 2024-09-12T22:49:57.119 INFO:tasks.workunit.client.0.smithi066.stdout:4/688: rename d5/d8/d16/d1b/d73 to d5/d8/d16/d93/de0/de8 0 2024-09-12T22:49:57.119 INFO:tasks.workunit.client.0.smithi066.stdout:0/605: link d1/c91 d1/d36/d65/dc2/dd7/cdc 0 2024-09-12T22:49:57.119 INFO:tasks.workunit.client.0.smithi066.stdout:7/541: mknod d0/d19/d26/d48/cb4 0 2024-09-12T22:49:57.119 INFO:tasks.workunit.client.0.smithi066.stdout:3/612: creat d0/fd7 x:0 0 0 2024-09-12T22:49:57.119 INFO:tasks.workunit.client.0.smithi066.stdout:5/703: mknod d5/d15/db9/cd2 0 2024-09-12T22:49:57.119 INFO:tasks.workunit.client.0.smithi066.stdout:9/636: fsync d9/d31/d77/dc2/dcb/f62 0 2024-09-12T22:49:57.119 INFO:tasks.workunit.client.0.smithi066.stdout:7/542: fsync d0/d19/d26/d48/f9e 0 2024-09-12T22:49:57.119 INFO:tasks.workunit.client.0.smithi066.stdout:8/650: write d17/d40/d47/d66/f78 [2694850,65998] 0 2024-09-12T22:49:57.119 INFO:tasks.workunit.client.0.smithi066.stdout:3/613: rename d0/d2/d7 to d0/d2/d7/d13/d31/dd8 22 2024-09-12T22:49:57.119 INFO:tasks.workunit.client.0.smithi066.stdout:4/689: link d5/d3e/d8d/dc7/fc9 d5/d8/d16/dc2/fe9 0 2024-09-12T22:49:57.119 INFO:tasks.workunit.client.0.smithi066.stdout:4/690: stat d5/d8/d10/de/f2b 0 2024-09-12T22:49:57.119 INFO:tasks.workunit.client.0.smithi066.stdout:4/691: readlink d5/d8/d16/lb4 0 2024-09-12T22:49:57.120 INFO:tasks.workunit.client.0.smithi066.stdout:3/614: rename d0/d2/d1d/d87/d6b/db2/cd3 to d0/d2/d1d/d87/d40/d44/d55/d91/cd9 0 2024-09-12T22:49:57.120 INFO:tasks.workunit.client.0.smithi066.stdout:5/704: dwrite d5/d11/d23/d6f/fc5 [0,4194304] 0 2024-09-12T22:49:57.120 INFO:tasks.workunit.client.0.smithi066.stdout:4/692: dread - d5/d8/d16/d1b/d1e/f51 zero size 2024-09-12T22:49:57.120 INFO:tasks.workunit.client.0.smithi066.stdout:2/605: dread d1/f6 [0,4194304] 0 2024-09-12T22:49:57.120 INFO:tasks.workunit.client.0.smithi066.stdout:9/637: dwrite d9/d31/d58/dbc/f66 [0,4194304] 0 2024-09-12T22:49:57.120 INFO:tasks.workunit.client.0.smithi066.stdout:9/638: fdatasync d9/d31/d58/f70 0 2024-09-12T22:49:57.120 INFO:tasks.workunit.client.0.smithi066.stdout:2/606: creat d1/d44/d51/fb8 x:0 0 0 2024-09-12T22:49:57.120 INFO:tasks.workunit.client.0.smithi066.stdout:9/639: chown d9/dc/d23 875 1 2024-09-12T22:49:57.120 INFO:tasks.workunit.client.0.smithi066.stdout:4/693: mkdir d5/d8/d16/d93/da6/dea 0 2024-09-12T22:49:57.120 INFO:tasks.workunit.client.0.smithi066.stdout:2/607: truncate d1/d44/d51/fb8 916938 0 2024-09-12T22:49:57.120 INFO:tasks.workunit.client.0.smithi066.stdout:9/640: truncate d9/dc/d8e/fa0 550967 0 2024-09-12T22:49:57.120 INFO:tasks.workunit.client.0.smithi066.stdout:2/608: fdatasync d1/dd/d68/f83 0 2024-09-12T22:49:57.120 INFO:tasks.workunit.client.0.smithi066.stdout:3/615: dwrite d0/d2/d1d/d87/d6b/fbe [0,4194304] 0 2024-09-12T22:49:57.121 INFO:tasks.workunit.client.0.smithi066.stdout:2/609: symlink d1/dd/d12/d18/lb9 0 2024-09-12T22:49:57.121 INFO:tasks.workunit.client.0.smithi066.stdout:1/525: truncate d0/dc/d33/f6c 3646768 0 2024-09-12T22:49:57.121 INFO:tasks.workunit.client.0.smithi066.stdout:2/610: stat d1/dd/d12/f21 0 2024-09-12T22:49:57.121 INFO:tasks.workunit.client.0.smithi066.stdout:4/694: dwrite d5/d8/d16/d1b/d1e/d1f/d8c/fcc [0,4194304] 0 2024-09-12T22:49:57.121 INFO:tasks.workunit.client.0.smithi066.stdout:9/641: dwrite d9/d31/d77/fc3 [0,4194304] 0 2024-09-12T22:49:57.121 INFO:tasks.workunit.client.0.smithi066.stdout:4/695: symlink d5/d8/d16/d93/leb 0 2024-09-12T22:49:57.121 INFO:tasks.workunit.client.0.smithi066.stdout:2/611: rename d1/db/f5d to d1/dd/d3d/fba 0 2024-09-12T22:49:57.121 INFO:tasks.workunit.client.0.smithi066.stdout:9/642: write d9/dc/d46/d8a/f95 [878236,44264] 0 2024-09-12T22:49:57.121 INFO:tasks.workunit.client.0.smithi066.stdout:7/543: read d0/d19/d24/f1d [4191583,114731] 0 2024-09-12T22:49:57.121 INFO:tasks.workunit.client.0.smithi066.stdout:4/696: write d5/d8/d16/f9b [278215,45811] 0 2024-09-12T22:49:57.121 INFO:tasks.workunit.client.0.smithi066.stdout:8/651: dwrite d17/d49/d4b/d57/d5e/d62/f67 [0,4194304] 0 2024-09-12T22:49:57.121 INFO:tasks.workunit.client.0.smithi066.stdout:9/643: truncate d9/d31/d58/fbe 918476 0 2024-09-12T22:49:57.121 INFO:tasks.workunit.client.0.smithi066.stdout:7/544: mknod d0/d19/d24/d33/d27/d70/d90/cb5 0 2024-09-12T22:49:57.121 INFO:tasks.workunit.client.0.smithi066.stdout:8/652: creat d17/d49/d4b/d4e/fe1 x:0 0 0 2024-09-12T22:49:57.122 INFO:tasks.workunit.client.0.smithi066.stdout:4/697: chown d5/d8/d16/d1b/c5f 8133277 1 2024-09-12T22:49:57.122 INFO:tasks.workunit.client.0.smithi066.stdout:8/653: sync 2024-09-12T22:49:57.122 INFO:tasks.workunit.client.0.smithi066.stdout:5/705: truncate d5/d11/d21/fb0 3347180 0 2024-09-12T22:49:57.122 INFO:tasks.workunit.client.0.smithi066.stdout:5/706: chown d5/c10 492 1 2024-09-12T22:49:57.122 INFO:tasks.workunit.client.0.smithi066.stdout:4/698: fdatasync d5/d8/d16/d1b/d1e/d1f/fb1 0 2024-09-12T22:49:57.122 INFO:tasks.workunit.client.0.smithi066.stdout:3/616: write d0/d2/d7/f97 [4382702,35144] 0 2024-09-12T22:49:57.122 INFO:tasks.workunit.client.0.smithi066.stdout:1/526: write d0/d36/d57/f27 [1129892,98347] 0 2024-09-12T22:49:57.122 INFO:tasks.workunit.client.0.smithi066.stdout:8/654: mkdir d17/d49/d4b/d4e/daf/dcb/de2 0 2024-09-12T22:49:57.122 INFO:tasks.workunit.client.0.smithi066.stdout:5/707: symlink d5/de/d50/d8b/ld3 0 2024-09-12T22:49:57.122 INFO:tasks.workunit.client.0.smithi066.stdout:9/644: creat d9/d31/d58/d7f/dc8/fd7 x:0 0 0 2024-09-12T22:49:57.122 INFO:tasks.workunit.client.0.smithi066.stdout:4/699: mkdir d5/d8/d10/de/d39/dc6/dec 0 2024-09-12T22:49:57.122 INFO:tasks.workunit.client.0.smithi066.stdout:3/617: symlink d0/d2/d1d/d87/d40/da2/lda 0 2024-09-12T22:49:57.122 INFO:tasks.workunit.client.0.smithi066.stdout:2/612: dwrite d1/dd/d12/d67/fb3 [0,4194304] 0 2024-09-12T22:49:57.122 INFO:tasks.workunit.client.0.smithi066.stdout:7/545: dwrite d0/d19/d24/f12 [0,4194304] 0 2024-09-12T22:49:57.123 INFO:tasks.workunit.client.0.smithi066.stdout:7/546: read - d0/d19/d24/d33/f5b zero size 2024-09-12T22:49:57.123 INFO:tasks.workunit.client.0.smithi066.stdout:4/700: getdents d5/d3e/d8d/dce 0 2024-09-12T22:49:57.123 INFO:tasks.workunit.client.0.smithi066.stdout:2/613: symlink d1/d11/d26/d4f/lbb 0 2024-09-12T22:49:57.123 INFO:tasks.workunit.client.0.smithi066.stdout:7/547: fsync d0/d19/d24/fa3 0 2024-09-12T22:49:57.123 INFO:tasks.workunit.client.0.smithi066.stdout:3/618: mknod d0/d2/d1d/d87/d40/d44/cdb 0 2024-09-12T22:49:57.123 INFO:tasks.workunit.client.0.smithi066.stdout:4/701: chown d5/d8/d16/d1b 9 1 2024-09-12T22:49:57.123 INFO:tasks.workunit.client.0.smithi066.stdout:2/614: write d1/db/d42/d43/f85 [560768,25127] 0 2024-09-12T22:49:57.123 INFO:tasks.workunit.client.0.smithi066.stdout:3/619: write d0/d2/d6/f9 [327886,30913] 0 2024-09-12T22:49:57.123 INFO:tasks.workunit.client.0.smithi066.stdout:7/548: symlink d0/d19/d24/d33/d27/d70/lb6 0 2024-09-12T22:49:57.123 INFO:tasks.workunit.client.0.smithi066.stdout:6/680: dread d6/d23/d25/d4e/dc4/f12 [0,4194304] 0 2024-09-12T22:49:57.123 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:57.103+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:57.127 INFO:tasks.workunit.client.0.smithi066.stdout:2/615: mkdir d1/dd/d68/dbc 0 2024-09-12T22:49:57.127 INFO:tasks.workunit.client.0.smithi066.stdout:7/549: creat d0/d86/fb7 x:0 0 0 2024-09-12T22:49:57.127 INFO:tasks.workunit.client.0.smithi066.stdout:9/645: dwrite d9/dc/dd/f5f [4194304,4194304] 0 2024-09-12T22:49:57.127 INFO:tasks.workunit.client.0.smithi066.stdout:4/702: rename d5/d8/d10/de/fbf to d5/d8/d16/d93/d9c/d98/d8b/fed 0 2024-09-12T22:49:57.127 INFO:tasks.workunit.client.0.smithi066.stdout:6/681: rmdir d6/d49 39 2024-09-12T22:49:57.127 INFO:tasks.workunit.client.0.smithi066.stdout:3/620: creat d0/d2/d7/fdc x:0 0 0 2024-09-12T22:49:57.127 INFO:tasks.workunit.client.0.smithi066.stdout:0/606: dread d1/f67 [0,4194304] 0 2024-09-12T22:49:57.127 INFO:tasks.workunit.client.0.smithi066.stdout:2/616: mknod d1/d11/d26/d4f/d5f/d61/cbd 0 2024-09-12T22:49:57.127 INFO:tasks.workunit.client.0.smithi066.stdout:8/655: write d17/d1b/f2e [19677,24713] 0 2024-09-12T22:49:57.127 INFO:tasks.workunit.client.0.smithi066.stdout:9/646: fdatasync d9/d31/d77/dc2/dcb/f71 0 2024-09-12T22:49:57.128 INFO:tasks.workunit.client.0.smithi066.stdout:8/656: creat d17/d40/dc4/fe3 x:0 0 0 2024-09-12T22:49:57.128 INFO:tasks.workunit.client.0.smithi066.stdout:0/607: readlink d1/d8/d1b/d88/la5 0 2024-09-12T22:49:57.128 INFO:tasks.workunit.client.0.smithi066.stdout:2/617: creat d1/d11/d26/d4f/d7c/fbe x:0 0 0 2024-09-12T22:49:57.128 INFO:tasks.workunit.client.0.smithi066.stdout:6/682: link d6/d23/d25/d4e/dc4/d99/fa3 d6/d23/d25/d2c/d69/fe3 0 2024-09-12T22:49:57.128 INFO:tasks.workunit.client.0.smithi066.stdout:8/657: stat d17/d40/d74/da3/dac 0 2024-09-12T22:49:57.128 INFO:tasks.workunit.client.0.smithi066.stdout:7/550: dwrite d0/d19/d24/d33/d27/f35 [0,4194304] 0 2024-09-12T22:49:57.128 INFO:tasks.workunit.client.0.smithi066.stdout:7/551: fsync d0/d19/d60/d85/d8b/fb0 0 2024-09-12T22:49:57.128 INFO:tasks.workunit.client.0.smithi066.stdout:8/658: creat d17/d49/d4b/d57/d5e/d65/fe4 x:0 0 0 2024-09-12T22:49:57.128 INFO:tasks.workunit.client.0.smithi066.stdout:8/659: sync 2024-09-12T22:49:57.128 INFO:tasks.workunit.client.0.smithi066.stdout:6/683: truncate d6/d23/d25/d4e/dc4/d50/f5d 1778279 0 2024-09-12T22:49:57.128 INFO:tasks.workunit.client.0.smithi066.stdout:2/618: rename d1/d11/f19 to d1/db/d42/d43/fbf 0 2024-09-12T22:49:57.128 INFO:tasks.workunit.client.0.smithi066.stdout:3/621: dwrite d0/d2/d7/f97 [0,4194304] 0 2024-09-12T22:49:57.128 INFO:tasks.workunit.client.0.smithi066.stdout:8/660: write d17/f27 [2464380,95361] 0 2024-09-12T22:49:57.129 INFO:tasks.workunit.client.0.smithi066.stdout:8/661: sync 2024-09-12T22:49:57.129 INFO:tasks.workunit.client.0.smithi066.stdout:6/684: write d6/d23/f5e [2053872,109257] 0 2024-09-12T22:49:57.129 INFO:tasks.workunit.client.0.smithi066.stdout:0/608: rename d1/d8/d1c/d13/f1e to d1/d8/d1b/dac/fdd 0 2024-09-12T22:49:57.129 INFO:tasks.workunit.client.0.smithi066.stdout:7/552: truncate d0/d19/d26/d48/d59/f68 2850949 0 2024-09-12T22:49:57.129 INFO:tasks.workunit.client.0.smithi066.stdout:6/685: stat d6/d23/d25/d4e/dc4/d50/f6c 0 2024-09-12T22:49:57.129 INFO:tasks.workunit.client.0.smithi066.stdout:3/622: mknod d0/d2/d1d/d87/d40/dd1/cdd 0 2024-09-12T22:49:57.129 INFO:tasks.workunit.client.0.smithi066.stdout:2/619: symlink d1/d11/lc0 0 2024-09-12T22:49:57.129 INFO:tasks.workunit.client.0.smithi066.stdout:0/609: write d1/f67 [1676948,120712] 0 2024-09-12T22:49:57.130 INFO:tasks.workunit.client.0.smithi066.stdout:6/686: unlink d6/d23/d25/d2c/d85/lac 0 2024-09-12T22:49:57.130 INFO:tasks.workunit.client.0.smithi066.stdout:0/610: readlink d1/d8/d1f/l60 0 2024-09-12T22:49:57.130 INFO:tasks.workunit.client.0.smithi066.stdout:2/620: write d1/d11/f50 [2546514,83316] 0 2024-09-12T22:49:57.130 INFO:tasks.workunit.client.0.smithi066.stdout:4/703: dread d5/f33 [0,4194304] 0 2024-09-12T22:49:57.131 INFO:tasks.workunit.client.0.smithi066.stdout:2/621: mkdir d1/dc1 0 2024-09-12T22:49:57.131 INFO:tasks.workunit.client.0.smithi066.stdout:0/611: rename d1/d36/d65/f9f to d1/d8/d1c/d13/d2f/dd8/fde 0 2024-09-12T22:49:57.131 INFO:tasks.workunit.client.0.smithi066.stdout:2/622: symlink d1/d11/d26/d4f/d5f/da9/lc2 0 2024-09-12T22:49:57.131 INFO:tasks.workunit.client.0.smithi066.stdout:4/704: dread d5/d8/d10/de/d2d/fa1 [0,4194304] 0 2024-09-12T22:49:57.131 INFO:tasks.workunit.client.0.smithi066.stdout:0/612: mkdir d1/d8/d1f/d30/ddf 0 2024-09-12T22:49:57.132 INFO:tasks.workunit.client.0.smithi066.stdout:6/687: dread d6/d23/d25/d4e/dc4/d32/f68 [0,4194304] 0 2024-09-12T22:49:57.132 INFO:tasks.workunit.client.0.smithi066.stdout:2/623: symlink d1/d11/d26/d4f/d5f/d61/d72/lc3 0 2024-09-12T22:49:57.132 INFO:tasks.workunit.client.0.smithi066.stdout:4/705: symlink d5/d8/d16/d93/d9c/d98/ddc/lee 0 2024-09-12T22:49:57.132 INFO:tasks.workunit.client.0.smithi066.stdout:0/613: rename d1/d36/f8b to d1/d8/d1b/dac/fe0 0 2024-09-12T22:49:57.132 INFO:tasks.workunit.client.0.smithi066.stdout:4/706: rename d5 to d5/d87/def 22 2024-09-12T22:49:57.133 INFO:tasks.workunit.client.0.smithi066.stdout:0/614: getdents d1/d8/d1f/d47 0 2024-09-12T22:49:57.133 INFO:tasks.workunit.client.0.smithi066.stdout:4/707: getdents d5/d3e/d65 0 2024-09-12T22:49:57.134 INFO:tasks.workunit.client.0.smithi066.stdout:0/615: mkdir d1/d8/d1c/d13/d2f/d8a/de1 0 2024-09-12T22:49:57.135 INFO:tasks.workunit.client.0.smithi066.stdout:4/708: symlink d5/d8/d16/d1b/d72/lf0 0 2024-09-12T22:49:57.135 INFO:tasks.workunit.client.0.smithi066.stdout:0/616: rmdir d1 39 2024-09-12T22:49:57.135 INFO:tasks.workunit.client.0.smithi066.stdout:4/709: chown d5/d3e/d8d/ce5 34755 1 2024-09-12T22:49:57.136 INFO:tasks.workunit.client.0.smithi066.stdout:6/688: dwrite d6/d23/d25/f6f [0,4194304] 0 2024-09-12T22:49:57.137 INFO:tasks.workunit.client.0.smithi066.stdout:6/689: fsync d6/d23/d25/d4e/dc4/f65 0 2024-09-12T22:49:57.139 INFO:tasks.workunit.client.0.smithi066.stdout:0/617: unlink d1/d8/d1c/d13/d2f/dd8/c31 0 2024-09-12T22:49:57.139 INFO:tasks.workunit.client.0.smithi066.stdout:4/710: mkdir d5/d8/d16/d93/d9c/d98/ddc/df1 0 2024-09-12T22:49:57.139 INFO:tasks.workunit.client.0.smithi066.stdout:1/527: write d0/dc/d1e/d95/f4d [594614,122043] 0 2024-09-12T22:49:57.139 INFO:tasks.workunit.client.0.smithi066.stdout:6/690: fdatasync d6/d7/faa 0 2024-09-12T22:49:57.139 INFO:tasks.workunit.client.0.smithi066.stdout:1/528: unlink d0/dc/f93 0 2024-09-12T22:49:57.140 INFO:tasks.workunit.client.0.smithi066.stdout:0/618: write d1/d8/d1f/d25/f34 [8500365,39999] 0 2024-09-12T22:49:57.140 INFO:tasks.workunit.client.0.smithi066.stdout:6/691: link d6/d23/d25/d88/f9d d6/d35/fe4 0 2024-09-12T22:49:57.140 INFO:tasks.workunit.client.0.smithi066.stdout:1/529: mkdir d0/dc/d99 0 2024-09-12T22:49:57.141 INFO:tasks.workunit.client.0.smithi066.stdout:6/692: creat d6/d23/d62/fe5 x:0 0 0 2024-09-12T22:49:57.141 INFO:tasks.workunit.client.0.smithi066.stdout:0/619: fdatasync d1/d8/d1c/f3a 0 2024-09-12T22:49:57.142 INFO:tasks.workunit.client.0.smithi066.stdout:0/620: sync 2024-09-12T22:49:57.142 INFO:tasks.workunit.client.0.smithi066.stdout:6/693: write d6/f4b [92107,108107] 0 2024-09-12T22:49:57.144 INFO:tasks.workunit.client.0.smithi066.stdout:0/621: mkdir d1/d8/d1f/d30/da0/de2 0 2024-09-12T22:49:57.144 INFO:tasks.workunit.client.0.smithi066.stdout:6/694: mkdir d6/d23/d25/d4e/de6 0 2024-09-12T22:49:57.144 INFO:tasks.workunit.client.0.smithi066.stdout:6/695: unlink d6/d7/cbd 0 2024-09-12T22:49:57.145 INFO:tasks.workunit.client.0.smithi066.stdout:5/708: dread d5/f24 [0,4194304] 0 2024-09-12T22:49:57.146 INFO:tasks.workunit.client.0.smithi066.stdout:1/530: dwrite d0/f64 [0,4194304] 0 2024-09-12T22:49:57.146 INFO:tasks.workunit.client.0.smithi066.stdout:7/553: truncate d0/d19/d60/f52 590344 0 2024-09-12T22:49:57.147 INFO:tasks.workunit.client.0.smithi066.stdout:1/531: stat d0/d36/d57/f2b 0 2024-09-12T22:49:57.148 INFO:tasks.workunit.client.0.smithi066.stdout:5/709: mknod d5/de/d57/cd4 0 2024-09-12T22:49:57.149 INFO:tasks.workunit.client.0.smithi066.stdout:2/624: dread d1/d11/d26/d4f/d52/f93 [0,4194304] 0 2024-09-12T22:49:57.150 INFO:tasks.workunit.client.0.smithi066.stdout:1/532: mkdir d0/d4e/d79/d94/d9a 0 2024-09-12T22:49:57.151 INFO:tasks.workunit.client.0.smithi066.stdout:5/710: mknod d5/d11/d23/d6f/daa/cd5 0 2024-09-12T22:49:57.151 INFO:tasks.workunit.client.0.smithi066.stdout:0/622: dwrite d1/d8/d1f/f7b [0,4194304] 0 2024-09-12T22:49:57.152 INFO:tasks.workunit.client.0.smithi066.stdout:7/554: read d0/d19/d60/d53/f67 [194543,34562] 0 2024-09-12T22:49:57.152 INFO:tasks.workunit.client.0.smithi066.stdout:6/696: dwrite d6/d23/d25/d4e/dc4/f12 [0,4194304] 0 2024-09-12T22:49:57.156 INFO:tasks.workunit.client.0.smithi066.stdout:6/697: readlink d6/d78/l7f 0 2024-09-12T22:49:57.156 INFO:tasks.workunit.client.0.smithi066.stdout:4/711: dread d5/d8/d16/f9b [0,4194304] 0 2024-09-12T22:49:57.157 INFO:tasks.workunit.client.0.smithi066.stdout:2/625: unlink d1/d11/d26/d4f/d5f/d61/d7e/l32 0 2024-09-12T22:49:57.157 INFO:tasks.workunit.client.0.smithi066.stdout:7/555: mkdir d0/d19/d24/d33/d27/d70/d90/db8 0 2024-09-12T22:49:57.157 INFO:tasks.workunit.client.0.smithi066.stdout:9/647: dread d9/d31/d58/f82 [0,4194304] 0 2024-09-12T22:49:57.158 INFO:tasks.workunit.client.0.smithi066.stdout:6/698: write d6/d23/d25/d4e/dc4/f12 [468503,31522] 0 2024-09-12T22:49:57.158 INFO:tasks.workunit.client.0.smithi066.stdout:4/712: creat d5/d8/d16/d93/d9c/d98/ff2 x:0 0 0 2024-09-12T22:49:57.158 INFO:tasks.workunit.client.0.smithi066.stdout:2/626: mkdir d1/dd/d12/d18/da8/dc4 0 2024-09-12T22:49:57.158 INFO:tasks.workunit.client.0.smithi066.stdout:9/648: fsync d9/d31/d58/dbc/f96 0 2024-09-12T22:49:57.159 INFO:tasks.workunit.client.0.smithi066.stdout:6/699: rename d6/d23/d62/l8d to d6/d23/d25/le7 0 2024-09-12T22:49:57.159 INFO:tasks.workunit.client.0.smithi066.stdout:5/711: dwrite d5/d11/d21/f4a [0,4194304] 0 2024-09-12T22:49:57.160 INFO:tasks.workunit.client.0.smithi066.stdout:2/627: rename d1/d44/d51/f8e to d1/dd/d12/d1e/fc5 0 2024-09-12T22:49:57.160 INFO:tasks.workunit.client.0.smithi066.stdout:4/713: getdents d5/d3e/d8d/dc7 0 2024-09-12T22:49:57.160 INFO:tasks.workunit.client.0.smithi066.stdout:6/700: symlink d6/d23/d41/le8 0 2024-09-12T22:49:57.161 INFO:tasks.workunit.client.0.smithi066.stdout:2/628: creat d1/d44/d51/d70/fc6 x:0 0 0 2024-09-12T22:49:57.162 INFO:tasks.workunit.client.0.smithi066.stdout:4/714: getdents d5/d8/d10/de/d2d/d64/d9a 0 2024-09-12T22:49:57.162 INFO:tasks.workunit.client.0.smithi066.stdout:2/629: mknod d1/d11/d26/d4f/d5f/d61/d9c/cc7 0 2024-09-12T22:49:57.163 INFO:tasks.workunit.client.0.smithi066.stdout:4/715: write d5/d3e/d65/f8f [4829139,36195] 0 2024-09-12T22:49:57.164 INFO:tasks.workunit.client.0.smithi066.stdout:2/630: rmdir d1/d11/d26/d8f 39 2024-09-12T22:49:57.164 INFO:tasks.workunit.client.0.smithi066.stdout:4/716: truncate d5/f4f 4810264 0 2024-09-12T22:49:57.165 INFO:tasks.workunit.client.0.smithi066.stdout:2/631: mkdir d1/d11/d26/d4f/d52/d56/dc8 0 2024-09-12T22:49:57.165 INFO:tasks.workunit.client.0.smithi066.stdout:6/701: dwrite d6/f8b [0,4194304] 0 2024-09-12T22:49:57.170 INFO:tasks.workunit.client.0.smithi066.stdout:2/632: dwrite d1/d44/f4b [0,4194304] 0 2024-09-12T22:49:57.171 INFO:tasks.workunit.client.0.smithi066.stdout:2/633: creat d1/dc1/fc9 x:0 0 0 2024-09-12T22:49:57.172 INFO:tasks.workunit.client.0.smithi066.stdout:3/623: dread d0/d2/d7/d13/d31/f83 [0,4194304] 0 2024-09-12T22:49:57.173 INFO:tasks.workunit.client.0.smithi066.stdout:3/624: mknod d0/d2/d7/dc4/cde 0 2024-09-12T22:49:57.173 INFO:tasks.workunit.client.0.smithi066.stdout:2/634: getdents d1/dd/d12 0 2024-09-12T22:49:57.174 INFO:tasks.workunit.client.0.smithi066.stdout:3/625: chown d0/d2/d7/d13/d31/f7f 476 1 2024-09-12T22:49:57.174 INFO:tasks.workunit.client.0.smithi066.stdout:3/626: chown d0/d2/d1d/d87/d40/f4d 118861 1 2024-09-12T22:49:57.175 INFO:tasks.workunit.client.0.smithi066.stdout:3/627: write d0/d2/d1d/d87/f8d [1246032,45364] 0 2024-09-12T22:49:57.182 INFO:tasks.workunit.client.0.smithi066.stdout:1/533: sync 2024-09-12T22:49:57.183 INFO:tasks.workunit.client.0.smithi066.stdout:1/534: rename d0/dc/fe to d0/dc/d1e/d47/f9b 0 2024-09-12T22:49:57.183 INFO:tasks.workunit.client.0.smithi066.stdout:8/662: dread d17/d1b/f30 [0,4194304] 0 2024-09-12T22:49:57.184 INFO:tasks.workunit.client.0.smithi066.stdout:1/535: chown d0/dc/d33/c59 1544005 1 2024-09-12T22:49:57.184 INFO:tasks.workunit.client.0.smithi066.stdout:8/663: symlink d17/d40/d74/le5 0 2024-09-12T22:49:57.184 INFO:tasks.workunit.client.0.smithi066.stdout:1/536: mkdir d0/d4e/d79/d86/d9c 0 2024-09-12T22:49:57.184 INFO:tasks.workunit.client.0.smithi066.stdout:8/664: fdatasync d17/f27 0 2024-09-12T22:49:57.185 INFO:tasks.workunit.client.0.smithi066.stdout:1/537: creat d0/d4e/d79/f9d x:0 0 0 2024-09-12T22:49:57.186 INFO:tasks.workunit.client.0.smithi066.stdout:8/665: symlink d17/d40/d74/da3/dac/dbb/le6 0 2024-09-12T22:49:57.186 INFO:tasks.workunit.client.0.smithi066.stdout:8/666: fdatasync d17/f70 0 2024-09-12T22:49:57.187 INFO:tasks.workunit.client.0.smithi066.stdout:8/667: rmdir d17/d49/d4b/d57/d5e 39 2024-09-12T22:49:57.189 INFO:tasks.workunit.client.0.smithi066.stdout:4/717: dread d5/d8/d16/f41 [4194304,4194304] 0 2024-09-12T22:49:57.189 INFO:tasks.workunit.client.0.smithi066.stdout:1/538: dwrite d0/d4e/f58 [0,4194304] 0 2024-09-12T22:49:57.191 INFO:tasks.workunit.client.0.smithi066.stdout:1/539: chown d0/d28/c2c 11 1 2024-09-12T22:49:57.193 INFO:tasks.workunit.client.0.smithi066.stdout:1/540: symlink d0/d4e/d79/d94/d9a/l9e 0 2024-09-12T22:49:57.196 INFO:tasks.workunit.client.0.smithi066.stdout:1/541: dwrite d0/d4e/d79/d86/f92 [0,4194304] 0 2024-09-12T22:49:57.197 INFO:tasks.workunit.client.0.smithi066.stdout:1/542: rmdir d0/d4e/d79 39 2024-09-12T22:49:57.199 INFO:tasks.workunit.client.0.smithi066.stdout:1/543: getdents d0/d4e 0 2024-09-12T22:49:57.199 INFO:tasks.workunit.client.0.smithi066.stdout:1/544: symlink d0/dc/l9f 0 2024-09-12T22:49:57.200 INFO:tasks.workunit.client.0.smithi066.stdout:1/545: rename d0/d89/c97 to d0/d36/d57/d81/ca0 0 2024-09-12T22:49:57.201 INFO:tasks.workunit.client.0.smithi066.stdout:1/546: write d0/dc/d1e/d95/f43 [681337,19769] 0 2024-09-12T22:49:57.202 INFO:tasks.workunit.client.0.smithi066.stdout:1/547: symlink d0/d4e/d79/d94/la1 0 2024-09-12T22:49:57.203 INFO:tasks.workunit.client.0.smithi066.stdout:1/548: symlink d0/d36/d6b/la2 0 2024-09-12T22:49:57.204 INFO:tasks.workunit.client.0.smithi066.stdout:1/549: write d0/d4e/d79/d86/f92 [3610833,81857] 0 2024-09-12T22:49:57.205 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:57.204+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:57.205 INFO:tasks.workunit.client.0.smithi066.stdout:1/550: creat d0/d89/fa3 x:0 0 0 2024-09-12T22:49:57.205 INFO:tasks.workunit.client.0.smithi066.stdout:1/551: stat d0/d4e/d79/d86/f92 0 2024-09-12T22:49:57.208 INFO:tasks.workunit.client.0.smithi066.stdout:2/635: dread d1/d11/f16 [0,4194304] 0 2024-09-12T22:49:57.209 INFO:tasks.workunit.client.0.smithi066.stdout:1/552: dwrite d0/dc/d1d/f39 [0,4194304] 0 2024-09-12T22:49:57.209 INFO:tasks.workunit.client.0.smithi066.stdout:2/636: read d1/dd/d12/d1e/f79 [5292,48532] 0 2024-09-12T22:49:57.211 INFO:tasks.workunit.client.0.smithi066.stdout:2/637: creat d1/db/fca x:0 0 0 2024-09-12T22:49:57.211 INFO:tasks.workunit.client.0.smithi066.stdout:1/553: dread d0/dc/d1d/f55 [0,4194304] 0 2024-09-12T22:49:57.212 INFO:tasks.workunit.client.0.smithi066.stdout:2/638: mknod d1/dd/d12/d18/da8/ccb 0 2024-09-12T22:49:57.212 INFO:tasks.workunit.client.0.smithi066.stdout:1/554: truncate d0/dc/d1e/d47/d6f/f98 288373 0 2024-09-12T22:49:57.214 INFO:tasks.workunit.client.0.smithi066.stdout:2/639: creat d1/d44/d51/fcc x:0 0 0 2024-09-12T22:49:57.214 INFO:tasks.workunit.client.0.smithi066.stdout:1/555: rmdir d0/d36/d6b 39 2024-09-12T22:49:57.214 INFO:tasks.workunit.client.0.smithi066.stdout:2/640: mknod d1/dd/d12/d1e/ccd 0 2024-09-12T22:49:57.214 INFO:tasks.workunit.client.0.smithi066.stdout:1/556: rename d0/d36/d57/f50 to d0/d36/d8e/fa4 0 2024-09-12T22:49:57.214 INFO:tasks.workunit.client.0.smithi066.stdout:2/641: write d1/d11/d26/d4f/d5f/d61/d7e/f34 [1698288,22536] 0 2024-09-12T22:49:57.215 INFO:tasks.workunit.client.0.smithi066.stdout:1/557: creat d0/d36/d57/d81/fa5 x:0 0 0 2024-09-12T22:49:57.215 INFO:tasks.workunit.client.0.smithi066.stdout:1/558: fdatasync d0/d36/d57/f3d 0 2024-09-12T22:49:57.215 INFO:tasks.workunit.client.0.smithi066.stdout:2/642: symlink d1/d11/d26/d4f/d5f/d61/d7e/lce 0 2024-09-12T22:49:57.216 INFO:tasks.workunit.client.0.smithi066.stdout:1/559: creat d0/d4e/d79/d94/fa6 x:0 0 0 2024-09-12T22:49:57.216 INFO:tasks.workunit.client.0.smithi066.stdout:2/643: creat d1/dd/d12/d18/fcf x:0 0 0 2024-09-12T22:49:57.216 INFO:tasks.workunit.client.0.smithi066.stdout:2/644: dread - d1/dd/d12/d18/fcf zero size 2024-09-12T22:49:57.217 INFO:tasks.workunit.client.0.smithi066.stdout:1/560: link d0/dc/d44/f54 d0/d36/d57/d81/fa7 0 2024-09-12T22:49:57.217 INFO:tasks.workunit.client.0.smithi066.stdout:2/645: symlink d1/d11/d26/d4f/d7c/ld0 0 2024-09-12T22:49:57.218 INFO:tasks.workunit.client.0.smithi066.stdout:9/649: sync 2024-09-12T22:49:57.218 INFO:tasks.workunit.client.0.smithi066.stdout:1/561: mknod d0/d36/d57/d81/ca8 0 2024-09-12T22:49:57.218 INFO:tasks.workunit.client.0.smithi066.stdout:9/650: dread - d9/d31/d58/d7f/fcf zero size 2024-09-12T22:49:57.219 INFO:tasks.workunit.client.0.smithi066.stdout:1/562: creat d0/d4e/d79/d94/fa9 x:0 0 0 2024-09-12T22:49:57.220 INFO:tasks.workunit.client.0.smithi066.stdout:9/651: rename d9/d31/d34/d4d/c69 to d9/dc/dd2/cd8 0 2024-09-12T22:49:57.220 INFO:tasks.workunit.client.0.smithi066.stdout:1/563: write d0/d4e/d79/d94/fa9 [307235,31397] 0 2024-09-12T22:49:57.221 INFO:tasks.workunit.client.0.smithi066.stdout:9/652: creat d9/d31/d58/da4/fd9 x:0 0 0 2024-09-12T22:49:57.221 INFO:tasks.workunit.client.0.smithi066.stdout:1/564: symlink d0/d4e/d79/d86/d9c/laa 0 2024-09-12T22:49:57.222 INFO:tasks.workunit.client.0.smithi066.stdout:2/646: dwrite d1/d11/d26/d4f/d5f/d61/d7e/f64 [0,4194304] 0 2024-09-12T22:49:57.222 INFO:tasks.workunit.client.0.smithi066.stdout:1/565: mknod d0/dc/d1e/d47/cab 0 2024-09-12T22:49:57.222 INFO:tasks.workunit.client.0.smithi066.stdout:9/653: getdents d9/d31/d34/d4d/d8c 0 2024-09-12T22:49:57.223 INFO:tasks.workunit.client.0.smithi066.stdout:2/647: fdatasync d1/dd/d12/d18/f3e 0 2024-09-12T22:49:57.223 INFO:tasks.workunit.client.0.smithi066.stdout:9/654: readlink d9/d31/d34/lae 0 2024-09-12T22:49:57.224 INFO:tasks.workunit.client.0.smithi066.stdout:2/648: mkdir d1/dd/d12/dd1 0 2024-09-12T22:49:57.224 INFO:tasks.workunit.client.0.smithi066.stdout:1/566: rename d0/dc/d33/f90 to d0/d4e/d79/d86/d9c/fac 0 2024-09-12T22:49:57.224 INFO:tasks.workunit.client.0.smithi066.stdout:9/655: creat d9/d31/d58/dbc/da8/fda x:0 0 0 2024-09-12T22:49:57.225 INFO:tasks.workunit.client.0.smithi066.stdout:9/656: chown d9/d31/db0 31 1 2024-09-12T22:49:57.225 INFO:tasks.workunit.client.0.smithi066.stdout:2/649: mknod d1/db/d42/d43/cd2 0 2024-09-12T22:49:57.225 INFO:tasks.workunit.client.0.smithi066.stdout:9/657: fdatasync d9/d31/d34/f3b 0 2024-09-12T22:49:57.226 INFO:tasks.workunit.client.0.smithi066.stdout:2/650: mknod d1/d11/d26/cd3 0 2024-09-12T22:49:57.228 INFO:tasks.workunit.client.0.smithi066.stdout:1/567: dwrite d0/d36/d57/f3f [0,4194304] 0 2024-09-12T22:49:57.230 INFO:tasks.workunit.client.0.smithi066.stdout:9/658: dwrite d9/f53 [0,4194304] 0 2024-09-12T22:49:57.230 INFO:tasks.workunit.client.0.smithi066.stdout:1/568: rmdir d0/d4e 39 2024-09-12T22:49:57.232 INFO:tasks.workunit.client.0.smithi066.stdout:9/659: rename d9/dc/d23/f41 to d9/dc/d23/fdb 0 2024-09-12T22:49:57.232 INFO:tasks.workunit.client.0.smithi066.stdout:9/660: chown d9/d31/d58/dbc/f74 43 1 2024-09-12T22:49:57.233 INFO:tasks.workunit.client.0.smithi066.stdout:9/661: readlink d9/d31/d77/d8f/ld0 0 2024-09-12T22:49:57.234 INFO:tasks.workunit.client.0.smithi066.stdout:9/662: truncate d9/d31/f5e 239404 0 2024-09-12T22:49:57.236 INFO:tasks.workunit.client.0.smithi066.stdout:1/569: dwrite d0/d4e/d79/d94/fa6 [0,4194304] 0 2024-09-12T22:49:57.239 INFO:tasks.workunit.client.0.smithi066.stdout:1/570: fsync d0/dc/d44/f77 0 2024-09-12T22:49:57.239 INFO:tasks.workunit.client.0.smithi066.stdout:9/663: dwrite d9/d31/d58/dbc/f74 [0,4194304] 0 2024-09-12T22:49:57.240 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:57.240 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:49:57.240 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:49:57.240 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:49:57.240 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:57.241 INFO:tasks.workunit.client.0.smithi066.stdout:1/571: mknod d0/dc/d1e/d95/cad 0 2024-09-12T22:49:57.241 INFO:tasks.workunit.client.0.smithi066.stdout:6/702: sync 2024-09-12T22:49:57.241 INFO:tasks.workunit.client.0.smithi066.stdout:4/718: sync 2024-09-12T22:49:57.241 INFO:tasks.workunit.client.0.smithi066.stdout:3/628: sync 2024-09-12T22:49:57.241 INFO:tasks.workunit.client.0.smithi066.stdout:3/629: stat d0/cb 0 2024-09-12T22:49:57.242 INFO:tasks.workunit.client.0.smithi066.stdout:1/572: chown d0/dc/d1e/d95/c20 6 1 2024-09-12T22:49:57.243 INFO:tasks.workunit.client.0.smithi066.stdout:3/630: getdents d0/d2/d1d/d87/d40/dbd 0 2024-09-12T22:49:57.244 INFO:tasks.workunit.client.0.smithi066.stdout:6/703: link d6/d23/d25/d4e/dc4/ca4 d6/d23/d25/d4e/dc4/d32/d3c/ce9 0 2024-09-12T22:49:57.244 INFO:tasks.workunit.client.0.smithi066.stdout:9/664: dwrite d9/f53 [0,4194304] 0 2024-09-12T22:49:57.245 INFO:tasks.workunit.client.0.smithi066.stdout:9/665: write d9/dc/dd/f65 [381584,60476] 0 2024-09-12T22:49:57.247 INFO:tasks.workunit.client.0.smithi066.stdout:6/704: creat d6/d23/d25/d4e/dc4/d32/dce/fea x:0 0 0 2024-09-12T22:49:57.248 INFO:tasks.workunit.client.0.smithi066.stdout:9/666: write d9/d31/d58/fc9 [682427,74725] 0 2024-09-12T22:49:57.248 INFO:tasks.workunit.client.0.smithi066.stdout:6/705: unlink d6/d51/c61 0 2024-09-12T22:49:57.248 INFO:tasks.workunit.client.0.smithi066.stdout:6/706: readlink d6/d23/d25/l76 0 2024-09-12T22:49:57.249 INFO:tasks.workunit.client.0.smithi066.stdout:6/707: fsync d6/d49/f2f 0 2024-09-12T22:49:57.251 INFO:tasks.workunit.client.0.smithi066.stdout:7/556: truncate d0/d19/d60/f8d 6047784 0 2024-09-12T22:49:57.252 INFO:tasks.workunit.client.0.smithi066.stdout:7/557: rename d0/d19/d24/c76 to d0/d19/d24/cb9 0 2024-09-12T22:49:57.253 INFO:tasks.workunit.client.0.smithi066.stdout:7/558: mkdir d0/d19/d24/d33/d27/dba 0 2024-09-12T22:49:57.254 INFO:tasks.workunit.client.0.smithi066.stdout:1/573: dread d0/d4e/d79/d86/d9c/fac [0,4194304] 0 2024-09-12T22:49:57.254 INFO:tasks.workunit.client.0.smithi066.stdout:7/559: dread - d0/d19/d60/d85/d8b/fa8 zero size 2024-09-12T22:49:57.255 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:57.255 INFO:tasks.workunit.client.0.smithi066.stdout:7/560: chown d0/d19/d26/d48/d84/laf 7 1 2024-09-12T22:49:57.256 INFO:tasks.workunit.client.0.smithi066.stdout:5/712: write d5/d14/f69 [342793,45325] 0 2024-09-12T22:49:57.256 INFO:tasks.workunit.client.0.smithi066.stdout:5/713: symlink d5/d11/d21/d78/ld6 0 2024-09-12T22:49:57.259 INFO:tasks.workunit.client.0.smithi066.stdout:5/714: dwrite d5/d11/d21/d78/f7b [0,4194304] 0 2024-09-12T22:49:57.277 INFO:tasks.workunit.client.0.smithi066.stdout:8/668: truncate d17/d49/d4b/d4e/f96 3605636 0 2024-09-12T22:49:57.277 INFO:tasks.workunit.client.0.smithi066.stdout:8/669: mkdir d17/d1b/de7 0 2024-09-12T22:49:57.277 INFO:tasks.workunit.client.0.smithi066.stdout:8/670: write d17/d49/d4b/d57/f80 [123706,98790] 0 2024-09-12T22:49:57.278 INFO:tasks.workunit.client.0.smithi066.stdout:9/667: dread d9/fa [0,4194304] 0 2024-09-12T22:49:57.279 INFO:tasks.workunit.client.0.smithi066.stdout:9/668: rename d9/dc/d46/la7 to d9/d31/d58/ldc 0 2024-09-12T22:49:57.279 INFO:tasks.workunit.client.0.smithi066.stdout:9/669: write d9/d31/d58/f70 [820694,19563] 0 2024-09-12T22:49:57.280 INFO:tasks.workunit.client.0.smithi066.stdout:8/671: read d17/d40/d47/d4d/d87/fa9 [2111419,63462] 0 2024-09-12T22:49:57.280 INFO:tasks.workunit.client.0.smithi066.stdout:9/670: write d9/dc6/fa2 [4445972,16173] 0 2024-09-12T22:49:57.281 INFO:tasks.workunit.client.0.smithi066.stdout:4/719: dread d5/d8/d16/d1b/d1e/d5a/f5d [0,4194304] 0 2024-09-12T22:49:57.282 INFO:tasks.workunit.client.0.smithi066.stdout:9/671: mknod d9/d31/d34/cdd 0 2024-09-12T22:49:57.282 INFO:tasks.workunit.client.0.smithi066.stdout:8/672: rename d17/d40/l4f to d17/d40/d74/da3/le8 0 2024-09-12T22:49:57.283 INFO:tasks.workunit.client.0.smithi066.stdout:9/672: write d9/dc/dd/f47 [473087,55936] 0 2024-09-12T22:49:57.284 INFO:tasks.workunit.client.0.smithi066.stdout:4/720: truncate d5/d8/d16/d93/de0/de8/f76 1661530 0 2024-09-12T22:49:57.284 INFO:tasks.workunit.client.0.smithi066.stdout:7/561: dread d0/d19/d26/d48/fa9 [0,4194304] 0 2024-09-12T22:49:57.284 INFO:tasks.workunit.client.0.smithi066.stdout:9/673: creat d9/d31/d77/dc2/dcb/fde x:0 0 0 2024-09-12T22:49:57.284 INFO:tasks.workunit.client.0.smithi066.stdout:8/673: getdents d17/d40/d74/da3/dac/dbb 0 2024-09-12T22:49:57.284 INFO:tasks.workunit.client.0.smithi066.stdout:7/562: mknod d0/cbb 0 2024-09-12T22:49:57.285 INFO:tasks.workunit.client.0.smithi066.stdout:4/721: write d5/d3e/d8d/dce/f3f [1804142,92633] 0 2024-09-12T22:49:57.285 INFO:tasks.workunit.client.0.smithi066.stdout:9/674: creat d9/d31/d58/dbc/fdf x:0 0 0 2024-09-12T22:49:57.285 INFO:tasks.workunit.client.0.smithi066.stdout:8/674: creat d17/d1b/de7/fe9 x:0 0 0 2024-09-12T22:49:57.285 INFO:tasks.workunit.client.0.smithi066.stdout:7/563: symlink d0/d19/d26/d5a/lbc 0 2024-09-12T22:49:57.286 INFO:tasks.workunit.client.0.smithi066.stdout:8/675: rename d17/d40/d74/da3/dac/dbb to d17/d1b/de7/dea 0 2024-09-12T22:49:57.287 INFO:tasks.workunit.client.0.smithi066.stdout:7/564: getdents d0/d19/d60 0 2024-09-12T22:49:57.291 INFO:tasks.workunit.client.0.smithi066.stdout:4/722: dwrite d5/d8/d16/d93/d9c/d98/d8b/f97 [0,4194304] 0 2024-09-12T22:49:57.293 INFO:tasks.workunit.client.0.smithi066.stdout:7/565: dwrite d0/d19/d60/d53/f8c [0,4194304] 0 2024-09-12T22:49:57.293 INFO:tasks.workunit.client.0.smithi066.stdout:2/651: dwrite d1/dd/d12/d18/da8/f9d [0,4194304] 0 2024-09-12T22:49:57.293 INFO:tasks.workunit.client.0.smithi066.stdout:0/623: unlink d1/f1a 0 2024-09-12T22:49:57.294 INFO:tasks.workunit.client.0.smithi066.stdout:3/631: write d0/d2/d1d/d87/d40/f96 [479910,121499] 0 2024-09-12T22:49:57.294 INFO:tasks.workunit.client.0.smithi066.stdout:4/723: fsync d5/d3e/d8d/f53 0 2024-09-12T22:49:57.295 INFO:tasks.workunit.client.0.smithi066.stdout:4/724: write d5/f46 [292550,48359] 0 2024-09-12T22:49:57.297 INFO:tasks.workunit.client.0.smithi066.stdout:2/652: dread d1/d44/d51/fb8 [0,4194304] 0 2024-09-12T22:49:57.298 INFO:tasks.workunit.client.0.smithi066.stdout:4/725: chown d5/d8/d16/d93/d9c/d98/dab/cb7 0 1 2024-09-12T22:49:57.300 INFO:tasks.workunit.client.0.smithi066.stdout:7/566: dwrite d0/d19/d24/d33/d27/d70/fb1 [4194304,4194304] 0 2024-09-12T22:49:57.301 INFO:tasks.workunit.client.0.smithi066.stdout:1/574: write d0/dc/f22 [2035207,13071] 0 2024-09-12T22:49:57.303 INFO:tasks.workunit.client.0.smithi066.stdout:0/624: dwrite d1/d8/d1b/dac/fad [0,4194304] 0 2024-09-12T22:49:57.303 INFO:tasks.workunit.client.0.smithi066.stdout:5/715: truncate d5/f3b 52474 0 2024-09-12T22:49:57.303 INFO:tasks.workunit.client.0.smithi066.stdout:7/567: stat d0/d19/d60/d53/c96 0 2024-09-12T22:49:57.304 INFO:tasks.workunit.client.0.smithi066.stdout:2/653: truncate d1/dd/d12/f21 2164103 0 2024-09-12T22:49:57.304 INFO:tasks.workunit.client.0.smithi066.stdout:5/716: symlink d5/d11/d7c/ld7 0 2024-09-12T22:49:57.305 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:57.304+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:57.306 INFO:tasks.workunit.client.0.smithi066.stdout:7/568: link d0/d6/l4a d0/d86/lbd 0 2024-09-12T22:49:57.306 INFO:tasks.workunit.client.0.smithi066.stdout:5/717: mknod d5/d11/d5d/cd8 0 2024-09-12T22:49:57.307 INFO:tasks.workunit.client.0.smithi066.stdout:2/654: dread d1/d44/d51/fb8 [0,4194304] 0 2024-09-12T22:49:57.307 INFO:tasks.workunit.client.0.smithi066.stdout:6/708: dwrite d6/d23/d25/d88/f9d [0,4194304] 0 2024-09-12T22:49:57.308 INFO:tasks.workunit.client.0.smithi066.stdout:5/718: creat d5/d11/d23/fd9 x:0 0 0 2024-09-12T22:49:57.308 INFO:tasks.workunit.client.0.smithi066.stdout:2/655: truncate d1/dd/d3d/fba 8634478 0 2024-09-12T22:49:57.309 INFO:tasks.workunit.client.0.smithi066.stdout:0/625: dread d1/d8/d1b/dac/fdd [0,4194304] 0 2024-09-12T22:49:57.309 INFO:tasks.workunit.client.0.smithi066.stdout:5/719: chown d5/de/d50/d8b/fa1 20399 1 2024-09-12T22:49:57.309 INFO:tasks.workunit.client.0.smithi066.stdout:7/569: mkdir d0/d19/d26/dbe 0 2024-09-12T22:49:57.310 INFO:tasks.workunit.client.0.smithi066.stdout:0/626: symlink d1/d8/d1c/d13/d2f/d8a/le3 0 2024-09-12T22:49:57.310 INFO:tasks.workunit.client.0.smithi066.stdout:7/570: unlink d0/d19/d24/d33/d27/f57 0 2024-09-12T22:49:57.311 INFO:tasks.workunit.client.0.smithi066.stdout:0/627: stat d1/d8/d1c/d13/fd6 0 2024-09-12T22:49:57.313 INFO:tasks.workunit.client.0.smithi066.stdout:0/628: creat d1/d5b/d6d/fe4 x:0 0 0 2024-09-12T22:49:57.314 INFO:tasks.workunit.client.0.smithi066.stdout:0/629: creat d1/d8/d1c/fe5 x:0 0 0 2024-09-12T22:49:57.315 INFO:tasks.workunit.client.0.smithi066.stdout:6/709: creat d6/d7/feb x:0 0 0 2024-09-12T22:49:57.315 INFO:tasks.workunit.client.0.smithi066.stdout:9/675: dread d9/dc/d46/f4b [0,4194304] 0 2024-09-12T22:49:57.316 INFO:tasks.workunit.client.0.smithi066.stdout:0/630: dread - d1/d8/d1b/d88/fc9 zero size 2024-09-12T22:49:57.318 INFO:tasks.workunit.client.0.smithi066.stdout:8/676: dwrite d17/d1b/de7/dea/fc0 [0,4194304] 0 2024-09-12T22:49:57.318 INFO:tasks.workunit.client.0.smithi066.stdout:9/676: write d9/dc/d46/d8a/f92 [988723,26953] 0 2024-09-12T22:49:57.318 INFO:tasks.workunit.client.0.smithi066.stdout:0/631: readlink d1/d8/d1b/d59/l87 0 2024-09-12T22:49:57.319 INFO:tasks.workunit.client.0.smithi066.stdout:0/632: mkdir d1/d36/de6 0 2024-09-12T22:49:57.319 INFO:tasks.workunit.client.0.smithi066.stdout:9/677: getdents d9/d31/d77/dc2 0 2024-09-12T22:49:57.320 INFO:tasks.workunit.client.0.smithi066.stdout:0/633: write d1/d5b/d6d/fc8 [4668302,127365] 0 2024-09-12T22:49:57.320 INFO:tasks.workunit.client.0.smithi066.stdout:8/677: link d17/d49/d4b/d57/d5e/fc3 d17/d40/d74/da3/dac/dc8/feb 0 2024-09-12T22:49:57.321 INFO:tasks.workunit.client.0.smithi066.stdout:9/678: mknod d9/d31/d58/dbc/ce0 0 2024-09-12T22:49:57.321 INFO:tasks.workunit.client.0.smithi066.stdout:6/710: dwrite d6/d23/d62/faf [0,4194304] 0 2024-09-12T22:49:57.321 INFO:tasks.workunit.client.0.smithi066.stdout:0/634: creat d1/d36/d65/fe7 x:0 0 0 2024-09-12T22:49:57.322 INFO:tasks.workunit.client.0.smithi066.stdout:6/711: fdatasync d6/d23/f27 0 2024-09-12T22:49:57.322 INFO:tasks.workunit.client.0.smithi066.stdout:6/712: readlink d6/d23/d25/d4e/dc4/d32/d3c/la5 0 2024-09-12T22:49:57.323 INFO:tasks.workunit.client.0.smithi066.stdout:0/635: creat d1/d8/d1c/d56/fe8 x:0 0 0 2024-09-12T22:49:57.323 INFO:tasks.workunit.client.0.smithi066.stdout:6/713: write d6/d51/fc3 [160255,51385] 0 2024-09-12T22:49:57.324 INFO:tasks.workunit.client.0.smithi066.stdout:8/678: creat d17/d49/d4b/d57/d5e/d62/dc1/dd1/fec x:0 0 0 2024-09-12T22:49:57.325 INFO:tasks.workunit.client.0.smithi066.stdout:0/636: truncate d1/d36/fcb 677196 0 2024-09-12T22:49:57.325 INFO:tasks.workunit.client.0.smithi066.stdout:3/632: dread d0/d2/d7/f1a [0,4194304] 0 2024-09-12T22:49:57.326 INFO:tasks.workunit.client.0.smithi066.stdout:6/714: mknod d6/d23/d25/d4e/dc4/d50/dd6/cec 0 2024-09-12T22:49:57.326 INFO:tasks.workunit.client.0.smithi066.stdout:9/679: dread d9/d31/d58/dbc/f74 [0,4194304] 0 2024-09-12T22:49:57.326 INFO:tasks.workunit.client.0.smithi066.stdout:0/637: mkdir d1/d36/d65/de9 0 2024-09-12T22:49:57.327 INFO:tasks.workunit.client.0.smithi066.stdout:6/715: mknod d6/d23/d41/db6/ced 0 2024-09-12T22:49:57.327 INFO:tasks.workunit.client.0.smithi066.stdout:3/633: symlink d0/d2/d1d/d87/d40/d44/d55/d91/dcb/ldf 0 2024-09-12T22:49:57.329 INFO:tasks.workunit.client.0.smithi066.stdout:6/716: creat d6/d23/d25/d4e/dc4/d32/dce/fee x:0 0 0 2024-09-12T22:49:57.329 INFO:tasks.workunit.client.0.smithi066.stdout:3/634: rename d0/db3/fcc to d0/d2/d1d/d87/d6b/fe0 0 2024-09-12T22:49:57.330 INFO:tasks.workunit.client.0.smithi066.stdout:8/679: dwrite d17/d1b/f86 [0,4194304] 0 2024-09-12T22:49:57.331 INFO:tasks.workunit.client.0.smithi066.stdout:7/571: write d0/d19/d60/d85/d8b/fa8 [635868,111726] 0 2024-09-12T22:49:57.332 INFO:tasks.workunit.client.0.smithi066.stdout:9/680: dread d9/d31/d77/fc3 [0,4194304] 0 2024-09-12T22:49:57.332 INFO:tasks.workunit.client.0.smithi066.stdout:3/635: fsync d0/d2/d1d/d87/d40/f4d 0 2024-09-12T22:49:57.333 INFO:tasks.workunit.client.0.smithi066.stdout:2/656: truncate d1/d11/d26/d4f/d5f/d61/d72/dad/d76/f95 733744 0 2024-09-12T22:49:57.333 INFO:tasks.workunit.client.0.smithi066.stdout:0/638: dwrite d1/d36/f79 [0,4194304] 0 2024-09-12T22:49:57.334 INFO:tasks.workunit.client.0.smithi066.stdout:5/720: write d5/f3b [805028,107278] 0 2024-09-12T22:49:57.335 INFO:tasks.workunit.client.0.smithi066.stdout:9/681: creat d9/dc/d46/d8a/fe1 x:0 0 0 2024-09-12T22:49:57.336 INFO:tasks.workunit.client.0.smithi066.stdout:5/721: write d5/d11/d5d/f83 [869371,10970] 0 2024-09-12T22:49:57.337 INFO:tasks.workunit.client.0.smithi066.stdout:3/636: symlink d0/d2/d1d/d87/d40/dbd/d74/le1 0 2024-09-12T22:49:57.337 INFO:tasks.workunit.client.0.smithi066.stdout:6/717: dwrite d6/f8b [0,4194304] 0 2024-09-12T22:49:57.338 INFO:tasks.workunit.client.0.smithi066.stdout:9/682: write d9/dc/d46/f4b [1559403,25288] 0 2024-09-12T22:49:57.338 INFO:tasks.workunit.client.0.smithi066.stdout:5/722: unlink d5/d11/d23/d6f/f7e 0 2024-09-12T22:49:57.339 INFO:tasks.workunit.client.0.smithi066.stdout:0/639: rename d1/d8/d1c/f17 to d1/fea 0 2024-09-12T22:49:57.339 INFO:tasks.workunit.client.0.smithi066.stdout:8/680: link d17/d2c/lb6 d17/d49/d4b/d57/d5e/d62/led 0 2024-09-12T22:49:57.340 INFO:tasks.workunit.client.0.smithi066.stdout:3/637: write d0/d2/d1d/d87/d40/f96 [687090,107351] 0 2024-09-12T22:49:57.340 INFO:tasks.workunit.client.0.smithi066.stdout:7/572: dwrite d0/d19/d24/d33/f69 [0,4194304] 0 2024-09-12T22:49:57.340 INFO:tasks.workunit.client.0.smithi066.stdout:5/723: chown d5/d11/d21/fb5 37827 1 2024-09-12T22:49:57.342 INFO:tasks.workunit.client.0.smithi066.stdout:0/640: symlink d1/d8/d1f/d47/leb 0 2024-09-12T22:49:57.343 INFO:tasks.workunit.client.0.smithi066.stdout:5/724: creat d5/d11/d21/d4d/fda x:0 0 0 2024-09-12T22:49:57.344 INFO:tasks.workunit.client.0.smithi066.stdout:8/681: getdents d17/d40/d74/da3/dac/db4 0 2024-09-12T22:49:57.345 INFO:tasks.workunit.client.0.smithi066.stdout:0/641: creat d1/d8/fec x:0 0 0 2024-09-12T22:49:57.345 INFO:tasks.workunit.client.0.smithi066.stdout:7/573: write d0/d19/d60/d85/d8b/fb0 [502911,110689] 0 2024-09-12T22:49:57.346 INFO:tasks.workunit.client.0.smithi066.stdout:2/657: read d1/dd/f14 [3866809,74304] 0 2024-09-12T22:49:57.346 INFO:tasks.workunit.client.0.smithi066.stdout:6/718: dwrite d6/d23/d25/d4e/dc4/d50/f6c [0,4194304] 0 2024-09-12T22:49:57.347 INFO:tasks.workunit.client.0.smithi066.stdout:6/719: symlink d6/d23/d41/db6/lef 0 2024-09-12T22:49:57.348 INFO:tasks.workunit.client.0.smithi066.stdout:2/658: creat d1/d11/d26/d4f/fd4 x:0 0 0 2024-09-12T22:49:57.351 INFO:tasks.workunit.client.0.smithi066.stdout:7/574: getdents d0/d19/d24/d33/d27/d70/d90 0 2024-09-12T22:49:57.351 INFO:tasks.workunit.client.0.smithi066.stdout:6/720: mknod d6/d78/d4a/cf0 0 2024-09-12T22:49:57.351 INFO:tasks.workunit.client.0.smithi066.stdout:7/575: unlink d0/d19/f6c 0 2024-09-12T22:49:57.351 INFO:tasks.workunit.client.0.smithi066.stdout:2/659: write d1/d11/d26/d4f/d7c/faa [536135,14605] 0 2024-09-12T22:49:57.351 INFO:tasks.workunit.client.0.smithi066.stdout:7/576: write d0/d19/d24/fa0 [516347,128174] 0 2024-09-12T22:49:57.352 INFO:tasks.workunit.client.0.smithi066.stdout:6/721: rename d6/d23/d62/cdb to d6/d78/d4a/cf1 0 2024-09-12T22:49:57.352 INFO:tasks.workunit.client.0.smithi066.stdout:2/660: creat d1/dd/d68/fd5 x:0 0 0 2024-09-12T22:49:57.354 INFO:tasks.workunit.client.0.smithi066.stdout:7/577: read - d0/d19/d26/d48/d84/f91 zero size 2024-09-12T22:49:57.354 INFO:tasks.workunit.client.0.smithi066.stdout:5/725: dread d5/d11/fca [0,4194304] 0 2024-09-12T22:49:57.354 INFO:tasks.workunit.client.0.smithi066.stdout:3/638: truncate d0/d2/d7/d29/f3d 2045527 0 2024-09-12T22:49:57.354 INFO:tasks.workunit.client.0.smithi066.stdout:7/578: fsync d0/d19/d24/f16 0 2024-09-12T22:49:57.354 INFO:tasks.workunit.client.0.smithi066.stdout:4/726: dread d5/d3e/d8d/dce/f3f [0,4194304] 0 2024-09-12T22:49:57.355 INFO:tasks.workunit.client.0.smithi066.stdout:3/639: dread - d0/d2/d7/d29/fcd zero size 2024-09-12T22:49:57.355 INFO:tasks.workunit.client.0.smithi066.stdout:9/683: fsync d9/dc/d46/f4b 0 2024-09-12T22:49:57.355 INFO:tasks.workunit.client.0.smithi066.stdout:5/726: read - d5/d11/d5d/d8a/fad zero size 2024-09-12T22:49:57.355 INFO:tasks.workunit.client.0.smithi066.stdout:7/579: symlink d0/d86/lbf 0 2024-09-12T22:49:57.357 INFO:tasks.workunit.client.0.smithi066.stdout:4/727: chown d5/d8/d16/f9b 79 1 2024-09-12T22:49:57.357 INFO:tasks.workunit.client.0.smithi066.stdout:5/727: rmdir d5/d11/d7c/d98 39 2024-09-12T22:49:57.357 INFO:tasks.workunit.client.0.smithi066.stdout:9/684: mkdir d9/d31/d34/d4d/d8c/de2 0 2024-09-12T22:49:57.357 INFO:tasks.workunit.client.0.smithi066.stdout:5/728: mknod d5/d14/cdb 0 2024-09-12T22:49:57.357 INFO:tasks.workunit.client.0.smithi066.stdout:4/728: fsync d5/d8/d16/d93/d9c/d98/d8b/fd6 0 2024-09-12T22:49:57.357 INFO:tasks.workunit.client.0.smithi066.stdout:3/640: getdents d0/d2/d1d/d87/d49/dc8 0 2024-09-12T22:49:57.358 INFO:tasks.workunit.client.0.smithi066.stdout:6/722: dwrite d6/d23/d25/d4e/dc4/fc5 [0,4194304] 0 2024-09-12T22:49:57.358 INFO:tasks.workunit.client.0.smithi066.stdout:5/729: stat d5/d11/d21/fb0 0 2024-09-12T22:49:57.358 INFO:tasks.workunit.client.0.smithi066.stdout:4/729: chown d5/d8/d16/d1b/d1e/d1f 107864683 1 2024-09-12T22:49:57.358 INFO:tasks.workunit.client.0.smithi066.stdout:1/575: dread d0/f1c [0,4194304] 0 2024-09-12T22:49:57.359 INFO:tasks.workunit.client.0.smithi066.stdout:4/730: write d5/d3e/d8d/dc7/f83 [4406237,84468] 0 2024-09-12T22:49:57.360 INFO:tasks.workunit.client.0.smithi066.stdout:9/685: truncate d9/dc/d23/f30 3776408 0 2024-09-12T22:49:57.360 INFO:tasks.workunit.client.0.smithi066.stdout:7/580: dwrite d0/d19/d26/d48/d84/f91 [0,4194304] 0 2024-09-12T22:49:57.361 INFO:tasks.workunit.client.0.smithi066.stdout:1/576: truncate d0/d4e/d79/f9d 245798 0 2024-09-12T22:49:57.361 INFO:tasks.workunit.client.0.smithi066.stdout:7/581: write d0/d19/d26/fad [2611384,67131] 0 2024-09-12T22:49:57.362 INFO:tasks.workunit.client.0.smithi066.stdout:9/686: symlink d9/dc/dd2/le3 0 2024-09-12T22:49:57.364 INFO:tasks.workunit.client.0.smithi066.stdout:7/582: dread - d0/d19/d24/d33/d27/d70/f9d zero size 2024-09-12T22:49:57.364 INFO:tasks.workunit.client.0.smithi066.stdout:9/687: mkdir d9/d31/d58/de4 0 2024-09-12T22:49:57.364 INFO:tasks.workunit.client.0.smithi066.stdout:1/577: link d0/dc/d33/f96 d0/dc/d1d/fae 0 2024-09-12T22:49:57.366 INFO:tasks.workunit.client.0.smithi066.stdout:0/642: sync 2024-09-12T22:49:57.366 INFO:tasks.workunit.client.0.smithi066.stdout:4/731: dwrite d5/d8/d10/de/d39/f3b [0,4194304] 0 2024-09-12T22:49:57.367 INFO:tasks.workunit.client.0.smithi066.stdout:4/732: creat d5/d8/d16/d1b/d1e/d1f/d8c/ff3 x:0 0 0 2024-09-12T22:49:57.368 INFO:tasks.workunit.client.0.smithi066.stdout:1/578: dread d0/d4e/d79/d94/fa6 [0,4194304] 0 2024-09-12T22:49:57.368 INFO:tasks.workunit.client.0.smithi066.stdout:1/579: chown d0/d28/c2a 2 1 2024-09-12T22:49:57.369 INFO:tasks.workunit.client.0.smithi066.stdout:6/723: read d6/d7/faa [411535,2565] 0 2024-09-12T22:49:57.369 INFO:tasks.workunit.client.0.smithi066.stdout:7/583: read d0/d19/d24/f1d [4181975,78563] 0 2024-09-12T22:49:57.369 INFO:tasks.workunit.client.0.smithi066.stdout:1/580: truncate d0/d36/d57/f27 1317739 0 2024-09-12T22:49:57.370 INFO:tasks.workunit.client.0.smithi066.stdout:6/724: mkdir d6/d23/d41/df2 0 2024-09-12T22:49:57.370 INFO:tasks.workunit.client.0.smithi066.stdout:1/581: readlink d0/dc/d44/l71 0 2024-09-12T22:49:57.371 INFO:tasks.workunit.client.0.smithi066.stdout:7/584: unlink d0/d19/d26/d48/f71 0 2024-09-12T22:49:57.371 INFO:tasks.workunit.client.0.smithi066.stdout:7/585: readlink d0/d6/l2d 0 2024-09-12T22:49:57.371 INFO:tasks.workunit.client.0.smithi066.stdout:6/725: rmdir d6/d23/d25/d4e/dc4/d99/dcb 0 2024-09-12T22:49:57.372 INFO:tasks.workunit.client.0.smithi066.stdout:6/726: rmdir d6/d23/d25/d88 39 2024-09-12T22:49:57.372 INFO:tasks.workunit.client.0.smithi066.stdout:7/586: creat d0/d19/d24/d33/d27/fc0 x:0 0 0 2024-09-12T22:49:57.373 INFO:tasks.workunit.client.0.smithi066.stdout:7/587: read d0/d19/d26/d48/d84/f91 [1061147,112613] 0 2024-09-12T22:49:57.375 INFO:tasks.workunit.client.0.smithi066.stdout:1/582: dread d0/dc/f17 [0,4194304] 0 2024-09-12T22:49:57.376 INFO:tasks.workunit.client.0.smithi066.stdout:8/682: truncate d17/d49/d4b/f76 229168 0 2024-09-12T22:49:57.376 INFO:tasks.workunit.client.0.smithi066.stdout:1/583: link d0/dc/d33/c4a d0/d36/d8e/caf 0 2024-09-12T22:49:57.377 INFO:tasks.workunit.client.0.smithi066.stdout:2/661: truncate d1/d44/d51/d70/f92 83550 0 2024-09-12T22:49:57.377 INFO:tasks.workunit.client.0.smithi066.stdout:0/643: sync 2024-09-12T22:49:57.378 INFO:tasks.workunit.client.0.smithi066.stdout:5/730: truncate d5/de/d50/f92 3805389 0 2024-09-12T22:49:57.378 INFO:tasks.workunit.client.0.smithi066.stdout:7/588: sync 2024-09-12T22:49:57.378 INFO:tasks.workunit.client.0.smithi066.stdout:1/584: mknod d0/d4e/d79/cb0 0 2024-09-12T22:49:57.378 INFO:tasks.workunit.client.0.smithi066.stdout:2/662: creat d1/d11/d26/d4f/fd6 x:0 0 0 2024-09-12T22:49:57.379 INFO:tasks.workunit.client.0.smithi066.stdout:7/589: rmdir d0/d19/d24/d33/d27/d70 39 2024-09-12T22:49:57.379 INFO:tasks.workunit.client.0.smithi066.stdout:0/644: chown d1/d8/d1f/d25/d9c/fb2 69267 1 2024-09-12T22:49:57.380 INFO:tasks.workunit.client.0.smithi066.stdout:5/731: creat d5/de/d50/d42/d49/fdc x:0 0 0 2024-09-12T22:49:57.380 INFO:tasks.workunit.client.0.smithi066.stdout:2/663: stat d1/d11/d53/l8b 0 2024-09-12T22:49:57.380 INFO:tasks.workunit.client.0.smithi066.stdout:1/585: truncate d0/d4e/d79/d86/f88 274255 0 2024-09-12T22:49:57.380 INFO:tasks.workunit.client.0.smithi066.stdout:4/733: write d5/d3e/d8d/dc7/fc9 [1548355,128160] 0 2024-09-12T22:49:57.381 INFO:tasks.workunit.client.0.smithi066.stdout:1/586: rmdir d0/d89 39 2024-09-12T22:49:57.381 INFO:tasks.workunit.client.0.smithi066.stdout:5/732: symlink d5/d11/d7c/ldd 0 2024-09-12T22:49:57.381 INFO:tasks.workunit.client.0.smithi066.stdout:7/590: symlink d0/d19/d24/d33/d27/lc1 0 2024-09-12T22:49:57.381 INFO:tasks.workunit.client.0.smithi066.stdout:6/727: write d6/d23/d25/f9f [2010347,61585] 0 2024-09-12T22:49:57.382 INFO:tasks.workunit.client.0.smithi066.stdout:0/645: rename d1/d8/d1c/c9a to d1/d8/d1f/d47/ced 0 2024-09-12T22:49:57.382 INFO:tasks.workunit.client.0.smithi066.stdout:2/664: rmdir d1/db/d42/d43/d9a 0 2024-09-12T22:49:57.382 INFO:tasks.workunit.client.0.smithi066.stdout:5/733: stat d5/de/d50/f92 0 2024-09-12T22:49:57.383 INFO:tasks.workunit.client.0.smithi066.stdout:4/734: rename d5/d8/d16/d93/de0/de8/ld5 to d5/d3e/d8d/lf4 0 2024-09-12T22:49:57.384 INFO:tasks.workunit.client.0.smithi066.stdout:2/665: symlink d1/d11/d26/d4f/d7c/da6/dab/ld7 0 2024-09-12T22:49:57.384 INFO:tasks.workunit.client.0.smithi066.stdout:7/591: mknod d0/d19/d24/d33/d27/d70/d90/db8/cc2 0 2024-09-12T22:49:57.384 INFO:tasks.workunit.client.0.smithi066.stdout:5/734: write d5/f3e [5053942,55253] 0 2024-09-12T22:49:57.385 INFO:tasks.workunit.client.0.smithi066.stdout:8/683: dread d17/d1b/f9f [0,4194304] 0 2024-09-12T22:49:57.386 INFO:tasks.workunit.client.0.smithi066.stdout:1/587: dread d0/dc/d44/f84 [0,4194304] 0 2024-09-12T22:49:57.387 INFO:tasks.workunit.client.0.smithi066.stdout:4/735: chown d5/d8/d10/de/f14 2 1 2024-09-12T22:49:57.387 INFO:tasks.workunit.client.0.smithi066.stdout:7/592: write d0/d19/d60/d85/d8b/f9c [1572313,7280] 0 2024-09-12T22:49:57.388 INFO:tasks.workunit.client.0.smithi066.stdout:8/684: write d17/d40/d47/d4d/fca [396202,123429] 0 2024-09-12T22:49:57.389 INFO:tasks.workunit.client.0.smithi066.stdout:5/735: rename d5/c29 to d5/d11/d23/d6f/cde 0 2024-09-12T22:49:57.389 INFO:tasks.workunit.client.0.smithi066.stdout:3/641: dread d0/d2/d7/d13/d31/f7f [0,4194304] 0 2024-09-12T22:49:57.390 INFO:tasks.workunit.client.0.smithi066.stdout:0/646: dwrite d1/d36/f8e [0,4194304] 0 2024-09-12T22:49:57.390 INFO:tasks.workunit.client.0.smithi066.stdout:4/736: rename d5/d8/d16 to d5/d8/d16/d1b/df5 22 2024-09-12T22:49:57.392 INFO:tasks.workunit.client.0.smithi066.stdout:8/685: read - d17/d49/d4b/d4e/fe1 zero size 2024-09-12T22:49:57.392 INFO:tasks.workunit.client.0.smithi066.stdout:5/736: symlink d5/d14/ldf 0 2024-09-12T22:49:57.393 INFO:tasks.workunit.client.0.smithi066.stdout:6/728: dwrite d6/f96 [0,4194304] 0 2024-09-12T22:49:57.395 INFO:tasks.workunit.client.0.smithi066.stdout:2/666: dwrite d1/dd/d12/d1e/f79 [0,4194304] 0 2024-09-12T22:49:57.396 INFO:tasks.workunit.client.0.smithi066.stdout:3/642: mknod d0/d2/d1d/d87/ce2 0 2024-09-12T22:49:57.396 INFO:tasks.workunit.client.0.smithi066.stdout:1/588: write d0/dc/d1d/fae [485046,36976] 0 2024-09-12T22:49:57.398 INFO:tasks.workunit.client.0.smithi066.stdout:4/737: rename d5/d8/d16/d1b/c5f to d5/d8/d10/de/cf6 0 2024-09-12T22:49:57.398 INFO:tasks.workunit.client.0.smithi066.stdout:6/729: mkdir d6/d59/df3 0 2024-09-12T22:49:57.398 INFO:tasks.workunit.client.0.smithi066.stdout:5/737: creat d5/d11/d5d/d64/d8f/fe0 x:0 0 0 2024-09-12T22:49:57.399 INFO:tasks.workunit.client.0.smithi066.stdout:3/643: creat d0/d2/d7/d29/fe3 x:0 0 0 2024-09-12T22:49:57.399 INFO:tasks.workunit.client.0.smithi066.stdout:0/647: rmdir d1/d36/d8f 0 2024-09-12T22:49:57.399 INFO:tasks.workunit.client.0.smithi066.stdout:1/589: symlink d0/lb1 0 2024-09-12T22:49:57.399 INFO:tasks.workunit.client.0.smithi066.stdout:2/667: fsync d1/d11/d26/d4f/d5f/d61/d72/dad/d76/f95 0 2024-09-12T22:49:57.400 INFO:tasks.workunit.client.0.smithi066.stdout:4/738: write d5/d8/f78 [2070621,75712] 0 2024-09-12T22:49:57.401 INFO:tasks.workunit.client.0.smithi066.stdout:0/648: dread - d1/d8/d1c/d13/d2f/dd8/f66 zero size 2024-09-12T22:49:57.401 INFO:tasks.workunit.client.0.smithi066.stdout:9/688: dread d9/d31/f72 [0,4194304] 0 2024-09-12T22:49:57.402 INFO:tasks.workunit.client.0.smithi066.stdout:2/668: symlink d1/ld8 0 2024-09-12T22:49:57.402 INFO:tasks.workunit.client.0.smithi066.stdout:6/730: creat d6/d23/d25/d4e/dc4/d99/ff4 x:0 0 0 2024-09-12T22:49:57.402 INFO:tasks.workunit.client.0.smithi066.stdout:0/649: readlink d1/d8/d1b/d59/la3 0 2024-09-12T22:49:57.402 INFO:tasks.workunit.client.0.smithi066.stdout:3/644: mknod d0/d2/d7/dc4/dcf/d9e/ce4 0 2024-09-12T22:49:57.402 INFO:tasks.workunit.client.0.smithi066.stdout:1/590: creat d0/dc/fb2 x:0 0 0 2024-09-12T22:49:57.403 INFO:tasks.workunit.client.0.smithi066.stdout:0/650: fdatasync d1/d8/d1f/fd5 0 2024-09-12T22:49:57.403 INFO:tasks.workunit.client.0.smithi066.stdout:9/689: getdents d9/d31 0 2024-09-12T22:49:57.404 INFO:tasks.workunit.client.0.smithi066.stdout:9/690: sync 2024-09-12T22:49:57.404 INFO:tasks.workunit.client.0.smithi066.stdout:2/669: chown d1/dd/d12/d18/f3e 6 1 2024-09-12T22:49:57.404 INFO:tasks.workunit.client.0.smithi066.stdout:1/591: chown d0/dc/f17 1 1 2024-09-12T22:49:57.404 INFO:tasks.workunit.client.0.smithi066.stdout:6/731: creat d6/d23/d62/d79/ff5 x:0 0 0 2024-09-12T22:49:57.405 INFO:tasks.workunit.client.0.smithi066.stdout:3/645: write d0/d2/d1d/d87/d40/f4d [2146690,6821] 0 2024-09-12T22:49:57.405 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:57.404+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:57.405 INFO:tasks.workunit.client.0.smithi066.stdout:1/592: fsync d0/dc/d1d/f60 0 2024-09-12T22:49:57.406 INFO:tasks.workunit.client.0.smithi066.stdout:2/670: fsync d1/dd/d3d/f4a 0 2024-09-12T22:49:57.406 INFO:tasks.workunit.client.0.smithi066.stdout:1/593: chown d0 776931 1 2024-09-12T22:49:57.406 INFO:tasks.workunit.client.0.smithi066.stdout:9/691: write d9/dc/d23/f79 [4667042,41546] 0 2024-09-12T22:49:57.408 INFO:tasks.workunit.client.0.smithi066.stdout:4/739: dwrite d5/fe4 [0,4194304] 0 2024-09-12T22:49:57.408 INFO:tasks.workunit.client.0.smithi066.stdout:3/646: chown d0/d2/d7/d13/l34 3607 1 2024-09-12T22:49:57.408 INFO:tasks.workunit.client.0.smithi066.stdout:9/692: write f7 [1098035,9528] 0 2024-09-12T22:49:57.409 INFO:tasks.workunit.client.0.smithi066.stdout:7/593: dwrite d0/d19/d26/d48/d59/f68 [0,4194304] 0 2024-09-12T22:49:57.409 INFO:tasks.workunit.client.0.smithi066.stdout:6/732: creat d6/d23/d25/d4e/dc4/ff6 x:0 0 0 2024-09-12T22:49:57.410 INFO:tasks.workunit.client.0.smithi066.stdout:9/693: unlink d9/d31/d34/f3b 0 2024-09-12T22:49:57.410 INFO:tasks.workunit.client.0.smithi066.stdout:1/594: creat d0/d89/fb3 x:0 0 0 2024-09-12T22:49:57.410 INFO:tasks.workunit.client.0.smithi066.stdout:3/647: creat d0/d2/d1d/d87/d6b/db2/fe5 x:0 0 0 2024-09-12T22:49:57.411 INFO:tasks.workunit.client.0.smithi066.stdout:0/651: link d1/d8/d1c/d13/d2f/dd8/f28 d1/d8/d1f/d30/da0/fee 0 2024-09-12T22:49:57.412 INFO:tasks.workunit.client.0.smithi066.stdout:7/594: mkdir d0/d19/d26/d48/dc3 0 2024-09-12T22:49:57.413 INFO:tasks.workunit.client.0.smithi066.stdout:4/740: symlink d5/d8/d16/d93/d9c/d98/d8b/d86/lf7 0 2024-09-12T22:49:57.413 INFO:tasks.workunit.client.0.smithi066.stdout:1/595: unlink d0/dc/d1d/f39 0 2024-09-12T22:49:57.413 INFO:tasks.workunit.client.0.smithi066.stdout:0/652: chown d1/d8/c86 6725 1 2024-09-12T22:49:57.414 INFO:tasks.workunit.client.0.smithi066.stdout:6/733: fsync d6/d23/d25/f2e 0 2024-09-12T22:49:57.415 INFO:tasks.workunit.client.0.smithi066.stdout:0/653: chown d1/d8/d1b/d59/la3 3 1 2024-09-12T22:49:57.415 INFO:tasks.workunit.client.0.smithi066.stdout:1/596: creat d0/dc/d8f/fb4 x:0 0 0 2024-09-12T22:49:57.416 INFO:tasks.workunit.client.0.smithi066.stdout:2/671: dwrite d1/d11/d26/d4f/d5f/d61/d7e/f8c [0,4194304] 0 2024-09-12T22:49:57.416 INFO:tasks.workunit.client.0.smithi066.stdout:4/741: symlink d5/d8/d16/d93/d9c/d98/ddc/lf8 0 2024-09-12T22:49:57.417 INFO:tasks.workunit.client.0.smithi066.stdout:7/595: truncate d0/d19/d26/f6a 2243620 0 2024-09-12T22:49:57.417 INFO:tasks.workunit.client.0.smithi066.stdout:0/654: unlink d1/d8/d1c/fe5 0 2024-09-12T22:49:57.418 INFO:tasks.workunit.client.0.smithi066.stdout:1/597: chown d0/d36/d8e/caf 422 1 2024-09-12T22:49:57.418 INFO:tasks.workunit.client.0.smithi066.stdout:5/738: dwrite d5/d15/f71 [0,4194304] 0 2024-09-12T22:49:57.418 INFO:tasks.workunit.client.0.smithi066.stdout:2/672: mkdir d1/db/dd9 0 2024-09-12T22:49:57.418 INFO:tasks.workunit.client.0.smithi066.stdout:6/734: rename d6/d78/c7e to d6/d23/d62/cf7 0 2024-09-12T22:49:57.421 INFO:tasks.workunit.client.0.smithi066.stdout:0/655: unlink d1/d36/d65/dc2/fce 0 2024-09-12T22:49:57.421 INFO:tasks.workunit.client.0.smithi066.stdout:5/739: rename d5/de/d50/d8b to d5/d11/d23/d6f/daa/dbb/dc6/de1 0 2024-09-12T22:49:57.423 INFO:tasks.workunit.client.0.smithi066.stdout:7/596: creat d0/d19/fc4 x:0 0 0 2024-09-12T22:49:57.423 INFO:tasks.workunit.client.0.smithi066.stdout:1/598: creat d0/dc/fb5 x:0 0 0 2024-09-12T22:49:57.423 INFO:tasks.workunit.client.0.smithi066.stdout:0/656: rename d1/d8/d1b/d88 to d1/d8/d1b/d88/def 22 2024-09-12T22:49:57.424 INFO:tasks.workunit.client.0.smithi066.stdout:4/742: dwrite d5/d8/d10/f5c [0,4194304] 0 2024-09-12T22:49:57.424 INFO:tasks.workunit.client.0.smithi066.stdout:0/657: stat d1/d8/d1c/d56/db7 0 2024-09-12T22:49:57.424 INFO:tasks.workunit.client.0.smithi066.stdout:5/740: truncate d5/de/f95 552532 0 2024-09-12T22:49:57.424 INFO:tasks.workunit.client.0.smithi066.stdout:4/743: readlink d5/d8/d16/d93/ld0 0 2024-09-12T22:49:57.425 INFO:tasks.workunit.client.0.smithi066.stdout:1/599: rename d0/d28/l7c to d0/lb6 0 2024-09-12T22:49:57.425 INFO:tasks.workunit.client.0.smithi066.stdout:0/658: chown d1/d8/d1b/dac/fdd 2220 1 2024-09-12T22:49:57.425 INFO:tasks.workunit.client.0.smithi066.stdout:0/659: stat d1/d36/fd2 0 2024-09-12T22:49:57.426 INFO:tasks.workunit.client.0.smithi066.stdout:4/744: write d5/f4f [670643,111733] 0 2024-09-12T22:49:57.426 INFO:tasks.workunit.client.0.smithi066.stdout:5/741: rename d5/d11/d7c/l89 to d5/d11/d7c/d98/le2 0 2024-09-12T22:49:57.426 INFO:tasks.workunit.client.0.smithi066.stdout:4/745: symlink d5/d8/d16/d93/d9c/lf9 0 2024-09-12T22:49:57.427 INFO:tasks.workunit.client.0.smithi066.stdout:1/600: getdents d0/dc/d44 0 2024-09-12T22:49:57.427 INFO:tasks.workunit.client.0.smithi066.stdout:0/660: getdents d1/d8/d1b 0 2024-09-12T22:49:57.427 INFO:tasks.workunit.client.0.smithi066.stdout:5/742: creat d5/d11/d7c/dc3/dc7/fe3 x:0 0 0 2024-09-12T22:49:57.428 INFO:tasks.workunit.client.0.smithi066.stdout:0/661: fdatasync d1/dbf/fc5 0 2024-09-12T22:49:57.428 INFO:tasks.workunit.client.0.smithi066.stdout:1/601: symlink d0/dc/d1e/d95/lb7 0 2024-09-12T22:49:57.428 INFO:tasks.workunit.client.0.smithi066.stdout:5/743: chown d5/de/d50/d42/d9d/fa8 0 1 2024-09-12T22:49:57.428 INFO:tasks.workunit.client.0.smithi066.stdout:4/746: rename d5/d8/d16/d1b/f88 to d5/d8/d16/ffa 0 2024-09-12T22:49:57.429 INFO:tasks.workunit.client.0.smithi066.stdout:0/662: chown d1/d8/d1f/f45 257898 1 2024-09-12T22:49:57.431 INFO:tasks.workunit.client.0.smithi066.stdout:0/663: unlink d1/d8/d1c/d13/d2f/dd8/f89 0 2024-09-12T22:49:57.432 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:49:57.432 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:49:57.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:49:57.432 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:49:57.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.432 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12403 4.0 4:0146e0d0:::100000031d4.00000000:head [write 0~4194304 [2@3733965]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:57.432 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:55.747692+0000", 2024-09-12T22:49:57.433 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 1.680768877, 2024-09-12T22:49:57.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.22362137500000001, 2024-09-12T22:49:57.433 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:57.433 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:57.433 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:57.433 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:57.433 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:57.433 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:57.433 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12403 2024-09-12T22:49:57.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.433 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:57.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:57.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.747692+0000", 2024-09-12T22:49:57.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:57.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.747692+0000", 2024-09-12T22:49:57.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:57.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.747693+0000", 2024-09-12T22:49:57.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3799999999999996e-07 2024-09-12T22:49:57.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:57.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959640+0000", 2024-09-12T22:49:57.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.21194702000000001 2024-09-12T22:49:57.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:57.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959660+0000", 2024-09-12T22:49:57.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9939e-05 2024-09-12T22:49:57.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:57.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959668+0000", 2024-09-12T22:49:57.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1669999999999999e-06 2024-09-12T22:49:57.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:57.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959764+0000", 2024-09-12T22:49:57.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5315000000000005e-05 2024-09-12T22:49:57.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:57.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959865+0000", 2024-09-12T22:49:57.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101618 2024-09-12T22:49:57.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:57.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.971224+0000", 2024-09-12T22:49:57.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011358541999999999 2024-09-12T22:49:57.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:57.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.971261+0000", 2024-09-12T22:49:57.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7092999999999999e-05 2024-09-12T22:49:57.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:57.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.971314+0000", 2024-09-12T22:49:57.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2843000000000002e-05 2024-09-12T22:49:57.439 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.439 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:57.439 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.439 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:12503 4.15 e56/17 4:ab29d13f:::100000033b1.00000000:head v 56'161, mlcod=55'159)", 2024-09-12T22:49:57.439 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:49:57.439 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 1.3978554000000001, 2024-09-12T22:49:57.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.043668640000000002, 2024-09-12T22:49:57.439 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:57.440 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:57.440 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:57.440 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:57.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:57.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:49:57.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:57.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:49:57.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:57.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:49:57.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:49:57.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:57.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039768+0000", 2024-09-12T22:49:57.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0091617190000000005 2024-09-12T22:49:57.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:57.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039781+0000", 2024-09-12T22:49:57.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2829e-05 2024-09-12T22:49:57.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:57.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039789+0000", 2024-09-12T22:49:57.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9340000000000006e-06 2024-09-12T22:49:57.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:57.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039846+0000", 2024-09-12T22:49:57.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6762999999999998e-05 2024-09-12T22:49:57.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:57.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039897+0000", 2024-09-12T22:49:57.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1517000000000002e-05 2024-09-12T22:49:57.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:57.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074225+0000", 2024-09-12T22:49:57.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034328138000000001 2024-09-12T22:49:57.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:57.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074274+0000", 2024-09-12T22:49:57.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9255999999999997e-05 2024-09-12T22:49:57.445 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.445 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:57.445 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.445 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12508 4.2d 4:b7b19b64:::10000003230.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:57.445 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.037293+0000", 2024-09-12T22:49:57.445 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 1.3911682249999999, 2024-09-12T22:49:57.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.037399772999999997, 2024-09-12T22:49:57.446 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:57.446 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:57.446 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:57.446 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:57.446 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:57.446 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:57.446 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12508 2024-09-12T22:49:57.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.446 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:57.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:57.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037293+0000", 2024-09-12T22:49:57.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:57.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037293+0000", 2024-09-12T22:49:57.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:57.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037294+0000", 2024-09-12T22:49:57.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4899999999999995e-07 2024-09-12T22:49:57.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:57.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042701+0000", 2024-09-12T22:49:57.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054069419999999997 2024-09-12T22:49:57.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:57.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042712+0000", 2024-09-12T22:49:57.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.171e-05 2024-09-12T22:49:57.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:57.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042719+0000", 2024-09-12T22:49:57.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1189999999999999e-06 2024-09-12T22:49:57.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:57.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042759+0000", 2024-09-12T22:49:57.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9478999999999999e-05 2024-09-12T22:49:57.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:57.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042827+0000", 2024-09-12T22:49:57.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8435999999999993e-05 2024-09-12T22:49:57.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:57.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042965+0000", 2024-09-12T22:49:57.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000137723 2024-09-12T22:49:57.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:57.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.058351+0000", 2024-09-12T22:49:57.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015385902 2024-09-12T22:49:57.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:57.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074620+0000", 2024-09-12T22:49:57.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016269018 2024-09-12T22:49:57.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:57.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074657+0000", 2024-09-12T22:49:57.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6619999999999998e-05 2024-09-12T22:49:57.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:57.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074693+0000", 2024-09-12T22:49:57.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6174999999999998e-05 2024-09-12T22:49:57.452 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.452 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:57.452 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.453 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12516 4.21 4:858ae08d:::100000030eb.00000000:head [write 0~4194304 [3@1582458]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:57.453 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.045143+0000", 2024-09-12T22:49:57.453 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 1.3833179369999999, 2024-09-12T22:49:57.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.039721657, 2024-09-12T22:49:57.453 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:57.453 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:57.453 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:57.453 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:57.453 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:57.453 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:57.453 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12516 2024-09-12T22:49:57.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.454 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:57.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:57.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.045143+0000", 2024-09-12T22:49:57.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:57.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.045143+0000", 2024-09-12T22:49:57.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:57.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.045144+0000", 2024-09-12T22:49:57.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2900000000000002e-07 2024-09-12T22:49:57.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:57.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049506+0000", 2024-09-12T22:49:57.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043620280000000004 2024-09-12T22:49:57.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:57.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049517+0000", 2024-09-12T22:49:57.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0726e-05 2024-09-12T22:49:57.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:57.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049522+0000", 2024-09-12T22:49:57.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3730000000000001e-06 2024-09-12T22:49:57.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:57.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049583+0000", 2024-09-12T22:49:57.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1254999999999995e-05 2024-09-12T22:49:57.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:57.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049645+0000", 2024-09-12T22:49:57.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1988000000000003e-05 2024-09-12T22:49:57.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:57.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049731+0000", 2024-09-12T22:49:57.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6040999999999998e-05 2024-09-12T22:49:57.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:57.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.064126+0000", 2024-09-12T22:49:57.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01439497 2024-09-12T22:49:57.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:57.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.084785+0000", 2024-09-12T22:49:57.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020658972000000001 2024-09-12T22:49:57.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:57.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.084829+0000", 2024-09-12T22:49:57.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3869000000000003e-05 2024-09-12T22:49:57.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:57.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.084865+0000", 2024-09-12T22:49:57.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5605999999999998e-05 2024-09-12T22:49:57.459 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.459 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:57.459 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.460 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1354 3.18 3:1e8917d7:::200.0000000e:head [write 498872~14494 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:49:57.460 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.048337+0000", 2024-09-12T22:49:57.460 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 1.3801240180000001, 2024-09-12T22:49:57.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034292491000000001, 2024-09-12T22:49:57.460 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:57.460 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:57.460 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:57.460 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:57.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:57.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048337+0000", 2024-09-12T22:49:57.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:57.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048337+0000", 2024-09-12T22:49:57.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:57.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048339+0000", 2024-09-12T22:49:57.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.409e-06 2024-09-12T22:49:57.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:57.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048360+0000", 2024-09-12T22:49:57.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1659999999999999e-05 2024-09-12T22:49:57.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:57.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048370+0000", 2024-09-12T22:49:57.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.611e-06 2024-09-12T22:49:57.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:57.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048376+0000", 2024-09-12T22:49:57.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5479999999999998e-06 2024-09-12T22:49:57.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:57.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048440+0000", 2024-09-12T22:49:57.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3367000000000005e-05 2024-09-12T22:49:57.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:57.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048557+0000", 2024-09-12T22:49:57.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116983 2024-09-12T22:49:57.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:57.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048719+0000", 2024-09-12T22:49:57.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016250499999999999 2024-09-12T22:49:57.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:57.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.058763+0000", 2024-09-12T22:49:57.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010043948 2024-09-12T22:49:57.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:57.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082499+0000", 2024-09-12T22:49:57.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023735320000000001 2024-09-12T22:49:57.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:57.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082561+0000", 2024-09-12T22:49:57.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2490000000000006e-05 2024-09-12T22:49:57.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:57.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082630+0000", 2024-09-12T22:49:57.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8650000000000002e-05 2024-09-12T22:49:57.466 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.466 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:57.466 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.466 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12517 4.1a 4:5a8c04dd:::10000003276.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:57.466 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.049539+0000", 2024-09-12T22:49:57.467 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 1.3789222560000001, 2024-09-12T22:49:57.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.036068957999999998, 2024-09-12T22:49:57.467 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:57.467 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:57.467 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:57.467 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:57.467 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:57.467 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:57.467 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12517 2024-09-12T22:49:57.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.467 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:57.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:57.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049539+0000", 2024-09-12T22:49:57.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:57.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049539+0000", 2024-09-12T22:49:57.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:57.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049540+0000", 2024-09-12T22:49:57.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1299999999999999e-07 2024-09-12T22:49:57.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:57.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054581+0000", 2024-09-12T22:49:57.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005041167 2024-09-12T22:49:57.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:57.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054593+0000", 2024-09-12T22:49:57.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1943000000000001e-05 2024-09-12T22:49:57.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:57.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054598+0000", 2024-09-12T22:49:57.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6500000000000001e-06 2024-09-12T22:49:57.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:57.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054658+0000", 2024-09-12T22:49:57.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9898999999999997e-05 2024-09-12T22:49:57.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:57.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054800+0000", 2024-09-12T22:49:57.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014187100000000001 2024-09-12T22:49:57.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:57.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.085456+0000", 2024-09-12T22:49:57.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.030655452 2024-09-12T22:49:57.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:57.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.085533+0000", 2024-09-12T22:49:57.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7478999999999995e-05 2024-09-12T22:49:57.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:57.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.085608+0000", 2024-09-12T22:49:57.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4684000000000005e-05 2024-09-12T22:49:57.472 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.472 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:57.472 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.473 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1355 3.18 3:1e8917d7:::200.0000000e:head [write 513366~7763 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:49:57.473 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.051378+0000", 2024-09-12T22:49:57.473 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 1.377083354, 2024-09-12T22:49:57.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031342464, 2024-09-12T22:49:57.473 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:57.473 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:57.473 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:57.473 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:57.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:57.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.051378+0000", 2024-09-12T22:49:57.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:57.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.051378+0000", 2024-09-12T22:49:57.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:57.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.051380+0000", 2024-09-12T22:49:57.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8679999999999999e-06 2024-09-12T22:49:57.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:57.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.051391+0000", 2024-09-12T22:49:57.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1364e-05 2024-09-12T22:49:57.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:57.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.051407+0000", 2024-09-12T22:49:57.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5574e-05 2024-09-12T22:49:57.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:57.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.051416+0000", 2024-09-12T22:49:57.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1190000000000003e-06 2024-09-12T22:49:57.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:57.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.057996+0000", 2024-09-12T22:49:57.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065801109999999996 2024-09-12T22:49:57.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:57.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.058095+0000", 2024-09-12T22:49:57.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9244000000000001e-05 2024-09-12T22:49:57.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:57.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.058236+0000", 2024-09-12T22:49:57.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014110699999999999 2024-09-12T22:49:57.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:57.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.061742+0000", 2024-09-12T22:49:57.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0035056050000000002 2024-09-12T22:49:57.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:57.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082638+0000", 2024-09-12T22:49:57.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020896076 2024-09-12T22:49:57.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:57.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082687+0000", 2024-09-12T22:49:57.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8943000000000002e-05 2024-09-12T22:49:57.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:57.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082720+0000", 2024-09-12T22:49:57.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3453e-05 2024-09-12T22:49:57.479 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.479 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:57.479 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.480 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1356 3.18 3:1e8917d7:::200.0000000e:head [write 521129~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:49:57.480 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.051437+0000", 2024-09-12T22:49:57.480 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 1.3770238020000001, 2024-09-12T22:49:57.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031373360000000003, 2024-09-12T22:49:57.480 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:57.480 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:57.480 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:57.480 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:57.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:57.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.051437+0000", 2024-09-12T22:49:57.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:57.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.051437+0000", 2024-09-12T22:49:57.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:57.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.051438+0000", 2024-09-12T22:49:57.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.34e-07 2024-09-12T22:49:57.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:57.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.051443+0000", 2024-09-12T22:49:57.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3449999999999996e-06 2024-09-12T22:49:57.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:57.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.051448+0000", 2024-09-12T22:49:57.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0880000000000002e-06 2024-09-12T22:49:57.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:57.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.051451+0000", 2024-09-12T22:49:57.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3270000000000001e-06 2024-09-12T22:49:57.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:57.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.058791+0000", 2024-09-12T22:49:57.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073400640000000003 2024-09-12T22:49:57.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:57.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.058844+0000", 2024-09-12T22:49:57.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2887999999999999e-05 2024-09-12T22:49:57.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:57.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.058937+0000", 2024-09-12T22:49:57.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2639000000000005e-05 2024-09-12T22:49:57.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:57.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.064399+0000", 2024-09-12T22:49:57.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054619689999999997 2024-09-12T22:49:57.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:57.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082728+0000", 2024-09-12T22:49:57.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018328728999999998 2024-09-12T22:49:57.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:57.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082768+0000", 2024-09-12T22:49:57.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0194999999999997e-05 2024-09-12T22:49:57.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:57.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082811+0000", 2024-09-12T22:49:57.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2882e-05 2024-09-12T22:49:57.487 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.487 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:57.487 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.487 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12677 4.10 4:0b7ac23f:::10000003457.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:57.487 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:49:57.487 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 1.1990474600000001, 2024-09-12T22:49:57.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033661045000000001, 2024-09-12T22:49:57.487 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:57.488 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:57.488 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:57.488 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:57.488 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:57.488 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:57.488 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12677 2024-09-12T22:49:57.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.488 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:57.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:57.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:49:57.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:57.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:49:57.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:57.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:49:57.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0100000000000005e-07 2024-09-12T22:49:57.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:57.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.237295+0000", 2024-09-12T22:49:57.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078803290000000002 2024-09-12T22:49:57.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:57.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.237307+0000", 2024-09-12T22:49:57.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2339e-05 2024-09-12T22:49:57.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:57.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.237312+0000", 2024-09-12T22:49:57.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9089999999999999e-06 2024-09-12T22:49:57.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:57.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.239034+0000", 2024-09-12T22:49:57.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001722424 2024-09-12T22:49:57.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:57.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.239129+0000", 2024-09-12T22:49:57.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4486000000000003e-05 2024-09-12T22:49:57.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:57.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.239206+0000", 2024-09-12T22:49:57.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7146999999999998e-05 2024-09-12T22:49:57.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:57.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.255921+0000", 2024-09-12T22:49:57.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016714685 2024-09-12T22:49:57.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:57.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.263025+0000", 2024-09-12T22:49:57.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071042470000000002 2024-09-12T22:49:57.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:57.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.263052+0000", 2024-09-12T22:49:57.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7195e-05 2024-09-12T22:49:57.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:57.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.263075+0000", 2024-09-12T22:49:57.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2782999999999999e-05 2024-09-12T22:49:57.494 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.494 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:57.494 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.494 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12979 4.1e 4:78503759:::10000003406.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:57.495 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:49:57.495 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.863360664, 2024-09-12T22:49:57.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032861456999999997, 2024-09-12T22:49:57.495 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:57.495 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:57.495 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:57.495 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:57.495 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:57.495 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:57.495 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12979 2024-09-12T22:49:57.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.495 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:57.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:57.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:49:57.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:57.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:49:57.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:57.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:49:57.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9999999999999998e-07 2024-09-12T22:49:57.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:57.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573365+0000", 2024-09-12T22:49:57.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082644229999999999 2024-09-12T22:49:57.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:57.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573379+0000", 2024-09-12T22:49:57.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3322999999999999e-05 2024-09-12T22:49:57.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:57.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573386+0000", 2024-09-12T22:49:57.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.199e-06 2024-09-12T22:49:57.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:57.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573464+0000", 2024-09-12T22:49:57.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7931999999999999e-05 2024-09-12T22:49:57.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:57.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573713+0000", 2024-09-12T22:49:57.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024922200000000001 2024-09-12T22:49:57.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:57.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.597870+0000", 2024-09-12T22:49:57.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024157221999999999 2024-09-12T22:49:57.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:57.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.597926+0000", 2024-09-12T22:49:57.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5838000000000003e-05 2024-09-12T22:49:57.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:57.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.597962+0000", 2024-09-12T22:49:57.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5898000000000001e-05 2024-09-12T22:49:57.500 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.501 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:57.501 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.501 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:13017 4.3b e56/17 4:deb39c3c:::1000000315d.00000000:head v 56'194, mlcod=56'192)", 2024-09-12T22:49:57.501 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.600876+0000", 2024-09-12T22:49:57.501 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.82758518800000003, 2024-09-12T22:49:57.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038152448999999998, 2024-09-12T22:49:57.501 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:57.501 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:57.501 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:57.502 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:57.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:57.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.600876+0000", 2024-09-12T22:49:57.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:57.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.600876+0000", 2024-09-12T22:49:57.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:57.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.600877+0000", 2024-09-12T22:49:57.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:49:57.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:57.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609737+0000", 2024-09-12T22:49:57.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088599089999999991 2024-09-12T22:49:57.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:57.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609748+0000", 2024-09-12T22:49:57.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1355999999999999e-05 2024-09-12T22:49:57.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:57.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609757+0000", 2024-09-12T22:49:57.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9190000000000005e-06 2024-09-12T22:49:57.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:57.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609801+0000", 2024-09-12T22:49:57.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4019e-05 2024-09-12T22:49:57.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:57.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609816+0000", 2024-09-12T22:49:57.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5226e-05 2024-09-12T22:49:57.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:57.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.638985+0000", 2024-09-12T22:49:57.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029168537000000001 2024-09-12T22:49:57.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:57.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.639028+0000", 2024-09-12T22:49:57.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3847000000000002e-05 2024-09-12T22:49:57.506 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.506 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:57.506 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.507 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13028 4.10 4:0905b8b9:::100000032b8.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:57.507 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.606486+0000", 2024-09-12T22:49:57.507 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.82197471499999997, 2024-09-12T22:49:57.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032454530000000002, 2024-09-12T22:49:57.507 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:57.507 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:57.507 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:57.507 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:57.507 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:57.507 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:57.507 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13028 2024-09-12T22:49:57.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.508 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:57.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:57.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.606486+0000", 2024-09-12T22:49:57.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:57.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.606486+0000", 2024-09-12T22:49:57.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:57.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.606487+0000", 2024-09-12T22:49:57.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1200000000000003e-07 2024-09-12T22:49:57.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:57.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.611694+0000", 2024-09-12T22:49:57.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052067650000000004 2024-09-12T22:49:57.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:57.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.611706+0000", 2024-09-12T22:49:57.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2719e-05 2024-09-12T22:49:57.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:57.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.611714+0000", 2024-09-12T22:49:57.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1069999999999999e-06 2024-09-12T22:49:57.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:57.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.611928+0000", 2024-09-12T22:49:57.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021484100000000001 2024-09-12T22:49:57.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:57.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.612072+0000", 2024-09-12T22:49:57.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014400799999999999 2024-09-12T22:49:57.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:57.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.612163+0000", 2024-09-12T22:49:57.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0266999999999995e-05 2024-09-12T22:49:57.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:57.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.631098+0000", 2024-09-12T22:49:57.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018934950999999998 2024-09-12T22:49:57.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:57.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.638761+0000", 2024-09-12T22:49:57.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0076633229999999997 2024-09-12T22:49:57.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:57.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.638859+0000", 2024-09-12T22:49:57.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8091999999999995e-05 2024-09-12T22:49:57.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:57.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.638941+0000", 2024-09-12T22:49:57.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1945000000000002e-05 2024-09-12T22:49:57.514 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.514 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:57.514 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.514 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13032 4.7 4:e102bf81:::1000000359e.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:57.514 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.616553+0000", 2024-09-12T22:49:57.514 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.81190833600000001, 2024-09-12T22:49:57.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032471027999999999, 2024-09-12T22:49:57.514 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:57.514 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:57.515 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:57.515 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:57.515 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:57.515 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:57.515 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13032 2024-09-12T22:49:57.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.515 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:57.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:57.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.616553+0000", 2024-09-12T22:49:57.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:57.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.616553+0000", 2024-09-12T22:49:57.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:57.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.616554+0000", 2024-09-12T22:49:57.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0100000000000004e-07 2024-09-12T22:49:57.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:57.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621405+0000", 2024-09-12T22:49:57.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0048517480000000003 2024-09-12T22:49:57.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:57.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621416+0000", 2024-09-12T22:49:57.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0264e-05 2024-09-12T22:49:57.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:57.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621446+0000", 2024-09-12T22:49:57.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0849000000000002e-05 2024-09-12T22:49:57.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:57.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621494+0000", 2024-09-12T22:49:57.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7018000000000003e-05 2024-09-12T22:49:57.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:57.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621590+0000", 2024-09-12T22:49:57.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6632999999999995e-05 2024-09-12T22:49:57.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:57.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621680+0000", 2024-09-12T22:49:57.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9704999999999996e-05 2024-09-12T22:49:57.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:57.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.639248+0000", 2024-09-12T22:49:57.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017568548 2024-09-12T22:49:57.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:57.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.648944+0000", 2024-09-12T22:49:57.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0096954659999999998 2024-09-12T22:49:57.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:57.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.648992+0000", 2024-09-12T22:49:57.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8059999999999997e-05 2024-09-12T22:49:57.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:57.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.649024+0000", 2024-09-12T22:49:57.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1936000000000001e-05 2024-09-12T22:49:57.524 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.524 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:57.525 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.525 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13424 4.7 4:e147809d:::10000003551.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:57.525 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.059264+0000", 2024-09-12T22:49:57.525 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.36919730299999998, 2024-09-12T22:49:57.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032269318999999998, 2024-09-12T22:49:57.525 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:57.525 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:57.525 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:57.526 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:57.526 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:57.526 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:57.526 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13424 2024-09-12T22:49:57.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.526 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:57.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:57.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.059264+0000", 2024-09-12T22:49:57.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:57.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.059264+0000", 2024-09-12T22:49:57.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:57.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.059264+0000", 2024-09-12T22:49:57.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8999999999999997e-07 2024-09-12T22:49:57.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:57.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.062876+0000", 2024-09-12T22:49:57.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036118809999999999 2024-09-12T22:49:57.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:57.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.062887+0000", 2024-09-12T22:49:57.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0845e-05 2024-09-12T22:49:57.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:57.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.062899+0000", 2024-09-12T22:49:57.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1719000000000001e-05 2024-09-12T22:49:57.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:57.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.062953+0000", 2024-09-12T22:49:57.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4295000000000001e-05 2024-09-12T22:49:57.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:57.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.063043+0000", 2024-09-12T22:49:57.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9790000000000006e-05 2024-09-12T22:49:57.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:57.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.063169+0000", 2024-09-12T22:49:57.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012591699999999999 2024-09-12T22:49:57.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:57.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.079426+0000", 2024-09-12T22:49:57.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016257240999999999 2024-09-12T22:49:57.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:57.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.091432+0000", 2024-09-12T22:49:57.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012005966 2024-09-12T22:49:57.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:57.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.091490+0000", 2024-09-12T22:49:57.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8063000000000003e-05 2024-09-12T22:49:57.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:57.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.091533+0000", 2024-09-12T22:49:57.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3112000000000003e-05 2024-09-12T22:49:57.532 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.532 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:57.532 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.533 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13428 4.37 4:eeed8456:::1000000321a.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:57.533 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.064666+0000", 2024-09-12T22:49:57.533 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.363795058, 2024-09-12T22:49:57.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033441308000000003, 2024-09-12T22:49:57.533 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:57.533 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:57.533 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:57.533 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:57.534 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:57.534 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:57.534 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13428 2024-09-12T22:49:57.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.534 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:57.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:57.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.064666+0000", 2024-09-12T22:49:57.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:57.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.064666+0000", 2024-09-12T22:49:57.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:57.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.064668+0000", 2024-09-12T22:49:57.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4160000000000001e-06 2024-09-12T22:49:57.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:57.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071829+0000", 2024-09-12T22:49:57.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071611390000000004 2024-09-12T22:49:57.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:57.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071840+0000", 2024-09-12T22:49:57.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1369000000000001e-05 2024-09-12T22:49:57.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:57.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071847+0000", 2024-09-12T22:49:57.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0960000000000003e-06 2024-09-12T22:49:57.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:57.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071904+0000", 2024-09-12T22:49:57.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7309000000000003e-05 2024-09-12T22:49:57.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:57.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.072051+0000", 2024-09-12T22:49:57.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014625 2024-09-12T22:49:57.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:57.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.072194+0000", 2024-09-12T22:49:57.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014379799999999999 2024-09-12T22:49:57.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:57.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.079527+0000", 2024-09-12T22:49:57.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007332674 2024-09-12T22:49:57.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:57.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.098048+0000", 2024-09-12T22:49:57.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018521174000000001 2024-09-12T22:49:57.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:57.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.098081+0000", 2024-09-12T22:49:57.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2910999999999997e-05 2024-09-12T22:49:57.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:57.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.098107+0000", 2024-09-12T22:49:57.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6171999999999999e-05 2024-09-12T22:49:57.540 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.540 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:57.540 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.540 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13472 4.12 4:4b0bd9b8:::100000033b0.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:57.540 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.113168+0000", 2024-09-12T22:49:57.541 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.315293359, 2024-09-12T22:49:57.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.039534103000000001, 2024-09-12T22:49:57.541 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:57.541 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:57.541 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:57.541 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:57.541 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:57.541 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:57.541 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13472 2024-09-12T22:49:57.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.541 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:57.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:57.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.113168+0000", 2024-09-12T22:49:57.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:57.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.113168+0000", 2024-09-12T22:49:57.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:57.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.113169+0000", 2024-09-12T22:49:57.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1960000000000001e-06 2024-09-12T22:49:57.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:57.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119849+0000", 2024-09-12T22:49:57.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0066801830000000001 2024-09-12T22:49:57.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:57.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119861+0000", 2024-09-12T22:49:57.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.199e-05 2024-09-12T22:49:57.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:57.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119866+0000", 2024-09-12T22:49:57.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8720000000000001e-06 2024-09-12T22:49:57.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:57.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119945+0000", 2024-09-12T22:49:57.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9268000000000001e-05 2024-09-12T22:49:57.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:57.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.120098+0000", 2024-09-12T22:49:57.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015299500000000001 2024-09-12T22:49:57.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:57.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.120218+0000", 2024-09-12T22:49:57.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011989099999999999 2024-09-12T22:49:57.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:57.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.140463+0000", 2024-09-12T22:49:57.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020244765000000001 2024-09-12T22:49:57.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:57.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.152629+0000", 2024-09-12T22:49:57.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012165601999999999 2024-09-12T22:49:57.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:57.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.152664+0000", 2024-09-12T22:49:57.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5599999999999998e-05 2024-09-12T22:49:57.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:57.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.152702+0000", 2024-09-12T22:49:57.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7741000000000003e-05 2024-09-12T22:49:57.548 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.548 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:57.548 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.548 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13480 4.29 4:950c2b77:::10000003293.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:57.548 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.121448+0000", 2024-09-12T22:49:57.548 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.30701335499999999, 2024-09-12T22:49:57.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031399851999999999, 2024-09-12T22:49:57.548 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:57.548 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:57.549 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:57.549 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:57.549 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:57.549 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:57.549 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13480 2024-09-12T22:49:57.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.549 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:57.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:57.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.121448+0000", 2024-09-12T22:49:57.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:57.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.121448+0000", 2024-09-12T22:49:57.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:57.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.121450+0000", 2024-09-12T22:49:57.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9429999999999999e-06 2024-09-12T22:49:57.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:57.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.125754+0000", 2024-09-12T22:49:57.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043040980000000001 2024-09-12T22:49:57.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:57.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.125766+0000", 2024-09-12T22:49:57.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2075e-05 2024-09-12T22:49:57.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.552 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:57.552 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.125774+0000", 2024-09-12T22:49:57.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6639999999999998e-06 2024-09-12T22:49:57.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.552 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:57.552 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.125833+0000", 2024-09-12T22:49:57.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9614999999999998e-05 2024-09-12T22:49:57.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:57.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.125942+0000", 2024-09-12T22:49:57.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010873 2024-09-12T22:49:57.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:57.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.152771+0000", 2024-09-12T22:49:57.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026828622999999999 2024-09-12T22:49:57.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:57.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.152802+0000", 2024-09-12T22:49:57.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1013999999999998e-05 2024-09-12T22:49:57.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:57.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.152848+0000", 2024-09-12T22:49:57.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6090000000000001e-05 2024-09-12T22:49:57.554 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.555 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:57.555 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.555 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13484 4.2f 4:f62c2e43:::1000000349e.00000000:head [write 0~4194304 [2@3461078]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:57.555 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.125796+0000", 2024-09-12T22:49:57.555 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.30266499600000002, 2024-09-12T22:49:57.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.036857236000000002, 2024-09-12T22:49:57.555 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:57.555 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:57.555 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:57.556 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:57.556 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:57.556 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:57.556 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13484 2024-09-12T22:49:57.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.556 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:57.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:57.556 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.125796+0000", 2024-09-12T22:49:57.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.557 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:57.557 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.125796+0000", 2024-09-12T22:49:57.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.557 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:57.557 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.125797+0000", 2024-09-12T22:49:57.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.108e-06 2024-09-12T22:49:57.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.558 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:57.558 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130725+0000", 2024-09-12T22:49:57.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049272949999999999 2024-09-12T22:49:57.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.558 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:57.558 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130739+0000", 2024-09-12T22:49:57.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4234e-05 2024-09-12T22:49:57.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:57.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130751+0000", 2024-09-12T22:49:57.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1848000000000001e-05 2024-09-12T22:49:57.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:57.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130816+0000", 2024-09-12T22:49:57.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5359999999999998e-05 2024-09-12T22:49:57.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:57.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130917+0000", 2024-09-12T22:49:57.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101178 2024-09-12T22:49:57.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:57.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.131058+0000", 2024-09-12T22:49:57.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140803 2024-09-12T22:49:57.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:57.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.153387+0000", 2024-09-12T22:49:57.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022328585000000001 2024-09-12T22:49:57.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:57.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.162465+0000", 2024-09-12T22:49:57.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090781360000000005 2024-09-12T22:49:57.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:57.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.162584+0000", 2024-09-12T22:49:57.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119634 2024-09-12T22:49:57.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:57.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.162653+0000", 2024-09-12T22:49:57.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9054999999999995e-05 2024-09-12T22:49:57.562 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.562 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:57.562 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.562 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13558 4.10 4:09df41af:::1000000333c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:57.562 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.229326+0000", 2024-09-12T22:49:57.562 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.199135168, 2024-09-12T22:49:57.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.039409786000000002, 2024-09-12T22:49:57.563 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:57.563 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:57.563 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:57.563 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:57.563 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:57.563 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:57.563 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13558 2024-09-12T22:49:57.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.563 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:57.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:57.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.229326+0000", 2024-09-12T22:49:57.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:57.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.229326+0000", 2024-09-12T22:49:57.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:57.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.229327+0000", 2024-09-12T22:49:57.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1200000000000002e-07 2024-09-12T22:49:57.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:57.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235243+0000", 2024-09-12T22:49:57.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059166310000000003 2024-09-12T22:49:57.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:57.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235255+0000", 2024-09-12T22:49:57.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1174e-05 2024-09-12T22:49:57.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:57.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235260+0000", 2024-09-12T22:49:57.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1749999999999996e-06 2024-09-12T22:49:57.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:57.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235295+0000", 2024-09-12T22:49:57.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4830999999999999e-05 2024-09-12T22:49:57.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:57.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235350+0000", 2024-09-12T22:49:57.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5092e-05 2024-09-12T22:49:57.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:57.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235426+0000", 2024-09-12T22:49:57.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6463000000000003e-05 2024-09-12T22:49:57.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:57.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.244772+0000", 2024-09-12T22:49:57.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0093457709999999992 2024-09-12T22:49:57.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:57.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.268679+0000", 2024-09-12T22:49:57.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023906788000000002 2024-09-12T22:49:57.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:57.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.268712+0000", 2024-09-12T22:49:57.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3701999999999997e-05 2024-09-12T22:49:57.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:57.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.268736+0000", 2024-09-12T22:49:57.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3447000000000001e-05 2024-09-12T22:49:57.569 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.569 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:57.569 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.570 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13560 4.f 4:f3272687:::10000003717.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:57.570 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.237314+0000", 2024-09-12T22:49:57.570 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.19114751199999999, 2024-09-12T22:49:57.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.031429410999999997, 2024-09-12T22:49:57.570 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:49:57.570 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:49:57.570 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:57.570 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:49:57.570 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:49:57.570 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:57.571 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13560 2024-09-12T22:49:57.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.571 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:49:57.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:49:57.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.237314+0000", 2024-09-12T22:49:57.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:49:57.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.237314+0000", 2024-09-12T22:49:57.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:49:57.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:49:57.572 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.237315+0000", 2024-09-12T22:49:57.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.221e-06 2024-09-12T22:49:57.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:49:57.572 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.242889+0000", 2024-09-12T22:49:57.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055737169999999997 2024-09-12T22:49:57.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:49:57.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.242912+0000", 2024-09-12T22:49:57.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3417e-05 2024-09-12T22:49:57.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:49:57.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.242921+0000", 2024-09-12T22:49:57.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6330000000000002e-06 2024-09-12T22:49:57.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:49:57.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.242981+0000", 2024-09-12T22:49:57.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0464000000000002e-05 2024-09-12T22:49:57.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:49:57.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.243092+0000", 2024-09-12T22:49:57.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000111128 2024-09-12T22:49:57.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:49:57.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.243198+0000", 2024-09-12T22:49:57.575 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105832 2024-09-12T22:49:57.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.575 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:49:57.575 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.253467+0000", 2024-09-12T22:49:57.575 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010268862 2024-09-12T22:49:57.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.575 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:57.575 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.268697+0000", 2024-09-12T22:49:57.575 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015230318 2024-09-12T22:49:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:49:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.268724+0000", 2024-09-12T22:49:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6325999999999998e-05 2024-09-12T22:49:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:49:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:49:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:49:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.268743+0000", 2024-09-12T22:49:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9493000000000001e-05 2024-09-12T22:49:57.576 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.577 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:57.577 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.577 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:49:57.577 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:49:57.577 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:49:57.579 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:57.577+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:57.580 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:57.607 INFO:tasks.workunit.client.0.smithi066.stdout:4/747: link d5/d8/f78 d5/d8/d16/d93/da6/dea/ffb 0 2024-09-12T22:49:57.607 INFO:tasks.workunit.client.0.smithi066.stdout:8/686: dread d17/f27 [0,4194304] 0 2024-09-12T22:49:57.607 INFO:tasks.workunit.client.0.smithi066.stdout:0/664: creat d1/d8/d1f/d47/ff0 x:0 0 0 2024-09-12T22:49:57.608 INFO:tasks.workunit.client.0.smithi066.stdout:2/673: dread d1/dd/f63 [0,4194304] 0 2024-09-12T22:49:57.608 INFO:tasks.workunit.client.0.smithi066.stdout:5/744: dwrite d5/d14/f74 [0,4194304] 0 2024-09-12T22:49:57.608 INFO:tasks.workunit.client.0.smithi066.stdout:1/602: dwrite d0/dc/fb2 [0,4194304] 0 2024-09-12T22:49:57.608 INFO:tasks.workunit.client.0.smithi066.stdout:8/687: creat d17/d49/d4b/d57/fee x:0 0 0 2024-09-12T22:49:57.608 INFO:tasks.workunit.client.0.smithi066.stdout:2/674: fdatasync d1/dd/d12/d18/f3e 0 2024-09-12T22:49:57.608 INFO:tasks.workunit.client.0.smithi066.stdout:5/745: creat d5/d11/d23/d6f/daa/dbb/fe4 x:0 0 0 2024-09-12T22:49:57.608 INFO:tasks.workunit.client.0.smithi066.stdout:3/648: dread d0/d2/d7/d29/f3d [0,4194304] 0 2024-09-12T22:49:57.608 INFO:tasks.workunit.client.0.smithi066.stdout:0/665: dwrite d1/d8/d1f/f33 [0,4194304] 0 2024-09-12T22:49:57.608 INFO:tasks.workunit.client.0.smithi066.stdout:7/597: dwrite d0/d19/d60/f8d [4194304,4194304] 0 2024-09-12T22:49:57.608 INFO:tasks.workunit.client.0.smithi066.stdout:5/746: write d5/de/d50/d42/d49/fdc [106812,71466] 0 2024-09-12T22:49:57.609 INFO:tasks.workunit.client.0.smithi066.stdout:0/666: dread - d1/d8/d1c/f98 zero size 2024-09-12T22:49:57.609 INFO:tasks.workunit.client.0.smithi066.stdout:8/688: dwrite d17/d2c/f38 [0,4194304] 0 2024-09-12T22:49:57.609 INFO:tasks.workunit.client.0.smithi066.stdout:3/649: mknod d0/d2/d7/d13/dc1/ce6 0 2024-09-12T22:49:57.609 INFO:tasks.workunit.client.0.smithi066.stdout:1/603: dwrite d0/d36/d6b/f80 [0,4194304] 0 2024-09-12T22:49:57.609 INFO:tasks.workunit.client.0.smithi066.stdout:2/675: dwrite d1/dd/d12/f24 [0,4194304] 0 2024-09-12T22:49:57.609 INFO:tasks.workunit.client.0.smithi066.stdout:0/667: write d1/dbf/fc5 [3970527,5090] 0 2024-09-12T22:49:57.609 INFO:tasks.workunit.client.0.smithi066.stdout:9/694: dread d9/f87 [0,4194304] 0 2024-09-12T22:49:57.609 INFO:tasks.workunit.client.0.smithi066.stdout:2/676: dread - d1/d11/d26/d4f/d7c/f9f zero size 2024-09-12T22:49:57.609 INFO:tasks.workunit.client.0.smithi066.stdout:8/689: symlink d17/d49/lef 0 2024-09-12T22:49:57.609 INFO:tasks.workunit.client.0.smithi066.stdout:1/604: unlink d0/dc/d44/f84 0 2024-09-12T22:49:57.609 INFO:tasks.workunit.client.0.smithi066.stdout:3/650: fsync d0/d2/d1d/f85 0 2024-09-12T22:49:57.610 INFO:tasks.workunit.client.0.smithi066.stdout:5/747: write d5/d11/d21/f47 [936430,73557] 0 2024-09-12T22:49:57.610 INFO:tasks.workunit.client.0.smithi066.stdout:3/651: stat d0/d2/d1d/d87/d6b/c93 0 2024-09-12T22:49:57.610 INFO:tasks.workunit.client.0.smithi066.stdout:9/695: stat d9/d31/d34/f89 0 2024-09-12T22:49:57.610 INFO:tasks.workunit.client.0.smithi066.stdout:2/677: fdatasync d1/d11/d26/d4f/d5f/d61/d7e/f64 0 2024-09-12T22:49:57.610 INFO:tasks.workunit.client.0.smithi066.stdout:2/678: dread - d1/db/fca zero size 2024-09-12T22:49:57.610 INFO:tasks.workunit.client.0.smithi066.stdout:1/605: unlink d0/d4e/d79/d86/d9c/fac 0 2024-09-12T22:49:57.610 INFO:tasks.workunit.client.0.smithi066.stdout:5/748: creat d5/d11/d23/d6f/daa/dbb/dc6/de1/fe5 x:0 0 0 2024-09-12T22:49:57.610 INFO:tasks.workunit.client.0.smithi066.stdout:9/696: rename d9/d31/l55 to d9/d31/d58/da4/le5 0 2024-09-12T22:49:57.610 INFO:tasks.workunit.client.0.smithi066.stdout:3/652: getdents d0/d2/d1d/d87/d40 0 2024-09-12T22:49:57.610 INFO:tasks.workunit.client.0.smithi066.stdout:2/679: symlink d1/d11/d26/d4f/d5f/da9/lda 0 2024-09-12T22:49:57.610 INFO:tasks.workunit.client.0.smithi066.stdout:5/749: mknod d5/de/d50/da0/ce6 0 2024-09-12T22:49:57.611 INFO:tasks.workunit.client.0.smithi066.stdout:2/680: rmdir d1/d11/d26 39 2024-09-12T22:49:57.611 INFO:tasks.workunit.client.0.smithi066.stdout:8/690: dwrite d17/d49/d4b/d57/d5e/d65/fe4 [0,4194304] 0 2024-09-12T22:49:57.611 INFO:tasks.workunit.client.0.smithi066.stdout:8/691: chown d17/d49/d4b/d57/fa6 6530476 1 2024-09-12T22:49:57.611 INFO:tasks.workunit.client.0.smithi066.stdout:2/681: chown d1/d11/d26/d4f/d5f/d61/d7e/lce 12 1 2024-09-12T22:49:57.611 INFO:tasks.workunit.client.0.smithi066.stdout:3/653: symlink d0/d2/d1d/d87/d6b/db2/le7 0 2024-09-12T22:49:57.611 INFO:tasks.workunit.client.0.smithi066.stdout:1/606: dwrite d0/d89/fb3 [0,4194304] 0 2024-09-12T22:49:57.611 INFO:tasks.workunit.client.0.smithi066.stdout:8/692: stat d17/d49/d4b/l6a 0 2024-09-12T22:49:57.611 INFO:tasks.workunit.client.0.smithi066.stdout:5/750: truncate d5/d11/d23/d6f/daa/dbb/dc6/de1/fa1 833183 0 2024-09-12T22:49:57.611 INFO:tasks.workunit.client.0.smithi066.stdout:3/654: write d0/d2/d1d/fa8 [833017,95170] 0 2024-09-12T22:49:57.611 INFO:tasks.workunit.client.0.smithi066.stdout:2/682: write d1/d11/d26/d4f/d52/d56/f8a [1437472,38820] 0 2024-09-12T22:49:57.612 INFO:tasks.workunit.client.0.smithi066.stdout:5/751: chown d5/de/d50/d42/lbf 0 1 2024-09-12T22:49:57.612 INFO:tasks.workunit.client.0.smithi066.stdout:1/607: rename d0/dc/d1e/f8a to d0/dc/d8f/fb8 0 2024-09-12T22:49:57.612 INFO:tasks.workunit.client.0.smithi066.stdout:8/693: mkdir d17/d40/d47/d4d/df0 0 2024-09-12T22:49:57.612 INFO:tasks.workunit.client.0.smithi066.stdout:1/608: symlink d0/dc/d8f/lb9 0 2024-09-12T22:49:57.612 INFO:tasks.workunit.client.0.smithi066.stdout:3/655: creat d0/d2/d1d/d87/d40/d44/fe8 x:0 0 0 2024-09-12T22:49:57.612 INFO:tasks.workunit.client.0.smithi066.stdout:5/752: rename d5/d11/d21/l33 to d5/d11/d23/d6f/daa/dbb/le7 0 2024-09-12T22:49:57.612 INFO:tasks.workunit.client.0.smithi066.stdout:2/683: creat d1/d11/d26/d4f/d5f/d61/d72/dad/d76/fdb x:0 0 0 2024-09-12T22:49:57.612 INFO:tasks.workunit.client.0.smithi066.stdout:1/609: mknod d0/cba 0 2024-09-12T22:49:57.612 INFO:tasks.workunit.client.0.smithi066.stdout:4/748: dread d5/d8/d16/d93/d9c/d98/fdf [0,4194304] 0 2024-09-12T22:49:57.612 INFO:tasks.workunit.client.0.smithi066.stdout:3/656: dread - d0/d2/d1d/d87/d40/dbd/fa5 zero size 2024-09-12T22:49:57.612 INFO:tasks.workunit.client.0.smithi066.stdout:1/610: unlink d0/dc/d1e/d95/f4d 0 2024-09-12T22:49:57.613 INFO:tasks.workunit.client.0.smithi066.stdout:2/684: getdents d1/dd/d3d 0 2024-09-12T22:49:57.613 INFO:tasks.workunit.client.0.smithi066.stdout:4/749: unlink d5/d8/d16/d1b/d1e/fa3 0 2024-09-12T22:49:57.613 INFO:tasks.workunit.client.0.smithi066.stdout:1/611: sync 2024-09-12T22:49:57.613 INFO:tasks.workunit.client.0.smithi066.stdout:3/657: creat d0/d2/d1d/fe9 x:0 0 0 2024-09-12T22:49:57.613 INFO:tasks.workunit.client.0.smithi066.stdout:2/685: stat d1/dd/d68/f83 0 2024-09-12T22:49:57.613 INFO:tasks.workunit.client.0.smithi066.stdout:2/686: stat d1/dd/d12/d1e/c41 0 2024-09-12T22:49:57.613 INFO:tasks.workunit.client.0.smithi066.stdout:3/658: write d0/d2/d1d/d87/d6b/fbe [3038008,32338] 0 2024-09-12T22:49:57.613 INFO:tasks.workunit.client.0.smithi066.stdout:4/750: link d5/d3e/d8d/l8a d5/d8/d16/d1b/d1e/lfc 0 2024-09-12T22:49:57.613 INFO:tasks.workunit.client.0.smithi066.stdout:2/687: write d1/dd/f71 [3692594,99078] 0 2024-09-12T22:49:57.613 INFO:tasks.workunit.client.0.smithi066.stdout:1/612: read d0/f7 [2768630,27298] 0 2024-09-12T22:49:57.613 INFO:tasks.workunit.client.0.smithi066.stdout:3/659: fdatasync d0/d2/d1d/f23 0 2024-09-12T22:49:57.614 INFO:tasks.workunit.client.0.smithi066.stdout:5/753: dwrite d5/f3b [0,4194304] 0 2024-09-12T22:49:57.614 INFO:tasks.workunit.client.0.smithi066.stdout:3/660: creat d0/d2/d7/dc4/fea x:0 0 0 2024-09-12T22:49:57.614 INFO:tasks.workunit.client.0.smithi066.stdout:4/751: mkdir d5/d8/d10/de/d2d/d64/d9a/dfd 0 2024-09-12T22:49:57.614 INFO:tasks.workunit.client.0.smithi066.stdout:2/688: symlink d1/dd/d12/ldc 0 2024-09-12T22:49:57.614 INFO:tasks.workunit.client.0.smithi066.stdout:2/689: mknod d1/d11/d26/d4f/d5f/d61/d72/dad/d76/db7/cdd 0 2024-09-12T22:49:57.614 INFO:tasks.workunit.client.0.smithi066.stdout:1/613: dwrite d0/d4e/d79/f9d [0,4194304] 0 2024-09-12T22:49:57.614 INFO:tasks.workunit.client.0.smithi066.stdout:2/690: dread - d1/d11/f98 zero size 2024-09-12T22:49:57.614 INFO:tasks.workunit.client.0.smithi066.stdout:2/691: write d1/dd/d12/d1e/f79 [4028657,8774] 0 2024-09-12T22:49:57.614 INFO:tasks.workunit.client.0.smithi066.stdout:8/694: dread d17/d1b/f2e [0,4194304] 0 2024-09-12T22:49:57.614 INFO:tasks.workunit.client.0.smithi066.stdout:3/661: dwrite d0/d2/d6/f7d [0,4194304] 0 2024-09-12T22:49:57.615 INFO:tasks.workunit.client.0.smithi066.stdout:3/662: truncate d0/d2/d7/fdc 464621 0 2024-09-12T22:49:57.615 INFO:tasks.workunit.client.0.smithi066.stdout:3/663: chown d0/d2/d1d/d87/d49/dc8/cca 104897754 1 2024-09-12T22:49:57.615 INFO:tasks.workunit.client.0.smithi066.stdout:1/614: dwrite d0/dc/d1e/d47/f9b [0,4194304] 0 2024-09-12T22:49:57.615 INFO:tasks.workunit.client.0.smithi066.stdout:1/615: sync 2024-09-12T22:49:57.615 INFO:tasks.workunit.client.0.smithi066.stdout:6/735: dread d6/d23/d25/d4e/dc4/f18 [0,4194304] 0 2024-09-12T22:49:57.615 INFO:tasks.workunit.client.0.smithi066.stdout:0/668: dwrite d1/f73 [0,4194304] 0 2024-09-12T22:49:57.615 INFO:tasks.workunit.client.0.smithi066.stdout:6/736: creat d6/d35/ff8 x:0 0 0 2024-09-12T22:49:57.615 INFO:tasks.workunit.client.0.smithi066.stdout:6/737: chown d6/d49/f9e 498946 1 2024-09-12T22:49:57.615 INFO:tasks.workunit.client.0.smithi066.stdout:3/664: dwrite d0/d2/d1d/d87/d6b/db2/f72 [0,4194304] 0 2024-09-12T22:49:57.615 INFO:tasks.workunit.client.0.smithi066.stdout:0/669: creat d1/d8/d1c/d13/d2f/d8a/de1/ff1 x:0 0 0 2024-09-12T22:49:57.615 INFO:tasks.workunit.client.0.smithi066.stdout:6/738: fdatasync d6/d23/d25/d4e/dc4/f12 0 2024-09-12T22:49:57.616 INFO:tasks.workunit.client.0.smithi066.stdout:3/665: dread - d0/d2/d1d/d87/d6b/fe0 zero size 2024-09-12T22:49:57.616 INFO:tasks.workunit.client.0.smithi066.stdout:6/739: mkdir d6/d23/d41/db6/dd3/df9 0 2024-09-12T22:49:57.616 INFO:tasks.workunit.client.0.smithi066.stdout:3/666: symlink d0/d2/d1d/leb 0 2024-09-12T22:49:57.616 INFO:tasks.workunit.client.0.smithi066.stdout:1/616: fdatasync d0/d36/d6b/f80 0 2024-09-12T22:49:57.616 INFO:tasks.workunit.client.0.smithi066.stdout:6/740: creat d6/d35/ffa x:0 0 0 2024-09-12T22:49:57.616 INFO:tasks.workunit.client.0.smithi066.stdout:1/617: creat d0/dc/d1e/fbb x:0 0 0 2024-09-12T22:49:57.616 INFO:tasks.workunit.client.0.smithi066.stdout:6/741: chown d6/d23/d25/d4e/dc4/d32/lcf 8162046 1 2024-09-12T22:49:57.616 INFO:tasks.workunit.client.0.smithi066.stdout:9/697: truncate d9/dc/f56 657706 0 2024-09-12T22:49:57.616 INFO:tasks.workunit.client.0.smithi066.stdout:3/667: write d0/d2/d7/d13/f39 [2348999,35727] 0 2024-09-12T22:49:57.616 INFO:tasks.workunit.client.0.smithi066.stdout:3/668: write d0/d2/d7/d29/fe3 [957442,115879] 0 2024-09-12T22:49:57.617 INFO:tasks.workunit.client.0.smithi066.stdout:3/669: write d0/d2/d1d/d87/d40/dbd/f60 [8165844,18801] 0 2024-09-12T22:49:57.617 INFO:tasks.workunit.client.0.smithi066.stdout:6/742: dwrite d6/d23/d62/fe5 [0,4194304] 0 2024-09-12T22:49:57.617 INFO:tasks.workunit.client.0.smithi066.stdout:6/743: mkdir d6/d7/dc/dfb 0 2024-09-12T22:49:57.617 INFO:tasks.workunit.client.0.smithi066.stdout:9/698: dwrite d9/dc/f1f [0,4194304] 0 2024-09-12T22:49:57.617 INFO:tasks.workunit.client.0.smithi066.stdout:6/744: link d6/d23/d25/lbf d6/d23/d41/db6/dd3/df9/lfc 0 2024-09-12T22:49:57.617 INFO:tasks.workunit.client.0.smithi066.stdout:9/699: link d9/dc/d46/l8b d9/d31/d58/d7f/dc8/le6 0 2024-09-12T22:49:57.617 INFO:tasks.workunit.client.0.smithi066.stdout:3/670: read d0/d2/d1d/d87/d40/dbd/f4c [3439901,19868] 0 2024-09-12T22:49:57.617 INFO:tasks.workunit.client.0.smithi066.stdout:9/700: rename d9/dc/d23/f45 to d9/d31/d58/fe7 0 2024-09-12T22:49:57.617 INFO:tasks.workunit.client.0.smithi066.stdout:9/701: fsync d9/dc/f40 0 2024-09-12T22:49:57.617 INFO:tasks.workunit.client.0.smithi066.stdout:6/745: fdatasync d6/d23/d25/d2c/d69/fe3 0 2024-09-12T22:49:57.617 INFO:tasks.workunit.client.0.smithi066.stdout:3/671: write d0/d2/d7/d13/d31/f7f [3935367,112353] 0 2024-09-12T22:49:57.617 INFO:tasks.workunit.client.0.smithi066.stdout:6/746: rmdir d6/d35 39 2024-09-12T22:49:57.618 INFO:tasks.workunit.client.0.smithi066.stdout:9/702: unlink d9/dc/f28 0 2024-09-12T22:49:57.618 INFO:tasks.workunit.client.0.smithi066.stdout:4/752: truncate d5/d8/d16/ffa 2877159 0 2024-09-12T22:49:57.618 INFO:tasks.workunit.client.0.smithi066.stdout:3/672: link d0/d2/d1d/d87/d40/dd1/cdd d0/d2/d7/d29/daf/cec 0 2024-09-12T22:49:57.618 INFO:tasks.workunit.client.0.smithi066.stdout:2/692: truncate d1/dd/d12/d67/f6a 402988 0 2024-09-12T22:49:57.618 INFO:tasks.workunit.client.0.smithi066.stdout:3/673: write d0/d2/d1d/d87/d6b/fe0 [282680,17689] 0 2024-09-12T22:49:57.618 INFO:tasks.workunit.client.0.smithi066.stdout:2/693: symlink d1/d11/d26/d4f/d52/lde 0 2024-09-12T22:49:57.618 INFO:tasks.workunit.client.0.smithi066.stdout:3/674: creat d0/d2/d7/dc4/dcf/fed x:0 0 0 2024-09-12T22:49:57.618 INFO:tasks.workunit.client.0.smithi066.stdout:6/747: dwrite d6/d49/f4d [0,4194304] 0 2024-09-12T22:49:57.618 INFO:tasks.workunit.client.0.smithi066.stdout:9/703: dwrite d9/dc/dd/f50 [0,4194304] 0 2024-09-12T22:49:57.618 INFO:tasks.workunit.client.0.smithi066.stdout:9/704: read - d9/d31/d58/dbc/fdf zero size 2024-09-12T22:49:57.618 INFO:tasks.workunit.client.0.smithi066.stdout:9/705: fdatasync d9/f32 0 2024-09-12T22:49:57.619 INFO:tasks.workunit.client.0.smithi066.stdout:7/598: dread d0/d19/d26/d48/f58 [0,4194304] 0 2024-09-12T22:49:57.619 INFO:tasks.workunit.client.0.smithi066.stdout:2/694: creat d1/db/d42/d43/fdf x:0 0 0 2024-09-12T22:49:57.619 INFO:tasks.workunit.client.0.smithi066.stdout:9/706: write d9/dc6/fa2 [5153875,66658] 0 2024-09-12T22:49:57.619 INFO:tasks.workunit.client.0.smithi066.stdout:3/675: dread d0/d2/d1d/d87/d6b/db2/f72 [0,4194304] 0 2024-09-12T22:49:57.619 INFO:tasks.workunit.client.0.smithi066.stdout:2/695: chown d1/d11/d26/d4f/d52/d56/f8a 313 1 2024-09-12T22:49:57.619 INFO:tasks.workunit.client.0.smithi066.stdout:7/599: getdents d0/d19/d24/d33/d27/dba 0 2024-09-12T22:49:57.619 INFO:tasks.workunit.client.0.smithi066.stdout:5/754: dread d5/d11/f1b [8388608,4194304] 0 2024-09-12T22:49:57.619 INFO:tasks.workunit.client.0.smithi066.stdout:4/753: dread d5/d3e/d8d/dc7/f99 [0,4194304] 0 2024-09-12T22:49:57.619 INFO:tasks.workunit.client.0.smithi066.stdout:9/707: truncate d9/d31/d34/d4d/fd3 514511 0 2024-09-12T22:49:57.619 INFO:tasks.workunit.client.0.smithi066.stdout:3/676: write d0/d2/d1d/d87/d6b/db2/fe5 [761666,80350] 0 2024-09-12T22:49:57.619 INFO:tasks.workunit.client.0.smithi066.stdout:5/755: rmdir d5/de/d57/dce 0 2024-09-12T22:49:57.620 INFO:tasks.workunit.client.0.smithi066.stdout:7/600: write d0/d19/d26/d5a/f61 [1608623,65382] 0 2024-09-12T22:49:57.620 INFO:tasks.workunit.client.0.smithi066.stdout:1/618: dwrite d0/dc/d44/f54 [0,4194304] 0 2024-09-12T22:49:57.620 INFO:tasks.workunit.client.0.smithi066.stdout:4/754: dread - d5/d8/d16/d93/d9c/d98/ff2 zero size 2024-09-12T22:49:57.620 INFO:tasks.workunit.client.0.smithi066.stdout:7/601: creat d0/d19/d24/fc5 x:0 0 0 2024-09-12T22:49:57.620 INFO:tasks.workunit.client.0.smithi066.stdout:4/755: chown d5/d8/d10/de/c5e 329846263 1 2024-09-12T22:49:57.620 INFO:tasks.workunit.client.0.smithi066.stdout:3/677: getdents d0/d2/d1d/d87/d40/dd0 0 2024-09-12T22:49:57.620 INFO:tasks.workunit.client.0.smithi066.stdout:7/602: symlink d0/d19/d26/dbe/lc6 0 2024-09-12T22:49:57.620 INFO:tasks.workunit.client.0.smithi066.stdout:1/619: getdents d0/dc/d1e/d95 0 2024-09-12T22:49:57.620 INFO:tasks.workunit.client.0.smithi066.stdout:3/678: creat d0/d2/d6/fee x:0 0 0 2024-09-12T22:49:57.620 INFO:tasks.workunit.client.0.smithi066.stdout:0/670: dread d1/d8/f5a [0,4194304] 0 2024-09-12T22:49:57.620 INFO:tasks.workunit.client.0.smithi066.stdout:5/756: dwrite d5/d11/d5d/d8a/f94 [0,4194304] 0 2024-09-12T22:49:57.620 INFO:tasks.workunit.client.0.smithi066.stdout:3/679: write d0/d2/d1d/f23 [1676576,92488] 0 2024-09-12T22:49:57.621 INFO:tasks.workunit.client.0.smithi066.stdout:4/756: dread d5/d8/d16/d93/d9c/d98/fdf [0,4194304] 0 2024-09-12T22:49:57.621 INFO:tasks.workunit.client.0.smithi066.stdout:5/757: truncate d5/d11/d21/d4d/fda 1034401 0 2024-09-12T22:49:57.621 INFO:tasks.workunit.client.0.smithi066.stdout:3/680: symlink d0/d2/d1d/d87/d40/dbd/lef 0 2024-09-12T22:49:57.621 INFO:tasks.workunit.client.0.smithi066.stdout:0/671: creat d1/d36/d65/de9/ff2 x:0 0 0 2024-09-12T22:49:57.621 INFO:tasks.workunit.client.0.smithi066.stdout:5/758: chown d5/d11/d5d/d64/d8f 1369210688 1 2024-09-12T22:49:57.621 INFO:tasks.workunit.client.0.smithi066.stdout:3/681: chown d0/d2/d1d/f23 99 1 2024-09-12T22:49:57.621 INFO:tasks.workunit.client.0.smithi066.stdout:4/757: rename d5/d8/d16/d1b/d1e/d1f/d8c/ff3 to d5/d87/ffe 0 2024-09-12T22:49:57.621 INFO:tasks.workunit.client.0.smithi066.stdout:5/759: symlink d5/de/le8 0 2024-09-12T22:49:57.621 INFO:tasks.workunit.client.0.smithi066.stdout:8/695: dread d17/d1b/f30 [0,4194304] 0 2024-09-12T22:49:57.621 INFO:tasks.workunit.client.0.smithi066.stdout:5/760: creat d5/d14/fe9 x:0 0 0 2024-09-12T22:49:57.621 INFO:tasks.workunit.client.0.smithi066.stdout:4/758: fdatasync d5/d8/d16/d1b/d1e/d5a/f5d 0 2024-09-12T22:49:57.622 INFO:tasks.workunit.client.0.smithi066.stdout:8/696: write d17/f27 [160751,116468] 0 2024-09-12T22:49:57.622 INFO:tasks.workunit.client.0.smithi066.stdout:1/620: dread d0/d4e/d79/d94/fa9 [0,4194304] 0 2024-09-12T22:49:57.622 INFO:tasks.workunit.client.0.smithi066.stdout:4/759: rename d5/d8/d10/de/d39/dc6/cd4 to d5/d8/d16/d93/d9c/d98/ddc/df1/cff 0 2024-09-12T22:49:57.622 INFO:tasks.workunit.client.0.smithi066.stdout:1/621: fsync d0/d4e/d79/d94/fa9 0 2024-09-12T22:49:57.622 INFO:tasks.workunit.client.0.smithi066.stdout:4/760: unlink d5/d8/d16/dc2/fe9 0 2024-09-12T22:49:57.622 INFO:tasks.workunit.client.0.smithi066.stdout:4/761: chown d5/d8/d10/de/d2d/fc1 16001 1 2024-09-12T22:49:57.622 INFO:tasks.workunit.client.0.smithi066.stdout:4/762: write d5/d8/d10/de/d2d/d64/f6c [3270769,54795] 0 2024-09-12T22:49:57.622 INFO:tasks.workunit.client.0.smithi066.stdout:1/622: dread d0/dc/d1e/d47/f9b [0,4194304] 0 2024-09-12T22:49:57.622 INFO:tasks.workunit.client.0.smithi066.stdout:8/697: dread d17/d2c/f90 [0,4194304] 0 2024-09-12T22:49:57.622 INFO:tasks.workunit.client.0.smithi066.stdout:2/696: dwrite d1/d44/d51/fb8 [0,4194304] 0 2024-09-12T22:49:57.622 INFO:tasks.workunit.client.0.smithi066.stdout:4/763: creat d5/d8/d10/de/d2d/d64/d9a/dfd/f100 x:0 0 0 2024-09-12T22:49:57.623 INFO:tasks.workunit.client.0.smithi066.stdout:1/623: write d0/dc/d1d/f66 [1514805,18559] 0 2024-09-12T22:49:57.623 INFO:tasks.workunit.client.0.smithi066.stdout:8/698: truncate d17/d40/d74/d99/fa7 514655 0 2024-09-12T22:49:57.623 INFO:tasks.workunit.client.0.smithi066.stdout:2/697: creat d1/d11/d26/d4f/d5f/d61/d72/fe0 x:0 0 0 2024-09-12T22:49:57.623 INFO:tasks.workunit.client.0.smithi066.stdout:8/699: mkdir d17/d40/d74/da3/df1 0 2024-09-12T22:49:57.623 INFO:tasks.workunit.client.0.smithi066.stdout:4/764: getdents d5/d8/d10/de/d39/dc0 0 2024-09-12T22:49:57.623 INFO:tasks.workunit.client.0.smithi066.stdout:1/624: truncate d0/dc/d33/f6c 4381193 0 2024-09-12T22:49:57.623 INFO:tasks.workunit.client.0.smithi066.stdout:4/765: link d5/d8/d10/de/d2d/fae d5/d8/d10/de/d39/f101 0 2024-09-12T22:49:57.623 INFO:tasks.workunit.client.0.smithi066.stdout:1/625: creat d0/dc/d44/fbc x:0 0 0 2024-09-12T22:49:57.623 INFO:tasks.workunit.client.0.smithi066.stdout:7/603: write d0/d19/d24/d33/f34 [1890998,103356] 0 2024-09-12T22:49:57.623 INFO:tasks.workunit.client.0.smithi066.stdout:0/672: truncate d1/d8/d1b/dac/fad 1574401 0 2024-09-12T22:49:57.623 INFO:tasks.workunit.client.0.smithi066.stdout:7/604: dread - d0/d86/fb7 zero size 2024-09-12T22:49:57.624 INFO:tasks.workunit.client.0.smithi066.stdout:0/673: mknod d1/d8/d1c/d56/db8/cf3 0 2024-09-12T22:49:57.624 INFO:tasks.workunit.client.0.smithi066.stdout:4/766: getdents d5/d8/d16/d93/d9c/d98/dab 0 2024-09-12T22:49:57.624 INFO:tasks.workunit.client.0.smithi066.stdout:2/698: dwrite d1/d11/d26/d4f/d5f/d61/d7e/f48 [0,4194304] 0 2024-09-12T22:49:57.624 INFO:tasks.workunit.client.0.smithi066.stdout:7/605: unlink d0/d19/d26/f28 0 2024-09-12T22:49:57.624 INFO:tasks.workunit.client.0.smithi066.stdout:4/767: symlink d5/d8/d16/l102 0 2024-09-12T22:49:57.624 INFO:tasks.workunit.client.0.smithi066.stdout:2/699: mknod d1/d44/d51/ce1 0 2024-09-12T22:49:57.624 INFO:tasks.workunit.client.0.smithi066.stdout:1/626: fdatasync d0/dc/d44/f54 0 2024-09-12T22:49:57.624 INFO:tasks.workunit.client.0.smithi066.stdout:7/606: creat d0/d19/d24/fc7 x:0 0 0 2024-09-12T22:49:57.624 INFO:tasks.workunit.client.0.smithi066.stdout:2/700: sync 2024-09-12T22:49:57.624 INFO:tasks.workunit.client.0.smithi066.stdout:1/627: readlink d0/dc/d1d/l65 0 2024-09-12T22:49:57.625 INFO:tasks.workunit.client.0.smithi066.stdout:7/607: chown d0/d19/d26/d48/f9e 2976 1 2024-09-12T22:49:57.625 INFO:tasks.workunit.client.0.smithi066.stdout:4/768: creat d5/d8/d16/d93/d9c/d98/dab/db3/f103 x:0 0 0 2024-09-12T22:49:57.625 INFO:tasks.workunit.client.0.smithi066.stdout:1/628: symlink d0/dc/d1e/d47/d6f/lbd 0 2024-09-12T22:49:57.625 INFO:tasks.workunit.client.0.smithi066.stdout:0/674: dwrite d1/d8/fec [0,4194304] 0 2024-09-12T22:49:57.625 INFO:tasks.workunit.client.0.smithi066.stdout:0/675: sync 2024-09-12T22:49:57.625 INFO:tasks.workunit.client.0.smithi066.stdout:5/761: dread d5/d11/d23/f56 [0,4194304] 0 2024-09-12T22:49:57.625 INFO:tasks.workunit.client.0.smithi066.stdout:3/682: dread d0/d2/d1d/f85 [0,4194304] 0 2024-09-12T22:49:57.625 INFO:tasks.workunit.client.0.smithi066.stdout:5/762: sync 2024-09-12T22:49:57.625 INFO:tasks.workunit.client.0.smithi066.stdout:7/608: mkdir d0/d19/d26/d5a/dc8 0 2024-09-12T22:49:57.625 INFO:tasks.workunit.client.0.smithi066.stdout:4/769: rmdir d5/d8/d16/d93/d9c/d98/dab/db3 39 2024-09-12T22:49:57.626 INFO:tasks.workunit.client.0.smithi066.stdout:2/701: dwrite d1/dc1/fc9 [0,4194304] 0 2024-09-12T22:49:57.626 INFO:tasks.workunit.client.0.smithi066.stdout:9/708: dwrite d9/dc/f56 [0,4194304] 0 2024-09-12T22:49:57.626 INFO:tasks.workunit.client.0.smithi066.stdout:1/629: dread d0/d89/fb3 [0,4194304] 0 2024-09-12T22:49:57.626 INFO:tasks.workunit.client.0.smithi066.stdout:2/702: stat d1/d11/d26/d4f/d5f/d61/cbd 0 2024-09-12T22:49:57.626 INFO:tasks.workunit.client.0.smithi066.stdout:5/763: mknod d5/d11/cea 0 2024-09-12T22:49:57.626 INFO:tasks.workunit.client.0.smithi066.stdout:6/748: dread d6/fb [0,4194304] 0 2024-09-12T22:49:57.626 INFO:tasks.workunit.client.0.smithi066.stdout:4/770: mkdir d5/d8/d10/de/d2d/d64/d104 0 2024-09-12T22:49:57.626 INFO:tasks.workunit.client.0.smithi066.stdout:3/683: truncate d0/d2/d7/f5e 146826 0 2024-09-12T22:49:57.626 INFO:tasks.workunit.client.0.smithi066.stdout:2/703: mkdir d1/dd/d12/de2 0 2024-09-12T22:49:57.626 INFO:tasks.workunit.client.0.smithi066.stdout:6/749: write d6/d49/f2f [724871,102015] 0 2024-09-12T22:49:57.627 INFO:tasks.workunit.client.0.smithi066.stdout:9/709: write d9/d31/f6f [4195354,80885] 0 2024-09-12T22:49:57.627 INFO:tasks.workunit.client.0.smithi066.stdout:1/630: link d0/dc/d1e/d95/lb7 d0/d4e/d79/d86/lbe 0 2024-09-12T22:49:57.627 INFO:tasks.workunit.client.0.smithi066.stdout:4/771: mknod d5/d8/d16/d93/d9c/d98/ddc/c105 0 2024-09-12T22:49:57.627 INFO:tasks.workunit.client.0.smithi066.stdout:2/704: write d1/dd/d12/d1e/f79 [4238878,48392] 0 2024-09-12T22:49:57.627 INFO:tasks.workunit.client.0.smithi066.stdout:1/631: stat d0/d36/d57/f27 0 2024-09-12T22:49:57.627 INFO:tasks.workunit.client.0.smithi066.stdout:7/609: stat d0/d19/d24/d33/d27/d70 0 2024-09-12T22:49:57.627 INFO:tasks.workunit.client.0.smithi066.stdout:3/684: creat d0/d2/d1d/d87/d40/dd1/ff0 x:0 0 0 2024-09-12T22:49:57.627 INFO:tasks.workunit.client.0.smithi066.stdout:3/685: sync 2024-09-12T22:49:57.627 INFO:tasks.workunit.client.0.smithi066.stdout:6/750: write d6/d23/d25/f6f [2704499,59316] 0 2024-09-12T22:49:57.627 INFO:tasks.workunit.client.0.smithi066.stdout:6/751: stat d6/d59/cd4 0 2024-09-12T22:49:57.628 INFO:tasks.workunit.client.0.smithi066.stdout:2/705: mknod d1/d11/d53/ce3 0 2024-09-12T22:49:57.628 INFO:tasks.workunit.client.0.smithi066.stdout:2/706: chown d1/dd/d12/d1e/c7a 0 1 2024-09-12T22:49:57.628 INFO:tasks.workunit.client.0.smithi066.stdout:5/764: dwrite d5/f3e [0,4194304] 0 2024-09-12T22:49:57.628 INFO:tasks.workunit.client.0.smithi066.stdout:3/686: write d0/d2/d1d/d87/d6b/fbe [7614106,32116] 0 2024-09-12T22:49:57.628 INFO:tasks.workunit.client.0.smithi066.stdout:6/752: mkdir d6/d23/d25/d4e/dc4/d32/dfd 0 2024-09-12T22:49:57.628 INFO:tasks.workunit.client.0.smithi066.stdout:2/707: fdatasync d1/d11/d26/d4f/d5f/d61/d7e/f34 0 2024-09-12T22:49:57.628 INFO:tasks.workunit.client.0.smithi066.stdout:5/765: getdents d5/de/d50/d42 0 2024-09-12T22:49:57.628 INFO:tasks.workunit.client.0.smithi066.stdout:9/710: dwrite d9/d31/d58/d7f/fcf [0,4194304] 0 2024-09-12T22:49:57.628 INFO:tasks.workunit.client.0.smithi066.stdout:2/708: mkdir d1/d44/d51/de4 0 2024-09-12T22:49:57.628 INFO:tasks.workunit.client.0.smithi066.stdout:6/753: rename d6/d51/cc2 to d6/d23/d25/d4e/dc4/d50/dd6/cfe 0 2024-09-12T22:49:57.628 INFO:tasks.workunit.client.0.smithi066.stdout:1/632: dwrite d0/dc/d1e/d95/f14 [4194304,4194304] 0 2024-09-12T22:49:57.629 INFO:tasks.workunit.client.0.smithi066.stdout:9/711: fdatasync d9/dc/fe 0 2024-09-12T22:49:57.629 INFO:tasks.workunit.client.0.smithi066.stdout:2/709: unlink d1/l62 0 2024-09-12T22:49:57.629 INFO:tasks.workunit.client.0.smithi066.stdout:1/633: rename d0/dc/d8f/f91 to d0/d36/d57/d81/fbf 0 2024-09-12T22:49:57.629 INFO:tasks.workunit.client.0.smithi066.stdout:9/712: unlink d9/d31/d58/dbc/ce0 0 2024-09-12T22:49:57.629 INFO:tasks.workunit.client.0.smithi066.stdout:6/754: chown d6/d7/d66/c6b 5480 1 2024-09-12T22:49:57.629 INFO:tasks.workunit.client.0.smithi066.stdout:2/710: chown d1/db/l58 3 1 2024-09-12T22:49:57.629 INFO:tasks.workunit.client.0.smithi066.stdout:6/755: fdatasync d6/d51/f95 0 2024-09-12T22:49:57.629 INFO:tasks.workunit.client.0.smithi066.stdout:3/687: dread d0/d2/d7/d29/fe3 [0,4194304] 0 2024-09-12T22:49:57.629 INFO:tasks.workunit.client.0.smithi066.stdout:1/634: mkdir d0/dc0 0 2024-09-12T22:49:57.629 INFO:tasks.workunit.client.0.smithi066.stdout:0/676: dread d1/d8/d1b/f97 [0,4194304] 0 2024-09-12T22:49:57.629 INFO:tasks.workunit.client.0.smithi066.stdout:2/711: write d1/dd/d12/f24 [235405,12370] 0 2024-09-12T22:49:57.630 INFO:tasks.workunit.client.0.smithi066.stdout:2/712: readlink d1/d11/lb6 0 2024-09-12T22:49:57.630 INFO:tasks.workunit.client.0.smithi066.stdout:1/635: rename d0/d36/d6b to d0/d4e/d79/dc1 0 2024-09-12T22:49:57.630 INFO:tasks.workunit.client.0.smithi066.stdout:0/677: mknod d1/cf4 0 2024-09-12T22:49:57.630 INFO:tasks.workunit.client.0.smithi066.stdout:9/713: getdents d9/d31/d77/d8f 0 2024-09-12T22:49:57.630 INFO:tasks.workunit.client.0.smithi066.stdout:3/688: read d0/d2/d1d/d87/d40/d44/d55/d91/fb0 [448483,105068] 0 2024-09-12T22:49:57.630 INFO:tasks.workunit.client.0.smithi066.stdout:6/756: link d6/d23/d25/d4e/dc4/d32/f68 d6/d23/d41/db6/dd3/df9/fff 0 2024-09-12T22:49:57.630 INFO:tasks.workunit.client.0.smithi066.stdout:0/678: fdatasync d1/d8/d1b/dac/fe0 0 2024-09-12T22:49:57.630 INFO:tasks.workunit.client.0.smithi066.stdout:1/636: fdatasync d0/dc/d44/f54 0 2024-09-12T22:49:57.630 INFO:tasks.workunit.client.0.smithi066.stdout:2/713: chown d1/dd/d12/d18/da8/dc4 475963 1 2024-09-12T22:49:57.630 INFO:tasks.workunit.client.0.smithi066.stdout:9/714: creat d9/dc/d46/fe8 x:0 0 0 2024-09-12T22:49:57.630 INFO:tasks.workunit.client.0.smithi066.stdout:8/700: dread d17/f29 [0,4194304] 0 2024-09-12T22:49:57.631 INFO:tasks.workunit.client.0.smithi066.stdout:5/766: dwrite d5/f55 [0,4194304] 0 2024-09-12T22:49:57.631 INFO:tasks.workunit.client.0.smithi066.stdout:1/637: write d0/dc/d1d/f66 [2466114,6171] 0 2024-09-12T22:49:57.631 INFO:tasks.workunit.client.0.smithi066.stdout:1/638: fdatasync d0/d4e/d79/d94/fa9 0 2024-09-12T22:49:57.631 INFO:tasks.workunit.client.0.smithi066.stdout:6/757: rename d6/d23/d41/c82 to d6/d23/d25/d4e/dc4/d50/dd6/c100 0 2024-09-12T22:49:57.631 INFO:tasks.workunit.client.0.smithi066.stdout:8/701: mkdir d17/d2c/dab/df2 0 2024-09-12T22:49:57.631 INFO:tasks.workunit.client.0.smithi066.stdout:0/679: truncate d1/d8/d1b/dac/fe0 1317371 0 2024-09-12T22:49:57.631 INFO:tasks.workunit.client.0.smithi066.stdout:3/689: rename d0/d2/d1d/d87/d40/dbd/d74/c84 to d0/d2/d1d/d87/d40/d44/d55/d91/cf1 0 2024-09-12T22:49:57.631 INFO:tasks.workunit.client.0.smithi066.stdout:6/758: mkdir d6/d23/d25/d4e/dc4/d99/d101 0 2024-09-12T22:49:57.631 INFO:tasks.workunit.client.0.smithi066.stdout:6/759: sync 2024-09-12T22:49:57.631 INFO:tasks.workunit.client.0.smithi066.stdout:1/639: rename d0/d4e/d79/d94/d9a/l9e to d0/d36/d57/d81/lc2 0 2024-09-12T22:49:57.631 INFO:tasks.workunit.client.0.smithi066.stdout:8/702: mkdir d17/d40/d47/d4d/df0/df3 0 2024-09-12T22:49:57.632 INFO:tasks.workunit.client.0.smithi066.stdout:0/680: write d1/d8/d1b/d59/fa1 [792183,122941] 0 2024-09-12T22:49:57.632 INFO:tasks.workunit.client.0.smithi066.stdout:8/703: mknod d17/d1b/de7/cf4 0 2024-09-12T22:49:57.632 INFO:tasks.workunit.client.0.smithi066.stdout:1/640: mknod d0/dc/d1d/cc3 0 2024-09-12T22:49:57.632 INFO:tasks.workunit.client.0.smithi066.stdout:2/714: dwrite d1/db/d42/d43/f85 [0,4194304] 0 2024-09-12T22:49:57.632 INFO:tasks.workunit.client.0.smithi066.stdout:0/681: dread - d1/d36/fc6 zero size 2024-09-12T22:49:57.632 INFO:tasks.workunit.client.0.smithi066.stdout:5/767: dwrite d5/d11/d23/d6f/daa/dbb/dc6/fcd [0,4194304] 0 2024-09-12T22:49:57.632 INFO:tasks.workunit.client.0.smithi066.stdout:8/704: rmdir d17/d40/d47/dde 39 2024-09-12T22:49:57.632 INFO:tasks.workunit.client.0.smithi066.stdout:2/715: unlink d1/d11/d26/d4f/d52/c84 0 2024-09-12T22:49:57.632 INFO:tasks.workunit.client.0.smithi066.stdout:6/760: dwrite d6/d23/f5e [4194304,4194304] 0 2024-09-12T22:49:57.632 INFO:tasks.workunit.client.0.smithi066.stdout:1/641: getdents d0/d36/d8e 0 2024-09-12T22:49:57.632 INFO:tasks.workunit.client.0.smithi066.stdout:8/705: symlink d17/d40/d74/da3/df1/lf5 0 2024-09-12T22:49:57.632 INFO:tasks.workunit.client.0.smithi066.stdout:9/715: read d9/d31/d77/f7d [2121051,49962] 0 2024-09-12T22:49:57.633 INFO:tasks.workunit.client.0.smithi066.stdout:0/682: dwrite d1/d36/fd2 [0,4194304] 0 2024-09-12T22:49:57.638 INFO:tasks.workunit.client.0.smithi066.stdout:1/642: creat d0/dc/d1d/fc4 x:0 0 0 2024-09-12T22:49:57.638 INFO:tasks.workunit.client.0.smithi066.stdout:3/690: truncate d0/d2/d1d/d87/d40/f48 537437 0 2024-09-12T22:49:57.638 INFO:tasks.workunit.client.0.smithi066.stdout:8/706: rename d17/d40/d47/d66/f85 to d17/d49/d4b/d57/d5e/d62/ff6 0 2024-09-12T22:49:57.638 INFO:tasks.workunit.client.0.smithi066.stdout:6/761: mkdir d6/d23/d41/db6/dd3/df9/d102 0 2024-09-12T22:49:57.638 INFO:tasks.workunit.client.0.smithi066.stdout:9/716: mkdir d9/dc/de9 0 2024-09-12T22:49:57.638 INFO:tasks.workunit.client.0.smithi066.stdout:4/772: dread d5/d8/d10/f36 [0,4194304] 0 2024-09-12T22:49:57.638 INFO:tasks.workunit.client.0.smithi066.stdout:6/762: getdents d6/d23/d25/d4e/dc4/d99/d101 0 2024-09-12T22:49:57.638 INFO:tasks.workunit.client.0.smithi066.stdout:8/707: link c10 d17/d40/d74/da3/dac/db4/cf7 0 2024-09-12T22:49:57.638 INFO:tasks.workunit.client.0.smithi066.stdout:1/643: getdents d0/dc/d1e 0 2024-09-12T22:49:57.639 INFO:tasks.workunit.client.0.smithi066.stdout:0/683: rename d1/d8/d1f/d30/da0 to d1/d8/df5 0 2024-09-12T22:49:57.639 INFO:tasks.workunit.client.0.smithi066.stdout:1/644: mknod d0/dc/cc5 0 2024-09-12T22:49:57.639 INFO:tasks.workunit.client.0.smithi066.stdout:6/763: chown d6/d23/d25/d4e/fd2 1761 1 2024-09-12T22:49:57.639 INFO:tasks.workunit.client.0.smithi066.stdout:0/684: chown d1/d8/d1c/d13/d2f/c4c 10 1 2024-09-12T22:49:57.639 INFO:tasks.workunit.client.0.smithi066.stdout:4/773: creat d5/d8/d16/d93/d9c/d98/ddc/df1/f106 x:0 0 0 2024-09-12T22:49:57.639 INFO:tasks.workunit.client.0.smithi066.stdout:1/645: dread - d0/d36/d57/d81/fbf zero size 2024-09-12T22:49:57.639 INFO:tasks.workunit.client.0.smithi066.stdout:3/691: dwrite d0/d2/d7/d29/daf/fa3 [0,4194304] 0 2024-09-12T22:49:57.639 INFO:tasks.workunit.client.0.smithi066.stdout:0/685: chown d1/d8/d1c/d13/d2f/f82 3846 1 2024-09-12T22:49:57.639 INFO:tasks.workunit.client.0.smithi066.stdout:8/708: link d17/d1b/c41 d17/d49/d4b/d57/d5e/d65/d91/cf8 0 2024-09-12T22:49:57.639 INFO:tasks.workunit.client.0.smithi066.stdout:1/646: creat d0/d4e/d79/dc1/fc6 x:0 0 0 2024-09-12T22:49:57.639 INFO:tasks.workunit.client.0.smithi066.stdout:3/692: chown d0/d2/l22 28 1 2024-09-12T22:49:57.640 INFO:tasks.workunit.client.0.smithi066.stdout:4/774: mknod d5/d8/d10/de/d2d/d64/d9a/c107 0 2024-09-12T22:49:57.640 INFO:tasks.workunit.client.0.smithi066.stdout:7/610: dread d0/d19/d26/d48/fa9 [0,4194304] 0 2024-09-12T22:49:57.640 INFO:tasks.workunit.client.0.smithi066.stdout:0/686: creat d1/d8/d1c/d56/db7/ff6 x:0 0 0 2024-09-12T22:49:57.640 INFO:tasks.workunit.client.0.smithi066.stdout:1/647: symlink d0/d4e/lc7 0 2024-09-12T22:49:57.640 INFO:tasks.workunit.client.0.smithi066.stdout:6/764: link d6/d23/d25/d4e/dc4/f12 d6/d23/d41/db6/dd3/df9/f103 0 2024-09-12T22:49:57.640 INFO:tasks.workunit.client.0.smithi066.stdout:4/775: read d5/d8/d16/d1b/f28 [1102709,107159] 0 2024-09-12T22:49:57.640 INFO:tasks.workunit.client.0.smithi066.stdout:1/648: dread - d0/d36/d57/d81/fbf zero size 2024-09-12T22:49:57.640 INFO:tasks.workunit.client.0.smithi066.stdout:6/765: mknod d6/d59/df3/c104 0 2024-09-12T22:49:57.640 INFO:tasks.workunit.client.0.smithi066.stdout:9/717: dwrite d9/dc/dd/f54 [0,4194304] 0 2024-09-12T22:49:57.640 INFO:tasks.workunit.client.0.smithi066.stdout:9/718: fdatasync d9/dc6/fa2 0 2024-09-12T22:49:57.640 INFO:tasks.workunit.client.0.smithi066.stdout:2/716: dread d1/dd/d12/d67/f6a [0,4194304] 0 2024-09-12T22:49:57.640 INFO:tasks.workunit.client.0.smithi066.stdout:1/649: mknod d0/d28/cc8 0 2024-09-12T22:49:57.641 INFO:tasks.workunit.client.0.smithi066.stdout:8/709: dwrite d17/d2c/f34 [4194304,4194304] 0 2024-09-12T22:49:57.641 INFO:tasks.workunit.client.0.smithi066.stdout:4/776: write d5/d8/d16/d93/d9c/d98/fa2 [633360,77712] 0 2024-09-12T22:49:57.641 INFO:tasks.workunit.client.0.smithi066.stdout:7/611: dread d0/d19/d26/d48/f58 [0,4194304] 0 2024-09-12T22:49:57.641 INFO:tasks.workunit.client.0.smithi066.stdout:4/777: sync 2024-09-12T22:49:57.641 INFO:tasks.workunit.client.0.smithi066.stdout:3/693: dwrite d0/d2/d7/d29/fe3 [0,4194304] 0 2024-09-12T22:49:57.641 INFO:tasks.workunit.client.0.smithi066.stdout:7/612: write d0/d19/d24/fa0 [749375,76501] 0 2024-09-12T22:49:57.641 INFO:tasks.workunit.client.0.smithi066.stdout:3/694: dread - d0/d2/d1d/fe9 zero size 2024-09-12T22:49:57.641 INFO:tasks.workunit.client.0.smithi066.stdout:2/717: creat d1/db/fe5 x:0 0 0 2024-09-12T22:49:57.641 INFO:tasks.workunit.client.0.smithi066.stdout:7/613: mkdir d0/d19/d24/d33/d27/dba/dc9 0 2024-09-12T22:49:57.641 INFO:tasks.workunit.client.0.smithi066.stdout:6/766: getdents d6/d23/d25/d4e/dc4/d32/d3c 0 2024-09-12T22:49:57.641 INFO:tasks.workunit.client.0.smithi066.stdout:8/710: rename d17/c44 to d17/d2c/dab/df2/cf9 0 2024-09-12T22:49:57.642 INFO:tasks.workunit.client.0.smithi066.stdout:3/695: write d0/d2/d7/f66 [1507572,7649] 0 2024-09-12T22:49:57.642 INFO:tasks.workunit.client.0.smithi066.stdout:1/650: chown d0/d4e/d79/d86/lbe 0 1 2024-09-12T22:49:57.642 INFO:tasks.workunit.client.0.smithi066.stdout:9/719: dwrite d9/fa1 [0,4194304] 0 2024-09-12T22:49:57.642 INFO:tasks.workunit.client.0.smithi066.stdout:2/718: chown d1/d11/d26/d4f/d5f/d61/d7e/l37 227 1 2024-09-12T22:49:57.644 INFO:tasks.workunit.client.0.smithi066.stdout:4/778: dwrite d5/f46 [0,4194304] 0 2024-09-12T22:49:57.644 INFO:tasks.workunit.client.0.smithi066.stdout:9/720: write d9/dc/d23/f79 [2615492,98018] 0 2024-09-12T22:49:57.644 INFO:tasks.workunit.client.0.smithi066.stdout:2/719: write d1/d11/d26/d4f/fd6 [547355,85728] 0 2024-09-12T22:49:57.644 INFO:tasks.workunit.client.0.smithi066.stdout:6/767: creat d6/d23/d25/d4e/f105 x:0 0 0 2024-09-12T22:49:57.644 INFO:tasks.workunit.client.0.smithi066.stdout:3/696: creat d0/d2/d7/d13/ff2 x:0 0 0 2024-09-12T22:49:57.645 INFO:tasks.workunit.client.0.smithi066.stdout:8/711: creat d17/d40/d74/da3/ffa x:0 0 0 2024-09-12T22:49:57.645 INFO:tasks.workunit.client.0.smithi066.stdout:7/614: mknod d0/d19/d26/d48/dc3/cca 0 2024-09-12T22:49:57.645 INFO:tasks.workunit.client.0.smithi066.stdout:4/779: creat d5/d8/d10/de/d39/f108 x:0 0 0 2024-09-12T22:49:57.645 INFO:tasks.workunit.client.0.smithi066.stdout:7/615: sync 2024-09-12T22:49:57.645 INFO:tasks.workunit.client.0.smithi066.stdout:2/720: stat d1/d11/d26/d8f 0 2024-09-12T22:49:57.645 INFO:tasks.workunit.client.0.smithi066.stdout:1/651: dread d0/dc/f46 [0,4194304] 0 2024-09-12T22:49:57.645 INFO:tasks.workunit.client.0.smithi066.stdout:8/712: write d17/d49/d4b/d57/d5e/d62/d79/fda [411850,103330] 0 2024-09-12T22:49:57.645 INFO:tasks.workunit.client.0.smithi066.stdout:4/780: creat d5/d8/d10/f109 x:0 0 0 2024-09-12T22:49:57.645 INFO:tasks.workunit.client.0.smithi066.stdout:6/768: creat d6/d23/d62/d79/f106 x:0 0 0 2024-09-12T22:49:57.645 INFO:tasks.workunit.client.0.smithi066.stdout:1/652: chown d0/l1 1903971889 1 2024-09-12T22:49:57.645 INFO:tasks.workunit.client.0.smithi066.stdout:3/697: creat d0/d2/d1d/d87/d6b/db2/ff3 x:0 0 0 2024-09-12T22:49:57.645 INFO:tasks.workunit.client.0.smithi066.stdout:2/721: symlink d1/d11/d26/d4f/d5f/da9/le6 0 2024-09-12T22:49:57.646 INFO:tasks.workunit.client.0.smithi066.stdout:6/769: chown d6/d7/feb 2156 1 2024-09-12T22:49:57.646 INFO:tasks.workunit.client.0.smithi066.stdout:1/653: dread - d0/d36/d57/d81/fbf zero size 2024-09-12T22:49:57.646 INFO:tasks.workunit.client.0.smithi066.stdout:7/616: rename d0/d19/d24/d33/d27/fc0 to d0/d19/d60/d53/fcb 0 2024-09-12T22:49:57.647 INFO:tasks.workunit.client.0.smithi066.stdout:4/781: truncate d5/d8/d16/fa0 1062812 0 2024-09-12T22:49:57.647 INFO:tasks.workunit.client.0.smithi066.stdout:8/713: mknod d17/d49/d4b/d57/d5e/d65/cfb 0 2024-09-12T22:49:57.647 INFO:tasks.workunit.client.0.smithi066.stdout:2/722: mknod d1/d44/d51/de4/ce7 0 2024-09-12T22:49:57.647 INFO:tasks.workunit.client.0.smithi066.stdout:1/654: write d0/d36/d57/f27 [1720982,687] 0 2024-09-12T22:49:57.647 INFO:tasks.workunit.client.0.smithi066.stdout:9/721: dwrite d9/d31/d58/fc1 [0,4194304] 0 2024-09-12T22:49:57.647 INFO:tasks.workunit.client.0.smithi066.stdout:4/782: creat d5/d87/f10a x:0 0 0 2024-09-12T22:49:57.647 INFO:tasks.workunit.client.0.smithi066.stdout:3/698: creat d0/d2/d1d/d87/d40/d44/ff4 x:0 0 0 2024-09-12T22:49:57.648 INFO:tasks.workunit.client.0.smithi066.stdout:8/714: mkdir d17/d49/d4b/d57/dfc 0 2024-09-12T22:49:57.648 INFO:tasks.workunit.client.0.smithi066.stdout:7/617: write d0/d19/d26/d48/fa9 [1707514,10339] 0 2024-09-12T22:49:57.649 INFO:tasks.workunit.client.0.smithi066.stdout:6/770: rename d6/d23/d62/d79/f106 to d6/d23/d25/d4e/dc4/d50/f107 0 2024-09-12T22:49:57.650 INFO:tasks.workunit.client.0.smithi066.stdout:9/722: mkdir d9/d31/d77/dc2/dcb/dea 0 2024-09-12T22:49:57.650 INFO:tasks.workunit.client.0.smithi066.stdout:8/715: mknod d17/d49/d4b/d57/d5e/d65/cfd 0 2024-09-12T22:49:57.650 INFO:tasks.workunit.client.0.smithi066.stdout:7/618: chown d0/d19/d24/l15 29 1 2024-09-12T22:49:57.651 INFO:tasks.workunit.client.0.smithi066.stdout:6/771: write d6/d59/f77 [1704467,60496] 0 2024-09-12T22:49:57.652 INFO:tasks.workunit.client.0.smithi066.stdout:8/716: chown d17/d1b/de7/dea/fc0 88 1 2024-09-12T22:49:57.652 INFO:tasks.workunit.client.0.smithi066.stdout:4/783: truncate d5/d8/d16/d93/d9c/d98/d8b/fed 775535 0 2024-09-12T22:49:57.653 INFO:tasks.workunit.client.0.smithi066.stdout:7/619: creat d0/d19/d60/d85/d8b/fcc x:0 0 0 2024-09-12T22:49:57.653 INFO:tasks.workunit.client.0.smithi066.stdout:5/768: dread d5/d11/d23/d6f/daa/dbb/dc6/de1/fa9 [0,4194304] 0 2024-09-12T22:49:57.653 INFO:tasks.workunit.client.0.smithi066.stdout:8/717: fdatasync d17/d40/d47/f8e 0 2024-09-12T22:49:57.654 INFO:tasks.workunit.client.0.smithi066.stdout:6/772: creat d6/d23/d41/f108 x:0 0 0 2024-09-12T22:49:57.655 INFO:tasks.workunit.client.0.smithi066.stdout:4/784: creat d5/d8/d16/d1b/d1e/f10b x:0 0 0 2024-09-12T22:49:57.656 INFO:tasks.workunit.client.0.smithi066.stdout:3/699: dwrite d0/d2/d7/d13/d31/fbc [0,4194304] 0 2024-09-12T22:49:57.657 INFO:tasks.workunit.client.0.smithi066.stdout:6/773: chown d6/d23/d25/d2c/d69/fe3 0 1 2024-09-12T22:49:57.657 INFO:tasks.workunit.client.0.smithi066.stdout:8/718: dread - d17/d49/d4b/d57/d5e/d62/dc1/dd1/fec zero size 2024-09-12T22:49:57.658 INFO:tasks.workunit.client.0.smithi066.stdout:5/769: read d5/de/d50/f5a [2589009,8874] 0 2024-09-12T22:49:57.658 INFO:tasks.workunit.client.0.smithi066.stdout:4/785: mknod d5/d87/c10c 0 2024-09-12T22:49:57.658 INFO:tasks.workunit.client.0.smithi066.stdout:4/786: sync 2024-09-12T22:49:57.658 INFO:tasks.workunit.client.0.smithi066.stdout:3/700: fdatasync d0/d2/f6e 0 2024-09-12T22:49:57.659 INFO:tasks.workunit.client.0.smithi066.stdout:9/723: dwrite d9/d31/d77/faa [0,4194304] 0 2024-09-12T22:49:57.659 INFO:tasks.workunit.client.0.smithi066.stdout:0/687: dread d1/d8/f35 [0,4194304] 0 2024-09-12T22:49:57.661 INFO:tasks.workunit.client.0.smithi066.stdout:3/701: mknod d0/d2/d1d/cf5 0 2024-09-12T22:49:57.662 INFO:tasks.workunit.client.0.smithi066.stdout:5/770: symlink d5/d11/d23/leb 0 2024-09-12T22:49:57.662 INFO:tasks.workunit.client.0.smithi066.stdout:8/719: creat d17/d49/d4b/d57/d5e/d62/d79/ffe x:0 0 0 2024-09-12T22:49:57.662 INFO:tasks.workunit.client.0.smithi066.stdout:6/774: truncate d6/d7/fae 4860907 0 2024-09-12T22:49:57.662 INFO:tasks.workunit.client.0.smithi066.stdout:9/724: truncate d9/d31/d34/d4d/faf 210123 0 2024-09-12T22:49:57.663 INFO:tasks.workunit.client.0.smithi066.stdout:4/787: write d5/d8/d16/d1b/d1e/d5a/f67 [1756164,10489] 0 2024-09-12T22:49:57.663 INFO:tasks.workunit.client.0.smithi066.stdout:0/688: creat d1/d8/d1c/d13/d2f/d8a/de1/ff7 x:0 0 0 2024-09-12T22:49:57.663 INFO:tasks.workunit.client.0.smithi066.stdout:8/720: unlink d17/d40/d74/l7e 0 2024-09-12T22:49:57.664 INFO:tasks.workunit.client.0.smithi066.stdout:9/725: write d9/fa [1875296,130584] 0 2024-09-12T22:49:57.664 INFO:tasks.workunit.client.0.smithi066.stdout:5/771: mknod d5/d11/d23/d6f/daa/dbb/dc6/cec 0 2024-09-12T22:49:57.665 INFO:tasks.workunit.client.0.smithi066.stdout:0/689: symlink d1/d8/lf8 0 2024-09-12T22:49:57.665 INFO:tasks.workunit.client.0.smithi066.stdout:8/721: truncate d17/fb2 503381 0 2024-09-12T22:49:57.666 INFO:tasks.workunit.client.0.smithi066.stdout:5/772: fsync d5/de/d50/f35 0 2024-09-12T22:49:57.666 INFO:tasks.workunit.client.0.smithi066.stdout:9/726: read - d9/d31/d58/dbc/fdf zero size 2024-09-12T22:49:57.666 INFO:tasks.workunit.client.0.smithi066.stdout:1/655: dwrite d0/dc/f17 [0,4194304] 0 2024-09-12T22:49:57.666 INFO:tasks.workunit.client.0.smithi066.stdout:5/773: chown d5/d11/d21/d4d/l53 13059 1 2024-09-12T22:49:57.667 INFO:tasks.workunit.client.0.smithi066.stdout:3/702: read d0/d2/d7/d13/d31/f7f [718893,100490] 0 2024-09-12T22:49:57.668 INFO:tasks.workunit.client.0.smithi066.stdout:0/690: rename d1/d8/d1b/d59/l72 to d1/d8/d1f/d30/lf9 0 2024-09-12T22:49:57.668 INFO:tasks.workunit.client.0.smithi066.stdout:8/722: mkdir d17/d49/d4b/d57/d5e/d62/dc1/dd1/dff 0 2024-09-12T22:49:57.668 INFO:tasks.workunit.client.0.smithi066.stdout:1/656: fdatasync d0/dc/d1d/f67 0 2024-09-12T22:49:57.670 INFO:tasks.workunit.client.0.smithi066.stdout:8/723: fdatasync d17/d40/f52 0 2024-09-12T22:49:57.670 INFO:tasks.workunit.client.0.smithi066.stdout:7/620: dread d0/d19/d26/d5a/f61 [0,4194304] 0 2024-09-12T22:49:57.670 INFO:tasks.workunit.client.0.smithi066.stdout:1/657: creat d0/d28/fc9 x:0 0 0 2024-09-12T22:49:57.670 INFO:tasks.workunit.client.0.smithi066.stdout:3/703: getdents d0/d2/d1d/d87/d6b 0 2024-09-12T22:49:57.671 INFO:tasks.workunit.client.0.smithi066.stdout:0/691: rename d1/d8/d1f/d30/la7 to d1/d8/df5/de2/lfa 0 2024-09-12T22:49:57.671 INFO:tasks.workunit.client.0.smithi066.stdout:1/658: mkdir d0/dc/dca 0 2024-09-12T22:49:57.672 INFO:tasks.workunit.client.0.smithi066.stdout:3/704: write d0/d2/fa [7108079,44044] 0 2024-09-12T22:49:57.672 INFO:tasks.workunit.client.0.smithi066.stdout:7/621: chown d0/d19/d24/d33/d27/d70/lb6 7787252 1 2024-09-12T22:49:57.672 INFO:tasks.workunit.client.0.smithi066.stdout:0/692: creat d1/d36/d65/dc2/ffb x:0 0 0 2024-09-12T22:49:57.673 INFO:tasks.workunit.client.0.smithi066.stdout:3/705: readlink d0/d2/d7/d13/l34 0 2024-09-12T22:49:57.673 INFO:tasks.workunit.client.0.smithi066.stdout:1/659: mkdir d0/dc/d1e/d95/dcb 0 2024-09-12T22:49:57.673 INFO:tasks.workunit.client.0.smithi066.stdout:7/622: write d0/d6/d83/fa4 [467279,95088] 0 2024-09-12T22:49:57.674 INFO:tasks.workunit.client.0.smithi066.stdout:0/693: symlink d1/d36/lfc 0 2024-09-12T22:49:57.674 INFO:tasks.workunit.client.0.smithi066.stdout:3/706: chown d0/d2/l22 186 1 2024-09-12T22:49:57.674 INFO:tasks.workunit.client.0.smithi066.stdout:9/727: dwrite d9/dc/f6a [0,4194304] 0 2024-09-12T22:49:57.674 INFO:tasks.workunit.client.0.smithi066.stdout:3/707: dread - d0/d2/d1d/d87/f65 zero size 2024-09-12T22:49:57.675 INFO:tasks.workunit.client.0.smithi066.stdout:9/728: write d9/dc/d46/d8a/f95 [487831,87323] 0 2024-09-12T22:49:57.675 INFO:tasks.workunit.client.0.smithi066.stdout:3/708: fdatasync d0/d2/d6/f9 0 2024-09-12T22:49:57.677 INFO:tasks.workunit.client.0.smithi066.stdout:5/774: read d5/de/d50/f5a [2366276,118754] 0 2024-09-12T22:49:57.677 INFO:tasks.workunit.client.0.smithi066.stdout:6/775: dread d6/d23/d25/d2c/d69/f83 [0,4194304] 0 2024-09-12T22:49:57.677 INFO:tasks.workunit.client.0.smithi066.stdout:7/623: creat d0/d6/fcd x:0 0 0 2024-09-12T22:49:57.677 INFO:tasks.workunit.client.0.smithi066.stdout:0/694: truncate d1/d8/f81 2633 0 2024-09-12T22:49:57.677 INFO:tasks.workunit.client.0.smithi066.stdout:1/660: rmdir d0/dc/dca 0 2024-09-12T22:49:57.677 INFO:tasks.workunit.client.0.smithi066.stdout:3/709: mkdir d0/d2/d6/df6 0 2024-09-12T22:49:57.677 INFO:tasks.workunit.client.0.smithi066.stdout:5/775: readlink d5/de/l61 0 2024-09-12T22:49:57.677 INFO:tasks.workunit.client.0.smithi066.stdout:3/710: dread - d0/db3/db7/fd6 zero size 2024-09-12T22:49:57.679 INFO:tasks.workunit.client.0.smithi066.stdout:6/776: readlink d6/d23/d25/d4e/dc4/d32/lcf 0 2024-09-12T22:49:57.679 INFO:tasks.workunit.client.0.smithi066.stdout:0/695: chown d1/d8/d1c/d13/d2f/dd8/f77 862543 1 2024-09-12T22:49:57.679 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:57.678+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:57.679 INFO:tasks.workunit.client.0.smithi066.stdout:9/729: symlink d9/dc/dd2/leb 0 2024-09-12T22:49:57.681 INFO:tasks.workunit.client.0.smithi066.stdout:8/724: truncate d17/f27 1440552 0 2024-09-12T22:49:57.681 INFO:tasks.workunit.client.0.smithi066.stdout:4/788: write d5/d8/d10/de/d2d/fae [2715299,87313] 0 2024-09-12T22:49:57.681 INFO:tasks.workunit.client.0.smithi066.stdout:5/776: symlink d5/d11/d5d/led 0 2024-09-12T22:49:57.682 INFO:tasks.workunit.client.0.smithi066.stdout:2/723: dread d1/d11/d26/f6f [0,4194304] 0 2024-09-12T22:49:57.682 INFO:tasks.workunit.client.0.smithi066.stdout:4/789: fsync d5/d3e/d65/dac/fd7 0 2024-09-12T22:49:57.683 INFO:tasks.workunit.client.0.smithi066.stdout:3/711: dread d0/d2/d1d/f85 [0,4194304] 0 2024-09-12T22:49:57.683 INFO:tasks.workunit.client.0.smithi066.stdout:7/624: dread d0/d19/d60/d85/d8b/f9c [0,4194304] 0 2024-09-12T22:49:57.683 INFO:tasks.workunit.client.0.smithi066.stdout:1/661: link d0/d4e/d79/dc1/l6e d0/d36/d57/lcc 0 2024-09-12T22:49:57.683 INFO:tasks.workunit.client.0.smithi066.stdout:5/777: rmdir d5/d11/d5d 39 2024-09-12T22:49:57.683 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:49:57.684 INFO:tasks.workunit.client.0.smithi066.stdout:0/696: symlink d1/d8/lfd 0 2024-09-12T22:49:57.685 INFO:tasks.workunit.client.0.smithi066.stdout:5/778: mkdir d5/d11/d23/d6f/dee 0 2024-09-12T22:49:57.687 INFO:tasks.workunit.client.0.smithi066.stdout:0/697: write d1/d8/d1f/d30/f5c [4284394,95485] 0 2024-09-12T22:49:57.687 INFO:tasks.workunit.client.0.smithi066.stdout:1/662: chown d0/d4e/d79/dc1/fc6 1 1 2024-09-12T22:49:57.687 INFO:tasks.workunit.client.0.smithi066.stdout:7/625: symlink d0/d19/d24/d33/d27/d70/d90/db8/lce 0 2024-09-12T22:49:57.688 INFO:tasks.workunit.client.0.smithi066.stdout:5/779: rmdir d5/d11/d7c/dc3 39 2024-09-12T22:49:57.689 INFO:tasks.workunit.client.0.smithi066.stdout:0/698: mknod d1/d36/de6/cfe 0 2024-09-12T22:49:57.690 INFO:tasks.workunit.client.0.smithi066.stdout:2/724: dwrite d1/d11/d26/d4f/d7c/f9f [0,4194304] 0 2024-09-12T22:49:57.690 INFO:tasks.workunit.client.0.smithi066.stdout:8/725: dwrite d17/d49/d4b/d57/d5e/f72 [0,4194304] 0 2024-09-12T22:49:57.692 INFO:tasks.workunit.client.0.smithi066.stdout:7/626: creat d0/d19/d60/d53/fcf x:0 0 0 2024-09-12T22:49:57.692 INFO:tasks.workunit.client.0.smithi066.stdout:5/780: symlink d5/d11/d21/d4d/lef 0 2024-09-12T22:49:57.695 INFO:tasks.workunit.client.0.smithi066.stdout:3/712: dwrite d0/d2/d1d/d87/d40/d44/f9c [0,4194304] 0 2024-09-12T22:49:57.695 INFO:tasks.workunit.client.0.smithi066.stdout:7/627: write d0/d19/d60/d85/d8b/fa8 [155214,26112] 0 2024-09-12T22:49:57.696 INFO:tasks.workunit.client.0.smithi066.stdout:9/730: write d9/dc/d46/f4b [1686143,104287] 0 2024-09-12T22:49:57.696 INFO:tasks.workunit.client.0.smithi066.stdout:4/790: write d5/d3e/d8d/dc7/fc9 [5219124,115931] 0 2024-09-12T22:49:57.696 INFO:tasks.workunit.client.0.smithi066.stdout:5/781: fsync d5/d11/d23/d6f/fc5 0 2024-09-12T22:49:57.698 INFO:tasks.workunit.client.0.smithi066.stdout:1/663: dwrite d0/dc/f17 [0,4194304] 0 2024-09-12T22:49:57.699 INFO:tasks.workunit.client.0.smithi066.stdout:3/713: write d0/d2/d6/f7d [3534774,104220] 0 2024-09-12T22:49:57.699 INFO:tasks.workunit.client.0.smithi066.stdout:9/731: chown d9/dc/dd2/le3 10 1 2024-09-12T22:49:57.699 INFO:tasks.workunit.client.0.smithi066.stdout:5/782: write d5/f3e [2334545,33703] 0 2024-09-12T22:49:57.700 INFO:tasks.workunit.client.0.smithi066.stdout:4/791: unlink d5/fba 0 2024-09-12T22:49:57.700 INFO:tasks.workunit.client.0.smithi066.stdout:0/699: link d1/d8/d1f/d30/f5c d1/d8/d1c/d56/fff 0 2024-09-12T22:49:57.700 INFO:tasks.workunit.client.0.smithi066.stdout:1/664: chown d0/dc/d1e/d95/f6a 25 1 2024-09-12T22:49:57.700 INFO:tasks.workunit.client.0.smithi066.stdout:3/714: fdatasync d0/d2/d7/d13/f19 0 2024-09-12T22:49:57.700 INFO:tasks.workunit.client.0.smithi066.stdout:7/628: creat d0/d19/d26/dbe/fd0 x:0 0 0 2024-09-12T22:49:57.701 INFO:tasks.workunit.client.0.smithi066.stdout:2/725: creat d1/d11/d26/d4f/d5f/d61/fe8 x:0 0 0 2024-09-12T22:49:57.701 INFO:tasks.workunit.client.0.smithi066.stdout:1/665: write d0/d36/d57/f3f [905238,47212] 0 2024-09-12T22:49:57.702 INFO:tasks.workunit.client.0.smithi066.stdout:8/726: dwrite d17/d49/f8d [8388608,4194304] 0 2024-09-12T22:49:57.703 INFO:tasks.workunit.client.0.smithi066.stdout:4/792: dread - d5/d8/d16/d93/d9c/d98/ddc/fe2 zero size 2024-09-12T22:49:57.703 INFO:tasks.workunit.client.0.smithi066.stdout:0/700: write d1/d8/d1c/d13/d2f/dd8/fde [4895,8121] 0 2024-09-12T22:49:57.703 INFO:tasks.workunit.client.0.smithi066.stdout:5/783: unlink d5/d11/d23/d6f/daa/dbb/le7 0 2024-09-12T22:49:57.704 INFO:tasks.workunit.client.0.smithi066.stdout:9/732: rename d9/dc/dd2/le3 to d9/d31/d58/d7f/dc8/lec 0 2024-09-12T22:49:57.704 INFO:tasks.workunit.client.0.smithi066.stdout:3/715: creat d0/d2/d1d/d87/d49/dc8/ff7 x:0 0 0 2024-09-12T22:49:57.704 INFO:tasks.workunit.client.0.smithi066.stdout:2/726: rename d1/d11/d26/d4f/d7c/da6/dab to d1/dd/d68/de9 0 2024-09-12T22:49:57.705 INFO:tasks.workunit.client.0.smithi066.stdout:1/666: chown d0/f7 288724 1 2024-09-12T22:49:57.705 INFO:tasks.workunit.client.0.smithi066.stdout:5/784: write d5/d14/f74 [1228095,124111] 0 2024-09-12T22:49:57.706 INFO:tasks.workunit.client.0.smithi066.stdout:2/727: stat d1/dd/d12/dd1 0 2024-09-12T22:49:57.706 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:57.706 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:49:57.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:57.707 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:13971 4.8 4:12384609:::100000035d0.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:57.707 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.690777+0000", 2024-09-12T22:49:57.707 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.014777317, 2024-09-12T22:49:57.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014802704999999999, 2024-09-12T22:49:57.707 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:57.707 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:57.707 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:57.707 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:57.707 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:57.707 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:57.707 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 13971 2024-09-12T22:49:57.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:57.708 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:57.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:57.708 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:57.708 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.690777+0000", 2024-09-12T22:49:57.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:57.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:57.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:57.708 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:57.708 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.690777+0000", 2024-09-12T22:49:57.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:57.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:57.709 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:57.709 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:57.709 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.690778+0000", 2024-09-12T22:49:57.709 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3499999999999995e-07 2024-09-12T22:49:57.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:57.709 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:57.709 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:57.709 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.698293+0000", 2024-09-12T22:49:57.709 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.007515529 2024-09-12T22:49:57.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:57.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:57.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:57.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.698304+0000", 2024-09-12T22:49:57.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0198e-05 2024-09-12T22:49:57.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:57.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:57.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:57.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.698309+0000", 2024-09-12T22:49:57.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0200000000000002e-06 2024-09-12T22:49:57.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:57.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:57.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:57.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.698347+0000", 2024-09-12T22:49:57.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8602000000000001e-05 2024-09-12T22:49:57.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:57.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:57.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:57.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.698456+0000", 2024-09-12T22:49:57.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000108479 2024-09-12T22:49:57.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:57.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:57.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:57.712 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.705562+0000", 2024-09-12T22:49:57.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071061040000000002 2024-09-12T22:49:57.712 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:57.712 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:57.712 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:57.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:57.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:57.712 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4459.0:13983 4.2 4:432a81e6:::100000034f2.00000000:head [write 4895~8121 in=8121b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:49:57.712 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.703744+0000", 2024-09-12T22:49:57.712 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0018109319999999999, 2024-09-12T22:49:57.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001919247, 2024-09-12T22:49:57.713 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:57.713 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:57.713 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:49:57.713 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-09-12T22:49:57.713 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4459", 2024-09-12T22:49:57.713 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:49:57.713 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 13983 2024-09-12T22:49:57.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:57.713 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:57.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:57.714 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:57.714 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.703744+0000", 2024-09-12T22:49:57.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:57.714 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:57.714 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:57.714 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:57.714 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.703744+0000", 2024-09-12T22:49:57.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:57.714 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:57.714 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:57.714 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:57.715 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.703744+0000", 2024-09-12T22:49:57.715 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2600000000000001e-07 2024-09-12T22:49:57.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:57.715 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:57.715 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:57.715 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.703807+0000", 2024-09-12T22:49:57.715 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2544000000000003e-05 2024-09-12T22:49:57.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:57.715 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:57.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:57.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.703816+0000", 2024-09-12T22:49:57.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8279999999999992e-06 2024-09-12T22:49:57.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:57.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:57.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:57.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.703821+0000", 2024-09-12T22:49:57.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8690000000000003e-06 2024-09-12T22:49:57.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:57.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:57.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:57.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.703875+0000", 2024-09-12T22:49:57.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4212999999999997e-05 2024-09-12T22:49:57.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:57.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:57.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:57.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.704022+0000", 2024-09-12T22:49:57.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000146933 2024-09-12T22:49:57.717 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:57.717 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:57.718 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:57.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:57.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:57.718 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:2210 3.8 3:17051619:::200.0000000f:head [write 2767598~19731 [fadvise_dontneed] in=19731b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:49:57.718 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.704765+0000", 2024-09-12T22:49:57.718 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.00078930299999999999, 2024-09-12T22:49:57.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094362099999999996, 2024-09-12T22:49:57.718 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:57.718 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:57.718 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:49:57.718 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:57.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:57.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:57.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.704765+0000", 2024-09-12T22:49:57.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:57.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:57.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:57.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:57.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.704765+0000", 2024-09-12T22:49:57.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:57.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:57.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:57.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:57.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.704766+0000", 2024-09-12T22:49:57.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7899999999999998e-07 2024-09-12T22:49:57.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:57.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:57.720 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:57.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.704812+0000", 2024-09-12T22:49:57.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6186999999999997e-05 2024-09-12T22:49:57.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:57.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:57.720 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:57.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.704820+0000", 2024-09-12T22:49:57.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.712e-06 2024-09-12T22:49:57.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:57.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:57.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:57.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.704824+0000", 2024-09-12T22:49:57.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.98e-06 2024-09-12T22:49:57.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:57.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:57.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:57.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.704898+0000", 2024-09-12T22:49:57.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4221000000000006e-05 2024-09-12T22:49:57.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:57.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:57.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:57.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.704946+0000", 2024-09-12T22:49:57.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7718e-05 2024-09-12T22:49:57.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:57.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:57.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:57.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.705013+0000", 2024-09-12T22:49:57.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7636000000000001e-05 2024-09-12T22:49:57.722 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:57.722 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:57.723 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:57.723 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:57.723 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-12T22:49:57.723 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 3 2024-09-12T22:49:57.723 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:57.723 INFO:tasks.workunit.client.0.smithi066.stdout:6/777: dread d6/d7/fae [0,4194304] 0 2024-09-12T22:49:57.725 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:57.729 INFO:tasks.workunit.client.0.smithi066.stdout:1/667: chown d0/dc/f17 173119 1 2024-09-12T22:49:57.729 INFO:tasks.workunit.client.0.smithi066.stdout:9/733: rmdir d9/d31/d77/dc2 39 2024-09-12T22:49:57.729 INFO:tasks.workunit.client.0.smithi066.stdout:4/793: creat d5/d8/d10/de/d39/f10d x:0 0 0 2024-09-12T22:49:57.729 INFO:tasks.workunit.client.0.smithi066.stdout:0/701: creat d1/d8/d1b/d88/f100 x:0 0 0 2024-09-12T22:49:57.729 INFO:tasks.workunit.client.0.smithi066.stdout:3/716: creat d0/d2/d7/d29/daf/ff8 x:0 0 0 2024-09-12T22:49:57.729 INFO:tasks.workunit.client.0.smithi066.stdout:2/728: chown d1/dd/d12/f24 761 1 2024-09-12T22:49:57.729 INFO:tasks.workunit.client.0.smithi066.stdout:6/778: mknod d6/d23/d41/c109 0 2024-09-12T22:49:57.729 INFO:tasks.workunit.client.0.smithi066.stdout:8/727: link d17/d40/d47/d4d/f93 d17/d40/d47/d4d/df0/f100 0 2024-09-12T22:49:57.730 INFO:tasks.workunit.client.0.smithi066.stdout:0/702: write d1/f7 [2269593,47798] 0 2024-09-12T22:49:57.730 INFO:tasks.workunit.client.0.smithi066.stdout:9/734: dread - d9/d31/d58/dbc/fdf zero size 2024-09-12T22:49:57.730 INFO:tasks.workunit.client.0.smithi066.stdout:5/785: getdents d5/d11/d21 0 2024-09-12T22:49:57.730 INFO:tasks.workunit.client.0.smithi066.stdout:8/728: rmdir d17/d40/d47/d4d/d87 39 2024-09-12T22:49:57.730 INFO:tasks.workunit.client.0.smithi066.stdout:4/794: chown d5/d8/d10/de/d2d/d64/d9a/c107 992 1 2024-09-12T22:49:57.730 INFO:tasks.workunit.client.0.smithi066.stdout:9/735: symlink d9/d31/d58/dbc/led 0 2024-09-12T22:49:57.730 INFO:tasks.workunit.client.0.smithi066.stdout:0/703: rename d1/d8/f81 to d1/d5b/f101 0 2024-09-12T22:49:57.730 INFO:tasks.workunit.client.0.smithi066.stdout:8/729: fsync d17/d49/d4b/d57/d5e/f72 0 2024-09-12T22:49:57.730 INFO:tasks.workunit.client.0.smithi066.stdout:9/736: rmdir d9/d31/d58/d7f 39 2024-09-12T22:49:57.730 INFO:tasks.workunit.client.0.smithi066.stdout:1/668: dwrite d0/f64 [0,4194304] 0 2024-09-12T22:49:57.733 INFO:tasks.workunit.client.0.smithi066.stdout:9/737: readlink d9/d31/d77/l84 0 2024-09-12T22:49:57.733 INFO:tasks.workunit.client.0.smithi066.stdout:0/704: read d1/d8/d1b/d59/fa1 [656825,61599] 0 2024-09-12T22:49:57.734 INFO:tasks.workunit.client.0.smithi066.stdout:6/779: dwrite d6/d23/f3e [0,4194304] 0 2024-09-12T22:49:57.734 INFO:tasks.workunit.client.0.smithi066.stdout:4/795: unlink d5/d8/d16/d93/d9c/d98/ddc/df1/f106 0 2024-09-12T22:49:57.734 INFO:tasks.workunit.client.0.smithi066.stdout:0/705: read - d1/d8/d1c/d13/d2f/f4a zero size 2024-09-12T22:49:57.734 INFO:tasks.workunit.client.0.smithi066.stdout:8/730: symlink d17/d2c/dab/df2/l101 0 2024-09-12T22:49:57.734 INFO:tasks.workunit.client.0.smithi066.stdout:6/780: stat d6/d59/f77 0 2024-09-12T22:49:57.734 INFO:tasks.workunit.client.0.smithi066.stdout:8/731: chown d17/d49/d4b/d4e/fe1 4058281 1 2024-09-12T22:49:57.734 INFO:tasks.workunit.client.0.smithi066.stdout:8/732: chown d17/d49/d4b/d57/fb9 408267 1 2024-09-12T22:49:57.734 INFO:tasks.workunit.client.0.smithi066.stdout:4/796: mknod d5/d8/d16/d93/de0/c10e 0 2024-09-12T22:49:57.735 INFO:tasks.workunit.client.0.smithi066.stdout:0/706: mkdir d1/dbf/d102 0 2024-09-12T22:49:57.735 INFO:tasks.workunit.client.0.smithi066.stdout:0/707: fsync d1/d8/d1b/d88/f100 0 2024-09-12T22:49:57.735 INFO:tasks.workunit.client.0.smithi066.stdout:3/717: truncate d0/d2/d1d/d87/f8d 348127 0 2024-09-12T22:49:57.735 INFO:tasks.workunit.client.0.smithi066.stdout:0/708: mknod d1/d8/d1c/d56/c103 0 2024-09-12T22:49:57.735 INFO:tasks.workunit.client.0.smithi066.stdout:6/781: dwrite d6/d23/d25/d4e/dc4/d99/fa0 [0,4194304] 0 2024-09-12T22:49:57.735 INFO:tasks.workunit.client.0.smithi066.stdout:3/718: mkdir d0/d2/d6/df9 0 2024-09-12T22:49:57.735 INFO:tasks.workunit.client.0.smithi066.stdout:3/719: mkdir d0/d2/d1d/d87/d6b/dfa 0 2024-09-12T22:49:57.735 INFO:tasks.workunit.client.0.smithi066.stdout:9/738: truncate d9/d31/f6f 3230539 0 2024-09-12T22:49:57.736 INFO:tasks.workunit.client.0.smithi066.stdout:4/797: truncate d5/d8/d10/de/f2b 6676177 0 2024-09-12T22:49:57.736 INFO:tasks.workunit.client.0.smithi066.stdout:4/798: chown d5/d3e/d65/dac/fd7 50039871 1 2024-09-12T22:49:57.736 INFO:tasks.workunit.client.0.smithi066.stdout:9/739: write d9/d31/d77/f91 [2784459,119733] 0 2024-09-12T22:49:57.736 INFO:tasks.workunit.client.0.smithi066.stdout:3/720: truncate d0/d2/d7/fdc 481529 0 2024-09-12T22:49:57.736 INFO:tasks.workunit.client.0.smithi066.stdout:0/709: dwrite d1/d8/d1f/d25/d9c/fd3 [0,4194304] 0 2024-09-12T22:49:57.736 INFO:tasks.workunit.client.0.smithi066.stdout:6/782: dwrite d6/fb [0,4194304] 0 2024-09-12T22:49:57.738 INFO:tasks.workunit.client.0.smithi066.stdout:4/799: write d5/d8/d16/d1b/d1e/d5a/f5d [2489183,94489] 0 2024-09-12T22:49:57.738 INFO:tasks.workunit.client.0.smithi066.stdout:6/783: truncate d6/f4b 5598930 0 2024-09-12T22:49:57.738 INFO:tasks.workunit.client.0.smithi066.stdout:0/710: chown d1/d8/d1f/l60 57 1 2024-09-12T22:49:57.738 INFO:tasks.workunit.client.0.smithi066.stdout:9/740: rename d9/d31/d77/dc2/dcb/f62 to d9/d31/d77/fee 0 2024-09-12T22:49:57.738 INFO:tasks.workunit.client.0.smithi066.stdout:4/800: symlink d5/d8/d10/l10f 0 2024-09-12T22:49:57.738 INFO:tasks.workunit.client.0.smithi066.stdout:0/711: creat d1/d8/d1c/d56/db7/f104 x:0 0 0 2024-09-12T22:49:57.739 INFO:tasks.workunit.client.0.smithi066.stdout:9/741: mknod d9/d31/d77/dc2/dcb/cef 0 2024-09-12T22:49:57.739 INFO:tasks.workunit.client.0.smithi066.stdout:0/712: rmdir d1/d8/d1c/d56/db7 39 2024-09-12T22:49:57.739 INFO:tasks.workunit.client.0.smithi066.stdout:6/784: creat d6/d7/f10a x:0 0 0 2024-09-12T22:49:57.739 INFO:tasks.workunit.client.0.smithi066.stdout:9/742: rename d9/d31/d34/d4d to d9/df0 0 2024-09-12T22:49:57.739 INFO:tasks.workunit.client.0.smithi066.stdout:4/801: write d5/d8/d10/de/d2d/fc1 [224219,1265] 0 2024-09-12T22:49:57.739 INFO:tasks.workunit.client.0.smithi066.stdout:6/785: dread - d6/d23/d25/d2c/f40 zero size 2024-09-12T22:49:57.739 INFO:tasks.workunit.client.0.smithi066.stdout:0/713: write d1/d8/d1c/d13/f22 [2338066,38835] 0 2024-09-12T22:49:57.739 INFO:tasks.workunit.client.0.smithi066.stdout:0/714: fdatasync d1/f10 0 2024-09-12T22:49:57.739 INFO:tasks.workunit.client.0.smithi066.stdout:6/786: dread d6/d23/f29 [0,4194304] 0 2024-09-12T22:49:57.739 INFO:tasks.workunit.client.0.smithi066.stdout:3/721: dwrite d0/d2/d7/d29/fc5 [0,4194304] 0 2024-09-12T22:49:57.740 INFO:tasks.workunit.client.0.smithi066.stdout:3/722: truncate d0/d2/d1d/fc3 415450 0 2024-09-12T22:49:57.741 INFO:tasks.workunit.client.0.smithi066.stdout:6/787: unlink d6/d23/d25/d4e/dc4/d50/f5d 0 2024-09-12T22:49:57.741 INFO:tasks.workunit.client.0.smithi066.stdout:3/723: symlink d0/d2/d1d/d87/d40/dbd/d74/lfb 0 2024-09-12T22:49:57.742 INFO:tasks.workunit.client.0.smithi066.stdout:9/743: dwrite d9/d31/d77/fc3 [0,4194304] 0 2024-09-12T22:49:57.742 INFO:tasks.workunit.client.0.smithi066.stdout:6/788: creat d6/d23/d41/f10b x:0 0 0 2024-09-12T22:49:57.742 INFO:tasks.workunit.client.0.smithi066.stdout:7/629: sync 2024-09-12T22:49:57.742 INFO:tasks.workunit.client.0.smithi066.stdout:2/729: sync 2024-09-12T22:49:57.742 INFO:tasks.workunit.client.0.smithi066.stdout:9/744: mknod d9/dc6/cf1 0 2024-09-12T22:49:57.744 INFO:tasks.workunit.client.0.smithi066.stdout:6/789: truncate d6/d23/d25/f97 3140492 0 2024-09-12T22:49:57.746 INFO:tasks.workunit.client.0.smithi066.stdout:9/745: getdents d9/dc/d46 0 2024-09-12T22:49:57.748 INFO:tasks.workunit.client.0.smithi066.stdout:2/730: dread d1/d11/d26/d4f/fd6 [0,4194304] 0 2024-09-12T22:49:57.748 INFO:tasks.workunit.client.0.smithi066.stdout:9/746: rmdir d9/d31/d58/dbc/da8 39 2024-09-12T22:49:57.750 INFO:tasks.workunit.client.0.smithi066.stdout:3/724: dread d0/d2/d7/d29/f42 [4194304,4194304] 0 2024-09-12T22:49:57.750 INFO:tasks.workunit.client.0.smithi066.stdout:8/733: dread d17/d1b/f86 [0,4194304] 0 2024-09-12T22:49:57.750 INFO:tasks.workunit.client.0.smithi066.stdout:9/747: chown d9/dc/dd/f54 30211 1 2024-09-12T22:49:57.750 INFO:tasks.workunit.client.0.smithi066.stdout:2/731: mknod d1/d44/d51/de4/cea 0 2024-09-12T22:49:57.751 INFO:tasks.workunit.client.0.smithi066.stdout:6/790: dwrite d6/d23/d25/f2e [4194304,4194304] 0 2024-09-12T22:49:57.751 INFO:tasks.workunit.client.0.smithi066.stdout:8/734: mknod d17/d1b/de7/c102 0 2024-09-12T22:49:57.752 INFO:tasks.workunit.client.0.smithi066.stdout:7/630: dwrite d0/d19/d60/d53/f67 [0,4194304] 0 2024-09-12T22:49:57.753 INFO:tasks.workunit.client.0.smithi066.stdout:6/791: write d6/d59/f77 [325081,63353] 0 2024-09-12T22:49:57.753 INFO:tasks.workunit.client.0.smithi066.stdout:8/735: read - d17/d1b/de7/fe9 zero size 2024-09-12T22:49:57.755 INFO:tasks.workunit.client.0.smithi066.stdout:7/631: chown d0/d19/d24/d33/d27/d70 589059256 1 2024-09-12T22:49:57.755 INFO:tasks.workunit.client.0.smithi066.stdout:7/632: chown d0/d19/d26/d48/l77 7959567 1 2024-09-12T22:49:57.755 INFO:tasks.workunit.client.0.smithi066.stdout:3/725: symlink d0/d2/d1d/d87/d40/d44/d55/d91/lfc 0 2024-09-12T22:49:57.755 INFO:tasks.workunit.client.0.smithi066.stdout:8/736: fdatasync d17/d2c/f34 0 2024-09-12T22:49:57.756 INFO:tasks.workunit.client.0.smithi066.stdout:2/732: creat d1/d11/d26/feb x:0 0 0 2024-09-12T22:49:57.756 INFO:tasks.workunit.client.0.smithi066.stdout:7/633: dread - d0/d19/d60/d85/d8b/fcc zero size 2024-09-12T22:49:57.756 INFO:tasks.workunit.client.0.smithi066.stdout:3/726: creat d0/d2/d1d/d87/d40/da2/ffd x:0 0 0 2024-09-12T22:49:57.756 INFO:tasks.workunit.client.0.smithi066.stdout:7/634: read - d0/d19/d7f/fa2 zero size 2024-09-12T22:49:57.757 INFO:tasks.workunit.client.0.smithi066.stdout:2/733: rename d1/la to d1/dd/d68/lec 0 2024-09-12T22:49:57.757 INFO:tasks.workunit.client.0.smithi066.stdout:8/737: chown d17/d49/d4b/d4e/l84 47966313 1 2024-09-12T22:49:57.758 INFO:tasks.workunit.client.0.smithi066.stdout:4/802: dread d5/d8/d16/ffa [0,4194304] 0 2024-09-12T22:49:57.758 INFO:tasks.workunit.client.0.smithi066.stdout:2/734: read d1/dd/d12/f24 [2665574,27525] 0 2024-09-12T22:49:57.758 INFO:tasks.workunit.client.0.smithi066.stdout:8/738: creat d17/d40/dc4/f103 x:0 0 0 2024-09-12T22:49:57.759 INFO:tasks.workunit.client.0.smithi066.stdout:3/727: dread d0/d2/d7/f5e [0,4194304] 0 2024-09-12T22:49:57.760 INFO:tasks.workunit.client.0.smithi066.stdout:2/735: fsync d1/d11/d26/d4f/d5f/d61/fe8 0 2024-09-12T22:49:57.762 INFO:tasks.workunit.client.0.smithi066.stdout:7/635: dwrite d0/d19/d24/fc7 [0,4194304] 0 2024-09-12T22:49:57.764 INFO:tasks.workunit.client.0.smithi066.stdout:7/636: readlink d0/d19/d60/d53/lae 0 2024-09-12T22:49:57.765 INFO:tasks.workunit.client.0.smithi066.stdout:7/637: rmdir d0/d19/d26/dbe 39 2024-09-12T22:49:57.765 INFO:tasks.workunit.client.0.smithi066.stdout:4/803: dwrite d5/d8/d10/f36 [4194304,4194304] 0 2024-09-12T22:49:57.765 INFO:tasks.workunit.client.0.smithi066.stdout:3/728: dwrite d0/d2/d1d/f2a [0,4194304] 0 2024-09-12T22:49:57.767 INFO:tasks.workunit.client.0.smithi066.stdout:7/638: rmdir d0/d19/d24/d33/d27/d70/d90/db8 39 2024-09-12T22:49:57.768 INFO:tasks.workunit.client.0.smithi066.stdout:3/729: rename d0/d2/d1d/d87/d40/d44/f9c to d0/ffe 0 2024-09-12T22:49:57.769 INFO:tasks.workunit.client.0.smithi066.stdout:3/730: mkdir d0/d2/d1d/d87/d40/dff 0 2024-09-12T22:49:57.769 INFO:tasks.workunit.client.0.smithi066.stdout:5/786: sync 2024-09-12T22:49:57.769 INFO:tasks.workunit.client.0.smithi066.stdout:1/669: sync 2024-09-12T22:49:57.770 INFO:tasks.workunit.client.0.smithi066.stdout:7/639: rename d0/d19/d60/c6f to d0/d19/cd1 0 2024-09-12T22:49:57.770 INFO:tasks.workunit.client.0.smithi066.stdout:5/787: stat d5/d11/d7c/dc3/dc7 0 2024-09-12T22:49:57.770 INFO:tasks.workunit.client.0.smithi066.stdout:3/731: mknod d0/d2/d1d/d87/d40/dd0/c100 0 2024-09-12T22:49:57.772 INFO:tasks.workunit.client.0.smithi066.stdout:7/640: rename d0/d19/fc4 to d0/d19/fd2 0 2024-09-12T22:49:57.773 INFO:tasks.workunit.client.0.smithi066.stdout:5/788: link d5/d11/d23/d6f/daa/dbb/dc6/de1/fd1 d5/d11/d7c/dc3/dc7/ff0 0 2024-09-12T22:49:57.774 INFO:tasks.workunit.client.0.smithi066.stdout:5/789: write d5/d11/d21/f47 [9454757,62879] 0 2024-09-12T22:49:57.775 INFO:tasks.workunit.client.0.smithi066.stdout:1/670: dwrite d0/dc/d1d/f60 [0,4194304] 0 2024-09-12T22:49:57.777 INFO:tasks.workunit.client.0.smithi066.stdout:1/671: mknod d0/ccd 0 2024-09-12T22:49:57.778 INFO:tasks.workunit.client.0.smithi066.stdout:1/672: unlink d0/dc/d1d/c51 0 2024-09-12T22:49:57.779 INFO:tasks.workunit.client.0.smithi066.stdout:1/673: dread - d0/dc/d1e/d95/f6a zero size 2024-09-12T22:49:57.780 INFO:tasks.workunit.client.0.smithi066.stdout:1/674: creat d0/dc0/fce x:0 0 0 2024-09-12T22:49:57.780 INFO:tasks.workunit.client.0.smithi066.stdout:1/675: creat d0/fcf x:0 0 0 2024-09-12T22:49:57.781 INFO:tasks.workunit.client.0.smithi066.stdout:1/676: mkdir d0/dc/d8f/dd0 0 2024-09-12T22:49:57.782 INFO:tasks.workunit.client.0.smithi066.stdout:2/736: truncate d1/d11/d26/d4f/fa5 1231673 0 2024-09-12T22:49:57.782 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:57.781+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:57.783 INFO:tasks.workunit.client.0.smithi066.stdout:1/677: creat d0/dc/d99/fd1 x:0 0 0 2024-09-12T22:49:57.783 INFO:tasks.workunit.client.0.smithi066.stdout:7/641: mknod d0/d19/d60/d85/cd3 0 2024-09-12T22:49:57.784 INFO:tasks.workunit.client.0.smithi066.stdout:2/737: mkdir d1/dd/d12/de2/ded 0 2024-09-12T22:49:57.784 INFO:tasks.workunit.client.0.smithi066.stdout:7/642: dread - d0/d19/d26/d48/f49 zero size 2024-09-12T22:49:57.785 INFO:tasks.workunit.client.0.smithi066.stdout:7/643: creat d0/d19/d60/fd4 x:0 0 0 2024-09-12T22:49:57.787 INFO:tasks.workunit.client.0.smithi066.stdout:7/644: rename d0/d19/d24/d33/f69 to d0/d19/d26/d5a/dc8/fd5 0 2024-09-12T22:49:57.787 INFO:tasks.workunit.client.0.smithi066.stdout:0/715: dread d1/d5b/dba/fd9 [0,4194304] 0 2024-09-12T22:49:57.788 INFO:tasks.workunit.client.0.smithi066.stdout:1/678: dwrite d0/d4e/d79/dc1/f80 [0,4194304] 0 2024-09-12T22:49:57.788 INFO:tasks.workunit.client.0.smithi066.stdout:7/645: write d0/d6/f21 [1129036,35310] 0 2024-09-12T22:49:57.789 INFO:tasks.workunit.client.0.smithi066.stdout:0/716: chown d1/d8/d1f/d25/c54 6134 1 2024-09-12T22:49:57.791 INFO:tasks.workunit.client.0.smithi066.stdout:1/679: symlink d0/dc/d1e/d95/dcb/ld2 0 2024-09-12T22:49:57.791 INFO:tasks.workunit.client.0.smithi066.stdout:2/738: dread d1/dd/f63 [0,4194304] 0 2024-09-12T22:49:57.792 INFO:tasks.workunit.client.0.smithi066.stdout:4/804: dread d5/d8/f78 [0,4194304] 0 2024-09-12T22:49:57.792 INFO:tasks.workunit.client.0.smithi066.stdout:1/680: readlink d0/d4e/l8b 0 2024-09-12T22:49:57.793 INFO:tasks.workunit.client.0.smithi066.stdout:7/646: link d0/d19/d24/d33/d27/d70/ca1 d0/d19/d26/d5a/cd6 0 2024-09-12T22:49:57.793 INFO:tasks.workunit.client.0.smithi066.stdout:2/739: link d1/dd/d12/d18/c5e d1/dd/d12/d1e/cee 0 2024-09-12T22:49:57.794 INFO:tasks.workunit.client.0.smithi066.stdout:1/681: write d0/d4e/d79/d86/f88 [56737,75821] 0 2024-09-12T22:49:57.795 INFO:tasks.workunit.client.0.smithi066.stdout:4/805: write d5/d8/d10/de/d2d/d64/f6c [1743738,103191] 0 2024-09-12T22:49:57.795 INFO:tasks.workunit.client.0.smithi066.stdout:7/647: read d0/d19/d26/d48/f58 [1588470,130103] 0 2024-09-12T22:49:57.795 INFO:tasks.workunit.client.0.smithi066.stdout:0/717: dwrite d1/d8/d1c/f3a [0,4194304] 0 2024-09-12T22:49:57.798 INFO:tasks.workunit.client.0.smithi066.stdout:2/740: getdents d1/d11/d26/d4f/d52/d56 0 2024-09-12T22:49:57.798 INFO:tasks.workunit.client.0.smithi066.stdout:4/806: symlink d5/d8/d10/de/d39/l110 0 2024-09-12T22:49:57.798 INFO:tasks.workunit.client.0.smithi066.stdout:1/682: rename d0/dc/d44/fbc to d0/dc/d1e/d95/dcb/fd3 0 2024-09-12T22:49:57.798 INFO:tasks.workunit.client.0.smithi066.stdout:3/732: write d0/d2/d1d/d87/f8d [282200,47207] 0 2024-09-12T22:49:57.799 INFO:tasks.workunit.client.0.smithi066.stdout:1/683: fdatasync d0/f1c 0 2024-09-12T22:49:57.799 INFO:tasks.workunit.client.0.smithi066.stdout:4/807: mknod d5/d8/d10/c111 0 2024-09-12T22:49:57.800 INFO:tasks.workunit.client.0.smithi066.stdout:0/718: link d1/d8/d1f/d30/lf9 d1/d8/df5/l105 0 2024-09-12T22:49:57.801 INFO:tasks.workunit.client.0.smithi066.stdout:3/733: creat d0/d2/d1d/d87/d40/dbd/d74/f101 x:0 0 0 2024-09-12T22:49:57.801 INFO:tasks.workunit.client.0.smithi066.stdout:1/684: creat d0/dc/d33/fd4 x:0 0 0 2024-09-12T22:49:57.801 INFO:tasks.workunit.client.0.smithi066.stdout:4/808: getdents d5/d8/d10/de/d39/dc6/dec 0 2024-09-12T22:49:57.803 INFO:tasks.workunit.client.0.smithi066.stdout:3/734: rmdir d0/d2/d1d/d87/d40/d44/d55 39 2024-09-12T22:49:57.803 INFO:tasks.workunit.client.0.smithi066.stdout:0/719: rename d1/d8/d1f/f33 to d1/d8/d1c/d56/db7/f106 0 2024-09-12T22:49:57.804 INFO:tasks.workunit.client.0.smithi066.stdout:4/809: creat d5/d8/d10/de/d2d/d64/d9a/dfd/f112 x:0 0 0 2024-09-12T22:49:57.804 INFO:tasks.workunit.client.0.smithi066.stdout:9/748: dread d9/dc/f19 [0,4194304] 0 2024-09-12T22:49:57.808 INFO:tasks.workunit.client.0.smithi066.stdout:9/749: creat d9/d31/d34/ff2 x:0 0 0 2024-09-12T22:49:57.810 INFO:tasks.workunit.client.0.smithi066.stdout:8/739: dread d17/d2c/f35 [0,4194304] 0 2024-09-12T22:49:57.811 INFO:tasks.workunit.client.0.smithi066.stdout:1/685: dwrite d0/dc/d1e/d95/dcb/fd3 [0,4194304] 0 2024-09-12T22:49:57.813 INFO:tasks.workunit.client.0.smithi066.stdout:8/740: read d17/d2c/f32 [604024,51235] 0 2024-09-12T22:49:57.814 INFO:tasks.workunit.client.0.smithi066.stdout:3/735: dwrite d0/d2/d1d/d87/d40/f4d [4194304,4194304] 0 2024-09-12T22:49:57.814 INFO:tasks.workunit.client.0.smithi066.stdout:6/792: dread d6/d23/d41/db6/dd3/df9/f103 [0,4194304] 0 2024-09-12T22:49:57.814 INFO:tasks.workunit.client.0.smithi066.stdout:0/720: truncate d1/d8/d1f/d30/f70 1897189 0 2024-09-12T22:49:57.815 INFO:tasks.workunit.client.0.smithi066.stdout:4/810: dwrite d5/d3e/d8d/dc7/fc9 [0,4194304] 0 2024-09-12T22:49:57.816 INFO:tasks.workunit.client.0.smithi066.stdout:1/686: mkdir d0/dc/d33/dd5 0 2024-09-12T22:49:57.816 INFO:tasks.workunit.client.0.smithi066.stdout:3/736: readlink d0/d2/d1d/d87/d40/da2/lda 0 2024-09-12T22:49:57.817 INFO:tasks.workunit.client.0.smithi066.stdout:8/741: dread - d17/d49/d4b/d57/fee zero size 2024-09-12T22:49:57.818 INFO:tasks.workunit.client.0.smithi066.stdout:7/648: sync 2024-09-12T22:49:57.819 INFO:tasks.workunit.client.0.smithi066.stdout:6/793: mknod d6/d23/d25/c10c 0 2024-09-12T22:49:57.819 INFO:tasks.workunit.client.0.smithi066.stdout:0/721: mkdir d1/d8/d1b/d59/d107 0 2024-09-12T22:49:57.819 INFO:tasks.workunit.client.0.smithi066.stdout:3/737: rmdir d0/d2/d7/d13/d31 39 2024-09-12T22:49:57.820 INFO:tasks.workunit.client.0.smithi066.stdout:5/790: dread d5/d15/f17 [4194304,4194304] 0 2024-09-12T22:49:57.820 INFO:tasks.workunit.client.0.smithi066.stdout:0/722: chown d1/d8/d1f/d25/f71 555320 1 2024-09-12T22:49:57.821 INFO:tasks.workunit.client.0.smithi066.stdout:4/811: chown d5/d8/d16/d93/d9c/d98/d8b/d86/f8e 1537 1 2024-09-12T22:49:57.821 INFO:tasks.workunit.client.0.smithi066.stdout:9/750: dwrite d9/d31/d77/dc2/dcb/fde [0,4194304] 0 2024-09-12T22:49:57.824 INFO:tasks.workunit.client.0.smithi066.stdout:9/751: write d9/dc/d23/f79 [5416870,8998] 0 2024-09-12T22:49:57.824 INFO:tasks.workunit.client.0.smithi066.stdout:2/741: dread d1/dd/d3d/f4a [0,4194304] 0 2024-09-12T22:49:57.824 INFO:tasks.workunit.client.0.smithi066.stdout:7/649: mknod d0/d86/cd7 0 2024-09-12T22:49:57.824 INFO:tasks.workunit.client.0.smithi066.stdout:6/794: creat d6/d23/d25/d2c/d69/f10d x:0 0 0 2024-09-12T22:49:57.824 INFO:tasks.workunit.client.0.smithi066.stdout:0/723: readlink d1/d8/d1f/d30/lf9 0 2024-09-12T22:49:57.825 INFO:tasks.workunit.client.0.smithi066.stdout:7/650: stat d0/d19/d24/d33/d27/f35 0 2024-09-12T22:49:57.825 INFO:tasks.workunit.client.0.smithi066.stdout:0/724: readlink d1/d8/df5/l105 0 2024-09-12T22:49:57.825 INFO:tasks.workunit.client.0.smithi066.stdout:5/791: rename d5/d11/d21/d4d/f6d to d5/d11/d23/d6f/dee/ff1 0 2024-09-12T22:49:57.825 INFO:tasks.workunit.client.0.smithi066.stdout:6/795: fsync d6/d23/f3e 0 2024-09-12T22:49:57.827 INFO:tasks.workunit.client.0.smithi066.stdout:0/725: rmdir d1/d36/d65/dc2 39 2024-09-12T22:49:57.827 INFO:tasks.workunit.client.0.smithi066.stdout:3/738: sync 2024-09-12T22:49:57.827 INFO:tasks.workunit.client.0.smithi066.stdout:9/752: mknod d9/d31/d58/db1/cf3 0 2024-09-12T22:49:57.829 INFO:tasks.workunit.client.0.smithi066.stdout:6/796: chown d6/d23/d41/db6/fda 15429100 1 2024-09-12T22:49:57.829 INFO:tasks.workunit.client.0.smithi066.stdout:0/726: truncate d1/f2a 5086285 0 2024-09-12T22:49:57.829 INFO:tasks.workunit.client.0.smithi066.stdout:6/797: sync 2024-09-12T22:49:57.829 INFO:tasks.workunit.client.0.smithi066.stdout:3/739: rmdir d0/d2/d1d/d87/d40/da2 39 2024-09-12T22:49:57.830 INFO:tasks.workunit.client.0.smithi066.stdout:0/727: mknod d1/c108 0 2024-09-12T22:49:57.830 INFO:tasks.workunit.client.0.smithi066.stdout:6/798: mkdir d6/d59/d10e 0 2024-09-12T22:49:57.830 INFO:tasks.workunit.client.0.smithi066.stdout:3/740: write d0/f38 [743893,107920] 0 2024-09-12T22:49:57.832 INFO:tasks.workunit.client.0.smithi066.stdout:5/792: dwrite d5/d11/d23/d6f/daa/dbb/fe4 [0,4194304] 0 2024-09-12T22:49:57.832 INFO:tasks.workunit.client.0.smithi066.stdout:6/799: write d6/d23/d41/db6/dd3/df9/f103 [1293375,92707] 0 2024-09-12T22:49:57.833 INFO:tasks.workunit.client.0.smithi066.stdout:3/741: write d0/d2/d1d/d87/d6b/db2/fe5 [1114015,52160] 0 2024-09-12T22:49:57.833 INFO:tasks.workunit.client.0.smithi066.stdout:7/651: read d0/d19/d60/f51 [74416,74331] 0 2024-09-12T22:49:57.836 INFO:tasks.workunit.client.0.smithi066.stdout:1/687: truncate d0/d36/d57/f2b 3067332 0 2024-09-12T22:49:57.836 INFO:tasks.workunit.client.0.smithi066.stdout:4/812: truncate d5/d8/d10/de/d2d/d64/f6c 1083922 0 2024-09-12T22:49:57.837 INFO:tasks.workunit.client.0.smithi066.stdout:0/728: rename d1/d8/df5/l105 to d1/d36/d65/dc2/dd7/l109 0 2024-09-12T22:49:57.837 INFO:tasks.workunit.client.0.smithi066.stdout:3/742: symlink d0/d2/d1d/d87/d40/d44/l102 0 2024-09-12T22:49:57.837 INFO:tasks.workunit.client.0.smithi066.stdout:7/652: symlink d0/d19/d26/d5a/dc8/ld8 0 2024-09-12T22:49:57.838 INFO:tasks.workunit.client.0.smithi066.stdout:5/793: creat d5/d11/d5d/d97/ff2 x:0 0 0 2024-09-12T22:49:57.838 INFO:tasks.workunit.client.0.smithi066.stdout:4/813: creat d5/d8/d16/d1b/d72/f113 x:0 0 0 2024-09-12T22:49:57.838 INFO:tasks.workunit.client.0.smithi066.stdout:1/688: truncate d0/d36/d57/f7e 980562 0 2024-09-12T22:49:57.839 INFO:tasks.workunit.client.0.smithi066.stdout:0/729: unlink d1/d8/d1b/f24 0 2024-09-12T22:49:57.839 INFO:tasks.workunit.client.0.smithi066.stdout:7/653: mknod d0/d86/cd9 0 2024-09-12T22:49:57.839 INFO:tasks.workunit.client.0.smithi066.stdout:6/800: dread d6/f17 [0,4194304] 0 2024-09-12T22:49:57.840 INFO:tasks.workunit.client.0.smithi066.stdout:0/730: fdatasync d1/d36/fcb 0 2024-09-12T22:49:57.840 INFO:tasks.workunit.client.0.smithi066.stdout:5/794: fdatasync d5/d11/d21/d4d/fa3 0 2024-09-12T22:49:57.841 INFO:tasks.workunit.client.0.smithi066.stdout:1/689: creat d0/dc/d99/fd6 x:0 0 0 2024-09-12T22:49:57.841 INFO:tasks.workunit.client.0.smithi066.stdout:7/654: creat d0/d19/d26/d5a/fda x:0 0 0 2024-09-12T22:49:57.841 INFO:tasks.workunit.client.0.smithi066.stdout:3/743: creat d0/d2/d7/d13/f103 x:0 0 0 2024-09-12T22:49:57.842 INFO:tasks.workunit.client.0.smithi066.stdout:6/801: symlink d6/d7/l10f 0 2024-09-12T22:49:57.842 INFO:tasks.workunit.client.0.smithi066.stdout:2/742: dwrite d1/dd/d12/f21 [0,4194304] 0 2024-09-12T22:49:57.843 INFO:tasks.workunit.client.0.smithi066.stdout:0/731: write d1/d36/d65/dc2/ffb [948626,25448] 0 2024-09-12T22:49:57.843 INFO:tasks.workunit.client.0.smithi066.stdout:5/795: chown d5/de/d50/d42/d49/f93 19520553 1 2024-09-12T22:49:57.843 INFO:tasks.workunit.client.0.smithi066.stdout:1/690: write d0/d36/d57/f3f [2742010,78946] 0 2024-09-12T22:49:57.844 INFO:tasks.workunit.client.0.smithi066.stdout:3/744: mknod d0/d2/d6/df9/c104 0 2024-09-12T22:49:57.844 INFO:tasks.workunit.client.0.smithi066.stdout:5/796: write d5/d14/f74 [3497633,124364] 0 2024-09-12T22:49:57.844 INFO:tasks.workunit.client.0.smithi066.stdout:0/732: creat d1/d5b/d6d/f10a x:0 0 0 2024-09-12T22:49:57.846 INFO:tasks.workunit.client.0.smithi066.stdout:2/743: creat d1/d11/d26/d4f/d5f/d61/d72/dad/d76/fef x:0 0 0 2024-09-12T22:49:57.847 INFO:tasks.workunit.client.0.smithi066.stdout:3/745: fdatasync d0/d2/d7/dc4/dcf/fb6 0 2024-09-12T22:49:57.848 INFO:tasks.workunit.client.0.smithi066.stdout:1/691: rename d0/dc/d33 to d0/d89/dd7 0 2024-09-12T22:49:57.848 INFO:tasks.workunit.client.0.smithi066.stdout:5/797: write d5/d11/d21/d4d/fa3 [638975,11898] 0 2024-09-12T22:49:57.849 INFO:tasks.workunit.client.0.smithi066.stdout:2/744: chown d1/dd/d12/de2/ded 6 1 2024-09-12T22:49:57.851 INFO:tasks.workunit.client.0.smithi066.stdout:6/802: dwrite d6/d49/f9e [0,4194304] 0 2024-09-12T22:49:57.852 INFO:tasks.workunit.client.0.smithi066.stdout:2/745: creat d1/dc1/ff0 x:0 0 0 2024-09-12T22:49:57.853 INFO:tasks.workunit.client.0.smithi066.stdout:5/798: creat d5/d11/d21/ff3 x:0 0 0 2024-09-12T22:49:57.853 INFO:tasks.workunit.client.0.smithi066.stdout:3/746: mknod d0/d2/d1d/d87/d49/c105 0 2024-09-12T22:49:57.853 INFO:tasks.workunit.client.0.smithi066.stdout:0/733: write d1/d8/d1b/dac/fdd [1058630,70743] 0 2024-09-12T22:49:57.856 INFO:tasks.workunit.client.0.smithi066.stdout:3/747: symlink d0/d2/d1d/l106 0 2024-09-12T22:49:57.857 INFO:tasks.workunit.client.0.smithi066.stdout:8/742: dread d17/d49/d4b/d57/d5e/fc3 [0,4194304] 0 2024-09-12T22:49:57.857 INFO:tasks.workunit.client.0.smithi066.stdout:4/814: dwrite d5/d8/d16/d93/fbb [0,4194304] 0 2024-09-12T22:49:57.857 INFO:tasks.workunit.client.0.smithi066.stdout:9/753: dread d9/d31/d58/dbc/f66 [0,4194304] 0 2024-09-12T22:49:57.857 INFO:tasks.workunit.client.0.smithi066.stdout:6/803: mknod d6/d78/d4a/c110 0 2024-09-12T22:49:57.858 INFO:tasks.workunit.client.0.smithi066.stdout:2/746: chown d1/d44/d51/d70/l73 50240729 1 2024-09-12T22:49:57.860 INFO:tasks.workunit.client.0.smithi066.stdout:6/804: unlink d6/d23/d25/c71 0 2024-09-12T22:49:57.860 INFO:tasks.workunit.client.0.smithi066.stdout:7/655: dwrite d0/d19/d24/d33/d27/d70/d90/fa5 [0,4194304] 0 2024-09-12T22:49:57.863 INFO:tasks.workunit.client.0.smithi066.stdout:8/743: mknod d17/d40/d47/d81/c104 0 2024-09-12T22:49:57.863 INFO:tasks.workunit.client.0.smithi066.stdout:0/734: write d1/d8/d1c/d13/f23 [41901,48665] 0 2024-09-12T22:49:57.863 INFO:tasks.workunit.client.0.smithi066.stdout:1/692: dwrite d0/d36/d57/f7e [0,4194304] 0 2024-09-12T22:49:57.863 INFO:tasks.workunit.client.0.smithi066.stdout:4/815: getdents d5/d3e/d8d/dce/dca 0 2024-09-12T22:49:57.865 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:57.865 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:49:57.865 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:49:57.865 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:49:57.865 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:57.866 INFO:tasks.workunit.client.0.smithi066.stdout:2/747: symlink d1/d11/d26/d4f/d5f/d61/d72/dad/d76/db7/lf1 0 2024-09-12T22:49:57.866 INFO:tasks.workunit.client.0.smithi066.stdout:8/744: truncate d17/d40/da8/fb1 512931 0 2024-09-12T22:49:57.866 INFO:tasks.workunit.client.0.smithi066.stdout:2/748: rmdir d1/d44 39 2024-09-12T22:49:57.866 INFO:tasks.workunit.client.0.smithi066.stdout:5/799: dwrite d5/d11/d23/d6f/fc5 [0,4194304] 0 2024-09-12T22:49:57.866 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:49:57.867 INFO:tasks.workunit.client.0.smithi066.stdout:1/693: mknod d0/dc/d8f/dd0/cd8 0 2024-09-12T22:49:57.867 INFO:tasks.workunit.client.0.smithi066.stdout:0/735: stat d1/d8/d1c/d13/d2f/d8a/de1/ff1 0 2024-09-12T22:49:57.868 INFO:tasks.workunit.client.0.smithi066.stdout:4/816: mkdir d5/d8/d10/de/d2d/d64/d104/d114 0 2024-09-12T22:49:57.871 INFO:tasks.workunit.client.0.smithi066.stdout:8/745: chown d17/d40/d47/d66/f6e 15 1 2024-09-12T22:49:57.871 INFO:tasks.workunit.client.0.smithi066.stdout:0/736: fdatasync d1/d8/d1b/d59/faf 0 2024-09-12T22:49:57.871 INFO:tasks.workunit.client.0.smithi066.stdout:7/656: link d0/d19/d60/d53/lae d0/d19/d24/d33/d27/dba/ldb 0 2024-09-12T22:49:57.871 INFO:tasks.workunit.client.0.smithi066.stdout:1/694: mkdir d0/d4e/d79/d94/d9a/dd9 0 2024-09-12T22:49:57.872 INFO:tasks.workunit.client.0.smithi066.stdout:9/754: dwrite d9/dc/dd/f65 [0,4194304] 0 2024-09-12T22:49:57.873 INFO:tasks.workunit.client.0.smithi066.stdout:8/746: stat d17/d49/d4b/d57/d5e/d65/ldb 0 2024-09-12T22:49:57.875 INFO:tasks.workunit.client.0.smithi066.stdout:7/657: symlink d0/d19/ldc 0 2024-09-12T22:49:57.875 INFO:tasks.workunit.client.0.smithi066.stdout:0/737: truncate d1/d8/d1b/d88/f100 206143 0 2024-09-12T22:49:57.875 INFO:tasks.workunit.client.0.smithi066.stdout:8/747: symlink d17/d40/d47/l105 0 2024-09-12T22:49:57.876 INFO:tasks.workunit.client.0.smithi066.stdout:6/805: sync 2024-09-12T22:49:57.877 INFO:tasks.workunit.client.0.smithi066.stdout:1/695: write d0/d36/d57/d81/fbf [1034248,44274] 0 2024-09-12T22:49:57.877 INFO:tasks.workunit.client.0.smithi066.stdout:9/755: rmdir d9/df0/d8c 39 2024-09-12T22:49:57.877 INFO:tasks.workunit.client.0.smithi066.stdout:5/800: dwrite d5/d11/d5d/d97/ff2 [0,4194304] 0 2024-09-12T22:49:57.878 INFO:tasks.workunit.client.0.smithi066.stdout:6/806: write d6/d23/d25/f2e [114945,33487] 0 2024-09-12T22:49:57.880 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:57.882 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:57.880+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:57.882 INFO:tasks.workunit.client.0.smithi066.stdout:7/658: mknod d0/d19/d26/d48/cdd 0 2024-09-12T22:49:57.883 INFO:tasks.workunit.client.0.smithi066.stdout:4/817: dwrite d5/d8/d16/d1b/d1e/f10b [0,4194304] 0 2024-09-12T22:49:57.883 INFO:tasks.workunit.client.0.smithi066.stdout:5/801: write d5/d11/d7c/dc3/dc7/fe3 [457337,47420] 0 2024-09-12T22:49:57.883 INFO:tasks.workunit.client.0.smithi066.stdout:8/748: creat d17/d49/d4b/d4e/daf/dcb/de2/f106 x:0 0 0 2024-09-12T22:49:57.884 INFO:tasks.workunit.client.0.smithi066.stdout:5/802: write f3 [12123191,125473] 0 2024-09-12T22:49:57.884 INFO:tasks.workunit.client.0.smithi066.stdout:1/696: dread d0/dc/d44/f77 [0,4194304] 0 2024-09-12T22:49:57.886 INFO:tasks.workunit.client.0.smithi066.stdout:0/738: dwrite d1/d8/d1f/d25/f71 [0,4194304] 0 2024-09-12T22:49:57.888 INFO:tasks.workunit.client.0.smithi066.stdout:9/756: rename d9/dc/l99 to d9/d31/d58/dbc/lf4 0 2024-09-12T22:49:57.889 INFO:tasks.workunit.client.0.smithi066.stdout:1/697: readlink d0/d4e/l8b 0 2024-09-12T22:49:57.890 INFO:tasks.workunit.client.0.smithi066.stdout:1/698: write d0/dc/d1e/d95/f6a [426732,27704] 0 2024-09-12T22:49:57.891 INFO:tasks.workunit.client.0.smithi066.stdout:5/803: read d5/d11/f43 [4891624,80120] 0 2024-09-12T22:49:57.892 INFO:tasks.workunit.client.0.smithi066.stdout:7/659: getdents d0/d19/d26/d48 0 2024-09-12T22:49:57.893 INFO:tasks.workunit.client.0.smithi066.stdout:6/807: truncate d6/d23/f5e 4484026 0 2024-09-12T22:49:57.893 INFO:tasks.workunit.client.0.smithi066.stdout:8/749: creat d17/d40/d47/d4d/df0/df3/f107 x:0 0 0 2024-09-12T22:49:57.893 INFO:tasks.workunit.client.0.smithi066.stdout:1/699: symlink d0/d36/d57/d81/lda 0 2024-09-12T22:49:57.894 INFO:tasks.workunit.client.0.smithi066.stdout:5/804: rename d5/de/cbe to d5/d11/d5d/d8a/cf4 0 2024-09-12T22:49:57.894 INFO:tasks.workunit.client.0.smithi066.stdout:5/805: write d5/d14/fe9 [815332,3013] 0 2024-09-12T22:49:57.895 INFO:tasks.workunit.client.0.smithi066.stdout:6/808: creat d6/d7/d66/f111 x:0 0 0 2024-09-12T22:49:57.895 INFO:tasks.workunit.client.0.smithi066.stdout:7/660: chown d0/d19/d24/d33/d27/l4e 496744 1 2024-09-12T22:49:57.896 INFO:tasks.workunit.client.0.smithi066.stdout:1/700: creat d0/dc/fdb x:0 0 0 2024-09-12T22:49:57.896 INFO:tasks.workunit.client.0.smithi066.stdout:5/806: dread - d5/de/d50/d42/d9d/fc4 zero size 2024-09-12T22:49:57.896 INFO:tasks.workunit.client.0.smithi066.stdout:8/750: chown d17/d40/d74/da3/df1/lf5 5 1 2024-09-12T22:49:57.897 INFO:tasks.workunit.client.0.smithi066.stdout:0/739: dwrite d1/d8/d1c/d13/d2f/dd8/f77 [0,4194304] 0 2024-09-12T22:49:57.897 INFO:tasks.workunit.client.0.smithi066.stdout:6/809: dread - d6/d23/d25/f7b zero size 2024-09-12T22:49:57.898 INFO:tasks.workunit.client.0.smithi066.stdout:1/701: creat d0/dc/d1e/d95/dcb/fdc x:0 0 0 2024-09-12T22:49:57.898 INFO:tasks.workunit.client.0.smithi066.stdout:5/807: creat d5/de/ff5 x:0 0 0 2024-09-12T22:49:57.899 INFO:tasks.workunit.client.0.smithi066.stdout:8/751: truncate d17/d40/d47/d4d/f93 100216 0 2024-09-12T22:49:57.899 INFO:tasks.workunit.client.0.smithi066.stdout:5/808: dread - d5/d11/d7c/fc0 zero size 2024-09-12T22:49:57.900 INFO:tasks.workunit.client.0.smithi066.stdout:6/810: getdents d6/d23 0 2024-09-12T22:49:57.900 INFO:tasks.workunit.client.0.smithi066.stdout:0/740: rename d1/d36/fd2 to d1/d8/f10b 0 2024-09-12T22:49:57.901 INFO:tasks.workunit.client.0.smithi066.stdout:1/702: link d0/d36/d57/c78 d0/cdd 0 2024-09-12T22:49:57.901 INFO:tasks.workunit.client.0.smithi066.stdout:5/809: write f4 [1488546,130608] 0 2024-09-12T22:49:57.902 INFO:tasks.workunit.client.0.smithi066.stdout:6/811: mknod d6/d7/c112 0 2024-09-12T22:49:57.903 INFO:tasks.workunit.client.0.smithi066.stdout:1/703: symlink d0/d36/d57/d81/lde 0 2024-09-12T22:49:57.903 INFO:tasks.workunit.client.0.smithi066.stdout:5/810: truncate d5/de/d50/d42/d49/fdc 630196 0 2024-09-12T22:49:57.903 INFO:tasks.workunit.client.0.smithi066.stdout:8/752: mknod d17/d40/d47/d4d/df0/df3/c108 0 2024-09-12T22:49:57.903 INFO:tasks.workunit.client.0.smithi066.stdout:6/812: creat d6/d51/f113 x:0 0 0 2024-09-12T22:49:57.904 INFO:tasks.workunit.client.0.smithi066.stdout:7/661: write d0/f4b [2658747,38727] 0 2024-09-12T22:49:57.905 INFO:tasks.workunit.client.0.smithi066.stdout:1/704: chown d0/d89/dd7/c73 2 1 2024-09-12T22:49:57.905 INFO:tasks.workunit.client.0.smithi066.stdout:6/813: mknod d6/d23/d25/c114 0 2024-09-12T22:49:57.907 INFO:tasks.workunit.client.0.smithi066.stdout:0/741: dwrite d1/d8/d1c/fa9 [0,4194304] 0 2024-09-12T22:49:57.908 INFO:tasks.workunit.client.0.smithi066.stdout:6/814: write d6/d23/d25/d4e/dc4/d32/dce/fee [1011575,88826] 0 2024-09-12T22:49:57.908 INFO:tasks.workunit.client.0.smithi066.stdout:1/705: dread - d0/dc/d1e/fbb zero size 2024-09-12T22:49:57.909 INFO:tasks.workunit.client.0.smithi066.stdout:8/753: getdents d17/d49/d4b 0 2024-09-12T22:49:57.909 INFO:tasks.workunit.client.0.smithi066.stdout:7/662: creat d0/d19/d24/d33/d27/d70/fde x:0 0 0 2024-09-12T22:49:57.910 INFO:tasks.workunit.client.0.smithi066.stdout:6/815: fsync d6/f2a 0 2024-09-12T22:49:57.910 INFO:tasks.workunit.client.0.smithi066.stdout:1/706: symlink d0/d4e/d79/d94/ldf 0 2024-09-12T22:49:57.911 INFO:tasks.workunit.client.0.smithi066.stdout:8/754: write d17/d2c/f34 [2780041,65863] 0 2024-09-12T22:49:57.911 INFO:tasks.workunit.client.0.smithi066.stdout:0/742: write d1/d8/d1c/d56/db7/ff6 [834061,107245] 0 2024-09-12T22:49:57.911 INFO:tasks.workunit.client.0.smithi066.stdout:7/663: write d0/d19/d26/fad [3759492,121512] 0 2024-09-12T22:49:57.912 INFO:tasks.workunit.client.0.smithi066.stdout:3/748: dread d0/d2/d1d/d87/d6b/f80 [0,4194304] 0 2024-09-12T22:49:57.913 INFO:tasks.workunit.client.0.smithi066.stdout:8/755: mkdir d17/d49/d4b/d57/d5e/d62/d109 0 2024-09-12T22:49:57.913 INFO:tasks.workunit.client.0.smithi066.stdout:1/707: mkdir d0/d89/dd7/dd5/de0 0 2024-09-12T22:49:57.914 INFO:tasks.workunit.client.0.smithi066.stdout:0/743: chown d1/d8/d1c/d13/d2f/d8a/le3 11972 1 2024-09-12T22:49:57.915 INFO:tasks.workunit.client.0.smithi066.stdout:8/756: rmdir d17/d40/d47/d4d/d87 39 2024-09-12T22:49:57.916 INFO:tasks.workunit.client.0.smithi066.stdout:1/708: write d0/dc/f22 [1716789,76581] 0 2024-09-12T22:49:57.916 INFO:tasks.workunit.client.0.smithi066.stdout:0/744: readlink d1/d8/d1b/d88/lc7 0 2024-09-12T22:49:57.916 INFO:tasks.workunit.client.0.smithi066.stdout:3/749: write d0/d2/d1d/d87/d6b/db2/fe5 [216031,368] 0 2024-09-12T22:49:57.919 INFO:tasks.workunit.client.0.smithi066.stdout:6/816: dwrite d6/d7/feb [0,4194304] 0 2024-09-12T22:49:57.919 INFO:tasks.workunit.client.0.smithi066.stdout:0/745: chown d1/d8/d1c/d13/d2f/d8a/f90 146 1 2024-09-12T22:49:57.921 INFO:tasks.workunit.client.0.smithi066.stdout:7/664: dwrite d0/d19/d24/fc7 [0,4194304] 0 2024-09-12T22:49:57.923 INFO:tasks.workunit.client.0.smithi066.stdout:0/746: write d1/d8/f35 [554203,4313] 0 2024-09-12T22:49:57.924 INFO:tasks.workunit.client.0.smithi066.stdout:2/749: dread d1/d11/d26/d4f/d5f/d61/d7e/f48 [0,4194304] 0 2024-09-12T22:49:57.924 INFO:tasks.workunit.client.0.smithi066.stdout:3/750: truncate d0/d2/d1d/d87/d40/d44/fe8 75811 0 2024-09-12T22:49:57.925 INFO:tasks.workunit.client.0.smithi066.stdout:5/811: dwrite d5/d11/d23/d6f/dee/ff1 [0,4194304] 0 2024-09-12T22:49:57.927 INFO:tasks.workunit.client.0.smithi066.stdout:5/812: chown d5/d14/fe9 14924 1 2024-09-12T22:49:57.927 INFO:tasks.workunit.client.0.smithi066.stdout:8/757: rename d17/d40/d47/d4d/df0/df3/c108 to d17/d40/c10a 0 2024-09-12T22:49:57.929 INFO:tasks.workunit.client.0.smithi066.stdout:5/813: chown d5/d11/f1b 133 1 2024-09-12T22:49:57.929 INFO:tasks.workunit.client.0.smithi066.stdout:0/747: getdents d1/d8/d1c 0 2024-09-12T22:49:57.929 INFO:tasks.workunit.client.0.smithi066.stdout:7/665: rename d0/d19/d24/l42 to d0/d19/d26/d48/dc3/ldf 0 2024-09-12T22:49:57.933 INFO:tasks.workunit.client.0.smithi066.stdout:0/748: read d1/d36/f79 [46904,56147] 0 2024-09-12T22:49:57.934 INFO:tasks.workunit.client.0.smithi066.stdout:2/750: dwrite d1/d11/f98 [0,4194304] 0 2024-09-12T22:49:57.935 INFO:tasks.workunit.client.0.smithi066.stdout:4/818: sync 2024-09-12T22:49:57.935 INFO:tasks.workunit.client.0.smithi066.stdout:3/751: dwrite d0/d2/d7/d29/fcd [0,4194304] 0 2024-09-12T22:49:57.936 INFO:tasks.workunit.client.0.smithi066.stdout:8/758: dread d17/d40/d74/d99/f9d [0,4194304] 0 2024-09-12T22:49:57.936 INFO:tasks.workunit.client.0.smithi066.stdout:7/666: getdents d0 0 2024-09-12T22:49:57.936 INFO:tasks.workunit.client.0.smithi066.stdout:3/752: readlink d0/d2/l22 0 2024-09-12T22:49:57.937 INFO:tasks.workunit.client.0.smithi066.stdout:8/759: chown d17/d2c/dab/df2/l101 1 1 2024-09-12T22:49:57.937 INFO:tasks.workunit.client.0.smithi066.stdout:5/814: rename d5/d11/d23/d6f/cde to d5/d11/d7c/d98/cf6 0 2024-09-12T22:49:57.938 INFO:tasks.workunit.client.0.smithi066.stdout:4/819: readlink d5/d8/d16/d93/d9c/d98/ddc/lf8 0 2024-09-12T22:49:57.938 INFO:tasks.workunit.client.0.smithi066.stdout:8/760: chown d17/d49 1773557 1 2024-09-12T22:49:57.938 INFO:tasks.workunit.client.0.smithi066.stdout:1/709: dread d0/d4e/f5a [0,4194304] 0 2024-09-12T22:49:57.939 INFO:tasks.workunit.client.0.smithi066.stdout:3/753: readlink d0/d2/d1d/l106 0 2024-09-12T22:49:57.939 INFO:tasks.workunit.client.0.smithi066.stdout:2/751: mkdir d1/d11/d26/d8f/df2 0 2024-09-12T22:49:57.940 INFO:tasks.workunit.client.0.smithi066.stdout:5/815: mknod d5/d11/d23/d6f/cf7 0 2024-09-12T22:49:57.941 INFO:tasks.workunit.client.0.smithi066.stdout:8/761: fdatasync d17/d49/d4b/d4e/daf/dcb/de2/f106 0 2024-09-12T22:49:57.942 INFO:tasks.workunit.client.0.smithi066.stdout:0/749: getdents d1/d8/d1c/d13/d2f/d8a/de1 0 2024-09-12T22:49:57.943 INFO:tasks.workunit.client.0.smithi066.stdout:9/757: dread d9/d31/d58/f82 [0,4194304] 0 2024-09-12T22:49:57.944 INFO:tasks.workunit.client.0.smithi066.stdout:3/754: creat d0/d2/d1d/d87/d40/d44/d55/d91/dcb/f107 x:0 0 0 2024-09-12T22:49:57.944 INFO:tasks.workunit.client.0.smithi066.stdout:5/816: write d5/d11/d21/d4d/fc2 [1034906,9425] 0 2024-09-12T22:49:57.945 INFO:tasks.workunit.client.0.smithi066.stdout:2/752: dwrite d1/d44/d51/d70/fc6 [0,4194304] 0 2024-09-12T22:49:57.946 INFO:tasks.workunit.client.0.smithi066.stdout:5/817: dread - d5/d11/d5d/d8a/fbd zero size 2024-09-12T22:49:57.947 INFO:tasks.workunit.client.0.smithi066.stdout:2/753: chown d1/d11/d26/d4f/d5f/d61/d7e/l96 699 1 2024-09-12T22:49:57.947 INFO:tasks.workunit.client.0.smithi066.stdout:1/710: dwrite d0/d4e/f5a [0,4194304] 0 2024-09-12T22:49:57.951 INFO:tasks.workunit.client.0.smithi066.stdout:0/750: chown d1/d8/d1f/d30/lf9 58424 1 2024-09-12T22:49:57.953 INFO:tasks.workunit.client.0.smithi066.stdout:5/818: unlink d5/de/d57/cd4 0 2024-09-12T22:49:57.953 INFO:tasks.workunit.client.0.smithi066.stdout:2/754: rename d1/dd to d1/d44/df3 0 2024-09-12T22:49:57.954 INFO:tasks.workunit.client.0.smithi066.stdout:9/758: rmdir d9/d31/d58/dbc/da8 39 2024-09-12T22:49:57.954 INFO:tasks.workunit.client.0.smithi066.stdout:0/751: creat d1/d36/d65/dc2/dd7/f10c x:0 0 0 2024-09-12T22:49:57.954 INFO:tasks.workunit.client.0.smithi066.stdout:5/819: readlink d5/d11/l86 0 2024-09-12T22:49:57.955 INFO:tasks.workunit.client.0.smithi066.stdout:1/711: link d0/dc/l1a d0/d4e/d79/d94/le1 0 2024-09-12T22:49:57.955 INFO:tasks.workunit.client.0.smithi066.stdout:8/762: getdents d17/d49/d4b/d4e 0 2024-09-12T22:49:57.955 INFO:tasks.workunit.client.0.smithi066.stdout:5/820: readlink d5/d15/l5e 0 2024-09-12T22:49:57.956 INFO:tasks.workunit.client.0.smithi066.stdout:0/752: symlink d1/d8/d1c/d56/l10d 0 2024-09-12T22:49:57.957 INFO:tasks.workunit.client.0.smithi066.stdout:0/753: stat d1/d8/d1b/d88/la5 0 2024-09-12T22:49:57.957 INFO:tasks.workunit.client.0.smithi066.stdout:2/755: truncate d1/d11/d26/d4f/fa5 2190626 0 2024-09-12T22:49:57.958 INFO:tasks.workunit.client.0.smithi066.stdout:5/821: link d5/d15/db9/cd2 d5/de/d57/cf8 0 2024-09-12T22:49:57.958 INFO:tasks.workunit.client.0.smithi066.stdout:1/712: creat d0/dc/d1e/d95/dcb/fe2 x:0 0 0 2024-09-12T22:49:57.958 INFO:tasks.workunit.client.0.smithi066.stdout:0/754: chown d1/dbf 0 1 2024-09-12T22:49:57.959 INFO:tasks.workunit.client.0.smithi066.stdout:1/713: mknod d0/dc0/ce3 0 2024-09-12T22:49:57.959 INFO:tasks.workunit.client.0.smithi066.stdout:0/755: symlink d1/d8/df5/l10e 0 2024-09-12T22:49:57.960 INFO:tasks.workunit.client.0.smithi066.stdout:2/756: mkdir d1/d11/d26/d4f/d5f/d61/d7e/df4 0 2024-09-12T22:49:57.960 INFO:tasks.workunit.client.0.smithi066.stdout:5/822: creat d5/d11/d7c/dc3/dc7/ff9 x:0 0 0 2024-09-12T22:49:57.961 INFO:tasks.workunit.client.0.smithi066.stdout:1/714: write d0/dc/d1d/fae [85620,61323] 0 2024-09-12T22:49:57.961 INFO:tasks.workunit.client.0.smithi066.stdout:2/757: chown d1/d11/d26/d4f/d7c/da6 63331 1 2024-09-12T22:49:57.962 INFO:tasks.workunit.client.0.smithi066.stdout:8/763: dwrite d17/d1b/de7/dea/fc0 [0,4194304] 0 2024-09-12T22:49:57.962 INFO:tasks.workunit.client.0.smithi066.stdout:5/823: symlink d5/de/d50/da0/lfa 0 2024-09-12T22:49:57.964 INFO:tasks.workunit.client.0.smithi066.stdout:0/756: unlink d1/d8/d1b/dac/fad 0 2024-09-12T22:49:57.965 INFO:tasks.workunit.client.0.smithi066.stdout:3/755: dread d0/d2/d1d/d87/d40/d44/d55/d91/fb0 [0,4194304] 0 2024-09-12T22:49:57.966 INFO:tasks.workunit.client.0.smithi066.stdout:5/824: creat d5/de/d50/d42/d49/ffb x:0 0 0 2024-09-12T22:49:57.966 INFO:tasks.workunit.client.0.smithi066.stdout:8/764: unlink d17/d40/d74/da3/la4 0 2024-09-12T22:49:57.966 INFO:tasks.workunit.client.0.smithi066.stdout:0/757: creat d1/d36/de6/f10f x:0 0 0 2024-09-12T22:49:57.966 INFO:tasks.workunit.client.0.smithi066.stdout:8/765: readlink d17/d40/d74/da3/ld2 0 2024-09-12T22:49:57.966 INFO:tasks.workunit.client.0.smithi066.stdout:3/756: stat d0/c12 0 2024-09-12T22:49:57.967 INFO:tasks.workunit.client.0.smithi066.stdout:5/825: creat d5/d15/ffc x:0 0 0 2024-09-12T22:49:57.967 INFO:tasks.workunit.client.0.smithi066.stdout:7/667: dread d0/d19/d26/f47 [0,4194304] 0 2024-09-12T22:49:57.968 INFO:tasks.workunit.client.0.smithi066.stdout:0/758: creat d1/d36/d65/de9/f110 x:0 0 0 2024-09-12T22:49:57.970 INFO:tasks.workunit.client.0.smithi066.stdout:0/759: write d1/d8/d1f/d25/f71 [1399063,91716] 0 2024-09-12T22:49:57.971 INFO:tasks.workunit.client.0.smithi066.stdout:5/826: stat d5/d11/d5d/d8a/cf4 0 2024-09-12T22:49:57.971 INFO:tasks.workunit.client.0.smithi066.stdout:8/766: rmdir d17/d49/d4b/d57/d5e/d62/dc6 0 2024-09-12T22:49:57.971 INFO:tasks.workunit.client.0.smithi066.stdout:9/759: truncate d9/dc/f38 2919677 0 2024-09-12T22:49:57.973 INFO:tasks.workunit.client.0.smithi066.stdout:2/758: getdents d1/d11/d26/d4f/d5f/d61/d7e 0 2024-09-12T22:49:57.973 INFO:tasks.workunit.client.0.smithi066.stdout:0/760: symlink d1/d8/d1f/l111 0 2024-09-12T22:49:57.973 INFO:tasks.workunit.client.0.smithi066.stdout:9/760: symlink d9/d31/d58/dbc/d9d/lf5 0 2024-09-12T22:49:57.973 INFO:tasks.workunit.client.0.smithi066.stdout:1/715: write d0/f1c [1951827,47250] 0 2024-09-12T22:49:57.974 INFO:tasks.workunit.client.0.smithi066.stdout:5/827: mknod d5/de/d50/d42/d9d/cfd 0 2024-09-12T22:49:57.975 INFO:tasks.workunit.client.0.smithi066.stdout:0/761: readlink d1/l6a 0 2024-09-12T22:49:57.975 INFO:tasks.workunit.client.0.smithi066.stdout:2/759: stat d1/d44/df3/d12/d1e/c41 0 2024-09-12T22:49:57.976 INFO:tasks.workunit.client.0.smithi066.stdout:6/817: dread d6/d35/fe4 [0,4194304] 0 2024-09-12T22:49:57.976 INFO:tasks.workunit.client.0.smithi066.stdout:9/761: chown d9/d31/d77/lbd 17 1 2024-09-12T22:49:57.977 INFO:tasks.workunit.client.0.smithi066.stdout:5/828: chown d5/d11/d21/f7f 73061 1 2024-09-12T22:49:57.979 INFO:tasks.workunit.client.0.smithi066.stdout:9/762: mkdir d9/dc6/df6 0 2024-09-12T22:49:57.980 INFO:tasks.workunit.client.0.smithi066.stdout:7/668: dread d0/d19/d24/fa0 [0,4194304] 0 2024-09-12T22:49:57.980 INFO:tasks.workunit.client.0.smithi066.stdout:1/716: rename d0/d89/dd7/f96 to d0/dc/d1e/d47/fe4 0 2024-09-12T22:49:57.980 INFO:tasks.workunit.client.0.smithi066.stdout:0/762: write d1/d8/d1b/d59/faf [4839698,30366] 0 2024-09-12T22:49:57.980 INFO:tasks.workunit.client.0.smithi066.stdout:5/829: write d5/d15/ffc [189065,67184] 0 2024-09-12T22:49:57.981 INFO:tasks.workunit.client.0.smithi066.stdout:8/767: dwrite d17/d1b/de7/dea/fc0 [4194304,4194304] 0 2024-09-12T22:49:57.981 INFO:tasks.workunit.client.0.smithi066.stdout:2/760: mkdir d1/d11/d26/d4f/d5f/d61/d72/dad/df5 0 2024-09-12T22:49:57.982 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:57.981+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:57.982 INFO:tasks.workunit.client.0.smithi066.stdout:3/757: dwrite d0/d2/d1d/d87/d40/d44/d55/d91/fb0 [0,4194304] 0 2024-09-12T22:49:57.983 INFO:tasks.workunit.client.0.smithi066.stdout:1/717: symlink d0/le5 0 2024-09-12T22:49:57.984 INFO:tasks.workunit.client.0.smithi066.stdout:0/763: truncate d1/d8/d1f/f6c 4596191 0 2024-09-12T22:49:57.986 INFO:tasks.workunit.client.0.smithi066.stdout:4/820: dread d5/d8/d16/d1b/d1e/d5a/f85 [0,4194304] 0 2024-09-12T22:49:57.987 INFO:tasks.workunit.client.0.smithi066.stdout:8/768: rmdir d17/d49/d4b/d57/d5e/d62 39 2024-09-12T22:49:57.987 INFO:tasks.workunit.client.0.smithi066.stdout:5/830: symlink d5/d11/d7c/dc3/dc7/lfe 0 2024-09-12T22:49:57.987 INFO:tasks.workunit.client.0.smithi066.stdout:9/763: fsync d9/d31/d77/d8f/fb3 0 2024-09-12T22:49:57.988 INFO:tasks.workunit.client.0.smithi066.stdout:7/669: link d0/d19/d60/d53/ca6 d0/d19/d7f/ce0 0 2024-09-12T22:49:57.988 INFO:tasks.workunit.client.0.smithi066.stdout:6/818: getdents d6/d23/d25/d4e/dc4/d50/dd6 0 2024-09-12T22:49:57.988 INFO:tasks.workunit.client.0.smithi066.stdout:0/764: dread - d1/d8/d1c/d56/db7/fdb zero size 2024-09-12T22:49:57.989 INFO:tasks.workunit.client.0.smithi066.stdout:5/831: readlink d5/d11/d23/l2d 0 2024-09-12T22:49:57.989 INFO:tasks.workunit.client.0.smithi066.stdout:2/761: getdents d1/d11 0 2024-09-12T22:49:57.989 INFO:tasks.workunit.client.0.smithi066.stdout:4/821: chown d5/d8/d16/d93/d9c/d98/ddc/df1 3365 1 2024-09-12T22:49:57.990 INFO:tasks.workunit.client.0.smithi066.stdout:6/819: readlink d6/d7/dc/l19 0 2024-09-12T22:49:57.991 INFO:tasks.workunit.client.0.smithi066.stdout:7/670: truncate d0/d19/d60/fd4 594540 0 2024-09-12T22:49:57.991 INFO:tasks.workunit.client.0.smithi066.stdout:1/718: truncate d0/f64 2740832 0 2024-09-12T22:49:57.991 INFO:tasks.workunit.client.0.smithi066.stdout:4/822: stat d5/d87/c10c 0 2024-09-12T22:49:57.992 INFO:tasks.workunit.client.0.smithi066.stdout:0/765: symlink d1/d8/d1f/d30/l112 0 2024-09-12T22:49:57.992 INFO:tasks.workunit.client.0.smithi066.stdout:8/769: mknod d17/d49/d4b/d57/d5e/d65/d91/c10b 0 2024-09-12T22:49:57.992 INFO:tasks.workunit.client.0.smithi066.stdout:6/820: symlink d6/d59/df3/l115 0 2024-09-12T22:49:57.993 INFO:tasks.workunit.client.0.smithi066.stdout:9/764: creat d9/df0/d8c/de2/ff7 x:0 0 0 2024-09-12T22:49:57.993 INFO:tasks.workunit.client.0.smithi066.stdout:1/719: creat d0/d89/fe6 x:0 0 0 2024-09-12T22:49:57.993 INFO:tasks.workunit.client.0.smithi066.stdout:5/832: creat d5/d11/d21/d4d/fff x:0 0 0 2024-09-12T22:49:57.993 INFO:tasks.workunit.client.0.smithi066.stdout:7/671: symlink d0/d6/le1 0 2024-09-12T22:49:57.994 INFO:tasks.workunit.client.0.smithi066.stdout:2/762: link d1/d11/f98 d1/d11/d26/d4f/d5f/d61/d72/ff6 0 2024-09-12T22:49:57.994 INFO:tasks.workunit.client.0.smithi066.stdout:8/770: write d17/d40/d47/f8e [4417819,108261] 0 2024-09-12T22:49:57.995 INFO:tasks.workunit.client.0.smithi066.stdout:1/720: creat d0/dc/d8f/fe7 x:0 0 0 2024-09-12T22:49:57.995 INFO:tasks.workunit.client.0.smithi066.stdout:4/823: symlink d5/d8/d10/de/d2d/l115 0 2024-09-12T22:49:57.996 INFO:tasks.workunit.client.0.smithi066.stdout:3/758: dwrite d0/d2/d1d/d87/d40/d44/d55/d91/dcb/f107 [0,4194304] 0 2024-09-12T22:49:57.996 INFO:tasks.workunit.client.0.smithi066.stdout:5/833: creat d5/d11/d23/d6f/dee/f100 x:0 0 0 2024-09-12T22:49:57.998 INFO:tasks.workunit.client.0.smithi066.stdout:7/672: dread - d0/d19/d26/d48/f9e zero size 2024-09-12T22:49:57.999 INFO:tasks.workunit.client.0.smithi066.stdout:3/759: dread - d0/db3/db7/fd6 zero size 2024-09-12T22:49:57.999 INFO:tasks.workunit.client.0.smithi066.stdout:1/721: write d0/dc0/fce [645265,84341] 0 2024-09-12T22:49:58.000 INFO:tasks.workunit.client.0.smithi066.stdout:5/834: write d5/d11/f58 [5199760,106101] 0 2024-09-12T22:49:58.000 INFO:tasks.workunit.client.0.smithi066.stdout:6/821: creat d6/d23/d25/d4e/dc4/d32/f116 x:0 0 0 2024-09-12T22:49:58.001 INFO:tasks.workunit.client.0.smithi066.stdout:9/765: rename d9/dc/f1f to d9/df0/ff8 0 2024-09-12T22:49:58.002 INFO:tasks.workunit.client.0.smithi066.stdout:8/771: link d17/f70 d17/d40/d74/da3/dac/db4/f10c 0 2024-09-12T22:49:58.003 INFO:tasks.workunit.client.0.smithi066.stdout:7/673: symlink d0/d19/d26/d48/d84/le2 0 2024-09-12T22:49:58.004 INFO:tasks.workunit.client.0.smithi066.stdout:3/760: creat d0/d2/d1d/d87/d40/da2/f108 x:0 0 0 2024-09-12T22:49:58.004 INFO:tasks.workunit.client.0.smithi066.stdout:9/766: readlink d9/dc/d46/lc7 0 2024-09-12T22:49:58.004 INFO:tasks.workunit.client.0.smithi066.stdout:6/822: mknod d6/d23/d25/d4e/de6/c117 0 2024-09-12T22:49:58.005 INFO:tasks.workunit.client.0.smithi066.stdout:0/766: dwrite d1/d36/de6/f10f [0,4194304] 0 2024-09-12T22:49:58.007 INFO:tasks.workunit.client.0.smithi066.stdout:2/763: dread d1/d11/d26/d4f/d5f/d61/d72/ff6 [0,4194304] 0 2024-09-12T22:49:58.008 INFO:tasks.workunit.client.0.smithi066.stdout:5/835: write d5/d11/d23/d6f/daa/dbb/dc6/fcd [1480082,46019] 0 2024-09-12T22:49:58.008 INFO:tasks.workunit.client.0.smithi066.stdout:3/761: write d0/d2/d7/dc4/fea [828232,95802] 0 2024-09-12T22:49:58.009 INFO:tasks.workunit.client.0.smithi066.stdout:0/767: chown d1/d36/f8e 2 1 2024-09-12T22:49:58.009 INFO:tasks.workunit.client.0.smithi066.stdout:6/823: creat d6/d78/d4a/f118 x:0 0 0 2024-09-12T22:49:58.009 INFO:tasks.workunit.client.0.smithi066.stdout:9/767: write d9/d31/d77/fee [931042,45093] 0 2024-09-12T22:49:58.010 INFO:tasks.workunit.client.0.smithi066.stdout:3/762: write d0/d2/d7/d29/fc5 [4774139,120399] 0 2024-09-12T22:49:58.011 INFO:tasks.workunit.client.0.smithi066.stdout:0/768: chown d1/l3e 0 1 2024-09-12T22:49:58.011 INFO:tasks.workunit.client.0.smithi066.stdout:1/722: dwrite d0/dc/d1e/fbb [0,4194304] 0 2024-09-12T22:49:58.013 INFO:tasks.workunit.client.0.smithi066.stdout:9/768: write d9/dc/dd/f50 [2036484,110316] 0 2024-09-12T22:49:58.014 INFO:tasks.workunit.client.0.smithi066.stdout:0/769: mknod d1/d36/c113 0 2024-09-12T22:49:58.017 INFO:tasks.workunit.client.0.smithi066.stdout:9/769: getdents d9/dc6/df6 0 2024-09-12T22:49:58.018 INFO:tasks.workunit.client.0.smithi066.stdout:3/763: unlink d0/d2/d1d/d87/d40/d44/d55/d91/cd9 0 2024-09-12T22:49:58.018 INFO:tasks.workunit.client.0.smithi066.stdout:2/764: dwrite d1/d44/df3/d12/f21 [0,4194304] 0 2024-09-12T22:49:58.020 INFO:tasks.workunit.client.0.smithi066.stdout:8/772: dwrite d17/d40/d47/d4d/d87/fa9 [0,4194304] 0 2024-09-12T22:49:58.022 INFO:tasks.workunit.client.0.smithi066.stdout:1/723: write d0/f64 [854457,72061] 0 2024-09-12T22:49:58.024 INFO:tasks.workunit.client.0.smithi066.stdout:6/824: dwrite d6/d23/d25/d4e/dc4/d99/fa0 [0,4194304] 0 2024-09-12T22:49:58.024 INFO:tasks.workunit.client.0.smithi066.stdout:2/765: write d1/d44/df3/f14 [525821,110821] 0 2024-09-12T22:49:58.024 INFO:tasks.workunit.client.0.smithi066.stdout:3/764: symlink d0/d2/d7/dc4/dcf/d9e/l109 0 2024-09-12T22:49:58.025 INFO:tasks.workunit.client.0.smithi066.stdout:0/770: link d1/d8/d1f/l64 d1/d8/d1c/d13/d2f/d8a/l114 0 2024-09-12T22:49:58.025 INFO:tasks.workunit.client.0.smithi066.stdout:9/770: write d9/d31/d77/dc2/dcb/f71 [164035,100380] 0 2024-09-12T22:49:58.026 INFO:tasks.workunit.client.0.smithi066.stdout:6/825: creat d6/d23/d41/db6/dd3/f119 x:0 0 0 2024-09-12T22:49:58.027 INFO:tasks.workunit.client.0.smithi066.stdout:0/771: write d1/f7 [1090130,97055] 0 2024-09-12T22:49:58.027 INFO:tasks.workunit.client.0.smithi066.stdout:8/773: rmdir d17/d49/d4b/d57/dfc 0 2024-09-12T22:49:58.027 INFO:tasks.workunit.client.0.smithi066.stdout:1/724: creat d0/d36/fe8 x:0 0 0 2024-09-12T22:49:58.028 INFO:tasks.workunit.client.0.smithi066.stdout:6/826: fsync d6/d7/feb 0 2024-09-12T22:49:58.028 INFO:tasks.workunit.client.0.smithi066.stdout:2/766: symlink d1/d11/d26/d4f/d5f/d61/d72/dad/df5/lf7 0 2024-09-12T22:49:58.029 INFO:tasks.workunit.client.0.smithi066.stdout:0/772: unlink d1/dbf/fc5 0 2024-09-12T22:49:58.029 INFO:tasks.workunit.client.0.smithi066.stdout:1/725: symlink d0/d36/le9 0 2024-09-12T22:49:58.030 INFO:tasks.workunit.client.0.smithi066.stdout:6/827: unlink d6/d23/d25/d4e/dc4/d99/fa3 0 2024-09-12T22:49:58.031 INFO:tasks.workunit.client.0.smithi066.stdout:1/726: mkdir d0/dea 0 2024-09-12T22:49:58.032 INFO:tasks.workunit.client.0.smithi066.stdout:6/828: fsync d6/d35/ffa 0 2024-09-12T22:49:58.034 INFO:tasks.workunit.client.0.smithi066.stdout:1/727: getdents d0/dc/d8f/dd0 0 2024-09-12T22:49:58.035 INFO:tasks.workunit.client.0.smithi066.stdout:6/829: write d6/d23/d41/db6/dd3/f119 [144621,122403] 0 2024-09-12T22:49:58.036 INFO:tasks.workunit.client.0.smithi066.stdout:1/728: unlink d0/dc/d1d/fae 0 2024-09-12T22:49:58.037 INFO:tasks.workunit.client.0.smithi066.stdout:0/773: dwrite d1/d8/d1c/d56/fca [0,4194304] 0 2024-09-12T22:49:58.037 INFO:tasks.workunit.client.0.smithi066.stdout:6/830: creat d6/d59/d10e/f11a x:0 0 0 2024-09-12T22:49:58.037 INFO:tasks.workunit.client.0.smithi066.stdout:4/824: dread d5/d8/d16/d93/de0/de8/f92 [0,4194304] 0 2024-09-12T22:49:58.039 INFO:tasks.workunit.client.0.smithi066.stdout:1/729: write d0/d4e/d79/dc1/fc6 [66733,57868] 0 2024-09-12T22:49:58.039 INFO:tasks.workunit.client.0.smithi066.stdout:6/831: write d6/d23/d25/d2c/d85/fbb [25489,76741] 0 2024-09-12T22:49:58.040 INFO:tasks.workunit.client.0.smithi066.stdout:0/774: write d1/fea [73416,61436] 0 2024-09-12T22:49:58.040 INFO:tasks.workunit.client.0.smithi066.stdout:4/825: write d5/d8/d16/d1b/d1e/d1f/d8c/fcc [529733,95428] 0 2024-09-12T22:49:58.041 INFO:tasks.workunit.client.0.smithi066.stdout:1/730: mkdir d0/dc/deb 0 2024-09-12T22:49:58.042 INFO:tasks.workunit.client.0.smithi066.stdout:7/674: sync 2024-09-12T22:49:58.043 INFO:tasks.workunit.client.0.smithi066.stdout:8/774: truncate d17/d49/d4b/d57/d5e/d62/d79/fda 493373 0 2024-09-12T22:49:58.043 INFO:tasks.workunit.client.0.smithi066.stdout:6/832: mknod d6/d23/d25/d4e/dc4/d99/c11b 0 2024-09-12T22:49:58.043 INFO:tasks.workunit.client.0.smithi066.stdout:4/826: creat d5/d8/d16/d93/de0/f116 x:0 0 0 2024-09-12T22:49:58.043 INFO:tasks.workunit.client.0.smithi066.stdout:7/675: write d0/d6/fcd [69994,95500] 0 2024-09-12T22:49:58.044 INFO:tasks.workunit.client.0.smithi066.stdout:1/731: chown d0/c42 4 1 2024-09-12T22:49:58.045 INFO:tasks.workunit.client.0.smithi066.stdout:7/676: dread - d0/d86/f95 zero size 2024-09-12T22:49:58.046 INFO:tasks.workunit.client.0.smithi066.stdout:6/833: link d6/d23/d62/cb7 d6/d35/c11c 0 2024-09-12T22:49:58.047 INFO:tasks.workunit.client.0.smithi066.stdout:4/827: write d5/d8/d16/d1b/d1e/d5a/f67 [774024,27109] 0 2024-09-12T22:49:58.047 INFO:tasks.workunit.client.0.smithi066.stdout:1/732: write d0/dc/d1e/d47/fe4 [1193379,11821] 0 2024-09-12T22:49:58.048 INFO:tasks.workunit.client.0.smithi066.stdout:0/775: dwrite d1/d36/d65/dc2/ffb [0,4194304] 0 2024-09-12T22:49:58.048 INFO:tasks.workunit.client.0.smithi066.stdout:7/677: unlink d0/d19/d60/f8d 0 2024-09-12T22:49:58.053 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:49:58.053 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:49:58.054 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:49:58.054 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:49:58.054 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.054 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1923 3.8 3:17051619:::200.0000000f:head [write 935107~4527 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:49:58.054 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.157731+0000", 2024-09-12T22:49:58.054 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.89290901700000003, 2024-09-12T22:49:58.055 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.085115956000000006, 2024-09-12T22:49:58.055 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:58.055 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:58.055 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:58.055 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:58.055 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.055 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:58.055 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157731+0000", 2024-09-12T22:49:58.055 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.055 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.056 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.056 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:58.056 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157731+0000", 2024-09-12T22:49:58.056 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.056 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.056 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:58.056 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157732+0000", 2024-09-12T22:49:58.056 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.99e-07 2024-09-12T22:49:58.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.056 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.056 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:58.056 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157737+0000", 2024-09-12T22:49:58.057 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6280000000000002e-06 2024-09-12T22:49:58.057 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.057 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.057 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:58.057 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157745+0000", 2024-09-12T22:49:58.057 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1749999999999999e-06 2024-09-12T22:49:58.057 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.057 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.057 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:58.057 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157749+0000", 2024-09-12T22:49:58.057 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.946e-06 2024-09-12T22:49:58.057 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.057 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.058 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:58.058 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.236865+0000", 2024-09-12T22:49:58.058 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079116687000000005 2024-09-12T22:49:58.058 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.058 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.058 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:58.058 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.236929+0000", 2024-09-12T22:49:58.058 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3566999999999996e-05 2024-09-12T22:49:58.058 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.058 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.058 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:58.058 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237025+0000", 2024-09-12T22:49:58.058 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6620000000000007e-05 2024-09-12T22:49:58.058 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.059 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.059 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:58.059 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240342+0000", 2024-09-12T22:49:58.059 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033162539999999998 2024-09-12T22:49:58.059 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.059 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.059 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:58.059 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242737+0000", 2024-09-12T22:49:58.059 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023957370000000002 2024-09-12T22:49:58.059 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.059 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.060 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:58.060 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242797+0000", 2024-09-12T22:49:58.060 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9323000000000001e-05 2024-09-12T22:49:58.060 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.060 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.060 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:58.060 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242847+0000", 2024-09-12T22:49:58.060 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0319999999999999e-05 2024-09-12T22:49:58.060 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.060 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:58.060 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.060 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.060 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.061 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1924 3.8 3:17051619:::200.0000000f:head [write 939634~6106 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:49:58.061 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.159169+0000", 2024-09-12T22:49:58.061 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.89147079799999995, 2024-09-12T22:49:58.061 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.083843601000000004, 2024-09-12T22:49:58.061 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:58.061 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:58.061 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:58.061 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:58.061 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.061 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:58.061 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159169+0000", 2024-09-12T22:49:58.061 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.061 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.062 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.062 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:58.062 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159169+0000", 2024-09-12T22:49:58.062 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.062 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.062 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.062 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:58.062 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159171+0000", 2024-09-12T22:49:58.062 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4959999999999999e-06 2024-09-12T22:49:58.062 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.062 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.062 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:58.062 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159182+0000", 2024-09-12T22:49:58.062 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1104000000000001e-05 2024-09-12T22:49:58.063 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.063 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.063 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:58.063 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159190+0000", 2024-09-12T22:49:58.063 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3520000000000007e-06 2024-09-12T22:49:58.063 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.063 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.063 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:58.063 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159196+0000", 2024-09-12T22:49:58.063 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5690000000000004e-06 2024-09-12T22:49:58.063 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.063 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.064 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:58.064 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237476+0000", 2024-09-12T22:49:58.064 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078280197999999995 2024-09-12T22:49:58.064 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.064 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.064 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:58.064 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237530+0000", 2024-09-12T22:49:58.064 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4419000000000002e-05 2024-09-12T22:49:58.064 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.064 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.064 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:58.065 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237593+0000", 2024-09-12T22:49:58.065 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2611000000000001e-05 2024-09-12T22:49:58.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.065 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.065 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:58.065 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242030+0000", 2024-09-12T22:49:58.065 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044367369999999996 2024-09-12T22:49:58.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.065 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.065 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:58.065 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242893+0000", 2024-09-12T22:49:58.065 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00086367400000000004 2024-09-12T22:49:58.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.066 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.066 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:58.066 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242956+0000", 2024-09-12T22:49:58.066 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2885999999999994e-05 2024-09-12T22:49:58.066 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.066 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.066 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:58.066 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243013+0000", 2024-09-12T22:49:58.066 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6555000000000003e-05 2024-09-12T22:49:58.066 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.066 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:58.066 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.066 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.066 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.067 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1925 3.8 3:17051619:::200.0000000f:head [write 945740~9955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:49:58.067 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.160395+0000", 2024-09-12T22:49:58.067 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.89024558899999995, 2024-09-12T22:49:58.067 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.091200247999999998, 2024-09-12T22:49:58.067 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:58.067 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:58.067 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:58.067 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:58.067 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.067 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:58.067 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160395+0000", 2024-09-12T22:49:58.067 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.067 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.068 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.068 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:58.068 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160395+0000", 2024-09-12T22:49:58.068 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.068 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.068 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.068 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:58.068 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160396+0000", 2024-09-12T22:49:58.068 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1599999999999999e-06 2024-09-12T22:49:58.068 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.068 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.068 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:58.068 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160415+0000", 2024-09-12T22:49:58.068 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9680000000000001e-05 2024-09-12T22:49:58.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.069 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:58.069 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160428+0000", 2024-09-12T22:49:58.069 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2792999999999999e-05 2024-09-12T22:49:58.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.069 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:58.069 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160436+0000", 2024-09-12T22:49:58.069 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0399999999999993e-06 2024-09-12T22:49:58.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.069 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:58.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.238408+0000", 2024-09-12T22:49:58.070 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077971602000000001 2024-09-12T22:49:58.070 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.070 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.070 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:58.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.238504+0000", 2024-09-12T22:49:58.070 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6714999999999998e-05 2024-09-12T22:49:58.070 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.070 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.070 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:58.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.238687+0000", 2024-09-12T22:49:58.070 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000182795 2024-09-12T22:49:58.070 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.071 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.071 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:58.071 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242036+0000", 2024-09-12T22:49:58.071 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003348887 2024-09-12T22:49:58.071 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.071 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.071 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:58.071 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251510+0000", 2024-09-12T22:49:58.071 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094733679999999994 2024-09-12T22:49:58.071 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.071 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.071 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:58.071 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251543+0000", 2024-09-12T22:49:58.072 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2974e-05 2024-09-12T22:49:58.072 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.072 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.072 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:58.072 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251595+0000", 2024-09-12T22:49:58.072 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2234000000000002e-05 2024-09-12T22:49:58.072 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.072 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:58.072 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.072 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.072 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.072 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1926 3.8 3:17051619:::200.0000000f:head [write 955695~5281 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:49:58.072 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.160849+0000", 2024-09-12T22:49:58.073 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.889790635, 2024-09-12T22:49:58.073 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.094772633999999994, 2024-09-12T22:49:58.073 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:58.073 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:58.073 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:58.073 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:58.073 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.073 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:58.073 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160849+0000", 2024-09-12T22:49:58.073 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.073 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.073 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.073 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:58.073 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160849+0000", 2024-09-12T22:49:58.074 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.074 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.074 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:58.074 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160850+0000", 2024-09-12T22:49:58.074 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6700000000000002e-07 2024-09-12T22:49:58.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.074 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.074 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:58.074 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160858+0000", 2024-09-12T22:49:58.074 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5630000000000003e-06 2024-09-12T22:49:58.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.075 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.075 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:58.075 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160866+0000", 2024-09-12T22:49:58.075 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7570000000000004e-06 2024-09-12T22:49:58.075 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.075 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.075 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:58.075 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160870+0000", 2024-09-12T22:49:58.075 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5929999999999999e-06 2024-09-12T22:49:58.075 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.076 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.076 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:58.076 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.239705+0000", 2024-09-12T22:49:58.076 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078834491000000007 2024-09-12T22:49:58.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.076 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.076 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:58.076 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.239764+0000", 2024-09-12T22:49:58.076 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9190000000000001e-05 2024-09-12T22:49:58.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.076 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.076 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:58.076 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.239851+0000", 2024-09-12T22:49:58.076 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7472999999999994e-05 2024-09-12T22:49:58.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.077 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:58.077 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254001+0000", 2024-09-12T22:49:58.077 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014149622000000001 2024-09-12T22:49:58.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.077 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:58.077 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255525+0000", 2024-09-12T22:49:58.077 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0015236500000000001 2024-09-12T22:49:58.078 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.078 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.078 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:58.078 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255567+0000", 2024-09-12T22:49:58.078 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2150999999999997e-05 2024-09-12T22:49:58.078 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.078 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.078 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:58.078 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255622+0000", 2024-09-12T22:49:58.078 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5276999999999999e-05 2024-09-12T22:49:58.078 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.078 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:58.079 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.079 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.079 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.079 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1927 3.8 3:17051619:::200.0000000f:head [write 960976~5828 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:49:58.079 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.164361+0000", 2024-09-12T22:49:58.079 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.88627893800000002, 2024-09-12T22:49:58.079 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.091388523999999999, 2024-09-12T22:49:58.079 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:58.079 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:58.079 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:58.079 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:58.079 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.079 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:58.080 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164361+0000", 2024-09-12T22:49:58.080 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.080 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.080 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:58.080 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164361+0000", 2024-09-12T22:49:58.080 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.080 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.080 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:58.080 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164363+0000", 2024-09-12T22:49:58.080 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.389e-06 2024-09-12T22:49:58.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.081 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:58.081 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164370+0000", 2024-09-12T22:49:58.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.99e-06 2024-09-12T22:49:58.081 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.081 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:58.081 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164379+0000", 2024-09-12T22:49:58.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9499999999999996e-06 2024-09-12T22:49:58.081 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.081 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:58.081 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164385+0000", 2024-09-12T22:49:58.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5879999999999997e-06 2024-09-12T22:49:58.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.082 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.082 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:58.082 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240385+0000", 2024-09-12T22:49:58.082 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075999995000000001 2024-09-12T22:49:58.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.082 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.082 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:58.082 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240533+0000", 2024-09-12T22:49:58.082 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014811699999999999 2024-09-12T22:49:58.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.082 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.082 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:58.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240886+0000", 2024-09-12T22:49:58.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000352517 2024-09-12T22:49:58.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.083 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:58.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254024+0000", 2024-09-12T22:49:58.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013138047999999999 2024-09-12T22:49:58.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.083 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:58.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255629+0000", 2024-09-12T22:49:58.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001604949 2024-09-12T22:49:58.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:58.084 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255683+0000", 2024-09-12T22:49:58.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4035e-05 2024-09-12T22:49:58.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:58.084 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255750+0000", 2024-09-12T22:49:58.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6946000000000006e-05 2024-09-12T22:49:58.084 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.084 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:58.084 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.085 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1928 3.8 3:17051619:::200.0000000f:head [write 966804~6536 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:49:58.085 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167179+0000", 2024-09-12T22:49:58.085 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.88346113999999998, 2024-09-12T22:49:58.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.089785880999999998, 2024-09-12T22:49:58.085 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:58.085 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:58.085 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:58.085 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:58.085 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.085 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:58.085 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167179+0000", 2024-09-12T22:49:58.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.085 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.085 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.086 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:58.086 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167179+0000", 2024-09-12T22:49:58.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.086 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:58.086 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167180+0000", 2024-09-12T22:49:58.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2869999999999999e-06 2024-09-12T22:49:58.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.086 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:58.086 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167192+0000", 2024-09-12T22:49:58.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.187e-05 2024-09-12T22:49:58.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:58.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167203+0000", 2024-09-12T22:49:58.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1076e-05 2024-09-12T22:49:58.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:58.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167210+0000", 2024-09-12T22:49:58.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1799999999999999e-06 2024-09-12T22:49:58.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:58.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.241518+0000", 2024-09-12T22:49:58.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074307845999999997 2024-09-12T22:49:58.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:58.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.241563+0000", 2024-09-12T22:49:58.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5138e-05 2024-09-12T22:49:58.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:58.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.241641+0000", 2024-09-12T22:49:58.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8016000000000007e-05 2024-09-12T22:49:58.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:58.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254041+0000", 2024-09-12T22:49:58.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012399666 2024-09-12T22:49:58.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:58.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.256880+0000", 2024-09-12T22:49:58.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0028390580000000002 2024-09-12T22:49:58.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:58.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.256918+0000", 2024-09-12T22:49:58.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7552999999999998e-05 2024-09-12T22:49:58.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.090 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:58.090 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.256965+0000", 2024-09-12T22:49:58.090 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7191000000000003e-05 2024-09-12T22:49:58.090 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.090 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:58.090 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.090 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1929 3.8 3:17051619:::200.0000000f:head [write 973340~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:49:58.090 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167521+0000", 2024-09-12T22:49:58.090 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.88311897699999997, 2024-09-12T22:49:58.090 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.093206336000000001, 2024-09-12T22:49:58.090 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:58.090 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:58.091 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:58.091 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:58.091 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.091 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:58.091 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167521+0000", 2024-09-12T22:49:58.091 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.091 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.091 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.091 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:58.091 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167521+0000", 2024-09-12T22:49:58.091 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.091 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.091 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.091 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:58.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167522+0000", 2024-09-12T22:49:58.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8899999999999998e-07 2024-09-12T22:49:58.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:58.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167526+0000", 2024-09-12T22:49:58.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4490000000000001e-06 2024-09-12T22:49:58.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:58.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167544+0000", 2024-09-12T22:49:58.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7220000000000001e-05 2024-09-12T22:49:58.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:58.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167551+0000", 2024-09-12T22:49:58.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.046e-06 2024-09-12T22:49:58.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:58.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242079+0000", 2024-09-12T22:49:58.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074528436000000003 2024-09-12T22:49:58.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:58.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242167+0000", 2024-09-12T22:49:58.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7670000000000006e-05 2024-09-12T22:49:58.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:58.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242306+0000", 2024-09-12T22:49:58.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000138703 2024-09-12T22:49:58.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:58.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254058+0000", 2024-09-12T22:49:58.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011752395000000001 2024-09-12T22:49:58.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:58.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260654+0000", 2024-09-12T22:49:58.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0065964700000000001 2024-09-12T22:49:58.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.095 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:58.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260699+0000", 2024-09-12T22:49:58.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5095000000000001e-05 2024-09-12T22:49:58.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.095 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:58.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260727+0000", 2024-09-12T22:49:58.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7963e-05 2024-09-12T22:49:58.095 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.095 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:58.095 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.096 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1931 3.8 3:17051619:::200.0000000f:head [write 974738~2728 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:49:58.096 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167657+0000", 2024-09-12T22:49:58.096 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.88298297199999998, 2024-09-12T22:49:58.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.093133758999999997, 2024-09-12T22:49:58.096 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:58.096 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:58.096 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:58.096 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:58.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:58.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167657+0000", 2024-09-12T22:49:58.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:58.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167657+0000", 2024-09-12T22:49:58.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:58.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167658+0000", 2024-09-12T22:49:58.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2200000000000003e-07 2024-09-12T22:49:58.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:58.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167662+0000", 2024-09-12T22:49:58.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1489999999999996e-06 2024-09-12T22:49:58.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:58.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167673+0000", 2024-09-12T22:49:58.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0614e-05 2024-09-12T22:49:58.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:58.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167679+0000", 2024-09-12T22:49:58.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1500000000000004e-06 2024-09-12T22:49:58.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.099 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:58.099 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243054+0000", 2024-09-12T22:49:58.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075375027999999997 2024-09-12T22:49:58.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.099 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:58.099 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243134+0000", 2024-09-12T22:49:58.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0210000000000006e-05 2024-09-12T22:49:58.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.099 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:58.099 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243263+0000", 2024-09-12T22:49:58.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012919 2024-09-12T22:49:58.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:58.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254075+0000", 2024-09-12T22:49:58.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010811523 2024-09-12T22:49:58.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:58.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260733+0000", 2024-09-12T22:49:58.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.006658153 2024-09-12T22:49:58.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:58.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260756+0000", 2024-09-12T22:49:58.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2696000000000001e-05 2024-09-12T22:49:58.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:58.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260791+0000", 2024-09-12T22:49:58.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5324000000000003e-05 2024-09-12T22:49:58.101 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.101 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:58.101 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.101 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1932 3.8 3:17051619:::200.0000000f:head [write 977466~2771 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:49:58.101 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:49:58.101 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.88269328999999996, 2024-09-12T22:49:58.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.092944115999999993, 2024-09-12T22:49:58.102 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:58.102 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:58.102 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:58.102 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:58.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.102 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:58.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:49:58.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.102 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:58.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:49:58.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:58.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:49:58.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8400000000000004e-07 2024-09-12T22:49:58.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:58.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167952+0000", 2024-09-12T22:49:58.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.138e-06 2024-09-12T22:49:58.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:58.104 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167961+0000", 2024-09-12T22:49:58.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7990000000000005e-06 2024-09-12T22:49:58.104 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.104 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.104 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:58.104 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167968+0000", 2024-09-12T22:49:58.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4400000000000002e-06 2024-09-12T22:49:58.104 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.104 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.104 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:58.104 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.244002+0000", 2024-09-12T22:49:58.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.076034300999999999 2024-09-12T22:49:58.104 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.104 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.105 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:58.105 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.244061+0000", 2024-09-12T22:49:58.105 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8356999999999997e-05 2024-09-12T22:49:58.105 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.105 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.105 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:58.105 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.244161+0000", 2024-09-12T22:49:58.105 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000100126 2024-09-12T22:49:58.105 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.105 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.105 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:58.105 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254099+0000", 2024-09-12T22:49:58.105 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0099384940000000008 2024-09-12T22:49:58.105 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.106 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.106 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:58.106 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260799+0000", 2024-09-12T22:49:58.106 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0066995029999999999 2024-09-12T22:49:58.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.106 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.106 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:58.106 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260851+0000", 2024-09-12T22:49:58.106 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1861999999999999e-05 2024-09-12T22:49:58.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.106 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.106 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:58.106 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260891+0000", 2024-09-12T22:49:58.106 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0411999999999999e-05 2024-09-12T22:49:58.107 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.107 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:58.107 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.107 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.107 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.107 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1933 3.8 3:17051619:::200.0000000f:head [write 980237~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:49:58.107 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167993+0000", 2024-09-12T22:49:58.107 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.88264678699999999, 2024-09-12T22:49:58.107 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.092952307999999997, 2024-09-12T22:49:58.107 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:58.107 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:58.107 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:58.107 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:58.107 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.108 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:58.108 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167993+0000", 2024-09-12T22:49:58.108 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.108 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.108 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.108 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:58.108 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167993+0000", 2024-09-12T22:49:58.108 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.108 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.108 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.108 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:58.108 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167994+0000", 2024-09-12T22:49:58.108 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5000000000000003e-07 2024-09-12T22:49:58.109 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.109 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.109 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:58.109 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167997+0000", 2024-09-12T22:49:58.109 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5559999999999999e-06 2024-09-12T22:49:58.109 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.109 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.109 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:58.109 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168005+0000", 2024-09-12T22:49:58.109 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.588e-06 2024-09-12T22:49:58.109 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.109 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.109 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:58.109 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168011+0000", 2024-09-12T22:49:58.110 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7780000000000004e-06 2024-09-12T22:49:58.110 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.110 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.110 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:58.110 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.247983+0000", 2024-09-12T22:49:58.110 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079972090999999995 2024-09-12T22:49:58.110 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.110 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.110 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:58.110 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248038+0000", 2024-09-12T22:49:58.110 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4889999999999998e-05 2024-09-12T22:49:58.110 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.110 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.110 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:58.111 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248136+0000", 2024-09-12T22:49:58.111 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8271999999999997e-05 2024-09-12T22:49:58.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.111 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.111 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:58.111 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254134+0000", 2024-09-12T22:49:58.111 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005997751 2024-09-12T22:49:58.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.111 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.111 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:58.111 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260898+0000", 2024-09-12T22:49:58.111 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0067646429999999999 2024-09-12T22:49:58.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.111 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.112 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:58.112 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260923+0000", 2024-09-12T22:49:58.112 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4080999999999999e-05 2024-09-12T22:49:58.112 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.112 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.112 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:58.112 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260946+0000", 2024-09-12T22:49:58.112 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3108e-05 2024-09-12T22:49:58.112 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.112 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:58.112 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.112 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.112 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.113 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1934 3.8 3:17051619:::200.0000000f:head [write 982156~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:49:58.113 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:49:58.113 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.88262130100000002, 2024-09-12T22:49:58.113 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.093517738000000003, 2024-09-12T22:49:58.113 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:58.113 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:58.113 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:58.113 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:58.113 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.113 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:58.113 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:49:58.113 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.113 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.113 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.114 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:58.114 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:49:58.114 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.114 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.114 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.114 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:58.114 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:49:58.114 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6800000000000001e-07 2024-09-12T22:49:58.114 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.114 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.114 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:58.114 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168029+0000", 2024-09-12T22:49:58.114 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9699999999999994e-06 2024-09-12T22:49:58.114 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.115 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.115 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:58.115 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168036+0000", 2024-09-12T22:49:58.115 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9800000000000001e-06 2024-09-12T22:49:58.115 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.115 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.115 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:58.115 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168041+0000", 2024-09-12T22:49:58.115 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0629999999999996e-06 2024-09-12T22:49:58.115 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.115 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.115 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:58.115 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248449+0000", 2024-09-12T22:49:58.115 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.080407948000000007 2024-09-12T22:49:58.116 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.116 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.116 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:58.116 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248491+0000", 2024-09-12T22:49:58.116 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2027999999999998e-05 2024-09-12T22:49:58.116 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.116 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.116 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:58.116 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248569+0000", 2024-09-12T22:49:58.116 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8077000000000005e-05 2024-09-12T22:49:58.116 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.116 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.116 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:58.116 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260950+0000", 2024-09-12T22:49:58.117 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012380901 2024-09-12T22:49:58.117 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.117 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.117 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:58.117 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.261473+0000", 2024-09-12T22:49:58.117 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00052241699999999996 2024-09-12T22:49:58.117 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.117 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.117 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:58.117 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.261507+0000", 2024-09-12T22:49:58.117 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4616000000000002e-05 2024-09-12T22:49:58.117 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.117 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.117 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:58.118 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.261537+0000", 2024-09-12T22:49:58.118 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9369999999999998e-05 2024-09-12T22:49:58.118 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.118 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:58.118 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.118 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1935 3.8 3:17051619:::200.0000000f:head [write 984074~1914 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:49:58.118 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:49:58.118 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.88259137899999995, 2024-09-12T22:49:58.118 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.097660714999999995, 2024-09-12T22:49:58.118 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:58.118 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:58.119 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:58.119 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:58.119 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.119 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:58.119 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:49:58.119 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.119 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.119 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.119 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:58.119 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:49:58.119 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.119 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.119 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.119 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:58.120 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:49:58.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4400000000000001e-07 2024-09-12T22:49:58.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.120 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.120 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:58.120 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168052+0000", 2024-09-12T22:49:58.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.886e-06 2024-09-12T22:49:58.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.120 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.120 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:58.120 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168059+0000", 2024-09-12T22:49:58.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0489999999999998e-06 2024-09-12T22:49:58.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.120 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.121 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:58.121 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168081+0000", 2024-09-12T22:49:58.121 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1800000000000001e-05 2024-09-12T22:49:58.121 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.121 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.121 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:58.121 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.250512+0000", 2024-09-12T22:49:58.121 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.082431322000000001 2024-09-12T22:49:58.121 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.121 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.121 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:58.121 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.250621+0000", 2024-09-12T22:49:58.121 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010908600000000001 2024-09-12T22:49:58.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:58.122 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.250970+0000", 2024-09-12T22:49:58.122 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034828399999999997 2024-09-12T22:49:58.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:58.122 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265532+0000", 2024-09-12T22:49:58.122 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01456268 2024-09-12T22:49:58.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:58.122 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265614+0000", 2024-09-12T22:49:58.122 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1796000000000001e-05 2024-09-12T22:49:58.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.123 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:58.123 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265673+0000", 2024-09-12T22:49:58.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9314000000000002e-05 2024-09-12T22:49:58.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.123 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:58.123 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265709+0000", 2024-09-12T22:49:58.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6053999999999997e-05 2024-09-12T22:49:58.123 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.123 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:58.123 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.124 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1936 3.8 3:17051619:::200.0000000f:head [write 985988~2437 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:49:58.124 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.168095+0000", 2024-09-12T22:49:58.124 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.88254503200000001, 2024-09-12T22:49:58.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.097789345999999999, 2024-09-12T22:49:58.124 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:58.124 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:58.124 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:58.124 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:58.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:58.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168095+0000", 2024-09-12T22:49:58.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.125 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:58.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168095+0000", 2024-09-12T22:49:58.125 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.125 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:58.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168096+0000", 2024-09-12T22:49:58.125 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7700000000000005e-07 2024-09-12T22:49:58.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.125 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:58.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168099+0000", 2024-09-12T22:49:58.126 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.422e-06 2024-09-12T22:49:58.126 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.126 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.126 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:58.126 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168106+0000", 2024-09-12T22:49:58.126 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6889999999999998e-06 2024-09-12T22:49:58.126 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.126 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.126 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:58.126 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168110+0000", 2024-09-12T22:49:58.126 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8470000000000003e-06 2024-09-12T22:49:58.126 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.126 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.126 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:58.127 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251622+0000", 2024-09-12T22:49:58.127 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.083511539999999995 2024-09-12T22:49:58.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.127 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.127 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:58.127 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251674+0000", 2024-09-12T22:49:58.127 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1678999999999998e-05 2024-09-12T22:49:58.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.127 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.127 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:58.127 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251744+0000", 2024-09-12T22:49:58.127 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0440999999999999e-05 2024-09-12T22:49:58.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.127 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:58.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265545+0000", 2024-09-12T22:49:58.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013801000000000001 2024-09-12T22:49:58.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:58.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265771+0000", 2024-09-12T22:49:58.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000225632 2024-09-12T22:49:58.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:58.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265835+0000", 2024-09-12T22:49:58.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4541000000000004e-05 2024-09-12T22:49:58.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.129 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:58.129 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265884+0000", 2024-09-12T22:49:58.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9078e-05 2024-09-12T22:49:58.129 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.129 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:58.129 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.129 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1937 3.8 3:17051619:::200.0000000f:head [write 988425~1920 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:49:58.129 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.171188+0000", 2024-09-12T22:49:58.129 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.87945166100000005, 2024-09-12T22:49:58.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.094794626000000007, 2024-09-12T22:49:58.129 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:58.130 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:58.130 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:58.130 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:58.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:58.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171188+0000", 2024-09-12T22:49:58.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:58.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171188+0000", 2024-09-12T22:49:58.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.131 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.131 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:58.131 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171189+0000", 2024-09-12T22:49:58.131 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3200000000000003e-07 2024-09-12T22:49:58.131 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.131 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.131 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:58.131 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171194+0000", 2024-09-12T22:49:58.131 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2690000000000001e-06 2024-09-12T22:49:58.131 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.131 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.131 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:58.131 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171201+0000", 2024-09-12T22:49:58.132 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5310000000000004e-06 2024-09-12T22:49:58.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.132 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:58.132 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171206+0000", 2024-09-12T22:49:58.132 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7049999999999998e-06 2024-09-12T22:49:58.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.132 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:58.132 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254169+0000", 2024-09-12T22:49:58.132 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.082962835999999998 2024-09-12T22:49:58.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:58.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254263+0000", 2024-09-12T22:49:58.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3844999999999993e-05 2024-09-12T22:49:58.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:58.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254398+0000", 2024-09-12T22:49:58.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013560499999999999 2024-09-12T22:49:58.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:58.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265897+0000", 2024-09-12T22:49:58.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01149846 2024-09-12T22:49:58.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.134 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:58.134 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265922+0000", 2024-09-12T22:49:58.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5130000000000002e-05 2024-09-12T22:49:58.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.134 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:58.134 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265954+0000", 2024-09-12T22:49:58.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2512999999999999e-05 2024-09-12T22:49:58.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.134 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:58.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265983+0000", 2024-09-12T22:49:58.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8799999999999999e-05 2024-09-12T22:49:58.135 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.135 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:58.135 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.135 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1938 3.8 3:17051619:::200.0000000f:head [write 990345~2499 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:49:58.135 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:49:58.135 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.87941148199999997, 2024-09-12T22:49:58.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.094864730999999994, 2024-09-12T22:49:58.136 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:58.136 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:58.136 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:58.136 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:58.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.136 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:58.136 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:49:58.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.136 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:58.136 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:49:58.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:58.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:49:58.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:49:58.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:58.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171242+0000", 2024-09-12T22:49:58.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3111e-05 2024-09-12T22:49:58.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:58.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171247+0000", 2024-09-12T22:49:58.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0939999999999998e-06 2024-09-12T22:49:58.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:58.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171251+0000", 2024-09-12T22:49:58.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.298e-06 2024-09-12T22:49:58.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:58.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254869+0000", 2024-09-12T22:49:58.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.083618681 2024-09-12T22:49:58.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:58.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254957+0000", 2024-09-12T22:49:58.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7783999999999998e-05 2024-09-12T22:49:58.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:58.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255093+0000", 2024-09-12T22:49:58.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013579600000000001 2024-09-12T22:49:58.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:58.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265997+0000", 2024-09-12T22:49:58.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010903777999999999 2024-09-12T22:49:58.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:58.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266047+0000", 2024-09-12T22:49:58.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0151999999999997e-05 2024-09-12T22:49:58.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:58.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266075+0000", 2024-09-12T22:49:58.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8082e-05 2024-09-12T22:49:58.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:58.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266093+0000", 2024-09-12T22:49:58.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8396000000000001e-05 2024-09-12T22:49:58.144 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.144 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:58.144 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.145 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1944 3.8 3:17051619:::200.0000000f:head [write 1037561~3947 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:49:58.145 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.186089+0000", 2024-09-12T22:49:58.145 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.86455123199999995, 2024-09-12T22:49:58.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087755745999999996, 2024-09-12T22:49:58.145 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:58.145 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:58.145 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:58.145 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:58.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:58.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186089+0000", 2024-09-12T22:49:58.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:58.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186089+0000", 2024-09-12T22:49:58.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:58.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186090+0000", 2024-09-12T22:49:58.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1349999999999999e-06 2024-09-12T22:49:58.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:58.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186098+0000", 2024-09-12T22:49:58.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8390000000000007e-06 2024-09-12T22:49:58.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:58.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186106+0000", 2024-09-12T22:49:58.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4619999999999996e-06 2024-09-12T22:49:58.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:58.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186111+0000", 2024-09-12T22:49:58.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.057e-06 2024-09-12T22:49:58.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:58.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.264543+0000", 2024-09-12T22:49:58.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078432044000000006 2024-09-12T22:49:58.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:58.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.264617+0000", 2024-09-12T22:49:58.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3789999999999997e-05 2024-09-12T22:49:58.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:58.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.264760+0000", 2024-09-12T22:49:58.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014318499999999999 2024-09-12T22:49:58.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:58.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268441+0000", 2024-09-12T22:49:58.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036809360000000001 2024-09-12T22:49:58.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:58.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273776+0000", 2024-09-12T22:49:58.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053346449999999998 2024-09-12T22:49:58.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:58.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273807+0000", 2024-09-12T22:49:58.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1352000000000001e-05 2024-09-12T22:49:58.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:58.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273845+0000", 2024-09-12T22:49:58.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7301000000000001e-05 2024-09-12T22:49:58.150 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.150 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:58.150 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.150 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1945 3.8 3:17051619:::200.0000000f:head [write 1041508~10144 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:49:58.150 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:49:58.150 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.86427445999999997, 2024-09-12T22:49:58.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087573128, 2024-09-12T22:49:58.150 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:58.151 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:58.151 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:58.151 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:58.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:58.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:49:58.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:58.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:49:58.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.152 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:58.152 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:49:58.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1600000000000001e-07 2024-09-12T22:49:58.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.152 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:58.152 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186377+0000", 2024-09-12T22:49:58.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0301e-05 2024-09-12T22:49:58.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.152 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:58.152 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186386+0000", 2024-09-12T22:49:58.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5619999999999993e-06 2024-09-12T22:49:58.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.153 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:58.153 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186393+0000", 2024-09-12T22:49:58.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7150000000000001e-06 2024-09-12T22:49:58.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.153 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:58.153 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266725+0000", 2024-09-12T22:49:58.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.080331893000000001 2024-09-12T22:49:58.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.153 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:58.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266799+0000", 2024-09-12T22:49:58.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4086999999999997e-05 2024-09-12T22:49:58.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:58.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266904+0000", 2024-09-12T22:49:58.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105475 2024-09-12T22:49:58.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:58.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273882+0000", 2024-09-12T22:49:58.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069773780000000002 2024-09-12T22:49:58.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:58.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273889+0000", 2024-09-12T22:49:58.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1049999999999997e-06 2024-09-12T22:49:58.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:58.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273916+0000", 2024-09-12T22:49:58.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6716e-05 2024-09-12T22:49:58.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:58.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273939+0000", 2024-09-12T22:49:58.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3180000000000002e-05 2024-09-12T22:49:58.155 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.156 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:58.156 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.156 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1946 3.8 3:17051619:::200.0000000f:head [write 1051652~3875 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:49:58.156 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.186888+0000", 2024-09-12T22:49:58.156 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.86375218099999995, 2024-09-12T22:49:58.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087165134000000005, 2024-09-12T22:49:58.156 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:58.156 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:58.156 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:58.156 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:58.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:58.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186888+0000", 2024-09-12T22:49:58.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:58.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186888+0000", 2024-09-12T22:49:58.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:58.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186889+0000", 2024-09-12T22:49:58.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2500000000000005e-07 2024-09-12T22:49:58.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:58.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186894+0000", 2024-09-12T22:49:58.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3900000000000001e-06 2024-09-12T22:49:58.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:58.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186901+0000", 2024-09-12T22:49:58.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5649999999999998e-06 2024-09-12T22:49:58.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:58.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186906+0000", 2024-09-12T22:49:58.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0390000000000004e-06 2024-09-12T22:49:58.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:58.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.267852+0000", 2024-09-12T22:49:58.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.080946389999999993 2024-09-12T22:49:58.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:58.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.267910+0000", 2024-09-12T22:49:58.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7655999999999998e-05 2024-09-12T22:49:58.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:58.160 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.267981+0000", 2024-09-12T22:49:58.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0916999999999999e-05 2024-09-12T22:49:58.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.160 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:58.160 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273944+0000", 2024-09-12T22:49:58.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0059635570000000004 2024-09-12T22:49:58.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.160 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:58.160 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273993+0000", 2024-09-12T22:49:58.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8350000000000003e-05 2024-09-12T22:49:58.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.160 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:58.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274022+0000", 2024-09-12T22:49:58.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9899999999999998e-05 2024-09-12T22:49:58.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:58.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274053+0000", 2024-09-12T22:49:58.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0645000000000002e-05 2024-09-12T22:49:58.161 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.161 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:58.161 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.161 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1947 3.8 3:17051619:::200.0000000f:head [write 1055527~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:49:58.162 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.187014+0000", 2024-09-12T22:49:58.162 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.86362594699999995, 2024-09-12T22:49:58.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087114608999999996, 2024-09-12T22:49:58.162 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:58.162 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:58.162 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:58.162 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:58.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:58.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187014+0000", 2024-09-12T22:49:58.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.163 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:58.163 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187014+0000", 2024-09-12T22:49:58.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.163 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:58.163 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187015+0000", 2024-09-12T22:49:58.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1500000000000004e-07 2024-09-12T22:49:58.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.163 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:58.163 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187018+0000", 2024-09-12T22:49:58.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.033e-06 2024-09-12T22:49:58.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:58.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187023+0000", 2024-09-12T22:49:58.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7550000000000002e-06 2024-09-12T22:49:58.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:58.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187026+0000", 2024-09-12T22:49:58.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2710000000000001e-06 2024-09-12T22:49:58.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:58.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268462+0000", 2024-09-12T22:49:58.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.081435699 2024-09-12T22:49:58.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:58.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268507+0000", 2024-09-12T22:49:58.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5643999999999999e-05 2024-09-12T22:49:58.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:58.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268597+0000", 2024-09-12T22:49:58.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0112999999999996e-05 2024-09-12T22:49:58.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:58.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273947+0000", 2024-09-12T22:49:58.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053501859999999998 2024-09-12T22:49:58.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:58.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274083+0000", 2024-09-12T22:49:58.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013525500000000001 2024-09-12T22:49:58.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:58.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274109+0000", 2024-09-12T22:49:58.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6352000000000001e-05 2024-09-12T22:49:58.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.167 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:58.167 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274129+0000", 2024-09-12T22:49:58.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9686000000000001e-05 2024-09-12T22:49:58.167 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.167 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:58.167 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.167 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1948 3.8 3:17051619:::200.0000000f:head [write 1057443~1896 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:49:58.167 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.189230+0000", 2024-09-12T22:49:58.167 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.86141013499999997, 2024-09-12T22:49:58.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.085028962999999999, 2024-09-12T22:49:58.167 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:49:58.168 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:49:58.168 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:49:58.168 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:49:58.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:49:58.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189230+0000", 2024-09-12T22:49:58.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:49:58.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189230+0000", 2024-09-12T22:49:58.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:49:58.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:49:58.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189231+0000", 2024-09-12T22:49:58.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1399999999999996e-07 2024-09-12T22:49:58.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:49:58.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189235+0000", 2024-09-12T22:49:58.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5970000000000002e-06 2024-09-12T22:49:58.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:49:58.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189242+0000", 2024-09-12T22:49:58.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8510000000000001e-06 2024-09-12T22:49:58.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:49:58.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189247+0000", 2024-09-12T22:49:58.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4800000000000003e-06 2024-09-12T22:49:58.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:49:58.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268908+0000", 2024-09-12T22:49:58.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079660983000000005 2024-09-12T22:49:58.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:49:58.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268967+0000", 2024-09-12T22:49:58.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9595000000000001e-05 2024-09-12T22:49:58.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:49:58.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.269040+0000", 2024-09-12T22:49:58.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2643000000000002e-05 2024-09-12T22:49:58.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:49:58.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273950+0000", 2024-09-12T22:49:58.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049105329999999999 2024-09-12T22:49:58.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:49:58.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274199+0000", 2024-09-12T22:49:58.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024824999999999999 2024-09-12T22:49:58.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:49:58.172 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274226+0000", 2024-09-12T22:49:58.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7602000000000001e-05 2024-09-12T22:49:58.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:49:58.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:49:58.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:49:58.172 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274259+0000", 2024-09-12T22:49:58.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2614999999999999e-05 2024-09-12T22:49:58.172 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.172 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:58.173 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.173 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:49:58.173 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:49:58.173 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:49:58.175 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:58.176 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:58.173+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:58.177 INFO:tasks.workunit.client.0.smithi066.stdout:1/733: mknod d0/d36/d8e/cec 0 2024-09-12T22:49:58.177 INFO:tasks.workunit.client.0.smithi066.stdout:4/828: mkdir d5/d8/d16/d1b/d1e/d1f/d8c/d117 0 2024-09-12T22:49:58.177 INFO:tasks.workunit.client.0.smithi066.stdout:4/829: mknod d5/d8/d10/de/d2d/d64/d9a/dfd/c118 0 2024-09-12T22:49:58.177 INFO:tasks.workunit.client.0.smithi066.stdout:7/678: truncate d0/d19/d24/d33/d27/d70/fb1 3194516 0 2024-09-12T22:49:58.177 INFO:tasks.workunit.client.0.smithi066.stdout:5/836: dread d5/d11/d21/d78/f99 [0,4194304] 0 2024-09-12T22:49:58.177 INFO:tasks.workunit.client.0.smithi066.stdout:4/830: mkdir d5/d8/d16/d93/de0/d119 0 2024-09-12T22:49:58.177 INFO:tasks.workunit.client.0.smithi066.stdout:6/834: dwrite d6/d23/d25/d4e/dc4/ff6 [0,4194304] 0 2024-09-12T22:49:58.178 INFO:tasks.workunit.client.0.smithi066.stdout:7/679: write d0/d19/d60/fd4 [1266952,67009] 0 2024-09-12T22:49:58.178 INFO:tasks.workunit.client.0.smithi066.stdout:1/734: dwrite d0/dc/fb5 [0,4194304] 0 2024-09-12T22:49:58.178 INFO:tasks.workunit.client.0.smithi066.stdout:4/831: mkdir d5/d8/d10/d11a 0 2024-09-12T22:49:58.178 INFO:tasks.workunit.client.0.smithi066.stdout:7/680: write d0/d19/d24/f3b [624026,18487] 0 2024-09-12T22:49:58.178 INFO:tasks.workunit.client.0.smithi066.stdout:6/835: write d6/d23/d25/d88/f9d [2128927,123040] 0 2024-09-12T22:49:58.178 INFO:tasks.workunit.client.0.smithi066.stdout:1/735: fsync d0/d4e/d79/f9d 0 2024-09-12T22:49:58.178 INFO:tasks.workunit.client.0.smithi066.stdout:3/765: dread d0/d2/d6/f18 [0,4194304] 0 2024-09-12T22:49:58.179 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:49:58.179 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:49:58.182 INFO:tasks.workunit.client.0.smithi066.stdout:5/837: dread d5/d15/f17 [4194304,4194304] 0 2024-09-12T22:49:58.182 INFO:tasks.workunit.client.0.smithi066.stdout:1/736: fdatasync d0/dc/d1e/d47/d6f/f98 0 2024-09-12T22:49:58.182 INFO:tasks.workunit.client.0.smithi066.stdout:6/836: write d6/d23/d41/db6/dd3/df9/f103 [1813610,76986] 0 2024-09-12T22:49:58.183 INFO:tasks.workunit.client.0.smithi066.stdout:9/771: dread d9/d31/f72 [0,4194304] 0 2024-09-12T22:49:58.183 INFO:tasks.workunit.client.0.smithi066.stdout:5/838: fdatasync d5/de/d50/f35 0 2024-09-12T22:49:58.183 INFO:tasks.workunit.client.0.smithi066.stdout:4/832: dwrite d5/d8/d10/de/f14 [0,4194304] 0 2024-09-12T22:49:58.183 INFO:tasks.workunit.client.0.smithi066.stdout:9/772: chown d9/d31/d34/cdd 8983 1 2024-09-12T22:49:58.183 INFO:tasks.workunit.client.0.smithi066.stdout:4/833: dread - d5/d8/d10/de/d2d/d64/d9a/dfd/f112 zero size 2024-09-12T22:49:58.183 INFO:tasks.workunit.client.0.smithi066.stdout:9/773: write d9/dc/f40 [3043216,36556] 0 2024-09-12T22:49:58.183 INFO:tasks.workunit.client.0.smithi066.stdout:2/767: dread d1/d44/df3/f2c [0,4194304] 0 2024-09-12T22:49:58.183 INFO:tasks.workunit.client.0.smithi066.stdout:2/768: symlink d1/d44/d51/lf8 0 2024-09-12T22:49:58.183 INFO:tasks.workunit.client.0.smithi066.stdout:6/837: getdents d6/d23/d62/d79 0 2024-09-12T22:49:58.183 INFO:tasks.workunit.client.0.smithi066.stdout:4/834: rename d5/d8/d10/de/d2d/lad to d5/d8/d10/de/d39/l11b 0 2024-09-12T22:49:58.183 INFO:tasks.workunit.client.0.smithi066.stdout:3/766: truncate d0/d2/d1d/f2a 3578881 0 2024-09-12T22:49:58.183 INFO:tasks.workunit.client.0.smithi066.stdout:6/838: symlink d6/d7/dcd/l11d 0 2024-09-12T22:49:58.183 INFO:tasks.workunit.client.0.smithi066.stdout:7/681: dwrite d0/d6/f8 [0,4194304] 0 2024-09-12T22:49:58.183 INFO:tasks.workunit.client.0.smithi066.stdout:6/839: symlink d6/d23/d41/l11e 0 2024-09-12T22:49:58.184 INFO:tasks.workunit.client.0.smithi066.stdout:2/769: dread d1/d11/d26/d4f/d5f/d61/d72/ff6 [0,4194304] 0 2024-09-12T22:49:58.184 INFO:tasks.workunit.client.0.smithi066.stdout:7/682: symlink d0/d86/le3 0 2024-09-12T22:49:58.184 INFO:tasks.workunit.client.0.smithi066.stdout:9/774: dwrite d9/df0/ff8 [0,4194304] 0 2024-09-12T22:49:58.184 INFO:tasks.workunit.client.0.smithi066.stdout:4/835: write d5/d8/d10/f40 [2161209,49417] 0 2024-09-12T22:49:58.184 INFO:tasks.workunit.client.0.smithi066.stdout:2/770: rename d1/d11/d26/d4f/d5f/d61/d72/dad/d76/db7/lf1 to d1/dc1/lf9 0 2024-09-12T22:49:58.184 INFO:tasks.workunit.client.0.smithi066.stdout:9/775: creat d9/d31/d58/dbc/da8/ff9 x:0 0 0 2024-09-12T22:49:58.184 INFO:tasks.workunit.client.0.smithi066.stdout:3/767: dwrite d0/d2/d1d/fe9 [0,4194304] 0 2024-09-12T22:49:58.184 INFO:tasks.workunit.client.0.smithi066.stdout:8/775: dread d17/d1b/f86 [0,4194304] 0 2024-09-12T22:49:58.184 INFO:tasks.workunit.client.0.smithi066.stdout:2/771: truncate d1/d11/d53/fb2 222304 0 2024-09-12T22:49:58.184 INFO:tasks.workunit.client.0.smithi066.stdout:7/683: dwrite d0/d6/f21 [0,4194304] 0 2024-09-12T22:49:58.184 INFO:tasks.workunit.client.0.smithi066.stdout:4/836: rename d5/d8/d10/de to d5/d8/d10/de/d2d/d64/d11c 22 2024-09-12T22:49:58.184 INFO:tasks.workunit.client.0.smithi066.stdout:3/768: write d0/d2/d1d/d87/d6b/db2/f72 [3197946,23541] 0 2024-09-12T22:49:58.184 INFO:tasks.workunit.client.0.smithi066.stdout:2/772: dread - d1/d44/df3/d68/fd5 zero size 2024-09-12T22:49:58.184 INFO:tasks.workunit.client.0.smithi066.stdout:8/776: write d17/d2c/f35 [2206309,84547] 0 2024-09-12T22:49:58.185 INFO:tasks.workunit.client.0.smithi066.stdout:9/776: rename d9/d31/d77/dc2/dcb/cef to d9/d31/d58/dbc/da8/cfa 0 2024-09-12T22:49:58.185 INFO:tasks.workunit.client.0.smithi066.stdout:3/769: symlink d0/d2/d1d/d87/d40/da2/l10a 0 2024-09-12T22:49:58.185 INFO:tasks.workunit.client.0.smithi066.stdout:2/773: write d1/d11/d26/d4f/d52/d56/f8a [1289938,95663] 0 2024-09-12T22:49:58.185 INFO:tasks.workunit.client.0.smithi066.stdout:3/770: mkdir d0/d2/d10b 0 2024-09-12T22:49:58.185 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:49:58.185 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:49:58.186 INFO:tasks.workunit.client.0.smithi066.stdout:2/774: write d1/d11/d26/d4f/d7c/faa [371415,85337] 0 2024-09-12T22:49:58.186 INFO:tasks.workunit.client.0.smithi066.stdout:8/777: symlink d17/d49/d4b/d57/d5e/d62/dc1/dd1/dff/l10d 0 2024-09-12T22:49:58.186 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:49:58.187 INFO:tasks.workunit.client.0.smithi066.stdout:3/771: symlink d0/d2/d7/d29/l10c 0 2024-09-12T22:49:58.187 INFO:tasks.workunit.client.0.smithi066.stdout:2/775: write d1/d11/faf [704890,43484] 0 2024-09-12T22:49:58.187 INFO:tasks.workunit.client.0.smithi066.stdout:4/837: dwrite d5/d8/d10/f6a [0,4194304] 0 2024-09-12T22:49:58.187 INFO:tasks.workunit.client.0.smithi066.stdout:3/772: dread - d0/d2/d1d/d87/d49/fd2 zero size 2024-09-12T22:49:58.188 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:49:58.188 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:49:58.201 INFO:tasks.workunit.client.0.smithi066.stdout:2/776: rmdir d1/d44/df3/d12/d18/da8 39 2024-09-12T22:49:58.201 INFO:tasks.workunit.client.0.smithi066.stdout:3/773: symlink d0/d2/d1d/d87/d49/dc8/l10d 0 2024-09-12T22:49:58.201 INFO:tasks.workunit.client.0.smithi066.stdout:4/838: write d5/d3e/d8d/dc7/f99 [853856,105695] 0 2024-09-12T22:49:58.201 INFO:tasks.workunit.client.0.smithi066.stdout:5/839: dread d5/d11/d23/f56 [0,4194304] 0 2024-09-12T22:49:58.201 INFO:tasks.workunit.client.0.smithi066.stdout:8/778: dwrite d17/d40/f4c [0,4194304] 0 2024-09-12T22:49:58.201 INFO:tasks.workunit.client.0.smithi066.stdout:2/777: mknod d1/d11/d53/cfa 0 2024-09-12T22:49:58.201 INFO:tasks.workunit.client.0.smithi066.stdout:3/774: write d0/d2/d1d/d87/d40/dbd/fa5 [824217,55762] 0 2024-09-12T22:49:58.201 INFO:tasks.workunit.client.0.smithi066.stdout:2/778: chown d1/d44/df3/d12/d1e/c9e 7 1 2024-09-12T22:49:58.201 INFO:tasks.workunit.client.0.smithi066.stdout:3/775: write d0/d2/d7/f97 [957006,30571] 0 2024-09-12T22:49:58.202 INFO:tasks.workunit.client.0.smithi066.stdout:4/839: write d5/d8/d10/de/d2d/fa1 [790994,13092] 0 2024-09-12T22:49:58.202 INFO:tasks.workunit.client.0.smithi066.stdout:1/737: dread d0/f16 [0,4194304] 0 2024-09-12T22:49:58.202 INFO:tasks.workunit.client.0.smithi066.stdout:1/738: stat d0/dc/d1e/d95/ca 0 2024-09-12T22:49:58.202 INFO:tasks.workunit.client.0.smithi066.stdout:9/777: truncate d9/dc/f88 208301 0 2024-09-12T22:49:58.202 INFO:tasks.workunit.client.0.smithi066.stdout:2/779: rename d1/db/d42/d43/f85 to d1/d11/d26/d4f/ffb 0 2024-09-12T22:49:58.202 INFO:tasks.workunit.client.0.smithi066.stdout:1/739: write d0/d4e/d79/d86/f92 [4239398,71532] 0 2024-09-12T22:49:58.202 INFO:tasks.workunit.client.0.smithi066.stdout:9/778: unlink d9/dc/dd2/cd8 0 2024-09-12T22:49:58.202 INFO:tasks.workunit.client.0.smithi066.stdout:1/740: chown d0/d89/dd7/fd4 78 1 2024-09-12T22:49:58.202 INFO:tasks.workunit.client.0.smithi066.stdout:6/840: dread d6/d23/d25/f97 [0,4194304] 0 2024-09-12T22:49:58.202 INFO:tasks.workunit.client.0.smithi066.stdout:3/776: dwrite d0/d2/d7/f66 [0,4194304] 0 2024-09-12T22:49:58.202 INFO:tasks.workunit.client.0.smithi066.stdout:6/841: write d6/f96 [4936395,108927] 0 2024-09-12T22:49:58.202 INFO:tasks.workunit.client.0.smithi066.stdout:5/840: dwrite d5/d11/d23/d6f/daa/dbb/dc6/de1/fd1 [0,4194304] 0 2024-09-12T22:49:58.202 INFO:tasks.workunit.client.0.smithi066.stdout:5/841: readlink d5/de/l91 0 2024-09-12T22:49:58.202 INFO:tasks.workunit.client.0.smithi066.stdout:7/684: dread d0/d19/d60/f52 [0,4194304] 0 2024-09-12T22:49:58.203 INFO:tasks.workunit.client.0.smithi066.stdout:1/741: write d0/dc/d1e/d47/f9b [1191882,112967] 0 2024-09-12T22:49:58.203 INFO:tasks.workunit.client.0.smithi066.stdout:3/777: creat d0/d2/d7/f10e x:0 0 0 2024-09-12T22:49:58.203 INFO:tasks.workunit.client.0.smithi066.stdout:1/742: dread - d0/dc/fdb zero size 2024-09-12T22:49:58.203 INFO:tasks.workunit.client.0.smithi066.stdout:9/779: dwrite d9/df0/d8c/de2/ff7 [0,4194304] 0 2024-09-12T22:49:58.203 INFO:tasks.workunit.client.0.smithi066.stdout:6/842: creat d6/d7/dc/f11f x:0 0 0 2024-09-12T22:49:58.203 INFO:tasks.workunit.client.0.smithi066.stdout:7/685: truncate d0/d19/d26/d48/d84/f91 4472176 0 2024-09-12T22:49:58.203 INFO:tasks.workunit.client.0.smithi066.stdout:1/743: symlink d0/d89/dd7/led 0 2024-09-12T22:49:58.203 INFO:tasks.workunit.client.0.smithi066.stdout:3/778: write d0/d2/d1d/d87/d40/dd1/ff0 [710960,54043] 0 2024-09-12T22:49:58.203 INFO:tasks.workunit.client.0.smithi066.stdout:1/744: readlink d0/dc/d1e/d95/dcb/ld2 0 2024-09-12T22:49:58.203 INFO:tasks.workunit.client.0.smithi066.stdout:6/843: truncate d6/d49/f9e 4306299 0 2024-09-12T22:49:58.203 INFO:tasks.workunit.client.0.smithi066.stdout:5/842: dwrite d5/d11/d23/f4e [0,4194304] 0 2024-09-12T22:49:58.203 INFO:tasks.workunit.client.0.smithi066.stdout:7/686: getdents d0/d6 0 2024-09-12T22:49:58.203 INFO:tasks.workunit.client.0.smithi066.stdout:3/779: creat d0/d2/d6/d7a/f10f x:0 0 0 2024-09-12T22:49:58.204 INFO:tasks.workunit.client.0.smithi066.stdout:5/843: stat d5/d11/l86 0 2024-09-12T22:49:58.204 INFO:tasks.workunit.client.0.smithi066.stdout:7/687: write d0/d19/d60/fd4 [205100,11405] 0 2024-09-12T22:49:58.204 INFO:tasks.workunit.client.0.smithi066.stdout:5/844: write d5/d11/d23/f5c [1244335,11645] 0 2024-09-12T22:49:58.204 INFO:tasks.workunit.client.0.smithi066.stdout:6/844: write d6/d23/d25/d2c/d69/f10d [135559,89175] 0 2024-09-12T22:49:58.204 INFO:tasks.workunit.client.0.smithi066.stdout:5/845: stat d5/de/d50/da0 0 2024-09-12T22:49:58.204 INFO:tasks.workunit.client.0.smithi066.stdout:5/846: stat d5/d11/d7c/fc0 0 2024-09-12T22:49:58.204 INFO:tasks.workunit.client.0.smithi066.stdout:7/688: rmdir d0/d19 39 2024-09-12T22:49:58.204 INFO:tasks.workunit.client.0.smithi066.stdout:6/845: write d6/d59/f77 [4976629,40937] 0 2024-09-12T22:49:58.204 INFO:tasks.workunit.client.0.smithi066.stdout:3/780: creat d0/d2/d6/df6/f110 x:0 0 0 2024-09-12T22:49:58.204 INFO:tasks.workunit.client.0.smithi066.stdout:7/689: fsync d0/d19/d24/f1f 0 2024-09-12T22:49:58.204 INFO:tasks.workunit.client.0.smithi066.stdout:6/846: truncate d6/d7/dc/f11f 780554 0 2024-09-12T22:49:58.204 INFO:tasks.workunit.client.0.smithi066.stdout:5/847: truncate d5/d11/d7c/dc3/dc7/fe3 1154888 0 2024-09-12T22:49:58.204 INFO:tasks.workunit.client.0.smithi066.stdout:8/779: dread d17/d2c/f32 [0,4194304] 0 2024-09-12T22:49:58.205 INFO:tasks.workunit.client.0.smithi066.stdout:3/781: rename d0/d2/d1d/d87/d40/d44/c8b to d0/d2/d10b/c111 0 2024-09-12T22:49:58.205 INFO:tasks.workunit.client.0.smithi066.stdout:6/847: creat d6/d35/f120 x:0 0 0 2024-09-12T22:49:58.205 INFO:tasks.workunit.client.0.smithi066.stdout:7/690: dread d0/d19/d60/f52 [0,4194304] 0 2024-09-12T22:49:58.205 INFO:tasks.workunit.client.0.smithi066.stdout:3/782: creat d0/db3/f112 x:0 0 0 2024-09-12T22:49:58.205 INFO:tasks.workunit.client.0.smithi066.stdout:5/848: rmdir d5/d11/d7c/dc3/dc7 39 2024-09-12T22:49:58.205 INFO:tasks.workunit.client.0.smithi066.stdout:3/783: stat d0/d2/d1d/d87/d40/dbd/f4c 0 2024-09-12T22:49:58.205 INFO:tasks.workunit.client.0.smithi066.stdout:6/848: symlink d6/d7/dcd/l121 0 2024-09-12T22:49:58.205 INFO:tasks.workunit.client.0.smithi066.stdout:5/849: rename d5/d14/f69 to d5/d11/d7c/dc3/dc7/f101 0 2024-09-12T22:49:58.205 INFO:tasks.workunit.client.0.smithi066.stdout:3/784: mknod d0/d2/d1d/d87/d6b/db2/c113 0 2024-09-12T22:49:58.205 INFO:tasks.workunit.client.0.smithi066.stdout:6/849: write d6/d23/f3e [4514133,73051] 0 2024-09-12T22:49:58.205 INFO:tasks.workunit.client.0.smithi066.stdout:5/850: read - d5/d11/d23/d6f/dee/f100 zero size 2024-09-12T22:49:58.205 INFO:tasks.workunit.client.0.smithi066.stdout:3/785: stat d0/d2/d1d/d87/d6b 0 2024-09-12T22:49:58.205 INFO:tasks.workunit.client.0.smithi066.stdout:6/850: creat d6/d59/df3/f122 x:0 0 0 2024-09-12T22:49:58.205 INFO:tasks.workunit.client.0.smithi066.stdout:0/776: sync 2024-09-12T22:49:58.206 INFO:tasks.workunit.client.0.smithi066.stdout:5/851: write d5/de/d50/d42/d9d/fbc [853766,97979] 0 2024-09-12T22:49:58.206 INFO:tasks.workunit.client.0.smithi066.stdout:3/786: rename d0/d2/d1d/d87/d6b/db2/c53 to d0/d2/d6/df9/c114 0 2024-09-12T22:49:58.206 INFO:tasks.workunit.client.0.smithi066.stdout:9/780: truncate d9/dc/f56 1823128 0 2024-09-12T22:49:58.206 INFO:tasks.workunit.client.0.smithi066.stdout:5/852: rename d5/d11/d7c/dc3/fc9 to d5/d11/d23/d6f/daa/dbb/dc6/de1/f102 0 2024-09-12T22:49:58.206 INFO:tasks.workunit.client.0.smithi066.stdout:3/787: creat d0/d2/d1d/d87/d49/f115 x:0 0 0 2024-09-12T22:49:58.206 INFO:tasks.workunit.client.0.smithi066.stdout:3/788: mkdir d0/d2/d7/dc4/d116 0 2024-09-12T22:49:58.206 INFO:tasks.workunit.client.0.smithi066.stdout:6/851: dwrite d6/d7/feb [0,4194304] 0 2024-09-12T22:49:58.206 INFO:tasks.workunit.client.0.smithi066.stdout:0/777: dwrite d1/f51 [0,4194304] 0 2024-09-12T22:49:58.206 INFO:tasks.workunit.client.0.smithi066.stdout:3/789: write d0/d2/d7/d29/fe3 [4920821,82160] 0 2024-09-12T22:49:58.206 INFO:tasks.workunit.client.0.smithi066.stdout:1/745: truncate d0/dc/fb5 1865349 0 2024-09-12T22:49:58.206 INFO:tasks.workunit.client.0.smithi066.stdout:9/781: rename d9/d31/d58/da4/cb7 to d9/dc/d46/d8a/cfb 0 2024-09-12T22:49:58.206 INFO:tasks.workunit.client.0.smithi066.stdout:0/778: symlink d1/d8/d1f/d30/l115 0 2024-09-12T22:49:58.206 INFO:tasks.workunit.client.0.smithi066.stdout:3/790: fdatasync d0/d2/d6/f18 0 2024-09-12T22:49:58.207 INFO:tasks.workunit.client.0.smithi066.stdout:6/852: rename d6/d23/d25/d2c/d69/f10d to d6/d23/d41/db6/dd3/df9/f123 0 2024-09-12T22:49:58.207 INFO:tasks.workunit.client.0.smithi066.stdout:0/779: fsync d1/d36/d65/fb6 0 2024-09-12T22:49:58.207 INFO:tasks.workunit.client.0.smithi066.stdout:5/853: dwrite d5/d11/d21/d4d/fc2 [0,4194304] 0 2024-09-12T22:49:58.207 INFO:tasks.workunit.client.0.smithi066.stdout:3/791: symlink d0/db3/l117 0 2024-09-12T22:49:58.207 INFO:tasks.workunit.client.0.smithi066.stdout:5/854: stat d5/de/d50/d42/d49/f77 0 2024-09-12T22:49:58.207 INFO:tasks.workunit.client.0.smithi066.stdout:3/792: write d0/d2/d1d/d87/d49/f115 [885270,122912] 0 2024-09-12T22:49:58.207 INFO:tasks.workunit.client.0.smithi066.stdout:0/780: getdents d1/d8/df5/de2 0 2024-09-12T22:49:58.207 INFO:tasks.workunit.client.0.smithi066.stdout:6/853: getdents d6/d7 0 2024-09-12T22:49:58.207 INFO:tasks.workunit.client.0.smithi066.stdout:0/781: fdatasync d1/d8/d1f/d30/f70 0 2024-09-12T22:49:58.207 INFO:tasks.workunit.client.0.smithi066.stdout:6/854: chown d6/d23/d41/db6/dd3/df9/f123 2771182 1 2024-09-12T22:49:58.207 INFO:tasks.workunit.client.0.smithi066.stdout:3/793: symlink d0/d2/d1d/d87/d40/d44/d55/l118 0 2024-09-12T22:49:58.207 INFO:tasks.workunit.client.0.smithi066.stdout:6/855: write d6/d23/f27 [646538,121197] 0 2024-09-12T22:49:58.207 INFO:tasks.workunit.client.0.smithi066.stdout:9/782: dwrite d9/d31/d77/d8f/fb3 [0,4194304] 0 2024-09-12T22:49:58.208 INFO:tasks.workunit.client.0.smithi066.stdout:6/856: dread - d6/d35/f120 zero size 2024-09-12T22:49:58.208 INFO:tasks.workunit.client.0.smithi066.stdout:0/782: rename d1/d8/d1f/d47/l94 to d1/d8/d1c/d13/d2f/d8a/de1/l116 0 2024-09-12T22:49:58.208 INFO:tasks.workunit.client.0.smithi066.stdout:6/857: mkdir d6/d23/d25/d4e/dc4/d99/d101/d124 0 2024-09-12T22:49:58.208 INFO:tasks.workunit.client.0.smithi066.stdout:0/783: mkdir d1/dbf/d117 0 2024-09-12T22:49:58.208 INFO:tasks.workunit.client.0.smithi066.stdout:6/858: link d6/d35/c11c d6/d23/d25/d2c/d69/c125 0 2024-09-12T22:49:58.208 INFO:tasks.workunit.client.0.smithi066.stdout:6/859: chown d6/d23/d25/d4e/dc4/d32/dce/fee 856289113 1 2024-09-12T22:49:58.208 INFO:tasks.workunit.client.0.smithi066.stdout:3/794: dread d0/d2/d1d/d87/d40/dbd/fab [0,4194304] 0 2024-09-12T22:49:58.208 INFO:tasks.workunit.client.0.smithi066.stdout:3/795: rmdir d0/d2/d1d/d87/d40/dd1 39 2024-09-12T22:49:58.208 INFO:tasks.workunit.client.0.smithi066.stdout:3/796: symlink d0/d2/d1d/d87/d40/dbd/l119 0 2024-09-12T22:49:58.208 INFO:tasks.workunit.client.0.smithi066.stdout:3/797: creat d0/d2/d7/d29/f11a x:0 0 0 2024-09-12T22:49:58.208 INFO:tasks.workunit.client.0.smithi066.stdout:3/798: symlink d0/d2/d1d/d87/d40/dbd/d74/l11b 0 2024-09-12T22:49:58.208 INFO:tasks.workunit.client.0.smithi066.stdout:5/855: write d5/de/f95 [698460,93109] 0 2024-09-12T22:49:58.208 INFO:tasks.workunit.client.0.smithi066.stdout:3/799: dread - d0/d2/d1d/d87/d49/dc8/ff7 zero size 2024-09-12T22:49:58.209 INFO:tasks.workunit.client.0.smithi066.stdout:3/800: creat d0/d2/d7/dc4/f11c x:0 0 0 2024-09-12T22:49:58.209 INFO:tasks.workunit.client.0.smithi066.stdout:5/856: rename d5/d11/d7c/dc3 to d5/d103 0 2024-09-12T22:49:58.209 INFO:tasks.workunit.client.0.smithi066.stdout:7/691: dread d0/d19/d24/f12 [4194304,4194304] 0 2024-09-12T22:49:58.209 INFO:tasks.workunit.client.0.smithi066.stdout:7/692: write d0/d19/d26/f47 [4643318,110883] 0 2024-09-12T22:49:58.209 INFO:tasks.workunit.client.0.smithi066.stdout:3/801: getdents d0/d2/d1d/d87/d40/dd0 0 2024-09-12T22:49:58.209 INFO:tasks.workunit.client.0.smithi066.stdout:5/857: link d5/d103/dc7/lfe d5/d11/d23/d6f/dee/l104 0 2024-09-12T22:49:58.209 INFO:tasks.workunit.client.0.smithi066.stdout:7/693: write d0/d19/d24/d33/d27/d70/fde [90292,111114] 0 2024-09-12T22:49:58.209 INFO:tasks.workunit.client.0.smithi066.stdout:5/858: creat d5/d11/d5d/d64/d8f/f105 x:0 0 0 2024-09-12T22:49:58.209 INFO:tasks.workunit.client.0.smithi066.stdout:3/802: write d0/d2/d1d/d87/d40/dd1/ff0 [764018,70513] 0 2024-09-12T22:49:58.209 INFO:tasks.workunit.client.0.smithi066.stdout:3/803: mknod d0/d2/d1d/d87/c11d 0 2024-09-12T22:49:58.209 INFO:tasks.workunit.client.0.smithi066.stdout:3/804: fdatasync d0/d2/d1d/d87/d49/f5a 0 2024-09-12T22:49:58.209 INFO:tasks.workunit.client.0.smithi066.stdout:7/694: getdents d0/d19/d24/d33/d27/d70/d90/db8 0 2024-09-12T22:49:58.209 INFO:tasks.workunit.client.0.smithi066.stdout:7/695: creat d0/d19/d26/dbe/fe4 x:0 0 0 2024-09-12T22:49:58.209 INFO:tasks.workunit.client.0.smithi066.stdout:5/859: dwrite d5/d11/d5d/d8a/fcb [0,4194304] 0 2024-09-12T22:49:58.210 INFO:tasks.workunit.client.0.smithi066.stdout:3/805: dwrite d0/d2/d1d/d87/d40/dbd/fa5 [0,4194304] 0 2024-09-12T22:49:58.210 INFO:tasks.workunit.client.0.smithi066.stdout:7/696: write d0/d19/d24/d33/f78 [2757167,56845] 0 2024-09-12T22:49:58.210 INFO:tasks.workunit.client.0.smithi066.stdout:6/860: dread d6/d23/f3e [0,4194304] 0 2024-09-12T22:49:58.210 INFO:tasks.workunit.client.0.smithi066.stdout:1/746: dread d0/d36/d57/f3f [0,4194304] 0 2024-09-12T22:49:58.210 INFO:tasks.workunit.client.0.smithi066.stdout:3/806: write d0/d2/d7/d29/f3d [852958,42327] 0 2024-09-12T22:49:58.210 INFO:tasks.workunit.client.0.smithi066.stdout:1/747: stat d0/dc/d1e/d95/dcb/fdc 0 2024-09-12T22:49:58.210 INFO:tasks.workunit.client.0.smithi066.stdout:1/748: write d0/f1c [1709705,105237] 0 2024-09-12T22:49:58.210 INFO:tasks.workunit.client.0.smithi066.stdout:7/697: mkdir d0/d19/d24/d33/d27/dba/dc9/de5 0 2024-09-12T22:49:58.210 INFO:tasks.workunit.client.0.smithi066.stdout:1/749: dread - d0/d36/d57/f70 zero size 2024-09-12T22:49:58.210 INFO:tasks.workunit.client.0.smithi066.stdout:1/750: dread - d0/dc/d8f/fb8 zero size 2024-09-12T22:49:58.210 INFO:tasks.workunit.client.0.smithi066.stdout:5/860: dread d5/d11/d23/f5c [0,4194304] 0 2024-09-12T22:49:58.210 INFO:tasks.workunit.client.0.smithi066.stdout:1/751: chown d0/dc/d1d/l8d 12699 1 2024-09-12T22:49:58.210 INFO:tasks.workunit.client.0.smithi066.stdout:1/752: mknod d0/d89/dd7/dd5/cee 0 2024-09-12T22:49:58.210 INFO:tasks.workunit.client.0.smithi066.stdout:0/784: dread d1/d8/f63 [0,4194304] 0 2024-09-12T22:49:58.211 INFO:tasks.workunit.client.0.smithi066.stdout:1/753: creat d0/dc0/fef x:0 0 0 2024-09-12T22:49:58.211 INFO:tasks.workunit.client.0.smithi066.stdout:0/785: write d1/d8/d1b/d59/faf [4980592,112892] 0 2024-09-12T22:49:58.211 INFO:tasks.workunit.client.0.smithi066.stdout:0/786: rename d1/d8/f63 to d1/d36/d65/de9/f118 0 2024-09-12T22:49:58.211 INFO:tasks.workunit.client.0.smithi066.stdout:7/698: dread d0/d19/d60/d85/d8b/f98 [0,4194304] 0 2024-09-12T22:49:58.211 INFO:tasks.workunit.client.0.smithi066.stdout:0/787: symlink d1/d36/d65/dc2/dd7/l119 0 2024-09-12T22:49:58.211 INFO:tasks.workunit.client.0.smithi066.stdout:7/699: mkdir d0/d19/d60/d85/de6 0 2024-09-12T22:49:58.211 INFO:tasks.workunit.client.0.smithi066.stdout:0/788: dread - d1/d8/d1b/d88/fc9 zero size 2024-09-12T22:49:58.211 INFO:tasks.workunit.client.0.smithi066.stdout:7/700: chown d0/d19/d24/d33/d27/l4e 61768 1 2024-09-12T22:49:58.211 INFO:tasks.workunit.client.0.smithi066.stdout:0/789: fdatasync d1/d8/d1b/dac/fe0 0 2024-09-12T22:49:58.211 INFO:tasks.workunit.client.0.smithi066.stdout:3/807: truncate d0/d2/d1d/d87/d6b/fe0 85883 0 2024-09-12T22:49:58.211 INFO:tasks.workunit.client.0.smithi066.stdout:3/808: write d0/d2/f2c [329482,6929] 0 2024-09-12T22:49:58.211 INFO:tasks.workunit.client.0.smithi066.stdout:7/701: link d0/d19/d60/f51 d0/d6/d83/fe7 0 2024-09-12T22:49:58.211 INFO:tasks.workunit.client.0.smithi066.stdout:7/702: fsync d0/d6/f8 0 2024-09-12T22:49:58.212 INFO:tasks.workunit.client.0.smithi066.stdout:3/809: write d0/d2/d1d/d87/d40/dd1/ff0 [729340,69762] 0 2024-09-12T22:49:58.212 INFO:tasks.workunit.client.0.smithi066.stdout:7/703: read - d0/d19/d24/fa3 zero size 2024-09-12T22:49:58.212 INFO:tasks.workunit.client.0.smithi066.stdout:3/810: symlink d0/db3/l11e 0 2024-09-12T22:49:58.212 INFO:tasks.workunit.client.0.smithi066.stdout:7/704: fsync d0/d19/d26/d48/d59/f68 0 2024-09-12T22:49:58.212 INFO:tasks.workunit.client.0.smithi066.stdout:3/811: chown d0/d2/d7/dc4/f11c 5658 1 2024-09-12T22:49:58.213 INFO:tasks.workunit.client.0.smithi066.stdout:7/705: truncate d0/d19/d24/fc5 12114 0 2024-09-12T22:49:58.214 INFO:tasks.workunit.client.0.smithi066.stdout:7/706: creat d0/d6/d83/fe8 x:0 0 0 2024-09-12T22:49:58.214 INFO:tasks.workunit.client.0.smithi066.stdout:3/812: dwrite d0/d2/d7/d29/f3d [0,4194304] 0 2024-09-12T22:49:58.214 INFO:tasks.workunit.client.0.smithi066.stdout:3/813: truncate d0/db3/db7/fd6 236298 0 2024-09-12T22:49:58.214 INFO:tasks.workunit.client.0.smithi066.stdout:3/814: truncate d0/d2/d7/d29/f11a 529022 0 2024-09-12T22:49:58.214 INFO:tasks.workunit.client.0.smithi066.stdout:3/815: mknod d0/d2/d7/dc4/dcf/c11f 0 2024-09-12T22:49:58.214 INFO:tasks.workunit.client.0.smithi066.stdout:0/790: dread d1/d8/d1b/dac/fe0 [0,4194304] 0 2024-09-12T22:49:58.214 INFO:tasks.workunit.client.0.smithi066.stdout:4/840: sync 2024-09-12T22:49:58.214 INFO:tasks.workunit.client.0.smithi066.stdout:2/780: sync 2024-09-12T22:49:58.214 INFO:tasks.workunit.client.0.smithi066.stdout:8/780: sync 2024-09-12T22:49:58.214 INFO:tasks.workunit.client.0.smithi066.stdout:3/816: mkdir d0/d2/d7/d120 0 2024-09-12T22:49:58.214 INFO:tasks.workunit.client.0.smithi066.stdout:4/841: readlink d5/d8/d10/de/le1 0 2024-09-12T22:49:58.214 INFO:tasks.workunit.client.0.smithi066.stdout:2/781: mknod d1/d44/df3/d68/dbc/cfc 0 2024-09-12T22:49:58.214 INFO:tasks.workunit.client.0.smithi066.stdout:4/842: chown d5/d8/d10/de/d39 882883582 1 2024-09-12T22:49:58.215 INFO:tasks.workunit.client.0.smithi066.stdout:8/781: getdents d17/d49/d4b/d57/d5e/d62/dc1 0 2024-09-12T22:49:58.215 INFO:tasks.workunit.client.0.smithi066.stdout:2/782: creat d1/d44/df3/d12/de2/ded/ffd x:0 0 0 2024-09-12T22:49:58.215 INFO:tasks.workunit.client.0.smithi066.stdout:3/817: dread d0/d2/d1d/d87/d40/dbd/fab [0,4194304] 0 2024-09-12T22:49:58.215 INFO:tasks.workunit.client.0.smithi066.stdout:4/843: unlink d5/d8/d16/d1b/d1e/d5a/f85 0 2024-09-12T22:49:58.215 INFO:tasks.workunit.client.0.smithi066.stdout:8/782: mkdir d17/d2c/dab/d10e 0 2024-09-12T22:49:58.216 INFO:tasks.workunit.client.0.smithi066.stdout:4/844: rmdir d5/d3e/d65/dac 39 2024-09-12T22:49:58.216 INFO:tasks.workunit.client.0.smithi066.stdout:3/818: chown d0/d2/d1d/d87/d40/dbd/fa5 3106 1 2024-09-12T22:49:58.216 INFO:tasks.workunit.client.0.smithi066.stdout:2/783: rename d1/la3 to d1/d44/d51/lfe 0 2024-09-12T22:49:58.216 INFO:tasks.workunit.client.0.smithi066.stdout:4/845: chown d5/d8/d16/fa0 810460 1 2024-09-12T22:49:58.216 INFO:tasks.workunit.client.0.smithi066.stdout:3/819: write d0/d2/d6/d7a/f10f [294892,114859] 0 2024-09-12T22:49:58.216 INFO:tasks.workunit.client.0.smithi066.stdout:8/783: write d17/d40/d47/d66/f78 [1579517,83167] 0 2024-09-12T22:49:58.217 INFO:tasks.workunit.client.0.smithi066.stdout:2/784: creat d1/d11/d26/d4f/d5f/d61/fff x:0 0 0 2024-09-12T22:49:58.217 INFO:tasks.workunit.client.0.smithi066.stdout:4/846: stat d5/d8/d16/d1b/d1e/d5a/fd2 0 2024-09-12T22:49:58.217 INFO:tasks.workunit.client.0.smithi066.stdout:1/754: dread d0/dc/d1e/d95/dcb/fd3 [0,4194304] 0 2024-09-12T22:49:58.217 INFO:tasks.workunit.client.0.smithi066.stdout:8/784: write d17/d40/f52 [3848840,121222] 0 2024-09-12T22:49:58.218 INFO:tasks.workunit.client.0.smithi066.stdout:3/820: creat d0/d2/d7/d13/dc1/f121 x:0 0 0 2024-09-12T22:49:58.218 INFO:tasks.workunit.client.0.smithi066.stdout:1/755: readlink d0/dc/d1d/l83 0 2024-09-12T22:49:58.218 INFO:tasks.workunit.client.0.smithi066.stdout:8/785: symlink d17/d1b/de7/l10f 0 2024-09-12T22:49:58.218 INFO:tasks.workunit.client.0.smithi066.stdout:4/847: chown d5/d8/d16/d93/d9c/d98/fdf 1 1 2024-09-12T22:49:58.219 INFO:tasks.workunit.client.0.smithi066.stdout:1/756: getdents d0/dc0 0 2024-09-12T22:49:58.220 INFO:tasks.workunit.client.0.smithi066.stdout:4/848: rename d5/d8/d10/de/d39/l11b to d5/d8/d16/d93/d9c/l11d 0 2024-09-12T22:49:58.222 INFO:tasks.workunit.client.0.smithi066.stdout:1/757: link d0/d89/dd7/f6c d0/d4e/d79/d86/ff0 0 2024-09-12T22:49:58.223 INFO:tasks.workunit.client.0.smithi066.stdout:4/849: write d5/d8/d16/d1b/d1e/d1f/d8c/fcc [3671366,38666] 0 2024-09-12T22:49:58.223 INFO:tasks.workunit.client.0.smithi066.stdout:8/786: dread d17/f42 [0,4194304] 0 2024-09-12T22:49:58.224 INFO:tasks.workunit.client.0.smithi066.stdout:3/821: dwrite d0/d2/d7/dc4/dcf/fed [0,4194304] 0 2024-09-12T22:49:58.226 INFO:tasks.workunit.client.0.smithi066.stdout:7/707: dread d0/d19/d26/d48/d84/f91 [0,4194304] 0 2024-09-12T22:49:58.226 INFO:tasks.workunit.client.0.smithi066.stdout:3/822: symlink d0/l122 0 2024-09-12T22:49:58.226 INFO:tasks.workunit.client.0.smithi066.stdout:4/850: creat d5/d8/d16/d1b/d1e/f11e x:0 0 0 2024-09-12T22:49:58.228 INFO:tasks.workunit.client.0.smithi066.stdout:3/823: chown d0/d2/d1d/leb 114 1 2024-09-12T22:49:58.228 INFO:tasks.workunit.client.0.smithi066.stdout:0/791: dwrite d1/d8/d1b/dac/fe0 [0,4194304] 0 2024-09-12T22:49:58.229 INFO:tasks.workunit.client.0.smithi066.stdout:1/758: dread d0/f16 [0,4194304] 0 2024-09-12T22:49:58.229 INFO:tasks.workunit.client.0.smithi066.stdout:4/851: chown d5/d8/d16/d1b/d1e/d1f/d8c/l9d 1 1 2024-09-12T22:49:58.229 INFO:tasks.workunit.client.0.smithi066.stdout:3/824: read d0/d2/d6/f18 [3782326,16947] 0 2024-09-12T22:49:58.229 INFO:tasks.workunit.client.0.smithi066.stdout:4/852: stat d5/d3e/d65 0 2024-09-12T22:49:58.230 INFO:tasks.workunit.client.0.smithi066.stdout:1/759: write d0/d36/d57/f70 [651463,16025] 0 2024-09-12T22:49:58.230 INFO:tasks.workunit.client.0.smithi066.stdout:3/825: readlink d0/d2/d6/d7a/l99 0 2024-09-12T22:49:58.231 INFO:tasks.workunit.client.0.smithi066.stdout:7/708: write d0/d19/d60/f3c [2817795,105013] 0 2024-09-12T22:49:58.231 INFO:tasks.workunit.client.0.smithi066.stdout:3/826: write d0/d2/d1d/fc2 [72738,74613] 0 2024-09-12T22:49:58.231 INFO:tasks.workunit.client.0.smithi066.stdout:7/709: creat d0/d19/d26/d48/d59/fe9 x:0 0 0 2024-09-12T22:49:58.232 INFO:tasks.workunit.client.0.smithi066.stdout:1/760: truncate d0/d36/d57/f3e 5665679 0 2024-09-12T22:49:58.233 INFO:tasks.workunit.client.0.smithi066.stdout:3/827: write d0/d2/d1d/d87/d6b/fbe [2694068,120137] 0 2024-09-12T22:49:58.233 INFO:tasks.workunit.client.0.smithi066.stdout:7/710: readlink d0/d19/d26/dbe/lc6 0 2024-09-12T22:49:58.233 INFO:tasks.workunit.client.0.smithi066.stdout:4/853: truncate d5/d8/d16/d1b/d72/fe3 408017 0 2024-09-12T22:49:58.233 INFO:tasks.workunit.client.0.smithi066.stdout:4/854: chown d5/f4f 75946159 1 2024-09-12T22:49:58.234 INFO:tasks.workunit.client.0.smithi066.stdout:1/761: write d0/dc/d1e/fbb [236558,113654] 0 2024-09-12T22:49:58.234 INFO:tasks.workunit.client.0.smithi066.stdout:7/711: dread d0/d6/fcd [0,4194304] 0 2024-09-12T22:49:58.234 INFO:tasks.workunit.client.0.smithi066.stdout:3/828: write d0/db3/db7/fd6 [94050,39137] 0 2024-09-12T22:49:58.234 INFO:tasks.workunit.client.0.smithi066.stdout:1/762: symlink d0/d4e/d79/d86/lf1 0 2024-09-12T22:49:58.235 INFO:tasks.workunit.client.0.smithi066.stdout:7/712: creat d0/d19/d74/fea x:0 0 0 2024-09-12T22:49:58.235 INFO:tasks.workunit.client.0.smithi066.stdout:3/829: creat d0/d2/d1d/d87/d49/dc8/f123 x:0 0 0 2024-09-12T22:49:58.236 INFO:tasks.workunit.client.0.smithi066.stdout:7/713: dread - d0/d19/d26/d48/d59/fe9 zero size 2024-09-12T22:49:58.236 INFO:tasks.workunit.client.0.smithi066.stdout:1/763: read d0/d89/dd7/f6d [459380,123780] 0 2024-09-12T22:49:58.237 INFO:tasks.workunit.client.0.smithi066.stdout:1/764: readlink d0/dc/d1d/l53 0 2024-09-12T22:49:58.238 INFO:tasks.workunit.client.0.smithi066.stdout:1/765: mkdir d0/dc/d1e/d95/df2 0 2024-09-12T22:49:58.239 INFO:tasks.workunit.client.0.smithi066.stdout:1/766: write d0/d4e/f5a [5126945,24349] 0 2024-09-12T22:49:58.240 INFO:tasks.workunit.client.0.smithi066.stdout:3/830: dwrite d0/d2/d7/d29/daf/fa3 [0,4194304] 0 2024-09-12T22:49:58.240 INFO:tasks.workunit.client.0.smithi066.stdout:7/714: truncate d0/d19/d24/d33/f34 928395 0 2024-09-12T22:49:58.241 INFO:tasks.workunit.client.0.smithi066.stdout:3/831: creat d0/d2/d1d/d87/d49/dc8/f124 x:0 0 0 2024-09-12T22:49:58.241 INFO:tasks.workunit.client.0.smithi066.stdout:7/715: readlink d0/d19/d26/l7a 0 2024-09-12T22:49:58.242 INFO:tasks.workunit.client.0.smithi066.stdout:3/832: symlink d0/d2/d6/l125 0 2024-09-12T22:49:58.244 INFO:tasks.workunit.client.0.smithi066.stdout:1/767: truncate d0/dc/d1e/d47/f9b 2961153 0 2024-09-12T22:49:58.247 INFO:tasks.workunit.client.0.smithi066.stdout:3/833: dwrite d0/d2/d6/f7d [0,4194304] 0 2024-09-12T22:49:58.249 INFO:tasks.workunit.client.0.smithi066.stdout:1/768: dwrite d0/dc/d8f/fe7 [0,4194304] 0 2024-09-12T22:49:58.250 INFO:tasks.workunit.client.0.smithi066.stdout:1/769: dread - d0/d89/fe6 zero size 2024-09-12T22:49:58.251 INFO:tasks.workunit.client.0.smithi066.stdout:1/770: mkdir d0/dc/d1e/d95/dcb/df3 0 2024-09-12T22:49:58.251 INFO:tasks.workunit.client.0.smithi066.stdout:3/834: getdents d0/d2/d7/d13 0 2024-09-12T22:49:58.252 INFO:tasks.workunit.client.0.smithi066.stdout:1/771: write d0/dc/d1e/d47/fe4 [1751232,15121] 0 2024-09-12T22:49:58.253 INFO:tasks.workunit.client.0.smithi066.stdout:3/835: creat d0/d2/d1d/d87/d40/dff/f126 x:0 0 0 2024-09-12T22:49:58.253 INFO:tasks.workunit.client.0.smithi066.stdout:4/855: dread d5/fe4 [0,4194304] 0 2024-09-12T22:49:58.254 INFO:tasks.workunit.client.0.smithi066.stdout:4/856: chown d5/d8/d10/de/d2d/d64/d104/d114 1011520 1 2024-09-12T22:49:58.254 INFO:tasks.workunit.client.0.smithi066.stdout:4/857: fdatasync d5/d87/ffe 0 2024-09-12T22:49:58.255 INFO:tasks.workunit.client.0.smithi066.stdout:4/858: stat d5/d3e/d8d/dc7/l96 0 2024-09-12T22:49:58.257 INFO:tasks.workunit.client.0.smithi066.stdout:4/859: getdents d5/d8/d16/d1b/d1e/d1f 0 2024-09-12T22:49:58.257 INFO:tasks.workunit.client.0.smithi066.stdout:3/836: truncate d0/d2/d1d/d87/d40/d44/d55/d91/dcb/f107 3422145 0 2024-09-12T22:49:58.259 INFO:tasks.workunit.client.0.smithi066.stdout:0/792: dread d1/d8/d1c/d13/d2f/dd8/f28 [0,4194304] 0 2024-09-12T22:49:58.260 INFO:tasks.workunit.client.0.smithi066.stdout:6/861: sync 2024-09-12T22:49:58.260 INFO:tasks.workunit.client.0.smithi066.stdout:5/861: sync 2024-09-12T22:49:58.260 INFO:tasks.workunit.client.0.smithi066.stdout:9/783: sync 2024-09-12T22:49:58.260 INFO:tasks.workunit.client.0.smithi066.stdout:2/785: sync 2024-09-12T22:49:58.260 INFO:tasks.workunit.client.0.smithi066.stdout:8/787: sync 2024-09-12T22:49:58.260 INFO:tasks.workunit.client.0.smithi066.stdout:0/793: write d1/d8/d1c/fb3 [441295,32110] 0 2024-09-12T22:49:58.261 INFO:tasks.workunit.client.0.smithi066.stdout:1/772: dwrite d0/dc/d8f/fb4 [0,4194304] 0 2024-09-12T22:49:58.264 INFO:tasks.workunit.client.0.smithi066.stdout:0/794: rmdir d1/d8/d1c/d13/d2f/dd8 39 2024-09-12T22:49:58.264 INFO:tasks.workunit.client.0.smithi066.stdout:9/784: symlink d9/d31/db0/lfc 0 2024-09-12T22:49:58.264 INFO:tasks.workunit.client.0.smithi066.stdout:5/862: fsync d5/de/d50/f92 0 2024-09-12T22:49:58.264 INFO:tasks.workunit.client.0.smithi066.stdout:8/788: link d17/d49/d4b/d57/f69 d17/d40/d47/d66/f110 0 2024-09-12T22:49:58.265 INFO:tasks.workunit.client.0.smithi066.stdout:4/860: dwrite d5/d8/d10/de/d39/f108 [0,4194304] 0 2024-09-12T22:49:58.266 INFO:tasks.workunit.client.0.smithi066.stdout:3/837: dwrite d0/d2/d1d/d87/d6b/fe0 [0,4194304] 0 2024-09-12T22:49:58.266 INFO:tasks.workunit.client.0.smithi066.stdout:8/789: creat d17/d49/f111 x:0 0 0 2024-09-12T22:49:58.268 INFO:tasks.workunit.client.0.smithi066.stdout:5/863: symlink d5/d11/d5f/l106 0 2024-09-12T22:49:58.269 INFO:tasks.workunit.client.0.smithi066.stdout:9/785: getdents d9/dc/dd/d9f 0 2024-09-12T22:49:58.272 INFO:tasks.workunit.client.0.smithi066.stdout:1/773: dwrite d0/dc/d1e/d47/fe4 [0,4194304] 0 2024-09-12T22:49:58.272 INFO:tasks.workunit.client.0.smithi066.stdout:5/864: symlink d5/d11/d21/d4d/l107 0 2024-09-12T22:49:58.273 INFO:tasks.workunit.client.0.smithi066.stdout:0/795: dwrite d1/d5b/dba/fc1 [0,4194304] 0 2024-09-12T22:49:58.274 INFO:tasks.workunit.client.0.smithi066.stdout:3/838: getdents d0/d2/d6/df9 0 2024-09-12T22:49:58.274 INFO:tasks.workunit.client.0.smithi066.stdout:9/786: creat d9/d31/d58/da4/ffd x:0 0 0 2024-09-12T22:49:58.275 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:58.273+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:58.275 INFO:tasks.workunit.client.0.smithi066.stdout:5/865: read d5/d11/d21/d4d/fc2 [3198621,34669] 0 2024-09-12T22:49:58.277 INFO:tasks.workunit.client.0.smithi066.stdout:8/790: dwrite d17/d40/d74/da3/ffa [0,4194304] 0 2024-09-12T22:49:58.277 INFO:tasks.workunit.client.0.smithi066.stdout:5/866: write d5/f12 [5384533,70150] 0 2024-09-12T22:49:58.278 INFO:tasks.workunit.client.0.smithi066.stdout:1/774: mknod d0/dc/cf4 0 2024-09-12T22:49:58.278 INFO:tasks.workunit.client.0.smithi066.stdout:4/861: dwrite d5/d8/d16/d93/d9c/d98/d8b/fed [0,4194304] 0 2024-09-12T22:49:58.281 INFO:tasks.workunit.client.0.smithi066.stdout:8/791: mknod d17/d49/d4b/d57/d5e/d65/d91/c112 0 2024-09-12T22:49:58.281 INFO:tasks.workunit.client.0.smithi066.stdout:9/787: link d9/c6d d9/d31/d77/cfe 0 2024-09-12T22:49:58.282 INFO:tasks.workunit.client.0.smithi066.stdout:8/792: chown d17/d40/d47/f8e 31620 1 2024-09-12T22:49:58.282 INFO:tasks.workunit.client.0.smithi066.stdout:9/788: chown d9/d31/d77/f91 3487260 1 2024-09-12T22:49:58.284 INFO:tasks.workunit.client.0.smithi066.stdout:3/839: dwrite d0/d2/d7/d29/daf/ff8 [0,4194304] 0 2024-09-12T22:49:58.285 INFO:tasks.workunit.client.0.smithi066.stdout:9/789: mkdir d9/d31/d58/dbc/d9d/dff 0 2024-09-12T22:49:58.285 INFO:tasks.workunit.client.0.smithi066.stdout:8/793: readlink d17/d49/d4b/d57/d5e/d62/led 0 2024-09-12T22:49:58.285 INFO:tasks.workunit.client.0.smithi066.stdout:3/840: mkdir d0/d2/d7/dc4/d127 0 2024-09-12T22:49:58.286 INFO:tasks.workunit.client.0.smithi066.stdout:5/867: dwrite d5/de/d50/d42/d49/f93 [8388608,4194304] 0 2024-09-12T22:49:58.287 INFO:tasks.workunit.client.0.smithi066.stdout:5/868: stat d5/de/d50/da0/ce6 0 2024-09-12T22:49:58.290 INFO:tasks.workunit.client.0.smithi066.stdout:3/841: symlink d0/d2/d7/d120/l128 0 2024-09-12T22:49:58.291 INFO:tasks.workunit.client.0.smithi066.stdout:9/790: dwrite d9/d31/d77/fc3 [4194304,4194304] 0 2024-09-12T22:49:58.292 INFO:tasks.workunit.client.0.smithi066.stdout:7/716: sync 2024-09-12T22:49:58.293 INFO:tasks.workunit.client.0.smithi066.stdout:3/842: write d0/d2/d7/dc4/fea [294614,5727] 0 2024-09-12T22:49:58.294 INFO:tasks.workunit.client.0.smithi066.stdout:9/791: write d9/df0/d8c/fce [362490,101820] 0 2024-09-12T22:49:58.294 INFO:tasks.workunit.client.0.smithi066.stdout:8/794: dwrite d17/d49/d4b/d57/d5e/d65/d91/f97 [0,4194304] 0 2024-09-12T22:49:58.294 INFO:tasks.workunit.client.0.smithi066.stdout:9/792: getdents d9/df0/d8c 0 2024-09-12T22:49:58.296 INFO:tasks.workunit.client.0.smithi066.stdout:9/793: rmdir d9/dc/d8e 39 2024-09-12T22:49:58.296 INFO:tasks.workunit.client.0.smithi066.stdout:3/843: creat d0/d2/d6/df9/f129 x:0 0 0 2024-09-12T22:49:58.298 INFO:tasks.workunit.client.0.smithi066.stdout:9/794: creat d9/d31/d58/dbc/f100 x:0 0 0 2024-09-12T22:49:58.299 INFO:tasks.workunit.client.0.smithi066.stdout:4/862: read d5/d8/d16/d93/d9c/d98/fa2 [515522,127480] 0 2024-09-12T22:49:58.299 INFO:tasks.workunit.client.0.smithi066.stdout:9/795: rename d9/dc/d46/fe8 to d9/d31/d77/dc2/dcb/dea/f101 0 2024-09-12T22:49:58.300 INFO:tasks.workunit.client.0.smithi066.stdout:3/844: link d0/d2/d7/d13/f39 d0/db3/db7/f12a 0 2024-09-12T22:49:58.300 INFO:tasks.workunit.client.0.smithi066.stdout:3/845: chown d0/d2/d1d/d87/d40/dbd/lef 19311 1 2024-09-12T22:49:58.300 INFO:tasks.workunit.client.0.smithi066.stdout:4/863: write d5/d8/d16/d1b/d1e/d1f/fa9 [1287591,16511] 0 2024-09-12T22:49:58.301 INFO:tasks.workunit.client.0.smithi066.stdout:9/796: rename d9/d31/d77/fc3 to d9/d31/d58/de4/f102 0 2024-09-12T22:49:58.301 INFO:tasks.workunit.client.0.smithi066.stdout:7/717: truncate d0/d19/d26/fad 3211661 0 2024-09-12T22:49:58.301 INFO:tasks.workunit.client.0.smithi066.stdout:8/795: write f16 [665911,119064] 0 2024-09-12T22:49:58.301 INFO:tasks.workunit.client.0.smithi066.stdout:3/846: stat d0/d2/d7/dc4/dcf/c11f 0 2024-09-12T22:49:58.302 INFO:tasks.workunit.client.0.smithi066.stdout:4/864: chown d5/d8/d16/dc2/ldd 1711277 1 2024-09-12T22:49:58.302 INFO:tasks.workunit.client.0.smithi066.stdout:7/718: fdatasync d0/d19/d26/d5a/f61 0 2024-09-12T22:49:58.302 INFO:tasks.workunit.client.0.smithi066.stdout:8/796: creat d17/d40/da8/f113 x:0 0 0 2024-09-12T22:49:58.304 INFO:tasks.workunit.client.0.smithi066.stdout:4/865: write d5/d8/d16/f9b [852129,103479] 0 2024-09-12T22:49:58.304 INFO:tasks.workunit.client.0.smithi066.stdout:8/797: chown d17/d40/d47/d4d/c56 184944 1 2024-09-12T22:49:58.305 INFO:tasks.workunit.client.0.smithi066.stdout:0/796: dread d1/f2a [4194304,4194304] 0 2024-09-12T22:49:58.305 INFO:tasks.workunit.client.0.smithi066.stdout:7/719: creat d0/d19/d24/d33/d27/dba/dc9/de5/feb x:0 0 0 2024-09-12T22:49:58.306 INFO:tasks.workunit.client.0.smithi066.stdout:0/797: fdatasync d1/d8/d1f/fd5 0 2024-09-12T22:49:58.306 INFO:tasks.workunit.client.0.smithi066.stdout:4/866: chown d5/d8/d16/d1b/d1e/d1f/f7a 1802 1 2024-09-12T22:49:58.306 INFO:tasks.workunit.client.0.smithi066.stdout:7/720: symlink d0/d19/lec 0 2024-09-12T22:49:58.306 INFO:tasks.workunit.client.0.smithi066.stdout:8/798: getdents d17/d40/d47/d4d/df0/df3 0 2024-09-12T22:49:58.307 INFO:tasks.workunit.client.0.smithi066.stdout:0/798: write d1/d8/d1f/f7b [4922276,87139] 0 2024-09-12T22:49:58.308 INFO:tasks.workunit.client.0.smithi066.stdout:3/847: dwrite d0/d2/d7/d13/dc1/f121 [0,4194304] 0 2024-09-12T22:49:58.308 INFO:tasks.workunit.client.0.smithi066.stdout:8/799: write d17/d49/d4b/d4e/fe1 [321987,120090] 0 2024-09-12T22:49:58.310 INFO:tasks.workunit.client.0.smithi066.stdout:0/799: creat d1/d36/d65/de9/f11a x:0 0 0 2024-09-12T22:49:58.310 INFO:tasks.workunit.client.0.smithi066.stdout:3/848: mknod d0/d2/d7/d29/c12b 0 2024-09-12T22:49:58.310 INFO:tasks.workunit.client.0.smithi066.stdout:8/800: creat d17/d49/f114 x:0 0 0 2024-09-12T22:49:58.311 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:58.311 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:58.311 INFO:tasks.workunit.client.0.smithi066.stdout:4/867: link d5/d8/d10/de/d39/dc0/ldb d5/d8/d10/de/d39/dc6/dec/l11f 0 2024-09-12T22:49:58.311 INFO:tasks.workunit.client.0.smithi066.stdout:0/800: creat d1/d8/d1f/d25/f11b x:0 0 0 2024-09-12T22:49:58.313 INFO:tasks.workunit.client.0.smithi066.stdout:4/868: mkdir d5/d3e/d8d/dce/d120 0 2024-09-12T22:49:58.314 INFO:tasks.workunit.client.0.smithi066.stdout:0/801: creat d1/d36/d65/f11c x:0 0 0 2024-09-12T22:49:58.314 INFO:tasks.workunit.client.0.smithi066.stdout:4/869: chown d5/d8/d16/cde 250225 1 2024-09-12T22:49:58.314 INFO:tasks.workunit.client.0.smithi066.stdout:6/862: dread d6/d23/d25/d88/f9d [0,4194304] 0 2024-09-12T22:49:58.316 INFO:tasks.workunit.client.0.smithi066.stdout:6/863: chown d6/d23/d25/d2c 21234588 1 2024-09-12T22:49:58.316 INFO:tasks.workunit.client.0.smithi066.stdout:0/802: mkdir d1/dbf/d102/d11d 0 2024-09-12T22:49:58.316 INFO:tasks.workunit.client.0.smithi066.stdout:3/849: dread d0/d2/d7/f66 [0,4194304] 0 2024-09-12T22:49:58.316 INFO:tasks.workunit.client.0.smithi066.stdout:4/870: mknod d5/d8/d10/de/d2d/d64/d9a/dfd/c121 0 2024-09-12T22:49:58.316 INFO:tasks.workunit.client.0.smithi066.stdout:0/803: fdatasync d1/d8/d1b/d59/f69 0 2024-09-12T22:49:58.316 INFO:tasks.workunit.client.0.smithi066.stdout:3/850: creat d0/d2/d7/dc4/dcf/f12c x:0 0 0 2024-09-12T22:49:58.317 INFO:tasks.workunit.client.0.smithi066.stdout:0/804: write d1/d8/d1c/d56/fca [1900513,113544] 0 2024-09-12T22:49:58.317 INFO:tasks.workunit.client.0.smithi066.stdout:4/871: mknod d5/d8/d16/d1b/d1e/d1f/d8c/d117/c122 0 2024-09-12T22:49:58.318 INFO:tasks.workunit.client.0.smithi066.stdout:9/797: truncate d9/d31/d77/fee 531839 0 2024-09-12T22:49:58.318 INFO:tasks.workunit.client.0.smithi066.stdout:6/864: dread d6/d7/f39 [4194304,4194304] 0 2024-09-12T22:49:58.319 INFO:tasks.workunit.client.0.smithi066.stdout:4/872: readlink d5/d8/d16/d93/d9c/l11d 0 2024-09-12T22:49:58.319 INFO:tasks.workunit.client.0.smithi066.stdout:3/851: fdatasync d0/d2/d7/d13/f39 0 2024-09-12T22:49:58.321 INFO:tasks.workunit.client.0.smithi066.stdout:8/801: write d17/d49/d4b/d4e/f96 [141744,57111] 0 2024-09-12T22:49:58.321 INFO:tasks.workunit.client.0.smithi066.stdout:6/865: chown d6/d23/d25/d4e/dc4/l1e 0 1 2024-09-12T22:49:58.321 INFO:tasks.workunit.client.0.smithi066.stdout:2/786: dread d1/d44/df3/d3d/fba [4194304,4194304] 0 2024-09-12T22:49:58.322 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:58.322 INFO:tasks.workunit.client.0.smithi066.stdout:9/798: link d9/dc/d23/c33 d9/dc/d46/c103 0 2024-09-12T22:49:58.323 INFO:tasks.workunit.client.0.smithi066.stdout:4/873: dread - d5/d8/d10/de/d2d/d64/d9a/dfd/f100 zero size 2024-09-12T22:49:58.323 INFO:tasks.workunit.client.0.smithi066.stdout:3/852: symlink d0/d2/d1d/d87/d40/dbd/l12d 0 2024-09-12T22:49:58.323 INFO:tasks.workunit.client.0.smithi066.stdout:2/787: mknod d1/d11/d53/c100 0 2024-09-12T22:49:58.323 INFO:tasks.workunit.client.0.smithi066.stdout:1/775: dread d0/dc/f69 [0,4194304] 0 2024-09-12T22:49:58.324 INFO:tasks.workunit.client.0.smithi066.stdout:3/853: write d0/d2/d1d/d87/f8d [827787,57900] 0 2024-09-12T22:49:58.324 INFO:tasks.workunit.client.0.smithi066.stdout:8/802: write d17/d49/d4b/db5/fb7 [956038,128985] 0 2024-09-12T22:49:58.324 INFO:tasks.workunit.client.0.smithi066.stdout:9/799: write d9/dc/f60 [4709385,95955] 0 2024-09-12T22:49:58.325 INFO:tasks.workunit.client.0.smithi066.stdout:1/776: symlink d0/dc/d1d/lf5 0 2024-09-12T22:49:58.325 INFO:tasks.workunit.client.0.smithi066.stdout:4/874: creat d5/d8/d10/de/d2d/d64/d9a/f123 x:0 0 0 2024-09-12T22:49:58.325 INFO:tasks.workunit.client.0.smithi066.stdout:0/805: dwrite d1/d36/f79 [0,4194304] 0 2024-09-12T22:49:58.327 INFO:tasks.workunit.client.0.smithi066.stdout:1/777: chown d0/d36/d57/f7e 28662 1 2024-09-12T22:49:58.327 INFO:tasks.workunit.client.0.smithi066.stdout:1/778: stat d0 0 2024-09-12T22:49:58.328 INFO:tasks.workunit.client.0.smithi066.stdout:2/788: mkdir d1/d11/d26/d4f/d5f/d61/d72/dad/d76/db7/d101 0 2024-09-12T22:49:58.329 INFO:tasks.workunit.client.0.smithi066.stdout:2/789: stat d1/d11/d26/d4f 0 2024-09-12T22:49:58.329 INFO:tasks.workunit.client.0.smithi066.stdout:6/866: dwrite d6/d78/f3f [0,4194304] 0 2024-09-12T22:49:58.329 INFO:tasks.workunit.client.0.smithi066.stdout:4/875: symlink d5/d8/d10/de/d2d/d64/l124 0 2024-09-12T22:49:58.329 INFO:tasks.workunit.client.0.smithi066.stdout:8/803: mknod d17/d40/d47/d4d/c115 0 2024-09-12T22:49:58.330 INFO:tasks.workunit.client.0.smithi066.stdout:4/876: fsync d5/f46 0 2024-09-12T22:49:58.330 INFO:tasks.workunit.client.0.smithi066.stdout:1/779: mknod d0/d36/cf6 0 2024-09-12T22:49:58.330 INFO:tasks.workunit.client.0.smithi066.stdout:6/867: mkdir d6/d126 0 2024-09-12T22:49:58.331 INFO:tasks.workunit.client.0.smithi066.stdout:6/868: write d6/d35/f120 [379444,81223] 0 2024-09-12T22:49:58.332 INFO:tasks.workunit.client.0.smithi066.stdout:2/790: rename d1/d44/df3/f2c to d1/d44/df3/d12/d18/da8/f102 0 2024-09-12T22:49:58.332 INFO:tasks.workunit.client.0.smithi066.stdout:1/780: write d0/d36/d57/f3f [3556174,20047] 0 2024-09-12T22:49:58.332 INFO:tasks.workunit.client.0.smithi066.stdout:4/877: write d5/d3e/d8d/dce/f3f [633830,74910] 0 2024-09-12T22:49:58.333 INFO:tasks.workunit.client.0.smithi066.stdout:5/869: dread f3 [8388608,4194304] 0 2024-09-12T22:49:58.333 INFO:tasks.workunit.client.0.smithi066.stdout:8/804: rename d17/d40/d47/d66 to d17/d1b/de7/d116 0 2024-09-12T22:49:58.333 INFO:tasks.workunit.client.0.smithi066.stdout:6/869: chown d6/d23/d25/f9f 4 1 2024-09-12T22:49:58.333 INFO:tasks.workunit.client.0.smithi066.stdout:1/781: read d0/dc/d1e/d47/fe4 [1533051,86898] 0 2024-09-12T22:49:58.333 INFO:tasks.workunit.client.0.smithi066.stdout:2/791: creat d1/db/dd9/f103 x:0 0 0 2024-09-12T22:49:58.334 INFO:tasks.workunit.client.0.smithi066.stdout:6/870: unlink d6/d35/fe4 0 2024-09-12T22:49:58.334 INFO:tasks.workunit.client.0.smithi066.stdout:1/782: truncate d0/f64 3211763 0 2024-09-12T22:49:58.335 INFO:tasks.workunit.client.0.smithi066.stdout:2/792: unlink d1/d44/df3/d68/f83 0 2024-09-12T22:49:58.335 INFO:tasks.workunit.client.0.smithi066.stdout:5/870: link d5/d11/d21/f7f d5/d11/d23/f108 0 2024-09-12T22:49:58.335 INFO:tasks.workunit.client.0.smithi066.stdout:1/783: write d0/d89/dd7/f6d [552940,40033] 0 2024-09-12T22:49:58.335 INFO:tasks.workunit.client.0.smithi066.stdout:0/806: dread d1/d5b/f101 [0,4194304] 0 2024-09-12T22:49:58.336 INFO:tasks.workunit.client.0.smithi066.stdout:2/793: truncate d1/d11/f66 4572131 0 2024-09-12T22:49:58.336 INFO:tasks.workunit.client.0.smithi066.stdout:5/871: dread d5/f3f [0,4194304] 0 2024-09-12T22:49:58.338 INFO:tasks.workunit.client.0.smithi066.stdout:1/784: rename d0/d4e/d79/d94 to d0/dea/df7 0 2024-09-12T22:49:58.338 INFO:tasks.workunit.client.0.smithi066.stdout:6/871: write d6/d23/d41/db6/dd3/df9/fff [756682,107258] 0 2024-09-12T22:49:58.338 INFO:tasks.workunit.client.0.smithi066.stdout:4/878: link d5/d3e/d8d/dc7/fc9 d5/d8/d16/d93/d9c/d98/dab/db3/f125 0 2024-09-12T22:49:58.338 INFO:tasks.workunit.client.0.smithi066.stdout:5/872: mknod d5/d11/d5d/d64/c109 0 2024-09-12T22:49:58.338 INFO:tasks.workunit.client.0.smithi066.stdout:8/805: dread d17/d49/d4b/d57/d5e/d62/d79/fda [0,4194304] 0 2024-09-12T22:49:58.338 INFO:tasks.workunit.client.0.smithi066.stdout:0/807: rename d1/d36/fc6 to d1/d8/d1c/d13/f11e 0 2024-09-12T22:49:58.338 INFO:tasks.workunit.client.0.smithi066.stdout:8/806: readlink d17/d40/d74/ld7 0 2024-09-12T22:49:58.339 INFO:tasks.workunit.client.0.smithi066.stdout:0/808: chown d1/l6a 318 1 2024-09-12T22:49:58.339 INFO:tasks.workunit.client.0.smithi066.stdout:1/785: creat d0/dea/df7/d9a/ff8 x:0 0 0 2024-09-12T22:49:58.339 INFO:tasks.workunit.client.0.smithi066.stdout:4/879: rename d5/d8/d10/de to d5/d3e/d8d/dc7/d126 0 2024-09-12T22:49:58.340 INFO:tasks.workunit.client.0.smithi066.stdout:6/872: mkdir d6/d23/d41/db6/dd3/df9/d127 0 2024-09-12T22:49:58.340 INFO:tasks.workunit.client.0.smithi066.stdout:1/786: fdatasync d0/dea/df7/fa9 0 2024-09-12T22:49:58.340 INFO:tasks.workunit.client.0.smithi066.stdout:2/794: getdents d1/d11/d26/d4f/d5f/d61/d72/dad/df5 0 2024-09-12T22:49:58.340 INFO:tasks.workunit.client.0.smithi066.stdout:0/809: mkdir d1/d36/d11f 0 2024-09-12T22:49:58.340 INFO:tasks.workunit.client.0.smithi066.stdout:8/807: mkdir d17/d2c/dab/d117 0 2024-09-12T22:49:58.341 INFO:tasks.workunit.client.0.smithi066.stdout:6/873: chown d6/d23/d25/d4e/ccc 0 1 2024-09-12T22:49:58.341 INFO:tasks.workunit.client.0.smithi066.stdout:1/787: mknod d0/dc/d1e/cf9 0 2024-09-12T22:49:58.341 INFO:tasks.workunit.client.0.smithi066.stdout:2/795: write d1/f3 [5080804,60001] 0 2024-09-12T22:49:58.342 INFO:tasks.workunit.client.0.smithi066.stdout:7/721: sync 2024-09-12T22:49:58.342 INFO:tasks.workunit.client.0.smithi066.stdout:5/873: sync 2024-09-12T22:49:58.342 INFO:tasks.workunit.client.0.smithi066.stdout:4/880: creat d5/d3e/d8d/dc7/d126/d2d/f127 x:0 0 0 2024-09-12T22:49:58.342 INFO:tasks.workunit.client.0.smithi066.stdout:2/796: mkdir d1/d11/d26/d4f/d5f/d61/d72/dad/d104 0 2024-09-12T22:49:58.344 INFO:tasks.workunit.client.0.smithi066.stdout:1/788: write d0/f16 [2326603,104404] 0 2024-09-12T22:49:58.345 INFO:tasks.workunit.client.0.smithi066.stdout:7/722: chown d0/d19/d26/d5a/fda 732773 1 2024-09-12T22:49:58.348 INFO:tasks.workunit.client.0.smithi066.stdout:6/874: link d6/d23/f29 d6/d23/d25/d4e/dc4/d32/dfd/f128 0 2024-09-12T22:49:58.348 INFO:tasks.workunit.client.0.smithi066.stdout:7/723: rmdir d0/d19/d26/d5a/dc8 39 2024-09-12T22:49:58.348 INFO:tasks.workunit.client.0.smithi066.stdout:2/797: rmdir d1/d11/d26/d4f/d5f/d61/d72/dad/d76 39 2024-09-12T22:49:58.348 INFO:tasks.workunit.client.0.smithi066.stdout:1/789: dread d0/dc/d1e/d47/d6f/f98 [0,4194304] 0 2024-09-12T22:49:58.350 INFO:tasks.workunit.client.0.smithi066.stdout:3/854: dread d0/d2/d1d/d87/d40/d44/d55/d91/fb0 [0,4194304] 0 2024-09-12T22:49:58.350 INFO:tasks.workunit.client.0.smithi066.stdout:7/724: write d0/d19/d7f/fa2 [249592,30130] 0 2024-09-12T22:49:58.351 INFO:tasks.workunit.client.0.smithi066.stdout:1/790: dread - d0/dc/d8f/fb8 zero size 2024-09-12T22:49:58.352 INFO:tasks.workunit.client.0.smithi066.stdout:0/810: dwrite d1/d8/d1c/d13/d2f/f6b [0,4194304] 0 2024-09-12T22:49:58.352 INFO:tasks.workunit.client.0.smithi066.stdout:6/875: truncate d6/d35/fb0 590097 0 2024-09-12T22:49:58.352 INFO:tasks.workunit.client.0.smithi066.stdout:8/808: sync 2024-09-12T22:49:58.354 INFO:tasks.workunit.client.0.smithi066.stdout:2/798: truncate d1/d44/df3/d68/fb0 1034641 0 2024-09-12T22:49:58.354 INFO:tasks.workunit.client.0.smithi066.stdout:5/874: dwrite d5/d11/d5d/d8a/fbd [0,4194304] 0 2024-09-12T22:49:58.354 INFO:tasks.workunit.client.0.smithi066.stdout:3/855: readlink d0/d2/d1d/d87/d40/d44/d55/d91/lfc 0 2024-09-12T22:49:58.354 INFO:tasks.workunit.client.0.smithi066.stdout:9/800: dread d9/dc/dd/f50 [0,4194304] 0 2024-09-12T22:49:58.355 INFO:tasks.workunit.client.0.smithi066.stdout:4/881: dwrite d5/d3e/d8d/dc7/d126/d2d/faa [0,4194304] 0 2024-09-12T22:49:58.358 INFO:tasks.workunit.client.0.smithi066.stdout:6/876: rename d6/d7/dcd to d6/d7/dc6/d129 0 2024-09-12T22:49:58.358 INFO:tasks.workunit.client.0.smithi066.stdout:0/811: creat d1/dbf/d102/f120 x:0 0 0 2024-09-12T22:49:58.358 INFO:tasks.workunit.client.0.smithi066.stdout:3/856: write d0/d2/d1d/d87/d40/f4d [8905235,31310] 0 2024-09-12T22:49:58.359 INFO:tasks.workunit.client.0.smithi066.stdout:5/875: mknod d5/d11/d23/d6f/daa/c10a 0 2024-09-12T22:49:58.360 INFO:tasks.workunit.client.0.smithi066.stdout:2/799: write d1/d44/df3/d12/d1e/fc5 [3625140,23260] 0 2024-09-12T22:49:58.360 INFO:tasks.workunit.client.0.smithi066.stdout:4/882: stat d5/d3e/d8d/dc7/d126/d2d/d64/f89 0 2024-09-12T22:49:58.362 INFO:tasks.workunit.client.0.smithi066.stdout:7/725: dwrite d0/d19/d24/f1f [0,4194304] 0 2024-09-12T22:49:58.362 INFO:tasks.workunit.client.0.smithi066.stdout:0/812: chown d1/d36/d65/de9/f11a 793 1 2024-09-12T22:49:58.364 INFO:tasks.workunit.client.0.smithi066.stdout:7/726: fsync d0/d6/f21 0 2024-09-12T22:49:58.364 INFO:tasks.workunit.client.0.smithi066.stdout:1/791: dwrite d0/dc/d1e/d47/d6f/f98 [0,4194304] 0 2024-09-12T22:49:58.365 INFO:tasks.workunit.client.0.smithi066.stdout:8/809: dwrite d17/d49/d4b/d57/d5e/d62/f83 [0,4194304] 0 2024-09-12T22:49:58.365 INFO:tasks.workunit.client.0.smithi066.stdout:8/810: fsync f16 0 2024-09-12T22:49:58.365 INFO:tasks.workunit.client.0.smithi066.stdout:9/801: dwrite d9/d31/d77/fb9 [0,4194304] 0 2024-09-12T22:49:58.366 INFO:tasks.workunit.client.0.smithi066.stdout:0/813: mkdir d1/dbf/d121 0 2024-09-12T22:49:58.366 INFO:tasks.workunit.client.0.smithi066.stdout:1/792: creat d0/d89/ffa x:0 0 0 2024-09-12T22:49:58.367 INFO:tasks.workunit.client.0.smithi066.stdout:6/877: getdents d6/d23/d25/d4e/dc4/d32 0 2024-09-12T22:49:58.367 INFO:tasks.workunit.client.0.smithi066.stdout:0/814: truncate d1/fbe 279084 0 2024-09-12T22:49:58.367 INFO:tasks.workunit.client.0.smithi066.stdout:1/793: fdatasync d0/d89/dd7/fd4 0 2024-09-12T22:49:58.368 INFO:tasks.workunit.client.0.smithi066.stdout:8/811: mkdir d17/d49/d118 0 2024-09-12T22:49:58.368 INFO:tasks.workunit.client.0.smithi066.stdout:4/883: creat d5/d8/d16/d93/da6/dea/f128 x:0 0 0 2024-09-12T22:49:58.368 INFO:tasks.workunit.client.0.smithi066.stdout:1/794: write d0/d4e/d79/dc1/f80 [398707,22384] 0 2024-09-12T22:49:58.369 INFO:tasks.workunit.client.0.smithi066.stdout:8/812: fsync d17/d40/d47/d4d/d87/fa9 0 2024-09-12T22:49:58.369 INFO:tasks.workunit.client.0.smithi066.stdout:4/884: dread - d5/d8/d16/d93/d9c/d98/ff2 zero size 2024-09-12T22:49:58.371 INFO:tasks.workunit.client.0.smithi066.stdout:7/727: dwrite d0/d19/d24/d33/d27/d70/fde [0,4194304] 0 2024-09-12T22:49:58.372 INFO:tasks.workunit.client.0.smithi066.stdout:9/802: readlink d9/d31/d58/d7f/dc8/lec 0 2024-09-12T22:49:58.372 INFO:tasks.workunit.client.0.smithi066.stdout:8/813: rename d17/d2c/f34 to d17/d40/da8/f119 0 2024-09-12T22:49:58.372 INFO:tasks.workunit.client.0.smithi066.stdout:6/878: mkdir d6/d23/d41/db6/dd3/df9/d102/d12a 0 2024-09-12T22:49:58.372 INFO:tasks.workunit.client.0.smithi066.stdout:0/815: symlink d1/d8/d1c/d13/d2f/d8a/dc0/l122 0 2024-09-12T22:49:58.373 INFO:tasks.workunit.client.0.smithi066.stdout:1/795: chown d0/lb6 131128 1 2024-09-12T22:49:58.373 INFO:tasks.workunit.client.0.smithi066.stdout:7/728: readlink d0/d19/d24/d33/d27/d70/d90/l73 0 2024-09-12T22:49:58.373 INFO:tasks.workunit.client.0.smithi066.stdout:2/800: read d1/d44/df3/d12/f24 [1849436,114126] 0 2024-09-12T22:49:58.373 INFO:tasks.workunit.client.0.smithi066.stdout:5/876: dread d5/d15/ffc [0,4194304] 0 2024-09-12T22:49:58.374 INFO:tasks.workunit.client.0.smithi066.stdout:0/816: chown d1/d8/d1f/d47 620 1 2024-09-12T22:49:58.374 INFO:tasks.workunit.client.0.smithi066.stdout:9/803: write d9/d31/d58/fc1 [2079410,89639] 0 2024-09-12T22:49:58.374 INFO:tasks.workunit.client.0.smithi066.stdout:1/796: symlink d0/d36/d57/lfb 0 2024-09-12T22:49:58.374 INFO:tasks.workunit.client.0.smithi066.stdout:8/814: dread d17/f42 [0,4194304] 0 2024-09-12T22:49:58.375 INFO:tasks.workunit.client.0.smithi066.stdout:2/801: readlink d1/d11/d26/d4f/d5f/d61/d72/lc3 0 2024-09-12T22:49:58.376 INFO:tasks.workunit.client.0.smithi066.stdout:0/817: rmdir d1/d8/d1b 39 2024-09-12T22:49:58.376 INFO:tasks.workunit.client.0.smithi066.stdout:6/879: rename d6/d59 to d6/d23/d25/d4e/dc4/d99/d101/d12b 0 2024-09-12T22:49:58.376 INFO:tasks.workunit.client.0.smithi066.stdout:9/804: mkdir d9/d31/db0/d104 0 2024-09-12T22:49:58.376 INFO:tasks.workunit.client.0.smithi066.stdout:2/802: write d1/d11/f66 [1700118,35943] 0 2024-09-12T22:49:58.377 INFO:tasks.workunit.client.0.smithi066.stdout:8/815: creat d17/f11a x:0 0 0 2024-09-12T22:49:58.379 INFO:tasks.workunit.client.0.smithi066.stdout:1/797: rename d0/dc/d8f/fe7 to d0/dc/d1e/d47/ffc 0 2024-09-12T22:49:58.379 INFO:tasks.workunit.client.0.smithi066.stdout:6/880: mknod d6/d23/d25/d2c/c12c 0 2024-09-12T22:49:58.379 INFO:tasks.workunit.client.0.smithi066.stdout:1/798: readlink d0/dc/d44/l87 0 2024-09-12T22:49:58.379 INFO:tasks.workunit.client.0.smithi066.stdout:2/803: creat d1/d44/df3/f105 x:0 0 0 2024-09-12T22:49:58.380 INFO:tasks.workunit.client.0.smithi066.stdout:5/877: read d5/de/d50/d42/d49/f87 [97003,8145] 0 2024-09-12T22:49:58.380 INFO:tasks.workunit.client.0.smithi066.stdout:2/804: dread - d1/d44/df3/d68/fd5 zero size 2024-09-12T22:49:58.381 INFO:tasks.workunit.client.0.smithi066.stdout:5/878: fdatasync d5/d11/d5d/d64/d8f/f105 0 2024-09-12T22:49:58.381 INFO:tasks.workunit.client.0.smithi066.stdout:1/799: rmdir d0/d36/d8e 39 2024-09-12T22:49:58.381 INFO:tasks.workunit.client.0.smithi066.stdout:2/805: stat d1/d11/d26/d4f/d5f/d61/d7e/l97 0 2024-09-12T22:49:58.382 INFO:tasks.workunit.client.0.smithi066.stdout:5/879: rmdir d5/d11/d7c 39 2024-09-12T22:49:58.382 INFO:tasks.workunit.client.0.smithi066.stdout:2/806: fdatasync d1/d44/d51/d70/fc6 0 2024-09-12T22:49:58.382 INFO:tasks.workunit.client.0.smithi066.stdout:1/800: unlink d0/dc/d1d/f60 0 2024-09-12T22:49:58.382 INFO:tasks.workunit.client.0.smithi066.stdout:5/880: symlink d5/d11/d5d/l10b 0 2024-09-12T22:49:58.383 INFO:tasks.workunit.client.0.smithi066.stdout:1/801: chown d0/dc/d8f/lb9 1123702 1 2024-09-12T22:49:58.385 INFO:tasks.workunit.client.0.smithi066.stdout:1/802: creat d0/d36/d57/d81/ffd x:0 0 0 2024-09-12T22:49:58.385 INFO:tasks.workunit.client.0.smithi066.stdout:5/881: rename d5/d14/cb4 to d5/d11/d23/d6f/daa/dbb/dc6/c10c 0 2024-09-12T22:49:58.385 INFO:tasks.workunit.client.0.smithi066.stdout:5/882: write d5/f55 [1027913,4296] 0 2024-09-12T22:49:58.387 INFO:tasks.workunit.client.0.smithi066.stdout:2/807: dwrite d1/d11/f25 [0,4194304] 0 2024-09-12T22:49:58.389 INFO:tasks.workunit.client.0.smithi066.stdout:2/808: write d1/db/fe5 [918663,30000] 0 2024-09-12T22:49:58.389 INFO:tasks.workunit.client.0.smithi066.stdout:1/803: dwrite d0/d4e/d79/d86/f88 [0,4194304] 0 2024-09-12T22:49:58.389 INFO:tasks.workunit.client.0.smithi066.stdout:7/729: dread d0/d19/d26/d5a/f61 [0,4194304] 0 2024-09-12T22:49:58.390 INFO:tasks.workunit.client.0.smithi066.stdout:2/809: stat d1/d44/df3/d12/d18/da8/f9d 0 2024-09-12T22:49:58.391 INFO:tasks.workunit.client.0.smithi066.stdout:2/810: sync 2024-09-12T22:49:58.391 INFO:tasks.workunit.client.0.smithi066.stdout:7/730: chown d0/d19/d24/d33/d27/d70/d90/l73 3610 1 2024-09-12T22:49:58.391 INFO:tasks.workunit.client.0.smithi066.stdout:1/804: creat d0/dea/df7/d9a/dd9/ffe x:0 0 0 2024-09-12T22:49:58.393 INFO:tasks.workunit.client.0.smithi066.stdout:6/881: truncate d6/d23/d25/d4e/dc4/f18 4068398 0 2024-09-12T22:49:58.395 INFO:tasks.workunit.client.0.smithi066.stdout:7/731: truncate d0/d19/d24/d33/d27/d70/f9d 218336 0 2024-09-12T22:49:58.395 INFO:tasks.workunit.client.0.smithi066.stdout:7/732: stat d0/d19/d24/d33/d27/d70/f9d 0 2024-09-12T22:49:58.396 INFO:tasks.workunit.client.0.smithi066.stdout:7/733: rmdir d0/d19/d24/d33/d27 39 2024-09-12T22:49:58.396 INFO:tasks.workunit.client.0.smithi066.stdout:2/811: dwrite d1/d44/df3/d68/fd5 [0,4194304] 0 2024-09-12T22:49:58.397 INFO:tasks.workunit.client.0.smithi066.stdout:7/734: stat d0/d19/d26/f6a 0 2024-09-12T22:49:58.397 INFO:tasks.workunit.client.0.smithi066.stdout:2/812: fdatasync d1/d44/df3/d12/d67/fb3 0 2024-09-12T22:49:58.398 INFO:tasks.workunit.client.0.smithi066.stdout:6/882: truncate d6/d23/d25/d4e/dc4/d99/d101/d12b/df3/f122 1031597 0 2024-09-12T22:49:58.398 INFO:tasks.workunit.client.0.smithi066.stdout:5/883: dread d5/d11/f58 [4194304,4194304] 0 2024-09-12T22:49:58.398 INFO:tasks.workunit.client.0.smithi066.stdout:7/735: mknod d0/d19/d24/ced 0 2024-09-12T22:49:58.398 INFO:tasks.workunit.client.0.smithi066.stdout:5/884: sync 2024-09-12T22:49:58.399 INFO:tasks.workunit.client.0.smithi066.stdout:2/813: stat d1/d44/df3/d12/d18/fcf 0 2024-09-12T22:49:58.399 INFO:tasks.workunit.client.0.smithi066.stdout:6/883: write d6/d23/d62/d79/ff5 [904342,14585] 0 2024-09-12T22:49:58.400 INFO:tasks.workunit.client.0.smithi066.stdout:7/736: write d0/d6/d83/fe8 [671564,128812] 0 2024-09-12T22:49:58.401 INFO:tasks.workunit.client.0.smithi066.stdout:5/885: rename d5/de/d50/d42/lbf to d5/d11/d5d/d64/d8f/l10d 0 2024-09-12T22:49:58.402 INFO:tasks.workunit.client.0.smithi066.stdout:7/737: stat d0/d19/d24/d33/d27/d70/d90/c66 0 2024-09-12T22:49:58.404 INFO:tasks.workunit.client.0.smithi066.stdout:5/886: mknod d5/d11/d23/d6f/daa/dbb/dc6/de1/c10e 0 2024-09-12T22:49:58.405 INFO:tasks.workunit.client.0.smithi066.stdout:5/887: write d5/de/d57/fb1 [294700,121010] 0 2024-09-12T22:49:58.405 INFO:tasks.workunit.client.0.smithi066.stdout:7/738: getdents d0/d19/d26/d5a/dc8 0 2024-09-12T22:49:58.405 INFO:tasks.workunit.client.0.smithi066.stdout:6/884: dwrite d6/f4b [0,4194304] 0 2024-09-12T22:49:58.405 INFO:tasks.workunit.client.0.smithi066.stdout:7/739: write d0/d86/f95 [406844,127156] 0 2024-09-12T22:49:58.406 INFO:tasks.workunit.client.0.smithi066.stdout:7/740: chown d0/d19/d26/dbe 6816995 1 2024-09-12T22:49:58.406 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:58.405+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:58.407 INFO:tasks.workunit.client.0.smithi066.stdout:6/885: rename d6/d23/d25/d4e/dc4/d99/l91 to d6/d7/dc6/l12d 0 2024-09-12T22:49:58.407 INFO:tasks.workunit.client.0.smithi066.stdout:7/741: symlink d0/d19/d24/d33/lee 0 2024-09-12T22:49:58.407 INFO:tasks.workunit.client.0.smithi066.stdout:6/886: read - d6/d23/d41/db6/dd3/fdf zero size 2024-09-12T22:49:58.409 INFO:tasks.workunit.client.0.smithi066.stdout:6/887: symlink d6/d23/d25/d4e/dc4/d32/d3c/l12e 0 2024-09-12T22:49:58.410 INFO:tasks.workunit.client.0.smithi066.stdout:6/888: creat d6/d23/d41/db6/dd3/df9/f12f x:0 0 0 2024-09-12T22:49:58.411 INFO:tasks.workunit.client.0.smithi066.stdout:6/889: fdatasync d6/d7/faa 0 2024-09-12T22:49:58.416 INFO:tasks.workunit.client.0.smithi066.stdout:4/885: dread d5/d3e/d8d/dc7/d126/f18 [4194304,4194304] 0 2024-09-12T22:49:58.416 INFO:tasks.workunit.client.0.smithi066.stdout:5/888: truncate d5/de/d50/d42/d49/f6b 3368421 0 2024-09-12T22:49:58.417 INFO:tasks.workunit.client.0.smithi066.stdout:5/889: dread - d5/d11/d5d/d64/d8f/fe0 zero size 2024-09-12T22:49:58.417 INFO:tasks.workunit.client.0.smithi066.stdout:4/886: fdatasync d5/d8/d16/d1b/d1e/f11e 0 2024-09-12T22:49:58.418 INFO:tasks.workunit.client.0.smithi066.stdout:3/857: dread d0/d2/d7/d13/d31/fb8 [0,4194304] 0 2024-09-12T22:49:58.419 INFO:tasks.workunit.client.0.smithi066.stdout:3/858: readlink d0/d2/d7/d13/l75 0 2024-09-12T22:49:58.419 INFO:tasks.workunit.client.0.smithi066.stdout:5/890: write d5/d11/d21/faf [2949829,90072] 0 2024-09-12T22:49:58.419 INFO:tasks.workunit.client.0.smithi066.stdout:3/859: sync 2024-09-12T22:49:58.421 INFO:tasks.workunit.client.0.smithi066.stdout:6/890: dwrite d6/d23/d25/d4e/dc4/d32/d3c/fa6 [0,4194304] 0 2024-09-12T22:49:58.421 INFO:tasks.workunit.client.0.smithi066.stdout:9/805: dread d9/d31/d77/dc2/dcb/f39 [0,4194304] 0 2024-09-12T22:49:58.421 INFO:tasks.workunit.client.0.smithi066.stdout:7/742: dread d0/d19/d24/fa0 [0,4194304] 0 2024-09-12T22:49:58.421 INFO:tasks.workunit.client.0.smithi066.stdout:3/860: rmdir d0/d2/d1d/d87/d40 39 2024-09-12T22:49:58.421 INFO:tasks.workunit.client.0.smithi066.stdout:3/861: sync 2024-09-12T22:49:58.421 INFO:tasks.workunit.client.0.smithi066.stdout:5/891: write d5/d11/d23/f56 [4925721,6194] 0 2024-09-12T22:49:58.423 INFO:tasks.workunit.client.0.smithi066.stdout:3/862: fdatasync d0/f38 0 2024-09-12T22:49:58.424 INFO:tasks.workunit.client.0.smithi066.stdout:7/743: stat d0/d19/d60/fd4 0 2024-09-12T22:49:58.425 INFO:tasks.workunit.client.0.smithi066.stdout:8/816: dread d17/d1b/f86 [0,4194304] 0 2024-09-12T22:49:58.425 INFO:tasks.workunit.client.0.smithi066.stdout:9/806: rename d9/d31/d77/dc2/dcb/cad to d9/d31/d58/da4/c105 0 2024-09-12T22:49:58.425 INFO:tasks.workunit.client.0.smithi066.stdout:4/887: dread d5/d8/d16/d93/d9c/d98/d8b/fed [0,4194304] 0 2024-09-12T22:49:58.425 INFO:tasks.workunit.client.0.smithi066.stdout:6/891: getdents d6/d23/d25/d4e/dc4/d99 0 2024-09-12T22:49:58.425 INFO:tasks.workunit.client.0.smithi066.stdout:1/805: dread d0/d4e/d79/d86/ff0 [0,4194304] 0 2024-09-12T22:49:58.425 INFO:tasks.workunit.client.0.smithi066.stdout:9/807: write d9/fa1 [1138003,22485] 0 2024-09-12T22:49:58.426 INFO:tasks.workunit.client.0.smithi066.stdout:3/863: dread - d0/d2/d1d/d87/d40/dff/f126 zero size 2024-09-12T22:49:58.426 INFO:tasks.workunit.client.0.smithi066.stdout:7/744: creat d0/d19/d24/d33/d27/dba/fef x:0 0 0 2024-09-12T22:49:58.427 INFO:tasks.workunit.client.0.smithi066.stdout:0/818: dread d1/d8/d1f/f52 [0,4194304] 0 2024-09-12T22:49:58.427 INFO:tasks.workunit.client.0.smithi066.stdout:6/892: symlink d6/d23/d25/d4e/dc4/d50/l130 0 2024-09-12T22:49:58.427 INFO:tasks.workunit.client.0.smithi066.stdout:4/888: chown d5/d3e/d8d/dc7/d126/f18 14227 1 2024-09-12T22:49:58.428 INFO:tasks.workunit.client.0.smithi066.stdout:1/806: creat d0/dc/d1e/d95/dcb/df3/fff x:0 0 0 2024-09-12T22:49:58.429 INFO:tasks.workunit.client.0.smithi066.stdout:3/864: write d0/d2/d7/d29/fc5 [1333458,109728] 0 2024-09-12T22:49:58.429 INFO:tasks.workunit.client.0.smithi066.stdout:7/745: dread - d0/d19/d26/dbe/fd0 zero size 2024-09-12T22:49:58.430 INFO:tasks.workunit.client.0.smithi066.stdout:0/819: write d1/d8/d1c/d13/d2f/f82 [516884,83817] 0 2024-09-12T22:49:58.431 INFO:tasks.workunit.client.0.smithi066.stdout:5/892: read d5/d11/d5d/d8a/f94 [3445528,126798] 0 2024-09-12T22:49:58.432 INFO:tasks.workunit.client.0.smithi066.stdout:8/817: dwrite d17/d40/d74/d99/fa7 [0,4194304] 0 2024-09-12T22:49:58.437 INFO:tasks.workunit.client.0.smithi066.stdout:7/746: rename d0/d19/d24/d33/d27/d70/d90/db8/lce to d0/d19/d26/d5a/lf0 0 2024-09-12T22:49:58.437 INFO:tasks.workunit.client.0.smithi066.stdout:9/808: dwrite d9/d31/d58/de4/f102 [4194304,4194304] 0 2024-09-12T22:49:58.439 INFO:tasks.workunit.client.0.smithi066.stdout:8/818: creat d17/d49/d4b/d57/d5e/d62/dc1/dd1/dff/f11b x:0 0 0 2024-09-12T22:49:58.439 INFO:tasks.workunit.client.0.smithi066.stdout:4/889: dwrite d5/d8/d16/d93/d9c/d98/fdf [0,4194304] 0 2024-09-12T22:49:58.440 INFO:tasks.workunit.client.0.smithi066.stdout:7/747: mkdir d0/d19/d26/d48/df1 0 2024-09-12T22:49:58.440 INFO:tasks.workunit.client.0.smithi066.stdout:6/893: truncate d6/fb 3623640 0 2024-09-12T22:49:58.442 INFO:tasks.workunit.client.0.smithi066.stdout:7/748: readlink d0/d19/ldc 0 2024-09-12T22:49:58.443 INFO:tasks.workunit.client.0.smithi066.stdout:0/820: dwrite d1/d8/d1c/d13/d2f/d8a/f90 [0,4194304] 0 2024-09-12T22:49:58.445 INFO:tasks.workunit.client.0.smithi066.stdout:5/893: dwrite d5/d11/d23/d6f/daa/dbb/dc6/de1/fa1 [0,4194304] 0 2024-09-12T22:49:58.445 INFO:tasks.workunit.client.0.smithi066.stdout:2/814: dread d1/d44/df3/d12/d18/da8/f88 [0,4194304] 0 2024-09-12T22:49:58.448 INFO:tasks.workunit.client.0.smithi066.stdout:8/819: getdents d17/d40/dc4 0 2024-09-12T22:49:58.448 INFO:tasks.workunit.client.0.smithi066.stdout:2/815: creat d1/d44/df3/d12/de2/f106 x:0 0 0 2024-09-12T22:49:58.449 INFO:tasks.workunit.client.0.smithi066.stdout:6/894: creat d6/d23/d41/db6/dd3/df9/d127/f131 x:0 0 0 2024-09-12T22:49:58.450 INFO:tasks.workunit.client.0.smithi066.stdout:4/890: dwrite d5/d8/d16/d93/d9c/d98/fdf [0,4194304] 0 2024-09-12T22:49:58.450 INFO:tasks.workunit.client.0.smithi066.stdout:7/749: rename d0/d19/d24/d33/d27/c3f to d0/d86/cf2 0 2024-09-12T22:49:58.451 INFO:tasks.workunit.client.0.smithi066.stdout:8/820: rename d17/d2c/dab/d10e to d17/d40/d74/da3/d11c 0 2024-09-12T22:49:58.451 INFO:tasks.workunit.client.0.smithi066.stdout:6/895: creat d6/d23/d25/d4e/dc4/d32/d3c/f132 x:0 0 0 2024-09-12T22:49:58.451 INFO:tasks.workunit.client.0.smithi066.stdout:2/816: write d1/db/d42/fa0 [752074,66420] 0 2024-09-12T22:49:58.452 INFO:tasks.workunit.client.0.smithi066.stdout:5/894: truncate f3 10483314 0 2024-09-12T22:49:58.452 INFO:tasks.workunit.client.0.smithi066.stdout:6/896: mkdir d6/d35/d133 0 2024-09-12T22:49:58.453 INFO:tasks.workunit.client.0.smithi066.stdout:2/817: creat d1/d11/d26/f107 x:0 0 0 2024-09-12T22:49:58.454 INFO:tasks.workunit.client.0.smithi066.stdout:8/821: dread - d17/d49/d4b/d57/d5e/d62/dc1/dd1/dff/f11b zero size 2024-09-12T22:49:58.455 INFO:tasks.workunit.client.0.smithi066.stdout:0/821: dwrite d1/d8/d1c/d13/d2f/dd8/fde [0,4194304] 0 2024-09-12T22:49:58.455 INFO:tasks.workunit.client.0.smithi066.stdout:8/822: sync 2024-09-12T22:49:58.456 INFO:tasks.workunit.client.0.smithi066.stdout:2/818: unlink d1/d11/d26/d4f/d5f/d61/d7e/l5c 0 2024-09-12T22:49:58.457 INFO:tasks.workunit.client.0.smithi066.stdout:5/895: link d5/d11/d5f/l63 d5/d11/d23/d6f/daa/dbb/l10f 0 2024-09-12T22:49:58.457 INFO:tasks.workunit.client.0.smithi066.stdout:8/823: rename c10 to d17/d40/d74/da3/c11d 0 2024-09-12T22:49:58.457 INFO:tasks.workunit.client.0.smithi066.stdout:0/822: getdents d1/d8/df5 0 2024-09-12T22:49:58.458 INFO:tasks.workunit.client.0.smithi066.stdout:5/896: symlink d5/d103/dc7/l110 0 2024-09-12T22:49:58.458 INFO:tasks.workunit.client.0.smithi066.stdout:8/824: unlink d17/d49/d4b/d57/d5e/d62/d79/fda 0 2024-09-12T22:49:58.459 INFO:tasks.workunit.client.0.smithi066.stdout:5/897: write d5/d11/d5d/f83 [655515,70428] 0 2024-09-12T22:49:58.459 INFO:tasks.workunit.client.0.smithi066.stdout:2/819: getdents d1/d11/d26/d4f/d5f 0 2024-09-12T22:49:58.460 INFO:tasks.workunit.client.0.smithi066.stdout:7/750: truncate d0/d19/d24/d33/f78 2054830 0 2024-09-12T22:49:58.460 INFO:tasks.workunit.client.0.smithi066.stdout:4/891: dread d5/d8/d10/f6b [0,4194304] 0 2024-09-12T22:49:58.461 INFO:tasks.workunit.client.0.smithi066.stdout:8/825: write d17/d1b/de7/d116/f110 [1259347,61668] 0 2024-09-12T22:49:58.462 INFO:tasks.workunit.client.0.smithi066.stdout:1/807: dread d0/dc/d1e/fbb [0,4194304] 0 2024-09-12T22:49:58.463 INFO:tasks.workunit.client.0.smithi066.stdout:8/826: chown d17/d49/d4b/db5/fb7 57 1 2024-09-12T22:49:58.464 INFO:tasks.workunit.client.0.smithi066.stdout:2/820: link d1/d11/d26/l86 d1/d11/d26/d8f/df2/l108 0 2024-09-12T22:49:58.464 INFO:tasks.workunit.client.0.smithi066.stdout:1/808: rename d0/l1 to d0/d36/d57/d81/l100 0 2024-09-12T22:49:58.464 INFO:tasks.workunit.client.0.smithi066.stdout:0/823: dwrite d1/d5b/d6d/f10a [0,4194304] 0 2024-09-12T22:49:58.465 INFO:tasks.workunit.client.0.smithi066.stdout:2/821: write d1/d11/d26/d4f/d5f/d61/fe8 [826932,48420] 0 2024-09-12T22:49:58.465 INFO:tasks.workunit.client.0.smithi066.stdout:1/809: mknod d0/dc/deb/c101 0 2024-09-12T22:49:58.466 INFO:tasks.workunit.client.0.smithi066.stdout:0/824: truncate d1/d36/d65/dc2/fcd 697647 0 2024-09-12T22:49:58.467 INFO:tasks.workunit.client.0.smithi066.stdout:2/822: mkdir d1/d44/df3/d12/de2/d109 0 2024-09-12T22:49:58.467 INFO:tasks.workunit.client.0.smithi066.stdout:1/810: read d0/f16 [1023435,12152] 0 2024-09-12T22:49:58.467 INFO:tasks.workunit.client.0.smithi066.stdout:1/811: creat d0/dc/d1d/f102 x:0 0 0 2024-09-12T22:49:58.468 INFO:tasks.workunit.client.0.smithi066.stdout:2/823: creat d1/d11/d26/d4f/d5f/d61/d72/dad/df5/f10a x:0 0 0 2024-09-12T22:49:58.469 INFO:tasks.workunit.client.0.smithi066.stdout:1/812: read d0/dc/d1e/fbb [1117821,83073] 0 2024-09-12T22:49:58.469 INFO:tasks.workunit.client.0.smithi066.stdout:2/824: rmdir d1/d44/df3/d3d 39 2024-09-12T22:49:58.469 INFO:tasks.workunit.client.0.smithi066.stdout:8/827: read d17/f27 [1364554,31617] 0 2024-09-12T22:49:58.470 INFO:tasks.workunit.client.0.smithi066.stdout:8/828: rename d17/d49/d4b to d17/d49/d4b/d57/d11e 22 2024-09-12T22:49:58.470 INFO:tasks.workunit.client.0.smithi066.stdout:1/813: link d0/d4e/d79/d86/f88 d0/dea/df7/d9a/dd9/f103 0 2024-09-12T22:49:58.471 INFO:tasks.workunit.client.0.smithi066.stdout:1/814: unlink d0/dc/l5d 0 2024-09-12T22:49:58.471 INFO:tasks.workunit.client.0.smithi066.stdout:8/829: creat d17/d49/d4b/d57/d5e/d65/d91/f11f x:0 0 0 2024-09-12T22:49:58.472 INFO:tasks.workunit.client.0.smithi066.stdout:7/751: read d0/d6/fcd [48433,52963] 0 2024-09-12T22:49:58.472 INFO:tasks.workunit.client.0.smithi066.stdout:1/815: mknod d0/d89/c104 0 2024-09-12T22:49:58.472 INFO:tasks.workunit.client.0.smithi066.stdout:8/830: creat d17/d2c/dab/df2/f120 x:0 0 0 2024-09-12T22:49:58.472 INFO:tasks.workunit.client.0.smithi066.stdout:7/752: write d0/d19/d60/f3c [4117402,42683] 0 2024-09-12T22:49:58.473 INFO:tasks.workunit.client.0.smithi066.stdout:1/816: getdents d0/d36/d8e 0 2024-09-12T22:49:58.473 INFO:tasks.workunit.client.0.smithi066.stdout:8/831: read d17/d1b/de7/d116/f78 [3594890,3898] 0 2024-09-12T22:49:58.474 INFO:tasks.workunit.client.0.smithi066.stdout:8/832: fdatasync d17/d40/da8/f113 0 2024-09-12T22:49:58.474 INFO:tasks.workunit.client.0.smithi066.stdout:8/833: creat d17/d49/f121 x:0 0 0 2024-09-12T22:49:58.475 INFO:tasks.workunit.client.0.smithi066.stdout:8/834: mknod d17/d1b/c122 0 2024-09-12T22:49:58.475 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:58.474+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:58.476 INFO:tasks.workunit.client.0.smithi066.stdout:8/835: fsync d17/d1b/f30 0 2024-09-12T22:49:58.476 INFO:tasks.workunit.client.0.smithi066.stdout:8/836: sync 2024-09-12T22:49:58.477 INFO:tasks.workunit.client.0.smithi066.stdout:8/837: creat d17/d40/d74/f123 x:0 0 0 2024-09-12T22:49:58.478 INFO:tasks.workunit.client.0.smithi066.stdout:1/817: dwrite d0/dc/d1e/d47/d6f/f72 [0,4194304] 0 2024-09-12T22:49:58.478 INFO:tasks.workunit.client.0.smithi066.stdout:1/818: dread - d0/d36/d57/d81/fa5 zero size 2024-09-12T22:49:58.481 INFO:tasks.workunit.client.0.smithi066.stdout:7/753: read d0/d86/f95 [163795,43754] 0 2024-09-12T22:49:58.481 INFO:tasks.workunit.client.0.smithi066.stdout:2/825: write d1/d44/df3/d12/d18/f80 [1208893,45628] 0 2024-09-12T22:49:58.483 INFO:tasks.workunit.client.0.smithi066.stdout:7/754: creat d0/d19/d26/d48/df1/ff3 x:0 0 0 2024-09-12T22:49:58.483 INFO:tasks.workunit.client.0.smithi066.stdout:2/826: creat d1/d44/df3/d12/d18/d90/f10b x:0 0 0 2024-09-12T22:49:58.484 INFO:tasks.workunit.client.0.smithi066.stdout:1/819: dwrite d0/d28/fc9 [0,4194304] 0 2024-09-12T22:49:58.488 INFO:tasks.workunit.client.0.smithi066.stdout:7/755: mkdir d0/d19/d24/d33/d27/d70/d90/db8/df4 0 2024-09-12T22:49:58.488 INFO:tasks.workunit.client.0.smithi066.stdout:8/838: dread d17/d49/d4b/d57/f69 [0,4194304] 0 2024-09-12T22:49:58.488 INFO:tasks.workunit.client.0.smithi066.stdout:6/897: dread d6/d23/d25/d4e/dc4/d32/f68 [0,4194304] 0 2024-09-12T22:49:58.489 INFO:tasks.workunit.client.0.smithi066.stdout:1/820: creat d0/f105 x:0 0 0 2024-09-12T22:49:58.489 INFO:tasks.workunit.client.0.smithi066.stdout:4/892: dread d5/d8/d16/d1b/d72/fda [0,4194304] 0 2024-09-12T22:49:58.489 INFO:tasks.workunit.client.0.smithi066.stdout:8/839: creat d17/d40/d74/da3/d11c/f124 x:0 0 0 2024-09-12T22:49:58.489 INFO:tasks.workunit.client.0.smithi066.stdout:6/898: write d6/d23/d25/d88/fa8 [1384318,105006] 0 2024-09-12T22:49:58.491 INFO:tasks.workunit.client.0.smithi066.stdout:2/827: dwrite d1/db/dd9/f103 [0,4194304] 0 2024-09-12T22:49:58.491 INFO:tasks.workunit.client.0.smithi066.stdout:1/821: getdents d0/dc/deb 0 2024-09-12T22:49:58.491 INFO:tasks.workunit.client.0.smithi066.stdout:3/865: dread d0/d2/d1d/f2a [0,4194304] 0 2024-09-12T22:49:58.492 INFO:tasks.workunit.client.0.smithi066.stdout:6/899: readlink d6/d23/d25/d2c/l53 0 2024-09-12T22:49:58.492 INFO:tasks.workunit.client.0.smithi066.stdout:8/840: mknod d17/d49/d4b/d4e/daf/dcb/de2/c125 0 2024-09-12T22:49:58.493 INFO:tasks.workunit.client.0.smithi066.stdout:4/893: creat d5/d8/d16/d93/de0/d119/f129 x:0 0 0 2024-09-12T22:49:58.494 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:58.494 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:58.494 INFO:tasks.workunit.client.0.smithi066.stdout:1/822: mknod d0/dc/d1e/d95/c106 0 2024-09-12T22:49:58.495 INFO:tasks.workunit.client.0.smithi066.stdout:7/756: dwrite d0/d19/d26/d48/d59/fe9 [0,4194304] 0 2024-09-12T22:49:58.495 INFO:tasks.workunit.client.0.smithi066.stdout:8/841: creat d17/d49/d4b/db5/f126 x:0 0 0 2024-09-12T22:49:58.498 INFO:tasks.workunit.client.0.smithi066.stdout:3/866: rename d0/d2/d7/d13/c2f to d0/d2/d1d/d87/d6b/db2/c12e 0 2024-09-12T22:49:58.499 INFO:tasks.workunit.client.0.smithi066.stdout:4/894: stat d5/d8/d16/d1b/d1e/c3c 0 2024-09-12T22:49:58.500 INFO:tasks.workunit.client.0.smithi066.stdout:8/842: write d17/d40/d74/f123 [648379,112883] 0 2024-09-12T22:49:58.500 INFO:tasks.workunit.client.0.smithi066.stdout:2/828: dwrite d1/dc1/ff0 [0,4194304] 0 2024-09-12T22:49:58.501 INFO:tasks.workunit.client.0.smithi066.stdout:9/809: dread d9/dc/d23/f79 [0,4194304] 0 2024-09-12T22:49:58.502 INFO:tasks.workunit.client.0.smithi066.stdout:4/895: write d5/d87/f10a [69275,14015] 0 2024-09-12T22:49:58.502 INFO:tasks.workunit.client.0.smithi066.stdout:2/829: readlink d1/db/l58 0 2024-09-12T22:49:58.502 INFO:tasks.workunit.client.0.smithi066.stdout:0/825: dread d1/f67 [0,4194304] 0 2024-09-12T22:49:58.503 INFO:tasks.workunit.client.0.smithi066.stdout:1/823: read d0/dc/d44/f77 [337231,66116] 0 2024-09-12T22:49:58.503 INFO:tasks.workunit.client.0.smithi066.stdout:8/843: mknod d17/d49/d4b/d57/d5e/d62/dc1/c127 0 2024-09-12T22:49:58.504 INFO:tasks.workunit.client.0.smithi066.stdout:9/810: symlink d9/d31/l106 0 2024-09-12T22:49:58.504 INFO:tasks.workunit.client.0.smithi066.stdout:2/830: write d1/d44/d51/fcc [83277,126416] 0 2024-09-12T22:49:58.504 INFO:tasks.workunit.client.0.smithi066.stdout:6/900: dwrite d6/d23/d25/d2c/d69/f83 [0,4194304] 0 2024-09-12T22:49:58.505 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:58.506 INFO:tasks.workunit.client.0.smithi066.stdout:1/824: truncate d0/dc/d1e/fbb 4600518 0 2024-09-12T22:49:58.506 INFO:tasks.workunit.client.0.smithi066.stdout:2/831: write d1/d44/df3/d12/d18/f3e [4092194,100074] 0 2024-09-12T22:49:58.506 INFO:tasks.workunit.client.0.smithi066.stdout:4/896: creat d5/d3e/f12a x:0 0 0 2024-09-12T22:49:58.506 INFO:tasks.workunit.client.0.smithi066.stdout:9/811: rmdir d9/df0/d8c/de2 39 2024-09-12T22:49:58.506 INFO:tasks.workunit.client.0.smithi066.stdout:8/844: mknod d17/d49/d4b/d4e/daf/c128 0 2024-09-12T22:49:58.507 INFO:tasks.workunit.client.0.smithi066.stdout:0/826: chown d1/d36/d65/dc2/dd7/cdc 18 1 2024-09-12T22:49:58.507 INFO:tasks.workunit.client.0.smithi066.stdout:8/845: chown d17/d2c/c2f 5669174 1 2024-09-12T22:49:58.507 INFO:tasks.workunit.client.0.smithi066.stdout:9/812: readlink d9/dc/l7a 0 2024-09-12T22:49:58.508 INFO:tasks.workunit.client.0.smithi066.stdout:0/827: fsync d1/d8/d1c/d13/d2f/dd8/f28 0 2024-09-12T22:49:58.509 INFO:tasks.workunit.client.0.smithi066.stdout:6/901: rename d6/d51/fc3 to d6/d23/d41/db6/dd3/df9/d102/f134 0 2024-09-12T22:49:58.509 INFO:tasks.workunit.client.0.smithi066.stdout:9/813: dread - d9/d31/d58/dbc/fdf zero size 2024-09-12T22:49:58.511 INFO:tasks.workunit.client.0.smithi066.stdout:7/757: truncate d0/d19/d24/f1d 2202234 0 2024-09-12T22:49:58.513 INFO:tasks.workunit.client.0.smithi066.stdout:0/828: dread - d1/d8/d1c/d13/d2f/d8a/de1/ff7 zero size 2024-09-12T22:49:58.513 INFO:tasks.workunit.client.0.smithi066.stdout:2/832: write d1/d11/d26/d4f/fa5 [538721,80018] 0 2024-09-12T22:49:58.513 INFO:tasks.workunit.client.0.smithi066.stdout:9/814: chown d9/df0/fd3 27652 1 2024-09-12T22:49:58.513 INFO:tasks.workunit.client.0.smithi066.stdout:5/898: dread d5/d11/d21/d78/f7b [0,4194304] 0 2024-09-12T22:49:58.513 INFO:tasks.workunit.client.0.smithi066.stdout:6/902: mkdir d6/d23/d25/d4e/d135 0 2024-09-12T22:49:58.513 INFO:tasks.workunit.client.0.smithi066.stdout:3/867: dread d0/d2/f6e [0,4194304] 0 2024-09-12T22:49:58.515 INFO:tasks.workunit.client.0.smithi066.stdout:7/758: creat d0/d19/d24/d33/ff5 x:0 0 0 2024-09-12T22:49:58.515 INFO:tasks.workunit.client.0.smithi066.stdout:1/825: dwrite d0/d36/d57/f7e [4194304,4194304] 0 2024-09-12T22:49:58.516 INFO:tasks.workunit.client.0.smithi066.stdout:5/899: fdatasync d5/d11/d21/f4a 0 2024-09-12T22:49:58.517 INFO:tasks.workunit.client.0.smithi066.stdout:9/815: mkdir d9/df0/d8c/de2/d107 0 2024-09-12T22:49:58.517 INFO:tasks.workunit.client.0.smithi066.stdout:4/897: dwrite d5/d3e/d8d/dc7/d126/f27 [0,4194304] 0 2024-09-12T22:49:58.518 INFO:tasks.workunit.client.0.smithi066.stdout:6/903: write d6/d23/d41/db6/dd3/fdf [963233,86645] 0 2024-09-12T22:49:58.519 INFO:tasks.workunit.client.0.smithi066.stdout:3/868: mknod d0/d2/d1d/d87/d40/dbd/d74/c12f 0 2024-09-12T22:49:58.522 INFO:tasks.workunit.client.0.smithi066.stdout:8/846: dwrite d17/d40/d47/d4d/df0/f100 [0,4194304] 0 2024-09-12T22:49:58.522 INFO:tasks.workunit.client.0.smithi066.stdout:6/904: write d6/d49/f2f [1408172,94482] 0 2024-09-12T22:49:58.524 INFO:tasks.workunit.client.0.smithi066.stdout:9/816: symlink d9/d31/d77/l108 0 2024-09-12T22:49:58.526 INFO:tasks.workunit.client.0.smithi066.stdout:0/829: dread d1/d8/d1c/d13/d2f/dd8/fde [0,4194304] 0 2024-09-12T22:49:58.526 INFO:tasks.workunit.client.0.smithi066.stdout:6/905: mkdir d6/d23/d25/d4e/dc4/d50/dd6/d136 0 2024-09-12T22:49:58.526 INFO:tasks.workunit.client.0.smithi066.stdout:8/847: mkdir d17/d49/d4b/d57/d5e/d62/dc1/d129 0 2024-09-12T22:49:58.527 INFO:tasks.workunit.client.0.smithi066.stdout:1/826: dwrite d0/d36/d57/f3f [4194304,4194304] 0 2024-09-12T22:49:58.528 INFO:tasks.workunit.client.0.smithi066.stdout:9/817: symlink d9/dc/d46/d8a/l109 0 2024-09-12T22:49:58.528 INFO:tasks.workunit.client.0.smithi066.stdout:7/759: dwrite d0/d19/d60/d53/f67 [0,4194304] 0 2024-09-12T22:49:58.528 INFO:tasks.workunit.client.0.smithi066.stdout:8/848: readlink d17/d49/d4b/d57/d5e/lba 0 2024-09-12T22:49:58.529 INFO:tasks.workunit.client.0.smithi066.stdout:8/849: write d17/d1b/f30 [3818174,25099] 0 2024-09-12T22:49:58.530 INFO:tasks.workunit.client.0.smithi066.stdout:4/898: write d5/d8/d16/d93/d9c/d98/dab/db3/f125 [112405,35305] 0 2024-09-12T22:49:58.530 INFO:tasks.workunit.client.0.smithi066.stdout:7/760: dread d0/d19/d24/fa0 [0,4194304] 0 2024-09-12T22:49:58.530 INFO:tasks.workunit.client.0.smithi066.stdout:0/830: unlink d1/d8/d1f/l111 0 2024-09-12T22:49:58.531 INFO:tasks.workunit.client.0.smithi066.stdout:5/900: dwrite d5/de/d50/d42/d9d/fa8 [0,4194304] 0 2024-09-12T22:49:58.532 INFO:tasks.workunit.client.0.smithi066.stdout:8/850: creat d17/d1b/de7/f12a x:0 0 0 2024-09-12T22:49:58.532 INFO:tasks.workunit.client.0.smithi066.stdout:0/831: readlink d1/d8/d1f/d47/l99 0 2024-09-12T22:49:58.532 INFO:tasks.workunit.client.0.smithi066.stdout:2/833: truncate d1/db/dd9/f103 1609180 0 2024-09-12T22:49:58.534 INFO:tasks.workunit.client.0.smithi066.stdout:7/761: mkdir d0/d19/d24/d33/d27/dba/dc9/df6 0 2024-09-12T22:49:58.535 INFO:tasks.workunit.client.0.smithi066.stdout:9/818: truncate d9/dc/d46/f4b 678529 0 2024-09-12T22:49:58.535 INFO:tasks.workunit.client.0.smithi066.stdout:6/906: write d6/f17 [3148272,122240] 0 2024-09-12T22:49:58.537 INFO:tasks.workunit.client.0.smithi066.stdout:7/762: dread - d0/d86/fb7 zero size 2024-09-12T22:49:58.537 INFO:tasks.workunit.client.0.smithi066.stdout:9/819: mkdir d9/d31/d10a 0 2024-09-12T22:49:58.538 INFO:tasks.workunit.client.0.smithi066.stdout:4/899: rename d5/d8/d16/d1b/l2f to d5/d8/d16/d93/d9c/d98/dab/l12b 0 2024-09-12T22:49:58.539 INFO:tasks.workunit.client.0.smithi066.stdout:2/834: dwrite d1/d11/d26/feb [0,4194304] 0 2024-09-12T22:49:58.539 INFO:tasks.workunit.client.0.smithi066.stdout:9/820: chown d9/dc/dd/f5f 1255935541 1 2024-09-12T22:49:58.541 INFO:tasks.workunit.client.0.smithi066.stdout:1/827: dwrite d0/dc/d1e/d47/f9b [0,4194304] 0 2024-09-12T22:49:58.541 INFO:tasks.workunit.client.0.smithi066.stdout:9/821: write d9/fd4 [529708,115860] 0 2024-09-12T22:49:58.542 INFO:tasks.workunit.client.0.smithi066.stdout:4/900: chown d5/d8/d16/d1b/d1e/d5a/ld8 125964590 1 2024-09-12T22:49:58.542 INFO:tasks.workunit.client.0.smithi066.stdout:8/851: rename d17/d1b/la2 to d17/d40/l12b 0 2024-09-12T22:49:58.545 INFO:tasks.workunit.client.0.smithi066.stdout:6/907: dwrite d6/d7/d66/fca [0,4194304] 0 2024-09-12T22:49:58.546 INFO:tasks.workunit.client.0.smithi066.stdout:1/828: creat d0/d89/dd7/f107 x:0 0 0 2024-09-12T22:49:58.547 INFO:tasks.workunit.client.0.smithi066.stdout:9/822: truncate d9/d31/d58/dbc/da8/fda 233495 0 2024-09-12T22:49:58.549 INFO:tasks.workunit.client.0.smithi066.stdout:8/852: truncate d17/f27 1993906 0 2024-09-12T22:49:58.552 INFO:tasks.workunit.client.0.smithi066.stdout:6/908: symlink d6/d7/dc1/l137 0 2024-09-12T22:49:58.553 INFO:tasks.workunit.client.0.smithi066.stdout:0/832: dread d1/d8/d1c/d13/d2f/f82 [0,4194304] 0 2024-09-12T22:49:58.554 INFO:tasks.workunit.client.0.smithi066.stdout:2/835: dwrite d1/db/d42/d43/fbf [4194304,4194304] 0 2024-09-12T22:49:58.554 INFO:tasks.workunit.client.0.smithi066.stdout:8/853: unlink d17/d40/c10a 0 2024-09-12T22:49:58.554 INFO:tasks.workunit.client.0.smithi066.stdout:7/763: dwrite d0/d19/d60/d85/d8b/f98 [0,4194304] 0 2024-09-12T22:49:58.554 INFO:tasks.workunit.client.0.smithi066.stdout:3/869: dread d0/d2/d7/dc4/dcf/fed [0,4194304] 0 2024-09-12T22:49:58.554 INFO:tasks.workunit.client.0.smithi066.stdout:1/829: rename d0/d36/d57/d81/ffd to d0/d4e/d79/dc1/f108 0 2024-09-12T22:49:58.554 INFO:tasks.workunit.client.0.smithi066.stdout:6/909: fsync d6/d7/f10a 0 2024-09-12T22:49:58.555 INFO:tasks.workunit.client.0.smithi066.stdout:0/833: fsync d1/d8/fe 0 2024-09-12T22:49:58.555 INFO:tasks.workunit.client.0.smithi066.stdout:7/764: stat d0/d19/cd1 0 2024-09-12T22:49:58.555 INFO:tasks.workunit.client.0.smithi066.stdout:4/901: dwrite d5/d8/d16/d93/da6/dea/f128 [0,4194304] 0 2024-09-12T22:49:58.557 INFO:tasks.workunit.client.0.smithi066.stdout:8/854: dread d17/d40/da8/fb1 [0,4194304] 0 2024-09-12T22:49:58.560 INFO:tasks.workunit.client.0.smithi066.stdout:6/910: truncate d6/d23/d25/d4e/dc4/d32/d3c/fa7 843579 0 2024-09-12T22:49:58.561 INFO:tasks.workunit.client.0.smithi066.stdout:0/834: rename d1/c91 to d1/d8/d1b/dac/c123 0 2024-09-12T22:49:58.562 INFO:tasks.workunit.client.0.smithi066.stdout:1/830: dread d0/dc/d1e/d47/d6f/f72 [0,4194304] 0 2024-09-12T22:49:58.562 INFO:tasks.workunit.client.0.smithi066.stdout:0/835: write d1/d8/fec [2727628,30800] 0 2024-09-12T22:49:58.563 INFO:tasks.workunit.client.0.smithi066.stdout:3/870: dwrite d0/d2/d7/f10e [0,4194304] 0 2024-09-12T22:49:58.563 INFO:tasks.workunit.client.0.smithi066.stdout:6/911: write d6/d23/f3e [683263,100205] 0 2024-09-12T22:49:58.564 INFO:tasks.workunit.client.0.smithi066.stdout:1/831: creat d0/dc0/f109 x:0 0 0 2024-09-12T22:49:58.564 INFO:tasks.workunit.client.0.smithi066.stdout:0/836: mkdir d1/d5b/d124 0 2024-09-12T22:49:58.565 INFO:tasks.workunit.client.0.smithi066.stdout:6/912: mkdir d6/d7/dc6/d138 0 2024-09-12T22:49:58.565 INFO:tasks.workunit.client.0.smithi066.stdout:0/837: chown d1/d5b/dba/fc1 47925 1 2024-09-12T22:49:58.566 INFO:tasks.workunit.client.0.smithi066.stdout:0/838: creat d1/dbf/d102/f125 x:0 0 0 2024-09-12T22:49:58.566 INFO:tasks.workunit.client.0.smithi066.stdout:4/902: dwrite d5/d8/d16/d1b/d1e/d1f/fa9 [0,4194304] 0 2024-09-12T22:49:58.566 INFO:tasks.workunit.client.0.smithi066.stdout:1/832: link d0/d28/l45 d0/dc/d1e/d95/df2/l10a 0 2024-09-12T22:49:58.567 INFO:tasks.workunit.client.0.smithi066.stdout:2/836: write d1/d11/f98 [717323,17895] 0 2024-09-12T22:49:58.567 INFO:tasks.workunit.client.0.smithi066.stdout:6/913: readlink d6/d23/d25/d4e/dc4/d32/d3c/l44 0 2024-09-12T22:49:58.569 INFO:tasks.workunit.client.0.smithi066.stdout:4/903: rmdir d5/d3e 39 2024-09-12T22:49:58.569 INFO:tasks.workunit.client.0.smithi066.stdout:1/833: readlink d0/d36/d57/lcc 0 2024-09-12T22:49:58.569 INFO:tasks.workunit.client.0.smithi066.stdout:0/839: creat d1/d36/d65/dc2/dd7/f126 x:0 0 0 2024-09-12T22:49:58.573 INFO:tasks.workunit.client.0.smithi066.stdout:1/834: write d0/dc/d1e/d95/f6a [1364563,18947] 0 2024-09-12T22:49:58.573 INFO:tasks.workunit.client.0.smithi066.stdout:4/904: link d5/d8/c63 d5/d8/d10/c12c 0 2024-09-12T22:49:58.574 INFO:tasks.workunit.client.0.smithi066.stdout:7/765: dwrite d0/f54 [0,4194304] 0 2024-09-12T22:49:58.575 INFO:tasks.workunit.client.0.smithi066.stdout:8/855: dwrite d17/d49/d4b/f76 [0,4194304] 0 2024-09-12T22:49:58.575 INFO:tasks.workunit.client.0.smithi066.stdout:1/835: fsync d0/d36/d57/f27 0 2024-09-12T22:49:58.575 INFO:tasks.workunit.client.0.smithi066.stdout:8/856: readlink d17/l26 0 2024-09-12T22:49:58.576 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:58.575+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:58.576 INFO:tasks.workunit.client.0.smithi066.stdout:1/836: write d0/f105 [166283,72493] 0 2024-09-12T22:49:58.576 INFO:tasks.workunit.client.0.smithi066.stdout:3/871: truncate d0/d2/d1d/d87/d40/d44/d55/d91/fb0 1350675 0 2024-09-12T22:49:58.578 INFO:tasks.workunit.client.0.smithi066.stdout:8/857: mkdir d17/d1b/de7/dea/d12c 0 2024-09-12T22:49:58.579 INFO:tasks.workunit.client.0.smithi066.stdout:0/840: dwrite d1/d36/d65/dc2/ffb [0,4194304] 0 2024-09-12T22:49:58.581 INFO:tasks.workunit.client.0.smithi066.stdout:6/914: dwrite d6/d23/f5e [0,4194304] 0 2024-09-12T22:49:58.582 INFO:tasks.workunit.client.0.smithi066.stdout:6/915: write d6/f17 [2705214,100020] 0 2024-09-12T22:49:58.584 INFO:tasks.workunit.client.0.smithi066.stdout:3/872: fdatasync d0/d2/d7/d13/d31/f83 0 2024-09-12T22:49:58.585 INFO:tasks.workunit.client.0.smithi066.stdout:0/841: fsync d1/d8/d1c/d56/db7/f106 0 2024-09-12T22:49:58.585 INFO:tasks.workunit.client.0.smithi066.stdout:1/837: dwrite d0/d89/ffa [0,4194304] 0 2024-09-12T22:49:58.585 INFO:tasks.workunit.client.0.smithi066.stdout:5/901: dread d5/d11/d23/d6f/daa/dbb/dc6/de1/fd1 [0,4194304] 0 2024-09-12T22:49:58.587 INFO:tasks.workunit.client.0.smithi066.stdout:8/858: mknod d17/d2c/dab/d117/c12d 0 2024-09-12T22:49:58.587 INFO:tasks.workunit.client.0.smithi066.stdout:1/838: symlink d0/d28/l10b 0 2024-09-12T22:49:58.588 INFO:tasks.workunit.client.0.smithi066.stdout:0/842: mkdir d1/d8/d1c/d56/db8/d127 0 2024-09-12T22:49:58.588 INFO:tasks.workunit.client.0.smithi066.stdout:6/916: write d6/d7/dc/fbe [1577163,118772] 0 2024-09-12T22:49:58.589 INFO:tasks.workunit.client.0.smithi066.stdout:2/837: dwrite d1/d11/d26/d4f/d5f/d61/d72/dad/d76/f95 [0,4194304] 0 2024-09-12T22:49:58.590 INFO:tasks.workunit.client.0.smithi066.stdout:1/839: chown d0/dc/d1e/d95/ca 1 1 2024-09-12T22:49:58.590 INFO:tasks.workunit.client.0.smithi066.stdout:2/838: chown d1 10509 1 2024-09-12T22:49:58.590 INFO:tasks.workunit.client.0.smithi066.stdout:0/843: unlink d1/d8/d1f/d30/fbb 0 2024-09-12T22:49:58.590 INFO:tasks.workunit.client.0.smithi066.stdout:6/917: truncate d6/d7/f39 2658809 0 2024-09-12T22:49:58.590 INFO:tasks.workunit.client.0.smithi066.stdout:8/859: unlink d17/d49/d4b/d57/d5e/d65/d91/cf8 0 2024-09-12T22:49:58.591 INFO:tasks.workunit.client.0.smithi066.stdout:0/844: fsync d1/d8/d1c/d13/d2f/f4a 0 2024-09-12T22:49:58.592 INFO:tasks.workunit.client.0.smithi066.stdout:1/840: symlink d0/dc/d1e/d95/dcb/df3/l10c 0 2024-09-12T22:49:58.592 INFO:tasks.workunit.client.0.smithi066.stdout:3/873: dwrite d0/d2/d1d/d87/d40/d44/ff4 [0,4194304] 0 2024-09-12T22:49:58.592 INFO:tasks.workunit.client.0.smithi066.stdout:6/918: write d6/d23/d25/f7b [878756,97289] 0 2024-09-12T22:49:58.594 INFO:tasks.workunit.client.0.smithi066.stdout:1/841: stat d0/d36/d57/d81/fa5 0 2024-09-12T22:49:58.594 INFO:tasks.workunit.client.0.smithi066.stdout:0/845: write d1/d36/d65/de9/f110 [126588,1860] 0 2024-09-12T22:49:58.595 INFO:tasks.workunit.client.0.smithi066.stdout:3/874: mkdir d0/d2/d1d/d87/d40/da2/d130 0 2024-09-12T22:49:58.595 INFO:tasks.workunit.client.0.smithi066.stdout:6/919: unlink d6/d23/d41/db6/ced 0 2024-09-12T22:49:58.595 INFO:tasks.workunit.client.0.smithi066.stdout:1/842: stat d0/dc/d1d/cc3 0 2024-09-12T22:49:58.596 INFO:tasks.workunit.client.0.smithi066.stdout:8/860: write d17/d40/d74/da3/dac/dc8/feb [1702726,112179] 0 2024-09-12T22:49:58.596 INFO:tasks.workunit.client.0.smithi066.stdout:6/920: fdatasync d6/d35/ff8 0 2024-09-12T22:49:58.597 INFO:tasks.workunit.client.0.smithi066.stdout:1/843: mknod d0/dc/d1e/d47/d6f/c10d 0 2024-09-12T22:49:58.598 INFO:tasks.workunit.client.0.smithi066.stdout:1/844: readlink d0/dc/d1e/l41 0 2024-09-12T22:49:58.598 INFO:tasks.workunit.client.0.smithi066.stdout:8/861: mkdir d17/d49/d4b/d57/d5e/d62/dc1/d12e 0 2024-09-12T22:49:58.598 INFO:tasks.workunit.client.0.smithi066.stdout:1/845: readlink d0/d36/l48 0 2024-09-12T22:49:58.598 INFO:tasks.workunit.client.0.smithi066.stdout:3/875: readlink d0/d2/d1d/d87/d40/d44/d55/d91/lfc 0 2024-09-12T22:49:58.598 INFO:tasks.workunit.client.0.smithi066.stdout:2/839: dwrite d1/d11/d26/d4f/d5f/d61/d7e/f64 [0,4194304] 0 2024-09-12T22:49:58.599 INFO:tasks.workunit.client.0.smithi066.stdout:8/862: fdatasync d17/d40/d47/d4d/d87/fa9 0 2024-09-12T22:49:58.599 INFO:tasks.workunit.client.0.smithi066.stdout:1/846: chown d0/dc/d1e/d95/f14 54 1 2024-09-12T22:49:58.600 INFO:tasks.workunit.client.0.smithi066.stdout:3/876: symlink d0/d2/d6/l131 0 2024-09-12T22:49:58.600 INFO:tasks.workunit.client.0.smithi066.stdout:8/863: dread - d17/d49/f111 zero size 2024-09-12T22:49:58.600 INFO:tasks.workunit.client.0.smithi066.stdout:7/766: sync 2024-09-12T22:49:58.601 INFO:tasks.workunit.client.0.smithi066.stdout:1/847: write d0/d4e/d79/dc1/f108 [670248,56818] 0 2024-09-12T22:49:58.602 INFO:tasks.workunit.client.0.smithi066.stdout:7/767: creat d0/d19/d60/d53/ff7 x:0 0 0 2024-09-12T22:49:58.602 INFO:tasks.workunit.client.0.smithi066.stdout:8/864: symlink d17/d1b/de7/dea/d12c/l12f 0 2024-09-12T22:49:58.603 INFO:tasks.workunit.client.0.smithi066.stdout:6/921: dwrite d6/d23/f27 [0,4194304] 0 2024-09-12T22:49:58.605 INFO:tasks.workunit.client.0.smithi066.stdout:1/848: symlink d0/d89/dd7/dd5/de0/l10e 0 2024-09-12T22:49:58.608 INFO:tasks.workunit.client.0.smithi066.stdout:1/849: write d0/d89/dd7/f107 [68158,101924] 0 2024-09-12T22:49:58.608 INFO:tasks.workunit.client.0.smithi066.stdout:3/877: dwrite d0/d2/d6/fc6 [0,4194304] 0 2024-09-12T22:49:58.610 INFO:tasks.workunit.client.0.smithi066.stdout:8/865: dwrite d17/d2c/f38 [8388608,4194304] 0 2024-09-12T22:49:58.611 INFO:tasks.workunit.client.0.smithi066.stdout:1/850: write d0/fcf [264621,105837] 0 2024-09-12T22:49:58.611 INFO:tasks.workunit.client.0.smithi066.stdout:3/878: mkdir d0/d2/d10b/d132 0 2024-09-12T22:49:58.611 INFO:tasks.workunit.client.0.smithi066.stdout:6/922: dwrite d6/d23/d25/d4e/f105 [0,4194304] 0 2024-09-12T22:49:58.611 INFO:tasks.workunit.client.0.smithi066.stdout:1/851: fsync d0/d36/d57/f3f 0 2024-09-12T22:49:58.612 INFO:tasks.workunit.client.0.smithi066.stdout:1/852: stat d0/d4e/d79/dc1/f108 0 2024-09-12T22:49:58.612 INFO:tasks.workunit.client.0.smithi066.stdout:3/879: write d0/d2/d1d/d87/d40/f4d [4098142,7960] 0 2024-09-12T22:49:58.614 INFO:tasks.workunit.client.0.smithi066.stdout:6/923: fdatasync d6/d23/d25/f97 0 2024-09-12T22:49:58.615 INFO:tasks.workunit.client.0.smithi066.stdout:3/880: creat d0/d2/d7/dc4/dcf/f133 x:0 0 0 2024-09-12T22:49:58.617 INFO:tasks.workunit.client.0.smithi066.stdout:6/924: creat d6/d23/d25/d2c/d69/f139 x:0 0 0 2024-09-12T22:49:58.617 INFO:tasks.workunit.client.0.smithi066.stdout:5/902: dread d5/de/d50/d42/d49/fdc [0,4194304] 0 2024-09-12T22:49:58.618 INFO:tasks.workunit.client.0.smithi066.stdout:8/866: dwrite d17/d1b/de7/d116/f6e [0,4194304] 0 2024-09-12T22:49:58.618 INFO:tasks.workunit.client.0.smithi066.stdout:3/881: mknod d0/d2/d10b/d132/c134 0 2024-09-12T22:49:58.619 INFO:tasks.workunit.client.0.smithi066.stdout:1/853: dread d0/dc/d1e/fbb [0,4194304] 0 2024-09-12T22:49:58.620 INFO:tasks.workunit.client.0.smithi066.stdout:2/840: dwrite d1/d44/df3/d12/d18/da8/f82 [0,4194304] 0 2024-09-12T22:49:58.620 INFO:tasks.workunit.client.0.smithi066.stdout:1/854: stat d0/dc 0 2024-09-12T22:49:58.621 INFO:tasks.workunit.client.0.smithi066.stdout:1/855: rmdir d0/dc/d1e/d47 39 2024-09-12T22:49:58.621 INFO:tasks.workunit.client.0.smithi066.stdout:1/856: sync 2024-09-12T22:49:58.622 INFO:tasks.workunit.client.0.smithi066.stdout:2/841: link d1/d11/d26/d4f/lbb d1/d11/d26/d4f/l10c 0 2024-09-12T22:49:58.624 INFO:tasks.workunit.client.0.smithi066.stdout:2/842: chown d1/d11/d26/d4f/d52 0 1 2024-09-12T22:49:58.624 INFO:tasks.workunit.client.0.smithi066.stdout:1/857: link d0/dc/d44/l71 d0/d36/d8e/l10f 0 2024-09-12T22:49:58.624 INFO:tasks.workunit.client.0.smithi066.stdout:8/867: dwrite d17/d1b/fd5 [0,4194304] 0 2024-09-12T22:49:58.625 INFO:tasks.workunit.client.0.smithi066.stdout:3/882: dwrite d0/d2/d1d/d87/d40/f95 [0,4194304] 0 2024-09-12T22:49:58.627 INFO:tasks.workunit.client.0.smithi066.stdout:2/843: read d1/d11/d26/d4f/d5f/d61/d7e/f64 [3826048,130879] 0 2024-09-12T22:49:58.627 INFO:tasks.workunit.client.0.smithi066.stdout:3/883: creat d0/d2/d1d/d87/d40/dbd/d74/f135 x:0 0 0 2024-09-12T22:49:58.629 INFO:tasks.workunit.client.0.smithi066.stdout:2/844: chown d1/d11/d26/d4f/d5f/d61/d72/dad/df5/f10a 245076803 1 2024-09-12T22:49:58.631 INFO:tasks.workunit.client.0.smithi066.stdout:8/868: dwrite d17/d2c/f38 [0,4194304] 0 2024-09-12T22:49:58.633 INFO:tasks.workunit.client.0.smithi066.stdout:3/884: dwrite d0/d2/d1d/d87/f8d [0,4194304] 0 2024-09-12T22:49:58.634 INFO:tasks.workunit.client.0.smithi066.stdout:8/869: mkdir d17/d49/d4b/d130 0 2024-09-12T22:49:58.634 INFO:tasks.workunit.client.0.smithi066.stdout:2/845: creat d1/d44/df3/f10d x:0 0 0 2024-09-12T22:49:58.635 INFO:tasks.workunit.client.0.smithi066.stdout:3/885: mkdir d0/db3/db7/d136 0 2024-09-12T22:49:58.635 INFO:tasks.workunit.client.0.smithi066.stdout:8/870: write d17/d1b/f86 [1650869,125339] 0 2024-09-12T22:49:58.636 INFO:tasks.workunit.client.0.smithi066.stdout:8/871: mkdir d17/d40/d47/d81/d131 0 2024-09-12T22:49:58.637 INFO:tasks.workunit.client.0.smithi066.stdout:2/846: truncate d1/d11/d26/d4f/fd6 1571707 0 2024-09-12T22:49:58.637 INFO:tasks.workunit.client.0.smithi066.stdout:3/886: write d0/d2/d7/d13/f103 [971732,130668] 0 2024-09-12T22:49:58.637 INFO:tasks.workunit.client.0.smithi066.stdout:3/887: sync 2024-09-12T22:49:58.640 INFO:tasks.workunit.client.0.smithi066.stdout:4/905: dread d5/d8/f78 [0,4194304] 0 2024-09-12T22:49:58.640 INFO:tasks.workunit.client.0.smithi066.stdout:9/823: dread d9/dc/dd/f5f [0,4194304] 0 2024-09-12T22:49:58.642 INFO:tasks.workunit.client.0.smithi066.stdout:9/824: dread - d9/d31/d34/ff2 zero size 2024-09-12T22:49:58.642 INFO:tasks.workunit.client.0.smithi066.stdout:4/906: unlink d5/d3e/d65/dac/fcb 0 2024-09-12T22:49:58.643 INFO:tasks.workunit.client.0.smithi066.stdout:3/888: dread d0/d2/d1d/d87/f8d [0,4194304] 0 2024-09-12T22:49:58.643 INFO:tasks.workunit.client.0.smithi066.stdout:6/925: rename d6/d23/d25 to d6/d23/d41/db6/dd3/d13a 0 2024-09-12T22:49:58.643 INFO:tasks.workunit.client.0.smithi066.stdout:4/907: mknod d5/c12d 0 2024-09-12T22:49:58.644 INFO:tasks.workunit.client.0.smithi066.stdout:9/825: creat d9/d31/d34/f10b x:0 0 0 2024-09-12T22:49:58.644 INFO:tasks.workunit.client.0.smithi066.stdout:5/903: rename d5/de/d50/da0 to d5/d11/d23/d6f/daa/dbb/d111 0 2024-09-12T22:49:58.644 INFO:tasks.workunit.client.0.smithi066.stdout:3/889: chown d0/d2/d1d/d87/d40/da2/f108 8091936 1 2024-09-12T22:49:58.644 INFO:tasks.workunit.client.0.smithi066.stdout:4/908: fsync d5/d8/d16/d1b/d1e/d5a/f67 0 2024-09-12T22:49:58.644 INFO:tasks.workunit.client.0.smithi066.stdout:8/872: rename d17/d2c/f90 to d17/d1b/f132 0 2024-09-12T22:49:58.645 INFO:tasks.workunit.client.0.smithi066.stdout:9/826: symlink d9/d31/d58/dbc/d9d/dff/l10c 0 2024-09-12T22:49:58.645 INFO:tasks.workunit.client.0.smithi066.stdout:2/847: read d1/d11/d26/f77 [958605,59302] 0 2024-09-12T22:49:58.645 INFO:tasks.workunit.client.0.smithi066.stdout:6/926: read d6/f8b [1600934,85] 0 2024-09-12T22:49:58.646 INFO:tasks.workunit.client.0.smithi066.stdout:3/890: write d0/d2/d1d/d87/d6b/db2/f72 [2481808,64642] 0 2024-09-12T22:49:58.646 INFO:tasks.workunit.client.0.smithi066.stdout:8/873: dread - d17/d40/dc4/f103 zero size 2024-09-12T22:49:58.646 INFO:tasks.workunit.client.0.smithi066.stdout:5/904: rename d5/d11/d21/l7d to d5/d11/d23/d6f/daa/dbb/l112 0 2024-09-12T22:49:58.647 INFO:tasks.workunit.client.0.smithi066.stdout:4/909: link d5/d3e/d8d/dc7/d126/d39/f101 d5/d8/d10/d11a/f12e 0 2024-09-12T22:49:58.647 INFO:tasks.workunit.client.0.smithi066.stdout:3/891: chown d0/d2/d7/d29/daf/lb4 1866526 1 2024-09-12T22:49:58.647 INFO:tasks.workunit.client.0.smithi066.stdout:3/892: sync 2024-09-12T22:49:58.647 INFO:tasks.workunit.client.0.smithi066.stdout:8/874: symlink d17/d49/d4b/d57/d5e/d62/dc1/l133 0 2024-09-12T22:49:58.647 INFO:tasks.workunit.client.0.smithi066.stdout:2/848: write d1/d11/d26/d4f/d5f/d61/d72/fe0 [331001,7180] 0 2024-09-12T22:49:58.648 INFO:tasks.workunit.client.0.smithi066.stdout:6/927: fsync d6/d23/d41/db6/dd3/d13a/d2c/d69/f139 0 2024-09-12T22:49:58.648 INFO:tasks.workunit.client.0.smithi066.stdout:4/910: symlink d5/d8/d16/d1b/d1e/l12f 0 2024-09-12T22:49:58.649 INFO:tasks.workunit.client.0.smithi066.stdout:2/849: creat d1/d11/d26/d8f/f10e x:0 0 0 2024-09-12T22:49:58.649 INFO:tasks.workunit.client.0.smithi066.stdout:2/850: sync 2024-09-12T22:49:58.649 INFO:tasks.workunit.client.0.smithi066.stdout:8/875: dread - d17/d49/d4b/d57/d5e/fc5 zero size 2024-09-12T22:49:58.650 INFO:tasks.workunit.client.0.smithi066.stdout:6/928: mknod d6/d23/d41/df2/c13b 0 2024-09-12T22:49:58.652 INFO:tasks.workunit.client.0.smithi066.stdout:4/911: creat d5/d8/d16/d93/d9c/f130 x:0 0 0 2024-09-12T22:49:58.652 INFO:tasks.workunit.client.0.smithi066.stdout:9/827: dwrite d9/fd4 [0,4194304] 0 2024-09-12T22:49:58.652 INFO:tasks.workunit.client.0.smithi066.stdout:8/876: creat d17/d49/f134 x:0 0 0 2024-09-12T22:49:58.654 INFO:tasks.workunit.client.0.smithi066.stdout:3/893: dwrite d0/f38 [4194304,4194304] 0 2024-09-12T22:49:58.657 INFO:tasks.workunit.client.0.smithi066.stdout:4/912: symlink d5/d8/d16/d93/d9c/d98/l131 0 2024-09-12T22:49:58.661 INFO:tasks.workunit.client.0.smithi066.stdout:3/894: mkdir d0/d2/d7/dc4/dcf/d9e/d137 0 2024-09-12T22:49:58.661 INFO:tasks.workunit.client.0.smithi066.stdout:5/905: write d5/de/d50/d42/d49/f6b [851819,96950] 0 2024-09-12T22:49:58.661 INFO:tasks.workunit.client.0.smithi066.stdout:9/828: read d9/fa [2087397,122546] 0 2024-09-12T22:49:58.661 INFO:tasks.workunit.client.0.smithi066.stdout:8/877: dwrite d17/d49/d4b/d57/d5e/fc5 [0,4194304] 0 2024-09-12T22:49:58.661 INFO:tasks.workunit.client.0.smithi066.stdout:3/895: truncate d0/d2/d1d/d87/d40/da2/ffd 429081 0 2024-09-12T22:49:58.661 INFO:tasks.workunit.client.0.smithi066.stdout:4/913: link d5/d8/d16/d1b/c57 d5/d8/d16/dc2/c132 0 2024-09-12T22:49:58.661 INFO:tasks.workunit.client.0.smithi066.stdout:0/846: dread d1/d8/d1c/fa9 [0,4194304] 0 2024-09-12T22:49:58.662 INFO:tasks.workunit.client.0.smithi066.stdout:3/896: read - d0/d2/d6/df9/f129 zero size 2024-09-12T22:49:58.662 INFO:tasks.workunit.client.0.smithi066.stdout:0/847: write d1/d8/d1f/f46 [3737624,67451] 0 2024-09-12T22:49:58.664 INFO:tasks.workunit.client.0.smithi066.stdout:8/878: rmdir d17/d40/d47/d4d/d87 39 2024-09-12T22:49:58.664 INFO:tasks.workunit.client.0.smithi066.stdout:5/906: write d5/d11/fca [983610,99759] 0 2024-09-12T22:49:58.664 INFO:tasks.workunit.client.0.smithi066.stdout:3/897: chown d0/d2/d1d/d87/d40/da2/l10a 3841066 1 2024-09-12T22:49:58.665 INFO:tasks.workunit.client.0.smithi066.stdout:8/879: read - d17/d49/d4b/db5/f126 zero size 2024-09-12T22:49:58.665 INFO:tasks.workunit.client.0.smithi066.stdout:5/907: read - d5/de/d50/d42/d9d/fc4 zero size 2024-09-12T22:49:58.666 INFO:tasks.workunit.client.0.smithi066.stdout:9/829: dwrite d9/fa1 [0,4194304] 0 2024-09-12T22:49:58.667 INFO:tasks.workunit.client.0.smithi066.stdout:0/848: truncate d1/d8/d1c/d13/d2f/dd8/f28 4892583 0 2024-09-12T22:49:58.667 INFO:tasks.workunit.client.0.smithi066.stdout:3/898: fsync d0/d2/d7/d13/ff2 0 2024-09-12T22:49:58.667 INFO:tasks.workunit.client.0.smithi066.stdout:0/849: creat d1/d8/d1c/d13/d2f/d8a/f128 x:0 0 0 2024-09-12T22:49:58.668 INFO:tasks.workunit.client.0.smithi066.stdout:9/830: unlink d9/dc/f38 0 2024-09-12T22:49:58.668 INFO:tasks.workunit.client.0.smithi066.stdout:8/880: write d17/d1b/f23 [2475177,130540] 0 2024-09-12T22:49:58.669 INFO:tasks.workunit.client.0.smithi066.stdout:0/850: link d1/d8/d1c/d13/f20 d1/d8/d1f/d47/f129 0 2024-09-12T22:49:58.669 INFO:tasks.workunit.client.0.smithi066.stdout:8/881: rename d17/d49/d4b/d57/f69 to d17/d49/f135 0 2024-09-12T22:49:58.670 INFO:tasks.workunit.client.0.smithi066.stdout:4/914: truncate d5/d8/d16/d1b/d72/fda 80097 0 2024-09-12T22:49:58.670 INFO:tasks.workunit.client.0.smithi066.stdout:0/851: write d1/fbe [981987,110388] 0 2024-09-12T22:49:58.670 INFO:tasks.workunit.client.0.smithi066.stdout:4/915: stat d5/d8/c6d 0 2024-09-12T22:49:58.670 INFO:tasks.workunit.client.0.smithi066.stdout:8/882: creat d17/d49/d4b/d130/f136 x:0 0 0 2024-09-12T22:49:58.671 INFO:tasks.workunit.client.0.smithi066.stdout:4/916: dread - d5/d87/ffe zero size 2024-09-12T22:49:58.671 INFO:tasks.workunit.client.0.smithi066.stdout:5/908: write d5/d11/d23/f108 [938371,118745] 0 2024-09-12T22:49:58.671 INFO:tasks.workunit.client.0.smithi066.stdout:3/899: truncate d0/d2/d1d/d87/d40/f95 3021838 0 2024-09-12T22:49:58.672 INFO:tasks.workunit.client.0.smithi066.stdout:0/852: getdents d1/d5b 0 2024-09-12T22:49:58.673 INFO:tasks.workunit.client.0.smithi066.stdout:5/909: write d5/d11/d5d/d64/d8f/fe0 [413824,34448] 0 2024-09-12T22:49:58.673 INFO:tasks.workunit.client.0.smithi066.stdout:0/853: chown d1/d8/d1f/c27 2343236 1 2024-09-12T22:49:58.674 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:58.674 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:58.675 INFO:tasks.workunit.client.0.smithi066.stdout:5/910: stat d5/d11/d21/d78/f7b 0 2024-09-12T22:49:58.676 INFO:tasks.workunit.client.0.smithi066.stdout:0/854: rmdir d1/d36/d11f 0 2024-09-12T22:49:58.677 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:58.676+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:58.678 INFO:tasks.workunit.client.0.smithi066.stdout:7/768: dread d0/d19/d60/f51 [0,4194304] 0 2024-09-12T22:49:58.679 INFO:tasks.workunit.client.0.smithi066.stdout:0/855: creat d1/d8/d1b/dac/f12a x:0 0 0 2024-09-12T22:49:58.681 INFO:tasks.workunit.client.0.smithi066.stdout:1/858: dread d0/d36/d8e/fa4 [0,4194304] 0 2024-09-12T22:49:58.681 INFO:tasks.workunit.client.0.smithi066.stdout:3/900: dwrite d0/d2/d1d/d87/d6b/fe0 [4194304,4194304] 0 2024-09-12T22:49:58.683 INFO:tasks.workunit.client.0.smithi066.stdout:4/917: dwrite d5/d3e/d8d/dc7/d126/d2d/fae [0,4194304] 0 2024-09-12T22:49:58.683 INFO:tasks.workunit.client.0.smithi066.stdout:0/856: write d1/d8/d1c/d56/f5e [2664426,26049] 0 2024-09-12T22:49:58.684 INFO:tasks.workunit.client.0.smithi066.stdout:6/929: dread d6/d78/f3f [0,4194304] 0 2024-09-12T22:49:58.684 INFO:tasks.workunit.client.0.smithi066.stdout:3/901: readlink d0/d2/d1d/d87/d40/d44/d55/d91/dcb/ldf 0 2024-09-12T22:49:58.685 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:58.686 INFO:tasks.workunit.client.0.smithi066.stdout:7/769: mkdir d0/d19/d24/d33/d27/dba/dc9/de5/df8 0 2024-09-12T22:49:58.686 INFO:tasks.workunit.client.0.smithi066.stdout:0/857: unlink d1/d8/f10b 0 2024-09-12T22:49:58.687 INFO:tasks.workunit.client.0.smithi066.stdout:0/858: symlink d1/dbf/l12b 0 2024-09-12T22:49:58.689 INFO:tasks.workunit.client.0.smithi066.stdout:4/918: rename d5/d8/d16/d93/d9c/d98/d8b/d86/lf7 to d5/d8/d16/d93/d9c/d98/d8b/db6/l133 0 2024-09-12T22:49:58.689 INFO:tasks.workunit.client.0.smithi066.stdout:3/902: creat d0/d2/d7/dc4/d127/f138 x:0 0 0 2024-09-12T22:49:58.689 INFO:tasks.workunit.client.0.smithi066.stdout:6/930: link d6/d23/d41/db6/dd3/d13a/d2c/d69/f139 d6/d23/d41/db6/dd3/d13a/d4e/dc4/d32/dce/f13c 0 2024-09-12T22:49:58.690 INFO:tasks.workunit.client.0.smithi066.stdout:0/859: write d1/f67 [3091856,96941] 0 2024-09-12T22:49:58.690 INFO:tasks.workunit.client.0.smithi066.stdout:7/770: creat d0/d19/d24/d33/ff9 x:0 0 0 2024-09-12T22:49:58.690 INFO:tasks.workunit.client.0.smithi066.stdout:4/919: rmdir d5/d8/d16 39 2024-09-12T22:49:58.690 INFO:tasks.workunit.client.0.smithi066.stdout:3/903: write d0/d2/f6e [199157,89424] 0 2024-09-12T22:49:58.691 INFO:tasks.workunit.client.0.smithi066.stdout:8/883: dread d17/d40/d47/d4d/f50 [0,4194304] 0 2024-09-12T22:49:58.691 INFO:tasks.workunit.client.0.smithi066.stdout:6/931: write d6/d23/f27 [3534026,29978] 0 2024-09-12T22:49:58.691 INFO:tasks.workunit.client.0.smithi066.stdout:7/771: fdatasync d0/d19/d60/d85/d8b/fcc 0 2024-09-12T22:49:58.692 INFO:tasks.workunit.client.0.smithi066.stdout:2/851: dread d1/d11/d26/f6f [0,4194304] 0 2024-09-12T22:49:58.692 INFO:teuthology.orchestra.run.smithi066.stderr:noscrub is set 2024-09-12T22:49:58.694 INFO:tasks.workunit.client.0.smithi066.stdout:4/920: write d5/d8/d16/d93/de0/f116 [209966,55410] 0 2024-09-12T22:49:58.694 INFO:tasks.workunit.client.0.smithi066.stdout:3/904: creat d0/d2/d7/dc4/dcf/f139 x:0 0 0 2024-09-12T22:49:58.694 INFO:tasks.workunit.client.0.smithi066.stdout:9/831: dread d9/dc/dd/f54 [0,4194304] 0 2024-09-12T22:49:58.696 INFO:tasks.workunit.client.0.smithi066.stdout:6/932: rename d6/d23/d41/db6/dd3/df9/d127/f131 to d6/d7/dc/f13d 0 2024-09-12T22:49:58.696 INFO:tasks.workunit.client.0.smithi066.stdout:4/921: stat d5/d3e/d8d/dc7/d126/d2d/d64/d9a/f123 0 2024-09-12T22:49:58.696 INFO:tasks.workunit.client.0.smithi066.stdout:3/905: getdents d0/d2/d10b 0 2024-09-12T22:49:58.696 INFO:tasks.workunit.client.0.smithi066.stdout:9/832: truncate d9/d31/d58/fc1 4360818 0 2024-09-12T22:49:58.697 INFO:tasks.workunit.client.0.smithi066.stdout:4/922: chown d5/d8/d16/d93/de0/f116 66111 1 2024-09-12T22:49:58.697 INFO:tasks.workunit.client.0.smithi066.stdout:3/906: fdatasync d0/d2/d1d/d87/d40/dbd/d74/f88 0 2024-09-12T22:49:58.697 INFO:tasks.workunit.client.0.smithi066.stdout:0/860: read d1/d8/d1c/d13/d2f/d8a/f90 [2973560,102714] 0 2024-09-12T22:49:58.698 INFO:tasks.workunit.client.0.smithi066.stdout:9/833: symlink d9/d31/d77/l10d 0 2024-09-12T22:49:58.699 INFO:tasks.workunit.client.0.smithi066.stdout:8/884: dwrite d17/d1b/de7/d116/f110 [0,4194304] 0 2024-09-12T22:49:58.699 INFO:tasks.workunit.client.0.smithi066.stdout:6/933: write d6/d23/d41/db6/dd3/d13a/d4e/dc4/f65 [887932,67505] 0 2024-09-12T22:49:58.699 INFO:tasks.workunit.client.0.smithi066.stdout:4/923: write d5/d8/f78 [1163841,26784] 0 2024-09-12T22:49:58.700 INFO:tasks.workunit.client.0.smithi066.stdout:0/861: chown d1/d8/d1b/d88/la5 3482 1 2024-09-12T22:49:58.700 INFO:tasks.workunit.client.0.smithi066.stdout:8/885: stat d17/d49/d4b/d57/f80 0 2024-09-12T22:49:58.701 INFO:tasks.workunit.client.0.smithi066.stdout:9/834: mkdir d9/d31/d58/db1/d10e 0 2024-09-12T22:49:58.702 INFO:tasks.workunit.client.0.smithi066.stdout:8/886: dread - d17/d49/f121 zero size 2024-09-12T22:49:58.702 INFO:tasks.workunit.client.0.smithi066.stdout:6/934: mknod d6/d23/d41/db6/dd3/d13a/d4e/dc4/d32/dfd/c13e 0 2024-09-12T22:49:58.704 INFO:tasks.workunit.client.0.smithi066.stdout:9/835: rename d9/d31/f72 to d9/d31/d34/f10f 0 2024-09-12T22:49:58.704 INFO:tasks.workunit.client.0.smithi066.stdout:6/935: chown d6/d7/dc6/d129/l121 241 1 2024-09-12T22:49:58.706 INFO:tasks.workunit.client.0.smithi066.stdout:4/924: dwrite d5/d8/d16/d1b/d1e/d1f/fa9 [0,4194304] 0 2024-09-12T22:49:58.708 INFO:tasks.workunit.client.0.smithi066.stdout:4/925: chown d5/d8/d16/d1b/l7b 486463 1 2024-09-12T22:49:58.709 INFO:tasks.workunit.client.0.smithi066.stdout:0/862: write d1/d5b/f101 [296318,19481] 0 2024-09-12T22:49:58.709 INFO:tasks.workunit.client.0.smithi066.stdout:1/859: sync 2024-09-12T22:49:58.710 INFO:tasks.workunit.client.0.smithi066.stdout:0/863: mknod d1/d8/df5/de2/c12c 0 2024-09-12T22:49:58.710 INFO:tasks.workunit.client.0.smithi066.stdout:6/936: dread d6/d23/d41/db6/dd3/d13a/d4e/dc4/f65 [0,4194304] 0 2024-09-12T22:49:58.711 INFO:tasks.workunit.client.0.smithi066.stdout:9/836: truncate d9/dc/dd/d9f/fbb 1325139 0 2024-09-12T22:49:58.711 INFO:tasks.workunit.client.0.smithi066.stdout:6/937: symlink d6/d7/l13f 0 2024-09-12T22:49:58.711 INFO:tasks.workunit.client.0.smithi066.stdout:1/860: dread d0/d4e/d79/d86/ff0 [4194304,4194304] 0 2024-09-12T22:49:58.712 INFO:tasks.workunit.client.0.smithi066.stdout:0/864: fdatasync d1/d36/d65/dc2/dd7/f10c 0 2024-09-12T22:49:58.712 INFO:tasks.workunit.client.0.smithi066.stdout:9/837: symlink d9/dc6/df6/l110 0 2024-09-12T22:49:58.712 INFO:tasks.workunit.client.0.smithi066.stdout:6/938: symlink d6/d35/d133/l140 0 2024-09-12T22:49:58.713 INFO:tasks.workunit.client.0.smithi066.stdout:0/865: write d1/d8/d1b/d88/fc9 [106341,90696] 0 2024-09-12T22:49:58.714 INFO:tasks.workunit.client.0.smithi066.stdout:9/838: symlink d9/df0/d8c/l111 0 2024-09-12T22:49:58.714 INFO:tasks.workunit.client.0.smithi066.stdout:6/939: write d6/d78/f3f [3889333,104031] 0 2024-09-12T22:49:58.715 INFO:tasks.workunit.client.0.smithi066.stdout:0/866: dread - d1/d8/d1f/d25/d9c/fb2 zero size 2024-09-12T22:49:58.716 INFO:tasks.workunit.client.0.smithi066.stdout:9/839: creat d9/dc/f112 x:0 0 0 2024-09-12T22:49:58.717 INFO:tasks.workunit.client.0.smithi066.stdout:0/867: stat d1/d8/d1c/fb3 0 2024-09-12T22:49:58.717 INFO:tasks.workunit.client.0.smithi066.stdout:5/911: dread d5/f12 [0,4194304] 0 2024-09-12T22:49:58.718 INFO:tasks.workunit.client.0.smithi066.stdout:9/840: creat d9/dc/d46/f113 x:0 0 0 2024-09-12T22:49:58.718 INFO:tasks.workunit.client.0.smithi066.stdout:1/861: dwrite d0/dc/f46 [0,4194304] 0 2024-09-12T22:49:58.719 INFO:tasks.workunit.client.0.smithi066.stdout:0/868: write d1/d8/d1b/dac/fe0 [2670742,99119] 0 2024-09-12T22:49:58.720 INFO:tasks.workunit.client.0.smithi066.stdout:5/912: unlink d5/d11/d7c/d98/c9a 0 2024-09-12T22:49:58.720 INFO:tasks.workunit.client.0.smithi066.stdout:1/862: symlink d0/dc/d1e/l110 0 2024-09-12T22:49:58.722 INFO:tasks.workunit.client.0.smithi066.stdout:9/841: rename d9/d31/d58/ldc to d9/d31/d58/dbc/d9d/dff/l114 0 2024-09-12T22:49:58.722 INFO:tasks.workunit.client.0.smithi066.stdout:5/913: symlink d5/de/d50/d42/l113 0 2024-09-12T22:49:58.722 INFO:tasks.workunit.client.0.smithi066.stdout:0/869: getdents d1/d8/d1b/d59 0 2024-09-12T22:49:58.724 INFO:tasks.workunit.client.0.smithi066.stdout:6/940: dwrite d6/d23/d41/db6/dd3/d13a/d4e/dc4/fc5 [0,4194304] 0 2024-09-12T22:49:58.728 INFO:tasks.workunit.client.0.smithi066.stdout:9/842: dwrite d9/d31/d77/d8f/fb3 [0,4194304] 0 2024-09-12T22:49:58.731 INFO:tasks.workunit.client.0.smithi066.stdout:3/907: dread d0/d2/d1d/d87/d6b/db2/f45 [0,4194304] 0 2024-09-12T22:49:58.731 INFO:tasks.workunit.client.0.smithi066.stdout:5/914: rename d5/de to d5/d14/d114 0 2024-09-12T22:49:58.731 INFO:tasks.workunit.client.0.smithi066.stdout:8/887: dread d17/d40/d74/d99/fa7 [0,4194304] 0 2024-09-12T22:49:58.732 INFO:tasks.workunit.client.0.smithi066.stdout:5/915: chown d5/d11/d21/f7f 11090551 1 2024-09-12T22:49:58.732 INFO:tasks.workunit.client.0.smithi066.stdout:2/852: dread d1/d44/df3/d3d/f4a [0,4194304] 0 2024-09-12T22:49:58.733 INFO:tasks.workunit.client.0.smithi066.stdout:3/908: write d0/d2/d1d/d87/d40/da2/ffd [333258,65697] 0 2024-09-12T22:49:58.733 INFO:tasks.workunit.client.0.smithi066.stdout:2/853: write d1/f6b [217125,14752] 0 2024-09-12T22:49:58.734 INFO:tasks.workunit.client.0.smithi066.stdout:3/909: stat d0/d2/d1d/d87/d6b/db2/f45 0 2024-09-12T22:49:58.735 INFO:tasks.workunit.client.0.smithi066.stdout:2/854: write d1/d11/d26/d4f/fa5 [1192314,108566] 0 2024-09-12T22:49:58.735 INFO:tasks.workunit.client.0.smithi066.stdout:1/863: dwrite d0/d89/dd7/f6c [0,4194304] 0 2024-09-12T22:49:58.736 INFO:tasks.workunit.client.0.smithi066.stdout:3/910: write d0/f54 [1963740,103724] 0 2024-09-12T22:49:58.736 INFO:tasks.workunit.client.0.smithi066.stdout:7/772: dread d0/d19/d24/d33/d27/d70/fde [0,4194304] 0 2024-09-12T22:49:58.736 INFO:tasks.workunit.client.0.smithi066.stdout:9/843: truncate d9/fa 555131 0 2024-09-12T22:49:58.737 INFO:tasks.workunit.client.0.smithi066.stdout:8/888: write f11 [2199500,41505] 0 2024-09-12T22:49:58.737 INFO:tasks.workunit.client.0.smithi066.stdout:7/773: dread - d0/d19/d26/dbe/fe4 zero size 2024-09-12T22:49:58.738 INFO:tasks.workunit.client.0.smithi066.stdout:9/844: chown d9/dc/d23/f51 9492 1 2024-09-12T22:49:58.738 INFO:tasks.workunit.client.0.smithi066.stdout:4/926: dread d5/d8/d10/f6a [0,4194304] 0 2024-09-12T22:49:58.741 INFO:tasks.workunit.client.0.smithi066.stdout:3/911: creat d0/d2/d1d/d87/d40/da2/d130/f13a x:0 0 0 2024-09-12T22:49:58.741 INFO:tasks.workunit.client.0.smithi066.stdout:7/774: creat d0/d19/d60/d85/de6/ffa x:0 0 0 2024-09-12T22:49:58.741 INFO:tasks.workunit.client.0.smithi066.stdout:5/916: write d5/d14/d114/d50/f35 [1080482,38499] 0 2024-09-12T22:49:58.741 INFO:tasks.workunit.client.0.smithi066.stdout:2/855: read d1/d11/d26/feb [1478433,59417] 0 2024-09-12T22:49:58.742 INFO:tasks.workunit.client.0.smithi066.stdout:9/845: creat d9/d31/f115 x:0 0 0 2024-09-12T22:49:58.742 INFO:tasks.workunit.client.0.smithi066.stdout:6/941: dread d6/d23/d41/db6/dd3/df9/fff [0,4194304] 0 2024-09-12T22:49:58.742 INFO:tasks.workunit.client.0.smithi066.stdout:3/912: rmdir d0/d2/d7/d13 39 2024-09-12T22:49:58.743 INFO:tasks.workunit.client.0.smithi066.stdout:5/917: stat d5/d14/d114/d57/fb1 0 2024-09-12T22:49:58.743 INFO:tasks.workunit.client.0.smithi066.stdout:9/846: fdatasync d9/dc/d8e/fa0 0 2024-09-12T22:49:58.743 INFO:tasks.workunit.client.0.smithi066.stdout:2/856: creat d1/db/dd9/f10f x:0 0 0 2024-09-12T22:49:58.743 INFO:tasks.workunit.client.0.smithi066.stdout:9/847: fdatasync d9/dc/d23/f51 0 2024-09-12T22:49:58.743 INFO:tasks.workunit.client.0.smithi066.stdout:7/775: getdents d0/d19/d26/d48/d59 0 2024-09-12T22:49:58.744 INFO:tasks.workunit.client.0.smithi066.stdout:3/913: creat d0/d2/d7/d13/f13b x:0 0 0 2024-09-12T22:49:58.745 INFO:tasks.workunit.client.0.smithi066.stdout:9/848: link d9/d31/d58/d7f/l9e d9/dc6/df6/l116 0 2024-09-12T22:49:58.745 INFO:tasks.workunit.client.0.smithi066.stdout:6/942: link d6/d23/d41/db6/dd3/d13a/d2c/d69/fe3 d6/d23/d41/db6/dd3/d13a/d4e/dc4/d99/d101/f141 0 2024-09-12T22:49:58.748 INFO:tasks.workunit.client.0.smithi066.stdout:4/927: truncate d5/d3e/d8d/dc7/f99 208959 0 2024-09-12T22:49:58.749 INFO:tasks.workunit.client.0.smithi066.stdout:2/857: truncate d1/f3 1905393 0 2024-09-12T22:49:58.753 INFO:tasks.workunit.client.0.smithi066.stdout:3/914: read d0/d2/d1d/d87/d40/dbd/f50 [3889215,66532] 0 2024-09-12T22:49:58.753 INFO:tasks.workunit.client.0.smithi066.stdout:9/849: dread d9/dc/d23/fdb [0,4194304] 0 2024-09-12T22:49:58.753 INFO:tasks.workunit.client.0.smithi066.stdout:1/864: dwrite d0/dea/df7/d9a/dd9/f103 [0,4194304] 0 2024-09-12T22:49:58.754 INFO:tasks.workunit.client.0.smithi066.stdout:8/889: dwrite d17/d2c/f32 [0,4194304] 0 2024-09-12T22:49:58.754 INFO:tasks.workunit.client.0.smithi066.stdout:2/858: creat d1/d11/d53/f110 x:0 0 0 2024-09-12T22:49:58.754 INFO:tasks.workunit.client.0.smithi066.stdout:5/918: dwrite d5/d11/d21/d4d/fc2 [0,4194304] 0 2024-09-12T22:49:58.755 INFO:tasks.workunit.client.0.smithi066.stdout:1/865: rename d0/dc/d1e/d95/lb7 to d0/dc/d1e/d95/l111 0 2024-09-12T22:49:58.755 INFO:tasks.workunit.client.0.smithi066.stdout:9/850: creat d9/df0/d8c/de2/d107/f117 x:0 0 0 2024-09-12T22:49:58.755 INFO:tasks.workunit.client.0.smithi066.stdout:3/915: getdents d0/db3 0 2024-09-12T22:49:58.755 INFO:tasks.workunit.client.0.smithi066.stdout:2/859: symlink d1/d11/d26/d4f/d5f/da9/l111 0 2024-09-12T22:49:58.757 INFO:tasks.workunit.client.0.smithi066.stdout:4/928: dread d5/d8/d16/d93/de0/de8/f92 [0,4194304] 0 2024-09-12T22:49:58.757 INFO:tasks.workunit.client.0.smithi066.stdout:3/916: fdatasync d0/d2/d7/d29/fcd 0 2024-09-12T22:49:58.758 INFO:tasks.workunit.client.0.smithi066.stdout:0/870: dread d1/d8/d1c/d13/d2f/dd8/f77 [0,4194304] 0 2024-09-12T22:49:58.758 INFO:tasks.workunit.client.0.smithi066.stdout:1/866: creat d0/dc/d1e/d47/d6f/f112 x:0 0 0 2024-09-12T22:49:58.758 INFO:tasks.workunit.client.0.smithi066.stdout:4/929: stat d5/d3e/d8d/dc7/d126/d2d/d64 0 2024-09-12T22:49:58.759 INFO:tasks.workunit.client.0.smithi066.stdout:0/871: write d1/d36/d65/fb6 [702233,39357] 0 2024-09-12T22:49:58.760 INFO:tasks.workunit.client.0.smithi066.stdout:3/917: unlink d0/d2/d1d/d87/d6b/db2/f72 0 2024-09-12T22:49:58.760 INFO:tasks.workunit.client.0.smithi066.stdout:8/890: read d17/d1b/f23 [108737,42786] 0 2024-09-12T22:49:58.760 INFO:tasks.workunit.client.0.smithi066.stdout:2/860: chown d1/d11/d26/d4f/d5f/d61/ca7 454 1 2024-09-12T22:49:58.761 INFO:tasks.workunit.client.0.smithi066.stdout:0/872: mkdir d1/dbf/d102/d12d 0 2024-09-12T22:49:58.761 INFO:tasks.workunit.client.0.smithi066.stdout:2/861: fdatasync d1/d11/d26/d4f/fd4 0 2024-09-12T22:49:58.761 INFO:tasks.workunit.client.0.smithi066.stdout:4/930: rename d5/d8/d16/d93/d9c/d98/ddc/lee to d5/d87/l134 0 2024-09-12T22:49:58.762 INFO:tasks.workunit.client.0.smithi066.stdout:3/918: unlink d0/d2/d1d/d87/d40/da2/la9 0 2024-09-12T22:49:58.762 INFO:tasks.workunit.client.0.smithi066.stdout:1/867: read d0/d89/dd7/f6d [594500,26279] 0 2024-09-12T22:49:58.762 INFO:tasks.workunit.client.0.smithi066.stdout:0/873: symlink d1/dbf/l12e 0 2024-09-12T22:49:58.763 INFO:tasks.workunit.client.0.smithi066.stdout:5/919: dwrite d5/d11/d21/d78/f99 [4194304,4194304] 0 2024-09-12T22:49:58.763 INFO:tasks.workunit.client.0.smithi066.stdout:3/919: mknod d0/d2/d1d/d87/d6b/c13c 0 2024-09-12T22:49:58.763 INFO:tasks.workunit.client.0.smithi066.stdout:4/931: stat d5/d3e/d8d/dc7/d126/f27 0 2024-09-12T22:49:58.763 INFO:tasks.workunit.client.0.smithi066.stdout:8/891: getdents d17/d40/d74/da3/dac 0 2024-09-12T22:49:58.765 INFO:tasks.workunit.client.0.smithi066.stdout:1/868: creat d0/dc/deb/f113 x:0 0 0 2024-09-12T22:49:58.765 INFO:tasks.workunit.client.0.smithi066.stdout:8/892: symlink d17/d49/d4b/db5/l137 0 2024-09-12T22:49:58.766 INFO:tasks.workunit.client.0.smithi066.stdout:5/920: creat d5/f115 x:0 0 0 2024-09-12T22:49:58.768 INFO:tasks.workunit.client.0.smithi066.stdout:9/851: dwrite d9/d31/f6f [0,4194304] 0 2024-09-12T22:49:58.768 INFO:tasks.workunit.client.0.smithi066.stdout:2/862: getdents d1/d11/d26/d4f/d5f/d61/d9c 0 2024-09-12T22:49:58.768 INFO:tasks.workunit.client.0.smithi066.stdout:0/874: getdents d1/d8/d1b 0 2024-09-12T22:49:58.768 INFO:tasks.workunit.client.0.smithi066.stdout:4/932: getdents d5/d3e/d8d/dc7/d126/d2d 0 2024-09-12T22:49:58.768 INFO:tasks.workunit.client.0.smithi066.stdout:8/893: write d17/d49/d4b/d57/fa6 [1056221,111209] 0 2024-09-12T22:49:58.769 INFO:tasks.workunit.client.0.smithi066.stdout:5/921: write d5/d11/d7c/fc0 [760073,91109] 0 2024-09-12T22:49:58.769 INFO:tasks.workunit.client.0.smithi066.stdout:3/920: write d0/d2/d1d/d87/d40/f48 [1302411,99558] 0 2024-09-12T22:49:58.769 INFO:tasks.workunit.client.0.smithi066.stdout:0/875: creat d1/d8/d1c/d13/f12f x:0 0 0 2024-09-12T22:49:58.770 INFO:tasks.workunit.client.0.smithi066.stdout:2/863: mkdir d1/d44/df3/d12/de2/d109/d112 0 2024-09-12T22:49:58.770 INFO:tasks.workunit.client.0.smithi066.stdout:1/869: dread d0/d36/d8e/fa4 [0,4194304] 0 2024-09-12T22:49:58.770 INFO:tasks.workunit.client.0.smithi066.stdout:4/933: write d5/d8/d16/ffa [3736831,77099] 0 2024-09-12T22:49:58.770 INFO:tasks.workunit.client.0.smithi066.stdout:9/852: rename d9/dc/dd/f47 to d9/d31/f118 0 2024-09-12T22:49:58.771 INFO:tasks.workunit.client.0.smithi066.stdout:2/864: stat d1/d44/d51/lfe 0 2024-09-12T22:49:58.771 INFO:tasks.workunit.client.0.smithi066.stdout:3/921: symlink d0/d2/l13d 0 2024-09-12T22:49:58.772 INFO:tasks.workunit.client.0.smithi066.stdout:8/894: getdents d17/d1b 0 2024-09-12T22:49:58.772 INFO:tasks.workunit.client.0.smithi066.stdout:4/934: dread - d5/d3e/d8d/dc7/d126/d2d/d64/d9a/dfd/f112 zero size 2024-09-12T22:49:58.773 INFO:tasks.workunit.client.0.smithi066.stdout:2/865: symlink d1/d44/df3/d68/l113 0 2024-09-12T22:49:58.773 INFO:tasks.workunit.client.0.smithi066.stdout:3/922: creat d0/d2/d1d/f13e x:0 0 0 2024-09-12T22:49:58.775 INFO:tasks.workunit.client.0.smithi066.stdout:3/923: read - d0/d2/d1d/d87/d6b/db2/ff3 zero size 2024-09-12T22:49:58.775 INFO:tasks.workunit.client.0.smithi066.stdout:8/895: write d17/d40/d74/da3/dac/fd9 [451927,117978] 0 2024-09-12T22:49:58.775 INFO:tasks.workunit.client.0.smithi066.stdout:4/935: creat d5/d8/d16/d1b/d1e/d1f/d8c/f135 x:0 0 0 2024-09-12T22:49:58.776 INFO:tasks.workunit.client.0.smithi066.stdout:5/922: dwrite d5/d11/d5d/f83 [0,4194304] 0 2024-09-12T22:49:58.777 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:58.776+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:58.777 INFO:tasks.workunit.client.0.smithi066.stdout:1/870: dwrite d0/dc/d44/f54 [4194304,4194304] 0 2024-09-12T22:49:58.779 INFO:tasks.workunit.client.0.smithi066.stdout:8/896: mkdir d17/d49/d4b/d130/d138 0 2024-09-12T22:49:58.779 INFO:tasks.workunit.client.0.smithi066.stdout:3/924: creat d0/d2/d7/dc4/dcf/d9e/d137/f13f x:0 0 0 2024-09-12T22:49:58.780 INFO:tasks.workunit.client.0.smithi066.stdout:4/936: getdents d5/d3e/d8d/dc7/d126/d2d/d64/d9a/dfd 0 2024-09-12T22:49:58.782 INFO:tasks.workunit.client.0.smithi066.stdout:2/866: dwrite d1/d44/df3/d3d/fba [0,4194304] 0 2024-09-12T22:49:58.783 INFO:tasks.workunit.client.0.smithi066.stdout:2/867: chown d1/d44/df3/d12/de2/f106 384597286 1 2024-09-12T22:49:58.785 INFO:tasks.workunit.client.0.smithi066.stdout:4/937: unlink d5/d8/d16/d1b/d1e/f11e 0 2024-09-12T22:49:58.785 INFO:tasks.workunit.client.0.smithi066.stdout:7/776: sync 2024-09-12T22:49:58.785 INFO:tasks.workunit.client.0.smithi066.stdout:0/876: sync 2024-09-12T22:49:58.786 INFO:tasks.workunit.client.0.smithi066.stdout:2/868: creat d1/d11/d26/d4f/d5f/d61/d72/dad/df5/f114 x:0 0 0 2024-09-12T22:49:58.786 INFO:tasks.workunit.client.0.smithi066.stdout:4/938: rmdir d5/d8/d16/d1b/d1e/d5a 39 2024-09-12T22:49:58.786 INFO:tasks.workunit.client.0.smithi066.stdout:1/871: dwrite d0/dc/d1d/f66 [0,4194304] 0 2024-09-12T22:49:58.788 INFO:tasks.workunit.client.0.smithi066.stdout:0/877: truncate d1/d36/d65/fe7 149922 0 2024-09-12T22:49:58.789 INFO:tasks.workunit.client.0.smithi066.stdout:8/897: dwrite d17/d1b/fd5 [0,4194304] 0 2024-09-12T22:49:58.789 INFO:tasks.workunit.client.0.smithi066.stdout:2/869: fdatasync d1/db/d42/d43/fdf 0 2024-09-12T22:49:58.789 INFO:tasks.workunit.client.0.smithi066.stdout:1/872: fdatasync d0/dc/d8f/fb8 0 2024-09-12T22:49:58.789 INFO:tasks.workunit.client.0.smithi066.stdout:4/939: write d5/d3e/f34 [925403,112076] 0 2024-09-12T22:49:58.792 INFO:tasks.workunit.client.0.smithi066.stdout:4/940: mkdir d5/d3e/d8d/dc7/d126/d2d/d136 0 2024-09-12T22:49:58.792 INFO:tasks.workunit.client.0.smithi066.stdout:2/870: rename d1/d11/d26/d4f/d5f/d61/d72/dad/d76/db7/cdd to d1/db/d42/c115 0 2024-09-12T22:49:58.793 INFO:tasks.workunit.client.0.smithi066.stdout:2/871: fdatasync d1/db/dd9/f103 0 2024-09-12T22:49:58.794 INFO:tasks.workunit.client.0.smithi066.stdout:7/777: dwrite d0/d19/d24/f93 [0,4194304] 0 2024-09-12T22:49:58.795 INFO:tasks.workunit.client.0.smithi066.stdout:4/941: truncate d5/d8/d16/d93/de0/d119/f129 844890 0 2024-09-12T22:49:58.795 INFO:tasks.workunit.client.0.smithi066.stdout:1/873: dwrite d0/d4e/d79/d86/f88 [0,4194304] 0 2024-09-12T22:49:58.798 INFO:tasks.workunit.client.0.smithi066.stdout:7/778: rename d0/d19/d60/d85/d8b/f98 to d0/d19/d24/d33/d27/dba/ffb 0 2024-09-12T22:49:58.798 INFO:tasks.workunit.client.0.smithi066.stdout:7/779: truncate d0/d19/d24/f6b 4982348 0 2024-09-12T22:49:58.799 INFO:tasks.workunit.client.0.smithi066.stdout:7/780: unlink d0/d6/d83/fe7 0 2024-09-12T22:49:58.803 INFO:tasks.workunit.client.0.smithi066.stdout:4/942: write d5/d3e/d8d/dc7/d126/d2d/f127 [518253,109669] 0 2024-09-12T22:49:58.804 INFO:tasks.workunit.client.0.smithi066.stdout:4/943: mkdir d5/d3e/d65/dac/d137 0 2024-09-12T22:49:58.804 INFO:tasks.workunit.client.0.smithi066.stdout:4/944: chown d5/d3e/d8d/dc7/d126/d39/dc0 1172 1 2024-09-12T22:49:58.809 INFO:tasks.workunit.client.0.smithi066.stdout:3/925: dread d0/d2/d1d/d87/d49/f115 [0,4194304] 0 2024-09-12T22:49:58.814 INFO:tasks.workunit.client.0.smithi066.stdout:3/926: dwrite d0/d2/d1d/d87/f8d [0,4194304] 0 2024-09-12T22:49:58.815 INFO:tasks.workunit.client.0.smithi066.stdout:3/927: write d0/d2/d7/d13/d31/fbc [2548346,56914] 0 2024-09-12T22:49:58.819 INFO:tasks.workunit.client.0.smithi066.stdout:6/943: sync 2024-09-12T22:49:58.819 INFO:tasks.workunit.client.0.smithi066.stdout:3/928: truncate d0/d2/d7/f66 242215 0 2024-09-12T22:49:58.819 INFO:tasks.workunit.client.0.smithi066.stdout:4/945: sync 2024-09-12T22:49:58.819 INFO:tasks.workunit.client.0.smithi066.stdout:7/781: sync 2024-09-12T22:49:58.820 INFO:tasks.workunit.client.0.smithi066.stdout:7/782: readlink d0/d19/d26/d5a/l99 0 2024-09-12T22:49:58.820 INFO:tasks.workunit.client.0.smithi066.stdout:9/853: dread d9/d31/d58/d7f/fcf [0,4194304] 0 2024-09-12T22:49:58.820 INFO:tasks.workunit.client.0.smithi066.stdout:3/929: symlink d0/d2/d7/d29/daf/l140 0 2024-09-12T22:49:58.820 INFO:tasks.workunit.client.0.smithi066.stdout:6/944: dread - d6/d23/d41/db6/dd3/d13a/d2c/f40 zero size 2024-09-12T22:49:58.821 INFO:tasks.workunit.client.0.smithi066.stdout:4/946: link d5/d87/f10a d5/d3e/d8d/dc7/f138 0 2024-09-12T22:49:58.821 INFO:tasks.workunit.client.0.smithi066.stdout:7/783: symlink d0/d19/d26/d48/dc3/lfc 0 2024-09-12T22:49:58.821 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:58.822 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:58.822 INFO:tasks.workunit.client.0.smithi066.stdout:3/930: mkdir d0/d2/d7/dc4/dcf/d9e/d137/d141 0 2024-09-12T22:49:58.823 INFO:tasks.workunit.client.0.smithi066.stdout:9/854: creat d9/d31/d58/d7f/dc8/f119 x:0 0 0 2024-09-12T22:49:58.824 INFO:tasks.workunit.client.0.smithi066.stdout:1/874: dread d0/dc/f22 [0,4194304] 0 2024-09-12T22:49:58.826 INFO:tasks.workunit.client.0.smithi066.stdout:9/855: write d9/dc/dd/f5f [3366620,27389] 0 2024-09-12T22:49:58.826 INFO:tasks.workunit.client.0.smithi066.stdout:3/931: symlink d0/d2/d7/dc4/d116/l142 0 2024-09-12T22:49:58.827 INFO:tasks.workunit.client.0.smithi066.stdout:1/875: write d0/dc/d99/fd6 [146749,62619] 0 2024-09-12T22:49:58.828 INFO:tasks.workunit.client.0.smithi066.stdout:6/945: dwrite d6/d7/f10a [0,4194304] 0 2024-09-12T22:49:58.830 INFO:tasks.workunit.client.0.smithi066.stdout:1/876: readlink d0/d4e/d79/d86/lf1 0 2024-09-12T22:49:58.830 INFO:tasks.workunit.client.0.smithi066.stdout:0/878: dread d1/d8/d1f/d25/f7d [0,4194304] 0 2024-09-12T22:49:58.830 INFO:tasks.workunit.client.0.smithi066.stdout:8/898: dread d17/d49/d4b/d57/d5e/fc3 [0,4194304] 0 2024-09-12T22:49:58.830 INFO:tasks.workunit.client.0.smithi066.stdout:4/947: dwrite d5/d8/d16/d93/de0/f116 [0,4194304] 0 2024-09-12T22:49:58.831 INFO:tasks.workunit.client.0.smithi066.stdout:3/932: fdatasync d0/d2/d7/d13/f13b 0 2024-09-12T22:49:58.832 INFO:tasks.workunit.client.0.smithi066.stdout:2/872: dread d1/d44/df3/d12/d1e/f79 [0,4194304] 0 2024-09-12T22:49:58.834 INFO:tasks.workunit.client.0.smithi066.stdout:7/784: dwrite d0/d86/f95 [0,4194304] 0 2024-09-12T22:49:58.834 INFO:tasks.workunit.client.0.smithi066.stdout:6/946: write d6/d78/d4a/f118 [453207,19602] 0 2024-09-12T22:49:58.834 INFO:tasks.workunit.client.0.smithi066.stdout:8/899: write d17/d40/da8/f113 [765697,96035] 0 2024-09-12T22:49:58.834 INFO:tasks.workunit.client.0.smithi066.stdout:0/879: truncate d1/fbe 1935145 0 2024-09-12T22:49:58.835 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:58.836 INFO:tasks.workunit.client.0.smithi066.stdout:5/923: dread d5/d11/d21/fb5 [0,4194304] 0 2024-09-12T22:49:58.836 INFO:tasks.workunit.client.0.smithi066.stdout:8/900: dread - d17/d40/d47/d4d/f8a zero size 2024-09-12T22:49:58.837 INFO:tasks.workunit.client.0.smithi066.stdout:9/856: dread d9/dc/d23/fac [0,4194304] 0 2024-09-12T22:49:58.837 INFO:tasks.workunit.client.0.smithi066.stdout:2/873: write d1/d11/d26/d4f/d5f/d61/d7e/f48 [2640956,128968] 0 2024-09-12T22:49:58.837 INFO:tasks.workunit.client.0.smithi066.stdout:5/924: write d5/f55 [4424693,115065] 0 2024-09-12T22:49:58.837 INFO:tasks.workunit.client.0.smithi066.stdout:5/925: sync 2024-09-12T22:49:58.837 INFO:tasks.workunit.client.0.smithi066.stdout:1/877: link d0/dc/cf4 d0/d36/d57/c114 0 2024-09-12T22:49:58.838 INFO:tasks.workunit.client.0.smithi066.stdout:3/933: link d0/d2/d7/d13/d31/l6f d0/d2/d7/d13/d31/l143 0 2024-09-12T22:49:58.838 INFO:tasks.workunit.client.0.smithi066.stdout:8/901: write d17/d2c/f32 [2057458,81767] 0 2024-09-12T22:49:58.838 INFO:tasks.workunit.client.0.smithi066.stdout:1/878: stat d0/fcf 0 2024-09-12T22:49:58.839 INFO:tasks.workunit.client.0.smithi066.stdout:9/857: mkdir d9/d31/d10a/d11a 0 2024-09-12T22:49:58.839 INFO:tasks.workunit.client.0.smithi066.stdout:2/874: symlink d1/d11/d26/d4f/l116 0 2024-09-12T22:49:58.840 INFO:tasks.workunit.client.0.smithi066.stdout:1/879: chown d0/dc/d1d/l8d 29266 1 2024-09-12T22:49:58.841 INFO:tasks.workunit.client.0.smithi066.stdout:3/934: creat d0/d2/d1d/d87/d40/d44/f144 x:0 0 0 2024-09-12T22:49:58.842 INFO:tasks.workunit.client.0.smithi066.stdout:1/880: stat d0/dea/df7/ldf 0 2024-09-12T22:49:58.843 INFO:tasks.workunit.client.0.smithi066.stdout:2/875: creat d1/d44/df3/f117 x:0 0 0 2024-09-12T22:49:58.843 INFO:tasks.workunit.client.0.smithi066.stdout:7/785: dwrite d0/d19/d24/d33/ff9 [0,4194304] 0 2024-09-12T22:49:58.843 INFO:tasks.workunit.client.0.smithi066.stdout:0/880: dwrite d1/d8/d1c/d13/f23 [0,4194304] 0 2024-09-12T22:49:58.844 INFO:tasks.workunit.client.0.smithi066.stdout:7/786: stat d0/d6/l4a 0 2024-09-12T22:49:58.844 INFO:tasks.workunit.client.0.smithi066.stdout:7/787: sync 2024-09-12T22:49:58.847 INFO:tasks.workunit.client.0.smithi066.stdout:3/935: rename d0/d2/d7/d29/c12b to d0/d2/d1d/d87/d6b/dfa/c145 0 2024-09-12T22:49:58.847 INFO:tasks.workunit.client.0.smithi066.stdout:0/881: symlink d1/dbf/d102/d11d/l130 0 2024-09-12T22:49:58.847 INFO:tasks.workunit.client.0.smithi066.stdout:9/858: dread d9/fa1 [0,4194304] 0 2024-09-12T22:49:58.848 INFO:tasks.workunit.client.0.smithi066.stdout:9/859: chown d9/d31/d58/dbc/da8/cfa 27523 1 2024-09-12T22:49:58.848 INFO:tasks.workunit.client.0.smithi066.stdout:0/882: getdents d1/d8/d1f/d30 0 2024-09-12T22:49:58.850 INFO:tasks.workunit.client.0.smithi066.stdout:3/936: write d0/d2/d6/fee [856844,37562] 0 2024-09-12T22:49:58.850 INFO:tasks.workunit.client.0.smithi066.stdout:9/860: dread - d9/d31/d58/da4/ffd zero size 2024-09-12T22:49:58.850 INFO:tasks.workunit.client.0.smithi066.stdout:7/788: dwrite d0/d6/d83/fe8 [0,4194304] 0 2024-09-12T22:49:58.851 INFO:tasks.workunit.client.0.smithi066.stdout:6/947: truncate d6/f4b 3417227 0 2024-09-12T22:49:58.853 INFO:tasks.workunit.client.0.smithi066.stdout:0/883: getdents d1/d8/d1b 0 2024-09-12T22:49:58.854 INFO:tasks.workunit.client.0.smithi066.stdout:3/937: link d0/d2/d7/d13/d31/l64 d0/d2/d10b/l146 0 2024-09-12T22:49:58.855 INFO:tasks.workunit.client.0.smithi066.stdout:4/948: dwrite d5/d3e/d8d/dc7/f138 [0,4194304] 0 2024-09-12T22:49:58.856 INFO:tasks.workunit.client.0.smithi066.stdout:9/861: dread d9/dc/dd/f5f [0,4194304] 0 2024-09-12T22:49:58.857 INFO:tasks.workunit.client.0.smithi066.stdout:6/948: getdents d6/d23/d41/db6/dd3/d13a/d88 0 2024-09-12T22:49:58.857 INFO:tasks.workunit.client.0.smithi066.stdout:3/938: write d0/d2/d7/d13/d31/fb8 [5887995,58711] 0 2024-09-12T22:49:58.857 INFO:tasks.workunit.client.0.smithi066.stdout:4/949: write d5/d8/d16/f41 [4971249,77172] 0 2024-09-12T22:49:58.858 INFO:tasks.workunit.client.0.smithi066.stdout:9/862: rename d9/d31/d58/f9b to d9/d31/d58/d7f/dc8/f11b 0 2024-09-12T22:49:58.859 INFO:tasks.workunit.client.0.smithi066.stdout:6/949: creat d6/d23/d62/f142 x:0 0 0 2024-09-12T22:49:58.859 INFO:tasks.workunit.client.0.smithi066.stdout:3/939: dread d0/d2/d1d/d87/d40/d44/fe8 [0,4194304] 0 2024-09-12T22:49:58.860 INFO:tasks.workunit.client.0.smithi066.stdout:6/950: rename d6/d23/d41/db6/dd3/d13a/d4e/dc4/d99/d101 to d6/d51/d143 0 2024-09-12T22:49:58.865 INFO:tasks.workunit.client.0.smithi066.stdout:6/951: write d6/d51/d143/f141 [5208210,21085] 0 2024-09-12T22:49:58.865 INFO:tasks.workunit.client.0.smithi066.stdout:7/789: dread d0/d19/d60/d85/d8b/fa8 [0,4194304] 0 2024-09-12T22:49:58.865 INFO:tasks.workunit.client.0.smithi066.stdout:9/863: dwrite d9/dc/d46/d8a/f97 [0,4194304] 0 2024-09-12T22:49:58.867 INFO:tasks.workunit.client.0.smithi066.stdout:3/940: dwrite d0/d2/d1d/d87/d49/f115 [0,4194304] 0 2024-09-12T22:49:58.867 INFO:tasks.workunit.client.0.smithi066.stdout:3/941: sync 2024-09-12T22:49:58.868 INFO:tasks.workunit.client.0.smithi066.stdout:9/864: symlink d9/df0/d8c/de2/l11c 0 2024-09-12T22:49:58.868 INFO:tasks.workunit.client.0.smithi066.stdout:7/790: creat d0/d19/d26/d5a/dc8/ffd x:0 0 0 2024-09-12T22:49:58.869 INFO:tasks.workunit.client.0.smithi066.stdout:6/952: creat d6/d23/d41/db6/dd3/d13a/d4e/d135/f144 x:0 0 0 2024-09-12T22:49:58.869 INFO:tasks.workunit.client.0.smithi066.stdout:7/791: write d0/d19/d60/fd4 [2331000,110134] 0 2024-09-12T22:49:58.869 INFO:tasks.workunit.client.0.smithi066.stdout:3/942: mknod d0/d2/d7/dc4/d127/c147 0 2024-09-12T22:49:58.873 INFO:tasks.workunit.client.0.smithi066.stdout:8/902: dread d17/d40/d47/d4d/f93 [0,4194304] 0 2024-09-12T22:49:58.873 INFO:tasks.workunit.client.0.smithi066.stdout:3/943: truncate d0/d2/d1d/d87/d40/da2/d130/f13a 484214 0 2024-09-12T22:49:58.873 INFO:tasks.workunit.client.0.smithi066.stdout:7/792: mknod d0/d19/d26/d5a/cfe 0 2024-09-12T22:49:58.873 INFO:tasks.workunit.client.0.smithi066.stdout:7/793: chown d0/d19/d24/cb9 1842714592 1 2024-09-12T22:49:58.874 INFO:tasks.workunit.client.0.smithi066.stdout:8/903: symlink d17/d49/d4b/d57/d5e/d62/d109/l139 0 2024-09-12T22:49:58.874 INFO:tasks.workunit.client.0.smithi066.stdout:5/926: dread d5/d11/d23/d6f/daa/dbb/dc6/de1/fd1 [0,4194304] 0 2024-09-12T22:49:58.874 INFO:tasks.workunit.client.0.smithi066.stdout:3/944: dread d0/d2/d1d/d87/d40/d44/fe8 [0,4194304] 0 2024-09-12T22:49:58.875 INFO:tasks.workunit.client.0.smithi066.stdout:6/953: read d6/d35/fb0 [507179,2398] 0 2024-09-12T22:49:58.875 INFO:tasks.workunit.client.0.smithi066.stdout:9/865: read d9/d31/d58/dbc/da8/fda [184673,125459] 0 2024-09-12T22:49:58.875 INFO:tasks.workunit.client.0.smithi066.stdout:7/794: read d0/d6/d83/fa4 [520102,113927] 0 2024-09-12T22:49:58.876 INFO:tasks.workunit.client.0.smithi066.stdout:3/945: chown d0/db3/db7/lba 8654 1 2024-09-12T22:49:58.876 INFO:tasks.workunit.client.0.smithi066.stdout:5/927: mkdir d5/d11/d5d/d64/d8f/d116 0 2024-09-12T22:49:58.876 INFO:tasks.workunit.client.0.smithi066.stdout:7/795: dread - d0/d19/d60/d85/d8b/fcc zero size 2024-09-12T22:49:58.877 INFO:tasks.workunit.client.0.smithi066.stdout:9/866: creat d9/d31/db0/f11d x:0 0 0 2024-09-12T22:49:58.877 INFO:tasks.workunit.client.0.smithi066.stdout:7/796: sync 2024-09-12T22:49:58.877 INFO:tasks.workunit.client.0.smithi066.stdout:3/946: creat d0/d2/d10b/d132/f148 x:0 0 0 2024-09-12T22:49:58.877 INFO:tasks.workunit.client.0.smithi066.stdout:6/954: creat d6/d23/d41/db6/dd3/d13a/d2c/f145 x:0 0 0 2024-09-12T22:49:58.879 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:58.877+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:58.881 INFO:tasks.workunit.client.0.smithi066.stdout:5/928: creat d5/d11/d23/d6f/daa/dbb/dc6/f117 x:0 0 0 2024-09-12T22:49:58.881 INFO:tasks.workunit.client.0.smithi066.stdout:8/904: write d17/f27 [238343,99921] 0 2024-09-12T22:49:58.881 INFO:tasks.workunit.client.0.smithi066.stdout:6/955: mknod d6/d7/d66/c146 0 2024-09-12T22:49:58.881 INFO:tasks.workunit.client.0.smithi066.stdout:3/947: write d0/d2/d7/d29/fcd [2777044,4796] 0 2024-09-12T22:49:58.881 INFO:tasks.workunit.client.0.smithi066.stdout:5/929: truncate d5/f3f 1477394 0 2024-09-12T22:49:58.881 INFO:tasks.workunit.client.0.smithi066.stdout:7/797: truncate d0/d19/d26/d48/d59/f7b 5121521 0 2024-09-12T22:49:58.881 INFO:tasks.workunit.client.0.smithi066.stdout:3/948: mkdir d0/d2/d149 0 2024-09-12T22:49:58.882 INFO:tasks.workunit.client.0.smithi066.stdout:5/930: creat d5/d11/d23/d6f/daa/dbb/f118 x:0 0 0 2024-09-12T22:49:58.882 INFO:tasks.workunit.client.0.smithi066.stdout:6/956: rename d6/d51/cd8 to d6/d23/d41/db6/dd3/d13a/d4e/c147 0 2024-09-12T22:49:58.882 INFO:tasks.workunit.client.0.smithi066.stdout:5/931: readlink l2 0 2024-09-12T22:49:58.882 INFO:tasks.workunit.client.0.smithi066.stdout:3/949: write d0/f54 [3967031,76527] 0 2024-09-12T22:49:58.883 INFO:tasks.workunit.client.0.smithi066.stdout:9/867: read d9/dc/f40 [1128793,75409] 0 2024-09-12T22:49:58.883 INFO:tasks.workunit.client.0.smithi066.stdout:0/884: dread d1/d8/d1f/d30/f70 [0,4194304] 0 2024-09-12T22:49:58.883 INFO:tasks.workunit.client.0.smithi066.stdout:5/932: read d5/d11/d21/d4d/fc2 [511503,107794] 0 2024-09-12T22:49:58.883 INFO:tasks.workunit.client.0.smithi066.stdout:7/798: rename d0/d6/d83/l88 to d0/d19/d24/d33/d27/d70/d90/lff 0 2024-09-12T22:49:58.883 INFO:tasks.workunit.client.0.smithi066.stdout:2/876: dread d1/d44/df3/d12/d18/da8/f102 [0,4194304] 0 2024-09-12T22:49:58.884 INFO:tasks.workunit.client.0.smithi066.stdout:9/868: creat d9/dc6/f11e x:0 0 0 2024-09-12T22:49:58.884 INFO:tasks.workunit.client.0.smithi066.stdout:0/885: rmdir d1/d8/d1c/d13 39 2024-09-12T22:49:58.885 INFO:tasks.workunit.client.0.smithi066.stdout:7/799: mkdir d0/d19/d24/d100 0 2024-09-12T22:49:58.885 INFO:tasks.workunit.client.0.smithi066.stdout:1/881: dread d0/d4e/d79/f9d [0,4194304] 0 2024-09-12T22:49:58.885 INFO:tasks.workunit.client.0.smithi066.stdout:5/933: write d5/f12 [6255966,53216] 0 2024-09-12T22:49:58.886 INFO:tasks.workunit.client.0.smithi066.stdout:8/905: dwrite d17/d49/d4b/d57/d5e/d62/ff6 [0,4194304] 0 2024-09-12T22:49:58.887 INFO:tasks.workunit.client.0.smithi066.stdout:6/957: truncate d6/d78/f9b 491725 0 2024-09-12T22:49:58.887 INFO:tasks.workunit.client.0.smithi066.stdout:2/877: mkdir d1/d11/d26/d4f/d5f/d61/d72/dad/df5/d118 0 2024-09-12T22:49:58.888 INFO:tasks.workunit.client.0.smithi066.stdout:7/800: chown d0/d19/d24/d33/d27/dba/dc9/df6 9698349 1 2024-09-12T22:49:58.888 INFO:tasks.workunit.client.0.smithi066.stdout:3/950: truncate d0/d2/d1d/d87/d40/d44/fe8 686174 0 2024-09-12T22:49:58.888 INFO:tasks.workunit.client.0.smithi066.stdout:9/869: creat d9/d31/d77/d8f/f11f x:0 0 0 2024-09-12T22:49:58.889 INFO:tasks.workunit.client.0.smithi066.stdout:5/934: creat d5/d11/d5d/d97/f119 x:0 0 0 2024-09-12T22:49:58.890 INFO:tasks.workunit.client.0.smithi066.stdout:8/906: link d17/d1b/de7/dea/le6 d17/d40/d47/d81/d131/l13a 0 2024-09-12T22:49:58.890 INFO:tasks.workunit.client.0.smithi066.stdout:2/878: mknod d1/d11/d26/d8f/c119 0 2024-09-12T22:49:58.891 INFO:tasks.workunit.client.0.smithi066.stdout:9/870: truncate d9/fd4 4475060 0 2024-09-12T22:49:58.893 INFO:tasks.workunit.client.0.smithi066.stdout:5/935: fdatasync d5/f24 0 2024-09-12T22:49:58.893 INFO:tasks.workunit.client.0.smithi066.stdout:4/950: dread d5/d8/d10/f5c [0,4194304] 0 2024-09-12T22:49:58.893 INFO:tasks.workunit.client.0.smithi066.stdout:2/879: write d1/d11/d26/d4f/d52/d56/f8a [934496,21612] 0 2024-09-12T22:49:58.893 INFO:tasks.workunit.client.0.smithi066.stdout:7/801: creat d0/d19/d24/d100/f101 x:0 0 0 2024-09-12T22:49:58.893 INFO:tasks.workunit.client.0.smithi066.stdout:0/886: dwrite d1/d8/d1f/f45 [0,4194304] 0 2024-09-12T22:49:58.894 INFO:tasks.workunit.client.0.smithi066.stdout:8/907: read d17/d40/d74/f123 [587141,90553] 0 2024-09-12T22:49:58.897 INFO:tasks.workunit.client.0.smithi066.stdout:9/871: creat d9/df0/f120 x:0 0 0 2024-09-12T22:49:58.897 INFO:tasks.workunit.client.0.smithi066.stdout:0/887: write d1/d36/d65/de9/f11a [940703,98284] 0 2024-09-12T22:49:58.897 INFO:tasks.workunit.client.0.smithi066.stdout:2/880: unlink d1/d44/d51/l5b 0 2024-09-12T22:49:58.898 INFO:tasks.workunit.client.0.smithi066.stdout:7/802: creat d0/d19/d24/d100/f102 x:0 0 0 2024-09-12T22:49:58.898 INFO:tasks.workunit.client.0.smithi066.stdout:8/908: chown d17/d49/d4b/d4e/l84 13792 1 2024-09-12T22:49:58.898 INFO:tasks.workunit.client.0.smithi066.stdout:6/958: dwrite d6/d23/d41/db6/dd3/d13a/d4e/dc4/ff6 [0,4194304] 0 2024-09-12T22:49:58.898 INFO:tasks.workunit.client.0.smithi066.stdout:4/951: fsync d5/d8/d16/d1b/d1e/f51 0 2024-09-12T22:49:58.900 INFO:tasks.workunit.client.0.smithi066.stdout:3/951: dwrite d0/d2/d7/d29/fc5 [4194304,4194304] 0 2024-09-12T22:49:58.900 INFO:tasks.workunit.client.0.smithi066.stdout:4/952: fsync d5/d3e/d8d/dc7/fc9 0 2024-09-12T22:49:58.901 INFO:tasks.workunit.client.0.smithi066.stdout:4/953: chown d5/d3e/d8d/dc7/d126/d39 2440407 1 2024-09-12T22:49:58.901 INFO:tasks.workunit.client.0.smithi066.stdout:9/872: unlink d9/d31/c9c 0 2024-09-12T22:49:58.901 INFO:tasks.workunit.client.0.smithi066.stdout:1/882: dread d0/f1c [0,4194304] 0 2024-09-12T22:49:58.902 INFO:tasks.workunit.client.0.smithi066.stdout:7/803: mknod d0/d19/d24/d33/d27/d70/d90/db8/c103 0 2024-09-12T22:49:58.903 INFO:tasks.workunit.client.0.smithi066.stdout:4/954: write d5/d3e/d8d/dc7/fc9 [3920714,54186] 0 2024-09-12T22:49:58.903 INFO:tasks.workunit.client.0.smithi066.stdout:0/888: symlink d1/dbf/d102/d12d/l131 0 2024-09-12T22:49:58.903 INFO:tasks.workunit.client.0.smithi066.stdout:8/909: write d17/d49/d4b/d57/d5e/fc3 [2098547,56256] 0 2024-09-12T22:49:58.903 INFO:tasks.workunit.client.0.smithi066.stdout:6/959: symlink d6/d51/d143/d124/l148 0 2024-09-12T22:49:58.904 INFO:tasks.workunit.client.0.smithi066.stdout:1/883: mkdir d0/dc0/d115 0 2024-09-12T22:49:58.904 INFO:tasks.workunit.client.0.smithi066.stdout:2/881: link d1/d11/lc0 d1/d44/l11a 0 2024-09-12T22:49:58.905 INFO:tasks.workunit.client.0.smithi066.stdout:8/910: write d17/d1b/fd5 [2641260,121503] 0 2024-09-12T22:49:58.906 INFO:tasks.workunit.client.0.smithi066.stdout:6/960: rmdir d6/d23/d62/d79 39 2024-09-12T22:49:58.906 INFO:tasks.workunit.client.0.smithi066.stdout:0/889: rename d1/d36/fb0 to d1/d5b/f132 0 2024-09-12T22:49:58.906 INFO:tasks.workunit.client.0.smithi066.stdout:4/955: getdents d5/d8/d16/d93/d9c/d98/dab/db3 0 2024-09-12T22:49:58.907 INFO:tasks.workunit.client.0.smithi066.stdout:6/961: write d6/d7/fae [3431061,57896] 0 2024-09-12T22:49:58.908 INFO:tasks.workunit.client.0.smithi066.stdout:2/882: getdents d1/d44/df3/d12/de2/ded 0 2024-09-12T22:49:58.909 INFO:tasks.workunit.client.0.smithi066.stdout:4/956: rename d5/d8/d10/f36 to d5/d8/d16/f139 0 2024-09-12T22:49:58.910 INFO:tasks.workunit.client.0.smithi066.stdout:9/873: dwrite d9/dc/d23/f79 [4194304,4194304] 0 2024-09-12T22:49:58.910 INFO:tasks.workunit.client.0.smithi066.stdout:6/962: fdatasync d6/d23/d41/db6/dd3/d13a/f97 0 2024-09-12T22:49:58.912 INFO:tasks.workunit.client.0.smithi066.stdout:9/874: creat d9/f121 x:0 0 0 2024-09-12T22:49:58.913 INFO:tasks.workunit.client.0.smithi066.stdout:8/911: dwrite d17/d1b/de7/d116/f6e [0,4194304] 0 2024-09-12T22:49:58.914 INFO:tasks.workunit.client.0.smithi066.stdout:9/875: dread - d9/d31/d34/ff2 zero size 2024-09-12T22:49:58.914 INFO:tasks.workunit.client.0.smithi066.stdout:4/957: symlink d5/d8/d16/d93/d9c/d98/dab/l13a 0 2024-09-12T22:49:58.914 INFO:tasks.workunit.client.0.smithi066.stdout:8/912: rename d17 to d17/d1b/d13b 22 2024-09-12T22:49:58.915 INFO:tasks.workunit.client.0.smithi066.stdout:4/958: fdatasync d5/d3e/d8d/dc7/d126/f14 0 2024-09-12T22:49:58.916 INFO:tasks.workunit.client.0.smithi066.stdout:2/883: dread d1/d44/df3/d12/d67/f6a [0,4194304] 0 2024-09-12T22:49:58.916 INFO:tasks.workunit.client.0.smithi066.stdout:8/913: chown d17/d49/d4b/d57/d5e/d62/d109 43 1 2024-09-12T22:49:58.916 INFO:tasks.workunit.client.0.smithi066.stdout:0/890: dwrite d1/d8/d1c/d56/db7/f104 [0,4194304] 0 2024-09-12T22:49:58.919 INFO:tasks.workunit.client.0.smithi066.stdout:8/914: chown d17/d49/d4b/d57/d5e/fc5 553423619 1 2024-09-12T22:49:58.919 INFO:tasks.workunit.client.0.smithi066.stdout:2/884: write d1/d11/d26/d4f/d5f/d61/d7e/f48 [1475793,29824] 0 2024-09-12T22:49:58.920 INFO:tasks.workunit.client.0.smithi066.stdout:0/891: fsync d1/d8/d1c/d13/d2f/dd8/f28 0 2024-09-12T22:49:58.921 INFO:tasks.workunit.client.0.smithi066.stdout:8/915: fdatasync d17/d40/dc4/f103 0 2024-09-12T22:49:58.921 INFO:tasks.workunit.client.0.smithi066.stdout:9/876: dwrite d9/df0/d8c/de2/ff7 [4194304,4194304] 0 2024-09-12T22:49:58.921 INFO:tasks.workunit.client.0.smithi066.stdout:2/885: truncate d1/d44/df3/f105 872993 0 2024-09-12T22:49:58.922 INFO:tasks.workunit.client.0.smithi066.stdout:4/959: dwrite d5/d8/d16/d1b/d72/f74 [0,4194304] 0 2024-09-12T22:49:58.924 INFO:tasks.workunit.client.0.smithi066.stdout:8/916: mkdir d17/d40/d47/d4d/d13c 0 2024-09-12T22:49:58.924 INFO:tasks.workunit.client.0.smithi066.stdout:4/960: fsync d5/d8/d16/f139 0 2024-09-12T22:49:58.924 INFO:tasks.workunit.client.0.smithi066.stdout:2/886: readlink d1/db/d42/d43/l7b 0 2024-09-12T22:49:58.926 INFO:tasks.workunit.client.0.smithi066.stdout:2/887: write d1/d11/d26/f6f [1923677,91430] 0 2024-09-12T22:49:58.926 INFO:tasks.workunit.client.0.smithi066.stdout:2/888: fsync d1/d44/df3/d12/d18/d90/f10b 0 2024-09-12T22:49:58.926 INFO:tasks.workunit.client.0.smithi066.stdout:7/804: sync 2024-09-12T22:49:58.926 INFO:tasks.workunit.client.0.smithi066.stdout:1/884: sync 2024-09-12T22:49:58.928 INFO:tasks.workunit.client.0.smithi066.stdout:0/892: creat d1/d36/d65/f133 x:0 0 0 2024-09-12T22:49:58.929 INFO:tasks.workunit.client.0.smithi066.stdout:8/917: getdents d17/d40/d74/da3/dac/dc8 0 2024-09-12T22:49:58.929 INFO:tasks.workunit.client.0.smithi066.stdout:6/963: read d6/d23/d41/db6/dd3/fdf [951745,29290] 0 2024-09-12T22:49:58.930 INFO:tasks.workunit.client.0.smithi066.stdout:4/961: truncate d5/fe4 1536570 0 2024-09-12T22:49:58.930 INFO:tasks.workunit.client.0.smithi066.stdout:7/805: creat d0/d19/d26/d48/dc3/f104 x:0 0 0 2024-09-12T22:49:58.930 INFO:tasks.workunit.client.0.smithi066.stdout:3/952: dread d0/f54 [0,4194304] 0 2024-09-12T22:49:58.931 INFO:tasks.workunit.client.0.smithi066.stdout:6/964: creat d6/d78/d4a/f149 x:0 0 0 2024-09-12T22:49:58.931 INFO:tasks.workunit.client.0.smithi066.stdout:1/885: rename d0/dc/d1e/d95/dcb/df3 to d0/d36/d8e/d116 0 2024-09-12T22:49:58.931 INFO:tasks.workunit.client.0.smithi066.stdout:7/806: readlink d0/d19/d26/d5a/dc8/ld8 0 2024-09-12T22:49:58.931 INFO:tasks.workunit.client.0.smithi066.stdout:6/965: chown d6/d23/d41/db6/dd3/d13a/d4e/d135 59798499 1 2024-09-12T22:49:58.932 INFO:tasks.workunit.client.0.smithi066.stdout:0/893: rename d1/d8/d1b/dac/fdd to d1/d8/d1c/d13/d2f/d8a/f134 0 2024-09-12T22:49:58.932 INFO:tasks.workunit.client.0.smithi066.stdout:7/807: stat d0/d19/d24/f6b 0 2024-09-12T22:49:58.932 INFO:tasks.workunit.client.0.smithi066.stdout:1/886: creat d0/dc/d1e/d95/f117 x:0 0 0 2024-09-12T22:49:58.932 INFO:tasks.workunit.client.0.smithi066.stdout:3/953: symlink d0/d2/d7/d13/l14a 0 2024-09-12T22:49:58.933 INFO:tasks.workunit.client.0.smithi066.stdout:0/894: mkdir d1/dbf/d135 0 2024-09-12T22:49:58.933 INFO:tasks.workunit.client.0.smithi066.stdout:6/966: mkdir d6/d23/d41/db6/dd3/d13a/d88/d14a 0 2024-09-12T22:49:58.934 INFO:tasks.workunit.client.0.smithi066.stdout:9/877: dread d9/f32 [0,4194304] 0 2024-09-12T22:49:58.934 INFO:tasks.workunit.client.0.smithi066.stdout:4/962: rename d5/d8/d16/d1b/d1e/lfc to d5/d3e/d8d/dc7/d126/d2d/d64/d104/l13b 0 2024-09-12T22:49:58.934 INFO:tasks.workunit.client.0.smithi066.stdout:5/936: dread d5/d11/f43 [0,4194304] 0 2024-09-12T22:49:58.935 INFO:tasks.workunit.client.0.smithi066.stdout:3/954: write d0/d2/d1d/d87/d40/d44/ff4 [974203,114856] 0 2024-09-12T22:49:58.935 INFO:tasks.workunit.client.0.smithi066.stdout:7/808: dread d0/d19/d24/d33/f5b [0,4194304] 0 2024-09-12T22:49:58.935 INFO:tasks.workunit.client.0.smithi066.stdout:6/967: chown d6/c46 8215604 1 2024-09-12T22:49:58.936 INFO:tasks.workunit.client.0.smithi066.stdout:9/878: creat d9/dc/d23/f122 x:0 0 0 2024-09-12T22:49:58.936 INFO:tasks.workunit.client.0.smithi066.stdout:6/968: chown d6/l10 93431 1 2024-09-12T22:49:58.937 INFO:tasks.workunit.client.0.smithi066.stdout:0/895: read d1/d8/d1f/d30/f5c [2021398,13128] 0 2024-09-12T22:49:58.937 INFO:tasks.workunit.client.0.smithi066.stdout:3/955: write d0/d2/d7/f1a [1295184,16232] 0 2024-09-12T22:49:58.938 INFO:tasks.workunit.client.0.smithi066.stdout:0/896: chown d1/d5b/dba 0 1 2024-09-12T22:49:58.939 INFO:tasks.workunit.client.0.smithi066.stdout:6/969: stat d6/d51/d143/d124/l148 0 2024-09-12T22:49:58.940 INFO:tasks.workunit.client.0.smithi066.stdout:3/956: mkdir d0/d2/d6/df9/d14b 0 2024-09-12T22:49:58.942 INFO:tasks.workunit.client.0.smithi066.stdout:1/887: dwrite d0/d36/d57/f70 [0,4194304] 0 2024-09-12T22:49:58.944 INFO:tasks.workunit.client.0.smithi066.stdout:0/897: write d1/d8/d1b/d59/fa1 [396475,58092] 0 2024-09-12T22:49:58.946 INFO:tasks.workunit.client.0.smithi066.stdout:3/957: rmdir d0/d2/d7/dc4/dcf 39 2024-09-12T22:49:58.947 INFO:tasks.workunit.client.0.smithi066.stdout:5/937: dwrite d5/d11/d23/d6f/dee/ff1 [0,4194304] 0 2024-09-12T22:49:58.947 INFO:tasks.workunit.client.0.smithi066.stdout:4/963: dwrite d5/d3e/d8d/dc7/d126/d39/f101 [0,4194304] 0 2024-09-12T22:49:58.947 INFO:tasks.workunit.client.0.smithi066.stdout:3/958: dread - d0/db3/f112 zero size 2024-09-12T22:49:58.948 INFO:tasks.workunit.client.0.smithi066.stdout:1/888: chown d0/d89/dd7/dd5/cee 23952916 1 2024-09-12T22:49:58.949 INFO:tasks.workunit.client.0.smithi066.stdout:0/898: symlink d1/d8/d1f/d25/d9c/l136 0 2024-09-12T22:49:58.950 INFO:tasks.workunit.client.0.smithi066.stdout:6/970: rename d6/d23/d41/db6/dd3/d13a/d4e/dc4/ca4 to d6/d23/d41/db6/dd3/df9/d102/c14b 0 2024-09-12T22:49:58.950 INFO:tasks.workunit.client.0.smithi066.stdout:3/959: chown d0/d2/d1d/d87/d40/dbd 2539 1 2024-09-12T22:49:58.951 INFO:tasks.workunit.client.0.smithi066.stdout:9/879: dwrite d9/dc/f88 [0,4194304] 0 2024-09-12T22:49:58.952 INFO:tasks.workunit.client.0.smithi066.stdout:3/960: write d0/d2/d7/d29/fcd [5241568,78482] 0 2024-09-12T22:49:58.956 INFO:tasks.workunit.client.0.smithi066.stdout:6/971: mkdir d6/d23/d41/db6/d14c 0 2024-09-12T22:49:58.956 INFO:tasks.workunit.client.0.smithi066.stdout:0/899: symlink d1/d5b/d124/l137 0 2024-09-12T22:49:58.957 INFO:tasks.workunit.client.0.smithi066.stdout:3/961: unlink d0/f54 0 2024-09-12T22:49:58.957 INFO:tasks.workunit.client.0.smithi066.stdout:4/964: dwrite d5/d8/f78 [0,4194304] 0 2024-09-12T22:49:58.957 INFO:tasks.workunit.client.0.smithi066.stdout:3/962: mknod d0/d2/d7/d13/d31/c14c 0 2024-09-12T22:49:58.958 INFO:tasks.workunit.client.0.smithi066.stdout:5/938: truncate d5/d11/d23/fa2 155708 0 2024-09-12T22:49:58.958 INFO:tasks.workunit.client.0.smithi066.stdout:3/963: readlink d0/d2/d7/d13/d31/l143 0 2024-09-12T22:49:58.958 INFO:tasks.workunit.client.0.smithi066.stdout:0/900: write d1/d8/d1c/d13/f20 [191339,69114] 0 2024-09-12T22:49:58.958 INFO:tasks.workunit.client.0.smithi066.stdout:5/939: stat d5/d103/dc7/ff0 0 2024-09-12T22:49:58.958 INFO:tasks.workunit.client.0.smithi066.stdout:3/964: dread - d0/d2/d1d/d87/d49/fd2 zero size 2024-09-12T22:49:58.958 INFO:tasks.workunit.client.0.smithi066.stdout:5/940: readlink d5/ld 0 2024-09-12T22:49:58.959 INFO:tasks.workunit.client.0.smithi066.stdout:0/901: mknod d1/d8/d1c/d56/db8/d127/c138 0 2024-09-12T22:49:58.959 INFO:tasks.workunit.client.0.smithi066.stdout:5/941: unlink d5/d11/d21/c26 0 2024-09-12T22:49:58.960 INFO:tasks.workunit.client.0.smithi066.stdout:9/880: dwrite d9/d31/d77/dc2/dcb/f63 [4194304,4194304] 0 2024-09-12T22:49:58.961 INFO:tasks.workunit.client.0.smithi066.stdout:2/889: dread d1/d44/df3/d12/f21 [0,4194304] 0 2024-09-12T22:49:58.962 INFO:tasks.workunit.client.0.smithi066.stdout:0/902: creat d1/d8/d1c/d56/db8/f139 x:0 0 0 2024-09-12T22:49:58.962 INFO:tasks.workunit.client.0.smithi066.stdout:5/942: write d5/d11/d23/d6f/daa/dbb/fe4 [4919553,102637] 0 2024-09-12T22:49:58.965 INFO:tasks.workunit.client.0.smithi066.stdout:4/965: dwrite d5/d8/f49 [0,4194304] 0 2024-09-12T22:49:58.965 INFO:tasks.workunit.client.0.smithi066.stdout:6/972: dread d6/d23/d41/db6/dd3/d13a/d4e/dc4/f65 [0,4194304] 0 2024-09-12T22:49:58.966 INFO:tasks.workunit.client.0.smithi066.stdout:5/943: write d5/d11/d23/d6f/daa/dbb/dc6/de1/f102 [549427,114582] 0 2024-09-12T22:49:58.968 INFO:tasks.workunit.client.0.smithi066.stdout:0/903: link d1/d8/d1c/d56/db7/ff6 d1/d36/de6/f13a 0 2024-09-12T22:49:58.968 INFO:tasks.workunit.client.0.smithi066.stdout:4/966: fdatasync d5/d8/d16/d1b/d72/fe3 0 2024-09-12T22:49:58.968 INFO:tasks.workunit.client.0.smithi066.stdout:5/944: mknod d5/d11/d21/d4d/c11a 0 2024-09-12T22:49:58.968 INFO:tasks.workunit.client.0.smithi066.stdout:6/973: getdents d6/d23/d41/db6/dd3/df9/d102 0 2024-09-12T22:49:58.969 INFO:tasks.workunit.client.0.smithi066.stdout:0/904: chown d1/d8/d1c/d13/d2f/dd8/l61 866 1 2024-09-12T22:49:58.970 INFO:tasks.workunit.client.0.smithi066.stdout:8/918: dread d17/d40/da8/f119 [0,4194304] 0 2024-09-12T22:49:58.970 INFO:tasks.workunit.client.0.smithi066.stdout:3/965: read d0/d2/d1d/d87/d6b/f80 [1678,70668] 0 2024-09-12T22:49:58.970 INFO:tasks.workunit.client.0.smithi066.stdout:6/974: write d6/d23/d41/f10b [937502,53731] 0 2024-09-12T22:49:58.970 INFO:tasks.workunit.client.0.smithi066.stdout:4/967: rename d5/d8/d16/d93/da6/dea to d5/d3e/d65/dac/d13c 0 2024-09-12T22:49:58.971 INFO:tasks.workunit.client.0.smithi066.stdout:8/919: mkdir d17/d13d 0 2024-09-12T22:49:58.971 INFO:tasks.workunit.client.0.smithi066.stdout:5/945: rename d5/d11/d21/faf to d5/d11/d23/d6f/daa/dbb/dc6/de1/f11b 0 2024-09-12T22:49:58.971 INFO:tasks.workunit.client.0.smithi066.stdout:6/975: mknod d6/d23/d41/db6/dd3/d13a/d4e/c14d 0 2024-09-12T22:49:58.971 INFO:tasks.workunit.client.0.smithi066.stdout:3/966: mknod d0/d2/d1d/d87/d40/d44/c14d 0 2024-09-12T22:49:58.972 INFO:tasks.workunit.client.0.smithi066.stdout:8/920: fsync d17/d49/d4b/d57/fa6 0 2024-09-12T22:49:58.972 INFO:tasks.workunit.client.0.smithi066.stdout:4/968: write d5/d3e/d65/dac/d13c/f128 [1888306,22982] 0 2024-09-12T22:49:58.972 INFO:tasks.workunit.client.0.smithi066.stdout:6/976: chown d6/d23/d41/db6/dd3/fdf 421833 1 2024-09-12T22:49:58.972 INFO:tasks.workunit.client.0.smithi066.stdout:4/969: fsync d5/f4f 0 2024-09-12T22:49:58.973 INFO:tasks.workunit.client.0.smithi066.stdout:8/921: symlink d17/d49/d4b/d4e/daf/dcb/l13e 0 2024-09-12T22:49:58.974 INFO:tasks.workunit.client.0.smithi066.stdout:3/967: getdents d0/d2/d1d/d87/d40/d44/d55/d91/dcb 0 2024-09-12T22:49:58.974 INFO:tasks.workunit.client.0.smithi066.stdout:8/922: mknod d17/d40/d47/d81/d131/c13f 0 2024-09-12T22:49:58.975 INFO:tasks.workunit.client.0.smithi066.stdout:7/809: sync 2024-09-12T22:49:58.976 INFO:tasks.workunit.client.0.smithi066.stdout:8/923: write d17/d1b/de7/f12a [802558,18727] 0 2024-09-12T22:49:58.976 INFO:tasks.workunit.client.0.smithi066.stdout:5/946: dwrite d5/d11/f54 [4194304,4194304] 0 2024-09-12T22:49:58.977 INFO:tasks.workunit.client.0.smithi066.stdout:9/881: truncate d9/dc/f19 570076 0 2024-09-12T22:49:58.978 INFO:tasks.workunit.client.0.smithi066.stdout:6/977: truncate d6/f17 561304 0 2024-09-12T22:49:58.978 INFO:tasks.workunit.client.0.smithi066.stdout:7/810: mkdir d0/d19/d24/d33/d27/dba/d105 0 2024-09-12T22:49:58.978 INFO:tasks.workunit.client.0.smithi066.stdout:8/924: creat d17/d2c/dab/d117/f140 x:0 0 0 2024-09-12T22:49:58.979 INFO:tasks.workunit.client.0.smithi066.stdout:6/978: read - d6/fe0 zero size 2024-09-12T22:49:58.979 INFO:tasks.workunit.client.0.smithi066.stdout:5/947: write d5/d11/d21/d78/f7b [821800,32398] 0 2024-09-12T22:49:58.979 INFO:tasks.workunit.client.0.smithi066.stdout:7/811: unlink d0/d19/cd1 0 2024-09-12T22:49:58.979 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:58.977+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:58.980 INFO:tasks.workunit.client.0.smithi066.stdout:9/882: write d9/dc/dd/f5f [6414357,127146] 0 2024-09-12T22:49:58.980 INFO:tasks.workunit.client.0.smithi066.stdout:4/970: read d5/d3e/d8d/dc7/d126/d2d/fa1 [648799,73426] 0 2024-09-12T22:49:58.980 INFO:tasks.workunit.client.0.smithi066.stdout:8/925: creat d17/d40/d47/d81/f141 x:0 0 0 2024-09-12T22:49:58.980 INFO:tasks.workunit.client.0.smithi066.stdout:5/948: mkdir d5/d11/d7c/d98/d11c 0 2024-09-12T22:49:58.981 INFO:tasks.workunit.client.0.smithi066.stdout:3/968: read d0/d2/d7/d29/fc5 [904537,25645] 0 2024-09-12T22:49:58.981 INFO:tasks.workunit.client.0.smithi066.stdout:5/949: write f4 [325658,27901] 0 2024-09-12T22:49:58.982 INFO:tasks.workunit.client.0.smithi066.stdout:6/979: getdents d6/d23/d41/db6/dd3/d13a/d4e/de6 0 2024-09-12T22:49:58.982 INFO:tasks.workunit.client.0.smithi066.stdout:4/971: fsync d5/d8/d16/d93/de0/de8/f92 0 2024-09-12T22:49:58.982 INFO:tasks.workunit.client.0.smithi066.stdout:8/926: write d17/d49/d4b/d57/d5e/d62/f67 [2965130,111935] 0 2024-09-12T22:49:58.984 INFO:tasks.workunit.client.0.smithi066.stdout:5/950: creat d5/d14/d114/d57/f11d x:0 0 0 2024-09-12T22:49:58.984 INFO:tasks.workunit.client.0.smithi066.stdout:9/883: link d9/df0/lc0 d9/d31/d77/dc2/dcb/dea/l123 0 2024-09-12T22:49:58.985 INFO:tasks.workunit.client.0.smithi066.stdout:6/980: mkdir d6/d23/d41/db6/dd3/d13a/d4e/dc4/d50/d14e 0 2024-09-12T22:49:58.985 INFO:tasks.workunit.client.0.smithi066.stdout:4/972: sync 2024-09-12T22:49:58.987 INFO:tasks.workunit.client.0.smithi066.stdout:5/951: creat d5/d11/d23/f11e x:0 0 0 2024-09-12T22:49:58.987 INFO:tasks.workunit.client.0.smithi066.stdout:7/812: dwrite d0/d19/d24/d33/d27/d70/f9d [0,4194304] 0 2024-09-12T22:49:58.987 INFO:tasks.workunit.client.0.smithi066.stdout:9/884: rename d9/dc/d46/l4a to d9/d31/d77/dc2/l124 0 2024-09-12T22:49:58.989 INFO:tasks.workunit.client.0.smithi066.stdout:4/973: chown d5/d8/d16/d93/de0/de8/f92 756 1 2024-09-12T22:49:58.989 INFO:tasks.workunit.client.0.smithi066.stdout:5/952: chown d5/d11/d23/f108 7 1 2024-09-12T22:49:58.989 INFO:tasks.workunit.client.0.smithi066.stdout:9/885: symlink d9/dc/d46/d8a/l125 0 2024-09-12T22:49:58.989 INFO:tasks.workunit.client.0.smithi066.stdout:4/974: dread - d5/d8/d10/f109 zero size 2024-09-12T22:49:58.990 INFO:tasks.workunit.client.0.smithi066.stdout:5/953: mknod d5/d14/d114/d57/c11f 0 2024-09-12T22:49:58.990 INFO:tasks.workunit.client.0.smithi066.stdout:8/927: dread d17/d49/d4b/d4e/fe1 [0,4194304] 0 2024-09-12T22:49:58.990 INFO:tasks.workunit.client.0.smithi066.stdout:9/886: write d9/f53 [1715682,37573] 0 2024-09-12T22:49:58.993 INFO:tasks.workunit.client.0.smithi066.stdout:3/969: dread d0/d2/d1d/d87/d40/dbd/d74/f88 [0,4194304] 0 2024-09-12T22:49:58.993 INFO:tasks.workunit.client.0.smithi066.stdout:4/975: unlink d5/d8/d16/d93/d9c/d98/l81 0 2024-09-12T22:49:58.993 INFO:tasks.workunit.client.0.smithi066.stdout:8/928: mknod d17/d49/d4b/d57/c142 0 2024-09-12T22:49:58.994 INFO:tasks.workunit.client.0.smithi066.stdout:9/887: mknod d9/df0/d8c/c126 0 2024-09-12T22:49:58.994 INFO:tasks.workunit.client.0.smithi066.stdout:5/954: creat d5/d14/d114/d50/d42/d49/f120 x:0 0 0 2024-09-12T22:49:58.997 INFO:tasks.workunit.client.0.smithi066.stdout:7/813: dwrite d0/d19/d26/d48/dc3/f104 [0,4194304] 0 2024-09-12T22:49:58.997 INFO:tasks.workunit.client.0.smithi066.stdout:3/970: chown d0/d2/d1d/d87/d49/dc8/cca 21115926 1 2024-09-12T22:49:58.997 INFO:tasks.workunit.client.0.smithi066.stdout:1/889: dread d0/d89/ffa [0,4194304] 0 2024-09-12T22:49:58.997 INFO:tasks.workunit.client.0.smithi066.stdout:2/890: dread d1/d11/d26/d4f/d5f/d61/d72/dad/f60 [0,4194304] 0 2024-09-12T22:49:58.997 INFO:tasks.workunit.client.0.smithi066.stdout:6/981: dwrite d6/d23/d41/db6/dd3/d13a/d4e/dc4/d50/f107 [0,4194304] 0 2024-09-12T22:49:59.001 INFO:tasks.workunit.client.0.smithi066.stdout:9/888: creat d9/d31/d10a/f127 x:0 0 0 2024-09-12T22:49:59.001 INFO:tasks.workunit.client.0.smithi066.stdout:8/929: readlink d17/d1b/de7/dea/le6 0 2024-09-12T22:49:59.001 INFO:tasks.workunit.client.0.smithi066.stdout:4/976: creat d5/d3e/d8d/dc7/d126/d39/dc0/f13d x:0 0 0 2024-09-12T22:49:59.001 INFO:tasks.workunit.client.0.smithi066.stdout:9/889: chown d9/f87 28985772 1 2024-09-12T22:49:59.001 INFO:tasks.workunit.client.0.smithi066.stdout:1/890: symlink d0/dea/df7/l118 0 2024-09-12T22:49:59.001 INFO:tasks.workunit.client.0.smithi066.stdout:7/814: write d0/d19/d60/d85/d8b/fb0 [4217950,34853] 0 2024-09-12T22:49:59.001 INFO:tasks.workunit.client.0.smithi066.stdout:2/891: mkdir d1/d44/df3/d68/dbc/d11b 0 2024-09-12T22:49:59.001 INFO:tasks.workunit.client.0.smithi066.stdout:3/971: chown d0/d2/d7/dc4/dcf 23 1 2024-09-12T22:49:59.002 INFO:tasks.workunit.client.0.smithi066.stdout:8/930: unlink d17/d49/d4b/d57/d5e/d65/d91/c10b 0 2024-09-12T22:49:59.002 INFO:tasks.workunit.client.0.smithi066.stdout:1/891: write d0/d36/d57/f70 [1099351,60529] 0 2024-09-12T22:49:59.003 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:59.004 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:59.004 INFO:tasks.workunit.client.0.smithi066.stdout:2/892: unlink d1/d11/d26/d4f/d5f/da9/lda 0 2024-09-12T22:49:59.004 INFO:tasks.workunit.client.0.smithi066.stdout:8/931: read d17/d40/d47/d4d/fa0 [115547,284] 0 2024-09-12T22:49:59.004 INFO:tasks.workunit.client.0.smithi066.stdout:1/892: mkdir d0/dc/d1e/d119 0 2024-09-12T22:49:59.005 INFO:tasks.workunit.client.0.smithi066.stdout:7/815: rename d0/d19/d24/d33/d27/d70/f9d to d0/d19/d60/d85/d8b/f106 0 2024-09-12T22:49:59.005 INFO:tasks.workunit.client.0.smithi066.stdout:8/932: write d17/d49/d4b/d57/d5e/d65/fe4 [55506,73932] 0 2024-09-12T22:49:59.006 INFO:tasks.workunit.client.0.smithi066.stdout:1/893: rename d0/cdd to d0/d89/dd7/dd5/c11a 0 2024-09-12T22:49:59.006 INFO:tasks.workunit.client.0.smithi066.stdout:7/816: fsync d0/d6/f8 0 2024-09-12T22:49:59.006 INFO:tasks.workunit.client.0.smithi066.stdout:6/982: dwrite d6/d7/faa [0,4194304] 0 2024-09-12T22:49:59.006 INFO:tasks.workunit.client.0.smithi066.stdout:5/955: dread d5/d11/d21/d4d/fda [0,4194304] 0 2024-09-12T22:49:59.008 INFO:tasks.workunit.client.0.smithi066.stdout:3/972: truncate d0/d2/d1d/d87/d40/f48 381132 0 2024-09-12T22:49:59.009 INFO:tasks.workunit.client.0.smithi066.stdout:6/983: truncate d6/d23/f29 4612610 0 2024-09-12T22:49:59.010 INFO:tasks.workunit.client.0.smithi066.stdout:2/893: dwrite d1/d11/d53/f7f [4194304,4194304] 0 2024-09-12T22:49:59.010 INFO:tasks.workunit.client.0.smithi066.stdout:1/894: rename d0/dc/d1e/d47/l75 to d0/d36/d57/d81/l11b 0 2024-09-12T22:49:59.010 INFO:tasks.workunit.client.0.smithi066.stdout:5/956: creat d5/d11/d5d/d64/f121 x:0 0 0 2024-09-12T22:49:59.011 INFO:tasks.workunit.client.0.smithi066.stdout:0/905: dread d1/d5b/d6d/fc8 [0,4194304] 0 2024-09-12T22:49:59.012 INFO:tasks.workunit.client.0.smithi066.stdout:4/977: read d5/d8/d16/f41 [7078693,4311] 0 2024-09-12T22:49:59.012 INFO:tasks.workunit.client.0.smithi066.stdout:3/973: mkdir d0/d2/d1d/d87/d40/d44/d55/d91/dcb/d14e 0 2024-09-12T22:49:59.012 INFO:tasks.workunit.client.0.smithi066.stdout:2/894: symlink d1/d44/df3/d68/dbc/l11c 0 2024-09-12T22:49:59.012 INFO:tasks.workunit.client.0.smithi066.stdout:5/957: creat d5/d103/dc7/f122 x:0 0 0 2024-09-12T22:49:59.013 INFO:tasks.workunit.client.0.smithi066.stdout:7/817: link d0/d19/d24/d33/f34 d0/d19/d24/f107 0 2024-09-12T22:49:59.013 INFO:tasks.workunit.client.0.smithi066.stdout:0/906: mknod d1/dbf/d117/c13b 0 2024-09-12T22:49:59.013 INFO:tasks.workunit.client.0.smithi066.stdout:2/895: fdatasync d1/d11/f66 0 2024-09-12T22:49:59.014 INFO:tasks.workunit.client.0.smithi066.stdout:5/958: creat d5/d15/db9/f123 x:0 0 0 2024-09-12T22:49:59.014 INFO:tasks.workunit.client.0.smithi066.stdout:7/818: rmdir d0/d19/d26/d48/df1 39 2024-09-12T22:49:59.016 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:59.017 INFO:tasks.workunit.client.0.smithi066.stdout:7/819: write d0/d19/d26/dbe/fe4 [971437,46636] 0 2024-09-12T22:49:59.017 INFO:tasks.workunit.client.0.smithi066.stdout:0/907: rename d1/d8/d1c/d13/d2f/d8a/f134 to d1/d5b/dba/f13c 0 2024-09-12T22:49:59.018 INFO:tasks.workunit.client.0.smithi066.stdout:1/895: dwrite d0/dc/d1d/fc4 [0,4194304] 0 2024-09-12T22:49:59.019 INFO:tasks.workunit.client.0.smithi066.stdout:9/890: dread d9/dc/d46/d8a/f92 [0,4194304] 0 2024-09-12T22:49:59.020 INFO:tasks.workunit.client.0.smithi066.stdout:2/896: read d1/d11/f25 [3346883,35688] 0 2024-09-12T22:49:59.021 INFO:tasks.workunit.client.0.smithi066.stdout:4/978: dread d5/d3e/d8d/dc7/d126/d2d/fa1 [0,4194304] 0 2024-09-12T22:49:59.022 INFO:tasks.workunit.client.0.smithi066.stdout:0/908: creat d1/d36/f13d x:0 0 0 2024-09-12T22:49:59.022 INFO:tasks.workunit.client.0.smithi066.stdout:7/820: link d0/d19/d7f/fa2 d0/d19/f108 0 2024-09-12T22:49:59.022 INFO:tasks.workunit.client.0.smithi066.stdout:3/974: dread d0/d2/d1d/d87/d40/f96 [0,4194304] 0 2024-09-12T22:49:59.022 INFO:tasks.workunit.client.0.smithi066.stdout:4/979: mkdir d5/d3e/d8d/dc7/d13e 0 2024-09-12T22:49:59.023 INFO:tasks.workunit.client.0.smithi066.stdout:5/959: dread d5/d11/d7c/fc0 [0,4194304] 0 2024-09-12T22:49:59.024 INFO:tasks.workunit.client.0.smithi066.stdout:0/909: unlink d1/d8/d1c/f98 0 2024-09-12T22:49:59.025 INFO:tasks.workunit.client.0.smithi066.stdout:1/896: dwrite d0/dea/df7/d9a/ff8 [0,4194304] 0 2024-09-12T22:49:59.025 INFO:tasks.workunit.client.0.smithi066.stdout:5/960: unlink d5/d11/d23/f5c 0 2024-09-12T22:49:59.026 INFO:tasks.workunit.client.0.smithi066.stdout:4/980: write d5/d3e/d8d/dc7/d126/d39/f3b [4356673,36173] 0 2024-09-12T22:49:59.026 INFO:tasks.workunit.client.0.smithi066.stdout:5/961: fdatasync d5/d11/d5d/d64/f121 0 2024-09-12T22:49:59.027 INFO:tasks.workunit.client.0.smithi066.stdout:7/821: dread d0/d19/f108 [0,4194304] 0 2024-09-12T22:49:59.027 INFO:tasks.workunit.client.0.smithi066.stdout:0/910: read d1/d8/d1f/d30/f3d [8060052,21504] 0 2024-09-12T22:49:59.028 INFO:tasks.workunit.client.0.smithi066.stdout:9/891: write d9/dc/d46/f67 [213052,11404] 0 2024-09-12T22:49:59.030 INFO:tasks.workunit.client.0.smithi066.stdout:1/897: rename d0/dc/d1d/l83 to d0/d4e/d79/dc1/l11c 0 2024-09-12T22:49:59.030 INFO:tasks.workunit.client.0.smithi066.stdout:7/822: chown d0/d19/d60/d85/d8b/f9c 980347 1 2024-09-12T22:49:59.031 INFO:tasks.workunit.client.0.smithi066.stdout:2/897: dwrite d1/d11/d26/d4f/d52/f69 [0,4194304] 0 2024-09-12T22:49:59.031 INFO:tasks.workunit.client.0.smithi066.stdout:0/911: mkdir d1/d8/d1c/d13/d2f/dd8/d13e 0 2024-09-12T22:49:59.031 INFO:tasks.workunit.client.0.smithi066.stdout:9/892: readlink d9/d31/d58/dbc/led 0 2024-09-12T22:49:59.031 INFO:tasks.workunit.client.0.smithi066.stdout:4/981: getdents d5/d3e/d8d/dc7/d126/d2d 0 2024-09-12T22:49:59.033 INFO:tasks.workunit.client.0.smithi066.stdout:1/898: write d0/f16 [1711249,11949] 0 2024-09-12T22:49:59.033 INFO:tasks.workunit.client.0.smithi066.stdout:0/912: symlink d1/d8/d1c/l13f 0 2024-09-12T22:49:59.033 INFO:tasks.workunit.client.0.smithi066.stdout:9/893: unlink d9/d31/f73 0 2024-09-12T22:49:59.033 INFO:tasks.workunit.client.0.smithi066.stdout:7/823: dread d0/d19/d7f/fa2 [0,4194304] 0 2024-09-12T22:49:59.033 INFO:tasks.workunit.client.0.smithi066.stdout:4/982: dread - d5/d8/d16/d93/d9c/d98/ddc/fe2 zero size 2024-09-12T22:49:59.034 INFO:tasks.workunit.client.0.smithi066.stdout:2/898: chown d1/d11/d26/l86 3689262 1 2024-09-12T22:49:59.034 INFO:tasks.workunit.client.0.smithi066.stdout:9/894: write d9/d31/d58/f70 [402383,99086] 0 2024-09-12T22:49:59.035 INFO:tasks.workunit.client.0.smithi066.stdout:0/913: write d1/d8/d1c/d56/db8/f139 [41833,75961] 0 2024-09-12T22:49:59.035 INFO:tasks.workunit.client.0.smithi066.stdout:5/962: truncate d5/d103/dc7/fe3 361162 0 2024-09-12T22:49:59.035 INFO:tasks.workunit.client.0.smithi066.stdout:7/824: getdents d0/d19/d26/d5a 0 2024-09-12T22:49:59.035 INFO:tasks.workunit.client.0.smithi066.stdout:4/983: creat d5/d8/d16/d93/d9c/d98/dab/db3/f13f x:0 0 0 2024-09-12T22:49:59.036 INFO:tasks.workunit.client.0.smithi066.stdout:2/899: chown d1/d44/df3/d12/d18/fcf 50335429 1 2024-09-12T22:49:59.036 INFO:tasks.workunit.client.0.smithi066.stdout:0/914: creat d1/d5b/d6d/f140 x:0 0 0 2024-09-12T22:49:59.036 INFO:tasks.workunit.client.0.smithi066.stdout:9/895: rename d9/dc to d9/d31/d58/dbc/db6/d128 0 2024-09-12T22:49:59.037 INFO:tasks.workunit.client.0.smithi066.stdout:0/915: readlink d1/d8/d1c/d13/d2f/dd8/la4 0 2024-09-12T22:49:59.037 INFO:tasks.workunit.client.0.smithi066.stdout:4/984: chown d5/fe4 100 1 2024-09-12T22:49:59.037 INFO:tasks.workunit.client.0.smithi066.stdout:1/899: read d0/dc/d1e/d47/ffc [1888813,114733] 0 2024-09-12T22:49:59.038 INFO:tasks.workunit.client.0.smithi066.stdout:5/963: getdents d5/d14/d114/d57 0 2024-09-12T22:49:59.038 INFO:tasks.workunit.client.0.smithi066.stdout:2/900: chown d1/d44/df3/d12/d1e/cee 984592 1 2024-09-12T22:49:59.038 INFO:tasks.workunit.client.0.smithi066.stdout:7/825: mkdir d0/d19/d24/d33/d27/d70/d90/db8/df4/d109 0 2024-09-12T22:49:59.038 INFO:tasks.workunit.client.0.smithi066.stdout:9/896: chown d9/d31/d58/dbc/db6/d128/d23/f79 3033 1 2024-09-12T22:49:59.038 INFO:tasks.workunit.client.0.smithi066.stdout:6/984: dread d6/d23/d41/db6/fda [0,4194304] 0 2024-09-12T22:49:59.039 INFO:tasks.workunit.client.0.smithi066.stdout:1/900: creat d0/dc/deb/f11d x:0 0 0 2024-09-12T22:49:59.039 INFO:tasks.workunit.client.0.smithi066.stdout:0/916: chown d1/d8/d1f/l64 2103364 1 2024-09-12T22:49:59.039 INFO:tasks.workunit.client.0.smithi066.stdout:4/985: creat d5/d3e/d8d/dc7/d126/d2d/f140 x:0 0 0 2024-09-12T22:49:59.039 INFO:tasks.workunit.client.0.smithi066.stdout:6/985: rmdir d6/d23/d62 39 2024-09-12T22:49:59.041 INFO:tasks.workunit.client.0.smithi066.stdout:7/826: read d0/d19/d60/d85/d8b/f106 [3547373,752] 0 2024-09-12T22:49:59.041 INFO:tasks.workunit.client.0.smithi066.stdout:0/917: mkdir d1/dbf/d102/d12d/d141 0 2024-09-12T22:49:59.041 INFO:tasks.workunit.client.0.smithi066.stdout:6/986: creat d6/d23/d41/db6/dd3/d13a/d4e/f14f x:0 0 0 2024-09-12T22:49:59.042 INFO:tasks.workunit.client.0.smithi066.stdout:1/901: dread d0/dc/d44/f77 [0,4194304] 0 2024-09-12T22:49:59.042 INFO:tasks.workunit.client.0.smithi066.stdout:0/918: read d1/d8/f5a [2799872,116316] 0 2024-09-12T22:49:59.042 INFO:tasks.workunit.client.0.smithi066.stdout:2/901: read d1/d11/d26/d4f/d5f/d61/fe8 [639052,83215] 0 2024-09-12T22:49:59.043 INFO:tasks.workunit.client.0.smithi066.stdout:1/902: unlink d0/d89/dd7/fd4 0 2024-09-12T22:49:59.043 INFO:tasks.workunit.client.0.smithi066.stdout:8/933: dread d17/d49/d4b/d57/f80 [0,4194304] 0 2024-09-12T22:49:59.045 INFO:tasks.workunit.client.0.smithi066.stdout:1/903: creat d0/d4e/d79/d86/d9c/f11e x:0 0 0 2024-09-12T22:49:59.047 INFO:tasks.workunit.client.0.smithi066.stdout:0/919: dwrite d1/d36/d65/f133 [0,4194304] 0 2024-09-12T22:49:59.048 INFO:tasks.workunit.client.0.smithi066.stdout:0/920: mknod d1/d8/d1c/c142 0 2024-09-12T22:49:59.049 INFO:tasks.workunit.client.0.smithi066.stdout:5/964: truncate d5/d11/d21/d4d/fda 462804 0 2024-09-12T22:49:59.049 INFO:tasks.workunit.client.0.smithi066.stdout:6/987: truncate d6/d7/dc/fbe 3173044 0 2024-09-12T22:49:59.050 INFO:tasks.workunit.client.0.smithi066.stdout:0/921: unlink d1/d8/d1c/d13/f22 0 2024-09-12T22:49:59.050 INFO:tasks.workunit.client.0.smithi066.stdout:3/975: dread d0/d2/d7/d29/daf/ff8 [0,4194304] 0 2024-09-12T22:49:59.051 INFO:tasks.workunit.client.0.smithi066.stdout:6/988: chown d6/d51/d143/d12b/df3/c104 2123331412 1 2024-09-12T22:49:59.051 INFO:tasks.workunit.client.0.smithi066.stdout:5/965: write d5/d14/d114/d50/d42/d49/f77 [2444249,19855] 0 2024-09-12T22:49:59.053 INFO:tasks.workunit.client.0.smithi066.stdout:4/986: dwrite d5/d8/d16/d1b/d72/fe3 [0,4194304] 0 2024-09-12T22:49:59.053 INFO:tasks.workunit.client.0.smithi066.stdout:5/966: creat d5/d11/d23/d6f/daa/f124 x:0 0 0 2024-09-12T22:49:59.054 INFO:tasks.workunit.client.0.smithi066.stdout:4/987: mknod d5/d8/d10/d11a/c141 0 2024-09-12T22:49:59.054 INFO:tasks.workunit.client.0.smithi066.stdout:5/967: mknod d5/d11/d7c/d98/d11c/c125 0 2024-09-12T22:49:59.054 INFO:tasks.workunit.client.0.smithi066.stdout:9/897: dread d9/d31/f118 [0,4194304] 0 2024-09-12T22:49:59.054 INFO:tasks.workunit.client.0.smithi066.stdout:0/922: truncate d1/f7 2112866 0 2024-09-12T22:49:59.055 INFO:tasks.workunit.client.0.smithi066.stdout:6/989: write d6/d35/fb0 [1241149,35498] 0 2024-09-12T22:49:59.055 INFO:tasks.workunit.client.0.smithi066.stdout:5/968: symlink d5/d11/d23/d6f/daa/dbb/dc6/l126 0 2024-09-12T22:49:59.057 INFO:tasks.workunit.client.0.smithi066.stdout:0/923: mknod d1/d8/d1b/dac/c143 0 2024-09-12T22:49:59.057 INFO:tasks.workunit.client.0.smithi066.stdout:5/969: rmdir d5/d14 39 2024-09-12T22:49:59.057 INFO:tasks.workunit.client.0.smithi066.stdout:5/970: mkdir d5/d11/d23/d6f/d127 0 2024-09-12T22:49:59.058 INFO:tasks.workunit.client.0.smithi066.stdout:6/990: link d6/d23/d41/db6/dd3/d13a/d4e/dc4/d32/f116 d6/d51/d143/d12b/f150 0 2024-09-12T22:49:59.058 INFO:tasks.workunit.client.0.smithi066.stdout:4/988: link d5/d8/d16/d93/d9c/d98/ddc/lf8 d5/d8/d16/d93/d9c/l142 0 2024-09-12T22:49:59.058 INFO:tasks.workunit.client.0.smithi066.stdout:5/971: write d5/d15/f71 [4384724,64453] 0 2024-09-12T22:49:59.058 INFO:tasks.workunit.client.0.smithi066.stdout:0/924: truncate d1/d8/d1b/d59/f69 267210 0 2024-09-12T22:49:59.058 INFO:tasks.workunit.client.0.smithi066.stdout:4/989: creat d5/d8/f143 x:0 0 0 2024-09-12T22:49:59.058 INFO:tasks.workunit.client.0.smithi066.stdout:6/991: readlink d6/d23/d41/db6/dd3/d13a/d4e/dc4/d32/lcf 0 2024-09-12T22:49:59.059 INFO:tasks.workunit.client.0.smithi066.stdout:0/925: creat d1/d8/d1c/d56/db8/f144 x:0 0 0 2024-09-12T22:49:59.059 INFO:tasks.workunit.client.0.smithi066.stdout:5/972: creat d5/d11/d23/d6f/daa/dbb/dc6/f128 x:0 0 0 2024-09-12T22:49:59.059 INFO:tasks.workunit.client.0.smithi066.stdout:4/990: creat d5/d3e/d8d/f144 x:0 0 0 2024-09-12T22:49:59.059 INFO:tasks.workunit.client.0.smithi066.stdout:5/973: chown d5/d11/d5d/cae 432959 1 2024-09-12T22:49:59.060 INFO:tasks.workunit.client.0.smithi066.stdout:3/976: truncate d0/d2/d6/fee 336338 0 2024-09-12T22:49:59.061 INFO:tasks.workunit.client.0.smithi066.stdout:3/977: rmdir d0/db3 39 2024-09-12T22:49:59.061 INFO:tasks.workunit.client.0.smithi066.stdout:5/974: mknod d5/d14/d114/c129 0 2024-09-12T22:49:59.062 INFO:tasks.workunit.client.0.smithi066.stdout:3/978: mknod d0/d2/d1d/d87/d40/dbd/c14f 0 2024-09-12T22:49:59.063 INFO:tasks.workunit.client.0.smithi066.stdout:6/992: dwrite d6/d7/dc/f43 [0,4194304] 0 2024-09-12T22:49:59.064 INFO:tasks.workunit.client.0.smithi066.stdout:0/926: dwrite d1/d8/d1c/d56/fff [4194304,4194304] 0 2024-09-12T22:49:59.064 INFO:tasks.workunit.client.0.smithi066.stdout:6/993: write d6/d7/fae [5328009,80028] 0 2024-09-12T22:49:59.066 INFO:tasks.workunit.client.0.smithi066.stdout:0/927: rename d1/d8/d1b/dac/f12a to d1/d8/df5/f145 0 2024-09-12T22:49:59.068 INFO:tasks.workunit.client.0.smithi066.stdout:3/979: dwrite d0/d2/d6/d7a/f10f [0,4194304] 0 2024-09-12T22:49:59.068 INFO:tasks.workunit.client.0.smithi066.stdout:7/827: sync 2024-09-12T22:49:59.069 INFO:tasks.workunit.client.0.smithi066.stdout:5/975: sync 2024-09-12T22:49:59.071 INFO:tasks.workunit.client.0.smithi066.stdout:7/828: fdatasync d0/d19/d24/d100/f102 0 2024-09-12T22:49:59.071 INFO:tasks.workunit.client.0.smithi066.stdout:0/928: link d1/d8/d1c/d13/d2f/d8a/le3 d1/d8/d1c/d56/l146 0 2024-09-12T22:49:59.072 INFO:tasks.workunit.client.0.smithi066.stdout:5/976: rename d5/d11/d5d/d64/d8f/fe0 to d5/d15/f12a 0 2024-09-12T22:49:59.072 INFO:tasks.workunit.client.0.smithi066.stdout:3/980: chown d0/d2/d7/dc4/dcf/d9e/d137/d141 5919 1 2024-09-12T22:49:59.073 INFO:tasks.workunit.client.0.smithi066.stdout:7/829: write d0/d19/d26/d48/f9e [906250,32371] 0 2024-09-12T22:49:59.074 INFO:tasks.workunit.client.0.smithi066.stdout:6/994: dwrite d6/d23/d41/db6/dd3/d13a/d4e/dc4/d99/fa0 [0,4194304] 0 2024-09-12T22:49:59.074 INFO:tasks.workunit.client.0.smithi066.stdout:5/977: write d5/d15/f12a [1492480,128395] 0 2024-09-12T22:49:59.074 INFO:tasks.workunit.client.0.smithi066.stdout:0/929: truncate d1/d8/d1b/d59/f69 233132 0 2024-09-12T22:49:59.075 INFO:tasks.workunit.client.0.smithi066.stdout:6/995: write d6/fe0 [525701,31666] 0 2024-09-12T22:49:59.075 INFO:tasks.workunit.client.0.smithi066.stdout:3/981: creat d0/d2/d1d/d87/d40/d44/d55/d91/dcb/d14e/f150 x:0 0 0 2024-09-12T22:49:59.075 INFO:tasks.workunit.client.0.smithi066.stdout:5/978: mknod d5/d11/d21/c12b 0 2024-09-12T22:49:59.076 INFO:tasks.workunit.client.0.smithi066.stdout:7/830: getdents d0/d19/d24/d33 0 2024-09-12T22:49:59.077 INFO:tasks.workunit.client.0.smithi066.stdout:3/982: getdents d0/d2/d1d/d87/d40/d44 0 2024-09-12T22:49:59.077 INFO:tasks.workunit.client.0.smithi066.stdout:5/979: truncate d5/d11/d23/d6f/daa/dbb/dc6/f117 443154 0 2024-09-12T22:49:59.079 INFO:tasks.workunit.client.0.smithi066.stdout:5/980: chown d5/ld 10092189 1 2024-09-12T22:49:59.079 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:59.078+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:59.080 INFO:tasks.workunit.client.0.smithi066.stdout:5/981: write d5/d11/d23/d6f/dee/f100 [577576,63629] 0 2024-09-12T22:49:59.080 INFO:tasks.workunit.client.0.smithi066.stdout:3/983: truncate d0/d2/d7/d13/d31/f83 3346800 0 2024-09-12T22:49:59.080 INFO:tasks.workunit.client.0.smithi066.stdout:0/930: dwrite d1/d8/d1c/d13/f12f [0,4194304] 0 2024-09-12T22:49:59.083 INFO:tasks.workunit.client.0.smithi066.stdout:0/931: read d1/d36/f79 [3919043,25204] 0 2024-09-12T22:49:59.083 INFO:tasks.workunit.client.0.smithi066.stdout:0/932: symlink d1/d36/d65/l147 0 2024-09-12T22:49:59.085 INFO:tasks.workunit.client.0.smithi066.stdout:0/933: write d1/d8/d1c/fb3 [1510064,9774] 0 2024-09-12T22:49:59.085 INFO:tasks.workunit.client.0.smithi066.stdout:0/934: symlink d1/d5b/dba/l148 0 2024-09-12T22:49:59.086 INFO:tasks.workunit.client.0.smithi066.stdout:0/935: creat d1/d8/d1f/f149 x:0 0 0 2024-09-12T22:49:59.086 INFO:tasks.workunit.client.0.smithi066.stdout:6/996: write d6/d23/d41/db6/dd3/d13a/f97 [3792688,31512] 0 2024-09-12T22:49:59.087 INFO:tasks.workunit.client.0.smithi066.stdout:2/902: dread d1/d44/df3/d12/d1e/fc5 [0,4194304] 0 2024-09-12T22:49:59.087 INFO:tasks.workunit.client.0.smithi066.stdout:0/936: rename d1/d8/d1c/d13/f23 to d1/dbf/d135/f14a 0 2024-09-12T22:49:59.088 INFO:tasks.workunit.client.0.smithi066.stdout:6/997: write d6/d23/d41/db6/dd3/d13a/d4e/dc4/d32/d3c/fad [107121,79193] 0 2024-09-12T22:49:59.089 INFO:tasks.workunit.client.0.smithi066.stdout:0/937: getdents d1/d8/d1b/dac 0 2024-09-12T22:49:59.089 INFO:tasks.workunit.client.0.smithi066.stdout:6/998: creat d6/d23/d41/db6/dd3/df9/d102/d12a/f151 x:0 0 0 2024-09-12T22:49:59.089 INFO:tasks.workunit.client.0.smithi066.stdout:0/938: stat d1/d8/d1c/d13 0 2024-09-12T22:49:59.090 INFO:tasks.workunit.client.0.smithi066.stdout:6/999: stat d6/f2a 0 2024-09-12T22:49:59.090 INFO:tasks.workunit.client.0.smithi066.stdout:0/939: mkdir d1/d36/d65/dc2/d14b 0 2024-09-12T22:49:59.090 INFO:tasks.workunit.client.0.smithi066.stdout:0/940: readlink d1/d36/lfc 0 2024-09-12T22:49:59.091 INFO:tasks.workunit.client.0.smithi066.stdout:0/941: creat d1/dbf/d102/f14c x:0 0 0 2024-09-12T22:49:59.091 INFO:tasks.workunit.client.0.smithi066.stdout:0/942: chown d1/d8/df5/cbd 13993885 1 2024-09-12T22:49:59.092 INFO:tasks.workunit.client.0.smithi066.stdout:0/943: write d1/f73 [5748708,90524] 0 2024-09-12T22:49:59.092 INFO:tasks.workunit.client.0.smithi066.stdout:0/944: chown d1/d8/d1b/d59/l74 11813359 1 2024-09-12T22:49:59.093 INFO:tasks.workunit.client.0.smithi066.stdout:0/945: rename d1/d8/d1f/d30/ddf to d1/dbf/d135/d14d 0 2024-09-12T22:49:59.093 INFO:tasks.workunit.client.0.smithi066.stdout:8/934: sync 2024-09-12T22:49:59.094 INFO:tasks.workunit.client.0.smithi066.stdout:9/898: sync 2024-09-12T22:49:59.094 INFO:tasks.workunit.client.0.smithi066.stdout:1/904: sync 2024-09-12T22:49:59.094 INFO:tasks.workunit.client.0.smithi066.stdout:4/991: sync 2024-09-12T22:49:59.094 INFO:tasks.workunit.client.0.smithi066.stdout:7/831: sync 2024-09-12T22:49:59.094 INFO:tasks.workunit.client.0.smithi066.stdout:0/946: truncate d1/d8/f62 1004464 0 2024-09-12T22:49:59.095 INFO:tasks.workunit.client.0.smithi066.stdout:9/899: creat d9/d31/d58/d7f/dc8/f129 x:0 0 0 2024-09-12T22:49:59.095 INFO:tasks.workunit.client.0.smithi066.stdout:8/935: creat d17/d49/d4b/d57/d5e/d62/f143 x:0 0 0 2024-09-12T22:49:59.096 INFO:tasks.workunit.client.0.smithi066.stdout:1/905: getdents d0/d4e 0 2024-09-12T22:49:59.096 INFO:tasks.workunit.client.0.smithi066.stdout:4/992: fdatasync d5/d3e/d8d/dc7/d126/d2d/fc1 0 2024-09-12T22:49:59.096 INFO:tasks.workunit.client.0.smithi066.stdout:9/900: fsync d9/df0/fd3 0 2024-09-12T22:49:59.096 INFO:tasks.workunit.client.0.smithi066.stdout:0/947: mknod d1/d8/d1c/d56/db8/d127/c14e 0 2024-09-12T22:49:59.097 INFO:tasks.workunit.client.0.smithi066.stdout:8/936: rename d17/d49/d4b/d4e/fe1 to d17/d1b/f144 0 2024-09-12T22:49:59.097 INFO:tasks.workunit.client.0.smithi066.stdout:4/993: creat d5/d3e/d8d/dc7/f145 x:0 0 0 2024-09-12T22:49:59.097 INFO:tasks.workunit.client.0.smithi066.stdout:1/906: symlink d0/d4e/d79/dc1/l11f 0 2024-09-12T22:49:59.098 INFO:tasks.workunit.client.0.smithi066.stdout:9/901: write d9/df0/ff8 [3644794,50752] 0 2024-09-12T22:49:59.099 INFO:tasks.workunit.client.0.smithi066.stdout:8/937: creat d17/d40/d47/d4d/df0/f145 x:0 0 0 2024-09-12T22:49:59.101 INFO:tasks.workunit.client.0.smithi066.stdout:1/907: creat d0/d36/d57/d81/f120 x:0 0 0 2024-09-12T22:49:59.101 INFO:tasks.workunit.client.0.smithi066.stdout:9/902: creat d9/df0/d8c/de2/f12a x:0 0 0 2024-09-12T22:49:59.101 INFO:tasks.workunit.client.0.smithi066.stdout:1/908: sync 2024-09-12T22:49:59.101 INFO:tasks.workunit.client.0.smithi066.stdout:7/832: dwrite d0/d19/d26/d5a/fda [0,4194304] 0 2024-09-12T22:49:59.101 INFO:tasks.workunit.client.0.smithi066.stdout:9/903: rmdir d9/d31 39 2024-09-12T22:49:59.103 INFO:tasks.workunit.client.0.smithi066.stdout:4/994: dread d5/d8/d10/f5c [0,4194304] 0 2024-09-12T22:49:59.106 INFO:tasks.workunit.client.0.smithi066.stdout:0/948: dwrite d1/d8/d1f/d25/f71 [4194304,4194304] 0 2024-09-12T22:49:59.106 INFO:tasks.workunit.client.0.smithi066.stdout:1/909: mknod d0/dea/df7/d9a/c121 0 2024-09-12T22:49:59.106 INFO:tasks.workunit.client.0.smithi066.stdout:9/904: symlink d9/dc6/df6/l12b 0 2024-09-12T22:49:59.108 INFO:tasks.workunit.client.0.smithi066.stdout:1/910: write d0/dc/f46 [2123138,73628] 0 2024-09-12T22:49:59.109 INFO:tasks.workunit.client.0.smithi066.stdout:4/995: write d5/fe4 [1989901,36431] 0 2024-09-12T22:49:59.109 INFO:tasks.workunit.client.0.smithi066.stdout:8/938: dwrite d17/d40/d74/da3/dac/dc8/feb [0,4194304] 0 2024-09-12T22:49:59.110 INFO:tasks.workunit.client.0.smithi066.stdout:7/833: dwrite d0/d19/d26/d48/f9e [0,4194304] 0 2024-09-12T22:49:59.112 INFO:tasks.workunit.client.0.smithi066.stdout:2/903: dread d1/d44/df3/d3d/fba [4194304,4194304] 0 2024-09-12T22:49:59.112 INFO:tasks.workunit.client.0.smithi066.stdout:0/949: symlink d1/d8/d1c/d13/d2f/l14f 0 2024-09-12T22:49:59.114 INFO:tasks.workunit.client.0.smithi066.stdout:9/905: symlink d9/d31/d58/dbc/d9d/l12c 0 2024-09-12T22:49:59.114 INFO:tasks.workunit.client.0.smithi066.stdout:7/834: mknod d0/d86/c10a 0 2024-09-12T22:49:59.114 INFO:tasks.workunit.client.0.smithi066.stdout:8/939: getdents d17/d49/d118 0 2024-09-12T22:49:59.114 INFO:tasks.workunit.client.0.smithi066.stdout:4/996: creat d5/d3e/d8d/dce/dca/f146 x:0 0 0 2024-09-12T22:49:59.114 INFO:tasks.workunit.client.0.smithi066.stdout:0/950: creat d1/d8/d1c/d13/d2f/d8a/dc0/f150 x:0 0 0 2024-09-12T22:49:59.115 INFO:tasks.workunit.client.0.smithi066.stdout:7/835: fdatasync d0/d19/d26/d48/dc3/f104 0 2024-09-12T22:49:59.115 INFO:tasks.workunit.client.0.smithi066.stdout:8/940: write d17/d40/d47/d4d/f50 [2930589,14412] 0 2024-09-12T22:49:59.116 INFO:tasks.workunit.client.0.smithi066.stdout:9/906: creat d9/d31/d58/db1/f12d x:0 0 0 2024-09-12T22:49:59.117 INFO:tasks.workunit.client.0.smithi066.stdout:0/951: rename d1/d5b/d124 to d1/d8/d1f/d47/d151 0 2024-09-12T22:49:59.117 INFO:tasks.workunit.client.0.smithi066.stdout:2/904: link d1/d11/d26/d4f/l10c d1/d44/df3/d12/de2/d109/d112/l11d 0 2024-09-12T22:49:59.118 INFO:tasks.workunit.client.0.smithi066.stdout:8/941: mknod d17/d40/d74/da3/dac/db4/c146 0 2024-09-12T22:49:59.118 INFO:tasks.workunit.client.0.smithi066.stdout:9/907: readlink d9/d31/d58/dbc/db6/d128/dd2/leb 0 2024-09-12T22:49:59.118 INFO:tasks.workunit.client.0.smithi066.stdout:2/905: chown d1/d11/d26/d4f/l78 477354 1 2024-09-12T22:49:59.119 INFO:tasks.workunit.client.0.smithi066.stdout:7/836: creat d0/d19/d24/d33/d27/d70/d90/db8/f10b x:0 0 0 2024-09-12T22:49:59.120 INFO:tasks.workunit.client.0.smithi066.stdout:9/908: symlink d9/d31/d58/dbc/da8/l12e 0 2024-09-12T22:49:59.121 INFO:tasks.workunit.client.0.smithi066.stdout:4/997: dwrite d5/d8/d16/d1b/d72/f74 [0,4194304] 0 2024-09-12T22:49:59.124 INFO:tasks.workunit.client.0.smithi066.stdout:7/837: creat d0/d19/d24/d33/d27/dba/dc9/de5/df8/f10c x:0 0 0 2024-09-12T22:49:59.124 INFO:tasks.workunit.client.0.smithi066.stdout:7/838: sync 2024-09-12T22:49:59.125 INFO:tasks.workunit.client.0.smithi066.stdout:0/952: dwrite d1/d8/d1c/d13/d2f/f82 [0,4194304] 0 2024-09-12T22:49:59.126 INFO:tasks.workunit.client.0.smithi066.stdout:8/942: dwrite d17/d40/d47/d81/f141 [0,4194304] 0 2024-09-12T22:49:59.126 INFO:tasks.workunit.client.0.smithi066.stdout:1/911: truncate d0/d36/d57/d81/fbf 891067 0 2024-09-12T22:49:59.128 INFO:tasks.workunit.client.0.smithi066.stdout:2/906: dwrite d1/f6b [0,4194304] 0 2024-09-12T22:49:59.128 INFO:tasks.workunit.client.0.smithi066.stdout:0/953: stat d1/d5b/d6d/f140 0 2024-09-12T22:49:59.129 INFO:tasks.workunit.client.0.smithi066.stdout:7/839: read d0/d19/d60/d85/d8b/fa8 [563491,84879] 0 2024-09-12T22:49:59.129 INFO:tasks.workunit.client.0.smithi066.stdout:4/998: symlink d5/d3e/d8d/dc7/d126/d2d/d64/d9a/l147 0 2024-09-12T22:49:59.130 INFO:tasks.workunit.client.0.smithi066.stdout:1/912: chown d0/dc/d1e/c3c 1095679 1 2024-09-12T22:49:59.131 INFO:tasks.workunit.client.0.smithi066.stdout:9/909: dwrite d9/df0/ff8 [0,4194304] 0 2024-09-12T22:49:59.131 INFO:tasks.workunit.client.0.smithi066.stdout:3/984: dread d0/d2/d1d/d87/d40/dbd/d74/f86 [0,4194304] 0 2024-09-12T22:49:59.133 INFO:tasks.workunit.client.0.smithi066.stdout:9/910: write d9/d31/d77/d8f/f11f [699410,124956] 0 2024-09-12T22:49:59.133 INFO:tasks.workunit.client.0.smithi066.stdout:0/954: write d1/d8/d1c/d13/d2f/f92 [818559,100357] 0 2024-09-12T22:49:59.135 INFO:tasks.workunit.client.0.smithi066.stdout:1/913: write d0/f1c [2037351,54989] 0 2024-09-12T22:49:59.136 INFO:tasks.workunit.client.0.smithi066.stdout:2/907: rename d1/d11/d26/d4f/d5f/d61/d72/fe0 to d1/d44/d51/de4/f11e 0 2024-09-12T22:49:59.136 INFO:tasks.workunit.client.0.smithi066.stdout:3/985: mkdir d0/d2/d1d/d151 0 2024-09-12T22:49:59.137 INFO:tasks.workunit.client.0.smithi066.stdout:2/908: stat d1/d11/d53 0 2024-09-12T22:49:59.137 INFO:tasks.workunit.client.0.smithi066.stdout:9/911: chown d9/d31/d58/dbc/da8/cfa 176195405 1 2024-09-12T22:49:59.137 INFO:tasks.workunit.client.0.smithi066.stdout:1/914: fsync d0/dc/fdb 0 2024-09-12T22:49:59.138 INFO:tasks.workunit.client.0.smithi066.stdout:8/943: getdents d17/d49/d4b/d57/d5e/d62/dc1/d129 0 2024-09-12T22:49:59.138 INFO:tasks.workunit.client.0.smithi066.stdout:5/982: dread d5/f36 [0,4194304] 0 2024-09-12T22:49:59.139 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:59.139 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:59.139 INFO:tasks.workunit.client.0.smithi066.stdout:1/915: mkdir d0/dea/df7/d9a/d122 0 2024-09-12T22:49:59.139 INFO:tasks.workunit.client.0.smithi066.stdout:7/840: read d0/d19/d24/f6b [63290,15247] 0 2024-09-12T22:49:59.141 INFO:tasks.workunit.client.0.smithi066.stdout:8/944: write d17/d49/d4b/d57/d5e/d62/d79/ffe [877532,116095] 0 2024-09-12T22:49:59.141 INFO:tasks.workunit.client.0.smithi066.stdout:1/916: write d0/dc/deb/f113 [288190,112376] 0 2024-09-12T22:49:59.141 INFO:tasks.workunit.client.0.smithi066.stdout:4/999: dwrite d5/d3e/d8d/dc7/d126/d2d/d64/d9a/dfd/f112 [0,4194304] 0 2024-09-12T22:49:59.142 INFO:tasks.workunit.client.0.smithi066.stdout:1/917: dread - d0/dc/deb/f11d zero size 2024-09-12T22:49:59.143 INFO:tasks.workunit.client.0.smithi066.stdout:8/945: mkdir d17/d1b/de7/d147 0 2024-09-12T22:49:59.145 INFO:tasks.workunit.client.0.smithi066.stdout:2/909: dwrite d1/d44/df3/f14 [0,4194304] 0 2024-09-12T22:49:59.146 INFO:tasks.workunit.client.0.smithi066.stdout:7/841: dwrite d0/d19/d24/f1f [0,4194304] 0 2024-09-12T22:49:59.147 INFO:tasks.workunit.client.0.smithi066.stdout:3/986: write d0/d2/d1d/d87/d40/d44/fe8 [718299,95307] 0 2024-09-12T22:49:59.147 INFO:tasks.workunit.client.0.smithi066.stdout:2/910: chown d1/d11/d26/d4f/d5f/d61/d7e/l97 0 1 2024-09-12T22:49:59.149 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:59.150 INFO:tasks.workunit.client.0.smithi066.stdout:3/987: write d0/d2/d6/f7d [1061902,127246] 0 2024-09-12T22:49:59.150 INFO:tasks.workunit.client.0.smithi066.stdout:1/918: dwrite d0/dc0/fce [0,4194304] 0 2024-09-12T22:49:59.150 INFO:tasks.workunit.client.0.smithi066.stdout:7/842: write d0/d19/d26/d48/d59/f68 [2461664,114446] 0 2024-09-12T22:49:59.151 INFO:tasks.workunit.client.0.smithi066.stdout:8/946: truncate d17/d49/f8d 4910189 0 2024-09-12T22:49:59.152 INFO:tasks.workunit.client.0.smithi066.stdout:1/919: symlink d0/dc/d1e/d95/df2/l123 0 2024-09-12T22:49:59.152 INFO:tasks.workunit.client.0.smithi066.stdout:3/988: creat d0/d2/d1d/d87/d40/dd1/f152 x:0 0 0 2024-09-12T22:49:59.153 INFO:tasks.workunit.client.0.smithi066.stdout:3/989: stat d0/d2/d7/d120 0 2024-09-12T22:49:59.153 INFO:tasks.workunit.client.0.smithi066.stdout:1/920: mkdir d0/dc/d1d/d124 0 2024-09-12T22:49:59.153 INFO:tasks.workunit.client.0.smithi066.stdout:2/911: dread d1/f6b [0,4194304] 0 2024-09-12T22:49:59.154 INFO:tasks.workunit.client.0.smithi066.stdout:3/990: chown d0/d2/d7/d13/d31/l69 933698 1 2024-09-12T22:49:59.154 INFO:tasks.workunit.client.0.smithi066.stdout:2/912: symlink d1/d44/df3/d12/d67/l11f 0 2024-09-12T22:49:59.155 INFO:tasks.workunit.client.0.smithi066.stdout:7/843: dwrite d0/d19/f108 [0,4194304] 0 2024-09-12T22:49:59.156 INFO:tasks.workunit.client.0.smithi066.stdout:2/913: mkdir d1/d44/df3/d12/de2/ded/d120 0 2024-09-12T22:49:59.159 INFO:tasks.workunit.client.0.smithi066.stdout:7/844: mkdir d0/d6/d10d 0 2024-09-12T22:49:59.159 INFO:tasks.workunit.client.0.smithi066.stdout:2/914: rename d1/d44/df3/d68/fd5 to d1/d44/df3/d12/d18/d90/f121 0 2024-09-12T22:49:59.159 INFO:tasks.workunit.client.0.smithi066.stdout:7/845: stat d0/d6/c3d 0 2024-09-12T22:49:59.159 INFO:tasks.workunit.client.0.smithi066.stdout:2/915: mkdir d1/d11/d26/d4f/d7c/d122 0 2024-09-12T22:49:59.160 INFO:tasks.workunit.client.0.smithi066.stdout:7/846: link d0/d19/d24/c89 d0/d19/d26/c10e 0 2024-09-12T22:49:59.161 INFO:tasks.workunit.client.0.smithi066.stdout:7/847: read - d0/d19/d60/d85/de6/ffa zero size 2024-09-12T22:49:59.161 INFO:tasks.workunit.client.0.smithi066.stdout:7/848: dread - d0/d19/d26/d48/f49 zero size 2024-09-12T22:49:59.162 INFO:tasks.workunit.client.0.smithi066.stdout:7/849: creat d0/d19/d24/d100/f10f x:0 0 0 2024-09-12T22:49:59.163 INFO:tasks.workunit.client.0.smithi066.stdout:7/850: unlink d0/d19/d60/d53/ff7 0 2024-09-12T22:49:59.163 INFO:tasks.workunit.client.0.smithi066.stdout:7/851: write d0/d19/d60/fd4 [767629,22093] 0 2024-09-12T22:49:59.165 INFO:tasks.workunit.client.0.smithi066.stdout:2/916: read d1/d44/df3/d12/d1e/f35 [1147584,33584] 0 2024-09-12T22:49:59.166 INFO:tasks.workunit.client.0.smithi066.stdout:2/917: creat d1/d44/df3/d12/d18/da8/f123 x:0 0 0 2024-09-12T22:49:59.167 INFO:tasks.workunit.client.0.smithi066.stdout:2/918: stat d1/dc1/lf9 0 2024-09-12T22:49:59.167 INFO:tasks.workunit.client.0.smithi066.stdout:2/919: write d1/d44/f4b [2672467,124110] 0 2024-09-12T22:49:59.169 INFO:tasks.workunit.client.0.smithi066.stdout:2/920: write d1/d11/d26/d4f/d5f/d61/d72/dad/df5/f10a [137707,130642] 0 2024-09-12T22:49:59.169 INFO:tasks.workunit.client.0.smithi066.stdout:2/921: fsync d1/d11/d26/d4f/fa5 0 2024-09-12T22:49:59.170 INFO:tasks.workunit.client.0.smithi066.stdout:2/922: mkdir d1/d11/d26/d4f/d5f/d61/d72/dad/df5/d124 0 2024-09-12T22:49:59.172 INFO:tasks.workunit.client.0.smithi066.stdout:7/852: dread d0/d6/d83/fa4 [0,4194304] 0 2024-09-12T22:49:59.173 INFO:tasks.workunit.client.0.smithi066.stdout:2/923: read d1/d11/f98 [2343222,39598] 0 2024-09-12T22:49:59.175 INFO:tasks.workunit.client.0.smithi066.stdout:2/924: mkdir d1/d44/df3/d12/de2/ded/d120/d125 0 2024-09-12T22:49:59.176 INFO:tasks.workunit.client.0.smithi066.stdout:7/853: dwrite d0/d19/d7f/fa2 [0,4194304] 0 2024-09-12T22:49:59.180 INFO:tasks.workunit.client.0.smithi066.stdout:3/991: truncate d0/d2/d1d/d87/f70 1622424 0 2024-09-12T22:49:59.180 INFO:tasks.workunit.client.0.smithi066.stdout:7/854: rmdir d0/d19/d26/d48/df1 39 2024-09-12T22:49:59.180 INFO:tasks.workunit.client.0.smithi066.stdout:2/925: write d1/d11/d26/d4f/d5f/d61/fe8 [1107269,92322] 0 2024-09-12T22:49:59.180 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:59.179+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:59.182 INFO:tasks.workunit.client.0.smithi066.stdout:7/855: rename d0/d19/d60/d53/lae to d0/d19/d24/d33/d27/dba/dc9/de5/l110 0 2024-09-12T22:49:59.183 INFO:tasks.workunit.client.0.smithi066.stdout:3/992: rename d0/d2/d1d/d87/d40/d44/d55/d91/dcb/f107 to d0/d2/d1d/d87/d40/d44/d55/d91/dcb/d14e/f153 0 2024-09-12T22:49:59.183 INFO:tasks.workunit.client.0.smithi066.stdout:9/912: dread d9/d31/d58/dbc/db6/d128/dd/f54 [0,4194304] 0 2024-09-12T22:49:59.184 INFO:tasks.workunit.client.0.smithi066.stdout:7/856: truncate d0/d19/d60/f51 4872300 0 2024-09-12T22:49:59.184 INFO:tasks.workunit.client.0.smithi066.stdout:3/993: creat d0/f154 x:0 0 0 2024-09-12T22:49:59.185 INFO:tasks.workunit.client.0.smithi066.stdout:7/857: stat d0/d19/d60/f3c 0 2024-09-12T22:49:59.186 INFO:tasks.workunit.client.0.smithi066.stdout:0/955: dread d1/d8/d1f/f45 [0,4194304] 0 2024-09-12T22:49:59.186 INFO:tasks.workunit.client.0.smithi066.stdout:2/926: dwrite d1/d11/d26/d4f/d5f/d61/d72/dad/df5/f114 [0,4194304] 0 2024-09-12T22:49:59.188 INFO:tasks.workunit.client.0.smithi066.stdout:2/927: chown d1/db/d42/c59 0 1 2024-09-12T22:49:59.189 INFO:tasks.workunit.client.0.smithi066.stdout:7/858: rename d0/d19/d74/l81 to d0/d19/d24/d33/l111 0 2024-09-12T22:49:59.189 INFO:tasks.workunit.client.0.smithi066.stdout:9/913: write d9/d31/d58/dbc/db6/d128/fe [3546147,59290] 0 2024-09-12T22:49:59.189 INFO:tasks.workunit.client.0.smithi066.stdout:2/928: mknod d1/d44/df3/d12/de2/d109/c126 0 2024-09-12T22:49:59.190 INFO:tasks.workunit.client.0.smithi066.stdout:8/947: dread d17/d49/f135 [0,4194304] 0 2024-09-12T22:49:59.191 INFO:tasks.workunit.client.0.smithi066.stdout:3/994: dwrite d0/d2/d1d/d87/d40/dd1/ff0 [0,4194304] 0 2024-09-12T22:49:59.193 INFO:tasks.workunit.client.0.smithi066.stdout:0/956: truncate d1/d8/d1b/d59/faf 4012941 0 2024-09-12T22:49:59.193 INFO:tasks.workunit.client.0.smithi066.stdout:7/859: mkdir d0/d19/d26/d48/df1/d112 0 2024-09-12T22:49:59.194 INFO:tasks.workunit.client.0.smithi066.stdout:8/948: getdents d17/d49/d4b/db5 0 2024-09-12T22:49:59.195 INFO:tasks.workunit.client.0.smithi066.stdout:2/929: dwrite d1/d11/f66 [0,4194304] 0 2024-09-12T22:49:59.195 INFO:tasks.workunit.client.0.smithi066.stdout:8/949: readlink d17/d40/d47/l105 0 2024-09-12T22:49:59.198 INFO:tasks.workunit.client.0.smithi066.stdout:8/950: creat d17/d1b/de7/d147/f148 x:0 0 0 2024-09-12T22:49:59.198 INFO:tasks.workunit.client.0.smithi066.stdout:3/995: dwrite d0/d2/d1d/d87/d40/dbd/d74/f86 [0,4194304] 0 2024-09-12T22:49:59.198 INFO:tasks.workunit.client.0.smithi066.stdout:9/914: dread d9/d31/d58/fbe [0,4194304] 0 2024-09-12T22:49:59.199 INFO:tasks.workunit.client.0.smithi066.stdout:5/983: dread d5/d11/d5d/d8a/fcb [0,4194304] 0 2024-09-12T22:49:59.199 INFO:tasks.workunit.client.0.smithi066.stdout:0/957: truncate d1/d8/df5/fee 4305351 0 2024-09-12T22:49:59.201 INFO:tasks.workunit.client.0.smithi066.stdout:9/915: write d9/df0/fb8 [2902611,47843] 0 2024-09-12T22:49:59.201 INFO:tasks.workunit.client.0.smithi066.stdout:8/951: write d17/d49/d4b/d57/d5e/d62/ff6 [552773,87395] 0 2024-09-12T22:49:59.202 INFO:tasks.workunit.client.0.smithi066.stdout:5/984: rename d5/d14/d114/c1e to d5/d15/c12c 0 2024-09-12T22:49:59.202 INFO:tasks.workunit.client.0.smithi066.stdout:8/952: write d17/d49/d4b/d57/fb9 [632321,21871] 0 2024-09-12T22:49:59.203 INFO:tasks.workunit.client.0.smithi066.stdout:9/916: symlink d9/d31/d58/dbc/db6/d128/dd2/l12f 0 2024-09-12T22:49:59.205 INFO:tasks.workunit.client.0.smithi066.stdout:9/917: mkdir d9/d31/d77/dc2/dcb/dea/d130 0 2024-09-12T22:49:59.205 INFO:tasks.workunit.client.0.smithi066.stdout:0/958: dwrite d1/d8/d1b/d59/fa1 [0,4194304] 0 2024-09-12T22:49:59.207 INFO:tasks.workunit.client.0.smithi066.stdout:0/959: symlink d1/d8/d1f/d30/l152 0 2024-09-12T22:49:59.208 INFO:tasks.workunit.client.0.smithi066.stdout:1/921: dread d0/d28/fc9 [0,4194304] 0 2024-09-12T22:49:59.208 INFO:tasks.workunit.client.0.smithi066.stdout:5/985: dwrite d5/d103/dc7/ff9 [0,4194304] 0 2024-09-12T22:49:59.210 INFO:tasks.workunit.client.0.smithi066.stdout:0/960: getdents d1/d36 0 2024-09-12T22:49:59.211 INFO:tasks.workunit.client.0.smithi066.stdout:0/961: chown d1/d8/d1f/d47 2123917436 1 2024-09-12T22:49:59.211 INFO:tasks.workunit.client.0.smithi066.stdout:8/953: truncate d17/d49/d4b/d57/d5e/d62/ff6 4137409 0 2024-09-12T22:49:59.212 INFO:tasks.workunit.client.0.smithi066.stdout:8/954: symlink d17/d2c/dab/df2/l149 0 2024-09-12T22:49:59.213 INFO:tasks.workunit.client.0.smithi066.stdout:9/918: dwrite d9/d31/d58/dbc/db6/d128/d23/f122 [0,4194304] 0 2024-09-12T22:49:59.213 INFO:tasks.workunit.client.0.smithi066.stdout:0/962: mknod d1/d8/d1b/d59/d107/c153 0 2024-09-12T22:49:59.213 INFO:tasks.workunit.client.0.smithi066.stdout:8/955: creat d17/d49/d4b/d4e/f14a x:0 0 0 2024-09-12T22:49:59.214 INFO:tasks.workunit.client.0.smithi066.stdout:9/919: rename d9/d31/d34/lae to d9/df0/l131 0 2024-09-12T22:49:59.215 INFO:tasks.workunit.client.0.smithi066.stdout:8/956: mkdir d17/d49/d14b 0 2024-09-12T22:49:59.216 INFO:tasks.workunit.client.0.smithi066.stdout:9/920: symlink d9/d31/d58/dbc/da8/l132 0 2024-09-12T22:49:59.218 INFO:tasks.workunit.client.0.smithi066.stdout:9/921: link d9/d31/d34/c85 d9/d31/d58/d7f/dc8/c133 0 2024-09-12T22:49:59.222 INFO:tasks.workunit.client.0.smithi066.stdout:9/922: dwrite d9/d31/d77/f91 [0,4194304] 0 2024-09-12T22:49:59.225 INFO:tasks.workunit.client.0.smithi066.stdout:9/923: unlink d9/d31/l106 0 2024-09-12T22:49:59.225 INFO:tasks.workunit.client.0.smithi066.stdout:3/996: dread d0/d2/d1d/d87/d40/d44/ff4 [0,4194304] 0 2024-09-12T22:49:59.226 INFO:tasks.workunit.client.0.smithi066.stdout:9/924: getdents d9/d31/d58/dbc 0 2024-09-12T22:49:59.226 INFO:tasks.workunit.client.0.smithi066.stdout:3/997: rmdir d0/d2/d1d/d87/d40/dff 39 2024-09-12T22:49:59.229 INFO:tasks.workunit.client.0.smithi066.stdout:7/860: dread d0/d19/d60/d53/f7c [0,4194304] 0 2024-09-12T22:49:59.229 INFO:tasks.workunit.client.0.smithi066.stdout:1/922: dread d0/d4e/f5a [0,4194304] 0 2024-09-12T22:49:59.230 INFO:tasks.workunit.client.0.smithi066.stdout:1/923: stat d0/ccd 0 2024-09-12T22:49:59.230 INFO:tasks.workunit.client.0.smithi066.stdout:7/861: creat d0/d19/d74/f113 x:0 0 0 2024-09-12T22:49:59.231 INFO:tasks.workunit.client.0.smithi066.stdout:1/924: chown d0/dea/df7/d9a/c121 168 1 2024-09-12T22:49:59.231 INFO:tasks.workunit.client.0.smithi066.stdout:3/998: dwrite d0/d2/d7/d13/f13b [0,4194304] 0 2024-09-12T22:49:59.231 INFO:tasks.workunit.client.0.smithi066.stdout:7/862: mknod d0/d19/d26/d5a/dc8/c114 0 2024-09-12T22:49:59.232 INFO:tasks.workunit.client.0.smithi066.stdout:1/925: write d0/d89/fe6 [207919,97883] 0 2024-09-12T22:49:59.233 INFO:tasks.workunit.client.0.smithi066.stdout:1/926: truncate d0/d89/dd7/f107 974598 0 2024-09-12T22:49:59.234 INFO:tasks.workunit.client.0.smithi066.stdout:1/927: dread - d0/d4e/d79/d86/d9c/f11e zero size 2024-09-12T22:49:59.235 INFO:tasks.workunit.client.0.smithi066.stdout:1/928: symlink d0/dc/d1e/d47/l125 0 2024-09-12T22:49:59.236 INFO:tasks.workunit.client.0.smithi066.stdout:1/929: write d0/d89/fa3 [1029615,100010] 0 2024-09-12T22:49:59.236 INFO:tasks.workunit.client.0.smithi066.stdout:3/999: truncate d0/d2/d1d/d87/d40/f4d 4166624 0 2024-09-12T22:49:59.237 INFO:tasks.workunit.client.0.smithi066.stdout:1/930: symlink d0/dc/deb/l126 0 2024-09-12T22:49:59.237 INFO:tasks.workunit.client.0.smithi066.stdout:0/963: dwrite d1/d36/d65/f9d [0,4194304] 0 2024-09-12T22:49:59.238 INFO:tasks.workunit.client.0.smithi066.stdout:0/964: write d1/d8/d1f/d47/ff0 [1040741,7812] 0 2024-09-12T22:49:59.239 INFO:tasks.workunit.client.0.smithi066.stdout:1/931: creat d0/d36/d8e/d116/f127 x:0 0 0 2024-09-12T22:49:59.239 INFO:tasks.workunit.client.0.smithi066.stdout:0/965: unlink d1/d8/d1c/d13/d2f/dd8/l1d 0 2024-09-12T22:49:59.240 INFO:tasks.workunit.client.0.smithi066.stdout:1/932: readlink d0/dc/d1e/l110 0 2024-09-12T22:49:59.241 INFO:tasks.workunit.client.0.smithi066.stdout:1/933: rename d0/lb6 to d0/d4e/d79/d86/l128 0 2024-09-12T22:49:59.242 INFO:tasks.workunit.client.0.smithi066.stdout:1/934: fsync d0/dc0/fef 0 2024-09-12T22:49:59.242 INFO:tasks.workunit.client.0.smithi066.stdout:1/935: stat d0/d89/l8c 0 2024-09-12T22:49:59.243 INFO:tasks.workunit.client.0.smithi066.stdout:1/936: unlink d0/d36/le9 0 2024-09-12T22:49:59.243 INFO:tasks.workunit.client.0.smithi066.stdout:2/930: sync 2024-09-12T22:49:59.243 INFO:tasks.workunit.client.0.smithi066.stdout:7/863: sync 2024-09-12T22:49:59.244 INFO:tasks.workunit.client.0.smithi066.stdout:0/966: dwrite d1/d8/d1f/f45 [0,4194304] 0 2024-09-12T22:49:59.244 INFO:tasks.workunit.client.0.smithi066.stdout:1/937: truncate d0/dc/fdb 301774 0 2024-09-12T22:49:59.245 INFO:tasks.workunit.client.0.smithi066.stdout:2/931: symlink d1/db/l127 0 2024-09-12T22:49:59.246 INFO:tasks.workunit.client.0.smithi066.stdout:2/932: unlink d1/d11/f98 0 2024-09-12T22:49:59.246 INFO:tasks.workunit.client.0.smithi066.stdout:7/864: dread d0/d19/d24/d33/f5b [0,4194304] 0 2024-09-12T22:49:59.246 INFO:tasks.workunit.client.0.smithi066.stdout:0/967: rename d1/d8/d1f/d25/d9c to d1/dbf/d102/d154 0 2024-09-12T22:49:59.247 INFO:tasks.workunit.client.0.smithi066.stdout:2/933: mknod d1/d44/df3/d68/dbc/d11b/c128 0 2024-09-12T22:49:59.247 INFO:tasks.workunit.client.0.smithi066.stdout:0/968: fsync d1/d8/d1c/d56/db7/f104 0 2024-09-12T22:49:59.247 INFO:tasks.workunit.client.0.smithi066.stdout:1/938: dread d0/dc/fdb [0,4194304] 0 2024-09-12T22:49:59.248 INFO:tasks.workunit.client.0.smithi066.stdout:0/969: read d1/f10 [2217989,75124] 0 2024-09-12T22:49:59.248 INFO:tasks.workunit.client.0.smithi066.stdout:8/957: dread d17/d40/d47/d4d/df0/f100 [0,4194304] 0 2024-09-12T22:49:59.249 INFO:tasks.workunit.client.0.smithi066.stdout:1/939: creat d0/dc/d8f/dd0/f129 x:0 0 0 2024-09-12T22:49:59.249 INFO:tasks.workunit.client.0.smithi066.stdout:7/865: mknod d0/d19/d24/d33/d27/dba/d105/c115 0 2024-09-12T22:49:59.249 INFO:tasks.workunit.client.0.smithi066.stdout:8/958: unlink d17/d49/d4b/db5/l137 0 2024-09-12T22:49:59.250 INFO:tasks.workunit.client.0.smithi066.stdout:0/970: read d1/d8/d1c/d13/d2f/f92 [73699,62206] 0 2024-09-12T22:49:59.250 INFO:tasks.workunit.client.0.smithi066.stdout:8/959: unlink d17/d49/f135 0 2024-09-12T22:49:59.251 INFO:tasks.workunit.client.0.smithi066.stdout:8/960: creat d17/d40/f14c x:0 0 0 2024-09-12T22:49:59.253 INFO:tasks.workunit.client.0.smithi066.stdout:8/961: symlink d17/d40/d47/d4d/d13c/l14d 0 2024-09-12T22:49:59.254 INFO:tasks.workunit.client.0.smithi066.stdout:1/940: dwrite d0/dc/d1d/f66 [4194304,4194304] 0 2024-09-12T22:49:59.254 INFO:tasks.workunit.client.0.smithi066.stdout:8/962: creat d17/d49/d4b/f14e x:0 0 0 2024-09-12T22:49:59.257 INFO:tasks.workunit.client.0.smithi066.stdout:1/941: rename d0/dc/cc5 to d0/dc/d1e/d119/c12a 0 2024-09-12T22:49:59.257 INFO:tasks.workunit.client.0.smithi066.stdout:8/963: mkdir d17/d49/d4b/d4e/daf/dcb/de2/d14f 0 2024-09-12T22:49:59.259 INFO:tasks.workunit.client.0.smithi066.stdout:8/964: write d17/f27 [632510,15982] 0 2024-09-12T22:49:59.259 INFO:tasks.workunit.client.0.smithi066.stdout:1/942: creat d0/dc/d1e/d95/df2/f12b x:0 0 0 2024-09-12T22:49:59.259 INFO:tasks.workunit.client.0.smithi066.stdout:9/925: dread d9/d31/d58/dbc/db6/d128/f6a [0,4194304] 0 2024-09-12T22:49:59.260 INFO:tasks.workunit.client.0.smithi066.stdout:2/934: read d1/d11/d26/d4f/d5f/d61/fe8 [184334,100940] 0 2024-09-12T22:49:59.260 INFO:tasks.workunit.client.0.smithi066.stdout:8/965: chown d17/d40/d47/d4d/fa0 810068 1 2024-09-12T22:49:59.260 INFO:tasks.workunit.client.0.smithi066.stdout:1/943: symlink d0/dc/d1e/d95/dcb/l12c 0 2024-09-12T22:49:59.261 INFO:tasks.workunit.client.0.smithi066.stdout:8/966: link d17/d49/d4b/d4e/f96 d17/f150 0 2024-09-12T22:49:59.263 INFO:tasks.workunit.client.0.smithi066.stdout:0/971: dread d1/d8/d1c/d13/d2f/dd8/f29 [0,4194304] 0 2024-09-12T22:49:59.263 INFO:tasks.workunit.client.0.smithi066.stdout:5/986: dread d5/d11/d21/d4d/fc2 [0,4194304] 0 2024-09-12T22:49:59.264 INFO:tasks.workunit.client.0.smithi066.stdout:1/944: truncate d0/d89/fa3 925646 0 2024-09-12T22:49:59.264 INFO:tasks.workunit.client.0.smithi066.stdout:8/967: link d17/d49/d4b/d4e/lb3 d17/d49/d4b/d4e/l151 0 2024-09-12T22:49:59.265 INFO:tasks.workunit.client.0.smithi066.stdout:0/972: creat d1/d36/d65/dc2/d14b/f155 x:0 0 0 2024-09-12T22:49:59.266 INFO:tasks.workunit.client.0.smithi066.stdout:9/926: dwrite d9/df0/fd3 [0,4194304] 0 2024-09-12T22:49:59.266 INFO:tasks.workunit.client.0.smithi066.stdout:5/987: creat d5/d11/d23/d6f/daa/dbb/dc6/f12d x:0 0 0 2024-09-12T22:49:59.266 INFO:tasks.workunit.client.0.smithi066.stdout:0/973: stat d1/d8/d1f/d30/c53 0 2024-09-12T22:49:59.267 INFO:tasks.workunit.client.0.smithi066.stdout:8/968: symlink d17/d40/d47/d4d/d87/l152 0 2024-09-12T22:49:59.269 INFO:tasks.workunit.client.0.smithi066.stdout:2/935: dwrite d1/d11/d26/d4f/d52/f93 [0,4194304] 0 2024-09-12T22:49:59.272 INFO:tasks.workunit.client.0.smithi066.stdout:7/866: dread d0/d19/d24/f6b [0,4194304] 0 2024-09-12T22:49:59.272 INFO:tasks.workunit.client.0.smithi066.stdout:0/974: getdents d1/d8/d1c/d13/d2f/d8a/de1 0 2024-09-12T22:49:59.273 INFO:tasks.workunit.client.0.smithi066.stdout:2/936: creat d1/d44/df3/d3d/f129 x:0 0 0 2024-09-12T22:49:59.274 INFO:tasks.workunit.client.0.smithi066.stdout:1/945: dwrite d0/dc/d1e/d47/f9b [0,4194304] 0 2024-09-12T22:49:59.275 INFO:tasks.workunit.client.0.smithi066.stdout:7/867: unlink d0/d19/d26/d5a/lbc 0 2024-09-12T22:49:59.275 INFO:tasks.workunit.client.0.smithi066.stdout:0/975: chown d1/d8/d1c/d13/f20 267698893 1 2024-09-12T22:49:59.275 INFO:tasks.workunit.client.0.smithi066.stdout:2/937: unlink d1/d11/d26/d4f/lbb 0 2024-09-12T22:49:59.276 INFO:tasks.workunit.client.0.smithi066.stdout:5/988: dwrite d5/d11/d23/d6f/daa/dbb/fe4 [0,4194304] 0 2024-09-12T22:49:59.277 INFO:tasks.workunit.client.0.smithi066.stdout:8/969: dwrite d17/d2c/dab/d117/f140 [0,4194304] 0 2024-09-12T22:49:59.277 INFO:tasks.workunit.client.0.smithi066.stdout:1/946: write d0/d36/d57/f3d [3143356,15826] 0 2024-09-12T22:49:59.278 INFO:tasks.workunit.client.0.smithi066.stdout:7/868: chown d0/d19/d60/d53/f67 21 1 2024-09-12T22:49:59.278 INFO:tasks.workunit.client.0.smithi066.stdout:8/970: write d17/d49/d4b/d57/fee [36412,23564] 0 2024-09-12T22:49:59.279 INFO:tasks.workunit.client.0.smithi066.stdout:5/989: mknod d5/d11/d23/d6f/c12e 0 2024-09-12T22:49:59.279 INFO:tasks.workunit.client.0.smithi066.stdout:7/869: symlink d0/d19/d74/l116 0 2024-09-12T22:49:59.280 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:59.280 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:59.281 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:59.279+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:59.281 INFO:tasks.workunit.client.0.smithi066.stdout:2/938: write d1/d44/df3/f63 [594619,110032] 0 2024-09-12T22:49:59.281 INFO:tasks.workunit.client.0.smithi066.stdout:1/947: rename d0/dc/d1e/d95/f6a to d0/d4e/d79/d86/f12d 0 2024-09-12T22:49:59.282 INFO:tasks.workunit.client.0.smithi066.stdout:2/939: stat d1/d44/df3/d12/d1e/c2f 0 2024-09-12T22:49:59.282 INFO:tasks.workunit.client.0.smithi066.stdout:2/940: fsync d1/d44/df3/f117 0 2024-09-12T22:49:59.283 INFO:tasks.workunit.client.0.smithi066.stdout:5/990: rename d5/d14/d114/d50/d42/c67 to d5/d11/d23/d6f/daa/dbb/dc6/c12f 0 2024-09-12T22:49:59.284 INFO:tasks.workunit.client.0.smithi066.stdout:0/976: dwrite d1/dbf/d102/f14c [0,4194304] 0 2024-09-12T22:49:59.284 INFO:tasks.workunit.client.0.smithi066.stdout:5/991: dread - d5/d11/d5d/d8a/fad zero size 2024-09-12T22:49:59.285 INFO:tasks.workunit.client.0.smithi066.stdout:2/941: write d1/d44/df3/d12/de2/ded/ffd [205034,86596] 0 2024-09-12T22:49:59.286 INFO:tasks.workunit.client.0.smithi066.stdout:2/942: fsync d1/d11/faf 0 2024-09-12T22:49:59.286 INFO:tasks.workunit.client.0.smithi066.stdout:1/948: dwrite d0/dc/d1d/fc4 [0,4194304] 0 2024-09-12T22:49:59.287 INFO:tasks.workunit.client.0.smithi066.stdout:8/971: write d17/d49/f8d [5171283,82710] 0 2024-09-12T22:49:59.288 INFO:tasks.workunit.client.0.smithi066.stdout:2/943: write d1/db/d42/d43/fbf [1768633,123420] 0 2024-09-12T22:49:59.289 INFO:tasks.workunit.client.0.smithi066.stdout:8/972: unlink d17/d40/dc4/cc9 0 2024-09-12T22:49:59.290 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:49:59.290 INFO:tasks.workunit.client.0.smithi066.stdout:8/973: creat d17/d1b/de7/f153 x:0 0 0 2024-09-12T22:49:59.290 INFO:tasks.workunit.client.0.smithi066.stdout:0/977: read d1/d36/d65/fb6 [78690,28272] 0 2024-09-12T22:49:59.290 INFO:tasks.workunit.client.0.smithi066.stdout:7/870: write d0/d19/d24/f107 [1928064,115653] 0 2024-09-12T22:49:59.292 INFO:tasks.workunit.client.0.smithi066.stdout:0/978: creat d1/dbf/d117/f156 x:0 0 0 2024-09-12T22:49:59.293 INFO:tasks.workunit.client.0.smithi066.stdout:5/992: dwrite d5/d11/d23/d6f/daa/dbb/dc6/de1/fa1 [4194304,4194304] 0 2024-09-12T22:49:59.293 INFO:tasks.workunit.client.0.smithi066.stdout:1/949: dwrite d0/dc/d1e/d47/d6f/f112 [0,4194304] 0 2024-09-12T22:49:59.294 INFO:tasks.workunit.client.0.smithi066.stdout:5/993: stat d5/d11/d23/f108 0 2024-09-12T22:49:59.294 INFO:tasks.workunit.client.0.smithi066.stdout:0/979: readlink d1/d8/d1c/d13/d2f/dd8/l61 0 2024-09-12T22:49:59.294 INFO:tasks.workunit.client.0.smithi066.stdout:8/974: read d17/d40/da8/f113 [553583,105433] 0 2024-09-12T22:49:59.295 INFO:tasks.workunit.client.0.smithi066.stdout:7/871: unlink d0/d19/d24/d33/l63 0 2024-09-12T22:49:59.295 INFO:tasks.workunit.client.0.smithi066.stdout:8/975: chown d17/d1b/cbf 0 1 2024-09-12T22:49:59.295 INFO:tasks.workunit.client.0.smithi066.stdout:1/950: creat d0/dea/f12e x:0 0 0 2024-09-12T22:49:59.295 INFO:tasks.workunit.client.0.smithi066.stdout:5/994: creat d5/d15/db9/f130 x:0 0 0 2024-09-12T22:49:59.295 INFO:tasks.workunit.client.0.smithi066.stdout:8/976: stat f15 0 2024-09-12T22:49:59.296 INFO:tasks.workunit.client.0.smithi066.stdout:0/980: link d1/d8/d1f/d47/l99 d1/d8/d1c/d56/l157 0 2024-09-12T22:49:59.296 INFO:tasks.workunit.client.0.smithi066.stdout:7/872: write d0/d6/f21 [2557949,112007] 0 2024-09-12T22:49:59.297 INFO:tasks.workunit.client.0.smithi066.stdout:0/981: fdatasync d1/d36/d65/dc2/dd7/f10c 0 2024-09-12T22:49:59.297 INFO:tasks.workunit.client.0.smithi066.stdout:7/873: chown d0/d19/d24/d33/d27/dba/dc9 220773930 1 2024-09-12T22:49:59.298 INFO:tasks.workunit.client.0.smithi066.stdout:1/951: unlink d0/d4e/d79/d86/d9c/laa 0 2024-09-12T22:49:59.299 INFO:tasks.workunit.client.0.smithi066.stdout:8/977: write d17/d1b/f9f [465107,84737] 0 2024-09-12T22:49:59.299 INFO:tasks.workunit.client.0.smithi066.stdout:7/874: creat d0/d19/d24/d100/f117 x:0 0 0 2024-09-12T22:49:59.299 INFO:tasks.workunit.client.0.smithi066.stdout:1/952: unlink d0/dc/d1d/l8d 0 2024-09-12T22:49:59.300 INFO:tasks.workunit.client.0.smithi066.stdout:5/995: dwrite d5/f12 [0,4194304] 0 2024-09-12T22:49:59.300 INFO:tasks.workunit.client.0.smithi066.stdout:0/982: link d1/d8/d1c/d56/db8/f139 d1/d8/d1b/d59/d107/f158 0 2024-09-12T22:49:59.301 INFO:tasks.workunit.client.0.smithi066.stdout:7/875: mkdir d0/d19/d24/d33/d27/d70/d90/db8/d118 0 2024-09-12T22:49:59.301 INFO:tasks.workunit.client.0.smithi066.stdout:8/978: rename d17/d49/d4b/d4e/l5b to d17/d49/d4b/d57/d5e/d65/d91/l154 0 2024-09-12T22:49:59.301 INFO:tasks.workunit.client.0.smithi066.stdout:0/983: chown d1/d8/d1f/d47/leb 2714 1 2024-09-12T22:49:59.304 INFO:tasks.workunit.client.0.smithi066.stdout:1/953: truncate d0/dc/d1d/fc4 1787048 0 2024-09-12T22:49:59.304 INFO:tasks.workunit.client.0.smithi066.stdout:0/984: creat d1/d36/d65/dc2/f159 x:0 0 0 2024-09-12T22:49:59.305 INFO:tasks.workunit.client.0.smithi066.stdout:7/876: write d0/d19/d26/d48/d84/f91 [4037174,117277] 0 2024-09-12T22:49:59.305 INFO:tasks.workunit.client.0.smithi066.stdout:0/985: fsync d1/d8/d1f/f7b 0 2024-09-12T22:49:59.306 INFO:tasks.workunit.client.0.smithi066.stdout:7/877: stat d0/d19/d24/d33/d27/f35 0 2024-09-12T22:49:59.306 INFO:tasks.workunit.client.0.smithi066.stdout:1/954: mkdir d0/dc/d44/d12f 0 2024-09-12T22:49:59.306 INFO:tasks.workunit.client.0.smithi066.stdout:0/986: unlink d1/d8/d1c/d13/f20 0 2024-09-12T22:49:59.307 INFO:tasks.workunit.client.0.smithi066.stdout:8/979: truncate d17/d2c/f35 1914862 0 2024-09-12T22:49:59.308 INFO:tasks.workunit.client.0.smithi066.stdout:7/878: readlink d0/d19/d24/d33/d27/dba/ldb 0 2024-09-12T22:49:59.308 INFO:tasks.workunit.client.0.smithi066.stdout:5/996: dwrite d5/d11/d21/fb0 [4194304,4194304] 0 2024-09-12T22:49:59.310 INFO:tasks.workunit.client.0.smithi066.stdout:2/944: dread d1/d44/df3/d12/d67/f6a [0,4194304] 0 2024-09-12T22:49:59.310 INFO:tasks.workunit.client.0.smithi066.stdout:9/927: dread d9/d31/d58/fc1 [0,4194304] 0 2024-09-12T22:49:59.311 INFO:tasks.workunit.client.0.smithi066.stdout:0/987: link d1/d5b/l5f d1/d8/d1b/d88/l15a 0 2024-09-12T22:49:59.311 INFO:tasks.workunit.client.0.smithi066.stdout:8/980: rename d17/d49/f8d to d17/d40/d47/f155 0 2024-09-12T22:49:59.311 INFO:tasks.workunit.client.0.smithi066.stdout:7/879: mknod d0/d19/d24/d33/d27/d70/c119 0 2024-09-12T22:49:59.312 INFO:tasks.workunit.client.0.smithi066.stdout:7/880: creat d0/d86/f11a x:0 0 0 2024-09-12T22:49:59.312 INFO:tasks.workunit.client.0.smithi066.stdout:9/928: fdatasync d9/d31/d58/dbc/da8/fda 0 2024-09-12T22:49:59.312 INFO:tasks.workunit.client.0.smithi066.stdout:2/945: creat d1/d44/df3/f12a x:0 0 0 2024-09-12T22:49:59.312 INFO:tasks.workunit.client.0.smithi066.stdout:8/981: mkdir d17/d40/d47/d4d/d156 0 2024-09-12T22:49:59.313 INFO:tasks.workunit.client.0.smithi066.stdout:9/929: write d9/df0/fb8 [678977,118060] 0 2024-09-12T22:49:59.313 INFO:tasks.workunit.client.0.smithi066.stdout:8/982: chown d17/d40/d47/d4d/d13c/l14d 872571 1 2024-09-12T22:49:59.315 INFO:tasks.workunit.client.0.smithi066.stdout:9/930: write d9/d31/d58/dbc/da8/ff9 [1007964,96473] 0 2024-09-12T22:49:59.315 INFO:tasks.workunit.client.0.smithi066.stdout:8/983: truncate d17/d49/d4b/d57/fcc 1005612 0 2024-09-12T22:49:59.316 INFO:tasks.workunit.client.0.smithi066.stdout:8/984: fdatasync d17/d40/f4c 0 2024-09-12T22:49:59.316 INFO:tasks.workunit.client.0.smithi066.stdout:5/997: read d5/d11/d23/d6f/dee/ff1 [2265095,120366] 0 2024-09-12T22:49:59.317 INFO:tasks.workunit.client.0.smithi066.stdout:7/881: dwrite d0/d19/d24/d100/f10f [0,4194304] 0 2024-09-12T22:49:59.317 INFO:tasks.workunit.client.0.smithi066.stdout:0/988: read d1/d8/fec [930313,52434] 0 2024-09-12T22:49:59.317 INFO:tasks.workunit.client.0.smithi066.stdout:9/931: write d9/d31/d58/dbc/db6/d128/d23/f83 [5005189,80089] 0 2024-09-12T22:49:59.319 INFO:tasks.workunit.client.0.smithi066.stdout:2/946: dwrite d1/d11/d26/d4f/d5f/d61/d7e/f64 [0,4194304] 0 2024-09-12T22:49:59.319 INFO:tasks.workunit.client.0.smithi066.stdout:7/882: fsync d0/d19/d26/d48/d59/f7b 0 2024-09-12T22:49:59.319 INFO:tasks.workunit.client.0.smithi066.stdout:9/932: fsync d9/d31/d77/dc2/dcb/fde 0 2024-09-12T22:49:59.320 INFO:tasks.workunit.client.0.smithi066.stdout:9/933: fsync d9/dc6/fa2 0 2024-09-12T22:49:59.320 INFO:tasks.workunit.client.0.smithi066.stdout:7/883: write d0/d19/d60/d53/fcf [685655,37235] 0 2024-09-12T22:49:59.322 INFO:tasks.workunit.client.0.smithi066.stdout:2/947: write d1/d11/d26/d4f/d5f/d61/d72/dad/df5/f114 [2575394,29902] 0 2024-09-12T22:49:59.322 INFO:tasks.workunit.client.0.smithi066.stdout:9/934: getdents d9/d31/d58/dbc/db6 0 2024-09-12T22:49:59.323 INFO:tasks.workunit.client.0.smithi066.stdout:2/948: truncate d1/f3 510721 0 2024-09-12T22:49:59.324 INFO:tasks.workunit.client.0.smithi066.stdout:2/949: write d1/d11/d26/d4f/d7c/fbe [928660,29243] 0 2024-09-12T22:49:59.326 INFO:tasks.workunit.client.0.smithi066.stdout:2/950: creat d1/d44/df3/d68/f12b x:0 0 0 2024-09-12T22:49:59.326 INFO:tasks.workunit.client.0.smithi066.stdout:7/884: dwrite d0/d19/d26/d5a/f61 [0,4194304] 0 2024-09-12T22:49:59.333 INFO:tasks.workunit.client.0.smithi066.stdout:5/998: dread d5/d11/d21/d4d/fa3 [0,4194304] 0 2024-09-12T22:49:59.334 INFO:tasks.workunit.client.0.smithi066.stdout:5/999: symlink d5/d11/d5d/l131 0 2024-09-12T22:49:59.334 INFO:tasks.workunit.client.0.smithi066.stdout:7/885: dread d0/d19/d24/fa0 [0,4194304] 0 2024-09-12T22:49:59.335 INFO:tasks.workunit.client.0.smithi066.stdout:7/886: unlink d0/d19/d24/f12 0 2024-09-12T22:49:59.344 INFO:tasks.workunit.client.0.smithi066.stdout:7/887: mknod d0/d19/d24/d100/c11b 0 2024-09-12T22:49:59.344 INFO:tasks.workunit.client.0.smithi066.stdout:8/985: dread d17/d49/d4b/d4e/f96 [0,4194304] 0 2024-09-12T22:49:59.344 INFO:tasks.workunit.client.0.smithi066.stdout:8/986: mknod d17/d49/d4b/d57/c157 0 2024-09-12T22:49:59.344 INFO:tasks.workunit.client.0.smithi066.stdout:7/888: truncate d0/d19/d24/d100/f10f 286570 0 2024-09-12T22:49:59.345 INFO:tasks.workunit.client.0.smithi066.stdout:8/987: rename d17/d40/la1 to d17/d40/d47/dde/l158 0 2024-09-12T22:49:59.345 INFO:tasks.workunit.client.0.smithi066.stdout:9/935: dread d9/d31/d58/dbc/db6/d128/d23/f30 [0,4194304] 0 2024-09-12T22:49:59.345 INFO:tasks.workunit.client.0.smithi066.stdout:8/988: readlink d17/d40/d74/d99/l9a 0 2024-09-12T22:49:59.345 INFO:tasks.workunit.client.0.smithi066.stdout:9/936: chown d9/df0/d8c/de2/d107/f117 61 1 2024-09-12T22:49:59.346 INFO:tasks.workunit.client.0.smithi066.stdout:9/937: creat d9/d31/d58/dbc/da8/f134 x:0 0 0 2024-09-12T22:49:59.348 INFO:tasks.workunit.client.0.smithi066.stdout:9/938: write d9/d31/d58/dbc/db6/d128/fe [1293442,68134] 0 2024-09-12T22:49:59.349 INFO:tasks.workunit.client.0.smithi066.stdout:7/889: dwrite d0/d19/d60/d85/d8b/f9c [0,4194304] 0 2024-09-12T22:49:59.350 INFO:tasks.workunit.client.0.smithi066.stdout:8/989: dwrite d17/d49/f134 [0,4194304] 0 2024-09-12T22:49:59.351 INFO:tasks.workunit.client.0.smithi066.stdout:1/955: dread d0/d4e/d79/d86/f92 [0,4194304] 0 2024-09-12T22:49:59.351 INFO:tasks.workunit.client.0.smithi066.stdout:2/951: sync 2024-09-12T22:49:59.351 INFO:tasks.workunit.client.0.smithi066.stdout:9/939: dread d9/d31/d58/dbc/db6/d128/d23/f30 [0,4194304] 0 2024-09-12T22:49:59.352 INFO:tasks.workunit.client.0.smithi066.stdout:8/990: creat d17/d49/d4b/f159 x:0 0 0 2024-09-12T22:49:59.353 INFO:tasks.workunit.client.0.smithi066.stdout:8/991: write d17/d1b/fd5 [1714402,19716] 0 2024-09-12T22:49:59.354 INFO:tasks.workunit.client.0.smithi066.stdout:7/890: rename d0/d6/c3d to d0/c11c 0 2024-09-12T22:49:59.354 INFO:tasks.workunit.client.0.smithi066.stdout:2/952: mknod d1/d11/d26/d4f/d5f/d61/d72/dad/df5/d118/c12c 0 2024-09-12T22:49:59.354 INFO:tasks.workunit.client.0.smithi066.stdout:1/956: getdents d0/d36/d8e/d116 0 2024-09-12T22:49:59.354 INFO:tasks.workunit.client.0.smithi066.stdout:7/891: read - d0/d86/fb7 zero size 2024-09-12T22:49:59.356 INFO:tasks.workunit.client.0.smithi066.stdout:9/940: rename d9/d31/d77/dc2/dcb/f6b to d9/d31/d58/dbc/db6/d128/f135 0 2024-09-12T22:49:59.356 INFO:tasks.workunit.client.0.smithi066.stdout:8/992: write d17/d49/d4b/d57/d5e/d62/f143 [36685,81251] 0 2024-09-12T22:49:59.356 INFO:tasks.workunit.client.0.smithi066.stdout:2/953: mknod d1/d44/df3/d3d/c12d 0 2024-09-12T22:49:59.357 INFO:tasks.workunit.client.0.smithi066.stdout:1/957: truncate d0/d4e/d79/f9d 1730931 0 2024-09-12T22:49:59.358 INFO:tasks.workunit.client.0.smithi066.stdout:7/892: truncate d0/d19/d24/d33/d27/d70/d90/db8/f10b 936013 0 2024-09-12T22:49:59.358 INFO:tasks.workunit.client.0.smithi066.stdout:8/993: creat d17/d40/d74/da3/dac/f15a x:0 0 0 2024-09-12T22:49:59.358 INFO:tasks.workunit.client.0.smithi066.stdout:1/958: write d0/d36/d57/f70 [4135047,77203] 0 2024-09-12T22:49:59.358 INFO:tasks.workunit.client.0.smithi066.stdout:2/954: truncate d1/d11/d26/d4f/d5f/d61/d7e/f64 4459760 0 2024-09-12T22:49:59.359 INFO:tasks.workunit.client.0.smithi066.stdout:1/959: mkdir d0/dc/d1e/d95/d130 0 2024-09-12T22:49:59.359 INFO:tasks.workunit.client.0.smithi066.stdout:7/893: symlink d0/d19/d24/d33/d27/d70/l11d 0 2024-09-12T22:49:59.360 INFO:tasks.workunit.client.0.smithi066.stdout:9/941: dwrite d9/f32 [0,4194304] 0 2024-09-12T22:49:59.360 INFO:tasks.workunit.client.0.smithi066.stdout:8/994: truncate d17/d40/d47/d4d/df0/df3/f107 262938 0 2024-09-12T22:49:59.360 INFO:tasks.workunit.client.0.smithi066.stdout:1/960: rmdir d0/d89/dd7 39 2024-09-12T22:49:59.361 INFO:tasks.workunit.client.0.smithi066.stdout:2/955: sync 2024-09-12T22:49:59.364 INFO:tasks.workunit.client.0.smithi066.stdout:9/942: sync 2024-09-12T22:49:59.364 INFO:tasks.workunit.client.0.smithi066.stdout:1/961: unlink d0/d28/l37 0 2024-09-12T22:49:59.366 INFO:tasks.workunit.client.0.smithi066.stdout:8/995: mknod d17/d40/d74/da3/d11c/c15b 0 2024-09-12T22:49:59.366 INFO:tasks.workunit.client.0.smithi066.stdout:2/956: chown d1/d44/df3/d12/d1e/cee 16348635 1 2024-09-12T22:49:59.366 INFO:tasks.workunit.client.0.smithi066.stdout:9/943: chown d9/d31/d58/dbc/led 2 1 2024-09-12T22:49:59.366 INFO:tasks.workunit.client.0.smithi066.stdout:1/962: mkdir d0/dc/d99/d131 0 2024-09-12T22:49:59.366 INFO:tasks.workunit.client.0.smithi066.stdout:7/894: link d0/d19/d26/d5a/lf0 d0/d19/d24/d33/d27/dba/l11e 0 2024-09-12T22:49:59.367 INFO:tasks.workunit.client.0.smithi066.stdout:2/957: write d1/d44/df3/f12a [654244,14309] 0 2024-09-12T22:49:59.367 INFO:tasks.workunit.client.0.smithi066.stdout:9/944: mkdir d9/d31/d136 0 2024-09-12T22:49:59.367 INFO:tasks.workunit.client.0.smithi066.stdout:8/996: dread d17/d40/da8/fb1 [0,4194304] 0 2024-09-12T22:49:59.367 INFO:tasks.workunit.client.0.smithi066.stdout:2/958: fsync d1/d11/d26/d4f/d5f/d61/fe8 0 2024-09-12T22:49:59.367 INFO:tasks.workunit.client.0.smithi066.stdout:7/895: symlink d0/d19/d24/d33/d27/dba/dc9/de5/df8/l11f 0 2024-09-12T22:49:59.367 INFO:tasks.workunit.client.0.smithi066.stdout:8/997: mknod d17/d49/d4b/d57/d5e/d62/d109/c15c 0 2024-09-12T22:49:59.367 INFO:tasks.workunit.client.0.smithi066.stdout:9/945: write d9/d31/d58/dbc/db6/d128/d46/d8a/f97 [4501176,128051] 0 2024-09-12T22:49:59.367 INFO:tasks.workunit.client.0.smithi066.stdout:2/959: symlink d1/dc1/l12e 0 2024-09-12T22:49:59.367 INFO:tasks.workunit.client.0.smithi066.stdout:7/896: fdatasync d0/d19/d26/f47 0 2024-09-12T22:49:59.367 INFO:tasks.workunit.client.0.smithi066.stdout:2/960: chown d1/db/dd9 32 1 2024-09-12T22:49:59.367 INFO:tasks.workunit.client.0.smithi066.stdout:7/897: chown d0/f54 273460 1 2024-09-12T22:49:59.367 INFO:tasks.workunit.client.0.smithi066.stdout:8/998: readlink d17/d40/d47/d4d/ld3 0 2024-09-12T22:49:59.368 INFO:tasks.workunit.client.0.smithi066.stdout:2/961: mknod d1/db/c12f 0 2024-09-12T22:49:59.368 INFO:tasks.workunit.client.0.smithi066.stdout:7/898: fsync d0/d19/d24/d33/d27/dba/dc9/de5/df8/f10c 0 2024-09-12T22:49:59.368 INFO:tasks.workunit.client.0.smithi066.stdout:0/989: dread d1/d8/df5/fee [0,4194304] 0 2024-09-12T22:49:59.369 INFO:tasks.workunit.client.0.smithi066.stdout:7/899: write d0/d19/d7f/fa2 [345708,34939] 0 2024-09-12T22:49:59.369 INFO:tasks.workunit.client.0.smithi066.stdout:0/990: fdatasync d1/d8/df5/fee 0 2024-09-12T22:49:59.369 INFO:tasks.workunit.client.0.smithi066.stdout:2/962: write d1/d11/d26/d4f/d5f/d61/d72/ff6 [2295226,9889] 0 2024-09-12T22:49:59.370 INFO:tasks.workunit.client.0.smithi066.stdout:0/991: mknod d1/dbf/d102/d11d/c15b 0 2024-09-12T22:49:59.370 INFO:tasks.workunit.client.0.smithi066.stdout:9/946: dwrite d9/d31/d58/dbc/fdf [0,4194304] 0 2024-09-12T22:49:59.370 INFO:tasks.workunit.client.0.smithi066.stdout:2/963: readlink d1/db/d42/d43/l7b 0 2024-09-12T22:49:59.371 INFO:tasks.workunit.client.0.smithi066.stdout:2/964: readlink d1/dc1/lf9 0 2024-09-12T22:49:59.371 INFO:tasks.workunit.client.0.smithi066.stdout:0/992: chown d1/d36/f8e 168 1 2024-09-12T22:49:59.371 INFO:tasks.workunit.client.0.smithi066.stdout:2/965: sync 2024-09-12T22:49:59.371 INFO:tasks.workunit.client.0.smithi066.stdout:2/966: fdatasync d1/dc1/ff0 0 2024-09-12T22:49:59.372 INFO:tasks.workunit.client.0.smithi066.stdout:9/947: symlink d9/d31/d58/dbc/db6/d128/de9/l137 0 2024-09-12T22:49:59.372 INFO:tasks.workunit.client.0.smithi066.stdout:0/993: symlink d1/dbf/d102/d12d/d141/l15c 0 2024-09-12T22:49:59.373 INFO:tasks.workunit.client.0.smithi066.stdout:9/948: chown d9/d31/d34/f37 53307 1 2024-09-12T22:49:59.373 INFO:tasks.workunit.client.0.smithi066.stdout:0/994: write d1/d8/d1c/d56/fe8 [657833,108693] 0 2024-09-12T22:49:59.374 INFO:tasks.workunit.client.0.smithi066.stdout:2/967: creat d1/d11/d26/d4f/d5f/d61/d72/dad/df5/d118/f130 x:0 0 0 2024-09-12T22:49:59.375 INFO:tasks.workunit.client.0.smithi066.stdout:9/949: creat d9/d31/d34/f138 x:0 0 0 2024-09-12T22:49:59.375 INFO:tasks.workunit.client.0.smithi066.stdout:7/900: dwrite d0/d19/d26/d48/d59/fe9 [0,4194304] 0 2024-09-12T22:49:59.375 INFO:tasks.workunit.client.0.smithi066.stdout:1/963: truncate d0/dc/d1e/d95/f43 2265067 0 2024-09-12T22:49:59.377 INFO:tasks.workunit.client.0.smithi066.stdout:0/995: creat d1/dbf/d135/d14d/f15d x:0 0 0 2024-09-12T22:49:59.377 INFO:tasks.workunit.client.0.smithi066.stdout:9/950: truncate d9/df0/d8c/de2/d107/f117 768726 0 2024-09-12T22:49:59.377 INFO:tasks.workunit.client.0.smithi066.stdout:8/999: write d17/d40/da8/fb1 [1099537,43398] 0 2024-09-12T22:49:59.377 INFO:tasks.workunit.client.0.smithi066.stdout:1/964: symlink d0/d36/d8e/l132 0 2024-09-12T22:49:59.377 INFO:tasks.workunit.client.0.smithi066.stdout:2/968: creat d1/d11/d26/d4f/d5f/d61/d72/dad/d76/db7/f131 x:0 0 0 2024-09-12T22:49:59.377 INFO:tasks.workunit.client.0.smithi066.stdout:7/901: rename d0/d19/d7f to d0/d19/d120 0 2024-09-12T22:49:59.377 INFO:tasks.workunit.client.0.smithi066.stdout:2/969: readlink d1/d44/df3/d12/d1e/l9b 0 2024-09-12T22:49:59.378 INFO:tasks.workunit.client.0.smithi066.stdout:9/951: write d9/d31/d58/dbc/db6/d128/dd/f54 [1254572,112847] 0 2024-09-12T22:49:59.378 INFO:tasks.workunit.client.0.smithi066.stdout:1/965: write d0/dc/d1e/d95/dcb/fd3 [2402275,122200] 0 2024-09-12T22:49:59.379 INFO:tasks.workunit.client.0.smithi066.stdout:1/966: sync 2024-09-12T22:49:59.379 INFO:tasks.workunit.client.0.smithi066.stdout:2/970: read - d1/d11/d26/d8f/f10e zero size 2024-09-12T22:49:59.379 INFO:tasks.workunit.client.0.smithi066.stdout:7/902: mknod d0/d19/d26/d5a/c121 0 2024-09-12T22:49:59.380 INFO:tasks.workunit.client.0.smithi066.stdout:9/952: mknod d9/d31/db0/d104/c139 0 2024-09-12T22:49:59.381 INFO:tasks.workunit.client.0.smithi066.stdout:7/903: creat d0/d19/d26/d48/f122 x:0 0 0 2024-09-12T22:49:59.381 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:59.380+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:59.381 INFO:tasks.workunit.client.0.smithi066.stdout:1/967: read d0/d36/d57/d81/fbf [685718,110973] 0 2024-09-12T22:49:59.382 INFO:tasks.workunit.client.0.smithi066.stdout:9/953: unlink d9/d31/d58/dbc/db6/d128/d46/f67 0 2024-09-12T22:49:59.382 INFO:tasks.workunit.client.0.smithi066.stdout:9/954: sync 2024-09-12T22:49:59.382 INFO:tasks.workunit.client.0.smithi066.stdout:7/904: creat d0/d19/d24/d33/d27/dba/dc9/df6/f123 x:0 0 0 2024-09-12T22:49:59.383 INFO:tasks.workunit.client.0.smithi066.stdout:1/968: truncate d0/dc/fb5 1141135 0 2024-09-12T22:49:59.383 INFO:tasks.workunit.client.0.smithi066.stdout:0/996: dwrite d1/d8/f62 [0,4194304] 0 2024-09-12T22:49:59.384 INFO:tasks.workunit.client.0.smithi066.stdout:0/997: write d1/fbe [65831,34432] 0 2024-09-12T22:49:59.385 INFO:tasks.workunit.client.0.smithi066.stdout:0/998: chown d1/d8/d1f/d30/lf9 599918485 1 2024-09-12T22:49:59.386 INFO:tasks.workunit.client.0.smithi066.stdout:7/905: creat d0/d19/d26/dbe/f124 x:0 0 0 2024-09-12T22:49:59.387 INFO:tasks.workunit.client.0.smithi066.stdout:9/955: dwrite d9/d31/d58/dbc/db6/d128/fe [0,4194304] 0 2024-09-12T22:49:59.388 INFO:tasks.workunit.client.0.smithi066.stdout:7/906: truncate d0/d19/d60/d85/d8b/fb0 4858549 0 2024-09-12T22:49:59.389 INFO:tasks.workunit.client.0.smithi066.stdout:2/971: truncate d1/d11/d26/d4f/d5f/d61/d7e/f48 293952 0 2024-09-12T22:49:59.390 INFO:tasks.workunit.client.0.smithi066.stdout:0/999: truncate d1/d8/d1c/fb3 1141075 0 2024-09-12T22:49:59.390 INFO:tasks.workunit.client.0.smithi066.stdout:9/956: mkdir d9/d13a 0 2024-09-12T22:49:59.390 INFO:tasks.workunit.client.0.smithi066.stdout:7/907: creat d0/d19/d24/d33/d27/dba/f125 x:0 0 0 2024-09-12T22:49:59.390 INFO:tasks.workunit.client.0.smithi066.stdout:2/972: creat d1/d11/d26/d4f/d7c/d122/f132 x:0 0 0 2024-09-12T22:49:59.391 INFO:tasks.workunit.client.0.smithi066.stdout:9/957: link d9/d31/d58/dbc/f100 d9/d13a/f13b 0 2024-09-12T22:49:59.392 INFO:tasks.workunit.client.0.smithi066.stdout:2/973: rmdir d1/d11/d26/d4f/d52/d56/dc8 0 2024-09-12T22:49:59.392 INFO:tasks.workunit.client.0.smithi066.stdout:7/908: getdents d0/d19/d26/d5a/dc8 0 2024-09-12T22:49:59.392 INFO:tasks.workunit.client.0.smithi066.stdout:9/958: mknod d9/d31/c13c 0 2024-09-12T22:49:59.393 INFO:tasks.workunit.client.0.smithi066.stdout:9/959: readlink d9/dc6/df6/l110 0 2024-09-12T22:49:59.393 INFO:tasks.workunit.client.0.smithi066.stdout:7/909: chown d0/d19/d24/d33/d27/d70/d90/fa5 146 1 2024-09-12T22:49:59.393 INFO:tasks.workunit.client.0.smithi066.stdout:2/974: truncate d1/d11/d26/d4f/d52/f93 5070953 0 2024-09-12T22:49:59.394 INFO:tasks.workunit.client.0.smithi066.stdout:9/960: getdents d9/d31/d58/da4 0 2024-09-12T22:49:59.394 INFO:tasks.workunit.client.0.smithi066.stdout:2/975: symlink d1/d44/df3/d12/dd1/l133 0 2024-09-12T22:49:59.395 INFO:tasks.workunit.client.0.smithi066.stdout:2/976: creat d1/d11/d26/d4f/d52/f134 x:0 0 0 2024-09-12T22:49:59.395 INFO:tasks.workunit.client.0.smithi066.stdout:9/961: chown d9/d31/d58/dbc/db6/d128/c3a 40268964 1 2024-09-12T22:49:59.397 INFO:tasks.workunit.client.0.smithi066.stdout:2/977: rmdir d1/d11/d26/d4f/d5f/d61/d72/dad/df5 39 2024-09-12T22:49:59.397 INFO:tasks.workunit.client.0.smithi066.stdout:7/910: dwrite d0/d19/d24/fc5 [0,4194304] 0 2024-09-12T22:49:59.398 INFO:tasks.workunit.client.0.smithi066.stdout:7/911: chown d0/d19/d26/l2b 573 1 2024-09-12T22:49:59.399 INFO:tasks.workunit.client.0.smithi066.stdout:2/978: truncate d1/f3 1136991 0 2024-09-12T22:49:59.400 INFO:tasks.workunit.client.0.smithi066.stdout:9/962: dwrite f7 [4194304,4194304] 0 2024-09-12T22:49:59.402 INFO:tasks.workunit.client.0.smithi066.stdout:9/963: chown d9/d31/d58/dbc/db6/d128/d23/fac 71376850 1 2024-09-12T22:49:59.402 INFO:tasks.workunit.client.0.smithi066.stdout:9/964: chown d9/d31/d58/de4 5 1 2024-09-12T22:49:59.404 INFO:tasks.workunit.client.0.smithi066.stdout:2/979: dwrite d1/d11/d26/f107 [0,4194304] 0 2024-09-12T22:49:59.406 INFO:tasks.workunit.client.0.smithi066.stdout:2/980: unlink d1/d11/lb6 0 2024-09-12T22:49:59.407 INFO:tasks.workunit.client.0.smithi066.stdout:2/981: symlink d1/d44/df3/l135 0 2024-09-12T22:49:59.408 INFO:tasks.workunit.client.0.smithi066.stdout:9/965: truncate d9/df0/d8c/de2/d107/f117 68343 0 2024-09-12T22:49:59.408 INFO:tasks.workunit.client.0.smithi066.stdout:9/966: chown d9/d31/d58/da4 50606 1 2024-09-12T22:49:59.409 INFO:tasks.workunit.client.0.smithi066.stdout:9/967: write d9/f87 [355028,4521] 0 2024-09-12T22:49:59.411 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:59.411 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:59.412 INFO:tasks.workunit.client.0.smithi066.stdout:9/968: rename d9/d31/d58/dbc/d9d/lcc to d9/d31/d58/dbc/da8/l13d 0 2024-09-12T22:49:59.412 INFO:tasks.workunit.client.0.smithi066.stdout:2/982: dwrite d1/d11/d53/f110 [0,4194304] 0 2024-09-12T22:49:59.413 INFO:tasks.workunit.client.0.smithi066.stdout:9/969: chown d9/d31/d58/dbc/db6/d128/d46/d8a 1049917229 1 2024-09-12T22:49:59.414 INFO:tasks.workunit.client.0.smithi066.stdout:1/969: dread d0/dea/df7/d9a/ff8 [0,4194304] 0 2024-09-12T22:49:59.415 INFO:tasks.workunit.client.0.smithi066.stdout:2/983: chown d1/d11/d26/d4f/d5f/da9/cae 2 1 2024-09-12T22:49:59.415 INFO:tasks.workunit.client.0.smithi066.stdout:2/984: sync 2024-09-12T22:49:59.415 INFO:tasks.workunit.client.0.smithi066.stdout:1/970: unlink d0/dc/d1d/f55 0 2024-09-12T22:49:59.416 INFO:tasks.workunit.client.0.smithi066.stdout:2/985: chown d1/d44/df3/d12/d18/f3e 43942138 1 2024-09-12T22:49:59.416 INFO:tasks.workunit.client.0.smithi066.stdout:1/971: creat d0/d89/dd7/f133 x:0 0 0 2024-09-12T22:49:59.417 INFO:tasks.workunit.client.0.smithi066.stdout:1/972: getdents d0/d89/dd7/dd5 0 2024-09-12T22:49:59.418 INFO:tasks.workunit.client.0.smithi066.stdout:7/912: dread d0/d19/d60/fd4 [0,4194304] 0 2024-09-12T22:49:59.418 INFO:tasks.workunit.client.0.smithi066.stdout:1/973: creat d0/dc/d1e/d95/d130/f134 x:0 0 0 2024-09-12T22:49:59.419 INFO:tasks.workunit.client.0.smithi066.stdout:7/913: write d0/d19/f108 [2536963,13173] 0 2024-09-12T22:49:59.419 INFO:tasks.workunit.client.0.smithi066.stdout:2/986: truncate d1/d44/df3/d12/d18/da8/f88 1583579 0 2024-09-12T22:49:59.419 INFO:tasks.workunit.client.0.smithi066.stdout:1/974: creat d0/d28/f135 x:0 0 0 2024-09-12T22:49:59.420 INFO:tasks.workunit.client.0.smithi066.stdout:1/975: readlink d0/dc/d1e/l82 0 2024-09-12T22:49:59.421 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:49:59.422 INFO:tasks.workunit.client.0.smithi066.stdout:7/914: link d0/l13 d0/d19/d24/d33/d27/dba/l126 0 2024-09-12T22:49:59.422 INFO:tasks.workunit.client.0.smithi066.stdout:2/987: rename d1/d11/d53/c100 to d1/d44/df3/d12/d67/c136 0 2024-09-12T22:49:59.422 INFO:tasks.workunit.client.0.smithi066.stdout:2/988: chown d1/d44/df3/d12/d1e 10725136 1 2024-09-12T22:49:59.422 INFO:tasks.workunit.client.0.smithi066.stdout:7/915: chown d0/d19/d60/f51 558 1 2024-09-12T22:49:59.422 INFO:tasks.workunit.client.0.smithi066.stdout:1/976: link d0/d36/d57/d81/fa5 d0/dc/d1d/f136 0 2024-09-12T22:49:59.422 INFO:tasks.workunit.client.0.smithi066.stdout:7/916: stat d0/d19/d26/d5a/dc8/c114 0 2024-09-12T22:49:59.423 INFO:tasks.workunit.client.0.smithi066.stdout:2/989: creat d1/d44/df3/f137 x:0 0 0 2024-09-12T22:49:59.423 INFO:tasks.workunit.client.0.smithi066.stdout:1/977: write d0/dc/d1e/d47/d6f/f72 [4986980,81222] 0 2024-09-12T22:49:59.423 INFO:tasks.workunit.client.0.smithi066.stdout:2/990: symlink d1/d44/df3/d12/d1e/l138 0 2024-09-12T22:49:59.423 INFO:tasks.workunit.client.0.smithi066.stdout:1/978: mkdir d0/dc/d1e/d119/d137 0 2024-09-12T22:49:59.424 INFO:tasks.workunit.client.0.smithi066.stdout:7/917: link d0/d19/d24/d33/ff9 d0/d19/d26/d48/d59/f127 0 2024-09-12T22:49:59.424 INFO:tasks.workunit.client.0.smithi066.stdout:2/991: creat d1/d11/d26/d4f/d5f/da9/f139 x:0 0 0 2024-09-12T22:49:59.425 INFO:tasks.workunit.client.0.smithi066.stdout:2/992: write d1/d11/d26/f6f [3013760,65401] 0 2024-09-12T22:49:59.426 INFO:tasks.workunit.client.0.smithi066.stdout:2/993: symlink d1/d11/d26/d4f/d5f/d61/d72/l13a 0 2024-09-12T22:49:59.427 INFO:tasks.workunit.client.0.smithi066.stdout:7/918: truncate d0/d19/d60/d85/d8b/f9c 2454321 0 2024-09-12T22:49:59.428 INFO:tasks.workunit.client.0.smithi066.stdout:2/994: chown d1/d44/df3/d12/d18/da8/f82 27363 1 2024-09-12T22:49:59.429 INFO:tasks.workunit.client.0.smithi066.stdout:1/979: dwrite d0/d36/d57/f7e [4194304,4194304] 0 2024-09-12T22:49:59.429 INFO:tasks.workunit.client.0.smithi066.stdout:7/919: creat d0/d19/d26/d5a/f128 x:0 0 0 2024-09-12T22:49:59.429 INFO:tasks.workunit.client.0.smithi066.stdout:2/995: mknod d1/d44/d51/d70/c13b 0 2024-09-12T22:49:59.430 INFO:tasks.workunit.client.0.smithi066.stdout:1/980: chown d0/d36/d57/d81/l100 409771 1 2024-09-12T22:49:59.430 INFO:tasks.workunit.client.0.smithi066.stdout:1/981: readlink d0/d28/l10b 0 2024-09-12T22:49:59.431 INFO:tasks.workunit.client.0.smithi066.stdout:2/996: symlink d1/d44/df3/d12/l13c 0 2024-09-12T22:49:59.433 INFO:tasks.workunit.client.0.smithi066.stdout:2/997: creat d1/d44/df3/d12/f13d x:0 0 0 2024-09-12T22:49:59.434 INFO:tasks.workunit.client.0.smithi066.stdout:2/998: write d1/d11/d26/f77 [623234,60985] 0 2024-09-12T22:49:59.434 INFO:tasks.workunit.client.0.smithi066.stdout:1/982: dwrite d0/d36/d57/f7e [0,4194304] 0 2024-09-12T22:49:59.435 INFO:tasks.workunit.client.0.smithi066.stdout:1/983: stat d0/d4e/d79/d86/f88 0 2024-09-12T22:49:59.435 INFO:tasks.workunit.client.0.smithi066.stdout:2/999: fdatasync d1/d11/d26/d4f/d7c/fbe 0 2024-09-12T22:49:59.437 INFO:tasks.workunit.client.0.smithi066.stdout:9/970: dread d9/d31/d58/dbc/f96 [0,4194304] 0 2024-09-12T22:49:59.439 INFO:tasks.workunit.client.0.smithi066.stdout:9/971: creat d9/d31/d58/dbc/d9d/dff/f13e x:0 0 0 2024-09-12T22:49:59.439 INFO:tasks.workunit.client.0.smithi066.stdout:1/984: dwrite d0/d89/dd7/f6c [0,4194304] 0 2024-09-12T22:49:59.443 INFO:tasks.workunit.client.0.smithi066.stdout:1/985: dwrite d0/dc/d99/fd1 [0,4194304] 0 2024-09-12T22:49:59.444 INFO:tasks.workunit.client.0.smithi066.stdout:1/986: mkdir d0/dc/d8f/dd0/d138 0 2024-09-12T22:49:59.445 INFO:tasks.workunit.client.0.smithi066.stdout:1/987: mkdir d0/d89/dd7/dd5/d139 0 2024-09-12T22:49:59.445 INFO:tasks.workunit.client.0.smithi066.stdout:1/988: stat d0/dc/d1e/d119/c12a 0 2024-09-12T22:49:59.446 INFO:tasks.workunit.client.0.smithi066.stdout:1/989: rmdir d0/d89/dd7/dd5 39 2024-09-12T22:49:59.446 INFO:tasks.workunit.client.0.smithi066.stdout:1/990: dread - d0/dc/d1e/d95/d130/f134 zero size 2024-09-12T22:49:59.447 INFO:tasks.workunit.client.0.smithi066.stdout:1/991: creat d0/dc/d99/d131/f13a x:0 0 0 2024-09-12T22:49:59.448 INFO:tasks.workunit.client.0.smithi066.stdout:1/992: symlink d0/dc/d1e/d47/d6f/l13b 0 2024-09-12T22:49:59.452 INFO:tasks.workunit.client.0.smithi066.stdout:1/993: truncate d0/d89/fb3 3575594 0 2024-09-12T22:49:59.453 INFO:tasks.workunit.client.0.smithi066.stdout:1/994: chown d0/d4e/d79/d86/l128 2170 1 2024-09-12T22:49:59.454 INFO:tasks.workunit.client.0.smithi066.stdout:1/995: creat d0/d89/f13c x:0 0 0 2024-09-12T22:49:59.454 INFO:tasks.workunit.client.0.smithi066.stdout:1/996: fdatasync d0/fcf 0 2024-09-12T22:49:59.455 INFO:tasks.workunit.client.0.smithi066.stdout:1/997: symlink d0/dc/deb/l13d 0 2024-09-12T22:49:59.455 INFO:tasks.workunit.client.0.smithi066.stdout:1/998: mknod d0/dc/c13e 0 2024-09-12T22:49:59.456 INFO:tasks.workunit.client.0.smithi066.stdout:1/999: fsync d0/d36/d57/f3e 0 2024-09-12T22:49:59.459 INFO:tasks.workunit.client.0.smithi066.stdout:7/920: dread d0/d19/d26/d5a/dc8/fd5 [0,4194304] 0 2024-09-12T22:49:59.461 INFO:tasks.workunit.client.0.smithi066.stdout:7/921: write d0/f5 [249690,58452] 0 2024-09-12T22:49:59.462 INFO:tasks.workunit.client.0.smithi066.stdout:7/922: write d0/d19/d24/d33/f5b [1769450,52881] 0 2024-09-12T22:49:59.464 INFO:tasks.workunit.client.0.smithi066.stdout:7/923: rename d0/d19/d60/d53/ca6 to d0/c129 0 2024-09-12T22:49:59.464 INFO:tasks.workunit.client.0.smithi066.stdout:7/924: symlink d0/d19/d60/d85/de6/l12a 0 2024-09-12T22:49:59.465 INFO:tasks.workunit.client.0.smithi066.stdout:7/925: truncate d0/d19/d24/f93 5408416 0 2024-09-12T22:49:59.465 INFO:tasks.workunit.client.0.smithi066.stdout:7/926: readlink d0/d19/d24/d33/d27/lc1 0 2024-09-12T22:49:59.470 INFO:tasks.workunit.client.0.smithi066.stdout:7/927: dwrite d0/d6/d83/fe8 [0,4194304] 0 2024-09-12T22:49:59.471 INFO:tasks.workunit.client.0.smithi066.stdout:9/972: dread d9/fa1 [0,4194304] 0 2024-09-12T22:49:59.472 INFO:tasks.workunit.client.0.smithi066.stdout:9/973: creat d9/d31/db0/f13f x:0 0 0 2024-09-12T22:49:59.473 INFO:tasks.workunit.client.0.smithi066.stdout:9/974: read - d9/d31/d58/da4/fd9 zero size 2024-09-12T22:49:59.473 INFO:tasks.workunit.client.0.smithi066.stdout:7/928: dread d0/d19/d24/f6b [0,4194304] 0 2024-09-12T22:49:59.474 INFO:tasks.workunit.client.0.smithi066.stdout:9/975: rename d9/df0 to d9/d31/d77/dc2/d140 0 2024-09-12T22:49:59.474 INFO:tasks.workunit.client.0.smithi066.stdout:9/976: mknod d9/d31/d58/dbc/c141 0 2024-09-12T22:49:59.476 INFO:tasks.workunit.client.0.smithi066.stdout:9/977: truncate d9/dc6/fa2 202318 0 2024-09-12T22:49:59.477 INFO:tasks.workunit.client.0.smithi066.stdout:9/978: mknod d9/d31/d58/dbc/db6/d128/c142 0 2024-09-12T22:49:59.477 INFO:tasks.workunit.client.0.smithi066.stdout:7/929: dwrite d0/d19/d74/f113 [0,4194304] 0 2024-09-12T22:49:59.479 INFO:tasks.workunit.client.0.smithi066.stdout:9/979: dread d9/d31/d58/dbc/db6/d128/d46/f4b [0,4194304] 0 2024-09-12T22:49:59.479 INFO:tasks.workunit.client.0.smithi066.stdout:7/930: symlink d0/d19/d24/d33/d27/dba/dc9/de5/df8/l12b 0 2024-09-12T22:49:59.479 INFO:tasks.workunit.client.0.smithi066.stdout:9/980: chown d9/d31/d58/dbc/db6/d128/dd/c21 421264 1 2024-09-12T22:49:59.480 INFO:tasks.workunit.client.0.smithi066.stdout:7/931: unlink d0/d19/d26/c10e 0 2024-09-12T22:49:59.480 INFO:tasks.workunit.client.0.smithi066.stdout:9/981: read d9/d31/d58/dbc/f96 [152146,115477] 0 2024-09-12T22:49:59.481 INFO:tasks.workunit.client.0.smithi066.stdout:9/982: dread - d9/d31/d34/f10b zero size 2024-09-12T22:49:59.481 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:59.480+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:59.481 INFO:tasks.workunit.client.0.smithi066.stdout:9/983: chown d9/d31/lb2 6421453 1 2024-09-12T22:49:59.482 INFO:tasks.workunit.client.0.smithi066.stdout:9/984: write d9/d31/d58/dbc/f66 [1262105,7639] 0 2024-09-12T22:49:59.482 INFO:tasks.workunit.client.0.smithi066.stdout:7/932: truncate d0/d19/d60/d53/f67 3047356 0 2024-09-12T22:49:59.483 INFO:tasks.workunit.client.0.smithi066.stdout:9/985: read d9/d31/d58/dbc/db6/d128/d23/f30 [213326,16416] 0 2024-09-12T22:49:59.483 INFO:tasks.workunit.client.0.smithi066.stdout:7/933: mkdir d0/d19/d24/d33/d27/dba/d105/d12c 0 2024-09-12T22:49:59.484 INFO:tasks.workunit.client.0.smithi066.stdout:7/934: dread - d0/d19/d74/fea zero size 2024-09-12T22:49:59.484 INFO:tasks.workunit.client.0.smithi066.stdout:9/986: truncate d9/d31/d58/dbc/db6/d128/d8e/fa0 936136 0 2024-09-12T22:49:59.485 INFO:tasks.workunit.client.0.smithi066.stdout:9/987: stat d9/fd4 0 2024-09-12T22:49:59.485 INFO:tasks.workunit.client.0.smithi066.stdout:9/988: symlink d9/d31/d58/de4/l143 0 2024-09-12T22:49:59.485 INFO:tasks.workunit.client.0.smithi066.stdout:9/989: stat d9/l3e 0 2024-09-12T22:49:59.486 INFO:tasks.workunit.client.0.smithi066.stdout:9/990: dread - d9/d31/d77/dc2/d140/f120 zero size 2024-09-12T22:49:59.488 INFO:tasks.workunit.client.0.smithi066.stdout:9/991: truncate d9/fd4 498238 0 2024-09-12T22:49:59.501 INFO:tasks.workunit.client.0.smithi066.stdout:7/935: dread d0/d19/d24/d33/d27/d70/fb1 [0,4194304] 0 2024-09-12T22:49:59.502 INFO:tasks.workunit.client.0.smithi066.stdout:7/936: creat d0/f12d x:0 0 0 2024-09-12T22:49:59.503 INFO:tasks.workunit.client.0.smithi066.stdout:9/992: dread d9/d31/d58/dbc/db6/d128/d23/f51 [0,4194304] 0 2024-09-12T22:49:59.505 INFO:tasks.workunit.client.0.smithi066.stdout:7/937: dread d0/d19/d24/fc5 [0,4194304] 0 2024-09-12T22:49:59.507 INFO:tasks.workunit.client.0.smithi066.stdout:7/938: read d0/d19/d24/f1d [667849,106312] 0 2024-09-12T22:49:59.508 INFO:tasks.workunit.client.0.smithi066.stdout:7/939: mkdir d0/d19/d26/d48/d84/d12e 0 2024-09-12T22:49:59.509 INFO:tasks.workunit.client.0.smithi066.stdout:7/940: truncate d0/d19/d60/d85/d8b/f9c 134898 0 2024-09-12T22:49:59.510 INFO:tasks.workunit.client.0.smithi066.stdout:7/941: stat d0/c129 0 2024-09-12T22:49:59.510 INFO:tasks.workunit.client.0.smithi066.stdout:7/942: fsync d0/d19/d26/d5a/dc8/ffd 0 2024-09-12T22:49:59.511 INFO:tasks.workunit.client.0.smithi066.stdout:7/943: getdents d0/d19/d26/d48/d59 0 2024-09-12T22:49:59.512 INFO:tasks.workunit.client.0.smithi066.stdout:7/944: creat d0/d19/d24/d33/d27/dba/dc9/df6/f12f x:0 0 0 2024-09-12T22:49:59.513 INFO:tasks.workunit.client.0.smithi066.stdout:7/945: fdatasync d0/d19/d60/fd4 0 2024-09-12T22:49:59.514 INFO:tasks.workunit.client.0.smithi066.stdout:7/946: creat d0/d19/d24/d33/d27/d70/d90/f130 x:0 0 0 2024-09-12T22:49:59.515 INFO:tasks.workunit.client.0.smithi066.stdout:7/947: creat d0/d19/d26/d48/df1/d112/f131 x:0 0 0 2024-09-12T22:49:59.516 INFO:tasks.workunit.client.0.smithi066.stdout:7/948: dread - d0/d19/d24/d33/d27/dba/dc9/de5/feb zero size 2024-09-12T22:49:59.516 INFO:tasks.workunit.client.0.smithi066.stdout:7/949: write d0/d19/d24/d33/d27/f35 [2000533,35686] 0 2024-09-12T22:49:59.517 INFO:tasks.workunit.client.0.smithi066.stdout:7/950: creat d0/d19/d120/f132 x:0 0 0 2024-09-12T22:49:59.517 INFO:tasks.workunit.client.0.smithi066.stdout:7/951: rmdir d0/d86 39 2024-09-12T22:49:59.518 INFO:tasks.workunit.client.0.smithi066.stdout:9/993: dread d9/d31/d77/dc2/d140/fb8 [0,4194304] 0 2024-09-12T22:49:59.519 INFO:tasks.workunit.client.0.smithi066.stdout:7/952: symlink d0/d19/d26/d48/dc3/l133 0 2024-09-12T22:49:59.519 INFO:tasks.workunit.client.0.smithi066.stdout:9/994: mkdir d9/d31/d58/dbc/db6/d128/dd2/d144 0 2024-09-12T22:49:59.520 INFO:tasks.workunit.client.0.smithi066.stdout:7/953: rename d0/d19/d60/d85/d8b/fb0 to d0/d19/d26/d48/d59/f134 0 2024-09-12T22:49:59.520 INFO:tasks.workunit.client.0.smithi066.stdout:9/995: sync 2024-09-12T22:49:59.520 INFO:tasks.workunit.client.0.smithi066.stdout:7/954: fsync d0/d19/d24/f1d 0 2024-09-12T22:49:59.521 INFO:tasks.workunit.client.0.smithi066.stdout:7/955: creat d0/d19/d60/d85/d8b/f135 x:0 0 0 2024-09-12T22:49:59.522 INFO:tasks.workunit.client.0.smithi066.stdout:7/956: dread - d0/d19/d60/d85/d8b/f135 zero size 2024-09-12T22:49:59.523 INFO:tasks.workunit.client.0.smithi066.stdout:7/957: truncate d0/d19/d24/f1d 1428493 0 2024-09-12T22:49:59.524 INFO:tasks.workunit.client.0.smithi066.stdout:9/996: dwrite d9/d31/d77/faa [0,4194304] 0 2024-09-12T22:49:59.524 INFO:tasks.workunit.client.0.smithi066.stdout:7/958: chown d0/d86/lbf 1661151 1 2024-09-12T22:49:59.525 INFO:tasks.workunit.client.0.smithi066.stdout:9/997: symlink d9/l145 0 2024-09-12T22:49:59.525 INFO:tasks.workunit.client.0.smithi066.stdout:7/959: readlink d0/d19/d24/d33/l111 0 2024-09-12T22:49:59.526 INFO:tasks.workunit.client.0.smithi066.stdout:7/960: write d0/d19/d24/fc7 [4989022,50057] 0 2024-09-12T22:49:59.526 INFO:tasks.workunit.client.0.smithi066.stdout:9/998: rmdir d9/d31/d58/de4 39 2024-09-12T22:49:59.526 INFO:tasks.workunit.client.0.smithi066.stdout:9/999: chown d9/d31/d77/fb9 1831 1 2024-09-12T22:49:59.530 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:59.530 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:59.533 INFO:tasks.workunit.client.0.smithi066.stdout:7/961: dread d0/d19/d26/dbe/fe4 [0,4194304] 0 2024-09-12T22:49:59.539 INFO:tasks.workunit.client.0.smithi066.stdout:7/962: read d0/d19/d26/d48/d59/f127 [3545002,9774] 0 2024-09-12T22:49:59.539 INFO:tasks.workunit.client.0.smithi066.stdout:7/963: creat d0/d19/d24/d33/d27/dba/d105/d12c/f136 x:0 0 0 2024-09-12T22:49:59.540 INFO:tasks.workunit.client.0.smithi066.stdout:7/964: read - d0/d19/d24/d33/d27/dba/dc9/de5/feb zero size 2024-09-12T22:49:59.542 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:49:59.542 INFO:tasks.workunit.client.0.smithi066.stdout:7/965: link d0/d19/d24/le d0/d19/d24/d33/l137 0 2024-09-12T22:49:59.542 INFO:tasks.workunit.client.0.smithi066.stdout:7/966: fdatasync d0/d19/d24/f6b 0 2024-09-12T22:49:59.542 INFO:tasks.workunit.client.0.smithi066.stdout:7/967: chown d0/d19/d24/d33/d27/d70/d90/db8/df4/d109 41510105 1 2024-09-12T22:49:59.543 INFO:tasks.workunit.client.0.smithi066.stdout:7/968: fdatasync d0/d19/d26/d48/d59/f7b 0 2024-09-12T22:49:59.544 INFO:tasks.workunit.client.0.smithi066.stdout:7/969: write d0/d19/d26/d48/f58 [2727034,31118] 0 2024-09-12T22:49:59.544 INFO:tasks.workunit.client.0.smithi066.stdout:7/970: unlink d0/f12d 0 2024-09-12T22:49:59.545 INFO:tasks.workunit.client.0.smithi066.stdout:7/971: truncate d0/d19/d60/d85/d8b/f135 731293 0 2024-09-12T22:49:59.546 INFO:tasks.workunit.client.0.smithi066.stdout:7/972: rename d0/d19/d24/d33/c80 to d0/d19/d60/d53/c138 0 2024-09-12T22:49:59.546 INFO:tasks.workunit.client.0.smithi066.stdout:7/973: sync 2024-09-12T22:49:59.547 INFO:tasks.workunit.client.0.smithi066.stdout:7/974: chown d0/d19/d26/d5a/dc8/ffd 2 1 2024-09-12T22:49:59.548 INFO:tasks.workunit.client.0.smithi066.stdout:7/975: link d0/d19/d26/d48/dc3/lfc d0/d19/d26/l139 0 2024-09-12T22:49:59.549 INFO:tasks.workunit.client.0.smithi066.stdout:7/976: read d0/d19/d24/f1d [541685,19039] 0 2024-09-12T22:49:59.550 INFO:tasks.workunit.client.0.smithi066.stdout:7/977: mkdir d0/d19/d24/d33/d27/d13a 0 2024-09-12T22:49:59.551 INFO:tasks.workunit.client.0.smithi066.stdout:7/978: symlink d0/d19/d26/d5a/d9f/l13b 0 2024-09-12T22:49:59.551 INFO:tasks.workunit.client.0.smithi066.stdout:7/979: read - d0/d19/d26/d5a/f128 zero size 2024-09-12T22:49:59.552 INFO:tasks.workunit.client.0.smithi066.stdout:7/980: creat d0/d19/d24/d33/d27/dba/dc9/de5/df8/f13c x:0 0 0 2024-09-12T22:49:59.552 INFO:tasks.workunit.client.0.smithi066.stdout:7/981: sync 2024-09-12T22:49:59.560 INFO:tasks.workunit.client.0.smithi066.stdout:7/982: dread d0/d19/d26/f6a [0,4194304] 0 2024-09-12T22:49:59.561 INFO:tasks.workunit.client.0.smithi066.stdout:7/983: symlink d0/d19/d60/d85/de6/l13d 0 2024-09-12T22:49:59.561 INFO:tasks.workunit.client.0.smithi066.stdout:7/984: sync 2024-09-12T22:49:59.562 INFO:tasks.workunit.client.0.smithi066.stdout:7/985: rmdir d0/d19/d60/d53 39 2024-09-12T22:49:59.562 INFO:tasks.workunit.client.0.smithi066.stdout:7/986: readlink d0/d19/d26/l139 0 2024-09-12T22:49:59.563 INFO:tasks.workunit.client.0.smithi066.stdout:7/987: write d0/d19/d26/d48/dc3/f104 [4484528,74644] 0 2024-09-12T22:49:59.566 INFO:tasks.workunit.client.0.smithi066.stdout:7/988: dwrite d0/d19/d24/f107 [0,4194304] 0 2024-09-12T22:49:59.568 INFO:tasks.workunit.client.0.smithi066.stdout:7/989: creat d0/d19/d26/f13e x:0 0 0 2024-09-12T22:49:59.568 INFO:tasks.workunit.client.0.smithi066.stdout:7/990: creat d0/d19/d26/d48/d84/f13f x:0 0 0 2024-09-12T22:49:59.573 INFO:tasks.workunit.client.0.smithi066.stdout:7/991: dwrite d0/d19/d24/d33/d27/dba/dc9/df6/f12f [0,4194304] 0 2024-09-12T22:49:59.575 INFO:tasks.workunit.client.0.smithi066.stdout:7/992: write d0/d19/d26/d48/d59/f134 [3297626,33520] 0 2024-09-12T22:49:59.577 INFO:tasks.workunit.client.0.smithi066.stdout:7/993: truncate d0/d19/d26/d48/f49 65230 0 2024-09-12T22:49:59.577 INFO:tasks.workunit.client.0.smithi066.stdout:7/994: read d0/d19/d24/fa0 [726246,96108] 0 2024-09-12T22:49:59.578 INFO:tasks.workunit.client.0.smithi066.stdout:7/995: mkdir d0/d19/d60/d85/d8b/d140 0 2024-09-12T22:49:59.578 INFO:tasks.workunit.client.0.smithi066.stdout:7/996: readlink d0/d19/d26/d5a/lf0 0 2024-09-12T22:49:59.578 INFO:tasks.workunit.client.0.smithi066.stdout:7/997: sync 2024-09-12T22:49:59.582 INFO:tasks.workunit.client.0.smithi066.stdout:7/998: dwrite d0/d19/d60/d53/f8c [0,4194304] 0 2024-09-12T22:49:59.583 INFO:tasks.workunit.client.0.smithi066.stdout:7/999: chown d0/d6/l43 5749592 1 2024-09-12T22:49:59.586 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:59.585+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:59.587 INFO:tasks.workunit.client.0.smithi066.stderr:+ rm -rf -- ./tmp.DBxqgsalZD 2024-09-12T22:49:59.647 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:59.648 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:59.656 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:49:59.697 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:59.696+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:59.754 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~88s 2024-09-12T22:49:59.784 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:59.783+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:49:59.799 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:59.799 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:59.807 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:49:59.885 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:49:59.884+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:49:59.912 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:49:59.912 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:49:59.920 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:49:59.986 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:49:59.985+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:00.026 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:00.026 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:00.036 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:50:00.120 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:00.119+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:00.188 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:00.186+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:00.188 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:00.188 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:00.190 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:50:00.198 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:50:00.289 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:00.288+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:00.329 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:50:00.329 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:50:00.344 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:00.345 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:00.348 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:50:00.348 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:50:00.348 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:50:00.351 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:50:00.352 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:50:00.353 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:50:00.395 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:00.394+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:00.466 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:50:00.466 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:50:00.466 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:50:00.466 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:50:00.476 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:50:00.491 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:00.490+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:00.584 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:50:00.585 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:50:00.585 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:50:00.585 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:50:00.585 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:50:00.591 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:00.590+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:00.594 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:50:00.692 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:00.691+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:00.716 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:50:00.743 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:50:00.743 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:50:00.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:50:00.743 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:50:00.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.744 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1923 3.8 3:17051619:::200.0000000f:head [write 935107~4527 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:00.744 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.157731+0000", 2024-09-12T22:50:00.744 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 3.5834945, 2024-09-12T22:50:00.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.085115956000000006, 2024-09-12T22:50:00.744 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:00.744 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:00.744 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:00.744 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:00.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:00.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157731+0000", 2024-09-12T22:50:00.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:00.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157731+0000", 2024-09-12T22:50:00.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:00.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157732+0000", 2024-09-12T22:50:00.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.99e-07 2024-09-12T22:50:00.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:00.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157737+0000", 2024-09-12T22:50:00.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6280000000000002e-06 2024-09-12T22:50:00.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:00.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157745+0000", 2024-09-12T22:50:00.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1749999999999999e-06 2024-09-12T22:50:00.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:00.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157749+0000", 2024-09-12T22:50:00.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.946e-06 2024-09-12T22:50:00.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:00.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.236865+0000", 2024-09-12T22:50:00.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079116687000000005 2024-09-12T22:50:00.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:00.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.236929+0000", 2024-09-12T22:50:00.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3566999999999996e-05 2024-09-12T22:50:00.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:00.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237025+0000", 2024-09-12T22:50:00.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6620000000000007e-05 2024-09-12T22:50:00.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.748 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:00.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240342+0000", 2024-09-12T22:50:00.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033162539999999998 2024-09-12T22:50:00.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.748 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:00.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242737+0000", 2024-09-12T22:50:00.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023957370000000002 2024-09-12T22:50:00.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.749 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:00.749 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242797+0000", 2024-09-12T22:50:00.749 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9323000000000001e-05 2024-09-12T22:50:00.749 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.749 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:00.749 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242847+0000", 2024-09-12T22:50:00.749 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0319999999999999e-05 2024-09-12T22:50:00.749 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.749 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:00.749 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.749 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.750 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1924 3.8 3:17051619:::200.0000000f:head [write 939634~6106 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:00.750 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.159169+0000", 2024-09-12T22:50:00.750 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 3.5820562809999998, 2024-09-12T22:50:00.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.083843601000000004, 2024-09-12T22:50:00.750 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:00.750 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:00.750 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:00.750 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:00.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:00.750 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159169+0000", 2024-09-12T22:50:00.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:00.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159169+0000", 2024-09-12T22:50:00.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:00.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159171+0000", 2024-09-12T22:50:00.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4959999999999999e-06 2024-09-12T22:50:00.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:00.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159182+0000", 2024-09-12T22:50:00.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1104000000000001e-05 2024-09-12T22:50:00.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:00.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159190+0000", 2024-09-12T22:50:00.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3520000000000007e-06 2024-09-12T22:50:00.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:00.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159196+0000", 2024-09-12T22:50:00.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5690000000000004e-06 2024-09-12T22:50:00.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:00.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237476+0000", 2024-09-12T22:50:00.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078280197999999995 2024-09-12T22:50:00.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:00.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237530+0000", 2024-09-12T22:50:00.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4419000000000002e-05 2024-09-12T22:50:00.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:00.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237593+0000", 2024-09-12T22:50:00.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2611000000000001e-05 2024-09-12T22:50:00.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:00.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242030+0000", 2024-09-12T22:50:00.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044367369999999996 2024-09-12T22:50:00.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:00.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242893+0000", 2024-09-12T22:50:00.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00086367400000000004 2024-09-12T22:50:00.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:00.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242956+0000", 2024-09-12T22:50:00.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2885999999999994e-05 2024-09-12T22:50:00.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:00.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243013+0000", 2024-09-12T22:50:00.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6555000000000003e-05 2024-09-12T22:50:00.755 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.755 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:00.755 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.755 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1925 3.8 3:17051619:::200.0000000f:head [write 945740~9955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:00.755 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.160395+0000", 2024-09-12T22:50:00.756 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 3.5808310720000001, 2024-09-12T22:50:00.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.091200247999999998, 2024-09-12T22:50:00.756 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:00.756 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:00.756 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:00.756 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:00.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:00.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160395+0000", 2024-09-12T22:50:00.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:00.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160395+0000", 2024-09-12T22:50:00.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:00.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160396+0000", 2024-09-12T22:50:00.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1599999999999999e-06 2024-09-12T22:50:00.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:00.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160415+0000", 2024-09-12T22:50:00.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9680000000000001e-05 2024-09-12T22:50:00.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:00.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160428+0000", 2024-09-12T22:50:00.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2792999999999999e-05 2024-09-12T22:50:00.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:00.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160436+0000", 2024-09-12T22:50:00.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0399999999999993e-06 2024-09-12T22:50:00.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:00.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.238408+0000", 2024-09-12T22:50:00.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077971602000000001 2024-09-12T22:50:00.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:00.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.238504+0000", 2024-09-12T22:50:00.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6714999999999998e-05 2024-09-12T22:50:00.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:00.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.238687+0000", 2024-09-12T22:50:00.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000182795 2024-09-12T22:50:00.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:00.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242036+0000", 2024-09-12T22:50:00.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003348887 2024-09-12T22:50:00.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:00.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251510+0000", 2024-09-12T22:50:00.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094733679999999994 2024-09-12T22:50:00.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:00.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251543+0000", 2024-09-12T22:50:00.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2974e-05 2024-09-12T22:50:00.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:00.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251595+0000", 2024-09-12T22:50:00.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2234000000000002e-05 2024-09-12T22:50:00.761 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.761 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:00.761 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.761 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1926 3.8 3:17051619:::200.0000000f:head [write 955695~5281 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:00.761 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.160849+0000", 2024-09-12T22:50:00.761 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 3.5803761180000002, 2024-09-12T22:50:00.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.094772633999999994, 2024-09-12T22:50:00.762 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:00.762 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:00.762 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:00.762 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:00.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:00.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160849+0000", 2024-09-12T22:50:00.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:00.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160849+0000", 2024-09-12T22:50:00.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:00.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160850+0000", 2024-09-12T22:50:00.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6700000000000002e-07 2024-09-12T22:50:00.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:00.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160858+0000", 2024-09-12T22:50:00.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5630000000000003e-06 2024-09-12T22:50:00.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:00.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160866+0000", 2024-09-12T22:50:00.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7570000000000004e-06 2024-09-12T22:50:00.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:00.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160870+0000", 2024-09-12T22:50:00.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5929999999999999e-06 2024-09-12T22:50:00.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:00.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.239705+0000", 2024-09-12T22:50:00.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078834491000000007 2024-09-12T22:50:00.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:00.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.239764+0000", 2024-09-12T22:50:00.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9190000000000001e-05 2024-09-12T22:50:00.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:00.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.239851+0000", 2024-09-12T22:50:00.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7472999999999994e-05 2024-09-12T22:50:00.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:00.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254001+0000", 2024-09-12T22:50:00.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014149622000000001 2024-09-12T22:50:00.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:00.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255525+0000", 2024-09-12T22:50:00.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0015236500000000001 2024-09-12T22:50:00.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:00.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255567+0000", 2024-09-12T22:50:00.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2150999999999997e-05 2024-09-12T22:50:00.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:00.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255622+0000", 2024-09-12T22:50:00.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5276999999999999e-05 2024-09-12T22:50:00.767 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.767 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:00.767 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.767 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1927 3.8 3:17051619:::200.0000000f:head [write 960976~5828 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:00.767 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.164361+0000", 2024-09-12T22:50:00.767 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 3.5768644209999998, 2024-09-12T22:50:00.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.091388523999999999, 2024-09-12T22:50:00.768 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:00.768 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:00.768 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:00.768 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:00.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:00.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164361+0000", 2024-09-12T22:50:00.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:00.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164361+0000", 2024-09-12T22:50:00.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:00.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164363+0000", 2024-09-12T22:50:00.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.389e-06 2024-09-12T22:50:00.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:00.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164370+0000", 2024-09-12T22:50:00.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.99e-06 2024-09-12T22:50:00.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:00.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164379+0000", 2024-09-12T22:50:00.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9499999999999996e-06 2024-09-12T22:50:00.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:00.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164385+0000", 2024-09-12T22:50:00.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5879999999999997e-06 2024-09-12T22:50:00.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:00.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240385+0000", 2024-09-12T22:50:00.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075999995000000001 2024-09-12T22:50:00.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:00.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240533+0000", 2024-09-12T22:50:00.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014811699999999999 2024-09-12T22:50:00.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:00.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240886+0000", 2024-09-12T22:50:00.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000352517 2024-09-12T22:50:00.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:00.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254024+0000", 2024-09-12T22:50:00.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013138047999999999 2024-09-12T22:50:00.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:00.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255629+0000", 2024-09-12T22:50:00.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001604949 2024-09-12T22:50:00.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:00.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255683+0000", 2024-09-12T22:50:00.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4035e-05 2024-09-12T22:50:00.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:00.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255750+0000", 2024-09-12T22:50:00.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6946000000000006e-05 2024-09-12T22:50:00.773 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.773 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:00.773 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.773 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1928 3.8 3:17051619:::200.0000000f:head [write 966804~6536 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:00.773 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167179+0000", 2024-09-12T22:50:00.773 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 3.5740466230000001, 2024-09-12T22:50:00.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.089785880999999998, 2024-09-12T22:50:00.773 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:00.774 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:00.774 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:00.774 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:00.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:00.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167179+0000", 2024-09-12T22:50:00.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:00.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167179+0000", 2024-09-12T22:50:00.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:00.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167180+0000", 2024-09-12T22:50:00.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2869999999999999e-06 2024-09-12T22:50:00.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:00.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167192+0000", 2024-09-12T22:50:00.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.187e-05 2024-09-12T22:50:00.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:00.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167203+0000", 2024-09-12T22:50:00.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1076e-05 2024-09-12T22:50:00.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:00.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167210+0000", 2024-09-12T22:50:00.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1799999999999999e-06 2024-09-12T22:50:00.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:00.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.241518+0000", 2024-09-12T22:50:00.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074307845999999997 2024-09-12T22:50:00.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:00.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.241563+0000", 2024-09-12T22:50:00.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5138e-05 2024-09-12T22:50:00.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:00.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.241641+0000", 2024-09-12T22:50:00.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8016000000000007e-05 2024-09-12T22:50:00.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:00.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254041+0000", 2024-09-12T22:50:00.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012399666 2024-09-12T22:50:00.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:00.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.256880+0000", 2024-09-12T22:50:00.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0028390580000000002 2024-09-12T22:50:00.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:00.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.256918+0000", 2024-09-12T22:50:00.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7552999999999998e-05 2024-09-12T22:50:00.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:00.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.256965+0000", 2024-09-12T22:50:00.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7191000000000003e-05 2024-09-12T22:50:00.779 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.779 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:00.779 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.779 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1929 3.8 3:17051619:::200.0000000f:head [write 973340~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:00.779 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167521+0000", 2024-09-12T22:50:00.779 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 3.5737044600000001, 2024-09-12T22:50:00.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.093206336000000001, 2024-09-12T22:50:00.780 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:00.780 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:00.780 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:00.780 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:00.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:00.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167521+0000", 2024-09-12T22:50:00.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:00.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167521+0000", 2024-09-12T22:50:00.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:00.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167522+0000", 2024-09-12T22:50:00.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8899999999999998e-07 2024-09-12T22:50:00.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:00.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167526+0000", 2024-09-12T22:50:00.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4490000000000001e-06 2024-09-12T22:50:00.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:00.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167544+0000", 2024-09-12T22:50:00.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7220000000000001e-05 2024-09-12T22:50:00.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:00.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167551+0000", 2024-09-12T22:50:00.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.046e-06 2024-09-12T22:50:00.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:00.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242079+0000", 2024-09-12T22:50:00.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074528436000000003 2024-09-12T22:50:00.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:00.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242167+0000", 2024-09-12T22:50:00.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7670000000000006e-05 2024-09-12T22:50:00.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:00.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242306+0000", 2024-09-12T22:50:00.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000138703 2024-09-12T22:50:00.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:00.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254058+0000", 2024-09-12T22:50:00.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011752395000000001 2024-09-12T22:50:00.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:00.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260654+0000", 2024-09-12T22:50:00.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0065964700000000001 2024-09-12T22:50:00.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:00.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260699+0000", 2024-09-12T22:50:00.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5095000000000001e-05 2024-09-12T22:50:00.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:00.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260727+0000", 2024-09-12T22:50:00.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7963e-05 2024-09-12T22:50:00.785 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.785 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:00.785 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.785 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1931 3.8 3:17051619:::200.0000000f:head [write 974738~2728 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:00.786 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167657+0000", 2024-09-12T22:50:00.786 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 3.5735684550000002, 2024-09-12T22:50:00.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.093133758999999997, 2024-09-12T22:50:00.786 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:00.786 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:00.786 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:00.786 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:00.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:00.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167657+0000", 2024-09-12T22:50:00.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:00.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167657+0000", 2024-09-12T22:50:00.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:00.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167658+0000", 2024-09-12T22:50:00.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2200000000000003e-07 2024-09-12T22:50:00.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:00.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167662+0000", 2024-09-12T22:50:00.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1489999999999996e-06 2024-09-12T22:50:00.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:00.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167673+0000", 2024-09-12T22:50:00.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0614e-05 2024-09-12T22:50:00.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:00.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167679+0000", 2024-09-12T22:50:00.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1500000000000004e-06 2024-09-12T22:50:00.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:00.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243054+0000", 2024-09-12T22:50:00.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075375027999999997 2024-09-12T22:50:00.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:00.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243134+0000", 2024-09-12T22:50:00.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0210000000000006e-05 2024-09-12T22:50:00.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:00.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243263+0000", 2024-09-12T22:50:00.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012919 2024-09-12T22:50:00.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:00.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254075+0000", 2024-09-12T22:50:00.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010811523 2024-09-12T22:50:00.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:00.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260733+0000", 2024-09-12T22:50:00.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.006658153 2024-09-12T22:50:00.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:00.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260756+0000", 2024-09-12T22:50:00.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2696000000000001e-05 2024-09-12T22:50:00.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:00.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260791+0000", 2024-09-12T22:50:00.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5324000000000003e-05 2024-09-12T22:50:00.791 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.791 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:00.791 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.791 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1932 3.8 3:17051619:::200.0000000f:head [write 977466~2771 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:00.791 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:50:00.791 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 3.5732787730000002, 2024-09-12T22:50:00.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.092944115999999993, 2024-09-12T22:50:00.791 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:00.791 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:00.792 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:00.792 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:00.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:00.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:50:00.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:00.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:50:00.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:00.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:50:00.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8400000000000004e-07 2024-09-12T22:50:00.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:00.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167952+0000", 2024-09-12T22:50:00.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.138e-06 2024-09-12T22:50:00.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:00.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167961+0000", 2024-09-12T22:50:00.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7990000000000005e-06 2024-09-12T22:50:00.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:00.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167968+0000", 2024-09-12T22:50:00.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4400000000000002e-06 2024-09-12T22:50:00.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:00.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.244002+0000", 2024-09-12T22:50:00.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.076034300999999999 2024-09-12T22:50:00.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:00.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.244061+0000", 2024-09-12T22:50:00.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8356999999999997e-05 2024-09-12T22:50:00.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:00.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.244161+0000", 2024-09-12T22:50:00.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000100126 2024-09-12T22:50:00.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:00.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254099+0000", 2024-09-12T22:50:00.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0099384940000000008 2024-09-12T22:50:00.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:00.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260799+0000", 2024-09-12T22:50:00.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0066995029999999999 2024-09-12T22:50:00.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:00.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260851+0000", 2024-09-12T22:50:00.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1861999999999999e-05 2024-09-12T22:50:00.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:00.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260891+0000", 2024-09-12T22:50:00.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0411999999999999e-05 2024-09-12T22:50:00.797 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.797 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:00.797 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.797 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1933 3.8 3:17051619:::200.0000000f:head [write 980237~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:00.797 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167993+0000", 2024-09-12T22:50:00.797 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 3.5732322700000001, 2024-09-12T22:50:00.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.092952307999999997, 2024-09-12T22:50:00.797 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:00.797 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:00.797 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:00.798 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:00.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:00.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167993+0000", 2024-09-12T22:50:00.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:00.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167993+0000", 2024-09-12T22:50:00.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:00.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167994+0000", 2024-09-12T22:50:00.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5000000000000003e-07 2024-09-12T22:50:00.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:00.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167997+0000", 2024-09-12T22:50:00.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5559999999999999e-06 2024-09-12T22:50:00.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:00.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168005+0000", 2024-09-12T22:50:00.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.588e-06 2024-09-12T22:50:00.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:00.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168011+0000", 2024-09-12T22:50:00.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7780000000000004e-06 2024-09-12T22:50:00.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:00.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.247983+0000", 2024-09-12T22:50:00.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079972090999999995 2024-09-12T22:50:00.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:00.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248038+0000", 2024-09-12T22:50:00.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4889999999999998e-05 2024-09-12T22:50:00.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:00.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248136+0000", 2024-09-12T22:50:00.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8271999999999997e-05 2024-09-12T22:50:00.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:00.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254134+0000", 2024-09-12T22:50:00.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005997751 2024-09-12T22:50:00.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:00.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260898+0000", 2024-09-12T22:50:00.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0067646429999999999 2024-09-12T22:50:00.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:00.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260923+0000", 2024-09-12T22:50:00.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4080999999999999e-05 2024-09-12T22:50:00.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:00.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260946+0000", 2024-09-12T22:50:00.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3108e-05 2024-09-12T22:50:00.802 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.802 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:00.802 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.803 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1934 3.8 3:17051619:::200.0000000f:head [write 982156~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:00.803 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:50:00.803 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 3.5732067839999999, 2024-09-12T22:50:00.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.093517738000000003, 2024-09-12T22:50:00.803 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:00.803 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:00.803 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:00.803 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:00.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:00.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:50:00.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:00.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:50:00.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:00.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:50:00.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6800000000000001e-07 2024-09-12T22:50:00.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:00.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168029+0000", 2024-09-12T22:50:00.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9699999999999994e-06 2024-09-12T22:50:00.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:00.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168036+0000", 2024-09-12T22:50:00.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9800000000000001e-06 2024-09-12T22:50:00.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:00.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168041+0000", 2024-09-12T22:50:00.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0629999999999996e-06 2024-09-12T22:50:00.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:00.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248449+0000", 2024-09-12T22:50:00.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.080407948000000007 2024-09-12T22:50:00.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:00.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248491+0000", 2024-09-12T22:50:00.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2027999999999998e-05 2024-09-12T22:50:00.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:00.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248569+0000", 2024-09-12T22:50:00.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8077000000000005e-05 2024-09-12T22:50:00.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:00.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260950+0000", 2024-09-12T22:50:00.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012380901 2024-09-12T22:50:00.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:00.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.261473+0000", 2024-09-12T22:50:00.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00052241699999999996 2024-09-12T22:50:00.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:00.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.261507+0000", 2024-09-12T22:50:00.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4616000000000002e-05 2024-09-12T22:50:00.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:00.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.261537+0000", 2024-09-12T22:50:00.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9369999999999998e-05 2024-09-12T22:50:00.808 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.808 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:00.808 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.809 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1935 3.8 3:17051619:::200.0000000f:head [write 984074~1914 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:00.809 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:50:00.809 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 3.573176862, 2024-09-12T22:50:00.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.097660714999999995, 2024-09-12T22:50:00.809 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:00.809 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:00.809 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:00.809 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:00.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:00.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:50:00.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:00.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:50:00.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:00.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:50:00.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4400000000000001e-07 2024-09-12T22:50:00.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:00.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168052+0000", 2024-09-12T22:50:00.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.886e-06 2024-09-12T22:50:00.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:00.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168059+0000", 2024-09-12T22:50:00.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0489999999999998e-06 2024-09-12T22:50:00.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:00.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168081+0000", 2024-09-12T22:50:00.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1800000000000001e-05 2024-09-12T22:50:00.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:00.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.250512+0000", 2024-09-12T22:50:00.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.082431322000000001 2024-09-12T22:50:00.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:00.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.250621+0000", 2024-09-12T22:50:00.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010908600000000001 2024-09-12T22:50:00.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:00.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.250970+0000", 2024-09-12T22:50:00.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034828399999999997 2024-09-12T22:50:00.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:00.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265532+0000", 2024-09-12T22:50:00.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01456268 2024-09-12T22:50:00.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:00.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265614+0000", 2024-09-12T22:50:00.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1796000000000001e-05 2024-09-12T22:50:00.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:00.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265673+0000", 2024-09-12T22:50:00.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9314000000000002e-05 2024-09-12T22:50:00.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:00.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265709+0000", 2024-09-12T22:50:00.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6053999999999997e-05 2024-09-12T22:50:00.814 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.814 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:00.814 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.815 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1936 3.8 3:17051619:::200.0000000f:head [write 985988~2437 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:00.815 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.168095+0000", 2024-09-12T22:50:00.815 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 3.5731305149999999, 2024-09-12T22:50:00.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.097789345999999999, 2024-09-12T22:50:00.815 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:00.815 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:00.815 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:00.815 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:00.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:00.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168095+0000", 2024-09-12T22:50:00.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:00.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168095+0000", 2024-09-12T22:50:00.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:00.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168096+0000", 2024-09-12T22:50:00.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7700000000000005e-07 2024-09-12T22:50:00.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:00.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168099+0000", 2024-09-12T22:50:00.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.422e-06 2024-09-12T22:50:00.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:00.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168106+0000", 2024-09-12T22:50:00.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6889999999999998e-06 2024-09-12T22:50:00.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:00.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168110+0000", 2024-09-12T22:50:00.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8470000000000003e-06 2024-09-12T22:50:00.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:00.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251622+0000", 2024-09-12T22:50:00.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.083511539999999995 2024-09-12T22:50:00.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:00.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251674+0000", 2024-09-12T22:50:00.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1678999999999998e-05 2024-09-12T22:50:00.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:00.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251744+0000", 2024-09-12T22:50:00.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0440999999999999e-05 2024-09-12T22:50:00.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:00.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265545+0000", 2024-09-12T22:50:00.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013801000000000001 2024-09-12T22:50:00.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:00.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265771+0000", 2024-09-12T22:50:00.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000225632 2024-09-12T22:50:00.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:00.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265835+0000", 2024-09-12T22:50:00.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4541000000000004e-05 2024-09-12T22:50:00.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:00.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265884+0000", 2024-09-12T22:50:00.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9078e-05 2024-09-12T22:50:00.820 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.820 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:00.820 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.820 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1937 3.8 3:17051619:::200.0000000f:head [write 988425~1920 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:00.820 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.171188+0000", 2024-09-12T22:50:00.821 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 3.5700371440000001, 2024-09-12T22:50:00.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.094794626000000007, 2024-09-12T22:50:00.821 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:00.821 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:00.821 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:00.821 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:00.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:00.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171188+0000", 2024-09-12T22:50:00.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:00.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171188+0000", 2024-09-12T22:50:00.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:00.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171189+0000", 2024-09-12T22:50:00.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3200000000000003e-07 2024-09-12T22:50:00.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:00.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171194+0000", 2024-09-12T22:50:00.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2690000000000001e-06 2024-09-12T22:50:00.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:00.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171201+0000", 2024-09-12T22:50:00.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5310000000000004e-06 2024-09-12T22:50:00.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:00.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171206+0000", 2024-09-12T22:50:00.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7049999999999998e-06 2024-09-12T22:50:00.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:00.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254169+0000", 2024-09-12T22:50:00.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.082962835999999998 2024-09-12T22:50:00.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:00.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254263+0000", 2024-09-12T22:50:00.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3844999999999993e-05 2024-09-12T22:50:00.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:00.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254398+0000", 2024-09-12T22:50:00.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013560499999999999 2024-09-12T22:50:00.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:00.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265897+0000", 2024-09-12T22:50:00.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01149846 2024-09-12T22:50:00.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:00.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265922+0000", 2024-09-12T22:50:00.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5130000000000002e-05 2024-09-12T22:50:00.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:00.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265954+0000", 2024-09-12T22:50:00.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2512999999999999e-05 2024-09-12T22:50:00.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:00.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265983+0000", 2024-09-12T22:50:00.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8799999999999999e-05 2024-09-12T22:50:00.826 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.826 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:00.826 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.826 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1938 3.8 3:17051619:::200.0000000f:head [write 990345~2499 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:00.826 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:50:00.826 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 3.5699969650000001, 2024-09-12T22:50:00.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.094864730999999994, 2024-09-12T22:50:00.826 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:00.826 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:00.826 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:00.827 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:00.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:00.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:50:00.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:00.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:50:00.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:00.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:50:00.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:50:00.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:00.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171242+0000", 2024-09-12T22:50:00.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3111e-05 2024-09-12T22:50:00.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:00.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171247+0000", 2024-09-12T22:50:00.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0939999999999998e-06 2024-09-12T22:50:00.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:00.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171251+0000", 2024-09-12T22:50:00.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.298e-06 2024-09-12T22:50:00.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:00.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254869+0000", 2024-09-12T22:50:00.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.083618681 2024-09-12T22:50:00.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:00.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254957+0000", 2024-09-12T22:50:00.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7783999999999998e-05 2024-09-12T22:50:00.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:00.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255093+0000", 2024-09-12T22:50:00.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013579600000000001 2024-09-12T22:50:00.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:00.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265997+0000", 2024-09-12T22:50:00.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010903777999999999 2024-09-12T22:50:00.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:00.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266047+0000", 2024-09-12T22:50:00.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0151999999999997e-05 2024-09-12T22:50:00.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:00.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266075+0000", 2024-09-12T22:50:00.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8082e-05 2024-09-12T22:50:00.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:00.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266093+0000", 2024-09-12T22:50:00.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8396000000000001e-05 2024-09-12T22:50:00.831 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.831 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:00.831 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.832 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1944 3.8 3:17051619:::200.0000000f:head [write 1037561~3947 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:00.832 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.186089+0000", 2024-09-12T22:50:00.832 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 3.5551367149999997, 2024-09-12T22:50:00.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087755745999999996, 2024-09-12T22:50:00.832 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:00.832 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:00.832 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:00.832 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:00.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:00.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186089+0000", 2024-09-12T22:50:00.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:00.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186089+0000", 2024-09-12T22:50:00.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:00.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186090+0000", 2024-09-12T22:50:00.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1349999999999999e-06 2024-09-12T22:50:00.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:00.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186098+0000", 2024-09-12T22:50:00.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8390000000000007e-06 2024-09-12T22:50:00.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:00.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186106+0000", 2024-09-12T22:50:00.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4619999999999996e-06 2024-09-12T22:50:00.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:00.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186111+0000", 2024-09-12T22:50:00.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.057e-06 2024-09-12T22:50:00.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:00.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.264543+0000", 2024-09-12T22:50:00.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078432044000000006 2024-09-12T22:50:00.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:00.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.264617+0000", 2024-09-12T22:50:00.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3789999999999997e-05 2024-09-12T22:50:00.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:00.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.264760+0000", 2024-09-12T22:50:00.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014318499999999999 2024-09-12T22:50:00.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:00.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268441+0000", 2024-09-12T22:50:00.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036809360000000001 2024-09-12T22:50:00.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:00.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273776+0000", 2024-09-12T22:50:00.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053346449999999998 2024-09-12T22:50:00.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:00.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273807+0000", 2024-09-12T22:50:00.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1352000000000001e-05 2024-09-12T22:50:00.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:00.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273845+0000", 2024-09-12T22:50:00.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7301000000000001e-05 2024-09-12T22:50:00.837 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.837 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:00.837 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.837 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1945 3.8 3:17051619:::200.0000000f:head [write 1041508~10144 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:00.837 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:50:00.837 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 3.5548599429999999, 2024-09-12T22:50:00.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087573128, 2024-09-12T22:50:00.837 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:00.837 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:00.838 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:00.838 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:00.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:00.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:50:00.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:00.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:50:00.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:00.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:50:00.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1600000000000001e-07 2024-09-12T22:50:00.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:00.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186377+0000", 2024-09-12T22:50:00.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0301e-05 2024-09-12T22:50:00.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:00.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186386+0000", 2024-09-12T22:50:00.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5619999999999993e-06 2024-09-12T22:50:00.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:00.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186393+0000", 2024-09-12T22:50:00.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7150000000000001e-06 2024-09-12T22:50:00.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:00.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266725+0000", 2024-09-12T22:50:00.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.080331893000000001 2024-09-12T22:50:00.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:00.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266799+0000", 2024-09-12T22:50:00.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4086999999999997e-05 2024-09-12T22:50:00.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:00.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266904+0000", 2024-09-12T22:50:00.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105475 2024-09-12T22:50:00.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:00.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273882+0000", 2024-09-12T22:50:00.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069773780000000002 2024-09-12T22:50:00.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:00.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273889+0000", 2024-09-12T22:50:00.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1049999999999997e-06 2024-09-12T22:50:00.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:00.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273916+0000", 2024-09-12T22:50:00.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6716e-05 2024-09-12T22:50:00.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:00.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273939+0000", 2024-09-12T22:50:00.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3180000000000002e-05 2024-09-12T22:50:00.843 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.843 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:00.843 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.843 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1946 3.8 3:17051619:::200.0000000f:head [write 1051652~3875 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:00.843 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.186888+0000", 2024-09-12T22:50:00.843 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 3.5543376640000002, 2024-09-12T22:50:00.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087165134000000005, 2024-09-12T22:50:00.843 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:00.843 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:00.843 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:00.843 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:00.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:00.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186888+0000", 2024-09-12T22:50:00.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:00.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186888+0000", 2024-09-12T22:50:00.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:00.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186889+0000", 2024-09-12T22:50:00.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2500000000000005e-07 2024-09-12T22:50:00.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:00.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186894+0000", 2024-09-12T22:50:00.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3900000000000001e-06 2024-09-12T22:50:00.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:00.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186901+0000", 2024-09-12T22:50:00.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5649999999999998e-06 2024-09-12T22:50:00.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:00.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186906+0000", 2024-09-12T22:50:00.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0390000000000004e-06 2024-09-12T22:50:00.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:00.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.267852+0000", 2024-09-12T22:50:00.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.080946389999999993 2024-09-12T22:50:00.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:00.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.267910+0000", 2024-09-12T22:50:00.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7655999999999998e-05 2024-09-12T22:50:00.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:00.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.267981+0000", 2024-09-12T22:50:00.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0916999999999999e-05 2024-09-12T22:50:00.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:00.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273944+0000", 2024-09-12T22:50:00.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0059635570000000004 2024-09-12T22:50:00.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:00.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273993+0000", 2024-09-12T22:50:00.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8350000000000003e-05 2024-09-12T22:50:00.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:00.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274022+0000", 2024-09-12T22:50:00.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9899999999999998e-05 2024-09-12T22:50:00.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:00.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274053+0000", 2024-09-12T22:50:00.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0645000000000002e-05 2024-09-12T22:50:00.848 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.848 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:00.848 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.849 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1947 3.8 3:17051619:::200.0000000f:head [write 1055527~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:00.849 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.187014+0000", 2024-09-12T22:50:00.849 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 3.5542114300000001, 2024-09-12T22:50:00.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087114608999999996, 2024-09-12T22:50:00.849 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:00.849 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:00.849 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:00.849 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:00.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:00.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187014+0000", 2024-09-12T22:50:00.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:00.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187014+0000", 2024-09-12T22:50:00.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:00.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187015+0000", 2024-09-12T22:50:00.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1500000000000004e-07 2024-09-12T22:50:00.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:00.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187018+0000", 2024-09-12T22:50:00.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.033e-06 2024-09-12T22:50:00.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:00.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187023+0000", 2024-09-12T22:50:00.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7550000000000002e-06 2024-09-12T22:50:00.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:00.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187026+0000", 2024-09-12T22:50:00.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2710000000000001e-06 2024-09-12T22:50:00.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:00.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268462+0000", 2024-09-12T22:50:00.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.081435699 2024-09-12T22:50:00.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:00.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268507+0000", 2024-09-12T22:50:00.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5643999999999999e-05 2024-09-12T22:50:00.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:00.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268597+0000", 2024-09-12T22:50:00.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0112999999999996e-05 2024-09-12T22:50:00.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:00.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273947+0000", 2024-09-12T22:50:00.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053501859999999998 2024-09-12T22:50:00.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:00.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274083+0000", 2024-09-12T22:50:00.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013525500000000001 2024-09-12T22:50:00.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:00.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274109+0000", 2024-09-12T22:50:00.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6352000000000001e-05 2024-09-12T22:50:00.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:00.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274129+0000", 2024-09-12T22:50:00.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9686000000000001e-05 2024-09-12T22:50:00.854 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.854 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:00.854 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.854 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1948 3.8 3:17051619:::200.0000000f:head [write 1057443~1896 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:00.854 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.189230+0000", 2024-09-12T22:50:00.854 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 3.5519956179999999, 2024-09-12T22:50:00.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.085028962999999999, 2024-09-12T22:50:00.854 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:00.855 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:00.855 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:00.855 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:00.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:00.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189230+0000", 2024-09-12T22:50:00.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:00.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189230+0000", 2024-09-12T22:50:00.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:00.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:00.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189231+0000", 2024-09-12T22:50:00.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1399999999999996e-07 2024-09-12T22:50:00.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:00.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189235+0000", 2024-09-12T22:50:00.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5970000000000002e-06 2024-09-12T22:50:00.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:00.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189242+0000", 2024-09-12T22:50:00.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8510000000000001e-06 2024-09-12T22:50:00.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:00.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189247+0000", 2024-09-12T22:50:00.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4800000000000003e-06 2024-09-12T22:50:00.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:00.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268908+0000", 2024-09-12T22:50:00.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079660983000000005 2024-09-12T22:50:00.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:00.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268967+0000", 2024-09-12T22:50:00.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9595000000000001e-05 2024-09-12T22:50:00.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:00.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.269040+0000", 2024-09-12T22:50:00.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2643000000000002e-05 2024-09-12T22:50:00.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:00.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273950+0000", 2024-09-12T22:50:00.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049105329999999999 2024-09-12T22:50:00.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:00.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274199+0000", 2024-09-12T22:50:00.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024824999999999999 2024-09-12T22:50:00.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:00.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274226+0000", 2024-09-12T22:50:00.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7602000000000001e-05 2024-09-12T22:50:00.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:00.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:00.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:00.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274259+0000", 2024-09-12T22:50:00.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2614999999999999e-05 2024-09-12T22:50:00.859 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.859 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:00.860 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.860 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:00.860 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:00.860 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:50:00.861 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:50:00.862 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:00.860+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:00.962 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:00.961+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:00.967 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:50:00.967 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:50:00.967 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:50:00.967 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:50:00.976 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:50:01.062 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:01.061+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:01.121 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:50:01.121 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:50:01.121 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:50:01.121 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:50:01.122 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:50:01.130 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:50:01.163 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:01.163+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:01.246 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:50:01.247 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:50:01.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:50:01.247 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:50:01.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.247 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12403 4.0 4:0146e0d0:::100000031d4.00000000:head [write 0~4194304 [2@3733965]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:01.247 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:55.747692+0000", 2024-09-12T22:50:01.247 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.4967218610000002, 2024-09-12T22:50:01.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.22362137500000001, 2024-09-12T22:50:01.247 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:01.247 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:01.248 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.248 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:01.248 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:01.248 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:01.248 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12403 2024-09-12T22:50:01.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.248 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:01.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:01.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.747692+0000", 2024-09-12T22:50:01.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:01.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.747692+0000", 2024-09-12T22:50:01.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:01.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.747693+0000", 2024-09-12T22:50:01.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3799999999999996e-07 2024-09-12T22:50:01.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:01.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959640+0000", 2024-09-12T22:50:01.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.21194702000000001 2024-09-12T22:50:01.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:01.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959660+0000", 2024-09-12T22:50:01.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9939e-05 2024-09-12T22:50:01.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959668+0000", 2024-09-12T22:50:01.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1669999999999999e-06 2024-09-12T22:50:01.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:01.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959764+0000", 2024-09-12T22:50:01.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5315000000000005e-05 2024-09-12T22:50:01.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:01.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959865+0000", 2024-09-12T22:50:01.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101618 2024-09-12T22:50:01.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:01.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.971224+0000", 2024-09-12T22:50:01.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011358541999999999 2024-09-12T22:50:01.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:01.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.971261+0000", 2024-09-12T22:50:01.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7092999999999999e-05 2024-09-12T22:50:01.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:01.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.971314+0000", 2024-09-12T22:50:01.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2843000000000002e-05 2024-09-12T22:50:01.252 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.252 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:01.252 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.253 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:12503 4.15 e56/17 4:ab29d13f:::100000033b1.00000000:head v 56'161, mlcod=55'159)", 2024-09-12T22:50:01.253 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:50:01.253 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.213808384, 2024-09-12T22:50:01.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.043668640000000002, 2024-09-12T22:50:01.253 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:01.253 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:01.253 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.253 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:01.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:01.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:50:01.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:01.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:50:01.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:01.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:50:01.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:50:01.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:01.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039768+0000", 2024-09-12T22:50:01.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0091617190000000005 2024-09-12T22:50:01.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:01.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039781+0000", 2024-09-12T22:50:01.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2829e-05 2024-09-12T22:50:01.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039789+0000", 2024-09-12T22:50:01.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9340000000000006e-06 2024-09-12T22:50:01.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:01.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039846+0000", 2024-09-12T22:50:01.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6762999999999998e-05 2024-09-12T22:50:01.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:01.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039897+0000", 2024-09-12T22:50:01.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1517000000000002e-05 2024-09-12T22:50:01.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:01.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074225+0000", 2024-09-12T22:50:01.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034328138000000001 2024-09-12T22:50:01.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:01.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074274+0000", 2024-09-12T22:50:01.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9255999999999997e-05 2024-09-12T22:50:01.258 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.258 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:01.258 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.258 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12508 4.2d 4:b7b19b64:::10000003230.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:01.258 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.037293+0000", 2024-09-12T22:50:01.259 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.2071212090000003, 2024-09-12T22:50:01.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.037399772999999997, 2024-09-12T22:50:01.259 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:01.259 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:01.259 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.259 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:01.259 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:01.259 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:01.259 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12508 2024-09-12T22:50:01.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.259 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:01.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:01.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037293+0000", 2024-09-12T22:50:01.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:01.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037293+0000", 2024-09-12T22:50:01.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:01.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037294+0000", 2024-09-12T22:50:01.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4899999999999995e-07 2024-09-12T22:50:01.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:01.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042701+0000", 2024-09-12T22:50:01.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054069419999999997 2024-09-12T22:50:01.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:01.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042712+0000", 2024-09-12T22:50:01.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.171e-05 2024-09-12T22:50:01.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042719+0000", 2024-09-12T22:50:01.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1189999999999999e-06 2024-09-12T22:50:01.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:01.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042759+0000", 2024-09-12T22:50:01.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9478999999999999e-05 2024-09-12T22:50:01.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:01.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042827+0000", 2024-09-12T22:50:01.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8435999999999993e-05 2024-09-12T22:50:01.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:01.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042965+0000", 2024-09-12T22:50:01.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000137723 2024-09-12T22:50:01.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:01.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.058351+0000", 2024-09-12T22:50:01.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015385902 2024-09-12T22:50:01.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:01.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074620+0000", 2024-09-12T22:50:01.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016269018 2024-09-12T22:50:01.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:01.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074657+0000", 2024-09-12T22:50:01.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6619999999999998e-05 2024-09-12T22:50:01.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:01.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074693+0000", 2024-09-12T22:50:01.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6174999999999998e-05 2024-09-12T22:50:01.264 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.264 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:01.264 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.265 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12516 4.21 4:858ae08d:::100000030eb.00000000:head [write 0~4194304 [3@1582458]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:01.265 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.045143+0000", 2024-09-12T22:50:01.265 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.1992709210000001, 2024-09-12T22:50:01.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.039721657, 2024-09-12T22:50:01.265 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:01.265 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:01.265 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.265 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:01.265 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:01.265 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:01.265 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12516 2024-09-12T22:50:01.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.266 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:01.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:01.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.045143+0000", 2024-09-12T22:50:01.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:01.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.045143+0000", 2024-09-12T22:50:01.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:01.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.045144+0000", 2024-09-12T22:50:01.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2900000000000002e-07 2024-09-12T22:50:01.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:01.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049506+0000", 2024-09-12T22:50:01.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043620280000000004 2024-09-12T22:50:01.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:01.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049517+0000", 2024-09-12T22:50:01.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0726e-05 2024-09-12T22:50:01.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049522+0000", 2024-09-12T22:50:01.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3730000000000001e-06 2024-09-12T22:50:01.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:01.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049583+0000", 2024-09-12T22:50:01.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1254999999999995e-05 2024-09-12T22:50:01.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:01.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049645+0000", 2024-09-12T22:50:01.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1988000000000003e-05 2024-09-12T22:50:01.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:01.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049731+0000", 2024-09-12T22:50:01.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6040999999999998e-05 2024-09-12T22:50:01.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:01.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.064126+0000", 2024-09-12T22:50:01.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01439497 2024-09-12T22:50:01.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:01.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.084785+0000", 2024-09-12T22:50:01.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020658972000000001 2024-09-12T22:50:01.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:01.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.084829+0000", 2024-09-12T22:50:01.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3869000000000003e-05 2024-09-12T22:50:01.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:01.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.084865+0000", 2024-09-12T22:50:01.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5605999999999998e-05 2024-09-12T22:50:01.271 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.271 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:01.271 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.271 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1354 3.18 3:1e8917d7:::200.0000000e:head [write 498872~14494 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:01.271 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.048337+0000", 2024-09-12T22:50:01.272 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.196077002, 2024-09-12T22:50:01.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034292491000000001, 2024-09-12T22:50:01.272 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:01.272 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:01.272 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.273 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:01.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:01.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048337+0000", 2024-09-12T22:50:01.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:01.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048337+0000", 2024-09-12T22:50:01.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:01.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048339+0000", 2024-09-12T22:50:01.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.409e-06 2024-09-12T22:50:01.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:01.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048360+0000", 2024-09-12T22:50:01.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1659999999999999e-05 2024-09-12T22:50:01.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:01.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048370+0000", 2024-09-12T22:50:01.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.611e-06 2024-09-12T22:50:01.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048376+0000", 2024-09-12T22:50:01.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5479999999999998e-06 2024-09-12T22:50:01.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:01.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048440+0000", 2024-09-12T22:50:01.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3367000000000005e-05 2024-09-12T22:50:01.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:01.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048557+0000", 2024-09-12T22:50:01.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116983 2024-09-12T22:50:01.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:01.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048719+0000", 2024-09-12T22:50:01.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016250499999999999 2024-09-12T22:50:01.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:01.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.058763+0000", 2024-09-12T22:50:01.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010043948 2024-09-12T22:50:01.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:01.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082499+0000", 2024-09-12T22:50:01.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023735320000000001 2024-09-12T22:50:01.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:01.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082561+0000", 2024-09-12T22:50:01.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2490000000000006e-05 2024-09-12T22:50:01.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:01.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082630+0000", 2024-09-12T22:50:01.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8650000000000002e-05 2024-09-12T22:50:01.280 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.280 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:01.280 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.280 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12517 4.1a 4:5a8c04dd:::10000003276.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:01.280 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.049539+0000", 2024-09-12T22:50:01.280 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.19487524, 2024-09-12T22:50:01.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.036068957999999998, 2024-09-12T22:50:01.280 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:01.281 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:01.281 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.281 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:01.281 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:01.281 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:01.281 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12517 2024-09-12T22:50:01.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.281 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:01.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:01.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049539+0000", 2024-09-12T22:50:01.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:01.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049539+0000", 2024-09-12T22:50:01.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:01.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049540+0000", 2024-09-12T22:50:01.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1299999999999999e-07 2024-09-12T22:50:01.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:01.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054581+0000", 2024-09-12T22:50:01.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005041167 2024-09-12T22:50:01.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:01.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054593+0000", 2024-09-12T22:50:01.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1943000000000001e-05 2024-09-12T22:50:01.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054598+0000", 2024-09-12T22:50:01.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6500000000000001e-06 2024-09-12T22:50:01.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:01.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054658+0000", 2024-09-12T22:50:01.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9898999999999997e-05 2024-09-12T22:50:01.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:01.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054800+0000", 2024-09-12T22:50:01.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014187100000000001 2024-09-12T22:50:01.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:01.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.085456+0000", 2024-09-12T22:50:01.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.030655452 2024-09-12T22:50:01.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:01.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.085533+0000", 2024-09-12T22:50:01.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7478999999999995e-05 2024-09-12T22:50:01.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:01.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.085608+0000", 2024-09-12T22:50:01.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4684000000000005e-05 2024-09-12T22:50:01.286 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.286 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:01.287 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.287 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12677 4.10 4:0b7ac23f:::10000003457.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:01.287 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:50:01.287 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.015000444, 2024-09-12T22:50:01.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033661045000000001, 2024-09-12T22:50:01.287 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:01.287 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:01.287 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.287 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:01.288 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:01.288 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:01.288 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12677 2024-09-12T22:50:01.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.288 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:01.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:01.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:50:01.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:01.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:50:01.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:01.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:50:01.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0100000000000005e-07 2024-09-12T22:50:01.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:01.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.237295+0000", 2024-09-12T22:50:01.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078803290000000002 2024-09-12T22:50:01.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:01.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.237307+0000", 2024-09-12T22:50:01.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2339e-05 2024-09-12T22:50:01.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.237312+0000", 2024-09-12T22:50:01.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9089999999999999e-06 2024-09-12T22:50:01.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:01.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.239034+0000", 2024-09-12T22:50:01.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001722424 2024-09-12T22:50:01.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:01.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.239129+0000", 2024-09-12T22:50:01.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4486000000000003e-05 2024-09-12T22:50:01.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:01.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.239206+0000", 2024-09-12T22:50:01.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7146999999999998e-05 2024-09-12T22:50:01.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:01.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.255921+0000", 2024-09-12T22:50:01.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016714685 2024-09-12T22:50:01.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:01.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.263025+0000", 2024-09-12T22:50:01.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071042470000000002 2024-09-12T22:50:01.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:01.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.263052+0000", 2024-09-12T22:50:01.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7195e-05 2024-09-12T22:50:01.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:01.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.263075+0000", 2024-09-12T22:50:01.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2782999999999999e-05 2024-09-12T22:50:01.293 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.293 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:01.293 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.293 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12979 4.1e 4:78503759:::10000003406.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:01.294 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:50:01.294 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.6793136479999999, 2024-09-12T22:50:01.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032861456999999997, 2024-09-12T22:50:01.294 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:01.294 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:01.294 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.294 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:01.294 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:01.294 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:01.294 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12979 2024-09-12T22:50:01.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.294 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:01.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:01.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:50:01.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:01.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:50:01.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:01.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:50:01.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9999999999999998e-07 2024-09-12T22:50:01.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:01.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573365+0000", 2024-09-12T22:50:01.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082644229999999999 2024-09-12T22:50:01.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:01.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573379+0000", 2024-09-12T22:50:01.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3322999999999999e-05 2024-09-12T22:50:01.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573386+0000", 2024-09-12T22:50:01.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.199e-06 2024-09-12T22:50:01.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:01.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573464+0000", 2024-09-12T22:50:01.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7931999999999999e-05 2024-09-12T22:50:01.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:01.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573713+0000", 2024-09-12T22:50:01.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024922200000000001 2024-09-12T22:50:01.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:01.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.597870+0000", 2024-09-12T22:50:01.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024157221999999999 2024-09-12T22:50:01.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:01.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.597926+0000", 2024-09-12T22:50:01.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5838000000000003e-05 2024-09-12T22:50:01.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:01.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.597962+0000", 2024-09-12T22:50:01.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5898000000000001e-05 2024-09-12T22:50:01.299 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.299 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:01.299 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.299 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:13017 4.3b e56/17 4:deb39c3c:::1000000315d.00000000:head v 56'194, mlcod=56'192)", 2024-09-12T22:50:01.299 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.600876+0000", 2024-09-12T22:50:01.299 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.6435381719999995, 2024-09-12T22:50:01.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038152448999999998, 2024-09-12T22:50:01.299 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:01.299 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:01.300 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.300 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:01.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:01.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.600876+0000", 2024-09-12T22:50:01.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:01.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.600876+0000", 2024-09-12T22:50:01.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:01.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.600877+0000", 2024-09-12T22:50:01.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:50:01.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:01.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609737+0000", 2024-09-12T22:50:01.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088599089999999991 2024-09-12T22:50:01.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:01.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609748+0000", 2024-09-12T22:50:01.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1355999999999999e-05 2024-09-12T22:50:01.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609757+0000", 2024-09-12T22:50:01.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9190000000000005e-06 2024-09-12T22:50:01.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:01.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609801+0000", 2024-09-12T22:50:01.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4019e-05 2024-09-12T22:50:01.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:01.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609816+0000", 2024-09-12T22:50:01.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5226e-05 2024-09-12T22:50:01.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:01.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.638985+0000", 2024-09-12T22:50:01.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029168537000000001 2024-09-12T22:50:01.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:01.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.639028+0000", 2024-09-12T22:50:01.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3847000000000002e-05 2024-09-12T22:50:01.303 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.303 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:01.304 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.304 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13032 4.7 4:e102bf81:::1000000359e.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:01.304 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.616553+0000", 2024-09-12T22:50:01.304 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.6278613200000001, 2024-09-12T22:50:01.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032471027999999999, 2024-09-12T22:50:01.304 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:01.304 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:01.304 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.304 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:01.304 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:01.304 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:01.305 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13032 2024-09-12T22:50:01.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.305 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:01.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:01.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.616553+0000", 2024-09-12T22:50:01.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:01.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.616553+0000", 2024-09-12T22:50:01.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:01.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.616554+0000", 2024-09-12T22:50:01.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0100000000000004e-07 2024-09-12T22:50:01.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:01.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621405+0000", 2024-09-12T22:50:01.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0048517480000000003 2024-09-12T22:50:01.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:01.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621416+0000", 2024-09-12T22:50:01.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0264e-05 2024-09-12T22:50:01.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621446+0000", 2024-09-12T22:50:01.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0849000000000002e-05 2024-09-12T22:50:01.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:01.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621494+0000", 2024-09-12T22:50:01.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7018000000000003e-05 2024-09-12T22:50:01.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:01.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621590+0000", 2024-09-12T22:50:01.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6632999999999995e-05 2024-09-12T22:50:01.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:01.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621680+0000", 2024-09-12T22:50:01.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9704999999999996e-05 2024-09-12T22:50:01.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:01.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.639248+0000", 2024-09-12T22:50:01.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017568548 2024-09-12T22:50:01.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:01.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.648944+0000", 2024-09-12T22:50:01.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0096954659999999998 2024-09-12T22:50:01.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:01.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.648992+0000", 2024-09-12T22:50:01.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8059999999999997e-05 2024-09-12T22:50:01.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:01.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.649024+0000", 2024-09-12T22:50:01.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1936000000000001e-05 2024-09-12T22:50:01.310 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.310 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:01.310 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.310 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13428 4.37 4:eeed8456:::1000000321a.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:01.310 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.064666+0000", 2024-09-12T22:50:01.310 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.1797480419999999, 2024-09-12T22:50:01.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033441308000000003, 2024-09-12T22:50:01.310 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:01.310 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:01.311 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.311 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:01.311 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:01.311 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:01.311 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13428 2024-09-12T22:50:01.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.311 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:01.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:01.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.064666+0000", 2024-09-12T22:50:01.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:01.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.064666+0000", 2024-09-12T22:50:01.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:01.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.064668+0000", 2024-09-12T22:50:01.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4160000000000001e-06 2024-09-12T22:50:01.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:01.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071829+0000", 2024-09-12T22:50:01.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071611390000000004 2024-09-12T22:50:01.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:01.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071840+0000", 2024-09-12T22:50:01.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1369000000000001e-05 2024-09-12T22:50:01.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071847+0000", 2024-09-12T22:50:01.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0960000000000003e-06 2024-09-12T22:50:01.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:01.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071904+0000", 2024-09-12T22:50:01.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7309000000000003e-05 2024-09-12T22:50:01.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:01.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.072051+0000", 2024-09-12T22:50:01.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014625 2024-09-12T22:50:01.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:01.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.072194+0000", 2024-09-12T22:50:01.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014379799999999999 2024-09-12T22:50:01.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:01.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.079527+0000", 2024-09-12T22:50:01.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007332674 2024-09-12T22:50:01.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:01.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.098048+0000", 2024-09-12T22:50:01.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018521174000000001 2024-09-12T22:50:01.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:01.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.098081+0000", 2024-09-12T22:50:01.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2910999999999997e-05 2024-09-12T22:50:01.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:01.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.098107+0000", 2024-09-12T22:50:01.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6171999999999999e-05 2024-09-12T22:50:01.316 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.316 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:01.316 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.317 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13472 4.12 4:4b0bd9b8:::100000033b0.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:01.317 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.113168+0000", 2024-09-12T22:50:01.317 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.1312463429999999, 2024-09-12T22:50:01.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.039534103000000001, 2024-09-12T22:50:01.317 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:01.317 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:01.317 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.317 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:01.317 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:01.317 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:01.317 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13472 2024-09-12T22:50:01.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.318 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:01.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:01.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.113168+0000", 2024-09-12T22:50:01.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:01.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.113168+0000", 2024-09-12T22:50:01.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:01.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.113169+0000", 2024-09-12T22:50:01.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1960000000000001e-06 2024-09-12T22:50:01.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:01.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119849+0000", 2024-09-12T22:50:01.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0066801830000000001 2024-09-12T22:50:01.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:01.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119861+0000", 2024-09-12T22:50:01.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.199e-05 2024-09-12T22:50:01.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119866+0000", 2024-09-12T22:50:01.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8720000000000001e-06 2024-09-12T22:50:01.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:01.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119945+0000", 2024-09-12T22:50:01.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9268000000000001e-05 2024-09-12T22:50:01.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:01.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.120098+0000", 2024-09-12T22:50:01.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015299500000000001 2024-09-12T22:50:01.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:01.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.120218+0000", 2024-09-12T22:50:01.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011989099999999999 2024-09-12T22:50:01.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:01.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.140463+0000", 2024-09-12T22:50:01.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020244765000000001 2024-09-12T22:50:01.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:01.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.152629+0000", 2024-09-12T22:50:01.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012165601999999999 2024-09-12T22:50:01.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:01.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.152664+0000", 2024-09-12T22:50:01.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5599999999999998e-05 2024-09-12T22:50:01.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:01.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.152702+0000", 2024-09-12T22:50:01.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7741000000000003e-05 2024-09-12T22:50:01.322 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.322 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:01.323 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.323 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13484 4.2f 4:f62c2e43:::1000000349e.00000000:head [write 0~4194304 [2@3461078]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:01.323 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.125796+0000", 2024-09-12T22:50:01.323 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.1186179799999998, 2024-09-12T22:50:01.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.036857236000000002, 2024-09-12T22:50:01.323 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:01.323 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:01.323 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.323 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:01.323 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:01.323 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:01.324 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13484 2024-09-12T22:50:01.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.324 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:01.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:01.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.125796+0000", 2024-09-12T22:50:01.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:01.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.125796+0000", 2024-09-12T22:50:01.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:01.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.125797+0000", 2024-09-12T22:50:01.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.108e-06 2024-09-12T22:50:01.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:01.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130725+0000", 2024-09-12T22:50:01.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049272949999999999 2024-09-12T22:50:01.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:01.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130739+0000", 2024-09-12T22:50:01.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4234e-05 2024-09-12T22:50:01.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130751+0000", 2024-09-12T22:50:01.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1848000000000001e-05 2024-09-12T22:50:01.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:01.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130816+0000", 2024-09-12T22:50:01.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5359999999999998e-05 2024-09-12T22:50:01.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:01.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130917+0000", 2024-09-12T22:50:01.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101178 2024-09-12T22:50:01.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:01.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.131058+0000", 2024-09-12T22:50:01.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140803 2024-09-12T22:50:01.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:01.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.153387+0000", 2024-09-12T22:50:01.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022328585000000001 2024-09-12T22:50:01.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:01.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.162465+0000", 2024-09-12T22:50:01.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090781360000000005 2024-09-12T22:50:01.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:01.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.162584+0000", 2024-09-12T22:50:01.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119634 2024-09-12T22:50:01.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:01.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.162653+0000", 2024-09-12T22:50:01.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9054999999999995e-05 2024-09-12T22:50:01.329 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.329 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:01.329 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.329 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13558 4.10 4:09df41af:::1000000333c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:01.329 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.229326+0000", 2024-09-12T22:50:01.329 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.0150881519999997, 2024-09-12T22:50:01.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.039409786000000002, 2024-09-12T22:50:01.329 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:01.329 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:01.329 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.329 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:01.330 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:01.330 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:01.330 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13558 2024-09-12T22:50:01.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.330 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:01.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:01.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.229326+0000", 2024-09-12T22:50:01.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:01.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.229326+0000", 2024-09-12T22:50:01.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:01.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.229327+0000", 2024-09-12T22:50:01.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1200000000000002e-07 2024-09-12T22:50:01.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:01.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235243+0000", 2024-09-12T22:50:01.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059166310000000003 2024-09-12T22:50:01.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:01.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235255+0000", 2024-09-12T22:50:01.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1174e-05 2024-09-12T22:50:01.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235260+0000", 2024-09-12T22:50:01.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1749999999999996e-06 2024-09-12T22:50:01.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:01.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235295+0000", 2024-09-12T22:50:01.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4830999999999999e-05 2024-09-12T22:50:01.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:01.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235350+0000", 2024-09-12T22:50:01.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5092e-05 2024-09-12T22:50:01.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:01.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235426+0000", 2024-09-12T22:50:01.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6463000000000003e-05 2024-09-12T22:50:01.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:01.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.244772+0000", 2024-09-12T22:50:01.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0093457709999999992 2024-09-12T22:50:01.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:01.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.268679+0000", 2024-09-12T22:50:01.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023906788000000002 2024-09-12T22:50:01.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:01.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.268712+0000", 2024-09-12T22:50:01.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3701999999999997e-05 2024-09-12T22:50:01.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:01.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.268736+0000", 2024-09-12T22:50:01.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3447000000000001e-05 2024-09-12T22:50:01.335 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.335 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:01.335 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.335 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13747 4.1e 4:7aa36f33:::100000035ed.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:01.335 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.457376+0000", 2024-09-12T22:50:01.335 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.7870380379999999, 2024-09-12T22:50:01.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.037057578000000001, 2024-09-12T22:50:01.335 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:01.335 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:01.336 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.336 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:01.336 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:01.336 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:01.336 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13747 2024-09-12T22:50:01.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.336 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:01.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:01.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.457376+0000", 2024-09-12T22:50:01.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:01.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.457376+0000", 2024-09-12T22:50:01.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:01.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.457377+0000", 2024-09-12T22:50:01.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1699999999999998e-07 2024-09-12T22:50:01.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:01.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464400+0000", 2024-09-12T22:50:01.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070235890000000002 2024-09-12T22:50:01.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:01.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464413+0000", 2024-09-12T22:50:01.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2397e-05 2024-09-12T22:50:01.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464418+0000", 2024-09-12T22:50:01.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5119999999999999e-06 2024-09-12T22:50:01.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:01.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464464+0000", 2024-09-12T22:50:01.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5976000000000002e-05 2024-09-12T22:50:01.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:01.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464529+0000", 2024-09-12T22:50:01.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5266999999999997e-05 2024-09-12T22:50:01.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:01.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.494315+0000", 2024-09-12T22:50:01.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029785329999999999 2024-09-12T22:50:01.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:01.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.494366+0000", 2024-09-12T22:50:01.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0903999999999999e-05 2024-09-12T22:50:01.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:01.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.494434+0000", 2024-09-12T22:50:01.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7985999999999996e-05 2024-09-12T22:50:01.340 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.340 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:01.340 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.341 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:13748 4.15 e56/17 4:ab1b03eb:::100000031a3.00000000:head v 56'173, mlcod=56'171)", 2024-09-12T22:50:01.341 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.462509+0000", 2024-09-12T22:50:01.341 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.7819049910000002, 2024-09-12T22:50:01.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044366823, 2024-09-12T22:50:01.341 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:01.341 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:01.341 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.341 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:01.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:01.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.462509+0000", 2024-09-12T22:50:01.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:01.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.462509+0000", 2024-09-12T22:50:01.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:01.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.462509+0000", 2024-09-12T22:50:01.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7599999999999998e-07 2024-09-12T22:50:01.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:01.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471576+0000", 2024-09-12T22:50:01.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090665490000000001 2024-09-12T22:50:01.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:01.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471591+0000", 2024-09-12T22:50:01.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4566000000000001e-05 2024-09-12T22:50:01.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471600+0000", 2024-09-12T22:50:01.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1630000000000002e-06 2024-09-12T22:50:01.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:01.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471689+0000", 2024-09-12T22:50:01.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9591000000000003e-05 2024-09-12T22:50:01.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:01.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471735+0000", 2024-09-12T22:50:01.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5429000000000002e-05 2024-09-12T22:50:01.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:01.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.506851+0000", 2024-09-12T22:50:01.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035116238000000001 2024-09-12T22:50:01.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:01.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.506876+0000", 2024-09-12T22:50:01.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5011000000000002e-05 2024-09-12T22:50:01.345 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.345 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:01.345 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.345 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13753 4.30 4:0dea61b7:::100000036ed.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:01.345 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.464559+0000", 2024-09-12T22:50:01.345 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.7798549919999997, 2024-09-12T22:50:01.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041415303000000001, 2024-09-12T22:50:01.346 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:01.346 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:01.346 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.346 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:01.346 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:01.346 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:01.346 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13753 2024-09-12T22:50:01.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.346 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:01.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:01.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464559+0000", 2024-09-12T22:50:01.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:01.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464559+0000", 2024-09-12T22:50:01.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:01.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464560+0000", 2024-09-12T22:50:01.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:50:01.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:01.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469861+0000", 2024-09-12T22:50:01.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053017139999999999 2024-09-12T22:50:01.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:01.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469878+0000", 2024-09-12T22:50:01.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6336000000000001e-05 2024-09-12T22:50:01.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469888+0000", 2024-09-12T22:50:01.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8320000000000001e-06 2024-09-12T22:50:01.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:01.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469950+0000", 2024-09-12T22:50:01.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1923999999999999e-05 2024-09-12T22:50:01.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:01.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.470059+0000", 2024-09-12T22:50:01.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109559 2024-09-12T22:50:01.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:01.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.505915+0000", 2024-09-12T22:50:01.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035855887000000003 2024-09-12T22:50:01.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:01.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.505939+0000", 2024-09-12T22:50:01.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3740999999999999e-05 2024-09-12T22:50:01.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:01.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.505974+0000", 2024-09-12T22:50:01.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5753999999999997e-05 2024-09-12T22:50:01.350 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.351 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:01.351 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.351 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13754 4.11 4:8a2f20b1:::10000003764.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:01.351 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.469921+0000", 2024-09-12T22:50:01.351 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.7744931400000001, 2024-09-12T22:50:01.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034721670000000003, 2024-09-12T22:50:01.351 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:01.351 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:01.351 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.351 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:01.351 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:01.352 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:01.352 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13754 2024-09-12T22:50:01.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.352 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:01.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:01.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469921+0000", 2024-09-12T22:50:01.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:01.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469921+0000", 2024-09-12T22:50:01.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:01.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469922+0000", 2024-09-12T22:50:01.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.006e-06 2024-09-12T22:50:01.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:01.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474681+0000", 2024-09-12T22:50:01.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047588539999999999 2024-09-12T22:50:01.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:01.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474698+0000", 2024-09-12T22:50:01.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7368999999999999e-05 2024-09-12T22:50:01.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474709+0000", 2024-09-12T22:50:01.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0738e-05 2024-09-12T22:50:01.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:01.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474780+0000", 2024-09-12T22:50:01.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0622000000000002e-05 2024-09-12T22:50:01.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:01.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474954+0000", 2024-09-12T22:50:01.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017394399999999999 2024-09-12T22:50:01.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:01.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.504488+0000", 2024-09-12T22:50:01.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029534721999999999 2024-09-12T22:50:01.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:01.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.504553+0000", 2024-09-12T22:50:01.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4877999999999998e-05 2024-09-12T22:50:01.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:01.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.504643+0000", 2024-09-12T22:50:01.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9536999999999993e-05 2024-09-12T22:50:01.356 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.356 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:01.356 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.356 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13763 4.2d 4:b5937a57:::100000031de.00000000:head [write 0~4194304 [3@52474]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:01.356 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.474957+0000", 2024-09-12T22:50:01.356 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.769456897, 2024-09-12T22:50:01.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.057329167, 2024-09-12T22:50:01.357 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:01.357 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:01.357 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.357 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:01.357 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:01.357 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:01.357 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13763 2024-09-12T22:50:01.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.357 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:01.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:01.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474957+0000", 2024-09-12T22:50:01.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:01.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474957+0000", 2024-09-12T22:50:01.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:01.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474958+0000", 2024-09-12T22:50:01.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8299999999999997e-07 2024-09-12T22:50:01.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:01.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.478970+0000", 2024-09-12T22:50:01.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040121100000000002 2024-09-12T22:50:01.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:01.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.478983+0000", 2024-09-12T22:50:01.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.292e-05 2024-09-12T22:50:01.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.478992+0000", 2024-09-12T22:50:01.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3759999999999997e-06 2024-09-12T22:50:01.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:01.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.479048+0000", 2024-09-12T22:50:01.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5381999999999999e-05 2024-09-12T22:50:01.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:01.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.479124+0000", 2024-09-12T22:50:01.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6643999999999993e-05 2024-09-12T22:50:01.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:01.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.479230+0000", 2024-09-12T22:50:01.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010581099999999999 2024-09-12T22:50:01.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:01.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.506897+0000", 2024-09-12T22:50:01.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027666863999999999 2024-09-12T22:50:01.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:01.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.532175+0000", 2024-09-12T22:50:01.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.025278367 2024-09-12T22:50:01.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:01.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.532232+0000", 2024-09-12T22:50:01.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6455000000000001e-05 2024-09-12T22:50:01.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:01.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.532286+0000", 2024-09-12T22:50:01.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4654999999999998e-05 2024-09-12T22:50:01.362 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.362 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:01.362 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.362 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13803 4.4 4:228c5bc4:::10000003314.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:01.363 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.515814+0000", 2024-09-12T22:50:01.363 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.728600471, 2024-09-12T22:50:01.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034442453999999997, 2024-09-12T22:50:01.363 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:01.363 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:01.363 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.363 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:01.363 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:01.363 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:01.363 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13803 2024-09-12T22:50:01.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.363 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:01.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:01.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.515814+0000", 2024-09-12T22:50:01.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:01.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.515814+0000", 2024-09-12T22:50:01.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:01.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:01.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.515814+0000", 2024-09-12T22:50:01.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4799999999999998e-07 2024-09-12T22:50:01.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:01.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522580+0000", 2024-09-12T22:50:01.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0067656959999999999 2024-09-12T22:50:01.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:01.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522591+0000", 2024-09-12T22:50:01.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1206000000000001e-05 2024-09-12T22:50:01.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522597+0000", 2024-09-12T22:50:01.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1500000000000004e-06 2024-09-12T22:50:01.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:01.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522639+0000", 2024-09-12T22:50:01.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1767999999999997e-05 2024-09-12T22:50:01.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:01.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522689+0000", 2024-09-12T22:50:01.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9472999999999999e-05 2024-09-12T22:50:01.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:01.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522771+0000", 2024-09-12T22:50:01.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2738000000000006e-05 2024-09-12T22:50:01.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:01.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.529356+0000", 2024-09-12T22:50:01.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065850329999999997 2024-09-12T22:50:01.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:01.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.550206+0000", 2024-09-12T22:50:01.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020849755000000001 2024-09-12T22:50:01.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:01.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.550233+0000", 2024-09-12T22:50:01.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6990000000000001e-05 2024-09-12T22:50:01.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:01.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:01.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:01.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.550256+0000", 2024-09-12T22:50:01.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3096999999999999e-05 2024-09-12T22:50:01.368 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.368 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:01.368 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.368 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:01.369 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:01.369 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:50:01.370 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:01.369+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:01.370 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:50:01.471 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:01.470+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:01.477 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:50:01.477 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:50:01.477 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:50:01.477 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:50:01.486 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:50:01.572 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:01.571+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:01.592 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:50:01.592 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:50:01.592 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:50:01.593 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:50:01.593 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:50:01.602 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:50:01.673 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:01.672+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:01.692 INFO:teuthology.orchestra.run.smithi066.stderr:nodeep-scrub is set 2024-09-12T22:50:01.711 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:50:01.711 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:50:01.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:50:01.712 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:50:01.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.712 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1923 3.8 3:17051619:::200.0000000f:head [write 935107~4527 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:01.712 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.157731+0000", 2024-09-12T22:50:01.712 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.5519055320000001, 2024-09-12T22:50:01.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.085115956000000006, 2024-09-12T22:50:01.712 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:01.712 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:01.712 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.712 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:01.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:01.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157731+0000", 2024-09-12T22:50:01.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.713 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:01.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157731+0000", 2024-09-12T22:50:01.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.713 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:01.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157732+0000", 2024-09-12T22:50:01.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.99e-07 2024-09-12T22:50:01.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.714 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:01.714 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157737+0000", 2024-09-12T22:50:01.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6280000000000002e-06 2024-09-12T22:50:01.714 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.714 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.714 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:01.714 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157745+0000", 2024-09-12T22:50:01.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1749999999999999e-06 2024-09-12T22:50:01.714 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.714 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.714 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.714 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157749+0000", 2024-09-12T22:50:01.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.946e-06 2024-09-12T22:50:01.714 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.715 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.715 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:01.715 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.236865+0000", 2024-09-12T22:50:01.715 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079116687000000005 2024-09-12T22:50:01.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.715 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.715 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:01.715 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.236929+0000", 2024-09-12T22:50:01.715 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3566999999999996e-05 2024-09-12T22:50:01.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.715 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.715 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:01.715 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237025+0000", 2024-09-12T22:50:01.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6620000000000007e-05 2024-09-12T22:50:01.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:01.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240342+0000", 2024-09-12T22:50:01.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033162539999999998 2024-09-12T22:50:01.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:01.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242737+0000", 2024-09-12T22:50:01.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023957370000000002 2024-09-12T22:50:01.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:01.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242797+0000", 2024-09-12T22:50:01.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9323000000000001e-05 2024-09-12T22:50:01.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:01.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242847+0000", 2024-09-12T22:50:01.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0319999999999999e-05 2024-09-12T22:50:01.717 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.717 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:01.717 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.718 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1924 3.8 3:17051619:::200.0000000f:head [write 939634~6106 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:01.718 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.159169+0000", 2024-09-12T22:50:01.718 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.5504673130000004, 2024-09-12T22:50:01.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.083843601000000004, 2024-09-12T22:50:01.718 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:01.718 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:01.718 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.718 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:01.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.718 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:01.718 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159169+0000", 2024-09-12T22:50:01.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:01.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159169+0000", 2024-09-12T22:50:01.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:01.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159171+0000", 2024-09-12T22:50:01.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4959999999999999e-06 2024-09-12T22:50:01.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:01.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159182+0000", 2024-09-12T22:50:01.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1104000000000001e-05 2024-09-12T22:50:01.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.720 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:01.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159190+0000", 2024-09-12T22:50:01.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3520000000000007e-06 2024-09-12T22:50:01.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.720 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159196+0000", 2024-09-12T22:50:01.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5690000000000004e-06 2024-09-12T22:50:01.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.720 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:01.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237476+0000", 2024-09-12T22:50:01.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078280197999999995 2024-09-12T22:50:01.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:01.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237530+0000", 2024-09-12T22:50:01.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4419000000000002e-05 2024-09-12T22:50:01.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:01.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237593+0000", 2024-09-12T22:50:01.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2611000000000001e-05 2024-09-12T22:50:01.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:01.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242030+0000", 2024-09-12T22:50:01.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044367369999999996 2024-09-12T22:50:01.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:01.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242893+0000", 2024-09-12T22:50:01.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00086367400000000004 2024-09-12T22:50:01.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:01.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242956+0000", 2024-09-12T22:50:01.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2885999999999994e-05 2024-09-12T22:50:01.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.723 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:01.723 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243013+0000", 2024-09-12T22:50:01.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6555000000000003e-05 2024-09-12T22:50:01.723 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.723 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:01.723 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.723 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1925 3.8 3:17051619:::200.0000000f:head [write 945740~9955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:01.723 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.160395+0000", 2024-09-12T22:50:01.723 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.5492421040000002, 2024-09-12T22:50:01.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.091200247999999998, 2024-09-12T22:50:01.723 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:01.723 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:01.724 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.724 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:01.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.724 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:01.724 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160395+0000", 2024-09-12T22:50:01.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.724 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:01.724 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160395+0000", 2024-09-12T22:50:01.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:01.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160396+0000", 2024-09-12T22:50:01.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1599999999999999e-06 2024-09-12T22:50:01.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:01.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160415+0000", 2024-09-12T22:50:01.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9680000000000001e-05 2024-09-12T22:50:01.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:01.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160428+0000", 2024-09-12T22:50:01.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2792999999999999e-05 2024-09-12T22:50:01.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.726 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.726 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160436+0000", 2024-09-12T22:50:01.726 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0399999999999993e-06 2024-09-12T22:50:01.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.726 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:01.726 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.238408+0000", 2024-09-12T22:50:01.726 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077971602000000001 2024-09-12T22:50:01.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.726 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:01.726 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.238504+0000", 2024-09-12T22:50:01.726 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6714999999999998e-05 2024-09-12T22:50:01.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:01.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.238687+0000", 2024-09-12T22:50:01.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000182795 2024-09-12T22:50:01.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:01.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242036+0000", 2024-09-12T22:50:01.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003348887 2024-09-12T22:50:01.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:01.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251510+0000", 2024-09-12T22:50:01.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094733679999999994 2024-09-12T22:50:01.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:01.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251543+0000", 2024-09-12T22:50:01.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2974e-05 2024-09-12T22:50:01.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:01.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251595+0000", 2024-09-12T22:50:01.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2234000000000002e-05 2024-09-12T22:50:01.728 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.728 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:01.728 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.729 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1926 3.8 3:17051619:::200.0000000f:head [write 955695~5281 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:01.729 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.160849+0000", 2024-09-12T22:50:01.729 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.5487871499999999, 2024-09-12T22:50:01.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.094772633999999994, 2024-09-12T22:50:01.729 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:01.729 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:01.729 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.729 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:01.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:01.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160849+0000", 2024-09-12T22:50:01.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:01.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160849+0000", 2024-09-12T22:50:01.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:01.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160850+0000", 2024-09-12T22:50:01.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6700000000000002e-07 2024-09-12T22:50:01.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:01.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160858+0000", 2024-09-12T22:50:01.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5630000000000003e-06 2024-09-12T22:50:01.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:01.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160866+0000", 2024-09-12T22:50:01.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7570000000000004e-06 2024-09-12T22:50:01.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160870+0000", 2024-09-12T22:50:01.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5929999999999999e-06 2024-09-12T22:50:01.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.732 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:01.732 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.239705+0000", 2024-09-12T22:50:01.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078834491000000007 2024-09-12T22:50:01.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.732 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:01.732 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.239764+0000", 2024-09-12T22:50:01.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9190000000000001e-05 2024-09-12T22:50:01.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.732 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:01.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.239851+0000", 2024-09-12T22:50:01.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7472999999999994e-05 2024-09-12T22:50:01.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:01.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254001+0000", 2024-09-12T22:50:01.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014149622000000001 2024-09-12T22:50:01.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:01.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255525+0000", 2024-09-12T22:50:01.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0015236500000000001 2024-09-12T22:50:01.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:01.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255567+0000", 2024-09-12T22:50:01.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2150999999999997e-05 2024-09-12T22:50:01.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:01.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255622+0000", 2024-09-12T22:50:01.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5276999999999999e-05 2024-09-12T22:50:01.734 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.734 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:01.734 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.734 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1927 3.8 3:17051619:::200.0000000f:head [write 960976~5828 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:01.735 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.164361+0000", 2024-09-12T22:50:01.735 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.5452754530000004, 2024-09-12T22:50:01.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.091388523999999999, 2024-09-12T22:50:01.735 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:01.735 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:01.735 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.735 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:01.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:01.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164361+0000", 2024-09-12T22:50:01.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:01.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164361+0000", 2024-09-12T22:50:01.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:01.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164363+0000", 2024-09-12T22:50:01.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.389e-06 2024-09-12T22:50:01.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:01.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164370+0000", 2024-09-12T22:50:01.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.99e-06 2024-09-12T22:50:01.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:01.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164379+0000", 2024-09-12T22:50:01.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9499999999999996e-06 2024-09-12T22:50:01.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164385+0000", 2024-09-12T22:50:01.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5879999999999997e-06 2024-09-12T22:50:01.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:01.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240385+0000", 2024-09-12T22:50:01.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075999995000000001 2024-09-12T22:50:01.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.738 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:01.738 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240533+0000", 2024-09-12T22:50:01.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014811699999999999 2024-09-12T22:50:01.738 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.738 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:01.738 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240886+0000", 2024-09-12T22:50:01.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000352517 2024-09-12T22:50:01.738 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.738 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:01.738 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254024+0000", 2024-09-12T22:50:01.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013138047999999999 2024-09-12T22:50:01.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.739 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:01.739 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255629+0000", 2024-09-12T22:50:01.739 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001604949 2024-09-12T22:50:01.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.739 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:01.739 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255683+0000", 2024-09-12T22:50:01.739 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4035e-05 2024-09-12T22:50:01.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.739 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:01.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255750+0000", 2024-09-12T22:50:01.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6946000000000006e-05 2024-09-12T22:50:01.740 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.740 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:01.740 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.740 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1928 3.8 3:17051619:::200.0000000f:head [write 966804~6536 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:01.740 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167179+0000", 2024-09-12T22:50:01.740 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.5424576549999998, 2024-09-12T22:50:01.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.089785880999999998, 2024-09-12T22:50:01.740 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:01.740 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:01.740 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.741 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:01.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:01.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167179+0000", 2024-09-12T22:50:01.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:01.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167179+0000", 2024-09-12T22:50:01.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:01.742 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167180+0000", 2024-09-12T22:50:01.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2869999999999999e-06 2024-09-12T22:50:01.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.742 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:01.742 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167192+0000", 2024-09-12T22:50:01.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.187e-05 2024-09-12T22:50:01.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.742 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:01.742 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167203+0000", 2024-09-12T22:50:01.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1076e-05 2024-09-12T22:50:01.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.743 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.743 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167210+0000", 2024-09-12T22:50:01.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1799999999999999e-06 2024-09-12T22:50:01.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.743 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:01.743 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.241518+0000", 2024-09-12T22:50:01.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074307845999999997 2024-09-12T22:50:01.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.743 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:01.743 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.241563+0000", 2024-09-12T22:50:01.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5138e-05 2024-09-12T22:50:01.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:01.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.241641+0000", 2024-09-12T22:50:01.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8016000000000007e-05 2024-09-12T22:50:01.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:01.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254041+0000", 2024-09-12T22:50:01.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012399666 2024-09-12T22:50:01.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:01.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.256880+0000", 2024-09-12T22:50:01.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0028390580000000002 2024-09-12T22:50:01.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:01.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.256918+0000", 2024-09-12T22:50:01.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7552999999999998e-05 2024-09-12T22:50:01.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:01.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.256965+0000", 2024-09-12T22:50:01.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7191000000000003e-05 2024-09-12T22:50:01.746 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.746 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:01.746 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.746 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1929 3.8 3:17051619:::200.0000000f:head [write 973340~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:01.746 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167521+0000", 2024-09-12T22:50:01.746 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.5421154919999998, 2024-09-12T22:50:01.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.093206336000000001, 2024-09-12T22:50:01.746 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:01.746 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:01.746 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.746 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:01.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:01.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167521+0000", 2024-09-12T22:50:01.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:01.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167521+0000", 2024-09-12T22:50:01.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:01.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167522+0000", 2024-09-12T22:50:01.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8899999999999998e-07 2024-09-12T22:50:01.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.748 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:01.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167526+0000", 2024-09-12T22:50:01.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4490000000000001e-06 2024-09-12T22:50:01.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.748 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:01.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167544+0000", 2024-09-12T22:50:01.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7220000000000001e-05 2024-09-12T22:50:01.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.749 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.749 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167551+0000", 2024-09-12T22:50:01.749 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.046e-06 2024-09-12T22:50:01.749 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.749 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:01.749 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242079+0000", 2024-09-12T22:50:01.749 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074528436000000003 2024-09-12T22:50:01.749 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.749 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:01.750 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242167+0000", 2024-09-12T22:50:01.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7670000000000006e-05 2024-09-12T22:50:01.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:01.750 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242306+0000", 2024-09-12T22:50:01.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000138703 2024-09-12T22:50:01.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:01.750 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254058+0000", 2024-09-12T22:50:01.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011752395000000001 2024-09-12T22:50:01.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:01.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260654+0000", 2024-09-12T22:50:01.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0065964700000000001 2024-09-12T22:50:01.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:01.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260699+0000", 2024-09-12T22:50:01.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5095000000000001e-05 2024-09-12T22:50:01.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:01.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260727+0000", 2024-09-12T22:50:01.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7963e-05 2024-09-12T22:50:01.752 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.752 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:01.752 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.752 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1931 3.8 3:17051619:::200.0000000f:head [write 974738~2728 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:01.752 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167657+0000", 2024-09-12T22:50:01.752 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.5419794869999999, 2024-09-12T22:50:01.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.093133758999999997, 2024-09-12T22:50:01.752 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:01.752 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:01.753 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.753 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:01.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:01.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167657+0000", 2024-09-12T22:50:01.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:01.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167657+0000", 2024-09-12T22:50:01.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:01.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167658+0000", 2024-09-12T22:50:01.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2200000000000003e-07 2024-09-12T22:50:01.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:01.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167662+0000", 2024-09-12T22:50:01.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1489999999999996e-06 2024-09-12T22:50:01.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:01.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167673+0000", 2024-09-12T22:50:01.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0614e-05 2024-09-12T22:50:01.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167679+0000", 2024-09-12T22:50:01.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1500000000000004e-06 2024-09-12T22:50:01.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:01.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243054+0000", 2024-09-12T22:50:01.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075375027999999997 2024-09-12T22:50:01.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:01.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243134+0000", 2024-09-12T22:50:01.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0210000000000006e-05 2024-09-12T22:50:01.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:01.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243263+0000", 2024-09-12T22:50:01.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012919 2024-09-12T22:50:01.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:01.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254075+0000", 2024-09-12T22:50:01.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010811523 2024-09-12T22:50:01.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:01.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260733+0000", 2024-09-12T22:50:01.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.006658153 2024-09-12T22:50:01.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:01.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260756+0000", 2024-09-12T22:50:01.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2696000000000001e-05 2024-09-12T22:50:01.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:01.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260791+0000", 2024-09-12T22:50:01.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5324000000000003e-05 2024-09-12T22:50:01.758 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.758 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:01.758 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.758 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1932 3.8 3:17051619:::200.0000000f:head [write 977466~2771 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:01.758 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:50:01.759 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.5416898049999999, 2024-09-12T22:50:01.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.092944115999999993, 2024-09-12T22:50:01.759 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:01.759 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:01.759 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.759 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:01.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:01.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:50:01.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:01.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:50:01.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:01.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:50:01.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8400000000000004e-07 2024-09-12T22:50:01.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:01.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167952+0000", 2024-09-12T22:50:01.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.138e-06 2024-09-12T22:50:01.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:01.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167961+0000", 2024-09-12T22:50:01.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7990000000000005e-06 2024-09-12T22:50:01.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167968+0000", 2024-09-12T22:50:01.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4400000000000002e-06 2024-09-12T22:50:01.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:01.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.244002+0000", 2024-09-12T22:50:01.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.076034300999999999 2024-09-12T22:50:01.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:01.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.244061+0000", 2024-09-12T22:50:01.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8356999999999997e-05 2024-09-12T22:50:01.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:01.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.244161+0000", 2024-09-12T22:50:01.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000100126 2024-09-12T22:50:01.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:01.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254099+0000", 2024-09-12T22:50:01.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0099384940000000008 2024-09-12T22:50:01.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:01.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260799+0000", 2024-09-12T22:50:01.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0066995029999999999 2024-09-12T22:50:01.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:01.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260851+0000", 2024-09-12T22:50:01.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1861999999999999e-05 2024-09-12T22:50:01.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:01.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260891+0000", 2024-09-12T22:50:01.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0411999999999999e-05 2024-09-12T22:50:01.764 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.764 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:01.764 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.765 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1933 3.8 3:17051619:::200.0000000f:head [write 980237~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:01.765 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167993+0000", 2024-09-12T22:50:01.765 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.5416433019999998, 2024-09-12T22:50:01.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.092952307999999997, 2024-09-12T22:50:01.765 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:01.765 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:01.765 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.765 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:01.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:01.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167993+0000", 2024-09-12T22:50:01.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:01.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167993+0000", 2024-09-12T22:50:01.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:01.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167994+0000", 2024-09-12T22:50:01.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5000000000000003e-07 2024-09-12T22:50:01.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:01.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167997+0000", 2024-09-12T22:50:01.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5559999999999999e-06 2024-09-12T22:50:01.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:01.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168005+0000", 2024-09-12T22:50:01.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.588e-06 2024-09-12T22:50:01.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168011+0000", 2024-09-12T22:50:01.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7780000000000004e-06 2024-09-12T22:50:01.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:01.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.247983+0000", 2024-09-12T22:50:01.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079972090999999995 2024-09-12T22:50:01.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:01.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248038+0000", 2024-09-12T22:50:01.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4889999999999998e-05 2024-09-12T22:50:01.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:01.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248136+0000", 2024-09-12T22:50:01.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8271999999999997e-05 2024-09-12T22:50:01.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:01.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254134+0000", 2024-09-12T22:50:01.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005997751 2024-09-12T22:50:01.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:01.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260898+0000", 2024-09-12T22:50:01.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0067646429999999999 2024-09-12T22:50:01.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:01.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260923+0000", 2024-09-12T22:50:01.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4080999999999999e-05 2024-09-12T22:50:01.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:01.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260946+0000", 2024-09-12T22:50:01.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3108e-05 2024-09-12T22:50:01.770 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.771 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:01.771 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.771 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1934 3.8 3:17051619:::200.0000000f:head [write 982156~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:01.771 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:50:01.771 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.5416178160000005, 2024-09-12T22:50:01.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.093517738000000003, 2024-09-12T22:50:01.771 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:01.771 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:01.771 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.771 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:01.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:01.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:50:01.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:01.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:50:01.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:01.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:50:01.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6800000000000001e-07 2024-09-12T22:50:01.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:01.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168029+0000", 2024-09-12T22:50:01.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9699999999999994e-06 2024-09-12T22:50:01.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:01.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168036+0000", 2024-09-12T22:50:01.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9800000000000001e-06 2024-09-12T22:50:01.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168041+0000", 2024-09-12T22:50:01.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0629999999999996e-06 2024-09-12T22:50:01.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:01.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248449+0000", 2024-09-12T22:50:01.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.080407948000000007 2024-09-12T22:50:01.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:01.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248491+0000", 2024-09-12T22:50:01.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2027999999999998e-05 2024-09-12T22:50:01.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:01.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248569+0000", 2024-09-12T22:50:01.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8077000000000005e-05 2024-09-12T22:50:01.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:01.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260950+0000", 2024-09-12T22:50:01.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012380901 2024-09-12T22:50:01.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:01.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.261473+0000", 2024-09-12T22:50:01.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00052241699999999996 2024-09-12T22:50:01.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:01.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.261507+0000", 2024-09-12T22:50:01.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4616000000000002e-05 2024-09-12T22:50:01.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:01.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.261537+0000", 2024-09-12T22:50:01.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9369999999999998e-05 2024-09-12T22:50:01.777 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.777 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:01.777 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.777 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1935 3.8 3:17051619:::200.0000000f:head [write 984074~1914 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:01.777 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:50:01.777 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.5415878940000001, 2024-09-12T22:50:01.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.097660714999999995, 2024-09-12T22:50:01.777 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:01.777 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:01.777 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.778 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:01.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:01.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:50:01.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:01.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:50:01.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:01.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:50:01.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4400000000000001e-07 2024-09-12T22:50:01.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:01.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168052+0000", 2024-09-12T22:50:01.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.886e-06 2024-09-12T22:50:01.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:01.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168059+0000", 2024-09-12T22:50:01.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0489999999999998e-06 2024-09-12T22:50:01.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168081+0000", 2024-09-12T22:50:01.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1800000000000001e-05 2024-09-12T22:50:01.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:01.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.250512+0000", 2024-09-12T22:50:01.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.082431322000000001 2024-09-12T22:50:01.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:01.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.250621+0000", 2024-09-12T22:50:01.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010908600000000001 2024-09-12T22:50:01.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:01.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.250970+0000", 2024-09-12T22:50:01.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034828399999999997 2024-09-12T22:50:01.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:01.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265532+0000", 2024-09-12T22:50:01.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01456268 2024-09-12T22:50:01.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:01.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265614+0000", 2024-09-12T22:50:01.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1796000000000001e-05 2024-09-12T22:50:01.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:01.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265673+0000", 2024-09-12T22:50:01.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9314000000000002e-05 2024-09-12T22:50:01.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:01.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265709+0000", 2024-09-12T22:50:01.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6053999999999997e-05 2024-09-12T22:50:01.783 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.783 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:01.783 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.783 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1936 3.8 3:17051619:::200.0000000f:head [write 985988~2437 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:01.783 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.168095+0000", 2024-09-12T22:50:01.783 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.5415415469999996, 2024-09-12T22:50:01.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.097789345999999999, 2024-09-12T22:50:01.783 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:01.783 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:01.783 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.783 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:01.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:01.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168095+0000", 2024-09-12T22:50:01.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:01.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168095+0000", 2024-09-12T22:50:01.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:01.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168096+0000", 2024-09-12T22:50:01.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7700000000000005e-07 2024-09-12T22:50:01.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:01.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168099+0000", 2024-09-12T22:50:01.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.422e-06 2024-09-12T22:50:01.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:01.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168106+0000", 2024-09-12T22:50:01.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6889999999999998e-06 2024-09-12T22:50:01.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168110+0000", 2024-09-12T22:50:01.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8470000000000003e-06 2024-09-12T22:50:01.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:01.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251622+0000", 2024-09-12T22:50:01.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.083511539999999995 2024-09-12T22:50:01.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:01.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251674+0000", 2024-09-12T22:50:01.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1678999999999998e-05 2024-09-12T22:50:01.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:01.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251744+0000", 2024-09-12T22:50:01.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0440999999999999e-05 2024-09-12T22:50:01.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:01.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265545+0000", 2024-09-12T22:50:01.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013801000000000001 2024-09-12T22:50:01.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:01.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265771+0000", 2024-09-12T22:50:01.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000225632 2024-09-12T22:50:01.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:01.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265835+0000", 2024-09-12T22:50:01.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4541000000000004e-05 2024-09-12T22:50:01.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:01.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265884+0000", 2024-09-12T22:50:01.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9078e-05 2024-09-12T22:50:01.788 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.788 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:01.789 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.789 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1937 3.8 3:17051619:::200.0000000f:head [write 988425~1920 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:01.789 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.171188+0000", 2024-09-12T22:50:01.789 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.5384481760000002, 2024-09-12T22:50:01.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.094794626000000007, 2024-09-12T22:50:01.789 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:01.789 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:01.789 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.789 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:01.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:01.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171188+0000", 2024-09-12T22:50:01.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:01.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171188+0000", 2024-09-12T22:50:01.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:01.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171189+0000", 2024-09-12T22:50:01.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3200000000000003e-07 2024-09-12T22:50:01.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:01.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171194+0000", 2024-09-12T22:50:01.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2690000000000001e-06 2024-09-12T22:50:01.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:01.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171201+0000", 2024-09-12T22:50:01.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5310000000000004e-06 2024-09-12T22:50:01.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171206+0000", 2024-09-12T22:50:01.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7049999999999998e-06 2024-09-12T22:50:01.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:01.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254169+0000", 2024-09-12T22:50:01.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.082962835999999998 2024-09-12T22:50:01.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:01.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254263+0000", 2024-09-12T22:50:01.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3844999999999993e-05 2024-09-12T22:50:01.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:01.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254398+0000", 2024-09-12T22:50:01.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013560499999999999 2024-09-12T22:50:01.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:01.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265897+0000", 2024-09-12T22:50:01.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01149846 2024-09-12T22:50:01.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:01.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265922+0000", 2024-09-12T22:50:01.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5130000000000002e-05 2024-09-12T22:50:01.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:01.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265954+0000", 2024-09-12T22:50:01.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2512999999999999e-05 2024-09-12T22:50:01.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:01.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265983+0000", 2024-09-12T22:50:01.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8799999999999999e-05 2024-09-12T22:50:01.794 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.794 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:01.795 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.795 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1938 3.8 3:17051619:::200.0000000f:head [write 990345~2499 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:01.795 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:50:01.795 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.5384079970000002, 2024-09-12T22:50:01.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.094864730999999994, 2024-09-12T22:50:01.795 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:01.795 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:01.795 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.795 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:01.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:01.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:50:01.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:01.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:50:01.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:01.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:50:01.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:50:01.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:01.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171242+0000", 2024-09-12T22:50:01.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3111e-05 2024-09-12T22:50:01.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:01.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171247+0000", 2024-09-12T22:50:01.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0939999999999998e-06 2024-09-12T22:50:01.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171251+0000", 2024-09-12T22:50:01.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.298e-06 2024-09-12T22:50:01.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:01.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254869+0000", 2024-09-12T22:50:01.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.083618681 2024-09-12T22:50:01.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:01.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254957+0000", 2024-09-12T22:50:01.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7783999999999998e-05 2024-09-12T22:50:01.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:01.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255093+0000", 2024-09-12T22:50:01.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013579600000000001 2024-09-12T22:50:01.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:01.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265997+0000", 2024-09-12T22:50:01.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010903777999999999 2024-09-12T22:50:01.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:01.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266047+0000", 2024-09-12T22:50:01.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0151999999999997e-05 2024-09-12T22:50:01.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:01.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266075+0000", 2024-09-12T22:50:01.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8082e-05 2024-09-12T22:50:01.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:01.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266093+0000", 2024-09-12T22:50:01.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8396000000000001e-05 2024-09-12T22:50:01.801 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.801 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:01.801 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.801 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1944 3.8 3:17051619:::200.0000000f:head [write 1037561~3947 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:01.801 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.186089+0000", 2024-09-12T22:50:01.801 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.5235477470000003, 2024-09-12T22:50:01.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087755745999999996, 2024-09-12T22:50:01.801 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:01.801 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:01.801 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.802 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:01.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:01.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186089+0000", 2024-09-12T22:50:01.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:01.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186089+0000", 2024-09-12T22:50:01.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:01.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186090+0000", 2024-09-12T22:50:01.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1349999999999999e-06 2024-09-12T22:50:01.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:01.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186098+0000", 2024-09-12T22:50:01.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8390000000000007e-06 2024-09-12T22:50:01.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:01.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186106+0000", 2024-09-12T22:50:01.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4619999999999996e-06 2024-09-12T22:50:01.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186111+0000", 2024-09-12T22:50:01.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.057e-06 2024-09-12T22:50:01.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:01.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.264543+0000", 2024-09-12T22:50:01.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078432044000000006 2024-09-12T22:50:01.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:01.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.264617+0000", 2024-09-12T22:50:01.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3789999999999997e-05 2024-09-12T22:50:01.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:01.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.264760+0000", 2024-09-12T22:50:01.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014318499999999999 2024-09-12T22:50:01.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:01.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268441+0000", 2024-09-12T22:50:01.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036809360000000001 2024-09-12T22:50:01.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:01.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273776+0000", 2024-09-12T22:50:01.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053346449999999998 2024-09-12T22:50:01.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:01.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273807+0000", 2024-09-12T22:50:01.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1352000000000001e-05 2024-09-12T22:50:01.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:01.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273845+0000", 2024-09-12T22:50:01.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7301000000000001e-05 2024-09-12T22:50:01.807 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.807 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:01.807 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.807 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1945 3.8 3:17051619:::200.0000000f:head [write 1041508~10144 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:01.807 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:50:01.807 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.523270975, 2024-09-12T22:50:01.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087573128, 2024-09-12T22:50:01.807 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:01.807 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:01.807 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.807 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:01.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:01.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:50:01.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:01.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:50:01.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:01.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:50:01.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1600000000000001e-07 2024-09-12T22:50:01.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:01.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186377+0000", 2024-09-12T22:50:01.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0301e-05 2024-09-12T22:50:01.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:01.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186386+0000", 2024-09-12T22:50:01.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5619999999999993e-06 2024-09-12T22:50:01.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186393+0000", 2024-09-12T22:50:01.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7150000000000001e-06 2024-09-12T22:50:01.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:01.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266725+0000", 2024-09-12T22:50:01.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.080331893000000001 2024-09-12T22:50:01.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:01.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266799+0000", 2024-09-12T22:50:01.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4086999999999997e-05 2024-09-12T22:50:01.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:01.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266904+0000", 2024-09-12T22:50:01.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105475 2024-09-12T22:50:01.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:01.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273882+0000", 2024-09-12T22:50:01.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069773780000000002 2024-09-12T22:50:01.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:01.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273889+0000", 2024-09-12T22:50:01.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1049999999999997e-06 2024-09-12T22:50:01.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:01.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273916+0000", 2024-09-12T22:50:01.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6716e-05 2024-09-12T22:50:01.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:01.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273939+0000", 2024-09-12T22:50:01.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3180000000000002e-05 2024-09-12T22:50:01.813 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.813 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:01.813 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.813 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1946 3.8 3:17051619:::200.0000000f:head [write 1051652~3875 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:01.813 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.186888+0000", 2024-09-12T22:50:01.814 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.5227486959999998, 2024-09-12T22:50:01.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087165134000000005, 2024-09-12T22:50:01.814 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:01.814 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:01.814 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.814 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:01.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:01.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186888+0000", 2024-09-12T22:50:01.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:01.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186888+0000", 2024-09-12T22:50:01.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:01.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186889+0000", 2024-09-12T22:50:01.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2500000000000005e-07 2024-09-12T22:50:01.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:01.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186894+0000", 2024-09-12T22:50:01.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3900000000000001e-06 2024-09-12T22:50:01.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:01.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186901+0000", 2024-09-12T22:50:01.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5649999999999998e-06 2024-09-12T22:50:01.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186906+0000", 2024-09-12T22:50:01.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0390000000000004e-06 2024-09-12T22:50:01.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:01.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.267852+0000", 2024-09-12T22:50:01.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.080946389999999993 2024-09-12T22:50:01.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:01.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.267910+0000", 2024-09-12T22:50:01.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7655999999999998e-05 2024-09-12T22:50:01.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:01.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.267981+0000", 2024-09-12T22:50:01.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0916999999999999e-05 2024-09-12T22:50:01.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:01.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273944+0000", 2024-09-12T22:50:01.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0059635570000000004 2024-09-12T22:50:01.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:01.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273993+0000", 2024-09-12T22:50:01.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8350000000000003e-05 2024-09-12T22:50:01.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:01.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274022+0000", 2024-09-12T22:50:01.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9899999999999998e-05 2024-09-12T22:50:01.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:01.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274053+0000", 2024-09-12T22:50:01.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0645000000000002e-05 2024-09-12T22:50:01.819 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.819 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:01.819 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.819 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1947 3.8 3:17051619:::200.0000000f:head [write 1055527~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:01.819 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.187014+0000", 2024-09-12T22:50:01.819 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.5226224620000002, 2024-09-12T22:50:01.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087114608999999996, 2024-09-12T22:50:01.820 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:01.820 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:01.820 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.820 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:01.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:01.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187014+0000", 2024-09-12T22:50:01.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:01.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187014+0000", 2024-09-12T22:50:01.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:01.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187015+0000", 2024-09-12T22:50:01.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1500000000000004e-07 2024-09-12T22:50:01.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:01.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187018+0000", 2024-09-12T22:50:01.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.033e-06 2024-09-12T22:50:01.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:01.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187023+0000", 2024-09-12T22:50:01.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7550000000000002e-06 2024-09-12T22:50:01.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187026+0000", 2024-09-12T22:50:01.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2710000000000001e-06 2024-09-12T22:50:01.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:01.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268462+0000", 2024-09-12T22:50:01.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.081435699 2024-09-12T22:50:01.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:01.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268507+0000", 2024-09-12T22:50:01.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5643999999999999e-05 2024-09-12T22:50:01.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:01.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268597+0000", 2024-09-12T22:50:01.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0112999999999996e-05 2024-09-12T22:50:01.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:01.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273947+0000", 2024-09-12T22:50:01.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053501859999999998 2024-09-12T22:50:01.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:01.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274083+0000", 2024-09-12T22:50:01.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013525500000000001 2024-09-12T22:50:01.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:01.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274109+0000", 2024-09-12T22:50:01.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6352000000000001e-05 2024-09-12T22:50:01.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:01.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274129+0000", 2024-09-12T22:50:01.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9686000000000001e-05 2024-09-12T22:50:01.825 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.825 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:01.825 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.825 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1948 3.8 3:17051619:::200.0000000f:head [write 1057443~1896 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:01.825 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.189230+0000", 2024-09-12T22:50:01.826 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.52040665, 2024-09-12T22:50:01.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.085028962999999999, 2024-09-12T22:50:01.826 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:01.826 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:01.826 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:01.826 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:01.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:01.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189230+0000", 2024-09-12T22:50:01.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:01.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189230+0000", 2024-09-12T22:50:01.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:01.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:01.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189231+0000", 2024-09-12T22:50:01.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1399999999999996e-07 2024-09-12T22:50:01.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:01.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189235+0000", 2024-09-12T22:50:01.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5970000000000002e-06 2024-09-12T22:50:01.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:01.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189242+0000", 2024-09-12T22:50:01.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8510000000000001e-06 2024-09-12T22:50:01.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:01.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189247+0000", 2024-09-12T22:50:01.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4800000000000003e-06 2024-09-12T22:50:01.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:01.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268908+0000", 2024-09-12T22:50:01.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079660983000000005 2024-09-12T22:50:01.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:01.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268967+0000", 2024-09-12T22:50:01.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9595000000000001e-05 2024-09-12T22:50:01.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:01.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.269040+0000", 2024-09-12T22:50:01.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2643000000000002e-05 2024-09-12T22:50:01.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:01.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273950+0000", 2024-09-12T22:50:01.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049105329999999999 2024-09-12T22:50:01.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:01.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274199+0000", 2024-09-12T22:50:01.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024824999999999999 2024-09-12T22:50:01.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:01.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274226+0000", 2024-09-12T22:50:01.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7602000000000001e-05 2024-09-12T22:50:01.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:01.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:01.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:01.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274259+0000", 2024-09-12T22:50:01.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2614999999999999e-05 2024-09-12T22:50:01.831 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.831 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:01.831 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.831 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:01.831 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:01.831 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:50:01.833 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:50:01.833 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:01.832+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:01.933 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:01.933+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:01.938 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:50:01.938 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:50:01.938 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:50:01.938 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:50:01.947 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:50:02.031 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T22:50:02.031 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T22:50:02.035 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:02.033+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:02.049 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:50:02.049 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:50:02.049 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:50:02.049 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:50:02.049 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:50:02.057 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:50:02.135 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:02.134+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:02.202 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:50:02.202 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:50:02.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:50:02.202 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:50:02.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.203 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12403 4.0 4:0146e0d0:::100000031d4.00000000:head [write 0~4194304 [2@3733965]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:02.203 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:55.747692+0000", 2024-09-12T22:50:02.203 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 6.4520571740000001, 2024-09-12T22:50:02.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.22362137500000001, 2024-09-12T22:50:02.203 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:02.203 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:02.203 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:02.204 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:02.204 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:02.204 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:02.204 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12403 2024-09-12T22:50:02.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.204 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:02.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:02.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.747692+0000", 2024-09-12T22:50:02.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:02.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.747692+0000", 2024-09-12T22:50:02.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:02.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.747693+0000", 2024-09-12T22:50:02.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3799999999999996e-07 2024-09-12T22:50:02.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:02.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959640+0000", 2024-09-12T22:50:02.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.21194702000000001 2024-09-12T22:50:02.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:02.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959660+0000", 2024-09-12T22:50:02.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9939e-05 2024-09-12T22:50:02.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:02.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959668+0000", 2024-09-12T22:50:02.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1669999999999999e-06 2024-09-12T22:50:02.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.209 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:02.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959764+0000", 2024-09-12T22:50:02.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5315000000000005e-05 2024-09-12T22:50:02.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.209 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:02.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959865+0000", 2024-09-12T22:50:02.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101618 2024-09-12T22:50:02.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:02.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.971224+0000", 2024-09-12T22:50:02.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011358541999999999 2024-09-12T22:50:02.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:02.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.971261+0000", 2024-09-12T22:50:02.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7092999999999999e-05 2024-09-12T22:50:02.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:02.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.971314+0000", 2024-09-12T22:50:02.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2843000000000002e-05 2024-09-12T22:50:02.212 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.212 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:02.212 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.212 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:12503 4.15 e56/17 4:ab29d13f:::100000033b1.00000000:head v 56'161, mlcod=55'159)", 2024-09-12T22:50:02.212 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:50:02.212 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 6.169143697, 2024-09-12T22:50:02.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.043668640000000002, 2024-09-12T22:50:02.213 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:02.213 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:02.213 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:02.213 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:02.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:02.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:50:02.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:02.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:50:02.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:02.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:50:02.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:50:02.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:02.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039768+0000", 2024-09-12T22:50:02.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0091617190000000005 2024-09-12T22:50:02.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:02.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039781+0000", 2024-09-12T22:50:02.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2829e-05 2024-09-12T22:50:02.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.215 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:02.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039789+0000", 2024-09-12T22:50:02.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9340000000000006e-06 2024-09-12T22:50:02.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.215 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:02.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039846+0000", 2024-09-12T22:50:02.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6762999999999998e-05 2024-09-12T22:50:02.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:02.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039897+0000", 2024-09-12T22:50:02.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1517000000000002e-05 2024-09-12T22:50:02.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:02.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074225+0000", 2024-09-12T22:50:02.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034328138000000001 2024-09-12T22:50:02.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:02.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074274+0000", 2024-09-12T22:50:02.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9255999999999997e-05 2024-09-12T22:50:02.217 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.217 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:02.217 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.217 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12508 4.2d 4:b7b19b64:::10000003230.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:02.217 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.037293+0000", 2024-09-12T22:50:02.217 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 6.1624565220000003, 2024-09-12T22:50:02.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.037399772999999997, 2024-09-12T22:50:02.217 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:02.217 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:02.218 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:02.218 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:02.218 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:02.218 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:02.218 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12508 2024-09-12T22:50:02.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.218 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:02.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:02.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037293+0000", 2024-09-12T22:50:02.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:02.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037293+0000", 2024-09-12T22:50:02.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:02.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037294+0000", 2024-09-12T22:50:02.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4899999999999995e-07 2024-09-12T22:50:02.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:02.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042701+0000", 2024-09-12T22:50:02.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054069419999999997 2024-09-12T22:50:02.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:02.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042712+0000", 2024-09-12T22:50:02.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.171e-05 2024-09-12T22:50:02.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:02.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042719+0000", 2024-09-12T22:50:02.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1189999999999999e-06 2024-09-12T22:50:02.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:02.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042759+0000", 2024-09-12T22:50:02.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9478999999999999e-05 2024-09-12T22:50:02.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.221 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:02.221 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042827+0000", 2024-09-12T22:50:02.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8435999999999993e-05 2024-09-12T22:50:02.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.221 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:02.221 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042965+0000", 2024-09-12T22:50:02.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000137723 2024-09-12T22:50:02.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.221 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:02.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.058351+0000", 2024-09-12T22:50:02.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015385902 2024-09-12T22:50:02.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:02.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074620+0000", 2024-09-12T22:50:02.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016269018 2024-09-12T22:50:02.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:02.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074657+0000", 2024-09-12T22:50:02.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6619999999999998e-05 2024-09-12T22:50:02.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:02.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074693+0000", 2024-09-12T22:50:02.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6174999999999998e-05 2024-09-12T22:50:02.223 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.223 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:02.223 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.223 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12516 4.21 4:858ae08d:::100000030eb.00000000:head [write 0~4194304 [3@1582458]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:02.223 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.045143+0000", 2024-09-12T22:50:02.223 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 6.1546062340000001, 2024-09-12T22:50:02.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.039721657, 2024-09-12T22:50:02.223 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:02.223 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:02.224 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:02.224 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:02.224 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:02.224 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:02.224 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12516 2024-09-12T22:50:02.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.224 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:02.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:02.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.045143+0000", 2024-09-12T22:50:02.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:02.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.045143+0000", 2024-09-12T22:50:02.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:02.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.045144+0000", 2024-09-12T22:50:02.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2900000000000002e-07 2024-09-12T22:50:02.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:02.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049506+0000", 2024-09-12T22:50:02.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043620280000000004 2024-09-12T22:50:02.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:02.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049517+0000", 2024-09-12T22:50:02.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0726e-05 2024-09-12T22:50:02.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:02.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049522+0000", 2024-09-12T22:50:02.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3730000000000001e-06 2024-09-12T22:50:02.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:02.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049583+0000", 2024-09-12T22:50:02.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1254999999999995e-05 2024-09-12T22:50:02.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.227 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:02.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049645+0000", 2024-09-12T22:50:02.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1988000000000003e-05 2024-09-12T22:50:02.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.227 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:02.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049731+0000", 2024-09-12T22:50:02.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6040999999999998e-05 2024-09-12T22:50:02.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.227 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:02.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.064126+0000", 2024-09-12T22:50:02.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01439497 2024-09-12T22:50:02.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:02.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.084785+0000", 2024-09-12T22:50:02.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020658972000000001 2024-09-12T22:50:02.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:02.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.084829+0000", 2024-09-12T22:50:02.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3869000000000003e-05 2024-09-12T22:50:02.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:02.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.084865+0000", 2024-09-12T22:50:02.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5605999999999998e-05 2024-09-12T22:50:02.229 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.229 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:02.229 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.229 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1354 3.18 3:1e8917d7:::200.0000000e:head [write 498872~14494 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:02.229 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.048337+0000", 2024-09-12T22:50:02.229 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 6.151412315, 2024-09-12T22:50:02.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034292491000000001, 2024-09-12T22:50:02.231 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:02.231 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:02.231 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:02.232 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:02.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:02.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048337+0000", 2024-09-12T22:50:02.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:02.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048337+0000", 2024-09-12T22:50:02.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:02.233 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048339+0000", 2024-09-12T22:50:02.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.409e-06 2024-09-12T22:50:02.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.233 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:02.233 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048360+0000", 2024-09-12T22:50:02.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1659999999999999e-05 2024-09-12T22:50:02.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.233 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:02.233 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048370+0000", 2024-09-12T22:50:02.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.611e-06 2024-09-12T22:50:02.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:02.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048376+0000", 2024-09-12T22:50:02.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5479999999999998e-06 2024-09-12T22:50:02.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:02.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048440+0000", 2024-09-12T22:50:02.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3367000000000005e-05 2024-09-12T22:50:02.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:02.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048557+0000", 2024-09-12T22:50:02.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116983 2024-09-12T22:50:02.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:02.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048719+0000", 2024-09-12T22:50:02.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016250499999999999 2024-09-12T22:50:02.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:02.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.058763+0000", 2024-09-12T22:50:02.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010043948 2024-09-12T22:50:02.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:02.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082499+0000", 2024-09-12T22:50:02.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023735320000000001 2024-09-12T22:50:02.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:02.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082561+0000", 2024-09-12T22:50:02.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2490000000000006e-05 2024-09-12T22:50:02.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:02.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082630+0000", 2024-09-12T22:50:02.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8650000000000002e-05 2024-09-12T22:50:02.236 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.236 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:02.236 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.237 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12517 4.1a 4:5a8c04dd:::10000003276.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:02.237 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.049539+0000", 2024-09-12T22:50:02.237 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 6.150210553, 2024-09-12T22:50:02.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.036068957999999998, 2024-09-12T22:50:02.237 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:02.237 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:02.237 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:02.237 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:02.237 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:02.237 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:02.237 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12517 2024-09-12T22:50:02.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.238 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:02.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:02.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049539+0000", 2024-09-12T22:50:02.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:02.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049539+0000", 2024-09-12T22:50:02.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:02.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049540+0000", 2024-09-12T22:50:02.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1299999999999999e-07 2024-09-12T22:50:02.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:02.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054581+0000", 2024-09-12T22:50:02.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005041167 2024-09-12T22:50:02.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:02.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054593+0000", 2024-09-12T22:50:02.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1943000000000001e-05 2024-09-12T22:50:02.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:02.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054598+0000", 2024-09-12T22:50:02.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6500000000000001e-06 2024-09-12T22:50:02.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:02.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054658+0000", 2024-09-12T22:50:02.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9898999999999997e-05 2024-09-12T22:50:02.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:02.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054800+0000", 2024-09-12T22:50:02.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014187100000000001 2024-09-12T22:50:02.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:02.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.085456+0000", 2024-09-12T22:50:02.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.030655452 2024-09-12T22:50:02.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:02.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.085533+0000", 2024-09-12T22:50:02.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7478999999999995e-05 2024-09-12T22:50:02.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:02.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.085608+0000", 2024-09-12T22:50:02.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4684000000000005e-05 2024-09-12T22:50:02.242 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.242 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:02.242 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.242 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12677 4.10 4:0b7ac23f:::10000003457.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:02.242 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:50:02.242 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.970335757, 2024-09-12T22:50:02.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033661045000000001, 2024-09-12T22:50:02.242 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:02.242 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:02.242 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:02.243 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:02.243 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:02.243 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:02.243 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12677 2024-09-12T22:50:02.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.243 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:02.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:02.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:50:02.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:02.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:50:02.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:02.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:50:02.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0100000000000005e-07 2024-09-12T22:50:02.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:02.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.237295+0000", 2024-09-12T22:50:02.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078803290000000002 2024-09-12T22:50:02.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:02.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.237307+0000", 2024-09-12T22:50:02.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2339e-05 2024-09-12T22:50:02.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:02.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.237312+0000", 2024-09-12T22:50:02.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9089999999999999e-06 2024-09-12T22:50:02.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:02.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.239034+0000", 2024-09-12T22:50:02.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001722424 2024-09-12T22:50:02.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:02.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.239129+0000", 2024-09-12T22:50:02.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4486000000000003e-05 2024-09-12T22:50:02.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:02.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.239206+0000", 2024-09-12T22:50:02.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7146999999999998e-05 2024-09-12T22:50:02.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:02.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.255921+0000", 2024-09-12T22:50:02.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016714685 2024-09-12T22:50:02.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:02.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.263025+0000", 2024-09-12T22:50:02.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071042470000000002 2024-09-12T22:50:02.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:02.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.263052+0000", 2024-09-12T22:50:02.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7195e-05 2024-09-12T22:50:02.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:02.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.263075+0000", 2024-09-12T22:50:02.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2782999999999999e-05 2024-09-12T22:50:02.248 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.248 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:02.248 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.248 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12979 4.1e 4:78503759:::10000003406.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:02.248 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:50:02.249 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.6346489609999999, 2024-09-12T22:50:02.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032861456999999997, 2024-09-12T22:50:02.249 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:02.249 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:02.249 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:02.249 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:02.249 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:02.249 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:02.249 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12979 2024-09-12T22:50:02.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.249 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:02.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:02.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:50:02.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:02.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:50:02.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:02.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:50:02.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9999999999999998e-07 2024-09-12T22:50:02.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:02.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573365+0000", 2024-09-12T22:50:02.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082644229999999999 2024-09-12T22:50:02.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:02.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573379+0000", 2024-09-12T22:50:02.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3322999999999999e-05 2024-09-12T22:50:02.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:02.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573386+0000", 2024-09-12T22:50:02.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.199e-06 2024-09-12T22:50:02.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:02.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573464+0000", 2024-09-12T22:50:02.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7931999999999999e-05 2024-09-12T22:50:02.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:02.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573713+0000", 2024-09-12T22:50:02.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024922200000000001 2024-09-12T22:50:02.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:02.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.597870+0000", 2024-09-12T22:50:02.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024157221999999999 2024-09-12T22:50:02.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:02.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.597926+0000", 2024-09-12T22:50:02.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5838000000000003e-05 2024-09-12T22:50:02.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:02.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.597962+0000", 2024-09-12T22:50:02.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5898000000000001e-05 2024-09-12T22:50:02.253 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.254 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:02.254 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.254 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:13017 4.3b e56/17 4:deb39c3c:::1000000315d.00000000:head v 56'194, mlcod=56'192)", 2024-09-12T22:50:02.254 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.600876+0000", 2024-09-12T22:50:02.254 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.5988734850000004, 2024-09-12T22:50:02.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038152448999999998, 2024-09-12T22:50:02.254 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:02.254 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:02.254 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:02.255 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:02.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:02.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.600876+0000", 2024-09-12T22:50:02.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:02.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.600876+0000", 2024-09-12T22:50:02.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:02.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.600877+0000", 2024-09-12T22:50:02.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:50:02.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:02.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609737+0000", 2024-09-12T22:50:02.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088599089999999991 2024-09-12T22:50:02.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:02.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609748+0000", 2024-09-12T22:50:02.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1355999999999999e-05 2024-09-12T22:50:02.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:02.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609757+0000", 2024-09-12T22:50:02.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9190000000000005e-06 2024-09-12T22:50:02.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:02.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609801+0000", 2024-09-12T22:50:02.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4019e-05 2024-09-12T22:50:02.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:02.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609816+0000", 2024-09-12T22:50:02.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5226e-05 2024-09-12T22:50:02.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:02.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.638985+0000", 2024-09-12T22:50:02.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029168537000000001 2024-09-12T22:50:02.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:02.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.639028+0000", 2024-09-12T22:50:02.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3847000000000002e-05 2024-09-12T22:50:02.258 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.258 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:02.258 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.259 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13032 4.7 4:e102bf81:::1000000359e.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:02.259 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.616553+0000", 2024-09-12T22:50:02.259 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.583196633, 2024-09-12T22:50:02.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032471027999999999, 2024-09-12T22:50:02.259 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:02.259 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:02.259 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:02.259 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:02.259 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:02.259 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:02.259 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13032 2024-09-12T22:50:02.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.259 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:02.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:02.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.616553+0000", 2024-09-12T22:50:02.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:02.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.616553+0000", 2024-09-12T22:50:02.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:02.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.616554+0000", 2024-09-12T22:50:02.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0100000000000004e-07 2024-09-12T22:50:02.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:02.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621405+0000", 2024-09-12T22:50:02.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0048517480000000003 2024-09-12T22:50:02.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:02.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621416+0000", 2024-09-12T22:50:02.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0264e-05 2024-09-12T22:50:02.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:02.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621446+0000", 2024-09-12T22:50:02.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0849000000000002e-05 2024-09-12T22:50:02.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:02.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621494+0000", 2024-09-12T22:50:02.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7018000000000003e-05 2024-09-12T22:50:02.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:02.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621590+0000", 2024-09-12T22:50:02.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6632999999999995e-05 2024-09-12T22:50:02.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:02.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621680+0000", 2024-09-12T22:50:02.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9704999999999996e-05 2024-09-12T22:50:02.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:02.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.639248+0000", 2024-09-12T22:50:02.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017568548 2024-09-12T22:50:02.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:02.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.648944+0000", 2024-09-12T22:50:02.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0096954659999999998 2024-09-12T22:50:02.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:02.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.648992+0000", 2024-09-12T22:50:02.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8059999999999997e-05 2024-09-12T22:50:02.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:02.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.649024+0000", 2024-09-12T22:50:02.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1936000000000001e-05 2024-09-12T22:50:02.264 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.264 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:02.264 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.265 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13428 4.37 4:eeed8456:::1000000321a.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:02.265 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.064666+0000", 2024-09-12T22:50:02.265 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.1350833549999999, 2024-09-12T22:50:02.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033441308000000003, 2024-09-12T22:50:02.265 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:02.265 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:02.265 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:02.265 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:02.265 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:02.265 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:02.265 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13428 2024-09-12T22:50:02.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.266 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:02.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:02.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.064666+0000", 2024-09-12T22:50:02.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:02.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.064666+0000", 2024-09-12T22:50:02.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:02.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.064668+0000", 2024-09-12T22:50:02.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4160000000000001e-06 2024-09-12T22:50:02.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:02.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071829+0000", 2024-09-12T22:50:02.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071611390000000004 2024-09-12T22:50:02.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:02.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071840+0000", 2024-09-12T22:50:02.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1369000000000001e-05 2024-09-12T22:50:02.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:02.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071847+0000", 2024-09-12T22:50:02.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0960000000000003e-06 2024-09-12T22:50:02.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:02.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071904+0000", 2024-09-12T22:50:02.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7309000000000003e-05 2024-09-12T22:50:02.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:02.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.072051+0000", 2024-09-12T22:50:02.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014625 2024-09-12T22:50:02.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:02.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.072194+0000", 2024-09-12T22:50:02.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014379799999999999 2024-09-12T22:50:02.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:02.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.079527+0000", 2024-09-12T22:50:02.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007332674 2024-09-12T22:50:02.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:02.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.098048+0000", 2024-09-12T22:50:02.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018521174000000001 2024-09-12T22:50:02.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:02.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.098081+0000", 2024-09-12T22:50:02.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2910999999999997e-05 2024-09-12T22:50:02.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:02.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.098107+0000", 2024-09-12T22:50:02.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6171999999999999e-05 2024-09-12T22:50:02.270 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.271 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:02.271 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.271 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13472 4.12 4:4b0bd9b8:::100000033b0.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:02.271 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.113168+0000", 2024-09-12T22:50:02.271 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.0865816559999999, 2024-09-12T22:50:02.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.039534103000000001, 2024-09-12T22:50:02.271 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:02.271 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:02.271 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:02.271 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:02.271 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:02.271 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:02.272 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13472 2024-09-12T22:50:02.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.272 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:02.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:02.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.113168+0000", 2024-09-12T22:50:02.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:02.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.113168+0000", 2024-09-12T22:50:02.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:02.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.113169+0000", 2024-09-12T22:50:02.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1960000000000001e-06 2024-09-12T22:50:02.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:02.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119849+0000", 2024-09-12T22:50:02.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0066801830000000001 2024-09-12T22:50:02.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:02.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119861+0000", 2024-09-12T22:50:02.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.199e-05 2024-09-12T22:50:02.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:02.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119866+0000", 2024-09-12T22:50:02.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8720000000000001e-06 2024-09-12T22:50:02.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:02.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119945+0000", 2024-09-12T22:50:02.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9268000000000001e-05 2024-09-12T22:50:02.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:02.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.120098+0000", 2024-09-12T22:50:02.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015299500000000001 2024-09-12T22:50:02.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:02.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.120218+0000", 2024-09-12T22:50:02.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011989099999999999 2024-09-12T22:50:02.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:02.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.140463+0000", 2024-09-12T22:50:02.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020244765000000001 2024-09-12T22:50:02.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.152629+0000", 2024-09-12T22:50:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012165601999999999 2024-09-12T22:50:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.152664+0000", 2024-09-12T22:50:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5599999999999998e-05 2024-09-12T22:50:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.152702+0000", 2024-09-12T22:50:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7741000000000003e-05 2024-09-12T22:50:02.277 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.277 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:02.277 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.277 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13484 4.2f 4:f62c2e43:::1000000349e.00000000:head [write 0~4194304 [2@3461078]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:02.277 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.125796+0000", 2024-09-12T22:50:02.277 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.0739532929999998, 2024-09-12T22:50:02.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.036857236000000002, 2024-09-12T22:50:02.277 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:02.277 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:02.277 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:02.277 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:02.277 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:02.278 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:02.278 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13484 2024-09-12T22:50:02.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.278 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:02.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:02.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.125796+0000", 2024-09-12T22:50:02.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:02.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.125796+0000", 2024-09-12T22:50:02.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:02.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.125797+0000", 2024-09-12T22:50:02.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.108e-06 2024-09-12T22:50:02.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:02.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130725+0000", 2024-09-12T22:50:02.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049272949999999999 2024-09-12T22:50:02.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:02.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130739+0000", 2024-09-12T22:50:02.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4234e-05 2024-09-12T22:50:02.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:02.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130751+0000", 2024-09-12T22:50:02.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1848000000000001e-05 2024-09-12T22:50:02.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:02.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130816+0000", 2024-09-12T22:50:02.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5359999999999998e-05 2024-09-12T22:50:02.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:02.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130917+0000", 2024-09-12T22:50:02.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101178 2024-09-12T22:50:02.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:02.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.131058+0000", 2024-09-12T22:50:02.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140803 2024-09-12T22:50:02.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:02.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.153387+0000", 2024-09-12T22:50:02.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022328585000000001 2024-09-12T22:50:02.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:02.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.162465+0000", 2024-09-12T22:50:02.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090781360000000005 2024-09-12T22:50:02.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:02.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.162584+0000", 2024-09-12T22:50:02.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119634 2024-09-12T22:50:02.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:02.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.162653+0000", 2024-09-12T22:50:02.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9054999999999995e-05 2024-09-12T22:50:02.283 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.283 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:02.283 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.283 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13558 4.10 4:09df41af:::1000000333c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:02.283 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.229326+0000", 2024-09-12T22:50:02.283 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.9704234649999997, 2024-09-12T22:50:02.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.039409786000000002, 2024-09-12T22:50:02.283 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:02.283 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:02.283 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:02.284 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:02.284 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:02.284 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:02.284 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13558 2024-09-12T22:50:02.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.284 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:02.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:02.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.229326+0000", 2024-09-12T22:50:02.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:02.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.229326+0000", 2024-09-12T22:50:02.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:02.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.229327+0000", 2024-09-12T22:50:02.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1200000000000002e-07 2024-09-12T22:50:02.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:02.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235243+0000", 2024-09-12T22:50:02.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059166310000000003 2024-09-12T22:50:02.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:02.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235255+0000", 2024-09-12T22:50:02.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1174e-05 2024-09-12T22:50:02.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:02.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235260+0000", 2024-09-12T22:50:02.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1749999999999996e-06 2024-09-12T22:50:02.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:02.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235295+0000", 2024-09-12T22:50:02.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4830999999999999e-05 2024-09-12T22:50:02.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:02.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235350+0000", 2024-09-12T22:50:02.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5092e-05 2024-09-12T22:50:02.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:02.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235426+0000", 2024-09-12T22:50:02.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6463000000000003e-05 2024-09-12T22:50:02.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:02.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.244772+0000", 2024-09-12T22:50:02.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0093457709999999992 2024-09-12T22:50:02.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:02.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.268679+0000", 2024-09-12T22:50:02.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023906788000000002 2024-09-12T22:50:02.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:02.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.268712+0000", 2024-09-12T22:50:02.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3701999999999997e-05 2024-09-12T22:50:02.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:02.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.268736+0000", 2024-09-12T22:50:02.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3447000000000001e-05 2024-09-12T22:50:02.289 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.289 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:02.289 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.289 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13747 4.1e 4:7aa36f33:::100000035ed.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:02.289 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.457376+0000", 2024-09-12T22:50:02.289 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.7423733510000003, 2024-09-12T22:50:02.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.037057578000000001, 2024-09-12T22:50:02.289 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:02.289 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:02.290 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:02.290 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:02.290 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:02.290 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:02.290 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13747 2024-09-12T22:50:02.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.291 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:02.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:02.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.457376+0000", 2024-09-12T22:50:02.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:02.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.457376+0000", 2024-09-12T22:50:02.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:02.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.457377+0000", 2024-09-12T22:50:02.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1699999999999998e-07 2024-09-12T22:50:02.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:02.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464400+0000", 2024-09-12T22:50:02.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070235890000000002 2024-09-12T22:50:02.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:02.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464413+0000", 2024-09-12T22:50:02.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2397e-05 2024-09-12T22:50:02.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:02.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464418+0000", 2024-09-12T22:50:02.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5119999999999999e-06 2024-09-12T22:50:02.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:02.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464464+0000", 2024-09-12T22:50:02.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5976000000000002e-05 2024-09-12T22:50:02.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:02.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464529+0000", 2024-09-12T22:50:02.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5266999999999997e-05 2024-09-12T22:50:02.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:02.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.494315+0000", 2024-09-12T22:50:02.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029785329999999999 2024-09-12T22:50:02.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:02.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.494366+0000", 2024-09-12T22:50:02.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0903999999999999e-05 2024-09-12T22:50:02.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:02.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.494434+0000", 2024-09-12T22:50:02.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7985999999999996e-05 2024-09-12T22:50:02.295 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.295 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:02.296 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.296 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:13748 4.15 e56/17 4:ab1b03eb:::100000031a3.00000000:head v 56'173, mlcod=56'171)", 2024-09-12T22:50:02.296 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.462509+0000", 2024-09-12T22:50:02.296 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.7372403040000002, 2024-09-12T22:50:02.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044366823, 2024-09-12T22:50:02.296 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:02.296 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:02.296 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:02.297 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:02.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:02.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.462509+0000", 2024-09-12T22:50:02.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:02.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.462509+0000", 2024-09-12T22:50:02.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:02.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.462509+0000", 2024-09-12T22:50:02.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7599999999999998e-07 2024-09-12T22:50:02.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:02.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471576+0000", 2024-09-12T22:50:02.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090665490000000001 2024-09-12T22:50:02.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:02.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471591+0000", 2024-09-12T22:50:02.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4566000000000001e-05 2024-09-12T22:50:02.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:02.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471600+0000", 2024-09-12T22:50:02.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1630000000000002e-06 2024-09-12T22:50:02.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:02.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471689+0000", 2024-09-12T22:50:02.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9591000000000003e-05 2024-09-12T22:50:02.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:02.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471735+0000", 2024-09-12T22:50:02.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5429000000000002e-05 2024-09-12T22:50:02.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:02.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.506851+0000", 2024-09-12T22:50:02.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035116238000000001 2024-09-12T22:50:02.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:02.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.506876+0000", 2024-09-12T22:50:02.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5011000000000002e-05 2024-09-12T22:50:02.301 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.301 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:02.301 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.302 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13753 4.30 4:0dea61b7:::100000036ed.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:02.302 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.464559+0000", 2024-09-12T22:50:02.302 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.7351903049999997, 2024-09-12T22:50:02.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041415303000000001, 2024-09-12T22:50:02.302 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:02.302 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:02.302 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:02.302 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:02.302 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:02.302 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:02.303 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13753 2024-09-12T22:50:02.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.303 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:02.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:02.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464559+0000", 2024-09-12T22:50:02.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:02.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464559+0000", 2024-09-12T22:50:02.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:02.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464560+0000", 2024-09-12T22:50:02.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:50:02.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:02.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469861+0000", 2024-09-12T22:50:02.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053017139999999999 2024-09-12T22:50:02.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:02.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469878+0000", 2024-09-12T22:50:02.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6336000000000001e-05 2024-09-12T22:50:02.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:02.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469888+0000", 2024-09-12T22:50:02.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8320000000000001e-06 2024-09-12T22:50:02.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:02.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469950+0000", 2024-09-12T22:50:02.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1923999999999999e-05 2024-09-12T22:50:02.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:02.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.470059+0000", 2024-09-12T22:50:02.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109559 2024-09-12T22:50:02.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:02.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.505915+0000", 2024-09-12T22:50:02.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035855887000000003 2024-09-12T22:50:02.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:02.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.505939+0000", 2024-09-12T22:50:02.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3740999999999999e-05 2024-09-12T22:50:02.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:02.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.505974+0000", 2024-09-12T22:50:02.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5753999999999997e-05 2024-09-12T22:50:02.308 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.308 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:02.308 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.308 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13754 4.11 4:8a2f20b1:::10000003764.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:02.308 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.469921+0000", 2024-09-12T22:50:02.308 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.7298284529999997, 2024-09-12T22:50:02.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034721670000000003, 2024-09-12T22:50:02.309 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:02.309 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:02.309 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:02.309 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:02.309 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:02.309 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:02.309 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13754 2024-09-12T22:50:02.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.310 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:02.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:02.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469921+0000", 2024-09-12T22:50:02.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:02.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469921+0000", 2024-09-12T22:50:02.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:02.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469922+0000", 2024-09-12T22:50:02.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.006e-06 2024-09-12T22:50:02.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:02.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474681+0000", 2024-09-12T22:50:02.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047588539999999999 2024-09-12T22:50:02.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:02.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474698+0000", 2024-09-12T22:50:02.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7368999999999999e-05 2024-09-12T22:50:02.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:02.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474709+0000", 2024-09-12T22:50:02.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0738e-05 2024-09-12T22:50:02.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:02.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474780+0000", 2024-09-12T22:50:02.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0622000000000002e-05 2024-09-12T22:50:02.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:02.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474954+0000", 2024-09-12T22:50:02.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017394399999999999 2024-09-12T22:50:02.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:02.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.504488+0000", 2024-09-12T22:50:02.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029534721999999999 2024-09-12T22:50:02.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:02.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.504553+0000", 2024-09-12T22:50:02.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4877999999999998e-05 2024-09-12T22:50:02.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:02.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.504643+0000", 2024-09-12T22:50:02.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9536999999999993e-05 2024-09-12T22:50:02.315 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.315 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:02.315 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.315 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13763 4.2d 4:b5937a57:::100000031de.00000000:head [write 0~4194304 [3@52474]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:02.315 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.474957+0000", 2024-09-12T22:50:02.315 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.7247922100000004, 2024-09-12T22:50:02.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.057329167, 2024-09-12T22:50:02.315 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:02.315 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:02.316 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:02.316 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:02.316 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:02.316 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:02.316 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13763 2024-09-12T22:50:02.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.316 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:02.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:02.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474957+0000", 2024-09-12T22:50:02.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:02.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474957+0000", 2024-09-12T22:50:02.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:02.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474958+0000", 2024-09-12T22:50:02.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8299999999999997e-07 2024-09-12T22:50:02.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:02.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.478970+0000", 2024-09-12T22:50:02.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040121100000000002 2024-09-12T22:50:02.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:02.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.478983+0000", 2024-09-12T22:50:02.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.292e-05 2024-09-12T22:50:02.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:02.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.478992+0000", 2024-09-12T22:50:02.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3759999999999997e-06 2024-09-12T22:50:02.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:02.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.479048+0000", 2024-09-12T22:50:02.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5381999999999999e-05 2024-09-12T22:50:02.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:02.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.479124+0000", 2024-09-12T22:50:02.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6643999999999993e-05 2024-09-12T22:50:02.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:02.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.479230+0000", 2024-09-12T22:50:02.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010581099999999999 2024-09-12T22:50:02.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:02.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.506897+0000", 2024-09-12T22:50:02.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027666863999999999 2024-09-12T22:50:02.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:02.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.532175+0000", 2024-09-12T22:50:02.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.025278367 2024-09-12T22:50:02.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:02.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.532232+0000", 2024-09-12T22:50:02.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6455000000000001e-05 2024-09-12T22:50:02.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:02.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.532286+0000", 2024-09-12T22:50:02.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4654999999999998e-05 2024-09-12T22:50:02.322 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.322 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:02.322 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.323 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13803 4.4 4:228c5bc4:::10000003314.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:02.323 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.515814+0000", 2024-09-12T22:50:02.323 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.683935784, 2024-09-12T22:50:02.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034442453999999997, 2024-09-12T22:50:02.323 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:02.323 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:02.323 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:02.323 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:02.323 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:02.324 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:02.324 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13803 2024-09-12T22:50:02.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.324 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:02.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:02.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.515814+0000", 2024-09-12T22:50:02.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:02.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.515814+0000", 2024-09-12T22:50:02.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:02.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:02.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.515814+0000", 2024-09-12T22:50:02.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4799999999999998e-07 2024-09-12T22:50:02.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:02.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522580+0000", 2024-09-12T22:50:02.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0067656959999999999 2024-09-12T22:50:02.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:02.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522591+0000", 2024-09-12T22:50:02.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1206000000000001e-05 2024-09-12T22:50:02.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:02.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522597+0000", 2024-09-12T22:50:02.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1500000000000004e-06 2024-09-12T22:50:02.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:02.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522639+0000", 2024-09-12T22:50:02.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1767999999999997e-05 2024-09-12T22:50:02.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:02.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522689+0000", 2024-09-12T22:50:02.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9472999999999999e-05 2024-09-12T22:50:02.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:02.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522771+0000", 2024-09-12T22:50:02.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2738000000000006e-05 2024-09-12T22:50:02.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:02.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.529356+0000", 2024-09-12T22:50:02.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065850329999999997 2024-09-12T22:50:02.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:02.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.550206+0000", 2024-09-12T22:50:02.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020849755000000001 2024-09-12T22:50:02.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:02.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.550233+0000", 2024-09-12T22:50:02.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6990000000000001e-05 2024-09-12T22:50:02.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:02.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:02.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:02.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.550256+0000", 2024-09-12T22:50:02.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3096999999999999e-05 2024-09-12T22:50:02.329 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.329 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:02.329 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.329 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:02.329 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:02.329 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:50:02.330 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:50:02.331 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:02.330+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:02.353 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:50:02.431 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:02.430+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:02.481 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:50:02.481 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:50:02.481 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:50:02.481 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:50:02.490 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:50:02.497 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:50:02.497 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:50:02.520 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:50:02.520 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:50:02.520 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:50:02.524 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:50:02.524 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:50:02.532 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:02.531+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:02.632 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:02.631+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:02.634 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:02.634 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:02.644 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:50:02.733 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:02.732+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:02.788 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:02.788 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:02.796 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:50:02.842 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:02.841+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:02.902 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:02.902 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:02.911 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:50:02.935 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:02.934+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:03.036 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:03.035+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:03.058 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:03.059 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:03.068 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:50:03.137 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:03.136+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:03.171 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:03.171 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:03.181 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:50:03.237 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:03.236+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:03.318 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:03.318 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:03.330 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:50:03.339 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:03.338+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:03.440 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:03.439+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:03.476 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:03.476 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:03.485 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:50:03.541 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:03.540+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:03.630 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:03.630 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:03.640 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:50:03.642 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:03.641+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:03.709 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:50:03.744 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:03.743+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:03.747 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:03.747 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:03.756 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:50:03.844 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:03.844+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:03.899 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:03.899 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:03.907 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:50:03.946 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:03.945+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:04.010 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:04.010 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:04.018 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:50:04.046 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:04.045+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:04.123 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:04.123 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:04.132 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:50:04.147 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:04.146+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:04.237 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:04.237 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:04.246 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:50:04.247 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:04.246+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:04.349 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:04.348+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:04.351 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:04.351 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:04.360 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:50:04.449 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:04.448+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:04.469 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:04.469 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:04.480 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:50:04.525 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:50:04.565 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:04.564+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:04.628 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:04.628 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:04.637 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:50:04.652 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:04.651+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:04.666 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:50:04.666 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:50:04.688 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:50:04.689 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:50:04.689 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:50:04.690 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:50:04.691 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:50:04.706 INFO:teuthology.orchestra.run.smithi066.stderr:noscrub is unset 2024-09-12T22:50:04.753 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:04.752+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:04.786 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:50:04.786 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:50:04.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:50:04.786 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:50:04.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.786 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12403 4.0 4:0146e0d0:::100000031d4.00000000:head [write 0~4194304 [2@3733965]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:04.786 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:55.747692+0000", 2024-09-12T22:50:04.787 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.0362840710000008, 2024-09-12T22:50:04.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.22362137500000001, 2024-09-12T22:50:04.787 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:04.787 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:04.787 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:04.787 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:04.787 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:04.787 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:04.787 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12403 2024-09-12T22:50:04.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.787 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:04.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.788 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:04.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.747692+0000", 2024-09-12T22:50:04.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.788 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:04.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.747692+0000", 2024-09-12T22:50:04.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:04.789 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.747693+0000", 2024-09-12T22:50:04.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3799999999999996e-07 2024-09-12T22:50:04.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:04.789 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959640+0000", 2024-09-12T22:50:04.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.21194702000000001 2024-09-12T22:50:04.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:04.789 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959660+0000", 2024-09-12T22:50:04.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9939e-05 2024-09-12T22:50:04.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.790 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:04.790 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959668+0000", 2024-09-12T22:50:04.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1669999999999999e-06 2024-09-12T22:50:04.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.790 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:04.790 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959764+0000", 2024-09-12T22:50:04.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5315000000000005e-05 2024-09-12T22:50:04.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:04.791 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959865+0000", 2024-09-12T22:50:04.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101618 2024-09-12T22:50:04.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:04.791 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.971224+0000", 2024-09-12T22:50:04.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011358541999999999 2024-09-12T22:50:04.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:04.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.971261+0000", 2024-09-12T22:50:04.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7092999999999999e-05 2024-09-12T22:50:04.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:04.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.971314+0000", 2024-09-12T22:50:04.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2843000000000002e-05 2024-09-12T22:50:04.792 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.792 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:04.792 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.793 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:12503 4.15 e56/17 4:ab29d13f:::100000033b1.00000000:head v 56'161, mlcod=55'159)", 2024-09-12T22:50:04.793 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:50:04.793 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.7533705939999997, 2024-09-12T22:50:04.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.043668640000000002, 2024-09-12T22:50:04.793 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:04.793 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:04.793 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:04.793 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:04.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:04.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:50:04.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:04.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:50:04.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:04.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:50:04.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:50:04.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:04.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039768+0000", 2024-09-12T22:50:04.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0091617190000000005 2024-09-12T22:50:04.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:04.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039781+0000", 2024-09-12T22:50:04.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2829e-05 2024-09-12T22:50:04.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.796 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.796 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:04.796 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039789+0000", 2024-09-12T22:50:04.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9340000000000006e-06 2024-09-12T22:50:04.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.796 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.796 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:04.796 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039846+0000", 2024-09-12T22:50:04.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6762999999999998e-05 2024-09-12T22:50:04.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:04.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039897+0000", 2024-09-12T22:50:04.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1517000000000002e-05 2024-09-12T22:50:04.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:04.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074225+0000", 2024-09-12T22:50:04.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034328138000000001 2024-09-12T22:50:04.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:04.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074274+0000", 2024-09-12T22:50:04.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9255999999999997e-05 2024-09-12T22:50:04.798 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.798 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:04.798 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.798 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12508 4.2d 4:b7b19b64:::10000003230.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:04.798 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.037293+0000", 2024-09-12T22:50:04.798 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.746683419, 2024-09-12T22:50:04.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.037399772999999997, 2024-09-12T22:50:04.799 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:04.799 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:04.799 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:04.799 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:04.799 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:04.799 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:04.799 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12508 2024-09-12T22:50:04.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.799 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:04.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.800 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:04.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037293+0000", 2024-09-12T22:50:04.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.800 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:04.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037293+0000", 2024-09-12T22:50:04.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.800 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:04.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037294+0000", 2024-09-12T22:50:04.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4899999999999995e-07 2024-09-12T22:50:04.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:04.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042701+0000", 2024-09-12T22:50:04.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054069419999999997 2024-09-12T22:50:04.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:04.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042712+0000", 2024-09-12T22:50:04.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.171e-05 2024-09-12T22:50:04.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.802 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.802 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:04.802 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042719+0000", 2024-09-12T22:50:04.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1189999999999999e-06 2024-09-12T22:50:04.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.802 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.802 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:04.802 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042759+0000", 2024-09-12T22:50:04.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9478999999999999e-05 2024-09-12T22:50:04.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.803 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:04.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042827+0000", 2024-09-12T22:50:04.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8435999999999993e-05 2024-09-12T22:50:04.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.803 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:04.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042965+0000", 2024-09-12T22:50:04.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000137723 2024-09-12T22:50:04.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:04.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.058351+0000", 2024-09-12T22:50:04.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015385902 2024-09-12T22:50:04.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:04.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074620+0000", 2024-09-12T22:50:04.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016269018 2024-09-12T22:50:04.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:04.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074657+0000", 2024-09-12T22:50:04.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6619999999999998e-05 2024-09-12T22:50:04.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:04.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074693+0000", 2024-09-12T22:50:04.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6174999999999998e-05 2024-09-12T22:50:04.805 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.805 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:04.805 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.806 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12516 4.21 4:858ae08d:::100000030eb.00000000:head [write 0~4194304 [3@1582458]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:04.806 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.045143+0000", 2024-09-12T22:50:04.806 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.7388331309999998, 2024-09-12T22:50:04.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.039721657, 2024-09-12T22:50:04.806 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:04.806 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:04.806 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:04.806 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:04.806 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:04.806 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:04.806 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12516 2024-09-12T22:50:04.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.807 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:04.807 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.807 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:04.807 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.045143+0000", 2024-09-12T22:50:04.807 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.807 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.807 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:04.807 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.045143+0000", 2024-09-12T22:50:04.807 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.808 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:04.808 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.045144+0000", 2024-09-12T22:50:04.808 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2900000000000002e-07 2024-09-12T22:50:04.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.808 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:04.808 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049506+0000", 2024-09-12T22:50:04.808 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043620280000000004 2024-09-12T22:50:04.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:04.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049517+0000", 2024-09-12T22:50:04.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0726e-05 2024-09-12T22:50:04.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:04.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049522+0000", 2024-09-12T22:50:04.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3730000000000001e-06 2024-09-12T22:50:04.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:04.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049583+0000", 2024-09-12T22:50:04.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1254999999999995e-05 2024-09-12T22:50:04.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.810 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:04.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049645+0000", 2024-09-12T22:50:04.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1988000000000003e-05 2024-09-12T22:50:04.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.810 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:04.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049731+0000", 2024-09-12T22:50:04.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6040999999999998e-05 2024-09-12T22:50:04.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.811 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:04.811 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.064126+0000", 2024-09-12T22:50:04.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01439497 2024-09-12T22:50:04.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.811 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:04.811 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.084785+0000", 2024-09-12T22:50:04.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020658972000000001 2024-09-12T22:50:04.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.812 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:04.812 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.084829+0000", 2024-09-12T22:50:04.812 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3869000000000003e-05 2024-09-12T22:50:04.812 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.812 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:04.812 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.084865+0000", 2024-09-12T22:50:04.812 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5605999999999998e-05 2024-09-12T22:50:04.812 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.812 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:04.813 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.813 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1354 3.18 3:1e8917d7:::200.0000000e:head [write 498872~14494 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:04.813 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.048337+0000", 2024-09-12T22:50:04.813 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.7356392120000006, 2024-09-12T22:50:04.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034292491000000001, 2024-09-12T22:50:04.813 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:04.813 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:04.813 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:04.813 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:04.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:04.814 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048337+0000", 2024-09-12T22:50:04.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:04.814 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048337+0000", 2024-09-12T22:50:04.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:04.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048339+0000", 2024-09-12T22:50:04.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.409e-06 2024-09-12T22:50:04.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:04.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048360+0000", 2024-09-12T22:50:04.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1659999999999999e-05 2024-09-12T22:50:04.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.816 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:04.816 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048370+0000", 2024-09-12T22:50:04.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.611e-06 2024-09-12T22:50:04.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.816 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:04.816 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048376+0000", 2024-09-12T22:50:04.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5479999999999998e-06 2024-09-12T22:50:04.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.816 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:04.816 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048440+0000", 2024-09-12T22:50:04.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3367000000000005e-05 2024-09-12T22:50:04.817 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.817 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.817 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:04.817 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048557+0000", 2024-09-12T22:50:04.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116983 2024-09-12T22:50:04.817 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.817 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.817 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:04.817 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048719+0000", 2024-09-12T22:50:04.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016250499999999999 2024-09-12T22:50:04.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.818 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.818 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:04.818 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.058763+0000", 2024-09-12T22:50:04.818 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010043948 2024-09-12T22:50:04.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.818 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.818 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:04.818 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082499+0000", 2024-09-12T22:50:04.818 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023735320000000001 2024-09-12T22:50:04.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.818 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.819 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:04.819 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082561+0000", 2024-09-12T22:50:04.819 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2490000000000006e-05 2024-09-12T22:50:04.819 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.819 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.819 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:04.819 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082630+0000", 2024-09-12T22:50:04.819 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8650000000000002e-05 2024-09-12T22:50:04.819 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.819 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:04.819 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.819 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.820 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.820 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12517 4.1a 4:5a8c04dd:::10000003276.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:04.820 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.049539+0000", 2024-09-12T22:50:04.820 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.7344374499999997, 2024-09-12T22:50:04.820 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.036068957999999998, 2024-09-12T22:50:04.820 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:04.820 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:04.820 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:04.820 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:04.820 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:04.820 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:04.821 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12517 2024-09-12T22:50:04.821 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.821 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:04.821 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.821 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:04.821 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049539+0000", 2024-09-12T22:50:04.821 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.821 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.821 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.821 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:04.821 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049539+0000", 2024-09-12T22:50:04.821 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.822 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.822 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:04.822 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049540+0000", 2024-09-12T22:50:04.822 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1299999999999999e-07 2024-09-12T22:50:04.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.822 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.822 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:04.822 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054581+0000", 2024-09-12T22:50:04.822 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005041167 2024-09-12T22:50:04.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.823 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:04.823 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054593+0000", 2024-09-12T22:50:04.823 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1943000000000001e-05 2024-09-12T22:50:04.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.823 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:04.823 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054598+0000", 2024-09-12T22:50:04.823 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6500000000000001e-06 2024-09-12T22:50:04.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.823 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:04.824 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054658+0000", 2024-09-12T22:50:04.824 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9898999999999997e-05 2024-09-12T22:50:04.824 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.824 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.824 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:04.824 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054800+0000", 2024-09-12T22:50:04.824 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014187100000000001 2024-09-12T22:50:04.824 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.824 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.824 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:04.824 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.085456+0000", 2024-09-12T22:50:04.824 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.030655452 2024-09-12T22:50:04.825 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.825 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.825 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:04.825 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.085533+0000", 2024-09-12T22:50:04.825 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7478999999999995e-05 2024-09-12T22:50:04.825 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.825 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.825 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:04.825 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.085608+0000", 2024-09-12T22:50:04.825 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4684000000000005e-05 2024-09-12T22:50:04.825 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.825 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:04.826 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.826 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.826 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12677 4.10 4:0b7ac23f:::10000003457.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:04.826 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:50:04.826 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.5545626539999997, 2024-09-12T22:50:04.826 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033661045000000001, 2024-09-12T22:50:04.826 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:04.826 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:04.826 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:04.826 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:04.827 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:04.827 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:04.827 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12677 2024-09-12T22:50:04.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.827 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:04.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.827 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:04.827 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:50:04.827 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.827 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:04.828 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:50:04.828 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.828 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.828 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.828 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:04.828 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:50:04.828 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0100000000000005e-07 2024-09-12T22:50:04.828 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.828 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.828 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:04.828 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.237295+0000", 2024-09-12T22:50:04.829 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078803290000000002 2024-09-12T22:50:04.829 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.829 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.829 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:04.829 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.237307+0000", 2024-09-12T22:50:04.829 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2339e-05 2024-09-12T22:50:04.829 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.829 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.829 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:04.829 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.237312+0000", 2024-09-12T22:50:04.829 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9089999999999999e-06 2024-09-12T22:50:04.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.830 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.830 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:04.830 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.239034+0000", 2024-09-12T22:50:04.830 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001722424 2024-09-12T22:50:04.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.830 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.830 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:04.830 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.239129+0000", 2024-09-12T22:50:04.830 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4486000000000003e-05 2024-09-12T22:50:04.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.830 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.831 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:04.831 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.239206+0000", 2024-09-12T22:50:04.831 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7146999999999998e-05 2024-09-12T22:50:04.831 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.831 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.831 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:04.831 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.255921+0000", 2024-09-12T22:50:04.831 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016714685 2024-09-12T22:50:04.831 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.831 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.831 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:04.831 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.263025+0000", 2024-09-12T22:50:04.832 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071042470000000002 2024-09-12T22:50:04.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.832 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.832 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:04.832 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.263052+0000", 2024-09-12T22:50:04.832 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7195e-05 2024-09-12T22:50:04.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.832 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.832 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:04.832 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.263075+0000", 2024-09-12T22:50:04.832 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2782999999999999e-05 2024-09-12T22:50:04.833 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.833 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:04.833 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.833 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.833 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.833 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12979 4.1e 4:78503759:::10000003406.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:04.833 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:50:04.833 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.2188758580000005, 2024-09-12T22:50:04.833 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032861456999999997, 2024-09-12T22:50:04.833 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:04.833 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:04.834 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:04.834 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:04.834 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:04.834 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:04.834 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12979 2024-09-12T22:50:04.834 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.834 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:04.834 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.834 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:04.834 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:50:04.834 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.834 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.835 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.835 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:04.835 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:50:04.835 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.835 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.835 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.835 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:04.835 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:50:04.835 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9999999999999998e-07 2024-09-12T22:50:04.835 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.835 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.836 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:04.836 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573365+0000", 2024-09-12T22:50:04.836 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082644229999999999 2024-09-12T22:50:04.836 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.836 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.836 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:04.836 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573379+0000", 2024-09-12T22:50:04.836 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3322999999999999e-05 2024-09-12T22:50:04.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.837 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:04.837 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573386+0000", 2024-09-12T22:50:04.837 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.199e-06 2024-09-12T22:50:04.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.837 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:04.837 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573464+0000", 2024-09-12T22:50:04.837 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7931999999999999e-05 2024-09-12T22:50:04.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.838 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:04.838 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573713+0000", 2024-09-12T22:50:04.838 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024922200000000001 2024-09-12T22:50:04.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.838 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:04.838 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.597870+0000", 2024-09-12T22:50:04.838 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024157221999999999 2024-09-12T22:50:04.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.839 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:04.839 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.597926+0000", 2024-09-12T22:50:04.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5838000000000003e-05 2024-09-12T22:50:04.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.839 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:04.839 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.597962+0000", 2024-09-12T22:50:04.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5898000000000001e-05 2024-09-12T22:50:04.839 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.839 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:04.840 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.840 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.840 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:13017 4.3b e56/17 4:deb39c3c:::1000000315d.00000000:head v 56'194, mlcod=56'192)", 2024-09-12T22:50:04.840 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.600876+0000", 2024-09-12T22:50:04.840 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.1831003819999992, 2024-09-12T22:50:04.840 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038152448999999998, 2024-09-12T22:50:04.840 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:04.840 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:04.840 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:04.840 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:04.841 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.841 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:04.841 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.600876+0000", 2024-09-12T22:50:04.841 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.841 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.841 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.841 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:04.841 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.600876+0000", 2024-09-12T22:50:04.841 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.841 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.841 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.841 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:04.842 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.600877+0000", 2024-09-12T22:50:04.842 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:50:04.842 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.842 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.842 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:04.842 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609737+0000", 2024-09-12T22:50:04.842 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088599089999999991 2024-09-12T22:50:04.842 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.842 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.842 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:04.842 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609748+0000", 2024-09-12T22:50:04.842 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1355999999999999e-05 2024-09-12T22:50:04.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.843 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:04.843 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609757+0000", 2024-09-12T22:50:04.843 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9190000000000005e-06 2024-09-12T22:50:04.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.843 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:04.843 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609801+0000", 2024-09-12T22:50:04.843 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4019e-05 2024-09-12T22:50:04.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.844 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:04.844 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609816+0000", 2024-09-12T22:50:04.844 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5226e-05 2024-09-12T22:50:04.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.844 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:04.844 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.638985+0000", 2024-09-12T22:50:04.844 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029168537000000001 2024-09-12T22:50:04.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.845 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:04.845 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.639028+0000", 2024-09-12T22:50:04.845 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3847000000000002e-05 2024-09-12T22:50:04.845 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.845 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:04.845 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.845 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.845 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13032 4.7 4:e102bf81:::1000000359e.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:04.845 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.616553+0000", 2024-09-12T22:50:04.845 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.1674235300000007, 2024-09-12T22:50:04.846 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032471027999999999, 2024-09-12T22:50:04.846 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:04.846 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:04.846 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:04.846 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:04.846 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:04.846 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:04.846 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13032 2024-09-12T22:50:04.846 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.846 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:04.846 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.846 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:04.847 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.616553+0000", 2024-09-12T22:50:04.847 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.847 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.847 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.847 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:04.847 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.616553+0000", 2024-09-12T22:50:04.847 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.847 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.847 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.847 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:04.847 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.616554+0000", 2024-09-12T22:50:04.848 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0100000000000004e-07 2024-09-12T22:50:04.848 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.848 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.848 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:04.848 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621405+0000", 2024-09-12T22:50:04.848 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0048517480000000003 2024-09-12T22:50:04.848 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.848 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.848 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:04.848 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621416+0000", 2024-09-12T22:50:04.848 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0264e-05 2024-09-12T22:50:04.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.849 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.849 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:04.849 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621446+0000", 2024-09-12T22:50:04.849 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0849000000000002e-05 2024-09-12T22:50:04.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.849 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.849 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:04.849 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621494+0000", 2024-09-12T22:50:04.849 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7018000000000003e-05 2024-09-12T22:50:04.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.850 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:04.850 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621590+0000", 2024-09-12T22:50:04.850 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6632999999999995e-05 2024-09-12T22:50:04.850 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.850 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:04.850 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621680+0000", 2024-09-12T22:50:04.850 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9704999999999996e-05 2024-09-12T22:50:04.850 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.850 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:04.850 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.639248+0000", 2024-09-12T22:50:04.851 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017568548 2024-09-12T22:50:04.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.851 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:04.851 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.648944+0000", 2024-09-12T22:50:04.851 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0096954659999999998 2024-09-12T22:50:04.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.851 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:04.851 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.648992+0000", 2024-09-12T22:50:04.851 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8059999999999997e-05 2024-09-12T22:50:04.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.852 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.852 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:04.852 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.649024+0000", 2024-09-12T22:50:04.852 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1936000000000001e-05 2024-09-12T22:50:04.852 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.852 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:04.852 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.852 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.852 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13428 4.37 4:eeed8456:::1000000321a.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:04.853 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.064666+0000", 2024-09-12T22:50:04.853 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 7.7193102519999997, 2024-09-12T22:50:04.853 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033441308000000003, 2024-09-12T22:50:04.853 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:04.853 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:04.853 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:04.853 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:04.853 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:04.853 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:04.853 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13428 2024-09-12T22:50:04.853 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.853 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:04.854 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.854 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:04.854 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.064666+0000", 2024-09-12T22:50:04.854 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.854 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.854 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.854 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:04.854 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.064666+0000", 2024-09-12T22:50:04.854 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.854 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.855 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:04.855 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.064668+0000", 2024-09-12T22:50:04.855 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4160000000000001e-06 2024-09-12T22:50:04.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.855 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:04.855 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071829+0000", 2024-09-12T22:50:04.855 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071611390000000004 2024-09-12T22:50:04.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.856 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:04.856 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071840+0000", 2024-09-12T22:50:04.856 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1369000000000001e-05 2024-09-12T22:50:04.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.856 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:04.856 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071847+0000", 2024-09-12T22:50:04.856 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0960000000000003e-06 2024-09-12T22:50:04.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.856 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:04.857 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071904+0000", 2024-09-12T22:50:04.857 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7309000000000003e-05 2024-09-12T22:50:04.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.857 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:04.857 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.072051+0000", 2024-09-12T22:50:04.857 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014625 2024-09-12T22:50:04.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.857 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:04.857 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.072194+0000", 2024-09-12T22:50:04.857 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014379799999999999 2024-09-12T22:50:04.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.858 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:04.858 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.079527+0000", 2024-09-12T22:50:04.858 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007332674 2024-09-12T22:50:04.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.858 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:04.858 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.098048+0000", 2024-09-12T22:50:04.858 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018521174000000001 2024-09-12T22:50:04.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.859 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:04.859 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.098081+0000", 2024-09-12T22:50:04.859 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2910999999999997e-05 2024-09-12T22:50:04.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.859 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:04.859 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.098107+0000", 2024-09-12T22:50:04.859 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6171999999999999e-05 2024-09-12T22:50:04.859 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.859 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:04.859 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.860 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13472 4.12 4:4b0bd9b8:::100000033b0.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:04.860 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.113168+0000", 2024-09-12T22:50:04.860 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 7.6708085529999996, 2024-09-12T22:50:04.860 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.039534103000000001, 2024-09-12T22:50:04.860 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:04.860 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:04.861 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:04.861 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:04.861 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:04.861 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:04.861 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13472 2024-09-12T22:50:04.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.861 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:04.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.861 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:04.861 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.113168+0000", 2024-09-12T22:50:04.861 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.862 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:04.862 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.113168+0000", 2024-09-12T22:50:04.862 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.862 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:04.862 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.113169+0000", 2024-09-12T22:50:04.862 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1960000000000001e-06 2024-09-12T22:50:04.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:04.863 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119849+0000", 2024-09-12T22:50:04.863 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0066801830000000001 2024-09-12T22:50:04.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:04.863 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119861+0000", 2024-09-12T22:50:04.863 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.199e-05 2024-09-12T22:50:04.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:04.864 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119866+0000", 2024-09-12T22:50:04.864 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8720000000000001e-06 2024-09-12T22:50:04.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.864 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:04.864 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119945+0000", 2024-09-12T22:50:04.864 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9268000000000001e-05 2024-09-12T22:50:04.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.864 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:04.864 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.120098+0000", 2024-09-12T22:50:04.865 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015299500000000001 2024-09-12T22:50:04.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.865 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.865 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:04.865 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.120218+0000", 2024-09-12T22:50:04.865 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011989099999999999 2024-09-12T22:50:04.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.865 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.865 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:04.866 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.140463+0000", 2024-09-12T22:50:04.866 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020244765000000001 2024-09-12T22:50:04.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.866 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:04.866 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.152629+0000", 2024-09-12T22:50:04.866 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012165601999999999 2024-09-12T22:50:04.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.866 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:04.866 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.152664+0000", 2024-09-12T22:50:04.866 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5599999999999998e-05 2024-09-12T22:50:04.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.867 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.867 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:04.867 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.152702+0000", 2024-09-12T22:50:04.867 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7741000000000003e-05 2024-09-12T22:50:04.867 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.867 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:04.867 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.867 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.867 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13484 4.2f 4:f62c2e43:::1000000349e.00000000:head [write 0~4194304 [2@3461078]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:04.868 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.125796+0000", 2024-09-12T22:50:04.868 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 7.6581801900000004, 2024-09-12T22:50:04.868 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.036857236000000002, 2024-09-12T22:50:04.868 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:04.868 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:04.868 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:04.868 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:04.868 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:04.868 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:04.868 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13484 2024-09-12T22:50:04.868 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.868 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:04.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.869 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:04.869 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.125796+0000", 2024-09-12T22:50:04.869 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.869 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:04.869 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.125796+0000", 2024-09-12T22:50:04.869 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.870 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:04.870 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.125797+0000", 2024-09-12T22:50:04.870 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.108e-06 2024-09-12T22:50:04.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.870 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:04.870 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130725+0000", 2024-09-12T22:50:04.870 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049272949999999999 2024-09-12T22:50:04.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.870 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:04.871 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130739+0000", 2024-09-12T22:50:04.871 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4234e-05 2024-09-12T22:50:04.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.871 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:04.871 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130751+0000", 2024-09-12T22:50:04.871 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1848000000000001e-05 2024-09-12T22:50:04.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.871 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:04.871 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130816+0000", 2024-09-12T22:50:04.872 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5359999999999998e-05 2024-09-12T22:50:04.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.872 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.872 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:04.872 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130917+0000", 2024-09-12T22:50:04.872 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101178 2024-09-12T22:50:04.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.872 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.872 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:04.872 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.131058+0000", 2024-09-12T22:50:04.873 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140803 2024-09-12T22:50:04.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.873 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.873 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:04.873 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.153387+0000", 2024-09-12T22:50:04.873 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022328585000000001 2024-09-12T22:50:04.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.873 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.873 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:04.873 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.162465+0000", 2024-09-12T22:50:04.873 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090781360000000005 2024-09-12T22:50:04.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.874 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.874 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:04.874 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.162584+0000", 2024-09-12T22:50:04.874 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119634 2024-09-12T22:50:04.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.874 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.874 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:04.874 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.162653+0000", 2024-09-12T22:50:04.874 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9054999999999995e-05 2024-09-12T22:50:04.874 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.874 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:04.875 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.875 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.875 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13558 4.10 4:09df41af:::1000000333c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:04.875 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.229326+0000", 2024-09-12T22:50:04.875 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 7.5546503620000003, 2024-09-12T22:50:04.875 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.039409786000000002, 2024-09-12T22:50:04.875 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:04.875 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:04.875 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:04.875 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:04.875 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:04.876 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:04.876 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13558 2024-09-12T22:50:04.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.876 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:04.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.876 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:04.876 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.229326+0000", 2024-09-12T22:50:04.876 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.876 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:04.877 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.229326+0000", 2024-09-12T22:50:04.877 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.877 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:04.877 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.229327+0000", 2024-09-12T22:50:04.877 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1200000000000002e-07 2024-09-12T22:50:04.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.877 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:04.877 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235243+0000", 2024-09-12T22:50:04.877 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059166310000000003 2024-09-12T22:50:04.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.878 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:04.878 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235255+0000", 2024-09-12T22:50:04.878 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1174e-05 2024-09-12T22:50:04.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.878 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:04.878 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235260+0000", 2024-09-12T22:50:04.878 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1749999999999996e-06 2024-09-12T22:50:04.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.879 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:04.879 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235295+0000", 2024-09-12T22:50:04.879 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4830999999999999e-05 2024-09-12T22:50:04.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.879 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.879 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:04.879 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235350+0000", 2024-09-12T22:50:04.879 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5092e-05 2024-09-12T22:50:04.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.879 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.879 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:04.880 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235426+0000", 2024-09-12T22:50:04.880 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6463000000000003e-05 2024-09-12T22:50:04.880 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.880 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.880 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:04.880 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.244772+0000", 2024-09-12T22:50:04.880 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0093457709999999992 2024-09-12T22:50:04.880 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.880 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.880 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:04.880 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.268679+0000", 2024-09-12T22:50:04.881 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023906788000000002 2024-09-12T22:50:04.881 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.881 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.881 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:04.881 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.268712+0000", 2024-09-12T22:50:04.881 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3701999999999997e-05 2024-09-12T22:50:04.881 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.881 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.881 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:04.881 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.268736+0000", 2024-09-12T22:50:04.881 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3447000000000001e-05 2024-09-12T22:50:04.881 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.882 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:04.882 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.882 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13747 4.1e 4:7aa36f33:::100000035ed.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:04.882 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.457376+0000", 2024-09-12T22:50:04.882 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 7.3266002480000001, 2024-09-12T22:50:04.882 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.037057578000000001, 2024-09-12T22:50:04.882 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:04.882 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:04.882 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:04.882 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:04.883 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:04.883 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:04.883 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13747 2024-09-12T22:50:04.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.883 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:04.883 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.883 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:04.883 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.457376+0000", 2024-09-12T22:50:04.883 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.883 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.883 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:04.884 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.457376+0000", 2024-09-12T22:50:04.884 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.884 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.884 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.884 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:04.884 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.457377+0000", 2024-09-12T22:50:04.884 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1699999999999998e-07 2024-09-12T22:50:04.884 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.884 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.884 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:04.884 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464400+0000", 2024-09-12T22:50:04.885 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070235890000000002 2024-09-12T22:50:04.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.885 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.885 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:04.885 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464413+0000", 2024-09-12T22:50:04.885 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2397e-05 2024-09-12T22:50:04.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.885 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.885 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:04.885 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464418+0000", 2024-09-12T22:50:04.885 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5119999999999999e-06 2024-09-12T22:50:04.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.886 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.886 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:04.886 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464464+0000", 2024-09-12T22:50:04.886 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5976000000000002e-05 2024-09-12T22:50:04.886 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.886 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.886 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:04.886 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464529+0000", 2024-09-12T22:50:04.886 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5266999999999997e-05 2024-09-12T22:50:04.886 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.886 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.887 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:04.887 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.494315+0000", 2024-09-12T22:50:04.887 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029785329999999999 2024-09-12T22:50:04.887 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.887 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.887 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:04.887 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.494366+0000", 2024-09-12T22:50:04.887 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0903999999999999e-05 2024-09-12T22:50:04.887 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.887 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.887 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:04.887 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.494434+0000", 2024-09-12T22:50:04.888 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7985999999999996e-05 2024-09-12T22:50:04.888 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.888 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:04.888 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.888 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:13748 4.15 e56/17 4:ab1b03eb:::100000031a3.00000000:head v 56'173, mlcod=56'171)", 2024-09-12T22:50:04.888 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.462509+0000", 2024-09-12T22:50:04.888 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 7.3214672009999999, 2024-09-12T22:50:04.888 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044366823, 2024-09-12T22:50:04.888 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:04.889 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:04.889 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:04.889 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:04.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.889 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:04.889 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.462509+0000", 2024-09-12T22:50:04.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.889 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:04.890 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.462509+0000", 2024-09-12T22:50:04.890 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.890 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.890 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.890 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:04.890 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.462509+0000", 2024-09-12T22:50:04.890 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7599999999999998e-07 2024-09-12T22:50:04.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.892 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.892 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:04.892 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471576+0000", 2024-09-12T22:50:04.892 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090665490000000001 2024-09-12T22:50:04.892 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.892 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.892 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:04.892 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471591+0000", 2024-09-12T22:50:04.892 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4566000000000001e-05 2024-09-12T22:50:04.892 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.892 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.893 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:04.893 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471600+0000", 2024-09-12T22:50:04.893 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1630000000000002e-06 2024-09-12T22:50:04.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.893 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:04.893 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471689+0000", 2024-09-12T22:50:04.893 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9591000000000003e-05 2024-09-12T22:50:04.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.893 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:04.894 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471735+0000", 2024-09-12T22:50:04.894 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5429000000000002e-05 2024-09-12T22:50:04.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:04.894 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.506851+0000", 2024-09-12T22:50:04.894 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035116238000000001 2024-09-12T22:50:04.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:04.894 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.506876+0000", 2024-09-12T22:50:04.895 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5011000000000002e-05 2024-09-12T22:50:04.895 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.895 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:04.895 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.895 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.895 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13753 4.30 4:0dea61b7:::100000036ed.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:04.895 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.464559+0000", 2024-09-12T22:50:04.895 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 7.3194172020000003, 2024-09-12T22:50:04.895 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041415303000000001, 2024-09-12T22:50:04.895 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:04.895 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:04.896 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:04.896 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:04.896 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:04.896 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:04.896 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13753 2024-09-12T22:50:04.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.896 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:04.896 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.896 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:04.896 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464559+0000", 2024-09-12T22:50:04.896 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.897 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.897 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:04.897 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464559+0000", 2024-09-12T22:50:04.897 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.897 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.897 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:04.897 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464560+0000", 2024-09-12T22:50:04.897 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:50:04.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.898 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:04.898 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469861+0000", 2024-09-12T22:50:04.898 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053017139999999999 2024-09-12T22:50:04.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.898 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:04.898 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469878+0000", 2024-09-12T22:50:04.898 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6336000000000001e-05 2024-09-12T22:50:04.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.898 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:04.899 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469888+0000", 2024-09-12T22:50:04.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8320000000000001e-06 2024-09-12T22:50:04.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:04.899 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469950+0000", 2024-09-12T22:50:04.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1923999999999999e-05 2024-09-12T22:50:04.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:04.899 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.470059+0000", 2024-09-12T22:50:04.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109559 2024-09-12T22:50:04.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.900 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:04.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.505915+0000", 2024-09-12T22:50:04.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035855887000000003 2024-09-12T22:50:04.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.900 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:04.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.505939+0000", 2024-09-12T22:50:04.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3740999999999999e-05 2024-09-12T22:50:04.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.901 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.901 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:04.901 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.505974+0000", 2024-09-12T22:50:04.901 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5753999999999997e-05 2024-09-12T22:50:04.901 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.901 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:04.901 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.901 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.901 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13754 4.11 4:8a2f20b1:::10000003764.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:04.901 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.469921+0000", 2024-09-12T22:50:04.901 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 7.3140553500000003, 2024-09-12T22:50:04.902 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034721670000000003, 2024-09-12T22:50:04.902 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:04.902 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:04.902 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:04.902 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:04.902 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:04.902 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:04.902 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13754 2024-09-12T22:50:04.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.902 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:04.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.902 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:04.903 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469921+0000", 2024-09-12T22:50:04.903 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.903 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.903 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.903 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:04.903 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469921+0000", 2024-09-12T22:50:04.903 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.903 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.903 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.903 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:04.903 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469922+0000", 2024-09-12T22:50:04.904 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.006e-06 2024-09-12T22:50:04.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.904 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:04.904 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474681+0000", 2024-09-12T22:50:04.904 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047588539999999999 2024-09-12T22:50:04.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.904 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:04.904 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474698+0000", 2024-09-12T22:50:04.904 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7368999999999999e-05 2024-09-12T22:50:04.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.905 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:04.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474709+0000", 2024-09-12T22:50:04.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0738e-05 2024-09-12T22:50:04.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.905 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:04.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474780+0000", 2024-09-12T22:50:04.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0622000000000002e-05 2024-09-12T22:50:04.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:04.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474954+0000", 2024-09-12T22:50:04.906 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017394399999999999 2024-09-12T22:50:04.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:04.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.504488+0000", 2024-09-12T22:50:04.906 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029534721999999999 2024-09-12T22:50:04.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:04.907 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.504553+0000", 2024-09-12T22:50:04.907 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4877999999999998e-05 2024-09-12T22:50:04.907 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.907 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.907 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:04.907 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.504643+0000", 2024-09-12T22:50:04.907 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9536999999999993e-05 2024-09-12T22:50:04.907 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.907 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:04.907 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.907 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.907 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.908 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13763 4.2d 4:b5937a57:::100000031de.00000000:head [write 0~4194304 [3@52474]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:04.908 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.474957+0000", 2024-09-12T22:50:04.908 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 7.3090191070000001, 2024-09-12T22:50:04.908 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.057329167, 2024-09-12T22:50:04.908 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:04.908 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:04.908 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:04.908 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:04.908 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:04.908 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:04.908 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13763 2024-09-12T22:50:04.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.909 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:04.909 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.909 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:04.909 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474957+0000", 2024-09-12T22:50:04.909 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.909 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.909 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:04.909 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474957+0000", 2024-09-12T22:50:04.909 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.910 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:04.910 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474958+0000", 2024-09-12T22:50:04.910 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8299999999999997e-07 2024-09-12T22:50:04.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.910 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:04.910 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.478970+0000", 2024-09-12T22:50:04.910 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040121100000000002 2024-09-12T22:50:04.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:04.911 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.478983+0000", 2024-09-12T22:50:04.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.292e-05 2024-09-12T22:50:04.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:04.911 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.478992+0000", 2024-09-12T22:50:04.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3759999999999997e-06 2024-09-12T22:50:04.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:04.912 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.479048+0000", 2024-09-12T22:50:04.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5381999999999999e-05 2024-09-12T22:50:04.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.912 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.912 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:04.912 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.479124+0000", 2024-09-12T22:50:04.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6643999999999993e-05 2024-09-12T22:50:04.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.912 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.912 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:04.912 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.479230+0000", 2024-09-12T22:50:04.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010581099999999999 2024-09-12T22:50:04.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:04.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.506897+0000", 2024-09-12T22:50:04.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027666863999999999 2024-09-12T22:50:04.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:04.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.532175+0000", 2024-09-12T22:50:04.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.025278367 2024-09-12T22:50:04.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.914 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.914 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:04.914 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.532232+0000", 2024-09-12T22:50:04.914 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6455000000000001e-05 2024-09-12T22:50:04.914 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.914 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.914 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:04.914 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.532286+0000", 2024-09-12T22:50:04.914 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4654999999999998e-05 2024-09-12T22:50:04.914 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.914 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:04.915 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.915 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.915 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.915 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13803 4.4 4:228c5bc4:::10000003314.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:04.915 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.515814+0000", 2024-09-12T22:50:04.915 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 7.2681626809999997, 2024-09-12T22:50:04.915 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034442453999999997, 2024-09-12T22:50:04.915 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:04.915 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:04.915 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:04.915 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:04.915 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:04.916 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:04.916 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13803 2024-09-12T22:50:04.916 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.916 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:04.916 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.916 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:04.916 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.515814+0000", 2024-09-12T22:50:04.916 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.916 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.916 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.916 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:04.916 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.515814+0000", 2024-09-12T22:50:04.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:04.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:04.917 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.515814+0000", 2024-09-12T22:50:04.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4799999999999998e-07 2024-09-12T22:50:04.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:04.917 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522580+0000", 2024-09-12T22:50:04.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0067656959999999999 2024-09-12T22:50:04.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.918 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:04.918 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522591+0000", 2024-09-12T22:50:04.918 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1206000000000001e-05 2024-09-12T22:50:04.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.918 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:04.918 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522597+0000", 2024-09-12T22:50:04.918 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1500000000000004e-06 2024-09-12T22:50:04.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:04.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522639+0000", 2024-09-12T22:50:04.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1767999999999997e-05 2024-09-12T22:50:04.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:04.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522689+0000", 2024-09-12T22:50:04.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9472999999999999e-05 2024-09-12T22:50:04.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:04.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522771+0000", 2024-09-12T22:50:04.920 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2738000000000006e-05 2024-09-12T22:50:04.920 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.920 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.920 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:04.920 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.529356+0000", 2024-09-12T22:50:04.920 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065850329999999997 2024-09-12T22:50:04.920 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.920 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.920 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:04.920 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.550206+0000", 2024-09-12T22:50:04.920 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020849755000000001 2024-09-12T22:50:04.921 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.921 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.921 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:04.921 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.550233+0000", 2024-09-12T22:50:04.921 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6990000000000001e-05 2024-09-12T22:50:04.921 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:04.921 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:04.921 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:04.921 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.550256+0000", 2024-09-12T22:50:04.921 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3096999999999999e-05 2024-09-12T22:50:04.921 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.921 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:04.922 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.922 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:04.922 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:04.922 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:50:04.923 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:04.922+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:04.924 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:50:05.024 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:05.023+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:05.028 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:50:05.028 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:50:05.028 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:50:05.028 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:50:05.037 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:50:05.125 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:05.124+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:05.182 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:50:05.182 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:50:05.182 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:50:05.182 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:50:05.182 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:50:05.191 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:50:05.232 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:05.231+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:05.326 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:05.325+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:05.388 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:50:05.388 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:50:05.388 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:50:05.388 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:50:05.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.389 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1923 3.8 3:17051619:::200.0000000f:head [write 935107~4527 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:05.389 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.157731+0000", 2024-09-12T22:50:05.389 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 8.2272701779999995, 2024-09-12T22:50:05.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.085115956000000006, 2024-09-12T22:50:05.389 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:05.389 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:05.389 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:05.389 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:05.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:05.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157731+0000", 2024-09-12T22:50:05.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:05.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157731+0000", 2024-09-12T22:50:05.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:05.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157732+0000", 2024-09-12T22:50:05.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.99e-07 2024-09-12T22:50:05.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.391 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:05.391 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157737+0000", 2024-09-12T22:50:05.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6280000000000002e-06 2024-09-12T22:50:05.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.391 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.391 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:05.391 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157745+0000", 2024-09-12T22:50:05.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1749999999999999e-06 2024-09-12T22:50:05.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.391 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.391 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:05.391 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157749+0000", 2024-09-12T22:50:05.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.946e-06 2024-09-12T22:50:05.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:05.392 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.236865+0000", 2024-09-12T22:50:05.392 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079116687000000005 2024-09-12T22:50:05.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:05.392 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.236929+0000", 2024-09-12T22:50:05.392 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3566999999999996e-05 2024-09-12T22:50:05.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:05.393 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237025+0000", 2024-09-12T22:50:05.393 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6620000000000007e-05 2024-09-12T22:50:05.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.393 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:05.393 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240342+0000", 2024-09-12T22:50:05.393 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033162539999999998 2024-09-12T22:50:05.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.393 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:05.393 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242737+0000", 2024-09-12T22:50:05.393 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023957370000000002 2024-09-12T22:50:05.395 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.395 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.395 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:05.395 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242797+0000", 2024-09-12T22:50:05.396 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9323000000000001e-05 2024-09-12T22:50:05.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.396 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:05.396 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242847+0000", 2024-09-12T22:50:05.396 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0319999999999999e-05 2024-09-12T22:50:05.396 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.396 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:05.396 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.396 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1924 3.8 3:17051619:::200.0000000f:head [write 939634~6106 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:05.396 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.159169+0000", 2024-09-12T22:50:05.397 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 8.2258319590000006, 2024-09-12T22:50:05.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.083843601000000004, 2024-09-12T22:50:05.397 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:05.397 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:05.397 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:05.397 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:05.397 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.397 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:05.397 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159169+0000", 2024-09-12T22:50:05.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.397 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.397 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:05.398 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159169+0000", 2024-09-12T22:50:05.398 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:05.398 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159171+0000", 2024-09-12T22:50:05.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4959999999999999e-06 2024-09-12T22:50:05.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.399 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:05.399 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159182+0000", 2024-09-12T22:50:05.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1104000000000001e-05 2024-09-12T22:50:05.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:05.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159190+0000", 2024-09-12T22:50:05.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3520000000000007e-06 2024-09-12T22:50:05.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:05.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159196+0000", 2024-09-12T22:50:05.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5690000000000004e-06 2024-09-12T22:50:05.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:05.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237476+0000", 2024-09-12T22:50:05.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078280197999999995 2024-09-12T22:50:05.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.401 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:05.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237530+0000", 2024-09-12T22:50:05.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4419000000000002e-05 2024-09-12T22:50:05.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.401 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:05.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237593+0000", 2024-09-12T22:50:05.402 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2611000000000001e-05 2024-09-12T22:50:05.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.402 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.402 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:05.402 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242030+0000", 2024-09-12T22:50:05.402 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044367369999999996 2024-09-12T22:50:05.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.402 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.402 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:05.402 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242893+0000", 2024-09-12T22:50:05.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00086367400000000004 2024-09-12T22:50:05.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.403 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.403 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:05.403 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242956+0000", 2024-09-12T22:50:05.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2885999999999994e-05 2024-09-12T22:50:05.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.403 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.403 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:05.403 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243013+0000", 2024-09-12T22:50:05.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6555000000000003e-05 2024-09-12T22:50:05.403 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.403 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:05.403 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.404 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.404 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.404 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1925 3.8 3:17051619:::200.0000000f:head [write 945740~9955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:05.404 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.160395+0000", 2024-09-12T22:50:05.404 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 8.2246067499999995, 2024-09-12T22:50:05.404 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.091200247999999998, 2024-09-12T22:50:05.404 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:05.404 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:05.404 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:05.404 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:05.404 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.404 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:05.404 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160395+0000", 2024-09-12T22:50:05.405 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.405 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:05.405 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160395+0000", 2024-09-12T22:50:05.405 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.405 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:05.406 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160396+0000", 2024-09-12T22:50:05.406 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1599999999999999e-06 2024-09-12T22:50:05.406 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.406 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.406 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:05.406 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160415+0000", 2024-09-12T22:50:05.406 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9680000000000001e-05 2024-09-12T22:50:05.406 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.406 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.406 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:05.406 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160428+0000", 2024-09-12T22:50:05.406 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2792999999999999e-05 2024-09-12T22:50:05.406 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.407 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:05.407 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160436+0000", 2024-09-12T22:50:05.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0399999999999993e-06 2024-09-12T22:50:05.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.407 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:05.407 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.238408+0000", 2024-09-12T22:50:05.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077971602000000001 2024-09-12T22:50:05.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.407 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:05.407 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.238504+0000", 2024-09-12T22:50:05.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6714999999999998e-05 2024-09-12T22:50:05.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:05.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.238687+0000", 2024-09-12T22:50:05.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000182795 2024-09-12T22:50:05.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:05.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242036+0000", 2024-09-12T22:50:05.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003348887 2024-09-12T22:50:05.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:05.409 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251510+0000", 2024-09-12T22:50:05.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094733679999999994 2024-09-12T22:50:05.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.409 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:05.409 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251543+0000", 2024-09-12T22:50:05.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2974e-05 2024-09-12T22:50:05.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.409 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:05.409 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251595+0000", 2024-09-12T22:50:05.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2234000000000002e-05 2024-09-12T22:50:05.409 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.409 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:05.410 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.410 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1926 3.8 3:17051619:::200.0000000f:head [write 955695~5281 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:05.410 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.160849+0000", 2024-09-12T22:50:05.410 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 8.2241517959999992, 2024-09-12T22:50:05.410 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.094772633999999994, 2024-09-12T22:50:05.410 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:05.410 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:05.410 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:05.410 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:05.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.410 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:05.411 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160849+0000", 2024-09-12T22:50:05.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.411 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:05.411 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160849+0000", 2024-09-12T22:50:05.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.411 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:05.411 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160850+0000", 2024-09-12T22:50:05.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6700000000000002e-07 2024-09-12T22:50:05.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.412 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:05.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160858+0000", 2024-09-12T22:50:05.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5630000000000003e-06 2024-09-12T22:50:05.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.412 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:05.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160866+0000", 2024-09-12T22:50:05.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7570000000000004e-06 2024-09-12T22:50:05.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.412 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:05.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160870+0000", 2024-09-12T22:50:05.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5929999999999999e-06 2024-09-12T22:50:05.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:05.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.239705+0000", 2024-09-12T22:50:05.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078834491000000007 2024-09-12T22:50:05.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:05.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.239764+0000", 2024-09-12T22:50:05.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9190000000000001e-05 2024-09-12T22:50:05.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:05.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.239851+0000", 2024-09-12T22:50:05.414 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7472999999999994e-05 2024-09-12T22:50:05.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.414 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.414 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:05.414 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254001+0000", 2024-09-12T22:50:05.414 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014149622000000001 2024-09-12T22:50:05.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.414 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.414 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:05.414 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255525+0000", 2024-09-12T22:50:05.414 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0015236500000000001 2024-09-12T22:50:05.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.414 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:05.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255567+0000", 2024-09-12T22:50:05.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2150999999999997e-05 2024-09-12T22:50:05.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:05.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255622+0000", 2024-09-12T22:50:05.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5276999999999999e-05 2024-09-12T22:50:05.415 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.415 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:05.415 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.415 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1927 3.8 3:17051619:::200.0000000f:head [write 960976~5828 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:05.416 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.164361+0000", 2024-09-12T22:50:05.416 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 8.2206400990000006, 2024-09-12T22:50:05.416 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.091388523999999999, 2024-09-12T22:50:05.416 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:05.416 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:05.416 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:05.416 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:05.416 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.416 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:05.416 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164361+0000", 2024-09-12T22:50:05.416 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.416 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.416 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:05.417 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164361+0000", 2024-09-12T22:50:05.417 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.417 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:05.417 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164363+0000", 2024-09-12T22:50:05.417 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.389e-06 2024-09-12T22:50:05.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.417 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:05.417 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164370+0000", 2024-09-12T22:50:05.417 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.99e-06 2024-09-12T22:50:05.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.418 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:05.418 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164379+0000", 2024-09-12T22:50:05.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9499999999999996e-06 2024-09-12T22:50:05.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.418 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:05.418 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164385+0000", 2024-09-12T22:50:05.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5879999999999997e-06 2024-09-12T22:50:05.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.418 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:05.418 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240385+0000", 2024-09-12T22:50:05.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075999995000000001 2024-09-12T22:50:05.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:05.419 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240533+0000", 2024-09-12T22:50:05.419 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014811699999999999 2024-09-12T22:50:05.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:05.419 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240886+0000", 2024-09-12T22:50:05.419 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000352517 2024-09-12T22:50:05.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:05.419 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254024+0000", 2024-09-12T22:50:05.420 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013138047999999999 2024-09-12T22:50:05.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.420 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:05.420 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255629+0000", 2024-09-12T22:50:05.420 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001604949 2024-09-12T22:50:05.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.420 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:05.421 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255683+0000", 2024-09-12T22:50:05.421 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4035e-05 2024-09-12T22:50:05.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.421 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.421 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:05.421 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255750+0000", 2024-09-12T22:50:05.421 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6946000000000006e-05 2024-09-12T22:50:05.421 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.421 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:05.421 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.421 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.421 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1928 3.8 3:17051619:::200.0000000f:head [write 966804~6536 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:05.422 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167179+0000", 2024-09-12T22:50:05.422 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 8.217822301, 2024-09-12T22:50:05.422 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.089785880999999998, 2024-09-12T22:50:05.422 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:05.422 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:05.422 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:05.422 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:05.422 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.422 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:05.422 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167179+0000", 2024-09-12T22:50:05.422 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.422 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.422 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:05.423 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167179+0000", 2024-09-12T22:50:05.423 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.423 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:05.423 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167180+0000", 2024-09-12T22:50:05.423 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2869999999999999e-06 2024-09-12T22:50:05.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.423 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:05.423 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167192+0000", 2024-09-12T22:50:05.423 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.187e-05 2024-09-12T22:50:05.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.424 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:05.424 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167203+0000", 2024-09-12T22:50:05.424 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1076e-05 2024-09-12T22:50:05.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.424 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:05.424 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167210+0000", 2024-09-12T22:50:05.424 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1799999999999999e-06 2024-09-12T22:50:05.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.424 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:05.424 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.241518+0000", 2024-09-12T22:50:05.424 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074307845999999997 2024-09-12T22:50:05.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.425 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.425 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:05.425 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.241563+0000", 2024-09-12T22:50:05.425 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5138e-05 2024-09-12T22:50:05.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.425 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.425 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:05.425 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.241641+0000", 2024-09-12T22:50:05.425 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8016000000000007e-05 2024-09-12T22:50:05.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.425 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.425 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:05.426 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254041+0000", 2024-09-12T22:50:05.426 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012399666 2024-09-12T22:50:05.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.426 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.426 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:05.426 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.256880+0000", 2024-09-12T22:50:05.426 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0028390580000000002 2024-09-12T22:50:05.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.426 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.426 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:05.426 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.256918+0000", 2024-09-12T22:50:05.426 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7552999999999998e-05 2024-09-12T22:50:05.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.427 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.427 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:05.427 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.256965+0000", 2024-09-12T22:50:05.427 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7191000000000003e-05 2024-09-12T22:50:05.427 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.427 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:05.427 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.427 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.427 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1929 3.8 3:17051619:::200.0000000f:head [write 973340~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:05.427 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167521+0000", 2024-09-12T22:50:05.427 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 8.2174801379999991, 2024-09-12T22:50:05.427 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.093206336000000001, 2024-09-12T22:50:05.427 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:05.428 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:05.428 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:05.428 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:05.428 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.428 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:05.428 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167521+0000", 2024-09-12T22:50:05.428 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.428 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.428 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:05.428 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167521+0000", 2024-09-12T22:50:05.428 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.429 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.429 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:05.429 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167522+0000", 2024-09-12T22:50:05.429 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8899999999999998e-07 2024-09-12T22:50:05.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.429 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.429 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:05.429 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167526+0000", 2024-09-12T22:50:05.429 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4490000000000001e-06 2024-09-12T22:50:05.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.429 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.429 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:05.429 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167544+0000", 2024-09-12T22:50:05.429 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7220000000000001e-05 2024-09-12T22:50:05.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.430 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.430 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:05.430 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167551+0000", 2024-09-12T22:50:05.430 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.046e-06 2024-09-12T22:50:05.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.430 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.430 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:05.430 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242079+0000", 2024-09-12T22:50:05.430 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074528436000000003 2024-09-12T22:50:05.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.430 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.430 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:05.430 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242167+0000", 2024-09-12T22:50:05.431 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7670000000000006e-05 2024-09-12T22:50:05.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.431 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.431 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:05.431 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242306+0000", 2024-09-12T22:50:05.431 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000138703 2024-09-12T22:50:05.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.431 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.431 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:05.431 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254058+0000", 2024-09-12T22:50:05.431 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011752395000000001 2024-09-12T22:50:05.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.431 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.432 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:05.432 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260654+0000", 2024-09-12T22:50:05.432 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0065964700000000001 2024-09-12T22:50:05.432 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.432 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.432 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:05.432 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260699+0000", 2024-09-12T22:50:05.432 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5095000000000001e-05 2024-09-12T22:50:05.432 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.432 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.432 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:05.432 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260727+0000", 2024-09-12T22:50:05.432 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7963e-05 2024-09-12T22:50:05.432 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.433 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:05.433 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.433 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.433 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.433 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1931 3.8 3:17051619:::200.0000000f:head [write 974738~2728 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:05.433 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167657+0000", 2024-09-12T22:50:05.433 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 8.2173441329999992, 2024-09-12T22:50:05.433 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.093133758999999997, 2024-09-12T22:50:05.433 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:05.433 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:05.433 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:05.433 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:05.433 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.434 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:05.434 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167657+0000", 2024-09-12T22:50:05.434 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.434 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.434 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.434 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:05.434 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167657+0000", 2024-09-12T22:50:05.434 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.434 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.434 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.434 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:05.434 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167658+0000", 2024-09-12T22:50:05.434 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2200000000000003e-07 2024-09-12T22:50:05.434 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.435 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.435 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:05.435 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167662+0000", 2024-09-12T22:50:05.435 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1489999999999996e-06 2024-09-12T22:50:05.435 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.435 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.435 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:05.435 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167673+0000", 2024-09-12T22:50:05.435 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0614e-05 2024-09-12T22:50:05.435 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.435 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.435 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:05.435 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167679+0000", 2024-09-12T22:50:05.436 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1500000000000004e-06 2024-09-12T22:50:05.436 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.436 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.436 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:05.436 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243054+0000", 2024-09-12T22:50:05.436 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075375027999999997 2024-09-12T22:50:05.436 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.436 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.436 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:05.436 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243134+0000", 2024-09-12T22:50:05.436 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0210000000000006e-05 2024-09-12T22:50:05.436 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.436 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.437 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:05.437 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243263+0000", 2024-09-12T22:50:05.437 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012919 2024-09-12T22:50:05.437 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.437 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.437 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:05.437 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254075+0000", 2024-09-12T22:50:05.437 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010811523 2024-09-12T22:50:05.437 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.437 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.437 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:05.437 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260733+0000", 2024-09-12T22:50:05.437 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.006658153 2024-09-12T22:50:05.437 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.438 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.438 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:05.438 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260756+0000", 2024-09-12T22:50:05.438 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2696000000000001e-05 2024-09-12T22:50:05.438 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.438 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.438 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:05.438 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260791+0000", 2024-09-12T22:50:05.438 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5324000000000003e-05 2024-09-12T22:50:05.438 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.438 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:05.438 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.438 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.439 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.439 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1932 3.8 3:17051619:::200.0000000f:head [write 977466~2771 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:05.439 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:50:05.439 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 8.2170544509999992, 2024-09-12T22:50:05.439 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.092944115999999993, 2024-09-12T22:50:05.439 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:05.439 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:05.439 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:05.439 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:05.439 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.439 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:05.439 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:50:05.439 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.440 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.440 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.440 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:05.440 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:50:05.440 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.440 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.440 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.440 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:05.440 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:50:05.440 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8400000000000004e-07 2024-09-12T22:50:05.440 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.440 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.440 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:05.441 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167952+0000", 2024-09-12T22:50:05.441 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.138e-06 2024-09-12T22:50:05.441 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.441 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.441 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:05.441 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167961+0000", 2024-09-12T22:50:05.441 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7990000000000005e-06 2024-09-12T22:50:05.441 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.441 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.441 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:05.441 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167968+0000", 2024-09-12T22:50:05.441 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4400000000000002e-06 2024-09-12T22:50:05.441 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.442 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.442 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:05.442 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.244002+0000", 2024-09-12T22:50:05.442 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.076034300999999999 2024-09-12T22:50:05.442 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.442 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.442 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:05.442 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.244061+0000", 2024-09-12T22:50:05.442 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8356999999999997e-05 2024-09-12T22:50:05.442 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.442 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.442 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:05.442 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.244161+0000", 2024-09-12T22:50:05.442 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000100126 2024-09-12T22:50:05.443 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.443 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.443 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:05.443 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254099+0000", 2024-09-12T22:50:05.443 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0099384940000000008 2024-09-12T22:50:05.443 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.443 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.443 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:05.443 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260799+0000", 2024-09-12T22:50:05.443 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0066995029999999999 2024-09-12T22:50:05.443 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.443 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.443 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:05.444 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260851+0000", 2024-09-12T22:50:05.444 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1861999999999999e-05 2024-09-12T22:50:05.444 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.444 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.444 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:05.444 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260891+0000", 2024-09-12T22:50:05.444 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0411999999999999e-05 2024-09-12T22:50:05.444 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.444 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:05.444 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.444 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.444 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.444 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1933 3.8 3:17051619:::200.0000000f:head [write 980237~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:05.445 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167993+0000", 2024-09-12T22:50:05.445 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 8.2170079479999991, 2024-09-12T22:50:05.445 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.092952307999999997, 2024-09-12T22:50:05.445 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:05.445 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:05.445 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:05.445 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:05.445 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.445 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:05.445 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167993+0000", 2024-09-12T22:50:05.445 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.445 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.445 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.445 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:05.446 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167993+0000", 2024-09-12T22:50:05.446 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.446 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.446 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.446 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:05.446 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167994+0000", 2024-09-12T22:50:05.446 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5000000000000003e-07 2024-09-12T22:50:05.446 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.446 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.446 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:05.446 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167997+0000", 2024-09-12T22:50:05.446 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5559999999999999e-06 2024-09-12T22:50:05.446 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.447 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.447 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:05.447 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168005+0000", 2024-09-12T22:50:05.447 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.588e-06 2024-09-12T22:50:05.447 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.447 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.447 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:05.447 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168011+0000", 2024-09-12T22:50:05.447 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7780000000000004e-06 2024-09-12T22:50:05.447 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.447 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.447 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:05.447 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.247983+0000", 2024-09-12T22:50:05.447 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079972090999999995 2024-09-12T22:50:05.448 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.448 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.448 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:05.448 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248038+0000", 2024-09-12T22:50:05.448 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4889999999999998e-05 2024-09-12T22:50:05.448 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.448 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.448 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:05.448 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248136+0000", 2024-09-12T22:50:05.448 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8271999999999997e-05 2024-09-12T22:50:05.448 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.448 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.448 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:05.449 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254134+0000", 2024-09-12T22:50:05.449 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005997751 2024-09-12T22:50:05.449 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.449 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.449 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:05.449 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260898+0000", 2024-09-12T22:50:05.449 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0067646429999999999 2024-09-12T22:50:05.449 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.449 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.449 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:05.449 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260923+0000", 2024-09-12T22:50:05.449 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4080999999999999e-05 2024-09-12T22:50:05.449 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.450 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.450 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:05.450 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260946+0000", 2024-09-12T22:50:05.450 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3108e-05 2024-09-12T22:50:05.450 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.450 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:05.450 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.450 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.450 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.450 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1934 3.8 3:17051619:::200.0000000f:head [write 982156~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:05.450 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:50:05.450 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 8.2169824620000007, 2024-09-12T22:50:05.450 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.093517738000000003, 2024-09-12T22:50:05.450 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:05.451 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:05.451 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:05.451 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:05.451 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.451 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:05.451 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:50:05.451 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.451 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.451 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.451 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:05.451 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:50:05.451 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.451 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.451 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.452 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:05.452 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:50:05.452 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6800000000000001e-07 2024-09-12T22:50:05.452 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.452 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.452 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:05.452 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168029+0000", 2024-09-12T22:50:05.452 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9699999999999994e-06 2024-09-12T22:50:05.452 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.452 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.452 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:05.452 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168036+0000", 2024-09-12T22:50:05.453 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9800000000000001e-06 2024-09-12T22:50:05.453 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.453 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.453 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:05.453 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168041+0000", 2024-09-12T22:50:05.453 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0629999999999996e-06 2024-09-12T22:50:05.453 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.453 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.453 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:05.453 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248449+0000", 2024-09-12T22:50:05.453 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.080407948000000007 2024-09-12T22:50:05.453 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.453 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.453 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:05.454 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248491+0000", 2024-09-12T22:50:05.454 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2027999999999998e-05 2024-09-12T22:50:05.454 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.454 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.454 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:05.454 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248569+0000", 2024-09-12T22:50:05.454 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8077000000000005e-05 2024-09-12T22:50:05.454 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.454 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.454 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:05.454 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260950+0000", 2024-09-12T22:50:05.454 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012380901 2024-09-12T22:50:05.454 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.454 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.455 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:05.455 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.261473+0000", 2024-09-12T22:50:05.455 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00052241699999999996 2024-09-12T22:50:05.455 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.455 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.455 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:05.455 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.261507+0000", 2024-09-12T22:50:05.455 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4616000000000002e-05 2024-09-12T22:50:05.455 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.455 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.455 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:05.455 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.261537+0000", 2024-09-12T22:50:05.455 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9369999999999998e-05 2024-09-12T22:50:05.456 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.456 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:05.456 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.456 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.456 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.456 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1935 3.8 3:17051619:::200.0000000f:head [write 984074~1914 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:05.456 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:50:05.456 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 8.2169525399999994, 2024-09-12T22:50:05.456 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.097660714999999995, 2024-09-12T22:50:05.456 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:05.456 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:05.456 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:05.456 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:05.457 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.457 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:05.457 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:50:05.457 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.457 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.457 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.457 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:05.457 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:50:05.457 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.457 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.457 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.457 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:05.457 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:50:05.458 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4400000000000001e-07 2024-09-12T22:50:05.458 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.458 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.458 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:05.458 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168052+0000", 2024-09-12T22:50:05.458 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.886e-06 2024-09-12T22:50:05.458 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.458 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.458 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:05.458 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168059+0000", 2024-09-12T22:50:05.458 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0489999999999998e-06 2024-09-12T22:50:05.458 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.458 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.458 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:05.459 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168081+0000", 2024-09-12T22:50:05.459 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1800000000000001e-05 2024-09-12T22:50:05.459 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.459 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.459 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:05.459 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.250512+0000", 2024-09-12T22:50:05.459 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.082431322000000001 2024-09-12T22:50:05.459 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.459 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.459 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:05.459 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.250621+0000", 2024-09-12T22:50:05.459 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010908600000000001 2024-09-12T22:50:05.459 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.460 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.460 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:05.460 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.250970+0000", 2024-09-12T22:50:05.460 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034828399999999997 2024-09-12T22:50:05.460 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.460 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.460 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:05.460 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265532+0000", 2024-09-12T22:50:05.460 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01456268 2024-09-12T22:50:05.460 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.460 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.460 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:05.460 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265614+0000", 2024-09-12T22:50:05.461 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1796000000000001e-05 2024-09-12T22:50:05.461 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.461 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.461 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:05.461 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265673+0000", 2024-09-12T22:50:05.461 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9314000000000002e-05 2024-09-12T22:50:05.461 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.461 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.461 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:05.461 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265709+0000", 2024-09-12T22:50:05.461 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6053999999999997e-05 2024-09-12T22:50:05.461 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.461 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:05.461 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.462 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.462 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.462 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1936 3.8 3:17051619:::200.0000000f:head [write 985988~2437 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:05.462 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.168095+0000", 2024-09-12T22:50:05.462 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 8.2169061929999998, 2024-09-12T22:50:05.462 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.097789345999999999, 2024-09-12T22:50:05.462 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:05.462 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:05.462 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:05.462 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:05.462 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.462 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:05.462 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168095+0000", 2024-09-12T22:50:05.462 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.463 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.463 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.463 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:05.463 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168095+0000", 2024-09-12T22:50:05.463 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.463 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.463 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.463 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:05.463 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168096+0000", 2024-09-12T22:50:05.463 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7700000000000005e-07 2024-09-12T22:50:05.463 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.463 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.463 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:05.464 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168099+0000", 2024-09-12T22:50:05.464 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.422e-06 2024-09-12T22:50:05.464 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.464 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.464 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:05.464 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168106+0000", 2024-09-12T22:50:05.464 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6889999999999998e-06 2024-09-12T22:50:05.464 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.464 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.464 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:05.464 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168110+0000", 2024-09-12T22:50:05.464 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8470000000000003e-06 2024-09-12T22:50:05.464 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.464 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.465 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:05.465 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251622+0000", 2024-09-12T22:50:05.465 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.083511539999999995 2024-09-12T22:50:05.465 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.465 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.465 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:05.465 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251674+0000", 2024-09-12T22:50:05.465 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1678999999999998e-05 2024-09-12T22:50:05.465 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.465 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.465 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:05.465 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251744+0000", 2024-09-12T22:50:05.465 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0440999999999999e-05 2024-09-12T22:50:05.465 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.466 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.466 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:05.466 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265545+0000", 2024-09-12T22:50:05.466 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013801000000000001 2024-09-12T22:50:05.466 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.466 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.466 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:05.466 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265771+0000", 2024-09-12T22:50:05.466 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000225632 2024-09-12T22:50:05.466 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.466 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.466 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:05.466 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265835+0000", 2024-09-12T22:50:05.467 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4541000000000004e-05 2024-09-12T22:50:05.467 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.467 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.467 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:05.467 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265884+0000", 2024-09-12T22:50:05.467 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9078e-05 2024-09-12T22:50:05.467 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.467 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:05.467 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.467 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.467 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.467 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1937 3.8 3:17051619:::200.0000000f:head [write 988425~1920 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:05.467 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.171188+0000", 2024-09-12T22:50:05.467 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 8.2138128219999995, 2024-09-12T22:50:05.468 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.094794626000000007, 2024-09-12T22:50:05.468 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:05.468 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:05.468 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:05.468 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:05.468 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.468 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:05.468 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171188+0000", 2024-09-12T22:50:05.468 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.468 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.468 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.468 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:05.468 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171188+0000", 2024-09-12T22:50:05.469 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.469 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.469 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.469 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:05.469 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171189+0000", 2024-09-12T22:50:05.469 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3200000000000003e-07 2024-09-12T22:50:05.469 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.469 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.469 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:05.469 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171194+0000", 2024-09-12T22:50:05.469 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2690000000000001e-06 2024-09-12T22:50:05.469 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.469 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.470 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:05.470 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171201+0000", 2024-09-12T22:50:05.470 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5310000000000004e-06 2024-09-12T22:50:05.470 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.470 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.470 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:05.470 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171206+0000", 2024-09-12T22:50:05.470 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7049999999999998e-06 2024-09-12T22:50:05.470 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.470 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.470 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:05.470 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254169+0000", 2024-09-12T22:50:05.470 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.082962835999999998 2024-09-12T22:50:05.470 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.471 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.471 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:05.471 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254263+0000", 2024-09-12T22:50:05.471 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3844999999999993e-05 2024-09-12T22:50:05.471 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.471 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.471 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:05.471 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254398+0000", 2024-09-12T22:50:05.471 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013560499999999999 2024-09-12T22:50:05.471 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.471 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.471 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:05.471 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265897+0000", 2024-09-12T22:50:05.471 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01149846 2024-09-12T22:50:05.472 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.472 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.472 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:05.472 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265922+0000", 2024-09-12T22:50:05.472 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5130000000000002e-05 2024-09-12T22:50:05.472 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.472 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.472 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:05.472 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265954+0000", 2024-09-12T22:50:05.472 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2512999999999999e-05 2024-09-12T22:50:05.472 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.472 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.472 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:05.473 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265983+0000", 2024-09-12T22:50:05.473 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8799999999999999e-05 2024-09-12T22:50:05.473 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.473 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:05.473 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.473 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.473 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.473 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1938 3.8 3:17051619:::200.0000000f:head [write 990345~2499 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:05.473 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:50:05.473 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 8.2137726430000004, 2024-09-12T22:50:05.473 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.094864730999999994, 2024-09-12T22:50:05.473 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:05.473 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:05.474 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:05.474 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:05.474 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.474 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:05.474 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:50:05.474 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.474 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.474 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.474 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:05.474 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:50:05.474 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.474 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.474 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.474 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:05.475 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:50:05.475 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:50:05.475 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.475 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.475 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:05.475 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171242+0000", 2024-09-12T22:50:05.475 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3111e-05 2024-09-12T22:50:05.475 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.475 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.475 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:05.475 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171247+0000", 2024-09-12T22:50:05.475 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0939999999999998e-06 2024-09-12T22:50:05.475 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.475 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.476 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:05.476 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171251+0000", 2024-09-12T22:50:05.476 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.298e-06 2024-09-12T22:50:05.476 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.476 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.476 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:05.476 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254869+0000", 2024-09-12T22:50:05.476 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.083618681 2024-09-12T22:50:05.476 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.476 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.476 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:05.476 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254957+0000", 2024-09-12T22:50:05.476 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7783999999999998e-05 2024-09-12T22:50:05.477 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.477 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.477 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:05.477 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255093+0000", 2024-09-12T22:50:05.477 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013579600000000001 2024-09-12T22:50:05.477 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.477 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.477 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:05.477 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265997+0000", 2024-09-12T22:50:05.477 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010903777999999999 2024-09-12T22:50:05.477 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.477 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.477 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:05.478 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266047+0000", 2024-09-12T22:50:05.478 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0151999999999997e-05 2024-09-12T22:50:05.478 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.478 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.478 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:05.478 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266075+0000", 2024-09-12T22:50:05.478 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8082e-05 2024-09-12T22:50:05.478 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.478 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.478 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:05.478 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266093+0000", 2024-09-12T22:50:05.478 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8396000000000001e-05 2024-09-12T22:50:05.478 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.478 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:05.479 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.479 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.479 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.479 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1944 3.8 3:17051619:::200.0000000f:head [write 1037561~3947 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:05.479 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.186089+0000", 2024-09-12T22:50:05.479 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 8.1989123930000005, 2024-09-12T22:50:05.479 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087755745999999996, 2024-09-12T22:50:05.479 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:05.479 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:05.479 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:05.479 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:05.479 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.479 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:05.480 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186089+0000", 2024-09-12T22:50:05.480 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.480 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.480 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.480 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:05.480 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186089+0000", 2024-09-12T22:50:05.480 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.480 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.480 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.480 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:05.480 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186090+0000", 2024-09-12T22:50:05.480 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1349999999999999e-06 2024-09-12T22:50:05.480 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.480 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.481 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:05.481 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186098+0000", 2024-09-12T22:50:05.481 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8390000000000007e-06 2024-09-12T22:50:05.481 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.481 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.481 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:05.481 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186106+0000", 2024-09-12T22:50:05.481 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4619999999999996e-06 2024-09-12T22:50:05.481 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.481 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.481 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:05.481 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186111+0000", 2024-09-12T22:50:05.481 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.057e-06 2024-09-12T22:50:05.482 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.482 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.482 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:05.482 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.264543+0000", 2024-09-12T22:50:05.482 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078432044000000006 2024-09-12T22:50:05.482 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.482 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.482 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:05.482 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.264617+0000", 2024-09-12T22:50:05.482 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3789999999999997e-05 2024-09-12T22:50:05.482 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.482 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.482 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:05.483 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.264760+0000", 2024-09-12T22:50:05.483 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014318499999999999 2024-09-12T22:50:05.483 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.483 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.483 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:05.483 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268441+0000", 2024-09-12T22:50:05.483 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036809360000000001 2024-09-12T22:50:05.483 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.483 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.483 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:05.483 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273776+0000", 2024-09-12T22:50:05.483 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053346449999999998 2024-09-12T22:50:05.483 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.483 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.484 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:05.484 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273807+0000", 2024-09-12T22:50:05.484 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1352000000000001e-05 2024-09-12T22:50:05.484 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.484 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.484 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:05.484 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273845+0000", 2024-09-12T22:50:05.484 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7301000000000001e-05 2024-09-12T22:50:05.484 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.484 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:05.484 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.484 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.484 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.485 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1945 3.8 3:17051619:::200.0000000f:head [write 1041508~10144 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:05.485 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:50:05.485 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 8.1986356209999993, 2024-09-12T22:50:05.485 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087573128, 2024-09-12T22:50:05.485 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:05.485 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:05.485 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:05.485 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:05.485 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.485 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:05.485 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:50:05.485 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.485 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.485 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.486 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:05.486 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:50:05.486 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.486 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.486 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.486 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:05.486 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:50:05.486 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1600000000000001e-07 2024-09-12T22:50:05.486 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.486 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.486 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:05.486 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186377+0000", 2024-09-12T22:50:05.486 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0301e-05 2024-09-12T22:50:05.486 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.487 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.487 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:05.487 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186386+0000", 2024-09-12T22:50:05.487 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5619999999999993e-06 2024-09-12T22:50:05.487 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.487 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.487 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:05.487 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186393+0000", 2024-09-12T22:50:05.487 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7150000000000001e-06 2024-09-12T22:50:05.487 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.487 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.487 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:05.487 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266725+0000", 2024-09-12T22:50:05.487 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.080331893000000001 2024-09-12T22:50:05.488 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.488 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.488 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:05.488 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266799+0000", 2024-09-12T22:50:05.488 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4086999999999997e-05 2024-09-12T22:50:05.488 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.488 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.488 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:05.488 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266904+0000", 2024-09-12T22:50:05.488 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105475 2024-09-12T22:50:05.488 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.488 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.488 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:05.489 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273882+0000", 2024-09-12T22:50:05.489 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069773780000000002 2024-09-12T22:50:05.489 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.489 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.489 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:05.489 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273889+0000", 2024-09-12T22:50:05.489 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1049999999999997e-06 2024-09-12T22:50:05.489 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.489 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.489 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:05.489 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273916+0000", 2024-09-12T22:50:05.489 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6716e-05 2024-09-12T22:50:05.489 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.489 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.490 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:05.490 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273939+0000", 2024-09-12T22:50:05.490 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3180000000000002e-05 2024-09-12T22:50:05.490 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.490 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:05.490 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.490 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.490 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.490 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1946 3.8 3:17051619:::200.0000000f:head [write 1051652~3875 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:05.490 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.186888+0000", 2024-09-12T22:50:05.490 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 8.1981133419999992, 2024-09-12T22:50:05.490 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087165134000000005, 2024-09-12T22:50:05.490 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:05.490 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:05.491 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:05.491 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:05.491 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.491 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:05.491 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186888+0000", 2024-09-12T22:50:05.491 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.491 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.491 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.491 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:05.491 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186888+0000", 2024-09-12T22:50:05.491 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.491 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.491 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.492 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:05.492 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186889+0000", 2024-09-12T22:50:05.492 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2500000000000005e-07 2024-09-12T22:50:05.492 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.492 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.492 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:05.492 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186894+0000", 2024-09-12T22:50:05.492 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3900000000000001e-06 2024-09-12T22:50:05.492 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.492 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.492 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:05.492 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186901+0000", 2024-09-12T22:50:05.492 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5649999999999998e-06 2024-09-12T22:50:05.493 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.493 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.493 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:05.493 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186906+0000", 2024-09-12T22:50:05.493 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0390000000000004e-06 2024-09-12T22:50:05.493 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.493 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.493 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:05.493 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.267852+0000", 2024-09-12T22:50:05.493 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.080946389999999993 2024-09-12T22:50:05.493 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.493 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.493 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:05.493 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.267910+0000", 2024-09-12T22:50:05.494 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7655999999999998e-05 2024-09-12T22:50:05.494 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.494 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.494 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:05.494 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.267981+0000", 2024-09-12T22:50:05.494 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0916999999999999e-05 2024-09-12T22:50:05.494 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.494 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.494 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:05.494 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273944+0000", 2024-09-12T22:50:05.494 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0059635570000000004 2024-09-12T22:50:05.494 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.494 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.495 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:05.495 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273993+0000", 2024-09-12T22:50:05.495 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8350000000000003e-05 2024-09-12T22:50:05.495 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.495 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.495 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:05.495 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274022+0000", 2024-09-12T22:50:05.495 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9899999999999998e-05 2024-09-12T22:50:05.495 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.495 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.495 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:05.495 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274053+0000", 2024-09-12T22:50:05.495 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0645000000000002e-05 2024-09-12T22:50:05.496 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.496 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:05.496 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.496 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.496 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.496 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1947 3.8 3:17051619:::200.0000000f:head [write 1055527~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:05.496 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.187014+0000", 2024-09-12T22:50:05.496 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 8.1979871079999995, 2024-09-12T22:50:05.496 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087114608999999996, 2024-09-12T22:50:05.496 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:05.496 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:05.496 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:05.496 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:05.497 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.497 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:05.497 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187014+0000", 2024-09-12T22:50:05.497 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.497 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.497 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.497 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:05.497 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187014+0000", 2024-09-12T22:50:05.497 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.497 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.497 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.497 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:05.497 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187015+0000", 2024-09-12T22:50:05.498 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1500000000000004e-07 2024-09-12T22:50:05.498 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.498 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.498 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:05.498 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187018+0000", 2024-09-12T22:50:05.498 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.033e-06 2024-09-12T22:50:05.498 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.498 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.498 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:05.498 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187023+0000", 2024-09-12T22:50:05.498 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7550000000000002e-06 2024-09-12T22:50:05.498 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.498 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.499 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:05.499 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187026+0000", 2024-09-12T22:50:05.499 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2710000000000001e-06 2024-09-12T22:50:05.499 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.499 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.499 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:05.499 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268462+0000", 2024-09-12T22:50:05.499 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.081435699 2024-09-12T22:50:05.499 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.499 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.499 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:05.499 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268507+0000", 2024-09-12T22:50:05.499 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5643999999999999e-05 2024-09-12T22:50:05.499 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.500 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.500 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:05.500 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268597+0000", 2024-09-12T22:50:05.500 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0112999999999996e-05 2024-09-12T22:50:05.500 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.500 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.500 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:05.500 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273947+0000", 2024-09-12T22:50:05.500 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053501859999999998 2024-09-12T22:50:05.500 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.500 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.500 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:05.500 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274083+0000", 2024-09-12T22:50:05.501 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013525500000000001 2024-09-12T22:50:05.501 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.501 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.501 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:05.501 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274109+0000", 2024-09-12T22:50:05.501 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6352000000000001e-05 2024-09-12T22:50:05.501 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.501 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.501 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:05.501 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274129+0000", 2024-09-12T22:50:05.501 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9686000000000001e-05 2024-09-12T22:50:05.501 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.501 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:05.502 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.502 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.502 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.502 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1948 3.8 3:17051619:::200.0000000f:head [write 1057443~1896 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:05.502 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.189230+0000", 2024-09-12T22:50:05.502 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 8.1957712960000002, 2024-09-12T22:50:05.502 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.085028962999999999, 2024-09-12T22:50:05.503 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:05.503 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:05.504 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:05.504 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:05.504 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.504 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:05.504 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189230+0000", 2024-09-12T22:50:05.504 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.504 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.504 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.504 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:05.504 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189230+0000", 2024-09-12T22:50:05.504 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:05.504 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.504 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.504 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:05.505 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189231+0000", 2024-09-12T22:50:05.505 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1399999999999996e-07 2024-09-12T22:50:05.505 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.505 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.505 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:05.505 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189235+0000", 2024-09-12T22:50:05.505 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5970000000000002e-06 2024-09-12T22:50:05.505 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.505 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.506 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:05.506 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189242+0000", 2024-09-12T22:50:05.506 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8510000000000001e-06 2024-09-12T22:50:05.506 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.506 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.506 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:05.506 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189247+0000", 2024-09-12T22:50:05.506 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4800000000000003e-06 2024-09-12T22:50:05.506 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.506 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.506 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:05.506 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268908+0000", 2024-09-12T22:50:05.506 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079660983000000005 2024-09-12T22:50:05.506 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.507 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.507 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:05.507 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268967+0000", 2024-09-12T22:50:05.507 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9595000000000001e-05 2024-09-12T22:50:05.507 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.507 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.507 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:05.507 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.269040+0000", 2024-09-12T22:50:05.507 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2643000000000002e-05 2024-09-12T22:50:05.507 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.507 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.507 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:05.507 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273950+0000", 2024-09-12T22:50:05.508 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049105329999999999 2024-09-12T22:50:05.508 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.508 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.508 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:05.508 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274199+0000", 2024-09-12T22:50:05.508 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024824999999999999 2024-09-12T22:50:05.508 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.508 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.598 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:05.598 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274226+0000", 2024-09-12T22:50:05.598 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7602000000000001e-05 2024-09-12T22:50:05.598 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:05.598 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:05.598 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:05.599 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274259+0000", 2024-09-12T22:50:05.599 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2614999999999999e-05 2024-09-12T22:50:05.599 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.599 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:05.599 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.599 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:05.599 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:05.599 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:50:05.600 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:05.599+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:05.601 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:50:05.701 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:05.700+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:05.708 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:50:05.708 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:50:05.708 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:50:05.708 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:50:05.715 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:50:05.802 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~94s 2024-09-12T22:50:05.803 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:05.802+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:05.865 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:50:05.865 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:50:05.865 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:50:05.866 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:50:05.866 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:50:05.874 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:50:05.904 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:05.904+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:06.005 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:06.005+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:06.024 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:50:06.024 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:50:06.024 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:50:06.024 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:50:06.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.025 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12403 4.0 4:0146e0d0:::100000031d4.00000000:head [write 0~4194304 [2@3733965]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:06.025 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:55.747692+0000", 2024-09-12T22:50:06.025 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 10.274625056, 2024-09-12T22:50:06.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.22362137500000001, 2024-09-12T22:50:06.025 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:06.025 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:06.025 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.025 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:06.025 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:06.025 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:06.025 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12403 2024-09-12T22:50:06.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.025 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:06.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:06.026 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.747692+0000", 2024-09-12T22:50:06.026 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:06.026 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.747692+0000", 2024-09-12T22:50:06.026 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:06.026 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.747693+0000", 2024-09-12T22:50:06.026 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3799999999999996e-07 2024-09-12T22:50:06.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.027 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:06.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959640+0000", 2024-09-12T22:50:06.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.21194702000000001 2024-09-12T22:50:06.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.027 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:06.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959660+0000", 2024-09-12T22:50:06.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9939e-05 2024-09-12T22:50:06.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.028 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.028 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959668+0000", 2024-09-12T22:50:06.028 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1669999999999999e-06 2024-09-12T22:50:06.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.028 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:06.028 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959764+0000", 2024-09-12T22:50:06.028 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5315000000000005e-05 2024-09-12T22:50:06.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.028 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:06.029 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959865+0000", 2024-09-12T22:50:06.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101618 2024-09-12T22:50:06.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.029 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:06.029 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.971224+0000", 2024-09-12T22:50:06.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011358541999999999 2024-09-12T22:50:06.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.029 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:06.029 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.971261+0000", 2024-09-12T22:50:06.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7092999999999999e-05 2024-09-12T22:50:06.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.030 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:06.030 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.971314+0000", 2024-09-12T22:50:06.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2843000000000002e-05 2024-09-12T22:50:06.030 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.030 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:06.030 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.030 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:12503 4.15 e56/17 4:ab29d13f:::100000033b1.00000000:head v 56'161, mlcod=55'159)", 2024-09-12T22:50:06.030 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:50:06.030 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.9917115790000004, 2024-09-12T22:50:06.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.043668640000000002, 2024-09-12T22:50:06.031 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:06.031 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:06.031 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.031 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:06.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:06.031 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:50:06.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:06.031 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:50:06.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.032 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:06.032 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:50:06.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:50:06.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.032 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:06.032 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039768+0000", 2024-09-12T22:50:06.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0091617190000000005 2024-09-12T22:50:06.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.032 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:06.032 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039781+0000", 2024-09-12T22:50:06.033 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2829e-05 2024-09-12T22:50:06.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.033 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.033 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039789+0000", 2024-09-12T22:50:06.033 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9340000000000006e-06 2024-09-12T22:50:06.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.033 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:06.033 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039846+0000", 2024-09-12T22:50:06.033 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6762999999999998e-05 2024-09-12T22:50:06.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.034 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:06.034 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039897+0000", 2024-09-12T22:50:06.034 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1517000000000002e-05 2024-09-12T22:50:06.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.034 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:06.034 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074225+0000", 2024-09-12T22:50:06.034 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034328138000000001 2024-09-12T22:50:06.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.034 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:06.035 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074274+0000", 2024-09-12T22:50:06.035 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9255999999999997e-05 2024-09-12T22:50:06.035 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.035 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:06.035 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.035 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12508 4.2d 4:b7b19b64:::10000003230.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:06.035 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.037293+0000", 2024-09-12T22:50:06.035 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.9850244040000007, 2024-09-12T22:50:06.035 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.037399772999999997, 2024-09-12T22:50:06.035 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:06.035 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:06.035 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.036 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:06.036 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:06.036 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:06.036 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12508 2024-09-12T22:50:06.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.036 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:06.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.036 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:06.036 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037293+0000", 2024-09-12T22:50:06.036 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.037 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:06.037 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037293+0000", 2024-09-12T22:50:06.037 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.037 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.037 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:06.037 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037294+0000", 2024-09-12T22:50:06.037 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4899999999999995e-07 2024-09-12T22:50:06.037 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.037 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:06.037 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042701+0000", 2024-09-12T22:50:06.038 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054069419999999997 2024-09-12T22:50:06.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.038 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:06.038 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042712+0000", 2024-09-12T22:50:06.038 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.171e-05 2024-09-12T22:50:06.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.038 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.038 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042719+0000", 2024-09-12T22:50:06.038 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1189999999999999e-06 2024-09-12T22:50:06.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.038 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:06.039 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042759+0000", 2024-09-12T22:50:06.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9478999999999999e-05 2024-09-12T22:50:06.039 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.039 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:06.039 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042827+0000", 2024-09-12T22:50:06.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8435999999999993e-05 2024-09-12T22:50:06.039 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.039 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:06.039 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042965+0000", 2024-09-12T22:50:06.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000137723 2024-09-12T22:50:06.039 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.040 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:06.040 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.058351+0000", 2024-09-12T22:50:06.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015385902 2024-09-12T22:50:06.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.040 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:06.040 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074620+0000", 2024-09-12T22:50:06.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016269018 2024-09-12T22:50:06.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.040 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:06.040 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074657+0000", 2024-09-12T22:50:06.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6619999999999998e-05 2024-09-12T22:50:06.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.041 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:06.041 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074693+0000", 2024-09-12T22:50:06.041 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6174999999999998e-05 2024-09-12T22:50:06.041 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.041 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:06.041 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.041 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12516 4.21 4:858ae08d:::100000030eb.00000000:head [write 0~4194304 [3@1582458]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:06.041 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.045143+0000", 2024-09-12T22:50:06.041 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.9771741160000005, 2024-09-12T22:50:06.042 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.039721657, 2024-09-12T22:50:06.042 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:06.042 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:06.042 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.042 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:06.042 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:06.042 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:06.042 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12516 2024-09-12T22:50:06.042 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.042 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:06.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.042 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:06.043 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.045143+0000", 2024-09-12T22:50:06.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.043 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:06.043 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.045143+0000", 2024-09-12T22:50:06.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.043 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:06.043 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.045144+0000", 2024-09-12T22:50:06.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2900000000000002e-07 2024-09-12T22:50:06.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:06.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049506+0000", 2024-09-12T22:50:06.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043620280000000004 2024-09-12T22:50:06.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:06.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049517+0000", 2024-09-12T22:50:06.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0726e-05 2024-09-12T22:50:06.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049522+0000", 2024-09-12T22:50:06.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3730000000000001e-06 2024-09-12T22:50:06.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:06.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049583+0000", 2024-09-12T22:50:06.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1254999999999995e-05 2024-09-12T22:50:06.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:06.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049645+0000", 2024-09-12T22:50:06.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1988000000000003e-05 2024-09-12T22:50:06.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:06.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049731+0000", 2024-09-12T22:50:06.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6040999999999998e-05 2024-09-12T22:50:06.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:06.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.064126+0000", 2024-09-12T22:50:06.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01439497 2024-09-12T22:50:06.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:06.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.084785+0000", 2024-09-12T22:50:06.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020658972000000001 2024-09-12T22:50:06.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:06.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.084829+0000", 2024-09-12T22:50:06.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3869000000000003e-05 2024-09-12T22:50:06.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:06.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.084865+0000", 2024-09-12T22:50:06.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5605999999999998e-05 2024-09-12T22:50:06.047 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.047 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:06.047 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.048 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1354 3.18 3:1e8917d7:::200.0000000e:head [write 498872~14494 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:06.048 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.048337+0000", 2024-09-12T22:50:06.048 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.9739801969999995, 2024-09-12T22:50:06.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034292491000000001, 2024-09-12T22:50:06.048 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:06.048 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:06.048 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.048 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:06.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:06.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048337+0000", 2024-09-12T22:50:06.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:06.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048337+0000", 2024-09-12T22:50:06.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:06.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048339+0000", 2024-09-12T22:50:06.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.409e-06 2024-09-12T22:50:06.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:06.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048360+0000", 2024-09-12T22:50:06.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1659999999999999e-05 2024-09-12T22:50:06.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:06.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048370+0000", 2024-09-12T22:50:06.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.611e-06 2024-09-12T22:50:06.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048376+0000", 2024-09-12T22:50:06.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5479999999999998e-06 2024-09-12T22:50:06.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:06.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048440+0000", 2024-09-12T22:50:06.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3367000000000005e-05 2024-09-12T22:50:06.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:06.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048557+0000", 2024-09-12T22:50:06.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116983 2024-09-12T22:50:06.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:06.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048719+0000", 2024-09-12T22:50:06.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016250499999999999 2024-09-12T22:50:06.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:06.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.058763+0000", 2024-09-12T22:50:06.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010043948 2024-09-12T22:50:06.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:06.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082499+0000", 2024-09-12T22:50:06.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023735320000000001 2024-09-12T22:50:06.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:06.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082561+0000", 2024-09-12T22:50:06.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2490000000000006e-05 2024-09-12T22:50:06.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:06.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082630+0000", 2024-09-12T22:50:06.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8650000000000002e-05 2024-09-12T22:50:06.054 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.054 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:06.054 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.054 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12517 4.1a 4:5a8c04dd:::10000003276.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:06.054 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.049539+0000", 2024-09-12T22:50:06.054 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.9727784350000004, 2024-09-12T22:50:06.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.036068957999999998, 2024-09-12T22:50:06.054 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:06.054 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:06.054 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.055 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:06.055 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:06.055 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:06.055 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12517 2024-09-12T22:50:06.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.055 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:06.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:06.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049539+0000", 2024-09-12T22:50:06.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:06.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049539+0000", 2024-09-12T22:50:06.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:06.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049540+0000", 2024-09-12T22:50:06.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1299999999999999e-07 2024-09-12T22:50:06.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:06.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054581+0000", 2024-09-12T22:50:06.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005041167 2024-09-12T22:50:06.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:06.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054593+0000", 2024-09-12T22:50:06.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1943000000000001e-05 2024-09-12T22:50:06.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054598+0000", 2024-09-12T22:50:06.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6500000000000001e-06 2024-09-12T22:50:06.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:06.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054658+0000", 2024-09-12T22:50:06.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9898999999999997e-05 2024-09-12T22:50:06.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:06.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054800+0000", 2024-09-12T22:50:06.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014187100000000001 2024-09-12T22:50:06.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:06.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.085456+0000", 2024-09-12T22:50:06.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.030655452 2024-09-12T22:50:06.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:06.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.085533+0000", 2024-09-12T22:50:06.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7478999999999995e-05 2024-09-12T22:50:06.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:06.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.085608+0000", 2024-09-12T22:50:06.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4684000000000005e-05 2024-09-12T22:50:06.059 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.059 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:06.059 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.060 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12677 4.10 4:0b7ac23f:::10000003457.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:06.060 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:50:06.060 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.7929036390000004, 2024-09-12T22:50:06.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033661045000000001, 2024-09-12T22:50:06.060 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:06.060 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:06.060 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.060 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:06.060 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:06.060 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:06.060 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12677 2024-09-12T22:50:06.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.060 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:06.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:06.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:50:06.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:06.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:50:06.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:06.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:50:06.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0100000000000005e-07 2024-09-12T22:50:06.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:06.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.237295+0000", 2024-09-12T22:50:06.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078803290000000002 2024-09-12T22:50:06.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:06.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.237307+0000", 2024-09-12T22:50:06.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2339e-05 2024-09-12T22:50:06.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.237312+0000", 2024-09-12T22:50:06.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9089999999999999e-06 2024-09-12T22:50:06.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:06.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.239034+0000", 2024-09-12T22:50:06.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001722424 2024-09-12T22:50:06.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:06.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.239129+0000", 2024-09-12T22:50:06.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4486000000000003e-05 2024-09-12T22:50:06.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:06.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.239206+0000", 2024-09-12T22:50:06.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7146999999999998e-05 2024-09-12T22:50:06.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:06.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.255921+0000", 2024-09-12T22:50:06.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016714685 2024-09-12T22:50:06.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:06.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.263025+0000", 2024-09-12T22:50:06.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071042470000000002 2024-09-12T22:50:06.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:06.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.263052+0000", 2024-09-12T22:50:06.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7195e-05 2024-09-12T22:50:06.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:06.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.263075+0000", 2024-09-12T22:50:06.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2782999999999999e-05 2024-09-12T22:50:06.065 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.065 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:06.066 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.066 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12979 4.1e 4:78503759:::10000003406.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:06.066 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:50:06.066 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.4572168429999994, 2024-09-12T22:50:06.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032861456999999997, 2024-09-12T22:50:06.066 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:06.066 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:06.066 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.066 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:06.066 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:06.066 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:06.066 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12979 2024-09-12T22:50:06.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.067 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:06.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:06.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:50:06.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:06.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:50:06.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:06.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:50:06.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9999999999999998e-07 2024-09-12T22:50:06.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:06.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573365+0000", 2024-09-12T22:50:06.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082644229999999999 2024-09-12T22:50:06.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:06.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573379+0000", 2024-09-12T22:50:06.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3322999999999999e-05 2024-09-12T22:50:06.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573386+0000", 2024-09-12T22:50:06.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.199e-06 2024-09-12T22:50:06.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:06.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573464+0000", 2024-09-12T22:50:06.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7931999999999999e-05 2024-09-12T22:50:06.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:06.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573713+0000", 2024-09-12T22:50:06.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024922200000000001 2024-09-12T22:50:06.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:06.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.597870+0000", 2024-09-12T22:50:06.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024157221999999999 2024-09-12T22:50:06.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:06.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.597926+0000", 2024-09-12T22:50:06.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5838000000000003e-05 2024-09-12T22:50:06.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:06.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.597962+0000", 2024-09-12T22:50:06.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5898000000000001e-05 2024-09-12T22:50:06.071 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.071 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:06.071 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.071 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:13017 4.3b e56/17 4:deb39c3c:::1000000315d.00000000:head v 56'194, mlcod=56'192)", 2024-09-12T22:50:06.071 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.600876+0000", 2024-09-12T22:50:06.071 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.4214413669999999, 2024-09-12T22:50:06.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038152448999999998, 2024-09-12T22:50:06.071 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:06.072 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:06.072 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.072 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:06.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:06.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.600876+0000", 2024-09-12T22:50:06.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:06.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.600876+0000", 2024-09-12T22:50:06.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:06.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.600877+0000", 2024-09-12T22:50:06.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:50:06.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:06.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609737+0000", 2024-09-12T22:50:06.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088599089999999991 2024-09-12T22:50:06.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:06.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609748+0000", 2024-09-12T22:50:06.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1355999999999999e-05 2024-09-12T22:50:06.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609757+0000", 2024-09-12T22:50:06.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9190000000000005e-06 2024-09-12T22:50:06.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:06.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609801+0000", 2024-09-12T22:50:06.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4019e-05 2024-09-12T22:50:06.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:06.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609816+0000", 2024-09-12T22:50:06.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5226e-05 2024-09-12T22:50:06.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:06.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.638985+0000", 2024-09-12T22:50:06.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029168537000000001 2024-09-12T22:50:06.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:06.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.639028+0000", 2024-09-12T22:50:06.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3847000000000002e-05 2024-09-12T22:50:06.075 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.076 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:06.076 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.076 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13032 4.7 4:e102bf81:::1000000359e.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:06.076 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.616553+0000", 2024-09-12T22:50:06.076 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.4057645149999995, 2024-09-12T22:50:06.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032471027999999999, 2024-09-12T22:50:06.076 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:06.076 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:06.076 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.076 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:06.076 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:06.077 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:06.077 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13032 2024-09-12T22:50:06.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.077 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:06.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:06.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.616553+0000", 2024-09-12T22:50:06.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:06.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.616553+0000", 2024-09-12T22:50:06.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:06.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.616554+0000", 2024-09-12T22:50:06.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0100000000000004e-07 2024-09-12T22:50:06.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:06.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621405+0000", 2024-09-12T22:50:06.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0048517480000000003 2024-09-12T22:50:06.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:06.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621416+0000", 2024-09-12T22:50:06.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0264e-05 2024-09-12T22:50:06.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621446+0000", 2024-09-12T22:50:06.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0849000000000002e-05 2024-09-12T22:50:06.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:06.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621494+0000", 2024-09-12T22:50:06.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7018000000000003e-05 2024-09-12T22:50:06.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:06.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621590+0000", 2024-09-12T22:50:06.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6632999999999995e-05 2024-09-12T22:50:06.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:06.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621680+0000", 2024-09-12T22:50:06.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9704999999999996e-05 2024-09-12T22:50:06.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:06.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.639248+0000", 2024-09-12T22:50:06.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017568548 2024-09-12T22:50:06.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:06.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.648944+0000", 2024-09-12T22:50:06.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0096954659999999998 2024-09-12T22:50:06.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:06.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.648992+0000", 2024-09-12T22:50:06.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8059999999999997e-05 2024-09-12T22:50:06.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:06.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.649024+0000", 2024-09-12T22:50:06.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1936000000000001e-05 2024-09-12T22:50:06.082 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.082 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:06.082 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.082 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13428 4.37 4:eeed8456:::1000000321a.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:06.082 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.064666+0000", 2024-09-12T22:50:06.082 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.9576512370000003, 2024-09-12T22:50:06.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033441308000000003, 2024-09-12T22:50:06.082 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:06.082 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:06.082 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.082 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:06.083 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:06.083 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:06.083 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13428 2024-09-12T22:50:06.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.083 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:06.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:06.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.064666+0000", 2024-09-12T22:50:06.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:06.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.064666+0000", 2024-09-12T22:50:06.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:06.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.064668+0000", 2024-09-12T22:50:06.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4160000000000001e-06 2024-09-12T22:50:06.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:06.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071829+0000", 2024-09-12T22:50:06.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071611390000000004 2024-09-12T22:50:06.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:06.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071840+0000", 2024-09-12T22:50:06.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1369000000000001e-05 2024-09-12T22:50:06.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071847+0000", 2024-09-12T22:50:06.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0960000000000003e-06 2024-09-12T22:50:06.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:06.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071904+0000", 2024-09-12T22:50:06.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7309000000000003e-05 2024-09-12T22:50:06.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:06.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.072051+0000", 2024-09-12T22:50:06.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014625 2024-09-12T22:50:06.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:06.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.072194+0000", 2024-09-12T22:50:06.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014379799999999999 2024-09-12T22:50:06.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:06.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.079527+0000", 2024-09-12T22:50:06.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007332674 2024-09-12T22:50:06.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:06.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.098048+0000", 2024-09-12T22:50:06.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018521174000000001 2024-09-12T22:50:06.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:06.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.098081+0000", 2024-09-12T22:50:06.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2910999999999997e-05 2024-09-12T22:50:06.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:06.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.098107+0000", 2024-09-12T22:50:06.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6171999999999999e-05 2024-09-12T22:50:06.088 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.088 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:06.088 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.088 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13472 4.12 4:4b0bd9b8:::100000033b0.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:06.088 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.113168+0000", 2024-09-12T22:50:06.088 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.9091495379999994, 2024-09-12T22:50:06.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.039534103000000001, 2024-09-12T22:50:06.089 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:06.089 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:06.089 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.089 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:06.089 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:06.089 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:06.089 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13472 2024-09-12T22:50:06.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.089 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:06.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:06.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.113168+0000", 2024-09-12T22:50:06.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:06.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.113168+0000", 2024-09-12T22:50:06.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:06.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.113169+0000", 2024-09-12T22:50:06.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1960000000000001e-06 2024-09-12T22:50:06.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:06.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119849+0000", 2024-09-12T22:50:06.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0066801830000000001 2024-09-12T22:50:06.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:06.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119861+0000", 2024-09-12T22:50:06.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.199e-05 2024-09-12T22:50:06.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119866+0000", 2024-09-12T22:50:06.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8720000000000001e-06 2024-09-12T22:50:06.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:06.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119945+0000", 2024-09-12T22:50:06.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9268000000000001e-05 2024-09-12T22:50:06.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:06.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.120098+0000", 2024-09-12T22:50:06.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015299500000000001 2024-09-12T22:50:06.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:06.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.120218+0000", 2024-09-12T22:50:06.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011989099999999999 2024-09-12T22:50:06.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:06.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.140463+0000", 2024-09-12T22:50:06.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020244765000000001 2024-09-12T22:50:06.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:06.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.152629+0000", 2024-09-12T22:50:06.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012165601999999999 2024-09-12T22:50:06.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:06.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.152664+0000", 2024-09-12T22:50:06.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5599999999999998e-05 2024-09-12T22:50:06.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:06.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.152702+0000", 2024-09-12T22:50:06.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7741000000000003e-05 2024-09-12T22:50:06.094 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.094 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:06.094 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.094 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13484 4.2f 4:f62c2e43:::1000000349e.00000000:head [write 0~4194304 [2@3461078]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:06.094 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.125796+0000", 2024-09-12T22:50:06.095 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.8965211750000002, 2024-09-12T22:50:06.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.036857236000000002, 2024-09-12T22:50:06.095 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:06.095 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:06.095 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.095 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:06.095 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:06.095 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:06.095 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13484 2024-09-12T22:50:06.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.095 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:06.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:06.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.125796+0000", 2024-09-12T22:50:06.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:06.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.125796+0000", 2024-09-12T22:50:06.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:06.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.125797+0000", 2024-09-12T22:50:06.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.108e-06 2024-09-12T22:50:06.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:06.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130725+0000", 2024-09-12T22:50:06.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049272949999999999 2024-09-12T22:50:06.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:06.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130739+0000", 2024-09-12T22:50:06.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4234e-05 2024-09-12T22:50:06.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130751+0000", 2024-09-12T22:50:06.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1848000000000001e-05 2024-09-12T22:50:06.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:06.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130816+0000", 2024-09-12T22:50:06.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5359999999999998e-05 2024-09-12T22:50:06.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:06.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130917+0000", 2024-09-12T22:50:06.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101178 2024-09-12T22:50:06.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:06.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.131058+0000", 2024-09-12T22:50:06.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140803 2024-09-12T22:50:06.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:06.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.153387+0000", 2024-09-12T22:50:06.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022328585000000001 2024-09-12T22:50:06.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:06.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.162465+0000", 2024-09-12T22:50:06.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090781360000000005 2024-09-12T22:50:06.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:06.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.162584+0000", 2024-09-12T22:50:06.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119634 2024-09-12T22:50:06.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:06.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.162653+0000", 2024-09-12T22:50:06.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9054999999999995e-05 2024-09-12T22:50:06.101 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.102 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:06.102 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.103 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13558 4.10 4:09df41af:::1000000333c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:06.103 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.229326+0000", 2024-09-12T22:50:06.103 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.7929913469999992, 2024-09-12T22:50:06.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.039409786000000002, 2024-09-12T22:50:06.103 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:06.103 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:06.103 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.103 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:06.103 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:06.104 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:06.104 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13558 2024-09-12T22:50:06.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.104 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:06.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:06.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.229326+0000", 2024-09-12T22:50:06.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:06.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.229326+0000", 2024-09-12T22:50:06.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:06.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.229327+0000", 2024-09-12T22:50:06.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1200000000000002e-07 2024-09-12T22:50:06.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:06.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235243+0000", 2024-09-12T22:50:06.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059166310000000003 2024-09-12T22:50:06.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:06.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235255+0000", 2024-09-12T22:50:06.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1174e-05 2024-09-12T22:50:06.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235260+0000", 2024-09-12T22:50:06.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1749999999999996e-06 2024-09-12T22:50:06.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:06.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235295+0000", 2024-09-12T22:50:06.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4830999999999999e-05 2024-09-12T22:50:06.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:06.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235350+0000", 2024-09-12T22:50:06.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5092e-05 2024-09-12T22:50:06.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:06.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235426+0000", 2024-09-12T22:50:06.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6463000000000003e-05 2024-09-12T22:50:06.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:06.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.244772+0000", 2024-09-12T22:50:06.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0093457709999999992 2024-09-12T22:50:06.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:06.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.268679+0000", 2024-09-12T22:50:06.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023906788000000002 2024-09-12T22:50:06.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:06.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.268712+0000", 2024-09-12T22:50:06.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3701999999999997e-05 2024-09-12T22:50:06.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:06.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.268736+0000", 2024-09-12T22:50:06.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3447000000000001e-05 2024-09-12T22:50:06.109 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.109 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:06.109 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.109 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13747 4.1e 4:7aa36f33:::100000035ed.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:06.110 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.457376+0000", 2024-09-12T22:50:06.110 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.5649412330000008, 2024-09-12T22:50:06.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.037057578000000001, 2024-09-12T22:50:06.110 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:06.110 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:06.110 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.110 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:06.110 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:06.110 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:06.110 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13747 2024-09-12T22:50:06.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.110 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:06.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:06.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.457376+0000", 2024-09-12T22:50:06.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:06.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.457376+0000", 2024-09-12T22:50:06.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:06.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.457377+0000", 2024-09-12T22:50:06.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1699999999999998e-07 2024-09-12T22:50:06.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:06.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464400+0000", 2024-09-12T22:50:06.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070235890000000002 2024-09-12T22:50:06.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:06.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464413+0000", 2024-09-12T22:50:06.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2397e-05 2024-09-12T22:50:06.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464418+0000", 2024-09-12T22:50:06.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5119999999999999e-06 2024-09-12T22:50:06.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:06.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464464+0000", 2024-09-12T22:50:06.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5976000000000002e-05 2024-09-12T22:50:06.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:06.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464529+0000", 2024-09-12T22:50:06.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5266999999999997e-05 2024-09-12T22:50:06.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:06.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.494315+0000", 2024-09-12T22:50:06.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029785329999999999 2024-09-12T22:50:06.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:06.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.494366+0000", 2024-09-12T22:50:06.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0903999999999999e-05 2024-09-12T22:50:06.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:06.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.494434+0000", 2024-09-12T22:50:06.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7985999999999996e-05 2024-09-12T22:50:06.116 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.116 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:06.116 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.116 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:13748 4.15 e56/17 4:ab1b03eb:::100000031a3.00000000:head v 56'173, mlcod=56'171)", 2024-09-12T22:50:06.116 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.462509+0000", 2024-09-12T22:50:06.116 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.5598081859999997, 2024-09-12T22:50:06.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044366823, 2024-09-12T22:50:06.116 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:06.116 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:06.117 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.117 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:06.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:06.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.462509+0000", 2024-09-12T22:50:06.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:06.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.462509+0000", 2024-09-12T22:50:06.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:06.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.462509+0000", 2024-09-12T22:50:06.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7599999999999998e-07 2024-09-12T22:50:06.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:06.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471576+0000", 2024-09-12T22:50:06.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090665490000000001 2024-09-12T22:50:06.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:06.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471591+0000", 2024-09-12T22:50:06.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4566000000000001e-05 2024-09-12T22:50:06.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471600+0000", 2024-09-12T22:50:06.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1630000000000002e-06 2024-09-12T22:50:06.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:06.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471689+0000", 2024-09-12T22:50:06.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9591000000000003e-05 2024-09-12T22:50:06.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:06.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471735+0000", 2024-09-12T22:50:06.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5429000000000002e-05 2024-09-12T22:50:06.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:06.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.506851+0000", 2024-09-12T22:50:06.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035116238000000001 2024-09-12T22:50:06.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:06.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.506876+0000", 2024-09-12T22:50:06.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5011000000000002e-05 2024-09-12T22:50:06.121 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.121 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:06.121 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.121 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13753 4.30 4:0dea61b7:::100000036ed.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:06.121 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.464559+0000", 2024-09-12T22:50:06.121 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.5577581869999992, 2024-09-12T22:50:06.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041415303000000001, 2024-09-12T22:50:06.122 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:06.122 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:06.122 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.122 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:06.122 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:06.122 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:06.122 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13753 2024-09-12T22:50:06.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.122 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:06.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:06.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464559+0000", 2024-09-12T22:50:06.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:06.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464559+0000", 2024-09-12T22:50:06.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:06.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464560+0000", 2024-09-12T22:50:06.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:50:06.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:06.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469861+0000", 2024-09-12T22:50:06.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053017139999999999 2024-09-12T22:50:06.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:06.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469878+0000", 2024-09-12T22:50:06.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6336000000000001e-05 2024-09-12T22:50:06.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469888+0000", 2024-09-12T22:50:06.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8320000000000001e-06 2024-09-12T22:50:06.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:06.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469950+0000", 2024-09-12T22:50:06.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1923999999999999e-05 2024-09-12T22:50:06.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:06.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.470059+0000", 2024-09-12T22:50:06.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109559 2024-09-12T22:50:06.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:06.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.505915+0000", 2024-09-12T22:50:06.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035855887000000003 2024-09-12T22:50:06.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:06.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.505939+0000", 2024-09-12T22:50:06.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3740999999999999e-05 2024-09-12T22:50:06.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:06.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.505974+0000", 2024-09-12T22:50:06.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5753999999999997e-05 2024-09-12T22:50:06.126 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.126 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:06.126 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.127 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13754 4.11 4:8a2f20b1:::10000003764.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:06.127 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.469921+0000", 2024-09-12T22:50:06.127 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.5523963349999992, 2024-09-12T22:50:06.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034721670000000003, 2024-09-12T22:50:06.127 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:06.127 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:06.127 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.127 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:06.127 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:06.127 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:06.127 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13754 2024-09-12T22:50:06.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.127 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:06.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:06.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469921+0000", 2024-09-12T22:50:06.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:06.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469921+0000", 2024-09-12T22:50:06.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:06.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469922+0000", 2024-09-12T22:50:06.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.006e-06 2024-09-12T22:50:06.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:06.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474681+0000", 2024-09-12T22:50:06.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047588539999999999 2024-09-12T22:50:06.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:06.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474698+0000", 2024-09-12T22:50:06.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7368999999999999e-05 2024-09-12T22:50:06.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474709+0000", 2024-09-12T22:50:06.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0738e-05 2024-09-12T22:50:06.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:06.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474780+0000", 2024-09-12T22:50:06.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0622000000000002e-05 2024-09-12T22:50:06.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:06.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474954+0000", 2024-09-12T22:50:06.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017394399999999999 2024-09-12T22:50:06.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:06.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.504488+0000", 2024-09-12T22:50:06.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029534721999999999 2024-09-12T22:50:06.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:06.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.504553+0000", 2024-09-12T22:50:06.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4877999999999998e-05 2024-09-12T22:50:06.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:06.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.504643+0000", 2024-09-12T22:50:06.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9536999999999993e-05 2024-09-12T22:50:06.132 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.132 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:06.132 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.132 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13763 4.2d 4:b5937a57:::100000031de.00000000:head [write 0~4194304 [3@52474]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:06.132 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.474957+0000", 2024-09-12T22:50:06.132 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.5473600919999999, 2024-09-12T22:50:06.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.057329167, 2024-09-12T22:50:06.132 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:06.132 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:06.132 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.133 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:06.133 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:06.133 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:06.133 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13763 2024-09-12T22:50:06.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.133 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:06.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:06.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474957+0000", 2024-09-12T22:50:06.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:06.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474957+0000", 2024-09-12T22:50:06.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:06.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474958+0000", 2024-09-12T22:50:06.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8299999999999997e-07 2024-09-12T22:50:06.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:06.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.478970+0000", 2024-09-12T22:50:06.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040121100000000002 2024-09-12T22:50:06.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:06.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.478983+0000", 2024-09-12T22:50:06.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.292e-05 2024-09-12T22:50:06.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.478992+0000", 2024-09-12T22:50:06.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3759999999999997e-06 2024-09-12T22:50:06.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:06.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.479048+0000", 2024-09-12T22:50:06.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5381999999999999e-05 2024-09-12T22:50:06.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:06.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.479124+0000", 2024-09-12T22:50:06.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6643999999999993e-05 2024-09-12T22:50:06.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:06.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.479230+0000", 2024-09-12T22:50:06.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010581099999999999 2024-09-12T22:50:06.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:06.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.506897+0000", 2024-09-12T22:50:06.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027666863999999999 2024-09-12T22:50:06.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:06.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.532175+0000", 2024-09-12T22:50:06.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.025278367 2024-09-12T22:50:06.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:06.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.532232+0000", 2024-09-12T22:50:06.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6455000000000001e-05 2024-09-12T22:50:06.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:06.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.532286+0000", 2024-09-12T22:50:06.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4654999999999998e-05 2024-09-12T22:50:06.138 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.138 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:06.138 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.138 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13803 4.4 4:228c5bc4:::10000003314.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:06.138 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.515814+0000", 2024-09-12T22:50:06.139 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.5065036660000004, 2024-09-12T22:50:06.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034442453999999997, 2024-09-12T22:50:06.139 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:06.139 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:06.139 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.139 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:06.139 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:06.139 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:06.139 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13803 2024-09-12T22:50:06.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.139 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:06.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:06.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.515814+0000", 2024-09-12T22:50:06.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:06.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.515814+0000", 2024-09-12T22:50:06.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:06.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:06.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.515814+0000", 2024-09-12T22:50:06.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4799999999999998e-07 2024-09-12T22:50:06.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:06.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522580+0000", 2024-09-12T22:50:06.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0067656959999999999 2024-09-12T22:50:06.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:06.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522591+0000", 2024-09-12T22:50:06.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1206000000000001e-05 2024-09-12T22:50:06.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522597+0000", 2024-09-12T22:50:06.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1500000000000004e-06 2024-09-12T22:50:06.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:06.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522639+0000", 2024-09-12T22:50:06.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1767999999999997e-05 2024-09-12T22:50:06.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:06.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522689+0000", 2024-09-12T22:50:06.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9472999999999999e-05 2024-09-12T22:50:06.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:06.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522771+0000", 2024-09-12T22:50:06.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2738000000000006e-05 2024-09-12T22:50:06.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:06.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.529356+0000", 2024-09-12T22:50:06.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065850329999999997 2024-09-12T22:50:06.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:06.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.550206+0000", 2024-09-12T22:50:06.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020849755000000001 2024-09-12T22:50:06.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:06.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.550233+0000", 2024-09-12T22:50:06.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6990000000000001e-05 2024-09-12T22:50:06.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:06.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:06.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:06.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.550256+0000", 2024-09-12T22:50:06.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3096999999999999e-05 2024-09-12T22:50:06.144 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.144 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:06.144 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.144 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:06.144 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:06.144 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:50:06.146 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:06.144+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:06.146 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:50:06.246 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:06.245+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:06.276 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:50:06.277 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:50:06.277 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.277 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:9518 4.1d 4:b82304b6:::1000000028c.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-09-12T22:50:06.277 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:50:06.273768+0000", 2024-09-12T22:50:06.277 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0012565930000000001, 2024-09-12T22:50:06.277 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001287809, 2024-09-12T22:50:06.277 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:06.277 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:06.277 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:50:06.277 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:06.277 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.278 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:06.278 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.273768+0000", 2024-09-12T22:50:06.278 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.278 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.278 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.278 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:06.278 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.273768+0000", 2024-09-12T22:50:06.278 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.278 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.278 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.278 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:06.278 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.273768+0000", 2024-09-12T22:50:06.279 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8199999999999998e-07 2024-09-12T22:50:06.279 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.279 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.279 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:06.279 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.273772+0000", 2024-09-12T22:50:06.279 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.014e-06 2024-09-12T22:50:06.279 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.280 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.280 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:06.280 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.273781+0000", 2024-09-12T22:50:06.280 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1610000000000003e-06 2024-09-12T22:50:06.280 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.280 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.280 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.280 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.273788+0000", 2024-09-12T22:50:06.280 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2640000000000002e-06 2024-09-12T22:50:06.280 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.280 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.280 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:06.280 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.274486+0000", 2024-09-12T22:50:06.281 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00069848000000000002 2024-09-12T22:50:06.281 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.281 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.281 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:06.281 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.274602+0000", 2024-09-12T22:50:06.281 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115253 2024-09-12T22:50:06.281 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.281 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:06.281 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.281 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.281 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.281 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:9519 4.2a 4:55828a49:::1000000028d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-09-12T22:50:06.281 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:50:06.273805+0000", 2024-09-12T22:50:06.282 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0012190739999999999, 2024-09-12T22:50:06.282 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001318072, 2024-09-12T22:50:06.282 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:06.282 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:06.282 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:50:06.282 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:06.282 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.282 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:06.282 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.273805+0000", 2024-09-12T22:50:06.282 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.282 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.282 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.282 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:06.283 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.273805+0000", 2024-09-12T22:50:06.283 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.283 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.283 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.283 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:06.283 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.273806+0000", 2024-09-12T22:50:06.283 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7599999999999997e-07 2024-09-12T22:50:06.283 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.283 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.283 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:06.283 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.273808+0000", 2024-09-12T22:50:06.283 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3470000000000001e-06 2024-09-12T22:50:06.283 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.283 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.284 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:06.284 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.273814+0000", 2024-09-12T22:50:06.284 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3430000000000001e-06 2024-09-12T22:50:06.284 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.284 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.284 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.284 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.273819+0000", 2024-09-12T22:50:06.284 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0270000000000003e-06 2024-09-12T22:50:06.284 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.284 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.284 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:06.284 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.273864+0000", 2024-09-12T22:50:06.284 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5207000000000003e-05 2024-09-12T22:50:06.285 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.285 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.285 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:06.285 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.274076+0000", 2024-09-12T22:50:06.285 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00021175 2024-09-12T22:50:06.285 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.285 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:06.285 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.285 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.285 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.285 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:9520 4.22 4:456115b5:::1000000028e.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-09-12T22:50:06.285 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:50:06.273833+0000", 2024-09-12T22:50:06.285 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.001191597, 2024-09-12T22:50:06.286 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001345314, 2024-09-12T22:50:06.286 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:06.286 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:06.286 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:50:06.286 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:06.286 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.286 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:06.286 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.273833+0000", 2024-09-12T22:50:06.286 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.286 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.286 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.287 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:06.287 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.273833+0000", 2024-09-12T22:50:06.287 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.287 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.287 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.287 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:06.287 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.273833+0000", 2024-09-12T22:50:06.287 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4700000000000002e-07 2024-09-12T22:50:06.287 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.287 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.287 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:06.287 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.273835+0000", 2024-09-12T22:50:06.287 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1689999999999999e-06 2024-09-12T22:50:06.287 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.288 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.288 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:06.288 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.273839+0000", 2024-09-12T22:50:06.288 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2440000000000004e-06 2024-09-12T22:50:06.288 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.288 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.288 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.288 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.273843+0000", 2024-09-12T22:50:06.288 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1549999999999999e-06 2024-09-12T22:50:06.288 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.288 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.288 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:06.288 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.273901+0000", 2024-09-12T22:50:06.289 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8161000000000001e-05 2024-09-12T22:50:06.289 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.289 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.289 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:06.289 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.274021+0000", 2024-09-12T22:50:06.289 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000120117 2024-09-12T22:50:06.289 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.289 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:06.289 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.289 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.289 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.290 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:9523 4.25 4:a61cbf99:::10000000291.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-09-12T22:50:06.290 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:50:06.273870+0000", 2024-09-12T22:50:06.290 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0011539549999999999, 2024-09-12T22:50:06.290 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013387539999999999, 2024-09-12T22:50:06.290 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:06.291 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:06.291 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:50:06.291 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:06.291 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.291 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:06.291 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.273870+0000", 2024-09-12T22:50:06.291 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.291 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.291 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.292 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:06.292 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.273870+0000", 2024-09-12T22:50:06.292 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.292 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.292 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.292 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:06.292 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.273871+0000", 2024-09-12T22:50:06.292 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.63e-07 2024-09-12T22:50:06.292 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.292 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.292 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:06.292 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.273878+0000", 2024-09-12T22:50:06.292 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9990000000000002e-06 2024-09-12T22:50:06.292 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.293 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.293 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:06.293 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.273910+0000", 2024-09-12T22:50:06.293 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2589999999999998e-05 2024-09-12T22:50:06.293 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.293 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.293 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.293 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.273916+0000", 2024-09-12T22:50:06.293 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7509999999999997e-06 2024-09-12T22:50:06.293 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.293 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.293 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:06.294 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.274307+0000", 2024-09-12T22:50:06.294 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00039074999999999998 2024-09-12T22:50:06.294 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.294 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.294 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:06.294 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.274427+0000", 2024-09-12T22:50:06.294 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000119886 2024-09-12T22:50:06.294 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.294 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:06.295 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.295 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.295 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.295 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:9524 4.2e 4:7472c580:::10000000292.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-09-12T22:50:06.295 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:50:06.274375+0000", 2024-09-12T22:50:06.295 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.00064936499999999995, 2024-09-12T22:50:06.295 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089245899999999996, 2024-09-12T22:50:06.295 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:06.295 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:06.296 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:50:06.296 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:06.296 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.296 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:06.296 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.274375+0000", 2024-09-12T22:50:06.296 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.296 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.296 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.296 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:06.297 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.274375+0000", 2024-09-12T22:50:06.297 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.297 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.297 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.298 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:06.298 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.274376+0000", 2024-09-12T22:50:06.298 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7599999999999996e-07 2024-09-12T22:50:06.298 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.298 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.299 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:06.299 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.274379+0000", 2024-09-12T22:50:06.299 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7840000000000001e-06 2024-09-12T22:50:06.299 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.299 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.299 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:06.300 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.274388+0000", 2024-09-12T22:50:06.300 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0909999999999999e-06 2024-09-12T22:50:06.300 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.300 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.300 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.300 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.274394+0000", 2024-09-12T22:50:06.300 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0229999999999998e-06 2024-09-12T22:50:06.301 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.301 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.301 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:06.301 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.274554+0000", 2024-09-12T22:50:06.301 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015957699999999999 2024-09-12T22:50:06.301 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.301 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.301 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:06.302 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.274653+0000", 2024-09-12T22:50:06.302 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9395000000000006e-05 2024-09-12T22:50:06.302 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.302 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.302 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:06.302 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.274737+0000", 2024-09-12T22:50:06.303 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3256000000000004e-05 2024-09-12T22:50:06.303 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.303 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:06.303 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.303 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.303 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.303 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:9525 4.14 4:2b324201:::10000000293.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-09-12T22:50:06.304 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:50:06.274413+0000", 2024-09-12T22:50:06.304 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.00061155699999999999, 2024-09-12T22:50:06.304 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00088932499999999995, 2024-09-12T22:50:06.304 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:06.304 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:06.304 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:50:06.305 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:06.305 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.305 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:06.305 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.274413+0000", 2024-09-12T22:50:06.305 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.306 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.306 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.306 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:06.306 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.274413+0000", 2024-09-12T22:50:06.306 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.306 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.306 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.307 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:06.307 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.274413+0000", 2024-09-12T22:50:06.307 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7599999999999997e-07 2024-09-12T22:50:06.307 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.307 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.307 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:06.307 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.274416+0000", 2024-09-12T22:50:06.307 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8600000000000001e-06 2024-09-12T22:50:06.307 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.308 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.308 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:06.308 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.274423+0000", 2024-09-12T22:50:06.308 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0949999999999998e-06 2024-09-12T22:50:06.308 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.308 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.308 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.308 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.274428+0000", 2024-09-12T22:50:06.308 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1549999999999998e-06 2024-09-12T22:50:06.308 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.308 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.308 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:06.308 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.274468+0000", 2024-09-12T22:50:06.309 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9227000000000002e-05 2024-09-12T22:50:06.309 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.309 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.309 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:06.309 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.274587+0000", 2024-09-12T22:50:06.309 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000119424 2024-09-12T22:50:06.310 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.310 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.310 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:06.310 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.274667+0000", 2024-09-12T22:50:06.310 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0187999999999999e-05 2024-09-12T22:50:06.310 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.310 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:06.311 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.311 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.311 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.311 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:9522 4.7 e59/17 4:e25a3370:::10000000290.00000000:head v 59'233, mlcod=59'231)", 2024-09-12T22:50:06.311 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:50:06.275081+0000", 2024-09-12T22:50:06.311 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4294967295.9999433, 2024-09-12T22:50:06.311 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026996399999999998, 2024-09-12T22:50:06.311 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:06.311 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:06.312 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:50:06.312 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:06.312 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.312 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:06.312 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275081+0000", 2024-09-12T22:50:06.312 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.312 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.313 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.313 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:06.313 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275081+0000", 2024-09-12T22:50:06.313 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.313 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.313 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.314 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:06.314 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275081+0000", 2024-09-12T22:50:06.314 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5800000000000001e-07 2024-09-12T22:50:06.314 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.314 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.314 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:06.314 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275085+0000", 2024-09-12T22:50:06.314 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3759999999999999e-06 2024-09-12T22:50:06.314 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.314 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.314 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:06.314 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275090+0000", 2024-09-12T22:50:06.314 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.694e-06 2024-09-12T22:50:06.315 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.315 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.315 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.315 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275095+0000", 2024-09-12T22:50:06.315 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4390000000000002e-06 2024-09-12T22:50:06.315 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.315 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.315 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:06.315 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275137+0000", 2024-09-12T22:50:06.315 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1978999999999999e-05 2024-09-12T22:50:06.315 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.315 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.315 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:06.316 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275154+0000", 2024-09-12T22:50:06.316 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7229000000000001e-05 2024-09-12T22:50:06.316 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.316 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:06.316 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.316 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.316 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.316 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:9528 4.21 e59/17 4:87a106c7:::10000000296.00000000:head v 59'286, mlcod=59'284)", 2024-09-12T22:50:06.316 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:50:06.275224+0000", 2024-09-12T22:50:06.316 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4294967295.9998002, 2024-09-12T22:50:06.316 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00018609900000000001, 2024-09-12T22:50:06.316 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:06.316 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:06.317 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:50:06.317 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:06.317 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.317 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:06.317 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275224+0000", 2024-09-12T22:50:06.317 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.317 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.317 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.317 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:06.317 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275224+0000", 2024-09-12T22:50:06.317 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.317 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.317 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.318 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:06.319 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275224+0000", 2024-09-12T22:50:06.319 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9100000000000004e-07 2024-09-12T22:50:06.319 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.319 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.319 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:06.319 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275229+0000", 2024-09-12T22:50:06.319 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1500000000000001e-06 2024-09-12T22:50:06.319 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.319 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.320 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:06.320 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275237+0000", 2024-09-12T22:50:06.320 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3909999999999998e-06 2024-09-12T22:50:06.320 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.320 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.320 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.320 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275242+0000", 2024-09-12T22:50:06.320 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0340000000000004e-06 2024-09-12T22:50:06.320 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.321 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.321 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:06.321 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275385+0000", 2024-09-12T22:50:06.321 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000143504 2024-09-12T22:50:06.321 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.321 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.321 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:06.321 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275402+0000", 2024-09-12T22:50:06.322 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6988999999999999e-05 2024-09-12T22:50:06.322 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.322 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:06.322 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.322 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.322 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:9529 4.13 4:c822edf7:::10000000297.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-09-12T22:50:06.322 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:50:06.275265+0000", 2024-09-12T22:50:06.323 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4294967295.9997597, 2024-09-12T22:50:06.323 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020830499999999999, 2024-09-12T22:50:06.323 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:06.323 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:06.323 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-12T22:50:06.323 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:06.323 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.323 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:06.323 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275265+0000", 2024-09-12T22:50:06.324 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.324 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.324 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.324 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:06.324 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275265+0000", 2024-09-12T22:50:06.324 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.324 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.324 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.325 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:06.325 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275265+0000", 2024-09-12T22:50:06.325 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5700000000000002e-07 2024-09-12T22:50:06.325 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.325 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.325 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:06.325 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275268+0000", 2024-09-12T22:50:06.325 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6139999999999999e-06 2024-09-12T22:50:06.326 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.326 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.326 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:06.326 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275275+0000", 2024-09-12T22:50:06.326 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0530000000000001e-06 2024-09-12T22:50:06.326 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.326 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.327 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275280+0000", 2024-09-12T22:50:06.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9740000000000001e-06 2024-09-12T22:50:06.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:06.327 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275351+0000", 2024-09-12T22:50:06.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0720000000000001e-05 2024-09-12T22:50:06.328 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.328 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:06.328 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.328 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:9532 4.1c 4:3b1326fd:::1000000029a.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-09-12T22:50:06.328 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:50:06.275321+0000", 2024-09-12T22:50:06.328 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4294967295.9997034, 2024-09-12T22:50:06.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00019549699999999999, 2024-09-12T22:50:06.329 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:06.329 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:06.329 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-12T22:50:06.329 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:06.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.329 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:06.329 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275321+0000", 2024-09-12T22:50:06.330 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.330 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.330 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.330 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:06.330 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275321+0000", 2024-09-12T22:50:06.330 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.330 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.330 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.331 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:06.331 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275321+0000", 2024-09-12T22:50:06.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2100000000000002e-07 2024-09-12T22:50:06.331 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.331 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.331 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:06.331 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275323+0000", 2024-09-12T22:50:06.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0660000000000002e-06 2024-09-12T22:50:06.331 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:06.332 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275330+0000", 2024-09-12T22:50:06.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.686e-06 2024-09-12T22:50:06.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275335+0000", 2024-09-12T22:50:06.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3839999999999996e-06 2024-09-12T22:50:06.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.333 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:06.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275452+0000", 2024-09-12T22:50:06.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000116784 2024-09-12T22:50:06.333 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.334 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:06.334 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.334 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:9533 4.1d 4:b92df426:::1000000029b.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-09-12T22:50:06.334 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:50:06.275347+0000", 2024-09-12T22:50:06.334 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4294967295.9996772, 2024-09-12T22:50:06.334 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00022472700000000001, 2024-09-12T22:50:06.334 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:06.335 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:06.335 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-09-12T22:50:06.335 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:06.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.335 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:06.335 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275347+0000", 2024-09-12T22:50:06.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.335 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:06.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275347+0000", 2024-09-12T22:50:06.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.336 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:06.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275347+0000", 2024-09-12T22:50:06.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9700000000000002e-07 2024-09-12T22:50:06.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.336 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:06.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275350+0000", 2024-09-12T22:50:06.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.655e-06 2024-09-12T22:50:06.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.337 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:06.337 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275357+0000", 2024-09-12T22:50:06.337 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7880000000000001e-06 2024-09-12T22:50:06.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.337 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.337 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275362+0000", 2024-09-12T22:50:06.337 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.797e-06 2024-09-12T22:50:06.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.337 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:06.337 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275413+0000", 2024-09-12T22:50:06.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1393000000000001e-05 2024-09-12T22:50:06.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.338 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:06.338 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275524+0000", 2024-09-12T22:50:06.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011071899999999999 2024-09-12T22:50:06.338 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.338 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:06.338 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.339 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:9534 4.33 4:ce199014:::1000000029c.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-09-12T22:50:06.339 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:50:06.275372+0000", 2024-09-12T22:50:06.339 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4294967295.9996524, 2024-09-12T22:50:06.339 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00025979200000000001, 2024-09-12T22:50:06.339 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:06.339 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:06.339 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-09-12T22:50:06.339 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:06.339 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.339 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:06.339 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275372+0000", 2024-09-12T22:50:06.339 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:06.340 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275372+0000", 2024-09-12T22:50:06.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:06.340 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275372+0000", 2024-09-12T22:50:06.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2200000000000004e-07 2024-09-12T22:50:06.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:06.340 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275374+0000", 2024-09-12T22:50:06.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.968e-06 2024-09-12T22:50:06.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.341 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:06.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275381+0000", 2024-09-12T22:50:06.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2489999999999998e-06 2024-09-12T22:50:06.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.341 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275386+0000", 2024-09-12T22:50:06.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9139999999999999e-06 2024-09-12T22:50:06.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.342 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:06.342 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275533+0000", 2024-09-12T22:50:06.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014746200000000001 2024-09-12T22:50:06.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.342 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:06.342 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.275634+0000", 2024-09-12T22:50:06.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000101358 2024-09-12T22:50:06.342 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.342 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:06.342 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.343 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:9505 4.3b 4:dcefc520:::1000000027f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-09-12T22:50:06.343 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:50:06.272537+0000", 2024-09-12T22:50:06.343 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0024866699999999999, 2024-09-12T22:50:06.343 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031543999999999999, 2024-09-12T22:50:06.343 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:06.343 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:06.343 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:50:06.343 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:06.343 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.343 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:06.343 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.272537+0000", 2024-09-12T22:50:06.343 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.343 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.343 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.344 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:06.344 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.272537+0000", 2024-09-12T22:50:06.344 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.344 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.344 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.344 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:06.344 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.272538+0000", 2024-09-12T22:50:06.344 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.08e-07 2024-09-12T22:50:06.344 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.344 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.344 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:06.344 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.272540+0000", 2024-09-12T22:50:06.344 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9690000000000001e-06 2024-09-12T22:50:06.344 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.345 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.345 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:06.345 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.272546+0000", 2024-09-12T22:50:06.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3620000000000002e-06 2024-09-12T22:50:06.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.345 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.345 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.345 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.272552+0000", 2024-09-12T22:50:06.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6969999999999998e-06 2024-09-12T22:50:06.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.345 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.345 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:06.346 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.273254+0000", 2024-09-12T22:50:06.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00070238899999999999 2024-09-12T22:50:06.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.346 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:06.346 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.273366+0000", 2024-09-12T22:50:06.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011157100000000001 2024-09-12T22:50:06.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.346 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:06.346 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.273462+0000", 2024-09-12T22:50:06.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5639999999999999e-05 2024-09-12T22:50:06.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.347 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:06.347 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:50:06.274604+0000", 2024-09-12T22:50:06.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011423589999999999 2024-09-12T22:50:06.347 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.347 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:06.347 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.347 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.347 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-12T22:50:06.347 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 13 2024-09-12T22:50:06.347 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:50:06.349 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:50:06.349 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:06.347+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:06.450 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:06.449+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:06.511 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:50:06.511 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:50:06.511 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:50:06.511 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:50:06.512 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:50:06.521 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:50:06.551 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:06.550+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:06.630 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:50:06.630 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:50:06.631 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:50:06.631 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:50:06.631 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.631 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1923 3.8 3:17051619:::200.0000000f:head [write 935107~4527 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:06.631 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.157731+0000", 2024-09-12T22:50:06.631 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.4706477660000008, 2024-09-12T22:50:06.631 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.085115956000000006, 2024-09-12T22:50:06.631 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:06.631 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:06.631 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.631 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:06.631 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.631 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:06.631 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157731+0000", 2024-09-12T22:50:06.632 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.632 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.632 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.632 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:06.632 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157731+0000", 2024-09-12T22:50:06.632 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.632 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.632 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.632 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:06.632 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157732+0000", 2024-09-12T22:50:06.632 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.99e-07 2024-09-12T22:50:06.632 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.633 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.633 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:06.633 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157737+0000", 2024-09-12T22:50:06.633 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6280000000000002e-06 2024-09-12T22:50:06.633 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.633 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.633 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:06.633 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157745+0000", 2024-09-12T22:50:06.633 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1749999999999999e-06 2024-09-12T22:50:06.633 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.633 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.633 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157749+0000", 2024-09-12T22:50:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.946e-06 2024-09-12T22:50:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.236865+0000", 2024-09-12T22:50:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079116687000000005 2024-09-12T22:50:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.236929+0000", 2024-09-12T22:50:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3566999999999996e-05 2024-09-12T22:50:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237025+0000", 2024-09-12T22:50:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6620000000000007e-05 2024-09-12T22:50:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240342+0000", 2024-09-12T22:50:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033162539999999998 2024-09-12T22:50:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242737+0000", 2024-09-12T22:50:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023957370000000002 2024-09-12T22:50:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242797+0000", 2024-09-12T22:50:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9323000000000001e-05 2024-09-12T22:50:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242847+0000", 2024-09-12T22:50:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0319999999999999e-05 2024-09-12T22:50:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1924 3.8 3:17051619:::200.0000000f:head [write 939634~6106 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.159169+0000", 2024-09-12T22:50:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.4692095470000002, 2024-09-12T22:50:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.083843601000000004, 2024-09-12T22:50:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:06.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:06.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159169+0000", 2024-09-12T22:50:06.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:06.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159169+0000", 2024-09-12T22:50:06.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:06.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159171+0000", 2024-09-12T22:50:06.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4959999999999999e-06 2024-09-12T22:50:06.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.639 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:06.639 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159182+0000", 2024-09-12T22:50:06.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1104000000000001e-05 2024-09-12T22:50:06.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.639 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:06.639 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159190+0000", 2024-09-12T22:50:06.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3520000000000007e-06 2024-09-12T22:50:06.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159196+0000", 2024-09-12T22:50:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5690000000000004e-06 2024-09-12T22:50:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237476+0000", 2024-09-12T22:50:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078280197999999995 2024-09-12T22:50:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237530+0000", 2024-09-12T22:50:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4419000000000002e-05 2024-09-12T22:50:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237593+0000", 2024-09-12T22:50:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2611000000000001e-05 2024-09-12T22:50:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242030+0000", 2024-09-12T22:50:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044367369999999996 2024-09-12T22:50:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242893+0000", 2024-09-12T22:50:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00086367400000000004 2024-09-12T22:50:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242956+0000", 2024-09-12T22:50:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2885999999999994e-05 2024-09-12T22:50:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243013+0000", 2024-09-12T22:50:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6555000000000003e-05 2024-09-12T22:50:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1925 3.8 3:17051619:::200.0000000f:head [write 945740~9955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.160395+0000", 2024-09-12T22:50:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.4679843380000008, 2024-09-12T22:50:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.091200247999999998, 2024-09-12T22:50:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160395+0000", 2024-09-12T22:50:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160395+0000", 2024-09-12T22:50:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160396+0000", 2024-09-12T22:50:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1599999999999999e-06 2024-09-12T22:50:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160415+0000", 2024-09-12T22:50:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9680000000000001e-05 2024-09-12T22:50:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160428+0000", 2024-09-12T22:50:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2792999999999999e-05 2024-09-12T22:50:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160436+0000", 2024-09-12T22:50:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0399999999999993e-06 2024-09-12T22:50:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.238408+0000", 2024-09-12T22:50:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077971602000000001 2024-09-12T22:50:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.238504+0000", 2024-09-12T22:50:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6714999999999998e-05 2024-09-12T22:50:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.238687+0000", 2024-09-12T22:50:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000182795 2024-09-12T22:50:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242036+0000", 2024-09-12T22:50:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003348887 2024-09-12T22:50:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251510+0000", 2024-09-12T22:50:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094733679999999994 2024-09-12T22:50:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251543+0000", 2024-09-12T22:50:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2974e-05 2024-09-12T22:50:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251595+0000", 2024-09-12T22:50:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2234000000000002e-05 2024-09-12T22:50:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1926 3.8 3:17051619:::200.0000000f:head [write 955695~5281 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.160849+0000", 2024-09-12T22:50:06.650 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.4675293840000005, 2024-09-12T22:50:06.650 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.094772633999999994, 2024-09-12T22:50:06.650 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:06.650 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:06.650 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.650 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:06.650 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.650 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:06.650 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160849+0000", 2024-09-12T22:50:06.651 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.651 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.651 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.651 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:06.651 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160849+0000", 2024-09-12T22:50:06.651 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.651 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.651 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.651 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:06.651 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160850+0000", 2024-09-12T22:50:06.651 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6700000000000002e-07 2024-09-12T22:50:06.651 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160858+0000", 2024-09-12T22:50:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5630000000000003e-06 2024-09-12T22:50:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160866+0000", 2024-09-12T22:50:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7570000000000004e-06 2024-09-12T22:50:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160870+0000", 2024-09-12T22:50:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5929999999999999e-06 2024-09-12T22:50:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.239705+0000", 2024-09-12T22:50:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078834491000000007 2024-09-12T22:50:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.239764+0000", 2024-09-12T22:50:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9190000000000001e-05 2024-09-12T22:50:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.239851+0000", 2024-09-12T22:50:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7472999999999994e-05 2024-09-12T22:50:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254001+0000", 2024-09-12T22:50:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014149622000000001 2024-09-12T22:50:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255525+0000", 2024-09-12T22:50:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0015236500000000001 2024-09-12T22:50:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255567+0000", 2024-09-12T22:50:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2150999999999997e-05 2024-09-12T22:50:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255622+0000", 2024-09-12T22:50:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5276999999999999e-05 2024-09-12T22:50:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1927 3.8 3:17051619:::200.0000000f:head [write 960976~5828 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.164361+0000", 2024-09-12T22:50:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.4640176870000001, 2024-09-12T22:50:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.091388523999999999, 2024-09-12T22:50:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164361+0000", 2024-09-12T22:50:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164361+0000", 2024-09-12T22:50:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164363+0000", 2024-09-12T22:50:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.389e-06 2024-09-12T22:50:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164370+0000", 2024-09-12T22:50:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.99e-06 2024-09-12T22:50:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164379+0000", 2024-09-12T22:50:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9499999999999996e-06 2024-09-12T22:50:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164385+0000", 2024-09-12T22:50:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5879999999999997e-06 2024-09-12T22:50:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240385+0000", 2024-09-12T22:50:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075999995000000001 2024-09-12T22:50:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240533+0000", 2024-09-12T22:50:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014811699999999999 2024-09-12T22:50:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240886+0000", 2024-09-12T22:50:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000352517 2024-09-12T22:50:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254024+0000", 2024-09-12T22:50:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013138047999999999 2024-09-12T22:50:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255629+0000", 2024-09-12T22:50:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001604949 2024-09-12T22:50:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255683+0000", 2024-09-12T22:50:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4035e-05 2024-09-12T22:50:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255750+0000", 2024-09-12T22:50:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6946000000000006e-05 2024-09-12T22:50:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1928 3.8 3:17051619:::200.0000000f:head [write 966804~6536 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167179+0000", 2024-09-12T22:50:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.4611998889999995, 2024-09-12T22:50:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.089785880999999998, 2024-09-12T22:50:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167179+0000", 2024-09-12T22:50:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167179+0000", 2024-09-12T22:50:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.664 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.664 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:06.664 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167180+0000", 2024-09-12T22:50:06.664 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2869999999999999e-06 2024-09-12T22:50:06.664 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.664 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.664 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:06.665 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167192+0000", 2024-09-12T22:50:06.665 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.187e-05 2024-09-12T22:50:06.665 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.665 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.665 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:06.666 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167203+0000", 2024-09-12T22:50:06.666 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1076e-05 2024-09-12T22:50:06.666 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.666 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.666 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.666 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167210+0000", 2024-09-12T22:50:06.667 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1799999999999999e-06 2024-09-12T22:50:06.667 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.667 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.667 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:06.667 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.241518+0000", 2024-09-12T22:50:06.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074307845999999997 2024-09-12T22:50:06.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:06.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.241563+0000", 2024-09-12T22:50:06.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5138e-05 2024-09-12T22:50:06.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.669 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.669 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:06.669 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.241641+0000", 2024-09-12T22:50:06.669 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8016000000000007e-05 2024-09-12T22:50:06.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.670 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.670 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:06.670 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254041+0000", 2024-09-12T22:50:06.670 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012399666 2024-09-12T22:50:06.670 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.671 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.671 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:06.671 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.256880+0000", 2024-09-12T22:50:06.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0028390580000000002 2024-09-12T22:50:06.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.671 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.672 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:06.672 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.256918+0000", 2024-09-12T22:50:06.672 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7552999999999998e-05 2024-09-12T22:50:06.672 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.673 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:06.673 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.256965+0000", 2024-09-12T22:50:06.673 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7191000000000003e-05 2024-09-12T22:50:06.673 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.674 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:06.674 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.674 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1929 3.8 3:17051619:::200.0000000f:head [write 973340~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:06.675 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167521+0000", 2024-09-12T22:50:06.675 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.4608577260000004, 2024-09-12T22:50:06.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.093206336000000001, 2024-09-12T22:50:06.675 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:06.675 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:06.676 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.676 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:06.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:06.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167521+0000", 2024-09-12T22:50:06.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.677 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:06.677 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167521+0000", 2024-09-12T22:50:06.677 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.678 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.678 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:06.678 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167522+0000", 2024-09-12T22:50:06.678 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8899999999999998e-07 2024-09-12T22:50:06.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:06.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167526+0000", 2024-09-12T22:50:06.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4490000000000001e-06 2024-09-12T22:50:06.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:06.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167544+0000", 2024-09-12T22:50:06.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7220000000000001e-05 2024-09-12T22:50:06.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167551+0000", 2024-09-12T22:50:06.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.046e-06 2024-09-12T22:50:06.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:06.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242079+0000", 2024-09-12T22:50:06.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074528436000000003 2024-09-12T22:50:06.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:06.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242167+0000", 2024-09-12T22:50:06.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7670000000000006e-05 2024-09-12T22:50:06.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:06.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242306+0000", 2024-09-12T22:50:06.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000138703 2024-09-12T22:50:06.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:06.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254058+0000", 2024-09-12T22:50:06.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011752395000000001 2024-09-12T22:50:06.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:06.686 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260654+0000", 2024-09-12T22:50:06.686 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0065964700000000001 2024-09-12T22:50:06.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.686 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:06.686 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260699+0000", 2024-09-12T22:50:06.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5095000000000001e-05 2024-09-12T22:50:06.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.687 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:06.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260727+0000", 2024-09-12T22:50:06.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7963e-05 2024-09-12T22:50:06.688 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.688 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:06.688 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.689 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1931 3.8 3:17051619:::200.0000000f:head [write 974738~2728 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:06.689 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167657+0000", 2024-09-12T22:50:06.689 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.4607217210000005, 2024-09-12T22:50:06.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.093133758999999997, 2024-09-12T22:50:06.689 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:06.690 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:06.690 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.690 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:06.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.690 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:06.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167657+0000", 2024-09-12T22:50:06.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.691 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:06.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167657+0000", 2024-09-12T22:50:06.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:06.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167658+0000", 2024-09-12T22:50:06.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2200000000000003e-07 2024-09-12T22:50:06.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167662+0000", 2024-09-12T22:50:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1489999999999996e-06 2024-09-12T22:50:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167673+0000", 2024-09-12T22:50:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0614e-05 2024-09-12T22:50:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167679+0000", 2024-09-12T22:50:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1500000000000004e-06 2024-09-12T22:50:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243054+0000", 2024-09-12T22:50:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075375027999999997 2024-09-12T22:50:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243134+0000", 2024-09-12T22:50:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0210000000000006e-05 2024-09-12T22:50:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243263+0000", 2024-09-12T22:50:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012919 2024-09-12T22:50:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254075+0000", 2024-09-12T22:50:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010811523 2024-09-12T22:50:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260733+0000", 2024-09-12T22:50:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.006658153 2024-09-12T22:50:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260756+0000", 2024-09-12T22:50:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2696000000000001e-05 2024-09-12T22:50:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260791+0000", 2024-09-12T22:50:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5324000000000003e-05 2024-09-12T22:50:06.698 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.698 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:06.698 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.698 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1932 3.8 3:17051619:::200.0000000f:head [write 977466~2771 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:06.698 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:50:06.698 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.4604320390000005, 2024-09-12T22:50:06.699 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.092944115999999993, 2024-09-12T22:50:06.699 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:06.699 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:06.699 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.699 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:06.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.699 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:06.699 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:50:06.699 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.700 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:06.700 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:50:06.700 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.700 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.700 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:06.700 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:50:06.700 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8400000000000004e-07 2024-09-12T22:50:06.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:06.701 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167952+0000", 2024-09-12T22:50:06.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.138e-06 2024-09-12T22:50:06.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.702 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:06.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167961+0000", 2024-09-12T22:50:06.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7990000000000005e-06 2024-09-12T22:50:06.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.702 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167968+0000", 2024-09-12T22:50:06.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4400000000000002e-06 2024-09-12T22:50:06.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.702 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:06.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.244002+0000", 2024-09-12T22:50:06.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.076034300999999999 2024-09-12T22:50:06.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:06.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.244061+0000", 2024-09-12T22:50:06.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8356999999999997e-05 2024-09-12T22:50:06.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:06.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.244161+0000", 2024-09-12T22:50:06.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000100126 2024-09-12T22:50:06.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.704 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.704 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:06.704 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254099+0000", 2024-09-12T22:50:06.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0099384940000000008 2024-09-12T22:50:06.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.704 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.704 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:06.704 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260799+0000", 2024-09-12T22:50:06.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0066995029999999999 2024-09-12T22:50:06.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.704 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.704 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:06.704 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260851+0000", 2024-09-12T22:50:06.705 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1861999999999999e-05 2024-09-12T22:50:06.705 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.705 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:06.705 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260891+0000", 2024-09-12T22:50:06.705 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0411999999999999e-05 2024-09-12T22:50:06.705 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.705 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:06.705 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.705 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.705 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1933 3.8 3:17051619:::200.0000000f:head [write 980237~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:06.706 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167993+0000", 2024-09-12T22:50:06.706 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.4603855360000004, 2024-09-12T22:50:06.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.092952307999999997, 2024-09-12T22:50:06.706 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:06.706 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:06.706 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.706 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167993+0000", 2024-09-12T22:50:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167993+0000", 2024-09-12T22:50:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167994+0000", 2024-09-12T22:50:06.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5000000000000003e-07 2024-09-12T22:50:06.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.708 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:06.708 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167997+0000", 2024-09-12T22:50:06.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5559999999999999e-06 2024-09-12T22:50:06.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.709 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:06.709 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168005+0000", 2024-09-12T22:50:06.709 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.588e-06 2024-09-12T22:50:06.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.709 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.709 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.709 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168011+0000", 2024-09-12T22:50:06.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7780000000000004e-06 2024-09-12T22:50:06.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:06.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.247983+0000", 2024-09-12T22:50:06.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079972090999999995 2024-09-12T22:50:06.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:06.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248038+0000", 2024-09-12T22:50:06.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4889999999999998e-05 2024-09-12T22:50:06.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:06.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248136+0000", 2024-09-12T22:50:06.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8271999999999997e-05 2024-09-12T22:50:06.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:06.712 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254134+0000", 2024-09-12T22:50:06.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005997751 2024-09-12T22:50:06.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.713 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:06.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260898+0000", 2024-09-12T22:50:06.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0067646429999999999 2024-09-12T22:50:06.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.713 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:06.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260923+0000", 2024-09-12T22:50:06.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4080999999999999e-05 2024-09-12T22:50:06.714 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.714 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.714 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:06.714 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260946+0000", 2024-09-12T22:50:06.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3108e-05 2024-09-12T22:50:06.714 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.715 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:06.715 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.715 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.715 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1934 3.8 3:17051619:::200.0000000f:head [write 982156~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:06.715 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:50:06.715 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.4603600500000002, 2024-09-12T22:50:06.715 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.093517738000000003, 2024-09-12T22:50:06.715 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:06.716 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:06.716 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.716 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:06.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:06.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:50:06.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:06.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:50:06.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:06.718 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:50:06.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6800000000000001e-07 2024-09-12T22:50:06.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.718 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:06.718 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168029+0000", 2024-09-12T22:50:06.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9699999999999994e-06 2024-09-12T22:50:06.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:06.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168036+0000", 2024-09-12T22:50:06.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9800000000000001e-06 2024-09-12T22:50:06.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168041+0000", 2024-09-12T22:50:06.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0629999999999996e-06 2024-09-12T22:50:06.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.720 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:06.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248449+0000", 2024-09-12T22:50:06.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.080407948000000007 2024-09-12T22:50:06.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:06.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248491+0000", 2024-09-12T22:50:06.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2027999999999998e-05 2024-09-12T22:50:06.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:06.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248569+0000", 2024-09-12T22:50:06.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8077000000000005e-05 2024-09-12T22:50:06.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:06.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260950+0000", 2024-09-12T22:50:06.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012380901 2024-09-12T22:50:06.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:06.723 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.261473+0000", 2024-09-12T22:50:06.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00052241699999999996 2024-09-12T22:50:06.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.723 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:06.723 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.261507+0000", 2024-09-12T22:50:06.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4616000000000002e-05 2024-09-12T22:50:06.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.724 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:06.724 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.261537+0000", 2024-09-12T22:50:06.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9369999999999998e-05 2024-09-12T22:50:06.724 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.724 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:06.724 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.725 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1935 3.8 3:17051619:::200.0000000f:head [write 984074~1914 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:06.725 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:50:06.725 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.4603301280000007, 2024-09-12T22:50:06.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.097660714999999995, 2024-09-12T22:50:06.725 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:06.725 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:06.725 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.725 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:06.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:06.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:50:06.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.726 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:06.726 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:50:06.726 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:06.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:50:06.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4400000000000001e-07 2024-09-12T22:50:06.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:06.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168052+0000", 2024-09-12T22:50:06.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.886e-06 2024-09-12T22:50:06.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:06.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168059+0000", 2024-09-12T22:50:06.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0489999999999998e-06 2024-09-12T22:50:06.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168081+0000", 2024-09-12T22:50:06.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1800000000000001e-05 2024-09-12T22:50:06.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:06.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.250512+0000", 2024-09-12T22:50:06.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.082431322000000001 2024-09-12T22:50:06.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:06.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.250621+0000", 2024-09-12T22:50:06.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010908600000000001 2024-09-12T22:50:06.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:06.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.250970+0000", 2024-09-12T22:50:06.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034828399999999997 2024-09-12T22:50:06.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:06.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265532+0000", 2024-09-12T22:50:06.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01456268 2024-09-12T22:50:06.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:06.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265614+0000", 2024-09-12T22:50:06.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1796000000000001e-05 2024-09-12T22:50:06.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:06.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265673+0000", 2024-09-12T22:50:06.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9314000000000002e-05 2024-09-12T22:50:06.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:06.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265709+0000", 2024-09-12T22:50:06.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6053999999999997e-05 2024-09-12T22:50:06.732 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.732 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:06.732 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.732 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1936 3.8 3:17051619:::200.0000000f:head [write 985988~2437 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:06.732 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.168095+0000", 2024-09-12T22:50:06.732 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.4602837809999993, 2024-09-12T22:50:06.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.097789345999999999, 2024-09-12T22:50:06.732 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:06.732 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:06.733 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.733 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:06.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:06.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168095+0000", 2024-09-12T22:50:06.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:06.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168095+0000", 2024-09-12T22:50:06.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:06.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168096+0000", 2024-09-12T22:50:06.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7700000000000005e-07 2024-09-12T22:50:06.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:06.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168099+0000", 2024-09-12T22:50:06.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.422e-06 2024-09-12T22:50:06.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:06.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168106+0000", 2024-09-12T22:50:06.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6889999999999998e-06 2024-09-12T22:50:06.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168110+0000", 2024-09-12T22:50:06.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8470000000000003e-06 2024-09-12T22:50:06.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:06.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251622+0000", 2024-09-12T22:50:06.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.083511539999999995 2024-09-12T22:50:06.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:06.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251674+0000", 2024-09-12T22:50:06.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1678999999999998e-05 2024-09-12T22:50:06.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:06.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251744+0000", 2024-09-12T22:50:06.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0440999999999999e-05 2024-09-12T22:50:06.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:06.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265545+0000", 2024-09-12T22:50:06.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013801000000000001 2024-09-12T22:50:06.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:06.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265771+0000", 2024-09-12T22:50:06.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000225632 2024-09-12T22:50:06.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:06.738 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265835+0000", 2024-09-12T22:50:06.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4541000000000004e-05 2024-09-12T22:50:06.738 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.738 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:06.738 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265884+0000", 2024-09-12T22:50:06.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9078e-05 2024-09-12T22:50:06.738 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.738 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:06.738 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.738 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.739 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1937 3.8 3:17051619:::200.0000000f:head [write 988425~1920 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:06.739 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.171188+0000", 2024-09-12T22:50:06.739 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.4571904100000008, 2024-09-12T22:50:06.739 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.094794626000000007, 2024-09-12T22:50:06.739 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:06.739 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:06.739 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.739 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:06.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.739 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:06.739 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171188+0000", 2024-09-12T22:50:06.739 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:06.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171188+0000", 2024-09-12T22:50:06.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:06.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171189+0000", 2024-09-12T22:50:06.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3200000000000003e-07 2024-09-12T22:50:06.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:06.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171194+0000", 2024-09-12T22:50:06.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2690000000000001e-06 2024-09-12T22:50:06.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:06.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171201+0000", 2024-09-12T22:50:06.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5310000000000004e-06 2024-09-12T22:50:06.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.742 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.742 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171206+0000", 2024-09-12T22:50:06.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7049999999999998e-06 2024-09-12T22:50:06.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.743 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:06.743 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254169+0000", 2024-09-12T22:50:06.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.082962835999999998 2024-09-12T22:50:06.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.743 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:06.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254263+0000", 2024-09-12T22:50:06.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3844999999999993e-05 2024-09-12T22:50:06.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:06.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254398+0000", 2024-09-12T22:50:06.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013560499999999999 2024-09-12T22:50:06.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:06.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265897+0000", 2024-09-12T22:50:06.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01149846 2024-09-12T22:50:06.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:06.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265922+0000", 2024-09-12T22:50:06.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5130000000000002e-05 2024-09-12T22:50:06.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:06.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265954+0000", 2024-09-12T22:50:06.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2512999999999999e-05 2024-09-12T22:50:06.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.748 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:06.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265983+0000", 2024-09-12T22:50:06.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8799999999999999e-05 2024-09-12T22:50:06.748 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.748 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:06.749 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.749 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.749 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1938 3.8 3:17051619:::200.0000000f:head [write 990345~2499 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:06.749 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:50:06.750 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.457150231, 2024-09-12T22:50:06.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.094864730999999994, 2024-09-12T22:50:06.750 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:06.750 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:06.750 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.751 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:06.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:06.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:50:06.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:06.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:50:06.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:06.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:50:06.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:50:06.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:06.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171242+0000", 2024-09-12T22:50:06.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3111e-05 2024-09-12T22:50:06.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:06.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171247+0000", 2024-09-12T22:50:06.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0939999999999998e-06 2024-09-12T22:50:06.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171251+0000", 2024-09-12T22:50:06.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.298e-06 2024-09-12T22:50:06.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:06.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254869+0000", 2024-09-12T22:50:06.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.083618681 2024-09-12T22:50:06.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:06.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254957+0000", 2024-09-12T22:50:06.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7783999999999998e-05 2024-09-12T22:50:06.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:06.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255093+0000", 2024-09-12T22:50:06.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013579600000000001 2024-09-12T22:50:06.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:06.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265997+0000", 2024-09-12T22:50:06.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010903777999999999 2024-09-12T22:50:06.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:06.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266047+0000", 2024-09-12T22:50:06.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0151999999999997e-05 2024-09-12T22:50:06.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:06.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266075+0000", 2024-09-12T22:50:06.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8082e-05 2024-09-12T22:50:06.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:06.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266093+0000", 2024-09-12T22:50:06.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8396000000000001e-05 2024-09-12T22:50:06.762 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.762 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:06.763 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.763 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1944 3.8 3:17051619:::200.0000000f:head [write 1037561~3947 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:06.763 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.186089+0000", 2024-09-12T22:50:06.764 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.4422899810000001, 2024-09-12T22:50:06.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087755745999999996, 2024-09-12T22:50:06.764 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:06.764 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:06.764 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.764 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:06.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:06.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186089+0000", 2024-09-12T22:50:06.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:06.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186089+0000", 2024-09-12T22:50:06.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:06.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186090+0000", 2024-09-12T22:50:06.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1349999999999999e-06 2024-09-12T22:50:06.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:06.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186098+0000", 2024-09-12T22:50:06.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8390000000000007e-06 2024-09-12T22:50:06.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:06.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186106+0000", 2024-09-12T22:50:06.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4619999999999996e-06 2024-09-12T22:50:06.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186111+0000", 2024-09-12T22:50:06.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.057e-06 2024-09-12T22:50:06.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:06.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.264543+0000", 2024-09-12T22:50:06.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078432044000000006 2024-09-12T22:50:06.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:06.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.264617+0000", 2024-09-12T22:50:06.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3789999999999997e-05 2024-09-12T22:50:06.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:06.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.264760+0000", 2024-09-12T22:50:06.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014318499999999999 2024-09-12T22:50:06.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:06.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268441+0000", 2024-09-12T22:50:06.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036809360000000001 2024-09-12T22:50:06.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:06.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273776+0000", 2024-09-12T22:50:06.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053346449999999998 2024-09-12T22:50:06.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:06.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273807+0000", 2024-09-12T22:50:06.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1352000000000001e-05 2024-09-12T22:50:06.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:06.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273845+0000", 2024-09-12T22:50:06.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7301000000000001e-05 2024-09-12T22:50:06.772 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.772 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:06.772 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.773 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1945 3.8 3:17051619:::200.0000000f:head [write 1041508~10144 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:06.773 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:50:06.773 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.4420132090000006, 2024-09-12T22:50:06.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087573128, 2024-09-12T22:50:06.773 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:06.773 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:06.773 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.774 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:06.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:06.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:50:06.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:06.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:50:06.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:06.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:50:06.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1600000000000001e-07 2024-09-12T22:50:06.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:06.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186377+0000", 2024-09-12T22:50:06.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0301e-05 2024-09-12T22:50:06.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:06.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186386+0000", 2024-09-12T22:50:06.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5619999999999993e-06 2024-09-12T22:50:06.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186393+0000", 2024-09-12T22:50:06.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7150000000000001e-06 2024-09-12T22:50:06.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:06.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266725+0000", 2024-09-12T22:50:06.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.080331893000000001 2024-09-12T22:50:06.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:06.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266799+0000", 2024-09-12T22:50:06.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4086999999999997e-05 2024-09-12T22:50:06.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:06.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266904+0000", 2024-09-12T22:50:06.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105475 2024-09-12T22:50:06.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:06.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273882+0000", 2024-09-12T22:50:06.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069773780000000002 2024-09-12T22:50:06.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:06.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273889+0000", 2024-09-12T22:50:06.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1049999999999997e-06 2024-09-12T22:50:06.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:06.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273916+0000", 2024-09-12T22:50:06.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6716e-05 2024-09-12T22:50:06.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:06.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273939+0000", 2024-09-12T22:50:06.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3180000000000002e-05 2024-09-12T22:50:06.784 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.784 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:06.784 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.785 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1946 3.8 3:17051619:::200.0000000f:head [write 1051652~3875 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:06.785 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.186888+0000", 2024-09-12T22:50:06.785 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.4414909300000005, 2024-09-12T22:50:06.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087165134000000005, 2024-09-12T22:50:06.785 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:06.786 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:06.786 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.786 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:06.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:06.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186888+0000", 2024-09-12T22:50:06.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:06.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186888+0000", 2024-09-12T22:50:06.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:06.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186889+0000", 2024-09-12T22:50:06.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2500000000000005e-07 2024-09-12T22:50:06.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:06.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186894+0000", 2024-09-12T22:50:06.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3900000000000001e-06 2024-09-12T22:50:06.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:06.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186901+0000", 2024-09-12T22:50:06.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5649999999999998e-06 2024-09-12T22:50:06.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186906+0000", 2024-09-12T22:50:06.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0390000000000004e-06 2024-09-12T22:50:06.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:06.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.267852+0000", 2024-09-12T22:50:06.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.080946389999999993 2024-09-12T22:50:06.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:06.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.267910+0000", 2024-09-12T22:50:06.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7655999999999998e-05 2024-09-12T22:50:06.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:06.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.267981+0000", 2024-09-12T22:50:06.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0916999999999999e-05 2024-09-12T22:50:06.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:06.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273944+0000", 2024-09-12T22:50:06.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0059635570000000004 2024-09-12T22:50:06.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:06.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273993+0000", 2024-09-12T22:50:06.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8350000000000003e-05 2024-09-12T22:50:06.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:06.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274022+0000", 2024-09-12T22:50:06.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9899999999999998e-05 2024-09-12T22:50:06.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:06.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274053+0000", 2024-09-12T22:50:06.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0645000000000002e-05 2024-09-12T22:50:06.794 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.794 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:06.795 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.795 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1947 3.8 3:17051619:::200.0000000f:head [write 1055527~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:06.795 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.187014+0000", 2024-09-12T22:50:06.795 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.4413646960000008, 2024-09-12T22:50:06.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087114608999999996, 2024-09-12T22:50:06.795 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:06.795 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:06.795 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.795 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:06.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:06.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187014+0000", 2024-09-12T22:50:06.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:06.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187014+0000", 2024-09-12T22:50:06.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:06.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187015+0000", 2024-09-12T22:50:06.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1500000000000004e-07 2024-09-12T22:50:06.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:06.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187018+0000", 2024-09-12T22:50:06.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.033e-06 2024-09-12T22:50:06.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:06.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187023+0000", 2024-09-12T22:50:06.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7550000000000002e-06 2024-09-12T22:50:06.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187026+0000", 2024-09-12T22:50:06.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2710000000000001e-06 2024-09-12T22:50:06.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:06.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268462+0000", 2024-09-12T22:50:06.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.081435699 2024-09-12T22:50:06.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:06.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268507+0000", 2024-09-12T22:50:06.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5643999999999999e-05 2024-09-12T22:50:06.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:06.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268597+0000", 2024-09-12T22:50:06.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0112999999999996e-05 2024-09-12T22:50:06.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:06.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273947+0000", 2024-09-12T22:50:06.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053501859999999998 2024-09-12T22:50:06.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:06.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274083+0000", 2024-09-12T22:50:06.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013525500000000001 2024-09-12T22:50:06.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:06.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274109+0000", 2024-09-12T22:50:06.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6352000000000001e-05 2024-09-12T22:50:06.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:06.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274129+0000", 2024-09-12T22:50:06.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9686000000000001e-05 2024-09-12T22:50:06.802 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.802 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:06.802 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.803 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1948 3.8 3:17051619:::200.0000000f:head [write 1057443~1896 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:06.803 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.189230+0000", 2024-09-12T22:50:06.803 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.4391488839999997, 2024-09-12T22:50:06.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.085028962999999999, 2024-09-12T22:50:06.803 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:06.803 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:06.803 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:06.803 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:06.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:06.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189230+0000", 2024-09-12T22:50:06.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:06.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189230+0000", 2024-09-12T22:50:06.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:06.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:06.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189231+0000", 2024-09-12T22:50:06.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1399999999999996e-07 2024-09-12T22:50:06.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:06.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189235+0000", 2024-09-12T22:50:06.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5970000000000002e-06 2024-09-12T22:50:06.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:06.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189242+0000", 2024-09-12T22:50:06.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8510000000000001e-06 2024-09-12T22:50:06.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:06.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189247+0000", 2024-09-12T22:50:06.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4800000000000003e-06 2024-09-12T22:50:06.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:06.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268908+0000", 2024-09-12T22:50:06.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079660983000000005 2024-09-12T22:50:06.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:06.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268967+0000", 2024-09-12T22:50:06.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9595000000000001e-05 2024-09-12T22:50:06.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:06.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.269040+0000", 2024-09-12T22:50:06.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2643000000000002e-05 2024-09-12T22:50:06.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:06.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273950+0000", 2024-09-12T22:50:06.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049105329999999999 2024-09-12T22:50:06.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:06.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274199+0000", 2024-09-12T22:50:06.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024824999999999999 2024-09-12T22:50:06.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:06.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274226+0000", 2024-09-12T22:50:06.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7602000000000001e-05 2024-09-12T22:50:06.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:06.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:06.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:06.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274259+0000", 2024-09-12T22:50:06.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2614999999999999e-05 2024-09-12T22:50:06.809 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.809 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:06.809 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.809 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:06.809 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:06.809 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:50:06.810 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:50:06.810 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:50:06.812 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:50:06.813 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:06.809+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:06.911 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:06.910+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:06.917 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:50:06.917 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:50:06.917 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:50:06.917 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:50:06.925 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:50:06.955 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:50:06.956 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:50:06.976 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:50:06.977 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:50:06.977 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:50:06.980 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:50:06.980 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:50:07.012 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:07.011+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:07.029 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:07.029 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:07.037 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:50:07.113 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:07.111+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:07.184 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:07.184 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:07.194 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:50:07.239 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:07.237+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:07.314 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:07.313+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:07.316 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:07.317 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:07.330 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:50:07.416 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:07.415+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:07.509 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:07.509 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:07.516 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:07.514+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:07.518 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:50:07.617 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:07.616+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:07.660 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:07.660 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:07.668 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:50:07.707 INFO:teuthology.orchestra.run.smithi066.stderr:nodeep-scrub is unset 2024-09-12T22:50:07.719 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:07.718+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:07.776 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:07.776 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:07.785 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:50:07.820 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:07.818+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:07.921 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:07.919+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:07.930 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:07.930 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:07.939 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:50:08.022 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:08.020+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:08.046 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:08.046 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:08.055 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:50:08.123 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:08.121+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:08.159 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:08.160 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:08.168 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:50:08.252 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:08.250+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:08.325 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:08.324+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:08.340 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:08.341 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:08.353 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:50:08.437 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:08.435+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:08.496 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:08.496 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:08.504 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:50:08.545 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:08.543+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:08.610 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:08.611 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:08.620 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:50:08.663 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:08.662+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:08.727 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:08.728 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:08.730 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:08.729+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:08.737 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:50:08.831 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:08.830+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:08.886 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:08.886 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:08.895 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:50:08.939 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:08.937+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:08.981 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:50:09.001 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:09.002 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:09.011 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:50:09.052 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:09.050+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:09.127 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:50:09.128 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:50:09.133 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:09.131+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:09.146 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:50:09.146 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:50:09.147 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:50:09.150 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:50:09.150 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:50:09.154 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:50:09.154 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:50:09.154 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:50:09.154 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:50:09.154 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:50:09.163 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:50:09.235 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:09.234+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:09.331 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:50:09.331 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:50:09.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:50:09.331 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:50:09.331 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.331 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1923 3.8 3:17051619:::200.0000000f:head [write 935107~4527 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:09.331 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.157731+0000", 2024-09-12T22:50:09.331 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 12.170086548, 2024-09-12T22:50:09.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.085115956000000006, 2024-09-12T22:50:09.332 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:09.332 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:09.332 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.332 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:09.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:09.332 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157731+0000", 2024-09-12T22:50:09.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:09.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157731+0000", 2024-09-12T22:50:09.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.333 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:09.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157732+0000", 2024-09-12T22:50:09.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.99e-07 2024-09-12T22:50:09.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.333 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:09.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157737+0000", 2024-09-12T22:50:09.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6280000000000002e-06 2024-09-12T22:50:09.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.334 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:09.334 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157745+0000", 2024-09-12T22:50:09.334 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1749999999999999e-06 2024-09-12T22:50:09.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.334 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.334 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157749+0000", 2024-09-12T22:50:09.334 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.946e-06 2024-09-12T22:50:09.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.334 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:09.334 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.236865+0000", 2024-09-12T22:50:09.334 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079116687000000005 2024-09-12T22:50:09.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.335 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:09.335 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.236929+0000", 2024-09-12T22:50:09.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3566999999999996e-05 2024-09-12T22:50:09.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.335 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:09.335 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237025+0000", 2024-09-12T22:50:09.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6620000000000007e-05 2024-09-12T22:50:09.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.336 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:09.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240342+0000", 2024-09-12T22:50:09.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033162539999999998 2024-09-12T22:50:09.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.336 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:09.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242737+0000", 2024-09-12T22:50:09.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023957370000000002 2024-09-12T22:50:09.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.336 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:09.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242797+0000", 2024-09-12T22:50:09.337 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9323000000000001e-05 2024-09-12T22:50:09.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.337 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:09.337 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242847+0000", 2024-09-12T22:50:09.337 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0319999999999999e-05 2024-09-12T22:50:09.337 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.337 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:09.337 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.337 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1924 3.8 3:17051619:::200.0000000f:head [write 939634~6106 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:09.337 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.159169+0000", 2024-09-12T22:50:09.337 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 12.168648329, 2024-09-12T22:50:09.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.083843601000000004, 2024-09-12T22:50:09.338 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:09.338 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:09.338 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.338 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:09.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.338 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:09.338 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159169+0000", 2024-09-12T22:50:09.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.338 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:09.338 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159169+0000", 2024-09-12T22:50:09.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.339 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.339 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:09.339 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159171+0000", 2024-09-12T22:50:09.339 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4959999999999999e-06 2024-09-12T22:50:09.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.339 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.339 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:09.339 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159182+0000", 2024-09-12T22:50:09.339 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1104000000000001e-05 2024-09-12T22:50:09.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.339 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.339 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:09.339 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159190+0000", 2024-09-12T22:50:09.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3520000000000007e-06 2024-09-12T22:50:09.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.340 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159196+0000", 2024-09-12T22:50:09.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5690000000000004e-06 2024-09-12T22:50:09.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:09.340 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237476+0000", 2024-09-12T22:50:09.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078280197999999995 2024-09-12T22:50:09.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.341 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:09.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237530+0000", 2024-09-12T22:50:09.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4419000000000002e-05 2024-09-12T22:50:09.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.341 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:09.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237593+0000", 2024-09-12T22:50:09.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2611000000000001e-05 2024-09-12T22:50:09.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.341 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:09.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242030+0000", 2024-09-12T22:50:09.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044367369999999996 2024-09-12T22:50:09.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.342 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:09.342 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242893+0000", 2024-09-12T22:50:09.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00086367400000000004 2024-09-12T22:50:09.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.342 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:09.342 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242956+0000", 2024-09-12T22:50:09.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2885999999999994e-05 2024-09-12T22:50:09.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.343 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:09.343 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243013+0000", 2024-09-12T22:50:09.343 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6555000000000003e-05 2024-09-12T22:50:09.343 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.343 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:09.343 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.343 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.343 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.343 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1925 3.8 3:17051619:::200.0000000f:head [write 945740~9955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:09.343 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.160395+0000", 2024-09-12T22:50:09.343 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 12.16742312, 2024-09-12T22:50:09.343 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.091200247999999998, 2024-09-12T22:50:09.343 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:09.344 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:09.344 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.344 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:09.344 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.344 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:09.344 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160395+0000", 2024-09-12T22:50:09.344 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.344 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.344 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.344 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:09.344 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160395+0000", 2024-09-12T22:50:09.344 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.344 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.345 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.345 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:09.345 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160396+0000", 2024-09-12T22:50:09.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1599999999999999e-06 2024-09-12T22:50:09.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.345 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.345 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:09.345 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160415+0000", 2024-09-12T22:50:09.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9680000000000001e-05 2024-09-12T22:50:09.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.345 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.345 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:09.345 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160428+0000", 2024-09-12T22:50:09.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2792999999999999e-05 2024-09-12T22:50:09.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.346 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.346 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160436+0000", 2024-09-12T22:50:09.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0399999999999993e-06 2024-09-12T22:50:09.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.346 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:09.346 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.238408+0000", 2024-09-12T22:50:09.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077971602000000001 2024-09-12T22:50:09.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.347 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:09.347 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.238504+0000", 2024-09-12T22:50:09.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6714999999999998e-05 2024-09-12T22:50:09.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.347 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.347 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:09.347 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.238687+0000", 2024-09-12T22:50:09.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000182795 2024-09-12T22:50:09.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.347 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.347 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:09.347 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242036+0000", 2024-09-12T22:50:09.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003348887 2024-09-12T22:50:09.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.348 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:09.348 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251510+0000", 2024-09-12T22:50:09.348 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094733679999999994 2024-09-12T22:50:09.348 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.348 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:09.348 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251543+0000", 2024-09-12T22:50:09.348 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2974e-05 2024-09-12T22:50:09.348 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.348 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:09.349 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251595+0000", 2024-09-12T22:50:09.349 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2234000000000002e-05 2024-09-12T22:50:09.349 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.349 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:09.349 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.349 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.349 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.349 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1926 3.8 3:17051619:::200.0000000f:head [write 955695~5281 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:09.349 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.160849+0000", 2024-09-12T22:50:09.349 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 12.166968166, 2024-09-12T22:50:09.349 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.094772633999999994, 2024-09-12T22:50:09.349 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:09.349 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:09.349 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.350 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:09.350 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.350 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:09.350 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160849+0000", 2024-09-12T22:50:09.350 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.350 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.350 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.350 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:09.350 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160849+0000", 2024-09-12T22:50:09.350 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.350 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.350 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.350 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:09.351 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160850+0000", 2024-09-12T22:50:09.351 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6700000000000002e-07 2024-09-12T22:50:09.351 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.351 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.351 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:09.351 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160858+0000", 2024-09-12T22:50:09.351 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5630000000000003e-06 2024-09-12T22:50:09.351 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.351 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.351 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:09.351 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160866+0000", 2024-09-12T22:50:09.351 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7570000000000004e-06 2024-09-12T22:50:09.351 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.351 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.352 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.352 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160870+0000", 2024-09-12T22:50:09.352 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5929999999999999e-06 2024-09-12T22:50:09.352 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.352 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.352 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:09.352 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.239705+0000", 2024-09-12T22:50:09.352 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078834491000000007 2024-09-12T22:50:09.352 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.352 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.352 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:09.352 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.239764+0000", 2024-09-12T22:50:09.353 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9190000000000001e-05 2024-09-12T22:50:09.353 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.353 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.353 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:09.353 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.239851+0000", 2024-09-12T22:50:09.353 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7472999999999994e-05 2024-09-12T22:50:09.353 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.353 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.353 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:09.353 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254001+0000", 2024-09-12T22:50:09.353 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014149622000000001 2024-09-12T22:50:09.353 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.353 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.353 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:09.354 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255525+0000", 2024-09-12T22:50:09.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0015236500000000001 2024-09-12T22:50:09.354 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.354 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:09.354 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255567+0000", 2024-09-12T22:50:09.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2150999999999997e-05 2024-09-12T22:50:09.354 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.354 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:09.354 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255622+0000", 2024-09-12T22:50:09.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5276999999999999e-05 2024-09-12T22:50:09.354 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.355 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:09.355 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.355 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.355 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.355 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1927 3.8 3:17051619:::200.0000000f:head [write 960976~5828 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:09.355 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.164361+0000", 2024-09-12T22:50:09.355 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 12.163456469, 2024-09-12T22:50:09.355 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.091388523999999999, 2024-09-12T22:50:09.355 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:09.355 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:09.355 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.355 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:09.355 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.355 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:09.356 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164361+0000", 2024-09-12T22:50:09.356 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.356 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.356 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.356 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:09.356 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164361+0000", 2024-09-12T22:50:09.356 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.356 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.356 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.356 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:09.356 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164363+0000", 2024-09-12T22:50:09.356 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.389e-06 2024-09-12T22:50:09.356 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:09.357 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164370+0000", 2024-09-12T22:50:09.357 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.99e-06 2024-09-12T22:50:09.357 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:09.357 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164379+0000", 2024-09-12T22:50:09.357 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9499999999999996e-06 2024-09-12T22:50:09.357 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.357 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164385+0000", 2024-09-12T22:50:09.358 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5879999999999997e-06 2024-09-12T22:50:09.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.358 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.358 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:09.358 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240385+0000", 2024-09-12T22:50:09.358 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075999995000000001 2024-09-12T22:50:09.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.358 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.358 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:09.358 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240533+0000", 2024-09-12T22:50:09.358 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014811699999999999 2024-09-12T22:50:09.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.358 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.359 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:09.359 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240886+0000", 2024-09-12T22:50:09.359 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000352517 2024-09-12T22:50:09.359 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.359 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.359 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:09.359 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254024+0000", 2024-09-12T22:50:09.359 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013138047999999999 2024-09-12T22:50:09.359 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.359 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.359 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:09.359 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255629+0000", 2024-09-12T22:50:09.359 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001604949 2024-09-12T22:50:09.359 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.360 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.360 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:09.360 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255683+0000", 2024-09-12T22:50:09.360 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4035e-05 2024-09-12T22:50:09.360 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.360 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.360 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:09.360 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255750+0000", 2024-09-12T22:50:09.360 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6946000000000006e-05 2024-09-12T22:50:09.360 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.360 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:09.361 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.361 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.361 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1928 3.8 3:17051619:::200.0000000f:head [write 966804~6536 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:09.361 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167179+0000", 2024-09-12T22:50:09.361 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 12.160638670999999, 2024-09-12T22:50:09.361 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.089785880999999998, 2024-09-12T22:50:09.361 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:09.361 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:09.361 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.361 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:09.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.362 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:09.362 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167179+0000", 2024-09-12T22:50:09.362 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.362 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.362 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.362 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:09.362 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167179+0000", 2024-09-12T22:50:09.362 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.362 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.362 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.362 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:09.362 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167180+0000", 2024-09-12T22:50:09.362 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2869999999999999e-06 2024-09-12T22:50:09.363 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.363 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.363 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:09.363 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167192+0000", 2024-09-12T22:50:09.363 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.187e-05 2024-09-12T22:50:09.363 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.363 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.363 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:09.363 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167203+0000", 2024-09-12T22:50:09.363 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1076e-05 2024-09-12T22:50:09.363 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.363 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.363 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.364 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167210+0000", 2024-09-12T22:50:09.364 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1799999999999999e-06 2024-09-12T22:50:09.364 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.364 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.364 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:09.364 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.241518+0000", 2024-09-12T22:50:09.364 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074307845999999997 2024-09-12T22:50:09.364 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.364 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.364 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:09.364 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.241563+0000", 2024-09-12T22:50:09.364 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5138e-05 2024-09-12T22:50:09.365 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.365 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.365 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:09.365 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.241641+0000", 2024-09-12T22:50:09.365 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8016000000000007e-05 2024-09-12T22:50:09.365 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.365 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.365 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:09.365 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254041+0000", 2024-09-12T22:50:09.365 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012399666 2024-09-12T22:50:09.365 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.365 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.365 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:09.366 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.256880+0000", 2024-09-12T22:50:09.366 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0028390580000000002 2024-09-12T22:50:09.366 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.366 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.366 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:09.366 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.256918+0000", 2024-09-12T22:50:09.366 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7552999999999998e-05 2024-09-12T22:50:09.366 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.366 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.366 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:09.366 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.256965+0000", 2024-09-12T22:50:09.366 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7191000000000003e-05 2024-09-12T22:50:09.366 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.367 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:09.367 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.367 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.367 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.367 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1929 3.8 3:17051619:::200.0000000f:head [write 973340~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:09.367 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167521+0000", 2024-09-12T22:50:09.367 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 12.160296508, 2024-09-12T22:50:09.367 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.093206336000000001, 2024-09-12T22:50:09.367 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:09.367 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:09.367 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.367 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:09.367 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.368 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:09.368 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167521+0000", 2024-09-12T22:50:09.368 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.368 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.368 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.368 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:09.368 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167521+0000", 2024-09-12T22:50:09.368 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.368 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.368 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.368 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:09.368 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167522+0000", 2024-09-12T22:50:09.368 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8899999999999998e-07 2024-09-12T22:50:09.369 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.369 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.369 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:09.369 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167526+0000", 2024-09-12T22:50:09.369 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4490000000000001e-06 2024-09-12T22:50:09.369 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.369 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.369 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:09.369 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167544+0000", 2024-09-12T22:50:09.369 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7220000000000001e-05 2024-09-12T22:50:09.369 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.369 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.369 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.370 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167551+0000", 2024-09-12T22:50:09.370 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.046e-06 2024-09-12T22:50:09.370 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.370 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.370 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:09.370 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242079+0000", 2024-09-12T22:50:09.370 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074528436000000003 2024-09-12T22:50:09.370 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.370 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.370 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:09.370 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242167+0000", 2024-09-12T22:50:09.370 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7670000000000006e-05 2024-09-12T22:50:09.370 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.370 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.371 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:09.371 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242306+0000", 2024-09-12T22:50:09.371 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000138703 2024-09-12T22:50:09.371 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.371 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.371 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:09.371 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254058+0000", 2024-09-12T22:50:09.371 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011752395000000001 2024-09-12T22:50:09.371 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.371 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.371 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:09.371 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260654+0000", 2024-09-12T22:50:09.371 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0065964700000000001 2024-09-12T22:50:09.372 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.372 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.372 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:09.372 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260699+0000", 2024-09-12T22:50:09.372 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5095000000000001e-05 2024-09-12T22:50:09.372 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.372 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.372 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:09.372 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260727+0000", 2024-09-12T22:50:09.372 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7963e-05 2024-09-12T22:50:09.372 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.372 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:09.372 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.373 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.373 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.373 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1931 3.8 3:17051619:::200.0000000f:head [write 974738~2728 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:09.373 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167657+0000", 2024-09-12T22:50:09.373 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 12.160160503, 2024-09-12T22:50:09.373 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.093133758999999997, 2024-09-12T22:50:09.373 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:09.373 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:09.373 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.373 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:09.373 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.373 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:09.373 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167657+0000", 2024-09-12T22:50:09.374 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.374 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.374 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.374 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:09.374 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167657+0000", 2024-09-12T22:50:09.374 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.374 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.374 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.374 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:09.374 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167658+0000", 2024-09-12T22:50:09.374 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2200000000000003e-07 2024-09-12T22:50:09.374 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.374 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.374 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:09.375 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167662+0000", 2024-09-12T22:50:09.375 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1489999999999996e-06 2024-09-12T22:50:09.375 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.375 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.375 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:09.375 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167673+0000", 2024-09-12T22:50:09.375 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0614e-05 2024-09-12T22:50:09.375 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.375 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.375 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.375 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167679+0000", 2024-09-12T22:50:09.375 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1500000000000004e-06 2024-09-12T22:50:09.376 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.376 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.376 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:09.376 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243054+0000", 2024-09-12T22:50:09.376 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075375027999999997 2024-09-12T22:50:09.376 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.376 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.376 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:09.376 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243134+0000", 2024-09-12T22:50:09.376 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0210000000000006e-05 2024-09-12T22:50:09.376 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.376 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.376 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:09.377 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243263+0000", 2024-09-12T22:50:09.377 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012919 2024-09-12T22:50:09.377 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.377 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.377 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:09.377 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254075+0000", 2024-09-12T22:50:09.377 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010811523 2024-09-12T22:50:09.377 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.377 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.377 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:09.377 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260733+0000", 2024-09-12T22:50:09.377 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.006658153 2024-09-12T22:50:09.377 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.378 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.378 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:09.378 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260756+0000", 2024-09-12T22:50:09.378 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2696000000000001e-05 2024-09-12T22:50:09.378 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.378 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.378 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:09.378 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260791+0000", 2024-09-12T22:50:09.378 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5324000000000003e-05 2024-09-12T22:50:09.378 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.378 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:09.378 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.378 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.379 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.379 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1932 3.8 3:17051619:::200.0000000f:head [write 977466~2771 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:09.379 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:50:09.379 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 12.159870821, 2024-09-12T22:50:09.379 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.092944115999999993, 2024-09-12T22:50:09.379 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:09.379 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:09.379 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.379 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:09.379 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.379 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:09.379 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:50:09.379 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.380 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.380 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.380 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:09.380 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:50:09.380 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.380 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.380 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.380 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:09.380 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:50:09.380 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8400000000000004e-07 2024-09-12T22:50:09.380 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.380 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.381 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:09.381 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167952+0000", 2024-09-12T22:50:09.381 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.138e-06 2024-09-12T22:50:09.381 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.381 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.381 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:09.381 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167961+0000", 2024-09-12T22:50:09.381 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7990000000000005e-06 2024-09-12T22:50:09.381 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.381 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.381 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.382 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167968+0000", 2024-09-12T22:50:09.382 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4400000000000002e-06 2024-09-12T22:50:09.382 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.382 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.382 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:09.382 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.244002+0000", 2024-09-12T22:50:09.382 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.076034300999999999 2024-09-12T22:50:09.382 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.382 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.382 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:09.382 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.244061+0000", 2024-09-12T22:50:09.382 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8356999999999997e-05 2024-09-12T22:50:09.382 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.383 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.383 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:09.383 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.244161+0000", 2024-09-12T22:50:09.383 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000100126 2024-09-12T22:50:09.383 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.383 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.383 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:09.383 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254099+0000", 2024-09-12T22:50:09.383 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0099384940000000008 2024-09-12T22:50:09.383 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.383 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.384 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:09.384 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260799+0000", 2024-09-12T22:50:09.384 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0066995029999999999 2024-09-12T22:50:09.384 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.384 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.384 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:09.384 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260851+0000", 2024-09-12T22:50:09.385 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1861999999999999e-05 2024-09-12T22:50:09.385 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.385 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.385 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:09.385 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260891+0000", 2024-09-12T22:50:09.385 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0411999999999999e-05 2024-09-12T22:50:09.385 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.385 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:09.385 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.385 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.385 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.385 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1933 3.8 3:17051619:::200.0000000f:head [write 980237~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:09.385 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167993+0000", 2024-09-12T22:50:09.386 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 12.159824318, 2024-09-12T22:50:09.386 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.092952307999999997, 2024-09-12T22:50:09.386 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:09.386 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:09.386 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.386 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:09.386 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.386 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:09.386 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167993+0000", 2024-09-12T22:50:09.386 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.386 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.386 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.386 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:09.387 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167993+0000", 2024-09-12T22:50:09.387 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.387 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.387 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.387 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:09.387 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167994+0000", 2024-09-12T22:50:09.387 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5000000000000003e-07 2024-09-12T22:50:09.387 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.387 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.387 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:09.387 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167997+0000", 2024-09-12T22:50:09.387 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5559999999999999e-06 2024-09-12T22:50:09.387 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.387 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.388 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:09.388 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168005+0000", 2024-09-12T22:50:09.388 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.588e-06 2024-09-12T22:50:09.388 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.388 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.388 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.388 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168011+0000", 2024-09-12T22:50:09.388 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7780000000000004e-06 2024-09-12T22:50:09.388 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.388 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.388 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:09.388 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.247983+0000", 2024-09-12T22:50:09.388 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079972090999999995 2024-09-12T22:50:09.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:09.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248038+0000", 2024-09-12T22:50:09.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4889999999999998e-05 2024-09-12T22:50:09.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:09.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248136+0000", 2024-09-12T22:50:09.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8271999999999997e-05 2024-09-12T22:50:09.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:09.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254134+0000", 2024-09-12T22:50:09.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005997751 2024-09-12T22:50:09.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:09.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260898+0000", 2024-09-12T22:50:09.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0067646429999999999 2024-09-12T22:50:09.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:09.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260923+0000", 2024-09-12T22:50:09.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4080999999999999e-05 2024-09-12T22:50:09.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.391 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.391 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:09.391 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260946+0000", 2024-09-12T22:50:09.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3108e-05 2024-09-12T22:50:09.391 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.391 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:09.391 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.391 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.391 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1934 3.8 3:17051619:::200.0000000f:head [write 982156~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:09.391 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:50:09.391 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 12.159798832, 2024-09-12T22:50:09.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.093517738000000003, 2024-09-12T22:50:09.392 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:09.392 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:09.392 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.392 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:09.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:09.392 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:50:09.392 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:09.392 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:50:09.393 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.393 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:09.393 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:50:09.393 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6800000000000001e-07 2024-09-12T22:50:09.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.393 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:09.393 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168029+0000", 2024-09-12T22:50:09.393 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9699999999999994e-06 2024-09-12T22:50:09.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.394 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:09.394 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168036+0000", 2024-09-12T22:50:09.394 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9800000000000001e-06 2024-09-12T22:50:09.394 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.394 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.394 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.394 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168041+0000", 2024-09-12T22:50:09.395 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0629999999999996e-06 2024-09-12T22:50:09.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.396 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:09.396 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248449+0000", 2024-09-12T22:50:09.396 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.080407948000000007 2024-09-12T22:50:09.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.397 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:09.397 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248491+0000", 2024-09-12T22:50:09.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2027999999999998e-05 2024-09-12T22:50:09.397 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.397 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.397 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:09.397 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248569+0000", 2024-09-12T22:50:09.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8077000000000005e-05 2024-09-12T22:50:09.397 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.397 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.397 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:09.397 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260950+0000", 2024-09-12T22:50:09.398 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012380901 2024-09-12T22:50:09.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:09.398 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.261473+0000", 2024-09-12T22:50:09.398 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00052241699999999996 2024-09-12T22:50:09.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:09.398 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.261507+0000", 2024-09-12T22:50:09.398 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4616000000000002e-05 2024-09-12T22:50:09.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.399 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:09.399 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.261537+0000", 2024-09-12T22:50:09.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9369999999999998e-05 2024-09-12T22:50:09.399 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.399 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:09.399 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.399 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1935 3.8 3:17051619:::200.0000000f:head [write 984074~1914 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:09.399 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:50:09.399 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 12.15976891, 2024-09-12T22:50:09.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.097660714999999995, 2024-09-12T22:50:09.400 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:09.400 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:09.400 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.400 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:09.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:09.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:50:09.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:09.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:50:09.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.401 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:09.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:50:09.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4400000000000001e-07 2024-09-12T22:50:09.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.401 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:09.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168052+0000", 2024-09-12T22:50:09.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.886e-06 2024-09-12T22:50:09.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.402 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:09.402 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168059+0000", 2024-09-12T22:50:09.402 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0489999999999998e-06 2024-09-12T22:50:09.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.402 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.402 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.402 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168081+0000", 2024-09-12T22:50:09.402 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1800000000000001e-05 2024-09-12T22:50:09.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.402 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.402 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:09.402 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.250512+0000", 2024-09-12T22:50:09.402 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.082431322000000001 2024-09-12T22:50:09.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.403 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.403 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:09.403 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.250621+0000", 2024-09-12T22:50:09.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010908600000000001 2024-09-12T22:50:09.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.403 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.403 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:09.403 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.250970+0000", 2024-09-12T22:50:09.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034828399999999997 2024-09-12T22:50:09.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.403 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.403 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:09.403 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265532+0000", 2024-09-12T22:50:09.404 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01456268 2024-09-12T22:50:09.404 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.404 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.404 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:09.404 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265614+0000", 2024-09-12T22:50:09.404 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1796000000000001e-05 2024-09-12T22:50:09.404 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.404 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.404 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:09.404 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265673+0000", 2024-09-12T22:50:09.404 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9314000000000002e-05 2024-09-12T22:50:09.404 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.404 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.404 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:09.405 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265709+0000", 2024-09-12T22:50:09.405 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6053999999999997e-05 2024-09-12T22:50:09.405 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.405 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:09.405 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.405 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1936 3.8 3:17051619:::200.0000000f:head [write 985988~2437 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:09.405 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.168095+0000", 2024-09-12T22:50:09.405 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 12.159722563000001, 2024-09-12T22:50:09.405 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.097789345999999999, 2024-09-12T22:50:09.405 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:09.405 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:09.406 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.406 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:09.406 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.406 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:09.406 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168095+0000", 2024-09-12T22:50:09.406 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.406 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.406 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.406 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:09.406 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168095+0000", 2024-09-12T22:50:09.406 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.406 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.406 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.406 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:09.407 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168096+0000", 2024-09-12T22:50:09.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7700000000000005e-07 2024-09-12T22:50:09.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.407 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:09.407 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168099+0000", 2024-09-12T22:50:09.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.422e-06 2024-09-12T22:50:09.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.407 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:09.407 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168106+0000", 2024-09-12T22:50:09.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6889999999999998e-06 2024-09-12T22:50:09.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168110+0000", 2024-09-12T22:50:09.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8470000000000003e-06 2024-09-12T22:50:09.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:09.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251622+0000", 2024-09-12T22:50:09.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.083511539999999995 2024-09-12T22:50:09.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:09.409 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251674+0000", 2024-09-12T22:50:09.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1678999999999998e-05 2024-09-12T22:50:09.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.409 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:09.409 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251744+0000", 2024-09-12T22:50:09.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0440999999999999e-05 2024-09-12T22:50:09.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.409 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:09.409 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265545+0000", 2024-09-12T22:50:09.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013801000000000001 2024-09-12T22:50:09.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.410 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:09.410 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265771+0000", 2024-09-12T22:50:09.410 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000225632 2024-09-12T22:50:09.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.410 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:09.410 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265835+0000", 2024-09-12T22:50:09.410 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4541000000000004e-05 2024-09-12T22:50:09.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.411 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:09.411 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265884+0000", 2024-09-12T22:50:09.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9078e-05 2024-09-12T22:50:09.411 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.411 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:09.411 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.411 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1937 3.8 3:17051619:::200.0000000f:head [write 988425~1920 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:09.411 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.171188+0000", 2024-09-12T22:50:09.411 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 12.156629192, 2024-09-12T22:50:09.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.094794626000000007, 2024-09-12T22:50:09.412 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:09.412 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:09.412 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.412 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:09.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:09.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171188+0000", 2024-09-12T22:50:09.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:09.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171188+0000", 2024-09-12T22:50:09.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.414 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:09.414 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171189+0000", 2024-09-12T22:50:09.414 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3200000000000003e-07 2024-09-12T22:50:09.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.414 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.414 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:09.414 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171194+0000", 2024-09-12T22:50:09.414 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2690000000000001e-06 2024-09-12T22:50:09.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.414 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.414 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:09.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171201+0000", 2024-09-12T22:50:09.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5310000000000004e-06 2024-09-12T22:50:09.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171206+0000", 2024-09-12T22:50:09.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7049999999999998e-06 2024-09-12T22:50:09.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:09.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254169+0000", 2024-09-12T22:50:09.416 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.082962835999999998 2024-09-12T22:50:09.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.416 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.416 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:09.416 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254263+0000", 2024-09-12T22:50:09.416 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3844999999999993e-05 2024-09-12T22:50:09.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.416 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.416 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:09.416 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254398+0000", 2024-09-12T22:50:09.416 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013560499999999999 2024-09-12T22:50:09.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.416 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.417 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:09.417 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265897+0000", 2024-09-12T22:50:09.417 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01149846 2024-09-12T22:50:09.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.417 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:09.417 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265922+0000", 2024-09-12T22:50:09.417 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5130000000000002e-05 2024-09-12T22:50:09.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.417 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:09.417 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265954+0000", 2024-09-12T22:50:09.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2512999999999999e-05 2024-09-12T22:50:09.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.418 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:09.418 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265983+0000", 2024-09-12T22:50:09.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8799999999999999e-05 2024-09-12T22:50:09.418 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.418 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:09.418 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.419 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1938 3.8 3:17051619:::200.0000000f:head [write 990345~2499 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:09.419 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:50:09.419 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 12.156589013, 2024-09-12T22:50:09.419 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.094864730999999994, 2024-09-12T22:50:09.419 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:09.419 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:09.419 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.419 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:09.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:09.419 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:50:09.419 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.420 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:09.420 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:50:09.420 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.420 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:09.420 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:50:09.420 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:50:09.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.420 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:09.421 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171242+0000", 2024-09-12T22:50:09.421 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3111e-05 2024-09-12T22:50:09.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.421 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.421 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:09.421 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171247+0000", 2024-09-12T22:50:09.421 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0939999999999998e-06 2024-09-12T22:50:09.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.421 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.421 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.421 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171251+0000", 2024-09-12T22:50:09.421 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.298e-06 2024-09-12T22:50:09.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.422 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.422 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:09.422 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254869+0000", 2024-09-12T22:50:09.422 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.083618681 2024-09-12T22:50:09.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.422 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.422 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:09.422 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254957+0000", 2024-09-12T22:50:09.422 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7783999999999998e-05 2024-09-12T22:50:09.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.422 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.422 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:09.423 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255093+0000", 2024-09-12T22:50:09.423 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013579600000000001 2024-09-12T22:50:09.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.423 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:09.423 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265997+0000", 2024-09-12T22:50:09.423 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010903777999999999 2024-09-12T22:50:09.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.423 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:09.423 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266047+0000", 2024-09-12T22:50:09.423 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0151999999999997e-05 2024-09-12T22:50:09.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.424 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:09.424 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266075+0000", 2024-09-12T22:50:09.424 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8082e-05 2024-09-12T22:50:09.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.424 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:09.424 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266093+0000", 2024-09-12T22:50:09.424 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8396000000000001e-05 2024-09-12T22:50:09.424 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.424 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:09.424 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.425 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.425 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1944 3.8 3:17051619:::200.0000000f:head [write 1037561~3947 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:09.425 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.186089+0000", 2024-09-12T22:50:09.425 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 12.141728763, 2024-09-12T22:50:09.425 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087755745999999996, 2024-09-12T22:50:09.425 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:09.425 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:09.425 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.425 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:09.426 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.426 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:09.426 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186089+0000", 2024-09-12T22:50:09.426 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.426 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.426 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:09.426 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186089+0000", 2024-09-12T22:50:09.426 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.426 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.426 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:09.426 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186090+0000", 2024-09-12T22:50:09.427 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1349999999999999e-06 2024-09-12T22:50:09.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.427 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.427 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:09.427 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186098+0000", 2024-09-12T22:50:09.427 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8390000000000007e-06 2024-09-12T22:50:09.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.427 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.427 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:09.427 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186106+0000", 2024-09-12T22:50:09.427 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4619999999999996e-06 2024-09-12T22:50:09.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.427 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.427 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.428 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186111+0000", 2024-09-12T22:50:09.428 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.057e-06 2024-09-12T22:50:09.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.428 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.428 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:09.428 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.264543+0000", 2024-09-12T22:50:09.428 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078432044000000006 2024-09-12T22:50:09.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.428 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.428 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:09.428 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.264617+0000", 2024-09-12T22:50:09.428 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3789999999999997e-05 2024-09-12T22:50:09.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.429 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.429 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:09.429 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.264760+0000", 2024-09-12T22:50:09.429 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014318499999999999 2024-09-12T22:50:09.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.429 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.429 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:09.429 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268441+0000", 2024-09-12T22:50:09.429 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036809360000000001 2024-09-12T22:50:09.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.429 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.429 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:09.429 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273776+0000", 2024-09-12T22:50:09.430 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053346449999999998 2024-09-12T22:50:09.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.430 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.430 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:09.430 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273807+0000", 2024-09-12T22:50:09.430 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1352000000000001e-05 2024-09-12T22:50:09.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.430 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.430 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:09.430 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273845+0000", 2024-09-12T22:50:09.430 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7301000000000001e-05 2024-09-12T22:50:09.430 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.431 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:09.431 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.431 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.431 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1945 3.8 3:17051619:::200.0000000f:head [write 1041508~10144 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:09.431 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:50:09.431 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 12.141451991, 2024-09-12T22:50:09.431 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087573128, 2024-09-12T22:50:09.431 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:09.431 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:09.431 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.431 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:09.431 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.431 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:09.432 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:50:09.432 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.432 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.432 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.432 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:09.432 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:50:09.432 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.432 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.432 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.432 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:09.432 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:50:09.432 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1600000000000001e-07 2024-09-12T22:50:09.432 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.433 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.433 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:09.433 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186377+0000", 2024-09-12T22:50:09.433 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0301e-05 2024-09-12T22:50:09.433 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.433 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.433 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:09.433 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186386+0000", 2024-09-12T22:50:09.433 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5619999999999993e-06 2024-09-12T22:50:09.433 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.433 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.434 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.434 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186393+0000", 2024-09-12T22:50:09.434 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7150000000000001e-06 2024-09-12T22:50:09.434 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.434 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.434 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:09.434 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266725+0000", 2024-09-12T22:50:09.434 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.080331893000000001 2024-09-12T22:50:09.434 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.434 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.434 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:09.434 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266799+0000", 2024-09-12T22:50:09.434 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4086999999999997e-05 2024-09-12T22:50:09.434 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.435 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.435 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:09.435 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266904+0000", 2024-09-12T22:50:09.435 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105475 2024-09-12T22:50:09.435 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.435 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.435 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:09.435 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273882+0000", 2024-09-12T22:50:09.435 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069773780000000002 2024-09-12T22:50:09.435 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.435 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.435 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:09.435 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273889+0000", 2024-09-12T22:50:09.435 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1049999999999997e-06 2024-09-12T22:50:09.436 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.436 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.436 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:09.436 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273916+0000", 2024-09-12T22:50:09.436 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6716e-05 2024-09-12T22:50:09.436 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.436 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.436 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:09.436 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273939+0000", 2024-09-12T22:50:09.436 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3180000000000002e-05 2024-09-12T22:50:09.436 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.436 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:09.436 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.437 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.437 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.437 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1946 3.8 3:17051619:::200.0000000f:head [write 1051652~3875 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:09.437 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.186888+0000", 2024-09-12T22:50:09.437 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 12.140929712, 2024-09-12T22:50:09.437 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087165134000000005, 2024-09-12T22:50:09.437 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:09.437 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:09.437 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.437 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:09.437 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.438 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:09.438 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186888+0000", 2024-09-12T22:50:09.438 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.438 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.438 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.438 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:09.438 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186888+0000", 2024-09-12T22:50:09.438 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.438 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.438 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.438 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:09.438 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186889+0000", 2024-09-12T22:50:09.438 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2500000000000005e-07 2024-09-12T22:50:09.439 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.439 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.439 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:09.439 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186894+0000", 2024-09-12T22:50:09.439 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3900000000000001e-06 2024-09-12T22:50:09.439 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.439 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.439 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:09.439 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186901+0000", 2024-09-12T22:50:09.439 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5649999999999998e-06 2024-09-12T22:50:09.439 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.439 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.439 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.440 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186906+0000", 2024-09-12T22:50:09.440 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0390000000000004e-06 2024-09-12T22:50:09.440 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.440 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.440 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:09.440 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.267852+0000", 2024-09-12T22:50:09.440 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.080946389999999993 2024-09-12T22:50:09.440 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.440 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.440 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:09.440 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.267910+0000", 2024-09-12T22:50:09.440 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7655999999999998e-05 2024-09-12T22:50:09.440 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.441 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.441 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:09.441 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.267981+0000", 2024-09-12T22:50:09.441 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0916999999999999e-05 2024-09-12T22:50:09.441 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.441 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.441 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:09.441 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273944+0000", 2024-09-12T22:50:09.441 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0059635570000000004 2024-09-12T22:50:09.441 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.441 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.441 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:09.441 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273993+0000", 2024-09-12T22:50:09.442 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8350000000000003e-05 2024-09-12T22:50:09.442 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.442 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.442 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:09.442 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274022+0000", 2024-09-12T22:50:09.442 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9899999999999998e-05 2024-09-12T22:50:09.442 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.442 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.442 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:09.442 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274053+0000", 2024-09-12T22:50:09.442 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0645000000000002e-05 2024-09-12T22:50:09.442 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.442 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:09.443 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.443 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.443 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.443 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1947 3.8 3:17051619:::200.0000000f:head [write 1055527~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:09.443 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.187014+0000", 2024-09-12T22:50:09.443 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 12.140803478, 2024-09-12T22:50:09.443 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087114608999999996, 2024-09-12T22:50:09.443 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:09.443 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:09.443 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.443 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:09.443 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.443 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:09.444 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187014+0000", 2024-09-12T22:50:09.444 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.444 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.444 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.444 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:09.444 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187014+0000", 2024-09-12T22:50:09.444 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.444 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.444 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.444 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:09.444 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187015+0000", 2024-09-12T22:50:09.444 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1500000000000004e-07 2024-09-12T22:50:09.444 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.445 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.445 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:09.445 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187018+0000", 2024-09-12T22:50:09.445 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.033e-06 2024-09-12T22:50:09.445 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.445 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.445 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:09.445 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187023+0000", 2024-09-12T22:50:09.445 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7550000000000002e-06 2024-09-12T22:50:09.445 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.445 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.445 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.446 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187026+0000", 2024-09-12T22:50:09.446 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2710000000000001e-06 2024-09-12T22:50:09.446 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.446 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.446 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:09.446 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268462+0000", 2024-09-12T22:50:09.446 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.081435699 2024-09-12T22:50:09.446 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.446 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.446 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:09.446 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268507+0000", 2024-09-12T22:50:09.446 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5643999999999999e-05 2024-09-12T22:50:09.446 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.446 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.447 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:09.447 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268597+0000", 2024-09-12T22:50:09.447 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0112999999999996e-05 2024-09-12T22:50:09.447 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.447 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.447 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:09.447 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273947+0000", 2024-09-12T22:50:09.447 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053501859999999998 2024-09-12T22:50:09.447 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.447 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.447 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:09.447 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274083+0000", 2024-09-12T22:50:09.447 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013525500000000001 2024-09-12T22:50:09.448 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.448 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.448 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:09.448 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274109+0000", 2024-09-12T22:50:09.448 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6352000000000001e-05 2024-09-12T22:50:09.448 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.448 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.448 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:09.448 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274129+0000", 2024-09-12T22:50:09.448 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9686000000000001e-05 2024-09-12T22:50:09.448 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.448 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:09.448 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.449 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.449 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.449 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1948 3.8 3:17051619:::200.0000000f:head [write 1057443~1896 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:09.449 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.189230+0000", 2024-09-12T22:50:09.449 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 12.138587665999999, 2024-09-12T22:50:09.449 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.085028962999999999, 2024-09-12T22:50:09.449 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:09.449 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:09.449 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.449 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:09.450 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.450 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:09.450 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189230+0000", 2024-09-12T22:50:09.450 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.450 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.450 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.450 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:09.450 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189230+0000", 2024-09-12T22:50:09.450 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:09.450 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.450 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.450 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:09.450 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189231+0000", 2024-09-12T22:50:09.450 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1399999999999996e-07 2024-09-12T22:50:09.451 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.451 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.451 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:09.451 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189235+0000", 2024-09-12T22:50:09.451 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5970000000000002e-06 2024-09-12T22:50:09.451 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.451 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.451 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:09.451 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189242+0000", 2024-09-12T22:50:09.451 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8510000000000001e-06 2024-09-12T22:50:09.451 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.451 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.451 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.452 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189247+0000", 2024-09-12T22:50:09.452 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4800000000000003e-06 2024-09-12T22:50:09.452 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.452 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.452 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:09.452 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268908+0000", 2024-09-12T22:50:09.452 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079660983000000005 2024-09-12T22:50:09.452 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.452 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.452 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:09.452 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268967+0000", 2024-09-12T22:50:09.452 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9595000000000001e-05 2024-09-12T22:50:09.453 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.453 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.453 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:09.453 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.269040+0000", 2024-09-12T22:50:09.453 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2643000000000002e-05 2024-09-12T22:50:09.453 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.453 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.453 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:09.453 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273950+0000", 2024-09-12T22:50:09.453 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049105329999999999 2024-09-12T22:50:09.453 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.453 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.453 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:09.454 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274199+0000", 2024-09-12T22:50:09.454 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024824999999999999 2024-09-12T22:50:09.454 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.454 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.454 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:09.454 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274226+0000", 2024-09-12T22:50:09.454 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7602000000000001e-05 2024-09-12T22:50:09.454 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:09.454 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:09.454 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:09.454 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274259+0000", 2024-09-12T22:50:09.454 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2614999999999999e-05 2024-09-12T22:50:09.454 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.454 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:09.455 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.455 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:09.455 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:09.455 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:50:09.456 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:50:09.457 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:09.455+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:09.557 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:09.555+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:09.567 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:50:09.568 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:50:09.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.568 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:16660 3.1a e60/16)", 2024-09-12T22:50:09.568 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:50:09.567356+0000", 2024-09-12T22:50:09.568 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 7.0258000000000004e-05, 2024-09-12T22:50:09.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5632999999999998e-05, 2024-09-12T22:50:09.568 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:09.568 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:09.568 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-12T22:50:09.568 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:09.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:09.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:50:09.567356+0000", 2024-09-12T22:50:09.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:09.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:50:09.567356+0000", 2024-09-12T22:50:09.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:09.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:50:09.567357+0000", 2024-09-12T22:50:09.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9800000000000003e-07 2024-09-12T22:50:09.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.570 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:09.570 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:50:09.567368+0000", 2024-09-12T22:50:09.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0662999999999999e-05 2024-09-12T22:50:09.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.570 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:09.570 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:50:09.567378+0000", 2024-09-12T22:50:09.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8889999999999997e-06 2024-09-12T22:50:09.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:50:09.567384+0000", 2024-09-12T22:50:09.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2160000000000003e-06 2024-09-12T22:50:09.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:09.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:50:09.567433+0000", 2024-09-12T22:50:09.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9427e-05 2024-09-12T22:50:09.571 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.571 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:09.572 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.572 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.572 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-12T22:50:09.572 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 1 2024-09-12T22:50:09.572 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:50:09.577 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:50:09.657 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:09.655+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:09.682 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:50:09.682 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:50:09.682 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:50:09.682 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:50:09.682 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:50:09.691 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:50:09.724 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:50:09.758 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:09.757+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:09.799 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:50:09.799 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:50:09.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:50:09.799 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:50:09.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.799 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12403 4.0 4:0146e0d0:::100000031d4.00000000:head [write 0~4194304 [2@3733965]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:09.800 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:55.747692+0000", 2024-09-12T22:50:09.800 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 14.049505143999999, 2024-09-12T22:50:09.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.22362137500000001, 2024-09-12T22:50:09.800 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:09.800 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:09.800 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.800 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:09.800 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:09.800 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:09.800 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12403 2024-09-12T22:50:09.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.800 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:09.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:09.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.747692+0000", 2024-09-12T22:50:09.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:09.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.747692+0000", 2024-09-12T22:50:09.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:09.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.747693+0000", 2024-09-12T22:50:09.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3799999999999996e-07 2024-09-12T22:50:09.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.802 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.802 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:09.802 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959640+0000", 2024-09-12T22:50:09.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.21194702000000001 2024-09-12T22:50:09.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.802 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.802 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:09.802 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959660+0000", 2024-09-12T22:50:09.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9939e-05 2024-09-12T22:50:09.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.802 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.802 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959668+0000", 2024-09-12T22:50:09.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1669999999999999e-06 2024-09-12T22:50:09.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.803 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:09.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959764+0000", 2024-09-12T22:50:09.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5315000000000005e-05 2024-09-12T22:50:09.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.803 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:09.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959865+0000", 2024-09-12T22:50:09.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101618 2024-09-12T22:50:09.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:09.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.971224+0000", 2024-09-12T22:50:09.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011358541999999999 2024-09-12T22:50:09.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:09.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.971261+0000", 2024-09-12T22:50:09.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7092999999999999e-05 2024-09-12T22:50:09.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:09.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.971314+0000", 2024-09-12T22:50:09.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2843000000000002e-05 2024-09-12T22:50:09.805 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.805 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:09.805 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.805 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:12503 4.15 e56/17 4:ab29d13f:::100000033b1.00000000:head v 56'161, mlcod=55'159)", 2024-09-12T22:50:09.805 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:50:09.805 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.766591667, 2024-09-12T22:50:09.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.043668640000000002, 2024-09-12T22:50:09.805 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:09.805 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:09.806 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.806 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:09.807 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.808 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:09.808 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:50:09.808 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.808 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:09.808 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:50:09.808 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.808 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:09.808 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:50:09.808 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:50:09.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:09.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039768+0000", 2024-09-12T22:50:09.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0091617190000000005 2024-09-12T22:50:09.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:09.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039781+0000", 2024-09-12T22:50:09.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2829e-05 2024-09-12T22:50:09.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039789+0000", 2024-09-12T22:50:09.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9340000000000006e-06 2024-09-12T22:50:09.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.810 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:09.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039846+0000", 2024-09-12T22:50:09.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6762999999999998e-05 2024-09-12T22:50:09.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.810 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:09.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039897+0000", 2024-09-12T22:50:09.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1517000000000002e-05 2024-09-12T22:50:09.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.811 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:09.811 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074225+0000", 2024-09-12T22:50:09.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034328138000000001 2024-09-12T22:50:09.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.811 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:09.811 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074274+0000", 2024-09-12T22:50:09.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9255999999999997e-05 2024-09-12T22:50:09.811 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.811 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:09.811 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.812 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12508 4.2d 4:b7b19b64:::10000003230.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:09.812 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.037293+0000", 2024-09-12T22:50:09.812 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.759904492, 2024-09-12T22:50:09.812 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.037399772999999997, 2024-09-12T22:50:09.812 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:09.812 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:09.812 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.812 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:09.812 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:09.812 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:09.812 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12508 2024-09-12T22:50:09.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.813 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:09.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.813 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:09.813 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037293+0000", 2024-09-12T22:50:09.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.813 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:09.813 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037293+0000", 2024-09-12T22:50:09.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:09.814 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037294+0000", 2024-09-12T22:50:09.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4899999999999995e-07 2024-09-12T22:50:09.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:09.814 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042701+0000", 2024-09-12T22:50:09.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054069419999999997 2024-09-12T22:50:09.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:09.814 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042712+0000", 2024-09-12T22:50:09.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.171e-05 2024-09-12T22:50:09.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042719+0000", 2024-09-12T22:50:09.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1189999999999999e-06 2024-09-12T22:50:09.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:09.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042759+0000", 2024-09-12T22:50:09.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9478999999999999e-05 2024-09-12T22:50:09.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:09.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042827+0000", 2024-09-12T22:50:09.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8435999999999993e-05 2024-09-12T22:50:09.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.816 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:09.816 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042965+0000", 2024-09-12T22:50:09.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000137723 2024-09-12T22:50:09.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.816 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:09.816 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.058351+0000", 2024-09-12T22:50:09.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015385902 2024-09-12T22:50:09.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.817 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.817 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:09.817 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074620+0000", 2024-09-12T22:50:09.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016269018 2024-09-12T22:50:09.817 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.817 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.817 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:09.817 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074657+0000", 2024-09-12T22:50:09.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6619999999999998e-05 2024-09-12T22:50:09.817 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.817 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.817 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:09.817 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074693+0000", 2024-09-12T22:50:09.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6174999999999998e-05 2024-09-12T22:50:09.818 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.818 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:09.818 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.818 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.818 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12516 4.21 4:858ae08d:::100000030eb.00000000:head [write 0~4194304 [3@1582458]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:09.818 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.045143+0000", 2024-09-12T22:50:09.818 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.752054204, 2024-09-12T22:50:09.818 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.039721657, 2024-09-12T22:50:09.818 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:09.818 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:09.818 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.819 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:09.819 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:09.819 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:09.819 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12516 2024-09-12T22:50:09.819 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.819 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:09.819 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.819 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:09.819 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.045143+0000", 2024-09-12T22:50:09.819 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.819 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.819 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.820 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:09.820 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.045143+0000", 2024-09-12T22:50:09.820 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.820 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.820 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.820 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:09.820 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.045144+0000", 2024-09-12T22:50:09.820 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2900000000000002e-07 2024-09-12T22:50:09.820 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.820 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.820 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:09.820 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049506+0000", 2024-09-12T22:50:09.821 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043620280000000004 2024-09-12T22:50:09.821 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.821 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.821 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:09.821 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049517+0000", 2024-09-12T22:50:09.821 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0726e-05 2024-09-12T22:50:09.821 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.821 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.821 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.821 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049522+0000", 2024-09-12T22:50:09.821 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3730000000000001e-06 2024-09-12T22:50:09.821 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.821 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.822 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:09.822 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049583+0000", 2024-09-12T22:50:09.822 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1254999999999995e-05 2024-09-12T22:50:09.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.822 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.822 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:09.822 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049645+0000", 2024-09-12T22:50:09.822 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1988000000000003e-05 2024-09-12T22:50:09.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.822 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.822 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:09.822 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049731+0000", 2024-09-12T22:50:09.823 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6040999999999998e-05 2024-09-12T22:50:09.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.823 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:09.823 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.064126+0000", 2024-09-12T22:50:09.823 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01439497 2024-09-12T22:50:09.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.823 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:09.823 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.084785+0000", 2024-09-12T22:50:09.823 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020658972000000001 2024-09-12T22:50:09.824 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.824 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.824 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:09.824 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.084829+0000", 2024-09-12T22:50:09.824 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3869000000000003e-05 2024-09-12T22:50:09.824 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.824 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.824 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:09.824 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.084865+0000", 2024-09-12T22:50:09.824 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5605999999999998e-05 2024-09-12T22:50:09.824 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.824 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:09.825 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.825 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.825 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.825 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1354 3.18 3:1e8917d7:::200.0000000e:head [write 498872~14494 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:09.825 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.048337+0000", 2024-09-12T22:50:09.825 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.748860284999999, 2024-09-12T22:50:09.825 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034292491000000001, 2024-09-12T22:50:09.825 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:09.825 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:09.825 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.825 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:09.825 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.825 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:09.826 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048337+0000", 2024-09-12T22:50:09.826 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.826 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.826 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:09.826 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048337+0000", 2024-09-12T22:50:09.826 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.826 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.826 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:09.826 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048339+0000", 2024-09-12T22:50:09.826 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.409e-06 2024-09-12T22:50:09.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.827 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:09.827 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048360+0000", 2024-09-12T22:50:09.827 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1659999999999999e-05 2024-09-12T22:50:09.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.827 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:09.827 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048370+0000", 2024-09-12T22:50:09.827 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.611e-06 2024-09-12T22:50:09.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.828 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.828 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.828 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048376+0000", 2024-09-12T22:50:09.828 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5479999999999998e-06 2024-09-12T22:50:09.828 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.828 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.828 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:09.828 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048440+0000", 2024-09-12T22:50:09.828 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3367000000000005e-05 2024-09-12T22:50:09.828 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.828 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.828 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:09.828 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048557+0000", 2024-09-12T22:50:09.829 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116983 2024-09-12T22:50:09.829 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.829 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.829 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:09.829 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048719+0000", 2024-09-12T22:50:09.829 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016250499999999999 2024-09-12T22:50:09.829 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.829 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.829 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:09.829 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.058763+0000", 2024-09-12T22:50:09.829 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010043948 2024-09-12T22:50:09.829 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.829 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.830 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:09.830 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082499+0000", 2024-09-12T22:50:09.830 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023735320000000001 2024-09-12T22:50:09.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.830 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.830 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:09.830 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082561+0000", 2024-09-12T22:50:09.830 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2490000000000006e-05 2024-09-12T22:50:09.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.830 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.830 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:09.830 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082630+0000", 2024-09-12T22:50:09.830 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8650000000000002e-05 2024-09-12T22:50:09.830 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.831 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:09.831 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.831 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.831 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.831 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12517 4.1a 4:5a8c04dd:::10000003276.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:09.831 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.049539+0000", 2024-09-12T22:50:09.831 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.747658523, 2024-09-12T22:50:09.831 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.036068957999999998, 2024-09-12T22:50:09.831 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:09.831 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:09.832 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.832 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:09.832 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:09.832 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:09.832 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12517 2024-09-12T22:50:09.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.832 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:09.832 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.832 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:09.832 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049539+0000", 2024-09-12T22:50:09.832 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.833 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.833 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:09.833 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049539+0000", 2024-09-12T22:50:09.833 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.833 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.833 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.833 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:09.833 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049540+0000", 2024-09-12T22:50:09.833 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1299999999999999e-07 2024-09-12T22:50:09.833 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.833 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.833 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:09.834 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054581+0000", 2024-09-12T22:50:09.834 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005041167 2024-09-12T22:50:09.834 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.834 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.834 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:09.834 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054593+0000", 2024-09-12T22:50:09.834 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1943000000000001e-05 2024-09-12T22:50:09.834 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.834 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.834 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.834 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054598+0000", 2024-09-12T22:50:09.834 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6500000000000001e-06 2024-09-12T22:50:09.834 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.835 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.835 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:09.835 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054658+0000", 2024-09-12T22:50:09.835 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9898999999999997e-05 2024-09-12T22:50:09.835 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.835 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.835 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:09.835 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054800+0000", 2024-09-12T22:50:09.835 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014187100000000001 2024-09-12T22:50:09.835 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.835 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.835 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:09.835 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.085456+0000", 2024-09-12T22:50:09.836 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.030655452 2024-09-12T22:50:09.836 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.836 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.836 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:09.836 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.085533+0000", 2024-09-12T22:50:09.836 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7478999999999995e-05 2024-09-12T22:50:09.836 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.836 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.836 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:09.836 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.085608+0000", 2024-09-12T22:50:09.836 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4684000000000005e-05 2024-09-12T22:50:09.836 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.837 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:09.837 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.837 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12677 4.10 4:0b7ac23f:::10000003457.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:09.837 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:50:09.837 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.567783727, 2024-09-12T22:50:09.837 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033661045000000001, 2024-09-12T22:50:09.837 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:09.837 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:09.837 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.837 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:09.837 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:09.838 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:09.838 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12677 2024-09-12T22:50:09.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.838 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:09.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.838 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:09.838 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:50:09.838 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.838 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:09.838 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:50:09.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.839 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:09.839 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:50:09.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0100000000000005e-07 2024-09-12T22:50:09.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.839 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:09.839 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.237295+0000", 2024-09-12T22:50:09.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078803290000000002 2024-09-12T22:50:09.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.840 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:09.840 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.237307+0000", 2024-09-12T22:50:09.840 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2339e-05 2024-09-12T22:50:09.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.840 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.840 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.840 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.237312+0000", 2024-09-12T22:50:09.840 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9089999999999999e-06 2024-09-12T22:50:09.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.840 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.840 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:09.841 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.239034+0000", 2024-09-12T22:50:09.841 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001722424 2024-09-12T22:50:09.841 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.841 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.841 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:09.841 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.239129+0000", 2024-09-12T22:50:09.841 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4486000000000003e-05 2024-09-12T22:50:09.841 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.841 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.841 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:09.841 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.239206+0000", 2024-09-12T22:50:09.841 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7146999999999998e-05 2024-09-12T22:50:09.841 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.841 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.842 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:09.842 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.255921+0000", 2024-09-12T22:50:09.842 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016714685 2024-09-12T22:50:09.842 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.842 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.842 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:09.842 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.263025+0000", 2024-09-12T22:50:09.842 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071042470000000002 2024-09-12T22:50:09.842 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.842 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.842 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:09.842 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.263052+0000", 2024-09-12T22:50:09.842 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7195e-05 2024-09-12T22:50:09.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.843 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:09.843 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.263075+0000", 2024-09-12T22:50:09.843 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2782999999999999e-05 2024-09-12T22:50:09.843 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.843 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:09.843 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.843 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12979 4.1e 4:78503759:::10000003406.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:09.843 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:50:09.843 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.232096930999999, 2024-09-12T22:50:09.843 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032861456999999997, 2024-09-12T22:50:09.844 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:09.844 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:09.844 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.844 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:09.844 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:09.844 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:09.844 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12979 2024-09-12T22:50:09.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.844 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:09.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.844 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:09.844 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:50:09.845 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.845 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.845 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:09.845 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:50:09.845 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.845 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.845 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:09.845 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:50:09.845 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9999999999999998e-07 2024-09-12T22:50:09.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.845 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.845 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:09.846 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573365+0000", 2024-09-12T22:50:09.846 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082644229999999999 2024-09-12T22:50:09.846 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.846 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.846 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:09.846 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573379+0000", 2024-09-12T22:50:09.846 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3322999999999999e-05 2024-09-12T22:50:09.846 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.846 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.846 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.847 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573386+0000", 2024-09-12T22:50:09.847 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.199e-06 2024-09-12T22:50:09.847 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.847 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.847 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:09.847 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573464+0000", 2024-09-12T22:50:09.847 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7931999999999999e-05 2024-09-12T22:50:09.847 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.847 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.847 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:09.847 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573713+0000", 2024-09-12T22:50:09.847 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024922200000000001 2024-09-12T22:50:09.847 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.848 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.848 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:09.848 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.597870+0000", 2024-09-12T22:50:09.848 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024157221999999999 2024-09-12T22:50:09.848 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.848 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.848 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:09.848 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.597926+0000", 2024-09-12T22:50:09.848 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5838000000000003e-05 2024-09-12T22:50:09.848 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.848 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.848 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:09.849 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.597962+0000", 2024-09-12T22:50:09.849 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5898000000000001e-05 2024-09-12T22:50:09.849 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.849 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:09.849 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.849 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.849 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:13017 4.3b e56/17 4:deb39c3c:::1000000315d.00000000:head v 56'194, mlcod=56'192)", 2024-09-12T22:50:09.849 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.600876+0000", 2024-09-12T22:50:09.849 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.196321455, 2024-09-12T22:50:09.849 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038152448999999998, 2024-09-12T22:50:09.849 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:09.849 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:09.850 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.850 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:09.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.850 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:09.850 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.600876+0000", 2024-09-12T22:50:09.850 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.850 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.850 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:09.850 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.600876+0000", 2024-09-12T22:50:09.850 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.850 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.850 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:09.851 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.600877+0000", 2024-09-12T22:50:09.851 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:50:09.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.851 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:09.851 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609737+0000", 2024-09-12T22:50:09.851 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088599089999999991 2024-09-12T22:50:09.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.851 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:09.851 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609748+0000", 2024-09-12T22:50:09.851 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1355999999999999e-05 2024-09-12T22:50:09.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.852 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.852 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609757+0000", 2024-09-12T22:50:09.852 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9190000000000005e-06 2024-09-12T22:50:09.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.852 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.852 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:09.852 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609801+0000", 2024-09-12T22:50:09.852 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4019e-05 2024-09-12T22:50:09.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.852 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.852 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:09.852 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609816+0000", 2024-09-12T22:50:09.852 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5226e-05 2024-09-12T22:50:09.853 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.853 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.853 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:09.853 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.638985+0000", 2024-09-12T22:50:09.853 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029168537000000001 2024-09-12T22:50:09.853 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.853 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.853 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:09.853 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.639028+0000", 2024-09-12T22:50:09.853 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3847000000000002e-05 2024-09-12T22:50:09.853 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.854 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:09.854 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.854 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.854 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.854 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13032 4.7 4:e102bf81:::1000000359e.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:09.854 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.616553+0000", 2024-09-12T22:50:09.854 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.180644602999999, 2024-09-12T22:50:09.854 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032471027999999999, 2024-09-12T22:50:09.854 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:09.854 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:09.854 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.854 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:09.854 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:09.855 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:09.855 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13032 2024-09-12T22:50:09.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.855 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:09.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.855 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:09.855 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.616553+0000", 2024-09-12T22:50:09.855 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.855 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:09.855 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.616553+0000", 2024-09-12T22:50:09.855 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.856 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:09.856 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.616554+0000", 2024-09-12T22:50:09.856 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0100000000000004e-07 2024-09-12T22:50:09.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.856 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:09.856 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621405+0000", 2024-09-12T22:50:09.856 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0048517480000000003 2024-09-12T22:50:09.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.856 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:09.856 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621416+0000", 2024-09-12T22:50:09.857 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0264e-05 2024-09-12T22:50:09.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.857 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.857 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621446+0000", 2024-09-12T22:50:09.857 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0849000000000002e-05 2024-09-12T22:50:09.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.857 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:09.857 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621494+0000", 2024-09-12T22:50:09.857 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7018000000000003e-05 2024-09-12T22:50:09.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.858 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:09.858 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621590+0000", 2024-09-12T22:50:09.858 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6632999999999995e-05 2024-09-12T22:50:09.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.858 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:09.858 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621680+0000", 2024-09-12T22:50:09.858 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9704999999999996e-05 2024-09-12T22:50:09.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.858 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:09.858 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.639248+0000", 2024-09-12T22:50:09.858 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017568548 2024-09-12T22:50:09.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.859 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:09.859 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.648944+0000", 2024-09-12T22:50:09.859 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0096954659999999998 2024-09-12T22:50:09.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.859 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:09.859 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.648992+0000", 2024-09-12T22:50:09.859 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8059999999999997e-05 2024-09-12T22:50:09.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.859 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:09.860 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.649024+0000", 2024-09-12T22:50:09.860 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1936000000000001e-05 2024-09-12T22:50:09.860 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.860 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:09.860 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.860 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13428 4.37 4:eeed8456:::1000000321a.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:09.860 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.064666+0000", 2024-09-12T22:50:09.860 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.732531325, 2024-09-12T22:50:09.860 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033441308000000003, 2024-09-12T22:50:09.860 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:09.861 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:09.861 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.861 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:09.861 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:09.861 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:09.861 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13428 2024-09-12T22:50:09.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.861 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:09.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.861 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:09.861 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.064666+0000", 2024-09-12T22:50:09.861 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.861 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:09.862 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.064666+0000", 2024-09-12T22:50:09.862 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.862 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:09.862 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.064668+0000", 2024-09-12T22:50:09.862 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4160000000000001e-06 2024-09-12T22:50:09.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:09.863 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071829+0000", 2024-09-12T22:50:09.863 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071611390000000004 2024-09-12T22:50:09.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:09.863 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071840+0000", 2024-09-12T22:50:09.863 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1369000000000001e-05 2024-09-12T22:50:09.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.863 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071847+0000", 2024-09-12T22:50:09.864 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0960000000000003e-06 2024-09-12T22:50:09.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.864 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:09.864 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071904+0000", 2024-09-12T22:50:09.864 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7309000000000003e-05 2024-09-12T22:50:09.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.864 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:09.864 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.072051+0000", 2024-09-12T22:50:09.864 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014625 2024-09-12T22:50:09.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.865 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.865 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:09.865 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.072194+0000", 2024-09-12T22:50:09.865 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014379799999999999 2024-09-12T22:50:09.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.865 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.865 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:09.865 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.079527+0000", 2024-09-12T22:50:09.865 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007332674 2024-09-12T22:50:09.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.865 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.865 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:09.865 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.098048+0000", 2024-09-12T22:50:09.866 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018521174000000001 2024-09-12T22:50:09.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.866 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:09.866 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.098081+0000", 2024-09-12T22:50:09.866 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2910999999999997e-05 2024-09-12T22:50:09.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.866 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:09.866 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.098107+0000", 2024-09-12T22:50:09.866 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6171999999999999e-05 2024-09-12T22:50:09.866 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.866 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:09.867 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.867 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.867 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13472 4.12 4:4b0bd9b8:::100000033b0.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:09.867 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.113168+0000", 2024-09-12T22:50:09.867 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.684029625999999, 2024-09-12T22:50:09.867 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.039534103000000001, 2024-09-12T22:50:09.867 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:09.867 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:09.867 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.867 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:09.867 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:09.868 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:09.868 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13472 2024-09-12T22:50:09.868 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.868 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:09.868 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.868 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:09.868 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.113168+0000", 2024-09-12T22:50:09.868 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.868 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.868 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.868 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:09.868 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.113168+0000", 2024-09-12T22:50:09.869 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.869 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:09.869 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.113169+0000", 2024-09-12T22:50:09.869 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1960000000000001e-06 2024-09-12T22:50:09.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.869 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:09.869 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119849+0000", 2024-09-12T22:50:09.869 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0066801830000000001 2024-09-12T22:50:09.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.870 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:09.870 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119861+0000", 2024-09-12T22:50:09.870 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.199e-05 2024-09-12T22:50:09.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.870 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.870 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119866+0000", 2024-09-12T22:50:09.870 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8720000000000001e-06 2024-09-12T22:50:09.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.870 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:09.870 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119945+0000", 2024-09-12T22:50:09.870 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9268000000000001e-05 2024-09-12T22:50:09.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.871 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:09.871 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.120098+0000", 2024-09-12T22:50:09.871 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015299500000000001 2024-09-12T22:50:09.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.871 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:09.871 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.120218+0000", 2024-09-12T22:50:09.871 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011989099999999999 2024-09-12T22:50:09.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.871 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:09.872 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.140463+0000", 2024-09-12T22:50:09.872 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020244765000000001 2024-09-12T22:50:09.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.872 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.872 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:09.872 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.152629+0000", 2024-09-12T22:50:09.872 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012165601999999999 2024-09-12T22:50:09.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.872 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.873 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:09.873 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.152664+0000", 2024-09-12T22:50:09.873 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5599999999999998e-05 2024-09-12T22:50:09.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.873 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.873 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:09.873 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.152702+0000", 2024-09-12T22:50:09.873 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7741000000000003e-05 2024-09-12T22:50:09.873 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.873 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:09.874 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.874 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.874 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13484 4.2f 4:f62c2e43:::1000000349e.00000000:head [write 0~4194304 [2@3461078]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:09.874 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.125796+0000", 2024-09-12T22:50:09.874 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.671401263, 2024-09-12T22:50:09.874 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.036857236000000002, 2024-09-12T22:50:09.874 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:09.874 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:09.874 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.874 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:09.874 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:09.874 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:09.875 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13484 2024-09-12T22:50:09.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.875 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:09.875 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.875 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:09.875 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.125796+0000", 2024-09-12T22:50:09.875 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.875 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.875 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:09.875 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.125796+0000", 2024-09-12T22:50:09.875 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.875 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.876 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:09.876 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.125797+0000", 2024-09-12T22:50:09.876 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.108e-06 2024-09-12T22:50:09.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.876 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:09.876 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130725+0000", 2024-09-12T22:50:09.876 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049272949999999999 2024-09-12T22:50:09.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.876 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:09.876 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130739+0000", 2024-09-12T22:50:09.876 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4234e-05 2024-09-12T22:50:09.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.877 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.877 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130751+0000", 2024-09-12T22:50:09.877 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1848000000000001e-05 2024-09-12T22:50:09.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.877 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:09.877 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130816+0000", 2024-09-12T22:50:09.877 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5359999999999998e-05 2024-09-12T22:50:09.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.877 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:09.877 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130917+0000", 2024-09-12T22:50:09.878 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101178 2024-09-12T22:50:09.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.878 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:09.878 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.131058+0000", 2024-09-12T22:50:09.878 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140803 2024-09-12T22:50:09.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.878 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:09.878 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.153387+0000", 2024-09-12T22:50:09.878 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022328585000000001 2024-09-12T22:50:09.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.879 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:09.879 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.162465+0000", 2024-09-12T22:50:09.879 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090781360000000005 2024-09-12T22:50:09.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.879 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.879 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:09.879 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.162584+0000", 2024-09-12T22:50:09.879 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119634 2024-09-12T22:50:09.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.879 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.879 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:09.879 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.162653+0000", 2024-09-12T22:50:09.879 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9054999999999995e-05 2024-09-12T22:50:09.880 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.880 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:09.880 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.880 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.880 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.880 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13558 4.10 4:09df41af:::1000000333c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:09.880 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.229326+0000", 2024-09-12T22:50:09.880 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.567871435000001, 2024-09-12T22:50:09.880 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.039409786000000002, 2024-09-12T22:50:09.880 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:09.880 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:09.880 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.881 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:09.881 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:09.881 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:09.881 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13558 2024-09-12T22:50:09.881 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.881 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:09.881 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.881 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:09.881 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.229326+0000", 2024-09-12T22:50:09.881 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.881 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.881 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.881 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:09.882 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.229326+0000", 2024-09-12T22:50:09.882 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.882 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:09.882 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.229327+0000", 2024-09-12T22:50:09.882 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1200000000000002e-07 2024-09-12T22:50:09.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.882 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:09.882 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235243+0000", 2024-09-12T22:50:09.883 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059166310000000003 2024-09-12T22:50:09.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.883 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.883 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:09.883 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235255+0000", 2024-09-12T22:50:09.883 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1174e-05 2024-09-12T22:50:09.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.883 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.883 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.883 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235260+0000", 2024-09-12T22:50:09.883 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1749999999999996e-06 2024-09-12T22:50:09.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.884 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.884 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:09.884 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235295+0000", 2024-09-12T22:50:09.884 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4830999999999999e-05 2024-09-12T22:50:09.884 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.884 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.884 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:09.884 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235350+0000", 2024-09-12T22:50:09.884 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5092e-05 2024-09-12T22:50:09.884 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.884 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.884 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:09.884 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235426+0000", 2024-09-12T22:50:09.885 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6463000000000003e-05 2024-09-12T22:50:09.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.885 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.885 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:09.885 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.244772+0000", 2024-09-12T22:50:09.885 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0093457709999999992 2024-09-12T22:50:09.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.885 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.885 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:09.885 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.268679+0000", 2024-09-12T22:50:09.885 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023906788000000002 2024-09-12T22:50:09.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.885 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.886 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:09.886 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.268712+0000", 2024-09-12T22:50:09.886 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3701999999999997e-05 2024-09-12T22:50:09.886 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.886 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.886 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:09.886 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.268736+0000", 2024-09-12T22:50:09.886 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3447000000000001e-05 2024-09-12T22:50:09.886 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.886 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:09.886 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.886 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.886 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.887 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13747 4.1e 4:7aa36f33:::100000035ed.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:09.887 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.457376+0000", 2024-09-12T22:50:09.887 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.339821321000001, 2024-09-12T22:50:09.887 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.037057578000000001, 2024-09-12T22:50:09.887 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:09.887 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:09.887 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.887 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:09.887 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:09.887 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:09.887 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13747 2024-09-12T22:50:09.887 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.887 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:09.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.888 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:09.888 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.457376+0000", 2024-09-12T22:50:09.888 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.888 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:09.888 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.457376+0000", 2024-09-12T22:50:09.888 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.888 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:09.889 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.457377+0000", 2024-09-12T22:50:09.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1699999999999998e-07 2024-09-12T22:50:09.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.889 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:09.889 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464400+0000", 2024-09-12T22:50:09.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070235890000000002 2024-09-12T22:50:09.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.889 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:09.889 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464413+0000", 2024-09-12T22:50:09.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2397e-05 2024-09-12T22:50:09.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.890 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.890 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.890 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464418+0000", 2024-09-12T22:50:09.890 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5119999999999999e-06 2024-09-12T22:50:09.890 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.890 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.890 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:09.890 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464464+0000", 2024-09-12T22:50:09.890 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5976000000000002e-05 2024-09-12T22:50:09.890 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.890 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.890 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:09.890 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464529+0000", 2024-09-12T22:50:09.891 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5266999999999997e-05 2024-09-12T22:50:09.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.891 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:09.891 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.494315+0000", 2024-09-12T22:50:09.891 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029785329999999999 2024-09-12T22:50:09.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.891 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:09.891 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.494366+0000", 2024-09-12T22:50:09.891 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0903999999999999e-05 2024-09-12T22:50:09.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.891 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:09.892 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.494434+0000", 2024-09-12T22:50:09.892 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7985999999999996e-05 2024-09-12T22:50:09.892 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.892 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:09.892 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.892 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.892 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.892 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:13748 4.15 e56/17 4:ab1b03eb:::100000031a3.00000000:head v 56'173, mlcod=56'171)", 2024-09-12T22:50:09.892 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.462509+0000", 2024-09-12T22:50:09.892 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.334688273999999, 2024-09-12T22:50:09.892 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044366823, 2024-09-12T22:50:09.892 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:09.892 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:09.893 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.893 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:09.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.893 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:09.893 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.462509+0000", 2024-09-12T22:50:09.893 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.893 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:09.893 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.462509+0000", 2024-09-12T22:50:09.893 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:09.894 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.462509+0000", 2024-09-12T22:50:09.894 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7599999999999998e-07 2024-09-12T22:50:09.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:09.894 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471576+0000", 2024-09-12T22:50:09.894 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090665490000000001 2024-09-12T22:50:09.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:09.894 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471591+0000", 2024-09-12T22:50:09.895 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4566000000000001e-05 2024-09-12T22:50:09.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.895 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.895 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.895 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471600+0000", 2024-09-12T22:50:09.895 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1630000000000002e-06 2024-09-12T22:50:09.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.895 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.895 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:09.895 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471689+0000", 2024-09-12T22:50:09.895 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9591000000000003e-05 2024-09-12T22:50:09.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.895 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.896 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:09.896 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471735+0000", 2024-09-12T22:50:09.896 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5429000000000002e-05 2024-09-12T22:50:09.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.896 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.896 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:09.896 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.506851+0000", 2024-09-12T22:50:09.896 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035116238000000001 2024-09-12T22:50:09.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.896 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.897 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:09.897 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.506876+0000", 2024-09-12T22:50:09.897 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5011000000000002e-05 2024-09-12T22:50:09.897 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.897 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:09.897 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.897 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.897 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13753 4.30 4:0dea61b7:::100000036ed.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:09.897 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.464559+0000", 2024-09-12T22:50:09.897 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.332638275000001, 2024-09-12T22:50:09.897 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041415303000000001, 2024-09-12T22:50:09.897 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:09.897 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:09.898 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.898 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:09.898 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:09.898 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:09.898 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13753 2024-09-12T22:50:09.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.898 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:09.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.898 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:09.898 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464559+0000", 2024-09-12T22:50:09.898 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:09.899 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464559+0000", 2024-09-12T22:50:09.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:09.899 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464560+0000", 2024-09-12T22:50:09.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:50:09.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:09.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469861+0000", 2024-09-12T22:50:09.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053017139999999999 2024-09-12T22:50:09.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.900 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:09.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469878+0000", 2024-09-12T22:50:09.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6336000000000001e-05 2024-09-12T22:50:09.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.900 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469888+0000", 2024-09-12T22:50:09.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8320000000000001e-06 2024-09-12T22:50:09.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.901 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.901 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:09.901 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469950+0000", 2024-09-12T22:50:09.901 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1923999999999999e-05 2024-09-12T22:50:09.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.901 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.901 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:09.901 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.470059+0000", 2024-09-12T22:50:09.901 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109559 2024-09-12T22:50:09.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.901 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.901 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:09.902 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.505915+0000", 2024-09-12T22:50:09.902 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035855887000000003 2024-09-12T22:50:09.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.902 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:09.902 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.505939+0000", 2024-09-12T22:50:09.902 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3740999999999999e-05 2024-09-12T22:50:09.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.902 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:09.902 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.505974+0000", 2024-09-12T22:50:09.902 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5753999999999997e-05 2024-09-12T22:50:09.903 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.903 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:09.903 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.903 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.903 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.903 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13754 4.11 4:8a2f20b1:::10000003764.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:09.903 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.469921+0000", 2024-09-12T22:50:09.903 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.327276423000001, 2024-09-12T22:50:09.903 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034721670000000003, 2024-09-12T22:50:09.903 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:09.903 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:09.903 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.903 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:09.904 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:09.904 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:09.904 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13754 2024-09-12T22:50:09.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.904 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:09.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.904 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:09.904 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469921+0000", 2024-09-12T22:50:09.904 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.904 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:09.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469921+0000", 2024-09-12T22:50:09.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.905 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:09.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469922+0000", 2024-09-12T22:50:09.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.006e-06 2024-09-12T22:50:09.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.905 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:09.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474681+0000", 2024-09-12T22:50:09.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047588539999999999 2024-09-12T22:50:09.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:09.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474698+0000", 2024-09-12T22:50:09.906 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7368999999999999e-05 2024-09-12T22:50:09.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474709+0000", 2024-09-12T22:50:09.906 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0738e-05 2024-09-12T22:50:09.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:09.907 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474780+0000", 2024-09-12T22:50:09.907 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0622000000000002e-05 2024-09-12T22:50:09.907 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.907 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.907 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:09.907 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474954+0000", 2024-09-12T22:50:09.907 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017394399999999999 2024-09-12T22:50:09.907 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.907 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.907 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:09.907 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.504488+0000", 2024-09-12T22:50:09.907 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029534721999999999 2024-09-12T22:50:09.907 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.908 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:09.908 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.504553+0000", 2024-09-12T22:50:09.908 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4877999999999998e-05 2024-09-12T22:50:09.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.908 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:09.908 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.504643+0000", 2024-09-12T22:50:09.908 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9536999999999993e-05 2024-09-12T22:50:09.908 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.908 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:09.908 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.909 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.909 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13763 4.2d 4:b5937a57:::100000031de.00000000:head [write 0~4194304 [3@52474]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:09.909 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.474957+0000", 2024-09-12T22:50:09.909 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.32224018, 2024-09-12T22:50:09.909 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.057329167, 2024-09-12T22:50:09.909 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:09.909 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:09.909 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.909 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:09.909 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:09.909 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:09.909 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13763 2024-09-12T22:50:09.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.910 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:09.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.910 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:09.910 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474957+0000", 2024-09-12T22:50:09.910 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.910 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:09.910 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474957+0000", 2024-09-12T22:50:09.910 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.910 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:09.911 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474958+0000", 2024-09-12T22:50:09.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8299999999999997e-07 2024-09-12T22:50:09.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:09.911 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.478970+0000", 2024-09-12T22:50:09.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040121100000000002 2024-09-12T22:50:09.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:09.911 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.478983+0000", 2024-09-12T22:50:09.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.292e-05 2024-09-12T22:50:09.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.912 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.912 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.912 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.478992+0000", 2024-09-12T22:50:09.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3759999999999997e-06 2024-09-12T22:50:09.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.912 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.912 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:09.912 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.479048+0000", 2024-09-12T22:50:09.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5381999999999999e-05 2024-09-12T22:50:09.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.912 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.912 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:09.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.479124+0000", 2024-09-12T22:50:09.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6643999999999993e-05 2024-09-12T22:50:09.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:09.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.479230+0000", 2024-09-12T22:50:09.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010581099999999999 2024-09-12T22:50:09.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:09.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.506897+0000", 2024-09-12T22:50:09.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027666863999999999 2024-09-12T22:50:09.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.914 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.914 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:09.914 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.532175+0000", 2024-09-12T22:50:09.914 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.025278367 2024-09-12T22:50:09.914 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.914 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.914 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:09.914 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.532232+0000", 2024-09-12T22:50:09.914 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6455000000000001e-05 2024-09-12T22:50:09.914 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.914 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.914 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:09.915 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.532286+0000", 2024-09-12T22:50:09.915 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4654999999999998e-05 2024-09-12T22:50:09.915 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.915 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:09.915 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.915 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.915 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.915 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13803 4.4 4:228c5bc4:::10000003314.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:09.915 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.515814+0000", 2024-09-12T22:50:09.915 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.281383754, 2024-09-12T22:50:09.915 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034442453999999997, 2024-09-12T22:50:09.915 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:09.915 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:09.915 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:09.916 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:09.916 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:09.916 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:09.916 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13803 2024-09-12T22:50:09.916 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.916 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:09.916 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.916 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:09.916 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.515814+0000", 2024-09-12T22:50:09.916 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.916 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.916 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:09.917 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.515814+0000", 2024-09-12T22:50:09.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:09.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:09.917 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.515814+0000", 2024-09-12T22:50:09.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4799999999999998e-07 2024-09-12T22:50:09.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:09.917 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522580+0000", 2024-09-12T22:50:09.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0067656959999999999 2024-09-12T22:50:09.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.918 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:09.918 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522591+0000", 2024-09-12T22:50:09.918 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1206000000000001e-05 2024-09-12T22:50:09.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.918 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:09.918 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522597+0000", 2024-09-12T22:50:09.918 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1500000000000004e-06 2024-09-12T22:50:09.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.918 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:09.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522639+0000", 2024-09-12T22:50:09.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1767999999999997e-05 2024-09-12T22:50:09.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:09.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522689+0000", 2024-09-12T22:50:09.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9472999999999999e-05 2024-09-12T22:50:09.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:09.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522771+0000", 2024-09-12T22:50:09.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2738000000000006e-05 2024-09-12T22:50:09.920 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.920 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.920 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:09.920 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.529356+0000", 2024-09-12T22:50:09.920 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065850329999999997 2024-09-12T22:50:09.920 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.920 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.920 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:09.920 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.550206+0000", 2024-09-12T22:50:09.920 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020849755000000001 2024-09-12T22:50:09.920 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.920 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.920 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:09.921 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.550233+0000", 2024-09-12T22:50:09.921 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6990000000000001e-05 2024-09-12T22:50:09.921 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:09.921 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:09.921 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:09.921 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.550256+0000", 2024-09-12T22:50:09.921 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3096999999999999e-05 2024-09-12T22:50:09.921 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.921 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:09.921 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.921 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:09.921 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:09.921 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:50:09.923 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:09.921+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:09.923 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:50:10.023 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:10.021+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:10.029 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:50:10.029 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:50:10.029 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:50:10.029 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:50:10.038 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:50:10.047 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-12T22:50:10.047 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T22:50:10.124 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:10.123+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:10.181 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:50:10.181 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:50:10.181 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:50:10.181 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:50:10.181 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:50:10.189 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:50:10.225 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:10.224+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:10.303 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:50:10.303 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:50:10.303 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:50:10.303 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:50:10.303 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.303 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1923 3.8 3:17051619:::200.0000000f:head [write 935107~4527 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:10.303 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.157731+0000", 2024-09-12T22:50:10.303 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.141908571, 2024-09-12T22:50:10.303 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.085115956000000006, 2024-09-12T22:50:10.303 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:10.304 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:10.304 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.304 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:10.304 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.304 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:10.304 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157731+0000", 2024-09-12T22:50:10.304 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.304 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.304 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.304 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:10.304 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157731+0000", 2024-09-12T22:50:10.304 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.304 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.305 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.305 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:10.305 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157732+0000", 2024-09-12T22:50:10.305 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.99e-07 2024-09-12T22:50:10.305 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.305 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.305 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:10.305 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157737+0000", 2024-09-12T22:50:10.305 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6280000000000002e-06 2024-09-12T22:50:10.305 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.305 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.305 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:10.305 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157745+0000", 2024-09-12T22:50:10.306 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1749999999999999e-06 2024-09-12T22:50:10.306 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.306 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.306 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.306 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157749+0000", 2024-09-12T22:50:10.306 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.946e-06 2024-09-12T22:50:10.306 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.306 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.306 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:10.306 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.236865+0000", 2024-09-12T22:50:10.306 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079116687000000005 2024-09-12T22:50:10.306 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.306 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.307 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:10.307 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.236929+0000", 2024-09-12T22:50:10.307 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3566999999999996e-05 2024-09-12T22:50:10.307 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.307 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.307 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:10.307 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237025+0000", 2024-09-12T22:50:10.307 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6620000000000007e-05 2024-09-12T22:50:10.307 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.307 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.307 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:10.307 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240342+0000", 2024-09-12T22:50:10.307 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033162539999999998 2024-09-12T22:50:10.308 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.308 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.308 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:10.308 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242737+0000", 2024-09-12T22:50:10.308 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023957370000000002 2024-09-12T22:50:10.308 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.308 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.308 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:10.308 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242797+0000", 2024-09-12T22:50:10.308 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9323000000000001e-05 2024-09-12T22:50:10.308 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.308 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.309 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:10.309 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242847+0000", 2024-09-12T22:50:10.309 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0319999999999999e-05 2024-09-12T22:50:10.309 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.309 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:10.309 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.309 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.309 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.309 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1924 3.8 3:17051619:::200.0000000f:head [write 939634~6106 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:10.309 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.159169+0000", 2024-09-12T22:50:10.309 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.140470351999999, 2024-09-12T22:50:10.309 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.083843601000000004, 2024-09-12T22:50:10.309 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:10.310 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:10.310 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.310 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:10.310 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.310 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:10.310 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159169+0000", 2024-09-12T22:50:10.310 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.310 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.310 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.310 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:10.310 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159169+0000", 2024-09-12T22:50:10.310 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.310 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.311 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.311 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:10.311 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159171+0000", 2024-09-12T22:50:10.311 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4959999999999999e-06 2024-09-12T22:50:10.311 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.311 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.311 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:10.311 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159182+0000", 2024-09-12T22:50:10.311 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1104000000000001e-05 2024-09-12T22:50:10.311 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.311 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.312 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:10.312 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159190+0000", 2024-09-12T22:50:10.312 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3520000000000007e-06 2024-09-12T22:50:10.312 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.312 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.312 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.312 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159196+0000", 2024-09-12T22:50:10.312 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5690000000000004e-06 2024-09-12T22:50:10.312 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.312 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.312 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:10.312 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237476+0000", 2024-09-12T22:50:10.312 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078280197999999995 2024-09-12T22:50:10.312 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.313 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.313 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:10.313 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237530+0000", 2024-09-12T22:50:10.313 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4419000000000002e-05 2024-09-12T22:50:10.313 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.313 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.313 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:10.313 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237593+0000", 2024-09-12T22:50:10.313 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2611000000000001e-05 2024-09-12T22:50:10.313 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.313 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.313 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:10.313 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242030+0000", 2024-09-12T22:50:10.314 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044367369999999996 2024-09-12T22:50:10.314 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.314 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.314 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:10.314 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242893+0000", 2024-09-12T22:50:10.314 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00086367400000000004 2024-09-12T22:50:10.314 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.314 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.314 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:10.314 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242956+0000", 2024-09-12T22:50:10.314 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2885999999999994e-05 2024-09-12T22:50:10.314 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.314 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.315 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:10.315 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243013+0000", 2024-09-12T22:50:10.315 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6555000000000003e-05 2024-09-12T22:50:10.315 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.315 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:10.315 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.315 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.315 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.315 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1925 3.8 3:17051619:::200.0000000f:head [write 945740~9955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:10.315 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.160395+0000", 2024-09-12T22:50:10.315 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.139245143, 2024-09-12T22:50:10.315 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.091200247999999998, 2024-09-12T22:50:10.315 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:10.315 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:10.316 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.316 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:10.316 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.316 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:10.316 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160395+0000", 2024-09-12T22:50:10.316 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.316 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.316 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.316 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:10.316 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160395+0000", 2024-09-12T22:50:10.316 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.316 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.316 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.316 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:10.317 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160396+0000", 2024-09-12T22:50:10.317 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1599999999999999e-06 2024-09-12T22:50:10.317 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.317 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.317 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:10.317 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160415+0000", 2024-09-12T22:50:10.317 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9680000000000001e-05 2024-09-12T22:50:10.317 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.317 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.317 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:10.317 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160428+0000", 2024-09-12T22:50:10.317 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2792999999999999e-05 2024-09-12T22:50:10.317 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.317 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.318 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.318 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160436+0000", 2024-09-12T22:50:10.318 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0399999999999993e-06 2024-09-12T22:50:10.318 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.318 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.318 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:10.318 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.238408+0000", 2024-09-12T22:50:10.318 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077971602000000001 2024-09-12T22:50:10.318 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.318 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.318 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:10.318 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.238504+0000", 2024-09-12T22:50:10.318 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6714999999999998e-05 2024-09-12T22:50:10.319 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.319 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.319 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:10.319 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.238687+0000", 2024-09-12T22:50:10.319 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000182795 2024-09-12T22:50:10.319 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.319 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.319 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:10.319 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242036+0000", 2024-09-12T22:50:10.319 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003348887 2024-09-12T22:50:10.319 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.319 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.319 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:10.319 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251510+0000", 2024-09-12T22:50:10.320 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094733679999999994 2024-09-12T22:50:10.320 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.320 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.320 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:10.320 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251543+0000", 2024-09-12T22:50:10.320 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2974e-05 2024-09-12T22:50:10.320 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.320 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.320 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:10.320 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251595+0000", 2024-09-12T22:50:10.320 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2234000000000002e-05 2024-09-12T22:50:10.320 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.320 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:10.320 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.321 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.321 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.321 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1926 3.8 3:17051619:::200.0000000f:head [write 955695~5281 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:10.321 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.160849+0000", 2024-09-12T22:50:10.321 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.138790189, 2024-09-12T22:50:10.321 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.094772633999999994, 2024-09-12T22:50:10.321 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:10.321 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:10.321 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.321 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:10.321 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.321 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:10.321 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160849+0000", 2024-09-12T22:50:10.322 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.322 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.322 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:10.322 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160849+0000", 2024-09-12T22:50:10.322 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.322 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.322 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:10.322 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160850+0000", 2024-09-12T22:50:10.322 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6700000000000002e-07 2024-09-12T22:50:10.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.322 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.322 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:10.323 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160858+0000", 2024-09-12T22:50:10.323 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5630000000000003e-06 2024-09-12T22:50:10.323 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.323 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.323 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:10.323 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160866+0000", 2024-09-12T22:50:10.323 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7570000000000004e-06 2024-09-12T22:50:10.323 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.323 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.323 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.323 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160870+0000", 2024-09-12T22:50:10.323 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5929999999999999e-06 2024-09-12T22:50:10.323 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.323 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.324 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:10.324 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.239705+0000", 2024-09-12T22:50:10.324 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078834491000000007 2024-09-12T22:50:10.324 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.324 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.324 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:10.324 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.239764+0000", 2024-09-12T22:50:10.324 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9190000000000001e-05 2024-09-12T22:50:10.324 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.324 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.324 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:10.324 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.239851+0000", 2024-09-12T22:50:10.325 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7472999999999994e-05 2024-09-12T22:50:10.325 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.325 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.325 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:10.325 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254001+0000", 2024-09-12T22:50:10.325 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014149622000000001 2024-09-12T22:50:10.325 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.325 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.325 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:10.325 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255525+0000", 2024-09-12T22:50:10.325 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0015236500000000001 2024-09-12T22:50:10.325 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.325 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.326 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:10.326 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255567+0000", 2024-09-12T22:50:10.326 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2150999999999997e-05 2024-09-12T22:50:10.326 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.326 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.326 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:10.326 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255622+0000", 2024-09-12T22:50:10.326 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5276999999999999e-05 2024-09-12T22:50:10.326 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.326 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:10.326 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.326 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.326 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.327 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1927 3.8 3:17051619:::200.0000000f:head [write 960976~5828 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:10.327 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.164361+0000", 2024-09-12T22:50:10.327 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.135278491999999, 2024-09-12T22:50:10.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.091388523999999999, 2024-09-12T22:50:10.327 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:10.327 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:10.327 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.327 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:10.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:10.327 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164361+0000", 2024-09-12T22:50:10.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.328 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:10.328 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164361+0000", 2024-09-12T22:50:10.328 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.328 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:10.328 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164363+0000", 2024-09-12T22:50:10.328 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.389e-06 2024-09-12T22:50:10.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.328 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:10.329 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164370+0000", 2024-09-12T22:50:10.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.99e-06 2024-09-12T22:50:10.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.329 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:10.329 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164379+0000", 2024-09-12T22:50:10.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9499999999999996e-06 2024-09-12T22:50:10.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.329 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.329 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164385+0000", 2024-09-12T22:50:10.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5879999999999997e-06 2024-09-12T22:50:10.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.330 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.330 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:10.330 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240385+0000", 2024-09-12T22:50:10.330 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075999995000000001 2024-09-12T22:50:10.330 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.330 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.330 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:10.330 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240533+0000", 2024-09-12T22:50:10.330 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014811699999999999 2024-09-12T22:50:10.330 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.330 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.330 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:10.330 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240886+0000", 2024-09-12T22:50:10.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000352517 2024-09-12T22:50:10.331 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.331 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.331 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:10.331 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254024+0000", 2024-09-12T22:50:10.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013138047999999999 2024-09-12T22:50:10.331 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.331 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.331 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:10.331 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255629+0000", 2024-09-12T22:50:10.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001604949 2024-09-12T22:50:10.331 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.331 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:10.332 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255683+0000", 2024-09-12T22:50:10.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4035e-05 2024-09-12T22:50:10.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:10.332 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255750+0000", 2024-09-12T22:50:10.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6946000000000006e-05 2024-09-12T22:50:10.332 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.332 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:10.332 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.333 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1928 3.8 3:17051619:::200.0000000f:head [write 966804~6536 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:10.333 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167179+0000", 2024-09-12T22:50:10.333 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.132460694000001, 2024-09-12T22:50:10.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.089785880999999998, 2024-09-12T22:50:10.333 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:10.333 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:10.333 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.333 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:10.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.333 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:10.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167179+0000", 2024-09-12T22:50:10.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.334 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:10.334 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167179+0000", 2024-09-12T22:50:10.334 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.334 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:10.334 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167180+0000", 2024-09-12T22:50:10.334 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2869999999999999e-06 2024-09-12T22:50:10.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.334 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:10.335 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167192+0000", 2024-09-12T22:50:10.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.187e-05 2024-09-12T22:50:10.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.335 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:10.335 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167203+0000", 2024-09-12T22:50:10.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1076e-05 2024-09-12T22:50:10.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.335 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.335 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167210+0000", 2024-09-12T22:50:10.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1799999999999999e-06 2024-09-12T22:50:10.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.336 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:10.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.241518+0000", 2024-09-12T22:50:10.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074307845999999997 2024-09-12T22:50:10.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.336 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:10.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.241563+0000", 2024-09-12T22:50:10.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5138e-05 2024-09-12T22:50:10.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.336 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:10.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.241641+0000", 2024-09-12T22:50:10.337 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8016000000000007e-05 2024-09-12T22:50:10.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.337 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:10.337 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254041+0000", 2024-09-12T22:50:10.337 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012399666 2024-09-12T22:50:10.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.337 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:10.337 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.256880+0000", 2024-09-12T22:50:10.337 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0028390580000000002 2024-09-12T22:50:10.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.338 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:10.338 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.256918+0000", 2024-09-12T22:50:10.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7552999999999998e-05 2024-09-12T22:50:10.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.338 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:10.338 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.256965+0000", 2024-09-12T22:50:10.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7191000000000003e-05 2024-09-12T22:50:10.338 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.338 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:10.338 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.339 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1929 3.8 3:17051619:::200.0000000f:head [write 973340~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:10.339 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167521+0000", 2024-09-12T22:50:10.339 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.132118531, 2024-09-12T22:50:10.339 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.093206336000000001, 2024-09-12T22:50:10.339 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:10.339 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:10.339 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.339 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:10.339 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.339 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:10.339 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167521+0000", 2024-09-12T22:50:10.339 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:10.340 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167521+0000", 2024-09-12T22:50:10.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:10.340 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167522+0000", 2024-09-12T22:50:10.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8899999999999998e-07 2024-09-12T22:50:10.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:10.340 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167526+0000", 2024-09-12T22:50:10.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4490000000000001e-06 2024-09-12T22:50:10.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.341 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:10.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167544+0000", 2024-09-12T22:50:10.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7220000000000001e-05 2024-09-12T22:50:10.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.341 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167551+0000", 2024-09-12T22:50:10.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.046e-06 2024-09-12T22:50:10.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.342 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:10.342 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242079+0000", 2024-09-12T22:50:10.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074528436000000003 2024-09-12T22:50:10.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.342 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:10.342 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242167+0000", 2024-09-12T22:50:10.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7670000000000006e-05 2024-09-12T22:50:10.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.342 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:10.342 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242306+0000", 2024-09-12T22:50:10.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000138703 2024-09-12T22:50:10.343 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.343 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.343 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:10.343 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254058+0000", 2024-09-12T22:50:10.343 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011752395000000001 2024-09-12T22:50:10.343 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.343 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.343 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:10.343 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260654+0000", 2024-09-12T22:50:10.343 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0065964700000000001 2024-09-12T22:50:10.343 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.343 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.344 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:10.344 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260699+0000", 2024-09-12T22:50:10.344 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5095000000000001e-05 2024-09-12T22:50:10.344 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.344 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.344 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:10.344 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260727+0000", 2024-09-12T22:50:10.344 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7963e-05 2024-09-12T22:50:10.344 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.344 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:10.344 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.344 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.344 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.345 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1931 3.8 3:17051619:::200.0000000f:head [write 974738~2728 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:10.345 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167657+0000", 2024-09-12T22:50:10.345 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.131982526, 2024-09-12T22:50:10.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.093133758999999997, 2024-09-12T22:50:10.345 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:10.345 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:10.345 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.345 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:10.345 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.345 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:10.345 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167657+0000", 2024-09-12T22:50:10.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.346 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:10.346 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167657+0000", 2024-09-12T22:50:10.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.346 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:10.346 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167658+0000", 2024-09-12T22:50:10.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2200000000000003e-07 2024-09-12T22:50:10.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.346 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:10.347 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167662+0000", 2024-09-12T22:50:10.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1489999999999996e-06 2024-09-12T22:50:10.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.347 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.347 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:10.347 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167673+0000", 2024-09-12T22:50:10.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0614e-05 2024-09-12T22:50:10.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.347 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.347 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.347 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167679+0000", 2024-09-12T22:50:10.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1500000000000004e-06 2024-09-12T22:50:10.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.348 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:10.348 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243054+0000", 2024-09-12T22:50:10.348 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075375027999999997 2024-09-12T22:50:10.348 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.348 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:10.348 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243134+0000", 2024-09-12T22:50:10.348 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0210000000000006e-05 2024-09-12T22:50:10.348 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.348 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:10.348 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243263+0000", 2024-09-12T22:50:10.349 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012919 2024-09-12T22:50:10.349 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.349 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.349 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:10.349 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254075+0000", 2024-09-12T22:50:10.349 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010811523 2024-09-12T22:50:10.349 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.349 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.349 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:10.349 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260733+0000", 2024-09-12T22:50:10.349 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.006658153 2024-09-12T22:50:10.349 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.349 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.350 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:10.350 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260756+0000", 2024-09-12T22:50:10.350 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2696000000000001e-05 2024-09-12T22:50:10.350 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.350 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.350 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:10.350 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260791+0000", 2024-09-12T22:50:10.350 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5324000000000003e-05 2024-09-12T22:50:10.350 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.350 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:10.350 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.350 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.350 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.350 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1932 3.8 3:17051619:::200.0000000f:head [write 977466~2771 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:10.351 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:50:10.351 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.131692844, 2024-09-12T22:50:10.351 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.092944115999999993, 2024-09-12T22:50:10.351 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:10.351 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:10.351 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.351 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:10.351 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.351 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:10.351 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:50:10.351 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.351 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.351 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.352 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:10.352 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:50:10.352 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.352 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.352 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.352 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:10.352 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:50:10.352 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8400000000000004e-07 2024-09-12T22:50:10.352 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.352 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.352 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:10.352 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167952+0000", 2024-09-12T22:50:10.352 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.138e-06 2024-09-12T22:50:10.352 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.353 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.353 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:10.353 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167961+0000", 2024-09-12T22:50:10.353 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7990000000000005e-06 2024-09-12T22:50:10.353 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.353 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.353 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.353 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167968+0000", 2024-09-12T22:50:10.353 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4400000000000002e-06 2024-09-12T22:50:10.353 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.353 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.353 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:10.353 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.244002+0000", 2024-09-12T22:50:10.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.076034300999999999 2024-09-12T22:50:10.354 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.354 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:10.354 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.244061+0000", 2024-09-12T22:50:10.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8356999999999997e-05 2024-09-12T22:50:10.354 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.354 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:10.354 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.244161+0000", 2024-09-12T22:50:10.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000100126 2024-09-12T22:50:10.354 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.354 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:10.355 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254099+0000", 2024-09-12T22:50:10.355 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0099384940000000008 2024-09-12T22:50:10.355 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.355 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.355 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:10.355 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260799+0000", 2024-09-12T22:50:10.355 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0066995029999999999 2024-09-12T22:50:10.355 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.355 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.355 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:10.355 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260851+0000", 2024-09-12T22:50:10.355 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1861999999999999e-05 2024-09-12T22:50:10.355 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.355 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.356 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:10.356 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260891+0000", 2024-09-12T22:50:10.356 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0411999999999999e-05 2024-09-12T22:50:10.356 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.356 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:10.356 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.356 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.356 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.356 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1933 3.8 3:17051619:::200.0000000f:head [write 980237~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:10.356 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167993+0000", 2024-09-12T22:50:10.356 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.131646341, 2024-09-12T22:50:10.356 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.092952307999999997, 2024-09-12T22:50:10.356 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:10.357 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:10.357 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.357 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:10.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:10.357 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167993+0000", 2024-09-12T22:50:10.357 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.357 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:10.357 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167993+0000", 2024-09-12T22:50:10.357 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.358 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.358 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:10.358 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167994+0000", 2024-09-12T22:50:10.358 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5000000000000003e-07 2024-09-12T22:50:10.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.358 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.358 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:10.358 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167997+0000", 2024-09-12T22:50:10.358 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5559999999999999e-06 2024-09-12T22:50:10.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.358 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.358 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:10.358 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168005+0000", 2024-09-12T22:50:10.359 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.588e-06 2024-09-12T22:50:10.359 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.359 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.359 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.359 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168011+0000", 2024-09-12T22:50:10.359 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7780000000000004e-06 2024-09-12T22:50:10.359 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.359 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.359 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:10.359 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.247983+0000", 2024-09-12T22:50:10.359 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079972090999999995 2024-09-12T22:50:10.359 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.359 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.360 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:10.360 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248038+0000", 2024-09-12T22:50:10.360 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4889999999999998e-05 2024-09-12T22:50:10.360 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.360 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.360 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:10.360 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248136+0000", 2024-09-12T22:50:10.360 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8271999999999997e-05 2024-09-12T22:50:10.360 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.360 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.360 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:10.360 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254134+0000", 2024-09-12T22:50:10.360 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005997751 2024-09-12T22:50:10.360 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.361 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:10.361 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260898+0000", 2024-09-12T22:50:10.361 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0067646429999999999 2024-09-12T22:50:10.361 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.361 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:10.361 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260923+0000", 2024-09-12T22:50:10.361 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4080999999999999e-05 2024-09-12T22:50:10.361 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.362 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.362 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:10.362 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260946+0000", 2024-09-12T22:50:10.362 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3108e-05 2024-09-12T22:50:10.363 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.363 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:10.363 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.363 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.363 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.363 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1934 3.8 3:17051619:::200.0000000f:head [write 982156~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:10.363 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:50:10.363 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.131620855, 2024-09-12T22:50:10.363 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.093517738000000003, 2024-09-12T22:50:10.363 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:10.363 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:10.363 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.363 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:10.364 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.364 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:10.364 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:50:10.364 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.364 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.364 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.364 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:10.364 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:50:10.364 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.364 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.364 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.364 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:10.364 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:50:10.365 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6800000000000001e-07 2024-09-12T22:50:10.365 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.365 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.365 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:10.365 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168029+0000", 2024-09-12T22:50:10.365 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9699999999999994e-06 2024-09-12T22:50:10.365 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.365 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.365 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:10.365 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168036+0000", 2024-09-12T22:50:10.366 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9800000000000001e-06 2024-09-12T22:50:10.366 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.366 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.366 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.366 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168041+0000", 2024-09-12T22:50:10.366 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0629999999999996e-06 2024-09-12T22:50:10.366 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.366 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.366 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:10.366 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248449+0000", 2024-09-12T22:50:10.366 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.080407948000000007 2024-09-12T22:50:10.366 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.366 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.367 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:10.367 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248491+0000", 2024-09-12T22:50:10.367 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2027999999999998e-05 2024-09-12T22:50:10.367 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.367 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.367 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:10.367 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248569+0000", 2024-09-12T22:50:10.367 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8077000000000005e-05 2024-09-12T22:50:10.367 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.367 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.367 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:10.368 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260950+0000", 2024-09-12T22:50:10.368 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012380901 2024-09-12T22:50:10.368 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.368 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.368 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:10.368 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.261473+0000", 2024-09-12T22:50:10.368 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00052241699999999996 2024-09-12T22:50:10.368 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.369 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.369 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:10.369 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.261507+0000", 2024-09-12T22:50:10.369 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4616000000000002e-05 2024-09-12T22:50:10.369 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.369 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.369 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:10.369 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.261537+0000", 2024-09-12T22:50:10.369 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9369999999999998e-05 2024-09-12T22:50:10.369 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.369 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:10.369 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.369 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.369 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.370 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1935 3.8 3:17051619:::200.0000000f:head [write 984074~1914 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:10.370 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:50:10.370 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.131590933, 2024-09-12T22:50:10.370 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.097660714999999995, 2024-09-12T22:50:10.370 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:10.370 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:10.370 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.370 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:10.370 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.370 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:10.370 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:50:10.370 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.370 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.371 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.371 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:10.371 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:50:10.371 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.371 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.371 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.371 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:10.371 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:50:10.371 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4400000000000001e-07 2024-09-12T22:50:10.371 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.371 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.371 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:10.372 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168052+0000", 2024-09-12T22:50:10.372 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.886e-06 2024-09-12T22:50:10.372 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.372 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.372 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:10.372 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168059+0000", 2024-09-12T22:50:10.372 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0489999999999998e-06 2024-09-12T22:50:10.372 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.372 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.372 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.372 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168081+0000", 2024-09-12T22:50:10.372 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1800000000000001e-05 2024-09-12T22:50:10.372 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.373 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.373 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:10.373 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.250512+0000", 2024-09-12T22:50:10.373 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.082431322000000001 2024-09-12T22:50:10.373 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.373 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.373 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:10.373 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.250621+0000", 2024-09-12T22:50:10.373 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010908600000000001 2024-09-12T22:50:10.373 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.373 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.373 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:10.373 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.250970+0000", 2024-09-12T22:50:10.374 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034828399999999997 2024-09-12T22:50:10.374 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.374 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.374 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:10.374 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265532+0000", 2024-09-12T22:50:10.374 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01456268 2024-09-12T22:50:10.374 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.374 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.374 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:10.374 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265614+0000", 2024-09-12T22:50:10.374 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1796000000000001e-05 2024-09-12T22:50:10.374 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.374 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.375 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:10.375 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265673+0000", 2024-09-12T22:50:10.375 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9314000000000002e-05 2024-09-12T22:50:10.375 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.375 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.375 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:10.375 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265709+0000", 2024-09-12T22:50:10.375 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6053999999999997e-05 2024-09-12T22:50:10.375 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.375 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:10.375 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.375 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.375 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.376 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1936 3.8 3:17051619:::200.0000000f:head [write 985988~2437 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:10.376 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.168095+0000", 2024-09-12T22:50:10.376 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.131544586, 2024-09-12T22:50:10.376 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.097789345999999999, 2024-09-12T22:50:10.376 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:10.376 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:10.376 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.376 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:10.376 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.376 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:10.376 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168095+0000", 2024-09-12T22:50:10.376 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.377 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.377 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.377 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:10.377 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168095+0000", 2024-09-12T22:50:10.377 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.377 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.377 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.377 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:10.377 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168096+0000", 2024-09-12T22:50:10.377 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7700000000000005e-07 2024-09-12T22:50:10.377 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.377 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.377 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:10.377 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168099+0000", 2024-09-12T22:50:10.378 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.422e-06 2024-09-12T22:50:10.378 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.378 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.378 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:10.378 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168106+0000", 2024-09-12T22:50:10.378 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6889999999999998e-06 2024-09-12T22:50:10.378 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.378 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.378 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.378 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168110+0000", 2024-09-12T22:50:10.378 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8470000000000003e-06 2024-09-12T22:50:10.378 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.379 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.379 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:10.379 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251622+0000", 2024-09-12T22:50:10.379 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.083511539999999995 2024-09-12T22:50:10.379 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.379 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.379 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:10.379 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251674+0000", 2024-09-12T22:50:10.379 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1678999999999998e-05 2024-09-12T22:50:10.379 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.379 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.379 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:10.379 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251744+0000", 2024-09-12T22:50:10.380 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0440999999999999e-05 2024-09-12T22:50:10.380 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.380 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.380 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:10.380 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265545+0000", 2024-09-12T22:50:10.380 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013801000000000001 2024-09-12T22:50:10.380 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.380 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.380 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:10.380 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265771+0000", 2024-09-12T22:50:10.380 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000225632 2024-09-12T22:50:10.380 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.380 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.381 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:10.381 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265835+0000", 2024-09-12T22:50:10.381 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4541000000000004e-05 2024-09-12T22:50:10.381 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.381 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.381 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:10.381 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265884+0000", 2024-09-12T22:50:10.381 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9078e-05 2024-09-12T22:50:10.381 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.381 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:10.381 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.381 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.381 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.382 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1937 3.8 3:17051619:::200.0000000f:head [write 988425~1920 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:10.382 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.171188+0000", 2024-09-12T22:50:10.382 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.128451215, 2024-09-12T22:50:10.382 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.094794626000000007, 2024-09-12T22:50:10.382 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:10.382 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:10.382 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.382 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:10.382 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.382 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:10.382 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171188+0000", 2024-09-12T22:50:10.382 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.382 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.383 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.383 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:10.383 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171188+0000", 2024-09-12T22:50:10.383 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.383 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.383 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.383 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:10.383 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171189+0000", 2024-09-12T22:50:10.383 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3200000000000003e-07 2024-09-12T22:50:10.383 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.383 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.383 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:10.384 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171194+0000", 2024-09-12T22:50:10.384 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2690000000000001e-06 2024-09-12T22:50:10.384 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.384 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.384 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:10.384 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171201+0000", 2024-09-12T22:50:10.384 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5310000000000004e-06 2024-09-12T22:50:10.384 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.384 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.384 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.384 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171206+0000", 2024-09-12T22:50:10.384 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7049999999999998e-06 2024-09-12T22:50:10.385 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.385 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.385 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:10.385 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254169+0000", 2024-09-12T22:50:10.385 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.082962835999999998 2024-09-12T22:50:10.385 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.385 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.385 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:10.385 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254263+0000", 2024-09-12T22:50:10.385 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3844999999999993e-05 2024-09-12T22:50:10.385 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.385 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.386 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:10.386 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254398+0000", 2024-09-12T22:50:10.386 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013560499999999999 2024-09-12T22:50:10.386 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.386 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.386 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:10.386 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265897+0000", 2024-09-12T22:50:10.386 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01149846 2024-09-12T22:50:10.386 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.386 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.386 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:10.386 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265922+0000", 2024-09-12T22:50:10.386 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5130000000000002e-05 2024-09-12T22:50:10.386 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.387 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.387 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:10.387 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265954+0000", 2024-09-12T22:50:10.387 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2512999999999999e-05 2024-09-12T22:50:10.387 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.387 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.387 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:10.387 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265983+0000", 2024-09-12T22:50:10.387 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8799999999999999e-05 2024-09-12T22:50:10.387 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.387 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:10.387 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.387 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.387 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.388 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1938 3.8 3:17051619:::200.0000000f:head [write 990345~2499 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:10.388 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:50:10.388 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.128411035999999, 2024-09-12T22:50:10.388 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.094864730999999994, 2024-09-12T22:50:10.388 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:10.388 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:10.388 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.388 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:10.388 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.388 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:10.388 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:50:10.388 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.388 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:10.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:50:10.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:10.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:50:10.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:50:10.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:10.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171242+0000", 2024-09-12T22:50:10.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3111e-05 2024-09-12T22:50:10.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:10.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171247+0000", 2024-09-12T22:50:10.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0939999999999998e-06 2024-09-12T22:50:10.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171251+0000", 2024-09-12T22:50:10.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.298e-06 2024-09-12T22:50:10.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:10.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254869+0000", 2024-09-12T22:50:10.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.083618681 2024-09-12T22:50:10.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.391 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.391 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:10.391 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254957+0000", 2024-09-12T22:50:10.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7783999999999998e-05 2024-09-12T22:50:10.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.391 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.391 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:10.391 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255093+0000", 2024-09-12T22:50:10.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013579600000000001 2024-09-12T22:50:10.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.391 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:10.392 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265997+0000", 2024-09-12T22:50:10.392 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010903777999999999 2024-09-12T22:50:10.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:10.392 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266047+0000", 2024-09-12T22:50:10.392 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0151999999999997e-05 2024-09-12T22:50:10.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:10.392 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266075+0000", 2024-09-12T22:50:10.392 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8082e-05 2024-09-12T22:50:10.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.393 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:10.393 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266093+0000", 2024-09-12T22:50:10.393 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8396000000000001e-05 2024-09-12T22:50:10.393 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.393 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:10.393 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.393 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1944 3.8 3:17051619:::200.0000000f:head [write 1037561~3947 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:10.393 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.186089+0000", 2024-09-12T22:50:10.393 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.113550785999999, 2024-09-12T22:50:10.393 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087755745999999996, 2024-09-12T22:50:10.393 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:10.394 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:10.394 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.394 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:10.394 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.394 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:10.394 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186089+0000", 2024-09-12T22:50:10.394 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.394 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.394 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.394 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:10.394 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186089+0000", 2024-09-12T22:50:10.394 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.394 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.395 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.395 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:10.395 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186090+0000", 2024-09-12T22:50:10.395 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1349999999999999e-06 2024-09-12T22:50:10.395 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.395 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.395 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:10.395 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186098+0000", 2024-09-12T22:50:10.395 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8390000000000007e-06 2024-09-12T22:50:10.395 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.395 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.395 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:10.395 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186106+0000", 2024-09-12T22:50:10.395 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4619999999999996e-06 2024-09-12T22:50:10.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.396 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.396 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186111+0000", 2024-09-12T22:50:10.396 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.057e-06 2024-09-12T22:50:10.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.396 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:10.396 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.264543+0000", 2024-09-12T22:50:10.396 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078432044000000006 2024-09-12T22:50:10.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.396 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:10.397 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.264617+0000", 2024-09-12T22:50:10.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3789999999999997e-05 2024-09-12T22:50:10.397 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.397 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.397 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:10.397 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.264760+0000", 2024-09-12T22:50:10.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014318499999999999 2024-09-12T22:50:10.397 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.397 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.397 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:10.397 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268441+0000", 2024-09-12T22:50:10.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036809360000000001 2024-09-12T22:50:10.397 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:10.398 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273776+0000", 2024-09-12T22:50:10.398 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053346449999999998 2024-09-12T22:50:10.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:10.398 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273807+0000", 2024-09-12T22:50:10.398 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1352000000000001e-05 2024-09-12T22:50:10.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:10.398 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273845+0000", 2024-09-12T22:50:10.398 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7301000000000001e-05 2024-09-12T22:50:10.399 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.399 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:10.399 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.399 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1945 3.8 3:17051619:::200.0000000f:head [write 1041508~10144 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:10.399 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:50:10.399 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.113274014, 2024-09-12T22:50:10.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087573128, 2024-09-12T22:50:10.399 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:10.399 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:10.399 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.399 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:10.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.399 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:10.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:50:10.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:10.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:50:10.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:10.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:50:10.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1600000000000001e-07 2024-09-12T22:50:10.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.401 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:10.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186377+0000", 2024-09-12T22:50:10.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0301e-05 2024-09-12T22:50:10.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.401 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:10.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186386+0000", 2024-09-12T22:50:10.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5619999999999993e-06 2024-09-12T22:50:10.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.401 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186393+0000", 2024-09-12T22:50:10.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7150000000000001e-06 2024-09-12T22:50:10.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.402 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.402 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:10.402 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266725+0000", 2024-09-12T22:50:10.402 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.080331893000000001 2024-09-12T22:50:10.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.402 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.402 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:10.402 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266799+0000", 2024-09-12T22:50:10.402 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4086999999999997e-05 2024-09-12T22:50:10.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.402 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.402 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:10.403 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266904+0000", 2024-09-12T22:50:10.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105475 2024-09-12T22:50:10.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.403 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.403 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:10.403 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273882+0000", 2024-09-12T22:50:10.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069773780000000002 2024-09-12T22:50:10.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.403 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.403 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:10.403 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273889+0000", 2024-09-12T22:50:10.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1049999999999997e-06 2024-09-12T22:50:10.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.404 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.404 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:10.404 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273916+0000", 2024-09-12T22:50:10.404 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6716e-05 2024-09-12T22:50:10.404 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.404 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.404 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:10.404 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273939+0000", 2024-09-12T22:50:10.404 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3180000000000002e-05 2024-09-12T22:50:10.404 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.404 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:10.404 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.405 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1946 3.8 3:17051619:::200.0000000f:head [write 1051652~3875 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:10.405 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.186888+0000", 2024-09-12T22:50:10.405 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.112751735, 2024-09-12T22:50:10.405 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087165134000000005, 2024-09-12T22:50:10.405 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:10.405 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:10.405 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.405 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:10.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.405 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:10.405 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186888+0000", 2024-09-12T22:50:10.405 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.406 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.406 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.406 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:10.406 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186888+0000", 2024-09-12T22:50:10.406 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.406 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.406 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.406 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:10.406 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186889+0000", 2024-09-12T22:50:10.406 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2500000000000005e-07 2024-09-12T22:50:10.406 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.406 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.407 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:10.407 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186894+0000", 2024-09-12T22:50:10.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3900000000000001e-06 2024-09-12T22:50:10.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.407 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:10.407 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186901+0000", 2024-09-12T22:50:10.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5649999999999998e-06 2024-09-12T22:50:10.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.407 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.407 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186906+0000", 2024-09-12T22:50:10.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0390000000000004e-06 2024-09-12T22:50:10.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:10.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.267852+0000", 2024-09-12T22:50:10.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.080946389999999993 2024-09-12T22:50:10.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:10.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.267910+0000", 2024-09-12T22:50:10.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7655999999999998e-05 2024-09-12T22:50:10.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:10.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.267981+0000", 2024-09-12T22:50:10.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0916999999999999e-05 2024-09-12T22:50:10.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.409 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:10.409 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273944+0000", 2024-09-12T22:50:10.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0059635570000000004 2024-09-12T22:50:10.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.409 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:10.409 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273993+0000", 2024-09-12T22:50:10.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8350000000000003e-05 2024-09-12T22:50:10.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.409 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:10.410 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274022+0000", 2024-09-12T22:50:10.410 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9899999999999998e-05 2024-09-12T22:50:10.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.410 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:10.410 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274053+0000", 2024-09-12T22:50:10.410 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0645000000000002e-05 2024-09-12T22:50:10.410 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.410 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:10.410 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.410 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1947 3.8 3:17051619:::200.0000000f:head [write 1055527~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:10.410 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.187014+0000", 2024-09-12T22:50:10.411 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.112625501, 2024-09-12T22:50:10.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087114608999999996, 2024-09-12T22:50:10.411 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:10.411 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:10.411 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.411 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:10.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.411 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:10.411 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187014+0000", 2024-09-12T22:50:10.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.411 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:10.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187014+0000", 2024-09-12T22:50:10.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.412 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:10.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187015+0000", 2024-09-12T22:50:10.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1500000000000004e-07 2024-09-12T22:50:10.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.412 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:10.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187018+0000", 2024-09-12T22:50:10.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.033e-06 2024-09-12T22:50:10.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:10.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187023+0000", 2024-09-12T22:50:10.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7550000000000002e-06 2024-09-12T22:50:10.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187026+0000", 2024-09-12T22:50:10.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2710000000000001e-06 2024-09-12T22:50:10.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:10.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268462+0000", 2024-09-12T22:50:10.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.081435699 2024-09-12T22:50:10.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.414 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.414 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:10.414 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268507+0000", 2024-09-12T22:50:10.414 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5643999999999999e-05 2024-09-12T22:50:10.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.414 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.414 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:10.414 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268597+0000", 2024-09-12T22:50:10.414 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0112999999999996e-05 2024-09-12T22:50:10.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.414 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.414 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:10.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273947+0000", 2024-09-12T22:50:10.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053501859999999998 2024-09-12T22:50:10.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:10.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274083+0000", 2024-09-12T22:50:10.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013525500000000001 2024-09-12T22:50:10.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:10.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274109+0000", 2024-09-12T22:50:10.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6352000000000001e-05 2024-09-12T22:50:10.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.416 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:10.416 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274129+0000", 2024-09-12T22:50:10.416 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9686000000000001e-05 2024-09-12T22:50:10.416 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.416 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:10.416 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.416 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.416 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1948 3.8 3:17051619:::200.0000000f:head [write 1057443~1896 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:10.416 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.189230+0000", 2024-09-12T22:50:10.416 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.110409689000001, 2024-09-12T22:50:10.416 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.085028962999999999, 2024-09-12T22:50:10.416 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:10.416 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:10.417 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.417 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:10.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.417 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:10.417 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189230+0000", 2024-09-12T22:50:10.417 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.417 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:10.417 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189230+0000", 2024-09-12T22:50:10.417 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:10.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.417 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:10.418 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189231+0000", 2024-09-12T22:50:10.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1399999999999996e-07 2024-09-12T22:50:10.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.418 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:10.418 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189235+0000", 2024-09-12T22:50:10.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5970000000000002e-06 2024-09-12T22:50:10.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.418 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:10.418 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189242+0000", 2024-09-12T22:50:10.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8510000000000001e-06 2024-09-12T22:50:10.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.419 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189247+0000", 2024-09-12T22:50:10.419 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4800000000000003e-06 2024-09-12T22:50:10.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:10.419 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268908+0000", 2024-09-12T22:50:10.419 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079660983000000005 2024-09-12T22:50:10.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:10.419 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268967+0000", 2024-09-12T22:50:10.419 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9595000000000001e-05 2024-09-12T22:50:10.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.420 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:10.420 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.269040+0000", 2024-09-12T22:50:10.420 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2643000000000002e-05 2024-09-12T22:50:10.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.420 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:10.420 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273950+0000", 2024-09-12T22:50:10.420 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049105329999999999 2024-09-12T22:50:10.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.420 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:10.420 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274199+0000", 2024-09-12T22:50:10.421 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024824999999999999 2024-09-12T22:50:10.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.421 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.421 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:10.421 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274226+0000", 2024-09-12T22:50:10.421 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7602000000000001e-05 2024-09-12T22:50:10.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:10.421 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:10.421 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:10.421 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274259+0000", 2024-09-12T22:50:10.421 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2614999999999999e-05 2024-09-12T22:50:10.421 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.421 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:10.422 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.422 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:10.422 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:10.422 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:50:10.423 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:10.422+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:10.424 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:50:10.425 DEBUG:teuthology.parallel:result is None 2024-09-12T22:50:10.425 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T22:50:10.459 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T22:50:10.459 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-12T22:50:10.472 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-12T22:50:10.472 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T22:50:10.472 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T22:50:10.515 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T22:50:10.515 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T22:50:10.524 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:10.522+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:10.529 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:50:10.529 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:50:10.529 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:50:10.529 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:50:10.538 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:50:10.572 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T22:50:10.624 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:10.623+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:10.640 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:50:10.640 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:50:10.640 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:50:10.640 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:50:10.640 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:50:10.648 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:50:10.725 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:10.724+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:10.742 INFO:teuthology.orchestra.run.smithi066.stderr:noscrub is set 2024-09-12T22:50:10.754 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:50:10.754 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:50:10.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:50:10.754 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:50:10.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.755 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12403 4.0 4:0146e0d0:::100000031d4.00000000:head [write 0~4194304 [2@3733965]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:10.755 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:55.747692+0000", 2024-09-12T22:50:10.755 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 15.004743767000001, 2024-09-12T22:50:10.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.22362137500000001, 2024-09-12T22:50:10.755 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:10.755 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:10.755 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.755 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:10.755 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:10.755 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:10.755 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12403 2024-09-12T22:50:10.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.756 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:10.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.756 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:10.756 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.747692+0000", 2024-09-12T22:50:10.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.756 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:10.756 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.747692+0000", 2024-09-12T22:50:10.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:10.757 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.747693+0000", 2024-09-12T22:50:10.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3799999999999996e-07 2024-09-12T22:50:10.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:10.757 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959640+0000", 2024-09-12T22:50:10.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.21194702000000001 2024-09-12T22:50:10.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:10.757 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959660+0000", 2024-09-12T22:50:10.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9939e-05 2024-09-12T22:50:10.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959668+0000", 2024-09-12T22:50:10.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1669999999999999e-06 2024-09-12T22:50:10.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:10.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959764+0000", 2024-09-12T22:50:10.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5315000000000005e-05 2024-09-12T22:50:10.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:10.759 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959865+0000", 2024-09-12T22:50:10.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101618 2024-09-12T22:50:10.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:10.759 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.971224+0000", 2024-09-12T22:50:10.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011358541999999999 2024-09-12T22:50:10.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:10.759 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.971261+0000", 2024-09-12T22:50:10.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7092999999999999e-05 2024-09-12T22:50:10.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.760 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:10.760 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.971314+0000", 2024-09-12T22:50:10.760 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2843000000000002e-05 2024-09-12T22:50:10.760 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.760 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:10.760 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.760 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:12503 4.15 e56/17 4:ab29d13f:::100000033b1.00000000:head v 56'161, mlcod=55'159)", 2024-09-12T22:50:10.760 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:50:10.761 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 14.72183029, 2024-09-12T22:50:10.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.043668640000000002, 2024-09-12T22:50:10.761 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:10.761 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:10.761 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.761 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:10.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:10.761 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:50:10.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:10.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:50:10.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:10.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:50:10.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:50:10.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:10.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039768+0000", 2024-09-12T22:50:10.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0091617190000000005 2024-09-12T22:50:10.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:10.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039781+0000", 2024-09-12T22:50:10.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2829e-05 2024-09-12T22:50:10.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039789+0000", 2024-09-12T22:50:10.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9340000000000006e-06 2024-09-12T22:50:10.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:10.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039846+0000", 2024-09-12T22:50:10.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6762999999999998e-05 2024-09-12T22:50:10.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:10.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039897+0000", 2024-09-12T22:50:10.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1517000000000002e-05 2024-09-12T22:50:10.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:10.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074225+0000", 2024-09-12T22:50:10.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034328138000000001 2024-09-12T22:50:10.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:10.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074274+0000", 2024-09-12T22:50:10.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9255999999999997e-05 2024-09-12T22:50:10.765 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.765 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:10.765 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.765 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12508 4.2d 4:b7b19b64:::10000003230.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:10.765 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.037293+0000", 2024-09-12T22:50:10.765 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 14.715143115, 2024-09-12T22:50:10.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.037399772999999997, 2024-09-12T22:50:10.766 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:10.766 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:10.766 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.766 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:10.766 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:10.766 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:10.766 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12508 2024-09-12T22:50:10.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.766 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:10.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.766 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:10.766 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037293+0000", 2024-09-12T22:50:10.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:10.767 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037293+0000", 2024-09-12T22:50:10.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:10.767 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037294+0000", 2024-09-12T22:50:10.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4899999999999995e-07 2024-09-12T22:50:10.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:10.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042701+0000", 2024-09-12T22:50:10.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054069419999999997 2024-09-12T22:50:10.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:10.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042712+0000", 2024-09-12T22:50:10.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.171e-05 2024-09-12T22:50:10.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042719+0000", 2024-09-12T22:50:10.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1189999999999999e-06 2024-09-12T22:50:10.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:10.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042759+0000", 2024-09-12T22:50:10.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9478999999999999e-05 2024-09-12T22:50:10.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:10.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042827+0000", 2024-09-12T22:50:10.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8435999999999993e-05 2024-09-12T22:50:10.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:10.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042965+0000", 2024-09-12T22:50:10.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000137723 2024-09-12T22:50:10.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:10.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.058351+0000", 2024-09-12T22:50:10.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015385902 2024-09-12T22:50:10.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:10.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074620+0000", 2024-09-12T22:50:10.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016269018 2024-09-12T22:50:10.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:10.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074657+0000", 2024-09-12T22:50:10.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6619999999999998e-05 2024-09-12T22:50:10.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:10.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074693+0000", 2024-09-12T22:50:10.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6174999999999998e-05 2024-09-12T22:50:10.771 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.771 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:10.771 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.772 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12516 4.21 4:858ae08d:::100000030eb.00000000:head [write 0~4194304 [3@1582458]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:10.772 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.045143+0000", 2024-09-12T22:50:10.772 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 14.707292827, 2024-09-12T22:50:10.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.039721657, 2024-09-12T22:50:10.772 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:10.772 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:10.772 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.772 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:10.772 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:10.772 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:10.773 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12516 2024-09-12T22:50:10.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.773 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:10.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:10.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.045143+0000", 2024-09-12T22:50:10.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:10.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.045143+0000", 2024-09-12T22:50:10.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:10.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.045144+0000", 2024-09-12T22:50:10.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2900000000000002e-07 2024-09-12T22:50:10.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:10.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049506+0000", 2024-09-12T22:50:10.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043620280000000004 2024-09-12T22:50:10.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:10.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049517+0000", 2024-09-12T22:50:10.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0726e-05 2024-09-12T22:50:10.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049522+0000", 2024-09-12T22:50:10.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3730000000000001e-06 2024-09-12T22:50:10.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:10.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049583+0000", 2024-09-12T22:50:10.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1254999999999995e-05 2024-09-12T22:50:10.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:10.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049645+0000", 2024-09-12T22:50:10.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1988000000000003e-05 2024-09-12T22:50:10.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:10.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049731+0000", 2024-09-12T22:50:10.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6040999999999998e-05 2024-09-12T22:50:10.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:10.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.064126+0000", 2024-09-12T22:50:10.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01439497 2024-09-12T22:50:10.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:10.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.084785+0000", 2024-09-12T22:50:10.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020658972000000001 2024-09-12T22:50:10.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:10.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.084829+0000", 2024-09-12T22:50:10.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3869000000000003e-05 2024-09-12T22:50:10.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:10.778 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.084865+0000", 2024-09-12T22:50:10.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5605999999999998e-05 2024-09-12T22:50:10.778 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.778 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:10.778 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.778 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1354 3.18 3:1e8917d7:::200.0000000e:head [write 498872~14494 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:10.778 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.048337+0000", 2024-09-12T22:50:10.778 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 14.704098908000001, 2024-09-12T22:50:10.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034292491000000001, 2024-09-12T22:50:10.778 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:10.779 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:10.779 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.779 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:10.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:10.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048337+0000", 2024-09-12T22:50:10.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:10.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048337+0000", 2024-09-12T22:50:10.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:10.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048339+0000", 2024-09-12T22:50:10.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.409e-06 2024-09-12T22:50:10.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:10.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048360+0000", 2024-09-12T22:50:10.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1659999999999999e-05 2024-09-12T22:50:10.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:10.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048370+0000", 2024-09-12T22:50:10.781 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.611e-06 2024-09-12T22:50:10.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.781 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.781 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048376+0000", 2024-09-12T22:50:10.781 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5479999999999998e-06 2024-09-12T22:50:10.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.781 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:10.781 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048440+0000", 2024-09-12T22:50:10.781 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3367000000000005e-05 2024-09-12T22:50:10.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.782 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:10.782 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048557+0000", 2024-09-12T22:50:10.782 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116983 2024-09-12T22:50:10.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.782 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.782 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:10.782 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048719+0000", 2024-09-12T22:50:10.782 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016250499999999999 2024-09-12T22:50:10.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.782 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.782 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:10.782 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.058763+0000", 2024-09-12T22:50:10.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010043948 2024-09-12T22:50:10.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.783 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:10.783 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082499+0000", 2024-09-12T22:50:10.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023735320000000001 2024-09-12T22:50:10.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.783 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:10.783 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082561+0000", 2024-09-12T22:50:10.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2490000000000006e-05 2024-09-12T22:50:10.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.784 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:10.784 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082630+0000", 2024-09-12T22:50:10.784 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8650000000000002e-05 2024-09-12T22:50:10.784 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.784 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:10.784 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.784 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12517 4.1a 4:5a8c04dd:::10000003276.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:10.784 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.049539+0000", 2024-09-12T22:50:10.785 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 14.702897146, 2024-09-12T22:50:10.785 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.036068957999999998, 2024-09-12T22:50:10.785 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:10.785 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:10.785 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.785 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:10.785 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:10.785 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:10.785 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12517 2024-09-12T22:50:10.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.785 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:10.785 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.786 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:10.786 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049539+0000", 2024-09-12T22:50:10.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.786 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:10.786 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049539+0000", 2024-09-12T22:50:10.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.786 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:10.786 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049540+0000", 2024-09-12T22:50:10.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1299999999999999e-07 2024-09-12T22:50:10.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:10.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054581+0000", 2024-09-12T22:50:10.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005041167 2024-09-12T22:50:10.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:10.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054593+0000", 2024-09-12T22:50:10.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1943000000000001e-05 2024-09-12T22:50:10.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054598+0000", 2024-09-12T22:50:10.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6500000000000001e-06 2024-09-12T22:50:10.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.788 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:10.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054658+0000", 2024-09-12T22:50:10.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9898999999999997e-05 2024-09-12T22:50:10.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.788 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:10.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054800+0000", 2024-09-12T22:50:10.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014187100000000001 2024-09-12T22:50:10.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:10.789 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.085456+0000", 2024-09-12T22:50:10.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.030655452 2024-09-12T22:50:10.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:10.789 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.085533+0000", 2024-09-12T22:50:10.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7478999999999995e-05 2024-09-12T22:50:10.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:10.789 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.085608+0000", 2024-09-12T22:50:10.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4684000000000005e-05 2024-09-12T22:50:10.790 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.790 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:10.790 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.790 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12677 4.10 4:0b7ac23f:::10000003457.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:10.790 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:50:10.790 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 14.52302235, 2024-09-12T22:50:10.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033661045000000001, 2024-09-12T22:50:10.790 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:10.790 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:10.790 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.791 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:10.791 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:10.791 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:10.791 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12677 2024-09-12T22:50:10.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.791 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:10.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:10.791 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:50:10.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:10.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:50:10.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:10.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:50:10.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0100000000000005e-07 2024-09-12T22:50:10.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:10.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.237295+0000", 2024-09-12T22:50:10.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078803290000000002 2024-09-12T22:50:10.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:10.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.237307+0000", 2024-09-12T22:50:10.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2339e-05 2024-09-12T22:50:10.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.237312+0000", 2024-09-12T22:50:10.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9089999999999999e-06 2024-09-12T22:50:10.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:10.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.239034+0000", 2024-09-12T22:50:10.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001722424 2024-09-12T22:50:10.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:10.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.239129+0000", 2024-09-12T22:50:10.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4486000000000003e-05 2024-09-12T22:50:10.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:10.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.239206+0000", 2024-09-12T22:50:10.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7146999999999998e-05 2024-09-12T22:50:10.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:10.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.255921+0000", 2024-09-12T22:50:10.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016714685 2024-09-12T22:50:10.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:10.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.263025+0000", 2024-09-12T22:50:10.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071042470000000002 2024-09-12T22:50:10.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:10.796 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.263052+0000", 2024-09-12T22:50:10.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7195e-05 2024-09-12T22:50:10.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.796 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.796 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:10.796 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.263075+0000", 2024-09-12T22:50:10.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2782999999999999e-05 2024-09-12T22:50:10.796 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.796 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:10.796 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.796 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.797 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12979 4.1e 4:78503759:::10000003406.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:10.797 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:50:10.797 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 14.187335554000001, 2024-09-12T22:50:10.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032861456999999997, 2024-09-12T22:50:10.797 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:10.797 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:10.797 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.797 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:10.797 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:10.797 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:10.797 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12979 2024-09-12T22:50:10.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.797 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:10.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:10.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:50:10.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:10.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:50:10.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:10.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:50:10.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9999999999999998e-07 2024-09-12T22:50:10.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:10.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573365+0000", 2024-09-12T22:50:10.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082644229999999999 2024-09-12T22:50:10.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:10.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573379+0000", 2024-09-12T22:50:10.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3322999999999999e-05 2024-09-12T22:50:10.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.800 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573386+0000", 2024-09-12T22:50:10.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.199e-06 2024-09-12T22:50:10.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.800 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:10.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573464+0000", 2024-09-12T22:50:10.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7931999999999999e-05 2024-09-12T22:50:10.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:10.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573713+0000", 2024-09-12T22:50:10.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024922200000000001 2024-09-12T22:50:10.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:10.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.597870+0000", 2024-09-12T22:50:10.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024157221999999999 2024-09-12T22:50:10.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:10.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.597926+0000", 2024-09-12T22:50:10.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5838000000000003e-05 2024-09-12T22:50:10.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.802 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.802 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:10.802 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.597962+0000", 2024-09-12T22:50:10.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5898000000000001e-05 2024-09-12T22:50:10.802 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.802 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:10.802 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.802 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.802 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:13017 4.3b e56/17 4:deb39c3c:::1000000315d.00000000:head v 56'194, mlcod=56'192)", 2024-09-12T22:50:10.802 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.600876+0000", 2024-09-12T22:50:10.803 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 14.151560077999999, 2024-09-12T22:50:10.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038152448999999998, 2024-09-12T22:50:10.803 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:10.803 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:10.803 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.803 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:10.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.803 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:10.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.600876+0000", 2024-09-12T22:50:10.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.803 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:10.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.600876+0000", 2024-09-12T22:50:10.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:10.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.600877+0000", 2024-09-12T22:50:10.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:50:10.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:10.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609737+0000", 2024-09-12T22:50:10.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088599089999999991 2024-09-12T22:50:10.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:10.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609748+0000", 2024-09-12T22:50:10.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1355999999999999e-05 2024-09-12T22:50:10.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609757+0000", 2024-09-12T22:50:10.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9190000000000005e-06 2024-09-12T22:50:10.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:10.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609801+0000", 2024-09-12T22:50:10.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4019e-05 2024-09-12T22:50:10.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:10.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609816+0000", 2024-09-12T22:50:10.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5226e-05 2024-09-12T22:50:10.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:10.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.638985+0000", 2024-09-12T22:50:10.807 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029168537000000001 2024-09-12T22:50:10.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.807 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.807 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:10.807 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.639028+0000", 2024-09-12T22:50:10.807 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3847000000000002e-05 2024-09-12T22:50:10.807 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.807 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:10.807 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.807 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.807 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13032 4.7 4:e102bf81:::1000000359e.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:10.808 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.616553+0000", 2024-09-12T22:50:10.808 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 14.135883226000001, 2024-09-12T22:50:10.808 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032471027999999999, 2024-09-12T22:50:10.808 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:10.808 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:10.808 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.808 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:10.808 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:10.808 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:10.808 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13032 2024-09-12T22:50:10.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.808 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:10.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:10.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.616553+0000", 2024-09-12T22:50:10.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:10.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.616553+0000", 2024-09-12T22:50:10.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:10.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.616554+0000", 2024-09-12T22:50:10.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0100000000000004e-07 2024-09-12T22:50:10.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.810 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:10.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621405+0000", 2024-09-12T22:50:10.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0048517480000000003 2024-09-12T22:50:10.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.810 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:10.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621416+0000", 2024-09-12T22:50:10.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0264e-05 2024-09-12T22:50:10.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.811 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.811 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621446+0000", 2024-09-12T22:50:10.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0849000000000002e-05 2024-09-12T22:50:10.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.811 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:10.811 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621494+0000", 2024-09-12T22:50:10.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7018000000000003e-05 2024-09-12T22:50:10.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.811 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:10.811 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621590+0000", 2024-09-12T22:50:10.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6632999999999995e-05 2024-09-12T22:50:10.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.812 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:10.812 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621680+0000", 2024-09-12T22:50:10.812 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9704999999999996e-05 2024-09-12T22:50:10.812 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.812 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:10.812 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.639248+0000", 2024-09-12T22:50:10.812 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017568548 2024-09-12T22:50:10.812 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.812 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:10.812 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.648944+0000", 2024-09-12T22:50:10.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0096954659999999998 2024-09-12T22:50:10.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.813 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:10.813 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.648992+0000", 2024-09-12T22:50:10.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8059999999999997e-05 2024-09-12T22:50:10.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.813 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:10.813 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.649024+0000", 2024-09-12T22:50:10.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1936000000000001e-05 2024-09-12T22:50:10.813 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.813 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:10.813 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.814 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13428 4.37 4:eeed8456:::1000000321a.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:10.814 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.064666+0000", 2024-09-12T22:50:10.814 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.687769948, 2024-09-12T22:50:10.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033441308000000003, 2024-09-12T22:50:10.814 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:10.814 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:10.814 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.814 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:10.814 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:10.814 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:10.815 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13428 2024-09-12T22:50:10.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.815 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:10.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:10.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.064666+0000", 2024-09-12T22:50:10.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:10.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.064666+0000", 2024-09-12T22:50:10.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.816 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:10.816 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.064668+0000", 2024-09-12T22:50:10.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4160000000000001e-06 2024-09-12T22:50:10.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.816 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:10.816 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071829+0000", 2024-09-12T22:50:10.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071611390000000004 2024-09-12T22:50:10.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.817 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:10.817 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071840+0000", 2024-09-12T22:50:10.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1369000000000001e-05 2024-09-12T22:50:10.817 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.817 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.817 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.817 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071847+0000", 2024-09-12T22:50:10.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0960000000000003e-06 2024-09-12T22:50:10.817 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.817 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.817 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:10.817 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071904+0000", 2024-09-12T22:50:10.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7309000000000003e-05 2024-09-12T22:50:10.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.818 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.818 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:10.818 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.072051+0000", 2024-09-12T22:50:10.818 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014625 2024-09-12T22:50:10.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.818 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.818 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:10.818 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.072194+0000", 2024-09-12T22:50:10.818 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014379799999999999 2024-09-12T22:50:10.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.818 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.818 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:10.818 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.079527+0000", 2024-09-12T22:50:10.819 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007332674 2024-09-12T22:50:10.819 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.819 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.819 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:10.819 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.098048+0000", 2024-09-12T22:50:10.819 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018521174000000001 2024-09-12T22:50:10.819 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.819 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.819 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:10.819 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.098081+0000", 2024-09-12T22:50:10.819 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2910999999999997e-05 2024-09-12T22:50:10.819 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.819 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.820 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:10.820 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.098107+0000", 2024-09-12T22:50:10.820 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6171999999999999e-05 2024-09-12T22:50:10.820 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.820 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:10.820 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.820 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.820 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.820 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13472 4.12 4:4b0bd9b8:::100000033b0.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:10.820 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.113168+0000", 2024-09-12T22:50:10.820 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.639268249000001, 2024-09-12T22:50:10.821 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.039534103000000001, 2024-09-12T22:50:10.821 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:10.821 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:10.821 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.821 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:10.821 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:10.821 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:10.821 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13472 2024-09-12T22:50:10.821 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.821 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:10.821 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.821 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:10.821 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.113168+0000", 2024-09-12T22:50:10.822 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.822 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.822 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:10.822 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.113168+0000", 2024-09-12T22:50:10.822 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.822 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.822 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:10.822 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.113169+0000", 2024-09-12T22:50:10.822 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1960000000000001e-06 2024-09-12T22:50:10.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.823 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:10.823 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119849+0000", 2024-09-12T22:50:10.823 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0066801830000000001 2024-09-12T22:50:10.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.823 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:10.823 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119861+0000", 2024-09-12T22:50:10.823 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.199e-05 2024-09-12T22:50:10.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.823 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.823 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119866+0000", 2024-09-12T22:50:10.824 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8720000000000001e-06 2024-09-12T22:50:10.824 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.824 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.824 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:10.824 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119945+0000", 2024-09-12T22:50:10.824 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9268000000000001e-05 2024-09-12T22:50:10.824 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.824 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.824 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:10.824 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.120098+0000", 2024-09-12T22:50:10.824 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015299500000000001 2024-09-12T22:50:10.825 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.825 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.825 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:10.825 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.120218+0000", 2024-09-12T22:50:10.825 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011989099999999999 2024-09-12T22:50:10.825 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.825 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.825 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:10.825 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.140463+0000", 2024-09-12T22:50:10.825 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020244765000000001 2024-09-12T22:50:10.825 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.825 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.826 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:10.826 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.152629+0000", 2024-09-12T22:50:10.826 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012165601999999999 2024-09-12T22:50:10.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.826 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.826 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:10.826 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.152664+0000", 2024-09-12T22:50:10.826 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5599999999999998e-05 2024-09-12T22:50:10.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.826 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.826 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:10.826 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.152702+0000", 2024-09-12T22:50:10.827 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7741000000000003e-05 2024-09-12T22:50:10.827 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.827 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:10.827 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.827 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13484 4.2f 4:f62c2e43:::1000000349e.00000000:head [write 0~4194304 [2@3461078]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:10.827 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.125796+0000", 2024-09-12T22:50:10.828 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.626639886, 2024-09-12T22:50:10.828 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.036857236000000002, 2024-09-12T22:50:10.828 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:10.828 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:10.828 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.828 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:10.828 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:10.828 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:10.828 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13484 2024-09-12T22:50:10.828 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.828 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:10.828 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.828 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:10.829 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.125796+0000", 2024-09-12T22:50:10.829 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.829 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.829 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.829 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:10.829 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.125796+0000", 2024-09-12T22:50:10.829 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.829 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.829 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.829 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:10.830 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.125797+0000", 2024-09-12T22:50:10.830 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.108e-06 2024-09-12T22:50:10.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.830 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.830 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:10.830 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130725+0000", 2024-09-12T22:50:10.830 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049272949999999999 2024-09-12T22:50:10.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.830 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.830 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:10.830 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130739+0000", 2024-09-12T22:50:10.830 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4234e-05 2024-09-12T22:50:10.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.831 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.831 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.831 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130751+0000", 2024-09-12T22:50:10.831 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1848000000000001e-05 2024-09-12T22:50:10.831 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.831 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.831 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:10.831 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130816+0000", 2024-09-12T22:50:10.831 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5359999999999998e-05 2024-09-12T22:50:10.831 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.831 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.831 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:10.832 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130917+0000", 2024-09-12T22:50:10.832 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101178 2024-09-12T22:50:10.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.832 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.832 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:10.832 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.131058+0000", 2024-09-12T22:50:10.832 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140803 2024-09-12T22:50:10.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.832 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.833 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:10.833 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.153387+0000", 2024-09-12T22:50:10.833 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022328585000000001 2024-09-12T22:50:10.833 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.833 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.833 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:10.833 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.162465+0000", 2024-09-12T22:50:10.833 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090781360000000005 2024-09-12T22:50:10.833 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.833 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.833 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:10.833 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.162584+0000", 2024-09-12T22:50:10.833 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119634 2024-09-12T22:50:10.833 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.834 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.834 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:10.834 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.162653+0000", 2024-09-12T22:50:10.834 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9054999999999995e-05 2024-09-12T22:50:10.834 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.834 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:10.834 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.834 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.834 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.834 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13558 4.10 4:09df41af:::1000000333c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:10.834 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.229326+0000", 2024-09-12T22:50:10.834 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.523110058, 2024-09-12T22:50:10.835 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.039409786000000002, 2024-09-12T22:50:10.835 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:10.835 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:10.835 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.835 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:10.835 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:10.835 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:10.835 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13558 2024-09-12T22:50:10.835 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.835 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:10.835 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.835 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:10.835 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.229326+0000", 2024-09-12T22:50:10.836 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.836 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.836 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.836 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:10.836 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.229326+0000", 2024-09-12T22:50:10.836 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.836 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.836 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.836 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:10.836 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.229327+0000", 2024-09-12T22:50:10.836 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1200000000000002e-07 2024-09-12T22:50:10.836 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.836 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.837 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:10.837 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235243+0000", 2024-09-12T22:50:10.837 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059166310000000003 2024-09-12T22:50:10.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.837 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:10.837 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235255+0000", 2024-09-12T22:50:10.837 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1174e-05 2024-09-12T22:50:10.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.837 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.837 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235260+0000", 2024-09-12T22:50:10.837 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1749999999999996e-06 2024-09-12T22:50:10.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.838 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:10.838 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235295+0000", 2024-09-12T22:50:10.838 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4830999999999999e-05 2024-09-12T22:50:10.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.838 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:10.838 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235350+0000", 2024-09-12T22:50:10.838 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5092e-05 2024-09-12T22:50:10.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.838 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:10.839 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235426+0000", 2024-09-12T22:50:10.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6463000000000003e-05 2024-09-12T22:50:10.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.839 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:10.839 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.244772+0000", 2024-09-12T22:50:10.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0093457709999999992 2024-09-12T22:50:10.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.839 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:10.839 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.268679+0000", 2024-09-12T22:50:10.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023906788000000002 2024-09-12T22:50:10.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.840 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:10.840 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.268712+0000", 2024-09-12T22:50:10.840 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3701999999999997e-05 2024-09-12T22:50:10.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.840 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.840 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:10.840 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.268736+0000", 2024-09-12T22:50:10.840 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3447000000000001e-05 2024-09-12T22:50:10.840 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.840 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:10.840 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.841 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.841 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13747 4.1e 4:7aa36f33:::100000035ed.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:10.841 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.457376+0000", 2024-09-12T22:50:10.841 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.295059944, 2024-09-12T22:50:10.841 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.037057578000000001, 2024-09-12T22:50:10.841 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:10.841 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:10.841 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.841 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:10.841 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:10.841 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:10.841 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13747 2024-09-12T22:50:10.841 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.841 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:10.842 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.842 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:10.842 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.457376+0000", 2024-09-12T22:50:10.842 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.842 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.842 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.842 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:10.842 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.457376+0000", 2024-09-12T22:50:10.842 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.842 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.842 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.842 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:10.842 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.457377+0000", 2024-09-12T22:50:10.843 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1699999999999998e-07 2024-09-12T22:50:10.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.843 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:10.843 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464400+0000", 2024-09-12T22:50:10.843 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070235890000000002 2024-09-12T22:50:10.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.843 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:10.843 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464413+0000", 2024-09-12T22:50:10.843 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2397e-05 2024-09-12T22:50:10.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.844 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.844 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464418+0000", 2024-09-12T22:50:10.844 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5119999999999999e-06 2024-09-12T22:50:10.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.844 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:10.844 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464464+0000", 2024-09-12T22:50:10.844 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5976000000000002e-05 2024-09-12T22:50:10.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.844 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:10.844 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464529+0000", 2024-09-12T22:50:10.844 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5266999999999997e-05 2024-09-12T22:50:10.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.845 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.845 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:10.845 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.494315+0000", 2024-09-12T22:50:10.845 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029785329999999999 2024-09-12T22:50:10.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.845 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.845 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:10.845 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.494366+0000", 2024-09-12T22:50:10.845 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0903999999999999e-05 2024-09-12T22:50:10.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.845 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.845 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:10.845 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.494434+0000", 2024-09-12T22:50:10.846 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7985999999999996e-05 2024-09-12T22:50:10.846 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.846 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:10.846 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.846 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.846 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.846 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:13748 4.15 e56/17 4:ab1b03eb:::100000031a3.00000000:head v 56'173, mlcod=56'171)", 2024-09-12T22:50:10.846 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.462509+0000", 2024-09-12T22:50:10.846 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.289926897000001, 2024-09-12T22:50:10.846 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044366823, 2024-09-12T22:50:10.846 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:10.846 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:10.846 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.847 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:10.847 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.847 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:10.847 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.462509+0000", 2024-09-12T22:50:10.847 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.847 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.847 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.847 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:10.847 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.462509+0000", 2024-09-12T22:50:10.847 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.847 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.847 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.847 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:10.848 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.462509+0000", 2024-09-12T22:50:10.848 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7599999999999998e-07 2024-09-12T22:50:10.848 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.848 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.848 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:10.848 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471576+0000", 2024-09-12T22:50:10.848 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090665490000000001 2024-09-12T22:50:10.848 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.848 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.848 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:10.848 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471591+0000", 2024-09-12T22:50:10.848 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4566000000000001e-05 2024-09-12T22:50:10.848 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.849 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.849 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.849 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471600+0000", 2024-09-12T22:50:10.849 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1630000000000002e-06 2024-09-12T22:50:10.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.849 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.849 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:10.849 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471689+0000", 2024-09-12T22:50:10.849 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9591000000000003e-05 2024-09-12T22:50:10.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.849 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.849 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:10.849 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471735+0000", 2024-09-12T22:50:10.850 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5429000000000002e-05 2024-09-12T22:50:10.850 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.850 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:10.850 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.506851+0000", 2024-09-12T22:50:10.850 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035116238000000001 2024-09-12T22:50:10.850 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.850 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:10.850 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.506876+0000", 2024-09-12T22:50:10.850 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5011000000000002e-05 2024-09-12T22:50:10.850 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.850 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:10.850 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.851 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13753 4.30 4:0dea61b7:::100000036ed.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:10.851 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.464559+0000", 2024-09-12T22:50:10.851 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.287876898, 2024-09-12T22:50:10.851 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041415303000000001, 2024-09-12T22:50:10.851 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:10.851 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:10.851 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.851 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:10.851 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:10.851 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:10.851 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13753 2024-09-12T22:50:10.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.852 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:10.852 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.852 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:10.852 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464559+0000", 2024-09-12T22:50:10.852 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.852 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.852 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:10.852 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464559+0000", 2024-09-12T22:50:10.852 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.853 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.853 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:10.853 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464560+0000", 2024-09-12T22:50:10.853 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:50:10.853 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.853 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.853 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:10.853 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469861+0000", 2024-09-12T22:50:10.853 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053017139999999999 2024-09-12T22:50:10.853 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.853 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.853 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:10.853 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469878+0000", 2024-09-12T22:50:10.854 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6336000000000001e-05 2024-09-12T22:50:10.854 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.854 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.854 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.854 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469888+0000", 2024-09-12T22:50:10.854 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8320000000000001e-06 2024-09-12T22:50:10.854 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.854 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.854 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:10.854 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469950+0000", 2024-09-12T22:50:10.854 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1923999999999999e-05 2024-09-12T22:50:10.854 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.854 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.855 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:10.855 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.470059+0000", 2024-09-12T22:50:10.855 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109559 2024-09-12T22:50:10.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.855 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:10.855 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.505915+0000", 2024-09-12T22:50:10.855 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035855887000000003 2024-09-12T22:50:10.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.855 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:10.855 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.505939+0000", 2024-09-12T22:50:10.855 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3740999999999999e-05 2024-09-12T22:50:10.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.856 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:10.856 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.505974+0000", 2024-09-12T22:50:10.856 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5753999999999997e-05 2024-09-12T22:50:10.856 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.856 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:10.856 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.856 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13754 4.11 4:8a2f20b1:::10000003764.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:10.856 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.469921+0000", 2024-09-12T22:50:10.856 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.282515046, 2024-09-12T22:50:10.857 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034721670000000003, 2024-09-12T22:50:10.857 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:10.857 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:10.857 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.857 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:10.857 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:10.857 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:10.857 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13754 2024-09-12T22:50:10.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.857 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:10.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.857 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:10.857 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469921+0000", 2024-09-12T22:50:10.858 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.858 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:10.858 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469921+0000", 2024-09-12T22:50:10.858 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.858 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:10.858 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469922+0000", 2024-09-12T22:50:10.858 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.006e-06 2024-09-12T22:50:10.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.858 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:10.859 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474681+0000", 2024-09-12T22:50:10.859 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047588539999999999 2024-09-12T22:50:10.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.859 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:10.859 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474698+0000", 2024-09-12T22:50:10.859 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7368999999999999e-05 2024-09-12T22:50:10.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.859 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.859 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474709+0000", 2024-09-12T22:50:10.859 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0738e-05 2024-09-12T22:50:10.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.860 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:10.860 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474780+0000", 2024-09-12T22:50:10.860 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0622000000000002e-05 2024-09-12T22:50:10.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.860 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:10.860 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474954+0000", 2024-09-12T22:50:10.860 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017394399999999999 2024-09-12T22:50:10.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.860 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:10.860 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.504488+0000", 2024-09-12T22:50:10.861 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029534721999999999 2024-09-12T22:50:10.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.861 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:10.861 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.504553+0000", 2024-09-12T22:50:10.861 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4877999999999998e-05 2024-09-12T22:50:10.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.861 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:10.861 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.504643+0000", 2024-09-12T22:50:10.861 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9536999999999993e-05 2024-09-12T22:50:10.861 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.861 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:10.862 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.862 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13763 4.2d 4:b5937a57:::100000031de.00000000:head [write 0~4194304 [3@52474]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:10.862 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.474957+0000", 2024-09-12T22:50:10.862 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.277478802999999, 2024-09-12T22:50:10.862 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.057329167, 2024-09-12T22:50:10.862 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:10.862 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:10.862 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.862 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:10.862 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:10.862 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:10.863 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13763 2024-09-12T22:50:10.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.863 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:10.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:10.863 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474957+0000", 2024-09-12T22:50:10.863 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:10.863 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474957+0000", 2024-09-12T22:50:10.863 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.864 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:10.864 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474958+0000", 2024-09-12T22:50:10.864 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8299999999999997e-07 2024-09-12T22:50:10.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.864 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:10.864 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.478970+0000", 2024-09-12T22:50:10.864 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040121100000000002 2024-09-12T22:50:10.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.864 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:10.864 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.478983+0000", 2024-09-12T22:50:10.865 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.292e-05 2024-09-12T22:50:10.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.865 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.865 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.865 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.478992+0000", 2024-09-12T22:50:10.865 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3759999999999997e-06 2024-09-12T22:50:10.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.865 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.865 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:10.865 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.479048+0000", 2024-09-12T22:50:10.865 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5381999999999999e-05 2024-09-12T22:50:10.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.865 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.866 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:10.866 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.479124+0000", 2024-09-12T22:50:10.866 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6643999999999993e-05 2024-09-12T22:50:10.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.866 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:10.866 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.479230+0000", 2024-09-12T22:50:10.866 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010581099999999999 2024-09-12T22:50:10.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.866 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:10.866 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.506897+0000", 2024-09-12T22:50:10.866 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027666863999999999 2024-09-12T22:50:10.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.867 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.867 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:10.867 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.532175+0000", 2024-09-12T22:50:10.867 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.025278367 2024-09-12T22:50:10.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.867 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.867 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:10.867 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.532232+0000", 2024-09-12T22:50:10.867 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6455000000000001e-05 2024-09-12T22:50:10.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.867 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.867 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:10.868 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.532286+0000", 2024-09-12T22:50:10.868 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4654999999999998e-05 2024-09-12T22:50:10.868 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.868 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:10.868 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.868 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.868 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.868 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13803 4.4 4:228c5bc4:::10000003314.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:10.868 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.515814+0000", 2024-09-12T22:50:10.868 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.236622377, 2024-09-12T22:50:10.868 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034442453999999997, 2024-09-12T22:50:10.868 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:10.869 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:10.869 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:10.869 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:10.869 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:10.869 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:10.869 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13803 2024-09-12T22:50:10.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.869 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:10.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.869 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:10.869 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.515814+0000", 2024-09-12T22:50:10.869 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.870 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:10.870 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.515814+0000", 2024-09-12T22:50:10.870 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:10.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.870 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:10.870 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.515814+0000", 2024-09-12T22:50:10.870 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4799999999999998e-07 2024-09-12T22:50:10.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.870 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:10.871 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522580+0000", 2024-09-12T22:50:10.871 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0067656959999999999 2024-09-12T22:50:10.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.871 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:10.871 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522591+0000", 2024-09-12T22:50:10.871 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1206000000000001e-05 2024-09-12T22:50:10.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.871 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:10.871 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522597+0000", 2024-09-12T22:50:10.871 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1500000000000004e-06 2024-09-12T22:50:10.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.872 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.872 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:10.872 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522639+0000", 2024-09-12T22:50:10.872 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1767999999999997e-05 2024-09-12T22:50:10.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.872 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.872 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:10.872 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522689+0000", 2024-09-12T22:50:10.872 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9472999999999999e-05 2024-09-12T22:50:10.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.872 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.872 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:10.873 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522771+0000", 2024-09-12T22:50:10.873 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2738000000000006e-05 2024-09-12T22:50:10.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.873 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.873 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:10.873 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.529356+0000", 2024-09-12T22:50:10.873 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065850329999999997 2024-09-12T22:50:10.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.873 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.873 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:10.873 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.550206+0000", 2024-09-12T22:50:10.873 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020849755000000001 2024-09-12T22:50:10.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.874 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.874 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:10.874 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.550233+0000", 2024-09-12T22:50:10.874 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6990000000000001e-05 2024-09-12T22:50:10.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:10.874 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:10.874 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:10.874 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.550256+0000", 2024-09-12T22:50:10.874 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3096999999999999e-05 2024-09-12T22:50:10.874 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.874 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:10.874 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.874 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:10.875 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:10.875 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:50:10.877 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:10.875+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:10.877 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:50:10.915 INFO:teuthology.orchestra.run.smithi066.stderr:listed 0 entries 2024-09-12T22:50:10.928 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T22:50:10.928 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T22:50:10.977 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:10.975+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:10.983 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:50:10.983 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:50:10.983 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:50:10.984 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:50:10.986 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T22:50:10.992 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:50:11.077 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:11.076+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:11.134 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:50:11.134 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:50:11.134 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:50:11.134 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:50:11.135 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:50:11.143 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:50:11.151 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:50:11.184 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:11.182+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:11.276 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:50:11.277 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:50:11.280 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:11.278+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:11.285 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:11.285 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:11.294 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:50:11.303 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:50:11.304 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:50:11.304 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:50:11.307 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:50:11.308 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:50:11.342 INFO:teuthology.orchestra.run.smithi066.stderr:listed 0 entries 2024-09-12T22:50:11.355 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi066.front.sepia.ceph.com... 2024-09-12T22:50:11.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:50:11.355 DEBUG:teuthology.orchestra.run.smithi066:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-12T22:50:11.381 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:11.380+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:11.422 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:50:11.422 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi066.stderr:ceph-fuse[32665]: fuse finished with error 0 and tester_r 0 2024-09-12T22:50:11.461 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:11.461 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:11.471 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:50:11.481 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:11.480+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:11.582 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:11.581+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:11.612 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:11.612 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:11.621 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:50:11.682 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~100s 2024-09-12T22:50:11.705 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:11.704+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:11.763 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:11.763 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:11.771 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:50:11.815 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:11.814+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:11.876 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:11.876 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:11.884 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:50:11.884 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:11.883+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:11.985 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:11.983+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:12.028 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:12.028 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:12.037 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:50:12.086 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:12.085+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:12.180 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:12.180 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:12.187 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:12.186+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:12.189 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:50:12.287 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:12.286+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:12.293 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:12.293 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:12.302 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:50:12.388 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:12.387+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:12.445 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:12.445 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:12.453 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:50:12.495 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:12.494+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:12.589 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:12.588+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:12.596 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:12.596 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:12.605 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:50:12.690 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:12.689+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:12.709 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:12.709 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:12.717 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:50:12.791 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:12.790+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:12.820 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:12.820 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:12.829 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:50:12.877 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:50:12.892 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:12.891+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:12.931 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:12.932 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:12.940 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:50:12.993 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:12.992+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:13.045 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:13.045 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:13.053 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:50:13.094 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:13.094+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:13.195 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:13.194+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:13.196 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:13.196 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:13.204 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:50:13.296 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:13.295+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:13.309 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:50:13.348 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:13.348 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:13.356 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:50:13.400 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:13.399+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:13.434 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:50:13.434 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:50:13.451 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:50:13.451 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:50:13.452 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:50:13.455 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:50:13.455 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:50:13.460 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:50:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:50:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:50:13.461 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:50:13.469 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:50:13.510 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:13.509+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:13.599 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:13.598+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:13.610 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:50:13.610 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:50:13.611 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:50:13.611 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:50:13.611 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:50:13.619 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:50:13.703 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:13.702+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:13.736 INFO:teuthology.orchestra.run.smithi066.stderr:nodeep-scrub is set 2024-09-12T22:50:13.765 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:50:13.765 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:50:13.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:50:13.765 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:50:13.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.765 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1923 3.8 3:17051619:::200.0000000f:head [write 935107~4527 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:13.765 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.157731+0000", 2024-09-12T22:50:13.765 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 16.605203468999999, 2024-09-12T22:50:13.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.085115956000000006, 2024-09-12T22:50:13.766 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:13.766 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:13.766 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:13.766 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:13.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:13.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157731+0000", 2024-09-12T22:50:13.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:13.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157731+0000", 2024-09-12T22:50:13.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:13.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157732+0000", 2024-09-12T22:50:13.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.99e-07 2024-09-12T22:50:13.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:13.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157737+0000", 2024-09-12T22:50:13.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6280000000000002e-06 2024-09-12T22:50:13.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:13.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157745+0000", 2024-09-12T22:50:13.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1749999999999999e-06 2024-09-12T22:50:13.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:13.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157749+0000", 2024-09-12T22:50:13.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.946e-06 2024-09-12T22:50:13.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:13.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.236865+0000", 2024-09-12T22:50:13.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079116687000000005 2024-09-12T22:50:13.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:13.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.236929+0000", 2024-09-12T22:50:13.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3566999999999996e-05 2024-09-12T22:50:13.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:13.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237025+0000", 2024-09-12T22:50:13.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6620000000000007e-05 2024-09-12T22:50:13.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:13.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240342+0000", 2024-09-12T22:50:13.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033162539999999998 2024-09-12T22:50:13.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:13.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242737+0000", 2024-09-12T22:50:13.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023957370000000002 2024-09-12T22:50:13.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:13.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242797+0000", 2024-09-12T22:50:13.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9323000000000001e-05 2024-09-12T22:50:13.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:13.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242847+0000", 2024-09-12T22:50:13.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0319999999999999e-05 2024-09-12T22:50:13.771 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.771 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:13.771 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.771 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1924 3.8 3:17051619:::200.0000000f:head [write 939634~6106 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:13.771 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.159169+0000", 2024-09-12T22:50:13.771 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 16.603765249999999, 2024-09-12T22:50:13.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.083843601000000004, 2024-09-12T22:50:13.772 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:13.772 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:13.772 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:13.772 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:13.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:13.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159169+0000", 2024-09-12T22:50:13.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:13.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159169+0000", 2024-09-12T22:50:13.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:13.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159171+0000", 2024-09-12T22:50:13.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4959999999999999e-06 2024-09-12T22:50:13.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:13.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159182+0000", 2024-09-12T22:50:13.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1104000000000001e-05 2024-09-12T22:50:13.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:13.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159190+0000", 2024-09-12T22:50:13.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3520000000000007e-06 2024-09-12T22:50:13.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:13.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159196+0000", 2024-09-12T22:50:13.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5690000000000004e-06 2024-09-12T22:50:13.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:13.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237476+0000", 2024-09-12T22:50:13.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078280197999999995 2024-09-12T22:50:13.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:13.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237530+0000", 2024-09-12T22:50:13.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4419000000000002e-05 2024-09-12T22:50:13.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:13.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237593+0000", 2024-09-12T22:50:13.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2611000000000001e-05 2024-09-12T22:50:13.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:13.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242030+0000", 2024-09-12T22:50:13.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044367369999999996 2024-09-12T22:50:13.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:13.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242893+0000", 2024-09-12T22:50:13.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00086367400000000004 2024-09-12T22:50:13.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:13.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242956+0000", 2024-09-12T22:50:13.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2885999999999994e-05 2024-09-12T22:50:13.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:13.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243013+0000", 2024-09-12T22:50:13.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6555000000000003e-05 2024-09-12T22:50:13.777 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.777 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:13.777 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.777 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1925 3.8 3:17051619:::200.0000000f:head [write 945740~9955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:13.777 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.160395+0000", 2024-09-12T22:50:13.777 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 16.602540041000001, 2024-09-12T22:50:13.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.091200247999999998, 2024-09-12T22:50:13.777 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:13.777 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:13.778 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:13.778 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:13.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:13.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160395+0000", 2024-09-12T22:50:13.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:13.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160395+0000", 2024-09-12T22:50:13.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:13.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160396+0000", 2024-09-12T22:50:13.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1599999999999999e-06 2024-09-12T22:50:13.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:13.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160415+0000", 2024-09-12T22:50:13.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9680000000000001e-05 2024-09-12T22:50:13.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:13.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160428+0000", 2024-09-12T22:50:13.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2792999999999999e-05 2024-09-12T22:50:13.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:13.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160436+0000", 2024-09-12T22:50:13.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0399999999999993e-06 2024-09-12T22:50:13.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:13.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.238408+0000", 2024-09-12T22:50:13.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077971602000000001 2024-09-12T22:50:13.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:13.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.238504+0000", 2024-09-12T22:50:13.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6714999999999998e-05 2024-09-12T22:50:13.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:13.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.238687+0000", 2024-09-12T22:50:13.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000182795 2024-09-12T22:50:13.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:13.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242036+0000", 2024-09-12T22:50:13.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003348887 2024-09-12T22:50:13.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:13.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251510+0000", 2024-09-12T22:50:13.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094733679999999994 2024-09-12T22:50:13.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:13.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251543+0000", 2024-09-12T22:50:13.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2974e-05 2024-09-12T22:50:13.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:13.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251595+0000", 2024-09-12T22:50:13.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2234000000000002e-05 2024-09-12T22:50:13.783 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.783 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:13.783 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.783 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1926 3.8 3:17051619:::200.0000000f:head [write 955695~5281 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:13.783 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.160849+0000", 2024-09-12T22:50:13.783 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 16.602085086999999, 2024-09-12T22:50:13.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.094772633999999994, 2024-09-12T22:50:13.783 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:13.783 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:13.784 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:13.784 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:13.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:13.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160849+0000", 2024-09-12T22:50:13.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:13.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160849+0000", 2024-09-12T22:50:13.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:13.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160850+0000", 2024-09-12T22:50:13.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6700000000000002e-07 2024-09-12T22:50:13.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:13.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160858+0000", 2024-09-12T22:50:13.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5630000000000003e-06 2024-09-12T22:50:13.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:13.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160866+0000", 2024-09-12T22:50:13.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7570000000000004e-06 2024-09-12T22:50:13.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:13.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160870+0000", 2024-09-12T22:50:13.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5929999999999999e-06 2024-09-12T22:50:13.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:13.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.239705+0000", 2024-09-12T22:50:13.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078834491000000007 2024-09-12T22:50:13.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:13.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.239764+0000", 2024-09-12T22:50:13.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9190000000000001e-05 2024-09-12T22:50:13.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:13.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.239851+0000", 2024-09-12T22:50:13.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7472999999999994e-05 2024-09-12T22:50:13.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:13.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254001+0000", 2024-09-12T22:50:13.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014149622000000001 2024-09-12T22:50:13.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:13.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255525+0000", 2024-09-12T22:50:13.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0015236500000000001 2024-09-12T22:50:13.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:13.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255567+0000", 2024-09-12T22:50:13.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2150999999999997e-05 2024-09-12T22:50:13.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:13.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255622+0000", 2024-09-12T22:50:13.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5276999999999999e-05 2024-09-12T22:50:13.789 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.789 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:13.789 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.789 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1927 3.8 3:17051619:::200.0000000f:head [write 960976~5828 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:13.789 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.164361+0000", 2024-09-12T22:50:13.789 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 16.598573389999999, 2024-09-12T22:50:13.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.091388523999999999, 2024-09-12T22:50:13.789 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:13.789 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:13.789 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:13.789 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:13.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:13.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164361+0000", 2024-09-12T22:50:13.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:13.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164361+0000", 2024-09-12T22:50:13.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:13.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164363+0000", 2024-09-12T22:50:13.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.389e-06 2024-09-12T22:50:13.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:13.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164370+0000", 2024-09-12T22:50:13.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.99e-06 2024-09-12T22:50:13.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:13.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164379+0000", 2024-09-12T22:50:13.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9499999999999996e-06 2024-09-12T22:50:13.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:13.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164385+0000", 2024-09-12T22:50:13.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5879999999999997e-06 2024-09-12T22:50:13.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:13.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240385+0000", 2024-09-12T22:50:13.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075999995000000001 2024-09-12T22:50:13.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:13.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240533+0000", 2024-09-12T22:50:13.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014811699999999999 2024-09-12T22:50:13.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:13.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240886+0000", 2024-09-12T22:50:13.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000352517 2024-09-12T22:50:13.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:13.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254024+0000", 2024-09-12T22:50:13.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013138047999999999 2024-09-12T22:50:13.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:13.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255629+0000", 2024-09-12T22:50:13.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001604949 2024-09-12T22:50:13.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:13.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255683+0000", 2024-09-12T22:50:13.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4035e-05 2024-09-12T22:50:13.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:13.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255750+0000", 2024-09-12T22:50:13.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6946000000000006e-05 2024-09-12T22:50:13.795 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.795 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:13.795 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.795 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1928 3.8 3:17051619:::200.0000000f:head [write 966804~6536 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:13.795 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167179+0000", 2024-09-12T22:50:13.795 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 16.595755592, 2024-09-12T22:50:13.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.089785880999999998, 2024-09-12T22:50:13.795 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:13.795 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:13.796 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:13.796 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:13.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:13.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167179+0000", 2024-09-12T22:50:13.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:13.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167179+0000", 2024-09-12T22:50:13.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:13.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167180+0000", 2024-09-12T22:50:13.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2869999999999999e-06 2024-09-12T22:50:13.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:13.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167192+0000", 2024-09-12T22:50:13.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.187e-05 2024-09-12T22:50:13.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:13.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167203+0000", 2024-09-12T22:50:13.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1076e-05 2024-09-12T22:50:13.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:13.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167210+0000", 2024-09-12T22:50:13.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1799999999999999e-06 2024-09-12T22:50:13.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:13.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.241518+0000", 2024-09-12T22:50:13.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074307845999999997 2024-09-12T22:50:13.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:13.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.241563+0000", 2024-09-12T22:50:13.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5138e-05 2024-09-12T22:50:13.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:13.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.241641+0000", 2024-09-12T22:50:13.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8016000000000007e-05 2024-09-12T22:50:13.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:13.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254041+0000", 2024-09-12T22:50:13.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012399666 2024-09-12T22:50:13.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:13.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.256880+0000", 2024-09-12T22:50:13.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0028390580000000002 2024-09-12T22:50:13.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:13.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.256918+0000", 2024-09-12T22:50:13.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7552999999999998e-05 2024-09-12T22:50:13.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.256965+0000", 2024-09-12T22:50:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7191000000000003e-05 2024-09-12T22:50:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1929 3.8 3:17051619:::200.0000000f:head [write 973340~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167521+0000", 2024-09-12T22:50:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 16.595413429000001, 2024-09-12T22:50:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.093206336000000001, 2024-09-12T22:50:13.802 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:13.802 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:13.802 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:13.802 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:13.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:13.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167521+0000", 2024-09-12T22:50:13.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:13.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167521+0000", 2024-09-12T22:50:13.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:13.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167522+0000", 2024-09-12T22:50:13.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8899999999999998e-07 2024-09-12T22:50:13.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:13.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167526+0000", 2024-09-12T22:50:13.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4490000000000001e-06 2024-09-12T22:50:13.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:13.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167544+0000", 2024-09-12T22:50:13.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7220000000000001e-05 2024-09-12T22:50:13.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:13.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167551+0000", 2024-09-12T22:50:13.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.046e-06 2024-09-12T22:50:13.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:13.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242079+0000", 2024-09-12T22:50:13.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074528436000000003 2024-09-12T22:50:13.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:13.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242167+0000", 2024-09-12T22:50:13.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7670000000000006e-05 2024-09-12T22:50:13.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242306+0000", 2024-09-12T22:50:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000138703 2024-09-12T22:50:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254058+0000", 2024-09-12T22:50:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011752395000000001 2024-09-12T22:50:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260654+0000", 2024-09-12T22:50:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0065964700000000001 2024-09-12T22:50:13.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:13.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260699+0000", 2024-09-12T22:50:13.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5095000000000001e-05 2024-09-12T22:50:13.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:13.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260727+0000", 2024-09-12T22:50:13.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7963e-05 2024-09-12T22:50:13.808 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.808 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:13.808 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.808 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1931 3.8 3:17051619:::200.0000000f:head [write 974738~2728 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:13.808 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167657+0000", 2024-09-12T22:50:13.808 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 16.595277423999999, 2024-09-12T22:50:13.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.093133758999999997, 2024-09-12T22:50:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167657+0000", 2024-09-12T22:50:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167657+0000", 2024-09-12T22:50:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167658+0000", 2024-09-12T22:50:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2200000000000003e-07 2024-09-12T22:50:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167662+0000", 2024-09-12T22:50:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1489999999999996e-06 2024-09-12T22:50:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167673+0000", 2024-09-12T22:50:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0614e-05 2024-09-12T22:50:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167679+0000", 2024-09-12T22:50:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1500000000000004e-06 2024-09-12T22:50:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243054+0000", 2024-09-12T22:50:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075375027999999997 2024-09-12T22:50:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243134+0000", 2024-09-12T22:50:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0210000000000006e-05 2024-09-12T22:50:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243263+0000", 2024-09-12T22:50:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012919 2024-09-12T22:50:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254075+0000", 2024-09-12T22:50:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010811523 2024-09-12T22:50:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260733+0000", 2024-09-12T22:50:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.006658153 2024-09-12T22:50:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260756+0000", 2024-09-12T22:50:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2696000000000001e-05 2024-09-12T22:50:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260791+0000", 2024-09-12T22:50:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5324000000000003e-05 2024-09-12T22:50:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1932 3.8 3:17051619:::200.0000000f:head [write 977466~2771 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:50:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 16.594987742000001, 2024-09-12T22:50:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.092944115999999993, 2024-09-12T22:50:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:50:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:50:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:50:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8400000000000004e-07 2024-09-12T22:50:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167952+0000", 2024-09-12T22:50:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.138e-06 2024-09-12T22:50:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167961+0000", 2024-09-12T22:50:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7990000000000005e-06 2024-09-12T22:50:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167968+0000", 2024-09-12T22:50:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4400000000000002e-06 2024-09-12T22:50:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.244002+0000", 2024-09-12T22:50:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.076034300999999999 2024-09-12T22:50:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.244061+0000", 2024-09-12T22:50:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8356999999999997e-05 2024-09-12T22:50:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.244161+0000", 2024-09-12T22:50:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000100126 2024-09-12T22:50:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254099+0000", 2024-09-12T22:50:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0099384940000000008 2024-09-12T22:50:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260799+0000", 2024-09-12T22:50:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0066995029999999999 2024-09-12T22:50:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260851+0000", 2024-09-12T22:50:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1861999999999999e-05 2024-09-12T22:50:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260891+0000", 2024-09-12T22:50:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0411999999999999e-05 2024-09-12T22:50:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1933 3.8 3:17051619:::200.0000000f:head [write 980237~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167993+0000", 2024-09-12T22:50:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 16.594941239000001, 2024-09-12T22:50:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.092952307999999997, 2024-09-12T22:50:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167993+0000", 2024-09-12T22:50:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167993+0000", 2024-09-12T22:50:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167994+0000", 2024-09-12T22:50:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5000000000000003e-07 2024-09-12T22:50:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167997+0000", 2024-09-12T22:50:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5559999999999999e-06 2024-09-12T22:50:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168005+0000", 2024-09-12T22:50:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.588e-06 2024-09-12T22:50:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168011+0000", 2024-09-12T22:50:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7780000000000004e-06 2024-09-12T22:50:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.247983+0000", 2024-09-12T22:50:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079972090999999995 2024-09-12T22:50:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248038+0000", 2024-09-12T22:50:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4889999999999998e-05 2024-09-12T22:50:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248136+0000", 2024-09-12T22:50:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8271999999999997e-05 2024-09-12T22:50:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254134+0000", 2024-09-12T22:50:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005997751 2024-09-12T22:50:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260898+0000", 2024-09-12T22:50:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0067646429999999999 2024-09-12T22:50:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260923+0000", 2024-09-12T22:50:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4080999999999999e-05 2024-09-12T22:50:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260946+0000", 2024-09-12T22:50:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3108e-05 2024-09-12T22:50:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1934 3.8 3:17051619:::200.0000000f:head [write 982156~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:50:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 16.594915752999999, 2024-09-12T22:50:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.093517738000000003, 2024-09-12T22:50:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:50:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:50:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:50:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6800000000000001e-07 2024-09-12T22:50:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168029+0000", 2024-09-12T22:50:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9699999999999994e-06 2024-09-12T22:50:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168036+0000", 2024-09-12T22:50:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9800000000000001e-06 2024-09-12T22:50:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168041+0000", 2024-09-12T22:50:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0629999999999996e-06 2024-09-12T22:50:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248449+0000", 2024-09-12T22:50:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.080407948000000007 2024-09-12T22:50:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248491+0000", 2024-09-12T22:50:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2027999999999998e-05 2024-09-12T22:50:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248569+0000", 2024-09-12T22:50:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8077000000000005e-05 2024-09-12T22:50:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260950+0000", 2024-09-12T22:50:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012380901 2024-09-12T22:50:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.261473+0000", 2024-09-12T22:50:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00052241699999999996 2024-09-12T22:50:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.261507+0000", 2024-09-12T22:50:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4616000000000002e-05 2024-09-12T22:50:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.261537+0000", 2024-09-12T22:50:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9369999999999998e-05 2024-09-12T22:50:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.832 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1935 3.8 3:17051619:::200.0000000f:head [write 984074~1914 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:13.832 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:50:13.832 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 16.594885830999999, 2024-09-12T22:50:13.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.097660714999999995, 2024-09-12T22:50:13.832 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:13.832 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:13.832 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:13.832 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:13.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:13.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:50:13.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:13.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:50:13.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:13.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:50:13.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4400000000000001e-07 2024-09-12T22:50:13.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:13.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168052+0000", 2024-09-12T22:50:13.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.886e-06 2024-09-12T22:50:13.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:13.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168059+0000", 2024-09-12T22:50:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0489999999999998e-06 2024-09-12T22:50:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168081+0000", 2024-09-12T22:50:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1800000000000001e-05 2024-09-12T22:50:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.250512+0000", 2024-09-12T22:50:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.082431322000000001 2024-09-12T22:50:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.250621+0000", 2024-09-12T22:50:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010908600000000001 2024-09-12T22:50:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.250970+0000", 2024-09-12T22:50:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034828399999999997 2024-09-12T22:50:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265532+0000", 2024-09-12T22:50:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01456268 2024-09-12T22:50:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265614+0000", 2024-09-12T22:50:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1796000000000001e-05 2024-09-12T22:50:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265673+0000", 2024-09-12T22:50:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9314000000000002e-05 2024-09-12T22:50:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265709+0000", 2024-09-12T22:50:13.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6053999999999997e-05 2024-09-12T22:50:13.838 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.838 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:13.838 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.838 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1936 3.8 3:17051619:::200.0000000f:head [write 985988~2437 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:13.838 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.168095+0000", 2024-09-12T22:50:13.838 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 16.594839484000001, 2024-09-12T22:50:13.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.097789345999999999, 2024-09-12T22:50:13.838 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:13.838 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:13.838 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:13.838 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168095+0000", 2024-09-12T22:50:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168095+0000", 2024-09-12T22:50:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168096+0000", 2024-09-12T22:50:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7700000000000005e-07 2024-09-12T22:50:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168099+0000", 2024-09-12T22:50:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.422e-06 2024-09-12T22:50:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168106+0000", 2024-09-12T22:50:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6889999999999998e-06 2024-09-12T22:50:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168110+0000", 2024-09-12T22:50:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8470000000000003e-06 2024-09-12T22:50:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251622+0000", 2024-09-12T22:50:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.083511539999999995 2024-09-12T22:50:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251674+0000", 2024-09-12T22:50:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1678999999999998e-05 2024-09-12T22:50:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251744+0000", 2024-09-12T22:50:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0440999999999999e-05 2024-09-12T22:50:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265545+0000", 2024-09-12T22:50:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013801000000000001 2024-09-12T22:50:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265771+0000", 2024-09-12T22:50:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000225632 2024-09-12T22:50:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265835+0000", 2024-09-12T22:50:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4541000000000004e-05 2024-09-12T22:50:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265884+0000", 2024-09-12T22:50:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9078e-05 2024-09-12T22:50:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1937 3.8 3:17051619:::200.0000000f:head [write 988425~1920 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.171188+0000", 2024-09-12T22:50:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 16.591746112999999, 2024-09-12T22:50:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.094794626000000007, 2024-09-12T22:50:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171188+0000", 2024-09-12T22:50:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171188+0000", 2024-09-12T22:50:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171189+0000", 2024-09-12T22:50:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3200000000000003e-07 2024-09-12T22:50:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171194+0000", 2024-09-12T22:50:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2690000000000001e-06 2024-09-12T22:50:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171201+0000", 2024-09-12T22:50:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5310000000000004e-06 2024-09-12T22:50:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171206+0000", 2024-09-12T22:50:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7049999999999998e-06 2024-09-12T22:50:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254169+0000", 2024-09-12T22:50:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.082962835999999998 2024-09-12T22:50:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254263+0000", 2024-09-12T22:50:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3844999999999993e-05 2024-09-12T22:50:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254398+0000", 2024-09-12T22:50:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013560499999999999 2024-09-12T22:50:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265897+0000", 2024-09-12T22:50:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01149846 2024-09-12T22:50:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265922+0000", 2024-09-12T22:50:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5130000000000002e-05 2024-09-12T22:50:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265954+0000", 2024-09-12T22:50:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2512999999999999e-05 2024-09-12T22:50:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265983+0000", 2024-09-12T22:50:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8799999999999999e-05 2024-09-12T22:50:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1938 3.8 3:17051619:::200.0000000f:head [write 990345~2499 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:50:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 16.591705934, 2024-09-12T22:50:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.094864730999999994, 2024-09-12T22:50:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:50:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:50:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:50:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:50:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171242+0000", 2024-09-12T22:50:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3111e-05 2024-09-12T22:50:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171247+0000", 2024-09-12T22:50:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0939999999999998e-06 2024-09-12T22:50:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171251+0000", 2024-09-12T22:50:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.298e-06 2024-09-12T22:50:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:13.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254869+0000", 2024-09-12T22:50:13.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.083618681 2024-09-12T22:50:13.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:13.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254957+0000", 2024-09-12T22:50:13.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7783999999999998e-05 2024-09-12T22:50:13.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:13.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255093+0000", 2024-09-12T22:50:13.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013579600000000001 2024-09-12T22:50:13.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:13.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265997+0000", 2024-09-12T22:50:13.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010903777999999999 2024-09-12T22:50:13.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:13.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266047+0000", 2024-09-12T22:50:13.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0151999999999997e-05 2024-09-12T22:50:13.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:13.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266075+0000", 2024-09-12T22:50:13.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8082e-05 2024-09-12T22:50:13.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:13.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266093+0000", 2024-09-12T22:50:13.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8396000000000001e-05 2024-09-12T22:50:13.856 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.856 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:13.856 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1944 3.8 3:17051619:::200.0000000f:head [write 1037561~3947 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.186089+0000", 2024-09-12T22:50:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 16.576845683999998, 2024-09-12T22:50:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087755745999999996, 2024-09-12T22:50:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186089+0000", 2024-09-12T22:50:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186089+0000", 2024-09-12T22:50:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186090+0000", 2024-09-12T22:50:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1349999999999999e-06 2024-09-12T22:50:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186098+0000", 2024-09-12T22:50:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8390000000000007e-06 2024-09-12T22:50:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186106+0000", 2024-09-12T22:50:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4619999999999996e-06 2024-09-12T22:50:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186111+0000", 2024-09-12T22:50:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.057e-06 2024-09-12T22:50:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.264543+0000", 2024-09-12T22:50:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078432044000000006 2024-09-12T22:50:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.264617+0000", 2024-09-12T22:50:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3789999999999997e-05 2024-09-12T22:50:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.264760+0000", 2024-09-12T22:50:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014318499999999999 2024-09-12T22:50:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268441+0000", 2024-09-12T22:50:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036809360000000001 2024-09-12T22:50:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273776+0000", 2024-09-12T22:50:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053346449999999998 2024-09-12T22:50:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273807+0000", 2024-09-12T22:50:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1352000000000001e-05 2024-09-12T22:50:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273845+0000", 2024-09-12T22:50:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7301000000000001e-05 2024-09-12T22:50:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1945 3.8 3:17051619:::200.0000000f:head [write 1041508~10144 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:50:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 16.576568911999999, 2024-09-12T22:50:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087573128, 2024-09-12T22:50:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:50:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:50:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:50:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1600000000000001e-07 2024-09-12T22:50:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186377+0000", 2024-09-12T22:50:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0301e-05 2024-09-12T22:50:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186386+0000", 2024-09-12T22:50:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5619999999999993e-06 2024-09-12T22:50:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186393+0000", 2024-09-12T22:50:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7150000000000001e-06 2024-09-12T22:50:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266725+0000", 2024-09-12T22:50:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.080331893000000001 2024-09-12T22:50:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266799+0000", 2024-09-12T22:50:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4086999999999997e-05 2024-09-12T22:50:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266904+0000", 2024-09-12T22:50:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105475 2024-09-12T22:50:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273882+0000", 2024-09-12T22:50:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069773780000000002 2024-09-12T22:50:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273889+0000", 2024-09-12T22:50:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1049999999999997e-06 2024-09-12T22:50:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273916+0000", 2024-09-12T22:50:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6716e-05 2024-09-12T22:50:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273939+0000", 2024-09-12T22:50:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3180000000000002e-05 2024-09-12T22:50:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1946 3.8 3:17051619:::200.0000000f:head [write 1051652~3875 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.186888+0000", 2024-09-12T22:50:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 16.576046633000001, 2024-09-12T22:50:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087165134000000005, 2024-09-12T22:50:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186888+0000", 2024-09-12T22:50:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186888+0000", 2024-09-12T22:50:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186889+0000", 2024-09-12T22:50:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2500000000000005e-07 2024-09-12T22:50:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186894+0000", 2024-09-12T22:50:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3900000000000001e-06 2024-09-12T22:50:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186901+0000", 2024-09-12T22:50:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5649999999999998e-06 2024-09-12T22:50:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186906+0000", 2024-09-12T22:50:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0390000000000004e-06 2024-09-12T22:50:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.267852+0000", 2024-09-12T22:50:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.080946389999999993 2024-09-12T22:50:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.267910+0000", 2024-09-12T22:50:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7655999999999998e-05 2024-09-12T22:50:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.267981+0000", 2024-09-12T22:50:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0916999999999999e-05 2024-09-12T22:50:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273944+0000", 2024-09-12T22:50:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0059635570000000004 2024-09-12T22:50:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273993+0000", 2024-09-12T22:50:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8350000000000003e-05 2024-09-12T22:50:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274022+0000", 2024-09-12T22:50:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9899999999999998e-05 2024-09-12T22:50:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274053+0000", 2024-09-12T22:50:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0645000000000002e-05 2024-09-12T22:50:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1947 3.8 3:17051619:::200.0000000f:head [write 1055527~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.187014+0000", 2024-09-12T22:50:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 16.575920399000001, 2024-09-12T22:50:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087114608999999996, 2024-09-12T22:50:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187014+0000", 2024-09-12T22:50:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187014+0000", 2024-09-12T22:50:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187015+0000", 2024-09-12T22:50:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1500000000000004e-07 2024-09-12T22:50:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187018+0000", 2024-09-12T22:50:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.033e-06 2024-09-12T22:50:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187023+0000", 2024-09-12T22:50:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7550000000000002e-06 2024-09-12T22:50:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187026+0000", 2024-09-12T22:50:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2710000000000001e-06 2024-09-12T22:50:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268462+0000", 2024-09-12T22:50:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.081435699 2024-09-12T22:50:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268507+0000", 2024-09-12T22:50:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5643999999999999e-05 2024-09-12T22:50:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268597+0000", 2024-09-12T22:50:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0112999999999996e-05 2024-09-12T22:50:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273947+0000", 2024-09-12T22:50:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053501859999999998 2024-09-12T22:50:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274083+0000", 2024-09-12T22:50:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013525500000000001 2024-09-12T22:50:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274109+0000", 2024-09-12T22:50:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6352000000000001e-05 2024-09-12T22:50:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274129+0000", 2024-09-12T22:50:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9686000000000001e-05 2024-09-12T22:50:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1948 3.8 3:17051619:::200.0000000f:head [write 1057443~1896 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.189230+0000", 2024-09-12T22:50:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 16.573704587000002, 2024-09-12T22:50:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.085028962999999999, 2024-09-12T22:50:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189230+0000", 2024-09-12T22:50:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189230+0000", 2024-09-12T22:50:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189231+0000", 2024-09-12T22:50:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1399999999999996e-07 2024-09-12T22:50:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.882 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:13.882 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189235+0000", 2024-09-12T22:50:13.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5970000000000002e-06 2024-09-12T22:50:13.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.882 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:13.882 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189242+0000", 2024-09-12T22:50:13.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8510000000000001e-06 2024-09-12T22:50:13.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.882 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189247+0000", 2024-09-12T22:50:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4800000000000003e-06 2024-09-12T22:50:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268908+0000", 2024-09-12T22:50:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079660983000000005 2024-09-12T22:50:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268967+0000", 2024-09-12T22:50:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9595000000000001e-05 2024-09-12T22:50:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:13.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.269040+0000", 2024-09-12T22:50:13.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2643000000000002e-05 2024-09-12T22:50:13.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:13.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273950+0000", 2024-09-12T22:50:13.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049105329999999999 2024-09-12T22:50:13.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274199+0000", 2024-09-12T22:50:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024824999999999999 2024-09-12T22:50:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274226+0000", 2024-09-12T22:50:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7602000000000001e-05 2024-09-12T22:50:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274259+0000", 2024-09-12T22:50:13.886 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2614999999999999e-05 2024-09-12T22:50:13.886 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.886 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:13.886 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.886 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:13.886 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:13.886 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:50:13.888 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:50:13.888 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:13.886+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:13.988 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:13.987+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:13.992 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:50:13.992 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:50:13.992 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:50:13.992 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:50:14.001 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:50:14.088 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:14.087+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:14.102 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:50:14.102 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:50:14.102 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:50:14.102 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:50:14.102 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:50:14.112 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:50:14.195 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:14.194+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:14.255 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:50:14.255 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:50:14.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:50:14.255 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:50:14.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.255 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12403 4.0 4:0146e0d0:::100000031d4.00000000:head [write 0~4194304 [2@3733965]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:14.255 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:55.747692+0000", 2024-09-12T22:50:14.255 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.505215299, 2024-09-12T22:50:14.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.22362137500000001, 2024-09-12T22:50:14.256 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:14.256 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:14.256 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.256 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:14.256 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:14.256 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:14.256 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12403 2024-09-12T22:50:14.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.256 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:14.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:14.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.747692+0000", 2024-09-12T22:50:14.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:14.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.747692+0000", 2024-09-12T22:50:14.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:14.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.747693+0000", 2024-09-12T22:50:14.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3799999999999996e-07 2024-09-12T22:50:14.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:14.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959640+0000", 2024-09-12T22:50:14.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.21194702000000001 2024-09-12T22:50:14.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:14.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959660+0000", 2024-09-12T22:50:14.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9939e-05 2024-09-12T22:50:14.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959668+0000", 2024-09-12T22:50:14.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1669999999999999e-06 2024-09-12T22:50:14.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:14.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959764+0000", 2024-09-12T22:50:14.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5315000000000005e-05 2024-09-12T22:50:14.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:14.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959865+0000", 2024-09-12T22:50:14.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101618 2024-09-12T22:50:14.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:14.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.971224+0000", 2024-09-12T22:50:14.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011358541999999999 2024-09-12T22:50:14.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:14.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.971261+0000", 2024-09-12T22:50:14.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7092999999999999e-05 2024-09-12T22:50:14.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:14.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.971314+0000", 2024-09-12T22:50:14.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2843000000000002e-05 2024-09-12T22:50:14.261 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.261 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:14.261 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.261 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:12503 4.15 e56/17 4:ab29d13f:::100000033b1.00000000:head v 56'161, mlcod=55'159)", 2024-09-12T22:50:14.261 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:50:14.261 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.222301821999999, 2024-09-12T22:50:14.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.043668640000000002, 2024-09-12T22:50:14.261 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:14.261 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:14.261 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.262 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:14.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:14.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:50:14.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:14.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:50:14.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:14.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:50:14.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:50:14.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:14.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039768+0000", 2024-09-12T22:50:14.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0091617190000000005 2024-09-12T22:50:14.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:14.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039781+0000", 2024-09-12T22:50:14.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2829e-05 2024-09-12T22:50:14.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039789+0000", 2024-09-12T22:50:14.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9340000000000006e-06 2024-09-12T22:50:14.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:14.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039846+0000", 2024-09-12T22:50:14.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6762999999999998e-05 2024-09-12T22:50:14.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:14.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039897+0000", 2024-09-12T22:50:14.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1517000000000002e-05 2024-09-12T22:50:14.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:14.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074225+0000", 2024-09-12T22:50:14.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034328138000000001 2024-09-12T22:50:14.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:14.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074274+0000", 2024-09-12T22:50:14.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9255999999999997e-05 2024-09-12T22:50:14.265 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.266 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:14.266 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.266 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12508 4.2d 4:b7b19b64:::10000003230.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:14.266 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.037293+0000", 2024-09-12T22:50:14.266 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.215614646999999, 2024-09-12T22:50:14.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.037399772999999997, 2024-09-12T22:50:14.266 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:14.266 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:14.266 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.266 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:14.266 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:14.267 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:14.267 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12508 2024-09-12T22:50:14.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.267 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:14.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:14.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037293+0000", 2024-09-12T22:50:14.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:14.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037293+0000", 2024-09-12T22:50:14.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:14.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037294+0000", 2024-09-12T22:50:14.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4899999999999995e-07 2024-09-12T22:50:14.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:14.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042701+0000", 2024-09-12T22:50:14.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054069419999999997 2024-09-12T22:50:14.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:14.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042712+0000", 2024-09-12T22:50:14.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.171e-05 2024-09-12T22:50:14.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042719+0000", 2024-09-12T22:50:14.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1189999999999999e-06 2024-09-12T22:50:14.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:14.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042759+0000", 2024-09-12T22:50:14.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9478999999999999e-05 2024-09-12T22:50:14.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:14.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042827+0000", 2024-09-12T22:50:14.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8435999999999993e-05 2024-09-12T22:50:14.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:14.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042965+0000", 2024-09-12T22:50:14.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000137723 2024-09-12T22:50:14.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:14.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.058351+0000", 2024-09-12T22:50:14.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015385902 2024-09-12T22:50:14.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:14.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074620+0000", 2024-09-12T22:50:14.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016269018 2024-09-12T22:50:14.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:14.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074657+0000", 2024-09-12T22:50:14.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6619999999999998e-05 2024-09-12T22:50:14.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:14.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074693+0000", 2024-09-12T22:50:14.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6174999999999998e-05 2024-09-12T22:50:14.272 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.272 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:14.272 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.272 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12516 4.21 4:858ae08d:::100000030eb.00000000:head [write 0~4194304 [3@1582458]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:14.272 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.045143+0000", 2024-09-12T22:50:14.272 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.207764358999999, 2024-09-12T22:50:14.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.039721657, 2024-09-12T22:50:14.273 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:14.273 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:14.273 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.273 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:14.273 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:14.273 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:14.273 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12516 2024-09-12T22:50:14.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.273 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:14.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:14.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.045143+0000", 2024-09-12T22:50:14.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:14.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.045143+0000", 2024-09-12T22:50:14.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:14.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.045144+0000", 2024-09-12T22:50:14.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2900000000000002e-07 2024-09-12T22:50:14.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:14.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049506+0000", 2024-09-12T22:50:14.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043620280000000004 2024-09-12T22:50:14.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:14.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049517+0000", 2024-09-12T22:50:14.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0726e-05 2024-09-12T22:50:14.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049522+0000", 2024-09-12T22:50:14.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3730000000000001e-06 2024-09-12T22:50:14.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:14.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049583+0000", 2024-09-12T22:50:14.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1254999999999995e-05 2024-09-12T22:50:14.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:14.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049645+0000", 2024-09-12T22:50:14.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1988000000000003e-05 2024-09-12T22:50:14.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:14.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049731+0000", 2024-09-12T22:50:14.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6040999999999998e-05 2024-09-12T22:50:14.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:14.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.064126+0000", 2024-09-12T22:50:14.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01439497 2024-09-12T22:50:14.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:14.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.084785+0000", 2024-09-12T22:50:14.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020658972000000001 2024-09-12T22:50:14.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:14.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.084829+0000", 2024-09-12T22:50:14.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3869000000000003e-05 2024-09-12T22:50:14.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:14.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.084865+0000", 2024-09-12T22:50:14.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5605999999999998e-05 2024-09-12T22:50:14.278 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.278 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:14.278 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.279 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1354 3.18 3:1e8917d7:::200.0000000e:head [write 498872~14494 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:14.279 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.048337+0000", 2024-09-12T22:50:14.279 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.204570440000001, 2024-09-12T22:50:14.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034292491000000001, 2024-09-12T22:50:14.279 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:14.279 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:14.279 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.279 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:14.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:14.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048337+0000", 2024-09-12T22:50:14.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:14.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048337+0000", 2024-09-12T22:50:14.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:14.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048339+0000", 2024-09-12T22:50:14.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.409e-06 2024-09-12T22:50:14.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:14.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048360+0000", 2024-09-12T22:50:14.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1659999999999999e-05 2024-09-12T22:50:14.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:14.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048370+0000", 2024-09-12T22:50:14.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.611e-06 2024-09-12T22:50:14.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048376+0000", 2024-09-12T22:50:14.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5479999999999998e-06 2024-09-12T22:50:14.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:14.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048440+0000", 2024-09-12T22:50:14.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3367000000000005e-05 2024-09-12T22:50:14.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:14.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048557+0000", 2024-09-12T22:50:14.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116983 2024-09-12T22:50:14.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:14.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048719+0000", 2024-09-12T22:50:14.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016250499999999999 2024-09-12T22:50:14.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:14.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.058763+0000", 2024-09-12T22:50:14.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010043948 2024-09-12T22:50:14.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:14.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082499+0000", 2024-09-12T22:50:14.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023735320000000001 2024-09-12T22:50:14.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:14.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082561+0000", 2024-09-12T22:50:14.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2490000000000006e-05 2024-09-12T22:50:14.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:14.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082630+0000", 2024-09-12T22:50:14.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8650000000000002e-05 2024-09-12T22:50:14.284 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.284 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:14.284 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.285 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12517 4.1a 4:5a8c04dd:::10000003276.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:14.285 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.049539+0000", 2024-09-12T22:50:14.285 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.203368678, 2024-09-12T22:50:14.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.036068957999999998, 2024-09-12T22:50:14.285 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:14.285 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:14.285 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.285 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:14.285 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:14.285 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:14.286 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12517 2024-09-12T22:50:14.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.286 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:14.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:14.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049539+0000", 2024-09-12T22:50:14.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:14.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049539+0000", 2024-09-12T22:50:14.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:14.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049540+0000", 2024-09-12T22:50:14.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1299999999999999e-07 2024-09-12T22:50:14.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:14.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054581+0000", 2024-09-12T22:50:14.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005041167 2024-09-12T22:50:14.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:14.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054593+0000", 2024-09-12T22:50:14.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1943000000000001e-05 2024-09-12T22:50:14.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054598+0000", 2024-09-12T22:50:14.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6500000000000001e-06 2024-09-12T22:50:14.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:14.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054658+0000", 2024-09-12T22:50:14.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9898999999999997e-05 2024-09-12T22:50:14.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:14.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054800+0000", 2024-09-12T22:50:14.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014187100000000001 2024-09-12T22:50:14.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:14.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.085456+0000", 2024-09-12T22:50:14.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.030655452 2024-09-12T22:50:14.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:14.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.085533+0000", 2024-09-12T22:50:14.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7478999999999995e-05 2024-09-12T22:50:14.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:14.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.085608+0000", 2024-09-12T22:50:14.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4684000000000005e-05 2024-09-12T22:50:14.290 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.290 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:14.290 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.290 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12677 4.10 4:0b7ac23f:::10000003457.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:14.290 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:50:14.290 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.023493882, 2024-09-12T22:50:14.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033661045000000001, 2024-09-12T22:50:14.291 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:14.291 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:14.291 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.291 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:14.291 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:14.291 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:14.291 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12677 2024-09-12T22:50:14.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.291 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:14.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:14.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:50:14.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:14.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:50:14.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:14.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:50:14.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0100000000000005e-07 2024-09-12T22:50:14.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:14.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.237295+0000", 2024-09-12T22:50:14.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078803290000000002 2024-09-12T22:50:14.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:14.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.237307+0000", 2024-09-12T22:50:14.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2339e-05 2024-09-12T22:50:14.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.237312+0000", 2024-09-12T22:50:14.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9089999999999999e-06 2024-09-12T22:50:14.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:14.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.239034+0000", 2024-09-12T22:50:14.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001722424 2024-09-12T22:50:14.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:14.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.239129+0000", 2024-09-12T22:50:14.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4486000000000003e-05 2024-09-12T22:50:14.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:14.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.239206+0000", 2024-09-12T22:50:14.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7146999999999998e-05 2024-09-12T22:50:14.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:14.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.255921+0000", 2024-09-12T22:50:14.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016714685 2024-09-12T22:50:14.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:14.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.263025+0000", 2024-09-12T22:50:14.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071042470000000002 2024-09-12T22:50:14.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:14.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.263052+0000", 2024-09-12T22:50:14.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7195e-05 2024-09-12T22:50:14.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:14.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.263075+0000", 2024-09-12T22:50:14.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2782999999999999e-05 2024-09-12T22:50:14.296 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.296 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:14.296 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.297 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12979 4.1e 4:78503759:::10000003406.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:14.297 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:50:14.297 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 17.687807085999999, 2024-09-12T22:50:14.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032861456999999997, 2024-09-12T22:50:14.297 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:14.297 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:14.297 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.297 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:14.297 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:14.297 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:14.297 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12979 2024-09-12T22:50:14.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.298 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:14.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:14.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:50:14.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:14.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:50:14.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:14.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:50:14.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9999999999999998e-07 2024-09-12T22:50:14.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:14.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573365+0000", 2024-09-12T22:50:14.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082644229999999999 2024-09-12T22:50:14.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:14.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573379+0000", 2024-09-12T22:50:14.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3322999999999999e-05 2024-09-12T22:50:14.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573386+0000", 2024-09-12T22:50:14.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.199e-06 2024-09-12T22:50:14.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:14.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573464+0000", 2024-09-12T22:50:14.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7931999999999999e-05 2024-09-12T22:50:14.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:14.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573713+0000", 2024-09-12T22:50:14.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024922200000000001 2024-09-12T22:50:14.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:14.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.597870+0000", 2024-09-12T22:50:14.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024157221999999999 2024-09-12T22:50:14.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:14.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.597926+0000", 2024-09-12T22:50:14.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5838000000000003e-05 2024-09-12T22:50:14.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:14.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.597962+0000", 2024-09-12T22:50:14.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5898000000000001e-05 2024-09-12T22:50:14.302 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.302 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:14.302 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.302 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:13017 4.3b e56/17 4:deb39c3c:::1000000315d.00000000:head v 56'194, mlcod=56'192)", 2024-09-12T22:50:14.302 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.600876+0000", 2024-09-12T22:50:14.302 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 17.652031610000002, 2024-09-12T22:50:14.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038152448999999998, 2024-09-12T22:50:14.303 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:14.303 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:14.303 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.303 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:14.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:14.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.600876+0000", 2024-09-12T22:50:14.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:14.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.600876+0000", 2024-09-12T22:50:14.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:14.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.600877+0000", 2024-09-12T22:50:14.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:50:14.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:14.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609737+0000", 2024-09-12T22:50:14.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088599089999999991 2024-09-12T22:50:14.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:14.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609748+0000", 2024-09-12T22:50:14.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1355999999999999e-05 2024-09-12T22:50:14.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609757+0000", 2024-09-12T22:50:14.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9190000000000005e-06 2024-09-12T22:50:14.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:14.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609801+0000", 2024-09-12T22:50:14.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4019e-05 2024-09-12T22:50:14.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:14.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609816+0000", 2024-09-12T22:50:14.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5226e-05 2024-09-12T22:50:14.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:14.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.638985+0000", 2024-09-12T22:50:14.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029168537000000001 2024-09-12T22:50:14.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:14.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.639028+0000", 2024-09-12T22:50:14.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3847000000000002e-05 2024-09-12T22:50:14.307 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.307 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:14.307 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.307 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13032 4.7 4:e102bf81:::1000000359e.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:14.307 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.616553+0000", 2024-09-12T22:50:14.308 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 17.636354758, 2024-09-12T22:50:14.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032471027999999999, 2024-09-12T22:50:14.308 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:14.308 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:14.308 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.308 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:14.308 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:14.308 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:14.308 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13032 2024-09-12T22:50:14.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.308 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:14.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:14.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.616553+0000", 2024-09-12T22:50:14.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:14.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.616553+0000", 2024-09-12T22:50:14.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:14.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.616554+0000", 2024-09-12T22:50:14.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0100000000000004e-07 2024-09-12T22:50:14.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:14.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621405+0000", 2024-09-12T22:50:14.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0048517480000000003 2024-09-12T22:50:14.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:14.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621416+0000", 2024-09-12T22:50:14.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0264e-05 2024-09-12T22:50:14.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621446+0000", 2024-09-12T22:50:14.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0849000000000002e-05 2024-09-12T22:50:14.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:14.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621494+0000", 2024-09-12T22:50:14.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7018000000000003e-05 2024-09-12T22:50:14.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:14.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621590+0000", 2024-09-12T22:50:14.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6632999999999995e-05 2024-09-12T22:50:14.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:14.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621680+0000", 2024-09-12T22:50:14.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9704999999999996e-05 2024-09-12T22:50:14.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:14.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.639248+0000", 2024-09-12T22:50:14.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017568548 2024-09-12T22:50:14.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:14.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.648944+0000", 2024-09-12T22:50:14.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0096954659999999998 2024-09-12T22:50:14.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:14.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.648992+0000", 2024-09-12T22:50:14.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8059999999999997e-05 2024-09-12T22:50:14.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:14.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.649024+0000", 2024-09-12T22:50:14.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1936000000000001e-05 2024-09-12T22:50:14.313 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.313 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:14.314 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.314 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13428 4.37 4:eeed8456:::1000000321a.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:14.314 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.064666+0000", 2024-09-12T22:50:14.314 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 17.188241479999999, 2024-09-12T22:50:14.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033441308000000003, 2024-09-12T22:50:14.316 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:14.316 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:14.316 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.316 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:14.316 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:14.316 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:14.316 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13428 2024-09-12T22:50:14.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.316 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:14.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:14.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.064666+0000", 2024-09-12T22:50:14.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:14.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.064666+0000", 2024-09-12T22:50:14.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:14.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.064668+0000", 2024-09-12T22:50:14.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4160000000000001e-06 2024-09-12T22:50:14.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:14.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071829+0000", 2024-09-12T22:50:14.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071611390000000004 2024-09-12T22:50:14.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:14.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071840+0000", 2024-09-12T22:50:14.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1369000000000001e-05 2024-09-12T22:50:14.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071847+0000", 2024-09-12T22:50:14.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0960000000000003e-06 2024-09-12T22:50:14.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:14.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071904+0000", 2024-09-12T22:50:14.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7309000000000003e-05 2024-09-12T22:50:14.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:14.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.072051+0000", 2024-09-12T22:50:14.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014625 2024-09-12T22:50:14.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:14.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.072194+0000", 2024-09-12T22:50:14.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014379799999999999 2024-09-12T22:50:14.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:14.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.079527+0000", 2024-09-12T22:50:14.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007332674 2024-09-12T22:50:14.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:14.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.098048+0000", 2024-09-12T22:50:14.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018521174000000001 2024-09-12T22:50:14.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:14.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.098081+0000", 2024-09-12T22:50:14.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2910999999999997e-05 2024-09-12T22:50:14.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:14.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.098107+0000", 2024-09-12T22:50:14.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6171999999999999e-05 2024-09-12T22:50:14.322 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.322 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:14.322 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.322 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13472 4.12 4:4b0bd9b8:::100000033b0.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:14.322 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.113168+0000", 2024-09-12T22:50:14.322 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 17.139739780999999, 2024-09-12T22:50:14.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.039534103000000001, 2024-09-12T22:50:14.322 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:14.322 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:14.322 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.322 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:14.322 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:14.323 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:14.323 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13472 2024-09-12T22:50:14.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.323 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:14.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:14.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.113168+0000", 2024-09-12T22:50:14.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:14.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.113168+0000", 2024-09-12T22:50:14.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:14.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.113169+0000", 2024-09-12T22:50:14.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1960000000000001e-06 2024-09-12T22:50:14.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:14.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119849+0000", 2024-09-12T22:50:14.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0066801830000000001 2024-09-12T22:50:14.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:14.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119861+0000", 2024-09-12T22:50:14.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.199e-05 2024-09-12T22:50:14.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119866+0000", 2024-09-12T22:50:14.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8720000000000001e-06 2024-09-12T22:50:14.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:14.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119945+0000", 2024-09-12T22:50:14.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9268000000000001e-05 2024-09-12T22:50:14.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:14.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.120098+0000", 2024-09-12T22:50:14.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015299500000000001 2024-09-12T22:50:14.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:14.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.120218+0000", 2024-09-12T22:50:14.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011989099999999999 2024-09-12T22:50:14.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:14.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.140463+0000", 2024-09-12T22:50:14.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020244765000000001 2024-09-12T22:50:14.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:14.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.152629+0000", 2024-09-12T22:50:14.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012165601999999999 2024-09-12T22:50:14.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:14.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.152664+0000", 2024-09-12T22:50:14.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5599999999999998e-05 2024-09-12T22:50:14.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:14.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.152702+0000", 2024-09-12T22:50:14.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7741000000000003e-05 2024-09-12T22:50:14.328 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.328 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:14.328 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.328 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13484 4.2f 4:f62c2e43:::1000000349e.00000000:head [write 0~4194304 [2@3461078]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:14.328 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.125796+0000", 2024-09-12T22:50:14.328 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 17.127111417999998, 2024-09-12T22:50:14.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.036857236000000002, 2024-09-12T22:50:14.329 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:14.329 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:14.329 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.329 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:14.329 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:14.329 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:14.329 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13484 2024-09-12T22:50:14.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.329 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:14.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:14.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.125796+0000", 2024-09-12T22:50:14.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:14.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.125796+0000", 2024-09-12T22:50:14.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:14.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.125797+0000", 2024-09-12T22:50:14.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.108e-06 2024-09-12T22:50:14.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:14.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130725+0000", 2024-09-12T22:50:14.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049272949999999999 2024-09-12T22:50:14.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:14.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130739+0000", 2024-09-12T22:50:14.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4234e-05 2024-09-12T22:50:14.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130751+0000", 2024-09-12T22:50:14.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1848000000000001e-05 2024-09-12T22:50:14.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:14.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130816+0000", 2024-09-12T22:50:14.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5359999999999998e-05 2024-09-12T22:50:14.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:14.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130917+0000", 2024-09-12T22:50:14.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101178 2024-09-12T22:50:14.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:14.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.131058+0000", 2024-09-12T22:50:14.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140803 2024-09-12T22:50:14.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:14.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.153387+0000", 2024-09-12T22:50:14.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022328585000000001 2024-09-12T22:50:14.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:14.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.162465+0000", 2024-09-12T22:50:14.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090781360000000005 2024-09-12T22:50:14.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:14.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.162584+0000", 2024-09-12T22:50:14.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119634 2024-09-12T22:50:14.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:14.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.162653+0000", 2024-09-12T22:50:14.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9054999999999995e-05 2024-09-12T22:50:14.334 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.334 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:14.334 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.335 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13558 4.10 4:09df41af:::1000000333c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:14.335 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.229326+0000", 2024-09-12T22:50:14.335 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 17.023581589999999, 2024-09-12T22:50:14.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.039409786000000002, 2024-09-12T22:50:14.335 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:14.335 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:14.335 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.335 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:14.335 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:14.335 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:14.335 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13558 2024-09-12T22:50:14.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.336 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:14.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:14.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.229326+0000", 2024-09-12T22:50:14.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:14.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.229326+0000", 2024-09-12T22:50:14.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:14.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.229327+0000", 2024-09-12T22:50:14.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1200000000000002e-07 2024-09-12T22:50:14.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:14.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235243+0000", 2024-09-12T22:50:14.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059166310000000003 2024-09-12T22:50:14.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:14.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235255+0000", 2024-09-12T22:50:14.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1174e-05 2024-09-12T22:50:14.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235260+0000", 2024-09-12T22:50:14.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1749999999999996e-06 2024-09-12T22:50:14.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:14.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235295+0000", 2024-09-12T22:50:14.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4830999999999999e-05 2024-09-12T22:50:14.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:14.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235350+0000", 2024-09-12T22:50:14.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5092e-05 2024-09-12T22:50:14.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:14.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235426+0000", 2024-09-12T22:50:14.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6463000000000003e-05 2024-09-12T22:50:14.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:14.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.244772+0000", 2024-09-12T22:50:14.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0093457709999999992 2024-09-12T22:50:14.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:14.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.268679+0000", 2024-09-12T22:50:14.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023906788000000002 2024-09-12T22:50:14.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:14.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.268712+0000", 2024-09-12T22:50:14.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3701999999999997e-05 2024-09-12T22:50:14.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:14.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.268736+0000", 2024-09-12T22:50:14.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3447000000000001e-05 2024-09-12T22:50:14.341 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.341 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:14.341 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.341 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13747 4.1e 4:7aa36f33:::100000035ed.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:14.341 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.457376+0000", 2024-09-12T22:50:14.342 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.795531476000001, 2024-09-12T22:50:14.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.037057578000000001, 2024-09-12T22:50:14.342 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:14.342 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:14.342 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.342 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:14.342 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:14.342 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:14.342 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13747 2024-09-12T22:50:14.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.342 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:14.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:14.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.457376+0000", 2024-09-12T22:50:14.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:14.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.457376+0000", 2024-09-12T22:50:14.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:14.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.457377+0000", 2024-09-12T22:50:14.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1699999999999998e-07 2024-09-12T22:50:14.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:14.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464400+0000", 2024-09-12T22:50:14.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070235890000000002 2024-09-12T22:50:14.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:14.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464413+0000", 2024-09-12T22:50:14.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2397e-05 2024-09-12T22:50:14.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464418+0000", 2024-09-12T22:50:14.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5119999999999999e-06 2024-09-12T22:50:14.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:14.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464464+0000", 2024-09-12T22:50:14.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5976000000000002e-05 2024-09-12T22:50:14.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:14.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464529+0000", 2024-09-12T22:50:14.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5266999999999997e-05 2024-09-12T22:50:14.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:14.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.494315+0000", 2024-09-12T22:50:14.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029785329999999999 2024-09-12T22:50:14.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:14.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.494366+0000", 2024-09-12T22:50:14.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0903999999999999e-05 2024-09-12T22:50:14.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:14.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.494434+0000", 2024-09-12T22:50:14.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7985999999999996e-05 2024-09-12T22:50:14.346 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.347 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:14.347 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.347 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:13748 4.15 e56/17 4:ab1b03eb:::100000031a3.00000000:head v 56'173, mlcod=56'171)", 2024-09-12T22:50:14.347 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.462509+0000", 2024-09-12T22:50:14.347 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.790398429, 2024-09-12T22:50:14.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044366823, 2024-09-12T22:50:14.347 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:14.347 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:14.347 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.347 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:14.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:14.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.462509+0000", 2024-09-12T22:50:14.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:14.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.462509+0000", 2024-09-12T22:50:14.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:14.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.462509+0000", 2024-09-12T22:50:14.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7599999999999998e-07 2024-09-12T22:50:14.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:14.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471576+0000", 2024-09-12T22:50:14.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090665490000000001 2024-09-12T22:50:14.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:14.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471591+0000", 2024-09-12T22:50:14.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4566000000000001e-05 2024-09-12T22:50:14.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471600+0000", 2024-09-12T22:50:14.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1630000000000002e-06 2024-09-12T22:50:14.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:14.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471689+0000", 2024-09-12T22:50:14.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9591000000000003e-05 2024-09-12T22:50:14.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:14.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471735+0000", 2024-09-12T22:50:14.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5429000000000002e-05 2024-09-12T22:50:14.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:14.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.506851+0000", 2024-09-12T22:50:14.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035116238000000001 2024-09-12T22:50:14.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:14.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.506876+0000", 2024-09-12T22:50:14.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5011000000000002e-05 2024-09-12T22:50:14.351 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.351 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:14.351 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.352 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13753 4.30 4:0dea61b7:::100000036ed.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:14.352 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.464559+0000", 2024-09-12T22:50:14.352 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.788348429999999, 2024-09-12T22:50:14.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041415303000000001, 2024-09-12T22:50:14.352 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:14.352 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:14.352 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.352 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:14.352 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:14.352 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:14.352 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13753 2024-09-12T22:50:14.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.353 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:14.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:14.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464559+0000", 2024-09-12T22:50:14.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:14.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464559+0000", 2024-09-12T22:50:14.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:14.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464560+0000", 2024-09-12T22:50:14.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:50:14.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:14.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469861+0000", 2024-09-12T22:50:14.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053017139999999999 2024-09-12T22:50:14.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:14.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469878+0000", 2024-09-12T22:50:14.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6336000000000001e-05 2024-09-12T22:50:14.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469888+0000", 2024-09-12T22:50:14.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8320000000000001e-06 2024-09-12T22:50:14.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:14.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469950+0000", 2024-09-12T22:50:14.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1923999999999999e-05 2024-09-12T22:50:14.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:14.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.470059+0000", 2024-09-12T22:50:14.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109559 2024-09-12T22:50:14.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:14.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.505915+0000", 2024-09-12T22:50:14.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035855887000000003 2024-09-12T22:50:14.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:14.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.505939+0000", 2024-09-12T22:50:14.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3740999999999999e-05 2024-09-12T22:50:14.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:14.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.505974+0000", 2024-09-12T22:50:14.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5753999999999997e-05 2024-09-12T22:50:14.357 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.357 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:14.357 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.357 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13754 4.11 4:8a2f20b1:::10000003764.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:14.357 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.469921+0000", 2024-09-12T22:50:14.357 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.782986577999999, 2024-09-12T22:50:14.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034721670000000003, 2024-09-12T22:50:14.358 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:14.358 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:14.358 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.358 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:14.358 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:14.358 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:14.358 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13754 2024-09-12T22:50:14.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.358 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:14.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:14.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469921+0000", 2024-09-12T22:50:14.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:14.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469921+0000", 2024-09-12T22:50:14.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:14.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469922+0000", 2024-09-12T22:50:14.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.006e-06 2024-09-12T22:50:14.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:14.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474681+0000", 2024-09-12T22:50:14.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047588539999999999 2024-09-12T22:50:14.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:14.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474698+0000", 2024-09-12T22:50:14.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7368999999999999e-05 2024-09-12T22:50:14.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474709+0000", 2024-09-12T22:50:14.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0738e-05 2024-09-12T22:50:14.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:14.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474780+0000", 2024-09-12T22:50:14.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0622000000000002e-05 2024-09-12T22:50:14.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:14.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474954+0000", 2024-09-12T22:50:14.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017394399999999999 2024-09-12T22:50:14.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:14.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.504488+0000", 2024-09-12T22:50:14.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029534721999999999 2024-09-12T22:50:14.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:14.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.504553+0000", 2024-09-12T22:50:14.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4877999999999998e-05 2024-09-12T22:50:14.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:14.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.504643+0000", 2024-09-12T22:50:14.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9536999999999993e-05 2024-09-12T22:50:14.363 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.363 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:14.363 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.363 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13763 4.2d 4:b5937a57:::100000031de.00000000:head [write 0~4194304 [3@52474]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:14.363 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.474957+0000", 2024-09-12T22:50:14.363 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.777950335, 2024-09-12T22:50:14.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.057329167, 2024-09-12T22:50:14.363 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:14.363 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:14.363 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.364 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:14.364 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:14.364 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:14.364 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13763 2024-09-12T22:50:14.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.364 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:14.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:14.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474957+0000", 2024-09-12T22:50:14.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:14.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474957+0000", 2024-09-12T22:50:14.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:14.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474958+0000", 2024-09-12T22:50:14.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8299999999999997e-07 2024-09-12T22:50:14.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:14.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.478970+0000", 2024-09-12T22:50:14.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040121100000000002 2024-09-12T22:50:14.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:14.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.478983+0000", 2024-09-12T22:50:14.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.292e-05 2024-09-12T22:50:14.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.478992+0000", 2024-09-12T22:50:14.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3759999999999997e-06 2024-09-12T22:50:14.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:14.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.479048+0000", 2024-09-12T22:50:14.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5381999999999999e-05 2024-09-12T22:50:14.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:14.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.479124+0000", 2024-09-12T22:50:14.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6643999999999993e-05 2024-09-12T22:50:14.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:14.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.479230+0000", 2024-09-12T22:50:14.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010581099999999999 2024-09-12T22:50:14.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:14.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.506897+0000", 2024-09-12T22:50:14.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027666863999999999 2024-09-12T22:50:14.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:14.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.532175+0000", 2024-09-12T22:50:14.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.025278367 2024-09-12T22:50:14.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:14.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.532232+0000", 2024-09-12T22:50:14.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6455000000000001e-05 2024-09-12T22:50:14.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:14.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.532286+0000", 2024-09-12T22:50:14.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4654999999999998e-05 2024-09-12T22:50:14.369 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.369 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:14.369 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.369 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13803 4.4 4:228c5bc4:::10000003314.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:14.369 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.515814+0000", 2024-09-12T22:50:14.370 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.737093908999999, 2024-09-12T22:50:14.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034442453999999997, 2024-09-12T22:50:14.370 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:14.370 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:14.370 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.370 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:14.370 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:14.370 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:14.370 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13803 2024-09-12T22:50:14.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.370 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:14.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:14.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.515814+0000", 2024-09-12T22:50:14.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:14.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.515814+0000", 2024-09-12T22:50:14.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:14.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:14.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.515814+0000", 2024-09-12T22:50:14.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4799999999999998e-07 2024-09-12T22:50:14.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:14.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522580+0000", 2024-09-12T22:50:14.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0067656959999999999 2024-09-12T22:50:14.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:14.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522591+0000", 2024-09-12T22:50:14.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1206000000000001e-05 2024-09-12T22:50:14.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522597+0000", 2024-09-12T22:50:14.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1500000000000004e-06 2024-09-12T22:50:14.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:14.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522639+0000", 2024-09-12T22:50:14.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1767999999999997e-05 2024-09-12T22:50:14.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:14.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522689+0000", 2024-09-12T22:50:14.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9472999999999999e-05 2024-09-12T22:50:14.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:14.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522771+0000", 2024-09-12T22:50:14.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2738000000000006e-05 2024-09-12T22:50:14.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:14.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.529356+0000", 2024-09-12T22:50:14.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065850329999999997 2024-09-12T22:50:14.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:14.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.550206+0000", 2024-09-12T22:50:14.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020849755000000001 2024-09-12T22:50:14.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:14.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.550233+0000", 2024-09-12T22:50:14.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6990000000000001e-05 2024-09-12T22:50:14.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:14.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:14.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:14.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.550256+0000", 2024-09-12T22:50:14.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3096999999999999e-05 2024-09-12T22:50:14.375 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.375 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:14.376 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.376 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:14.376 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:14.376 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:50:14.377 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:14.376+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:14.378 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:50:14.478 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:14.477+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:14.485 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:50:14.485 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:50:14.486 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:50:14.486 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:50:14.495 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:50:14.578 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:14.577+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:14.597 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:50:14.597 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:50:14.597 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:50:14.597 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:50:14.597 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:50:14.605 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:50:14.679 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:14.679+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:14.751 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:50:14.751 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:50:14.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:50:14.751 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:50:14.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.751 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1923 3.8 3:17051619:::200.0000000f:head [write 935107~4527 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:14.751 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.157731+0000", 2024-09-12T22:50:14.751 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.591054905, 2024-09-12T22:50:14.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.085115956000000006, 2024-09-12T22:50:14.752 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:14.752 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:14.752 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.752 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:14.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:14.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157731+0000", 2024-09-12T22:50:14.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:14.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157731+0000", 2024-09-12T22:50:14.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:14.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157732+0000", 2024-09-12T22:50:14.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.99e-07 2024-09-12T22:50:14.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:14.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157737+0000", 2024-09-12T22:50:14.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6280000000000002e-06 2024-09-12T22:50:14.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:14.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157745+0000", 2024-09-12T22:50:14.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1749999999999999e-06 2024-09-12T22:50:14.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157749+0000", 2024-09-12T22:50:14.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.946e-06 2024-09-12T22:50:14.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:14.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.236865+0000", 2024-09-12T22:50:14.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079116687000000005 2024-09-12T22:50:14.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:14.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.236929+0000", 2024-09-12T22:50:14.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3566999999999996e-05 2024-09-12T22:50:14.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:14.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237025+0000", 2024-09-12T22:50:14.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6620000000000007e-05 2024-09-12T22:50:14.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:14.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240342+0000", 2024-09-12T22:50:14.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033162539999999998 2024-09-12T22:50:14.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:14.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242737+0000", 2024-09-12T22:50:14.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023957370000000002 2024-09-12T22:50:14.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:14.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242797+0000", 2024-09-12T22:50:14.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9323000000000001e-05 2024-09-12T22:50:14.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:14.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242847+0000", 2024-09-12T22:50:14.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0319999999999999e-05 2024-09-12T22:50:14.757 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.757 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:14.758 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.758 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1924 3.8 3:17051619:::200.0000000f:head [write 939634~6106 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:14.758 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.159169+0000", 2024-09-12T22:50:14.758 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.589616685999999, 2024-09-12T22:50:14.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.083843601000000004, 2024-09-12T22:50:14.758 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:14.758 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:14.758 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.758 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:14.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:14.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159169+0000", 2024-09-12T22:50:14.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:14.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159169+0000", 2024-09-12T22:50:14.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:14.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159171+0000", 2024-09-12T22:50:14.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4959999999999999e-06 2024-09-12T22:50:14.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:14.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159182+0000", 2024-09-12T22:50:14.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1104000000000001e-05 2024-09-12T22:50:14.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:14.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159190+0000", 2024-09-12T22:50:14.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3520000000000007e-06 2024-09-12T22:50:14.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159196+0000", 2024-09-12T22:50:14.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5690000000000004e-06 2024-09-12T22:50:14.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:14.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237476+0000", 2024-09-12T22:50:14.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078280197999999995 2024-09-12T22:50:14.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:14.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237530+0000", 2024-09-12T22:50:14.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4419000000000002e-05 2024-09-12T22:50:14.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:14.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237593+0000", 2024-09-12T22:50:14.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2611000000000001e-05 2024-09-12T22:50:14.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:14.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242030+0000", 2024-09-12T22:50:14.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044367369999999996 2024-09-12T22:50:14.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:14.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242893+0000", 2024-09-12T22:50:14.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00086367400000000004 2024-09-12T22:50:14.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:14.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242956+0000", 2024-09-12T22:50:14.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2885999999999994e-05 2024-09-12T22:50:14.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:14.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243013+0000", 2024-09-12T22:50:14.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6555000000000003e-05 2024-09-12T22:50:14.764 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.764 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:14.764 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.764 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1925 3.8 3:17051619:::200.0000000f:head [write 945740~9955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:14.764 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.160395+0000", 2024-09-12T22:50:14.764 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.588391477000002, 2024-09-12T22:50:14.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.091200247999999998, 2024-09-12T22:50:14.764 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:14.764 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:14.764 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.765 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:14.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:14.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160395+0000", 2024-09-12T22:50:14.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:14.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160395+0000", 2024-09-12T22:50:14.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:14.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160396+0000", 2024-09-12T22:50:14.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1599999999999999e-06 2024-09-12T22:50:14.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:14.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160415+0000", 2024-09-12T22:50:14.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9680000000000001e-05 2024-09-12T22:50:14.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:14.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160428+0000", 2024-09-12T22:50:14.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2792999999999999e-05 2024-09-12T22:50:14.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160436+0000", 2024-09-12T22:50:14.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0399999999999993e-06 2024-09-12T22:50:14.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:14.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.238408+0000", 2024-09-12T22:50:14.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077971602000000001 2024-09-12T22:50:14.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:14.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.238504+0000", 2024-09-12T22:50:14.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6714999999999998e-05 2024-09-12T22:50:14.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:14.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.238687+0000", 2024-09-12T22:50:14.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000182795 2024-09-12T22:50:14.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:14.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242036+0000", 2024-09-12T22:50:14.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003348887 2024-09-12T22:50:14.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:14.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251510+0000", 2024-09-12T22:50:14.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094733679999999994 2024-09-12T22:50:14.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:14.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251543+0000", 2024-09-12T22:50:14.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2974e-05 2024-09-12T22:50:14.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:14.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251595+0000", 2024-09-12T22:50:14.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2234000000000002e-05 2024-09-12T22:50:14.770 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.770 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:14.770 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.770 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1926 3.8 3:17051619:::200.0000000f:head [write 955695~5281 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:14.770 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.160849+0000", 2024-09-12T22:50:14.770 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.587936523, 2024-09-12T22:50:14.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.094772633999999994, 2024-09-12T22:50:14.770 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:14.770 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:14.770 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.770 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:14.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:14.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160849+0000", 2024-09-12T22:50:14.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:14.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160849+0000", 2024-09-12T22:50:14.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:14.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160850+0000", 2024-09-12T22:50:14.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6700000000000002e-07 2024-09-12T22:50:14.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:14.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160858+0000", 2024-09-12T22:50:14.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5630000000000003e-06 2024-09-12T22:50:14.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:14.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160866+0000", 2024-09-12T22:50:14.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7570000000000004e-06 2024-09-12T22:50:14.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160870+0000", 2024-09-12T22:50:14.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5929999999999999e-06 2024-09-12T22:50:14.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:14.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.239705+0000", 2024-09-12T22:50:14.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078834491000000007 2024-09-12T22:50:14.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:14.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.239764+0000", 2024-09-12T22:50:14.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9190000000000001e-05 2024-09-12T22:50:14.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:14.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.239851+0000", 2024-09-12T22:50:14.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7472999999999994e-05 2024-09-12T22:50:14.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:14.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254001+0000", 2024-09-12T22:50:14.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014149622000000001 2024-09-12T22:50:14.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:14.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255525+0000", 2024-09-12T22:50:14.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0015236500000000001 2024-09-12T22:50:14.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:14.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255567+0000", 2024-09-12T22:50:14.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2150999999999997e-05 2024-09-12T22:50:14.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:14.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255622+0000", 2024-09-12T22:50:14.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5276999999999999e-05 2024-09-12T22:50:14.775 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.776 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:14.776 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.776 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1927 3.8 3:17051619:::200.0000000f:head [write 960976~5828 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:14.776 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.164361+0000", 2024-09-12T22:50:14.776 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.584424825999999, 2024-09-12T22:50:14.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.091388523999999999, 2024-09-12T22:50:14.776 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:14.776 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:14.777 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.777 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:14.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:14.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164361+0000", 2024-09-12T22:50:14.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:14.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164361+0000", 2024-09-12T22:50:14.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:14.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164363+0000", 2024-09-12T22:50:14.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.389e-06 2024-09-12T22:50:14.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:14.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164370+0000", 2024-09-12T22:50:14.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.99e-06 2024-09-12T22:50:14.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:14.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164379+0000", 2024-09-12T22:50:14.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9499999999999996e-06 2024-09-12T22:50:14.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164385+0000", 2024-09-12T22:50:14.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5879999999999997e-06 2024-09-12T22:50:14.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:14.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240385+0000", 2024-09-12T22:50:14.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075999995000000001 2024-09-12T22:50:14.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:14.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240533+0000", 2024-09-12T22:50:14.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014811699999999999 2024-09-12T22:50:14.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:14.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240886+0000", 2024-09-12T22:50:14.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000352517 2024-09-12T22:50:14.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:14.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254024+0000", 2024-09-12T22:50:14.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013138047999999999 2024-09-12T22:50:14.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:14.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255629+0000", 2024-09-12T22:50:14.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001604949 2024-09-12T22:50:14.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:14.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255683+0000", 2024-09-12T22:50:14.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4035e-05 2024-09-12T22:50:14.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:14.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255750+0000", 2024-09-12T22:50:14.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6946000000000006e-05 2024-09-12T22:50:14.782 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.782 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:14.782 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.782 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1928 3.8 3:17051619:::200.0000000f:head [write 966804~6536 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:14.783 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167179+0000", 2024-09-12T22:50:14.783 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.581607028000001, 2024-09-12T22:50:14.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.089785880999999998, 2024-09-12T22:50:14.783 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:14.783 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:14.783 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.783 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:14.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:14.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167179+0000", 2024-09-12T22:50:14.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:14.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167179+0000", 2024-09-12T22:50:14.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:14.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167180+0000", 2024-09-12T22:50:14.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2869999999999999e-06 2024-09-12T22:50:14.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:14.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167192+0000", 2024-09-12T22:50:14.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.187e-05 2024-09-12T22:50:14.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:14.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167203+0000", 2024-09-12T22:50:14.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1076e-05 2024-09-12T22:50:14.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167210+0000", 2024-09-12T22:50:14.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1799999999999999e-06 2024-09-12T22:50:14.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:14.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.241518+0000", 2024-09-12T22:50:14.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074307845999999997 2024-09-12T22:50:14.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:14.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.241563+0000", 2024-09-12T22:50:14.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5138e-05 2024-09-12T22:50:14.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:14.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.241641+0000", 2024-09-12T22:50:14.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8016000000000007e-05 2024-09-12T22:50:14.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:14.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254041+0000", 2024-09-12T22:50:14.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012399666 2024-09-12T22:50:14.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:14.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.256880+0000", 2024-09-12T22:50:14.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0028390580000000002 2024-09-12T22:50:14.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:14.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.256918+0000", 2024-09-12T22:50:14.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7552999999999998e-05 2024-09-12T22:50:14.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:14.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.256965+0000", 2024-09-12T22:50:14.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7191000000000003e-05 2024-09-12T22:50:14.788 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.788 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:14.788 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.788 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1929 3.8 3:17051619:::200.0000000f:head [write 973340~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:14.789 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167521+0000", 2024-09-12T22:50:14.789 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.581264865000001, 2024-09-12T22:50:14.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.093206336000000001, 2024-09-12T22:50:14.789 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:14.789 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:14.789 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.789 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:14.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:14.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167521+0000", 2024-09-12T22:50:14.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:14.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167521+0000", 2024-09-12T22:50:14.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:14.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167522+0000", 2024-09-12T22:50:14.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8899999999999998e-07 2024-09-12T22:50:14.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:14.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167526+0000", 2024-09-12T22:50:14.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4490000000000001e-06 2024-09-12T22:50:14.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:14.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167544+0000", 2024-09-12T22:50:14.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7220000000000001e-05 2024-09-12T22:50:14.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167551+0000", 2024-09-12T22:50:14.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.046e-06 2024-09-12T22:50:14.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:14.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242079+0000", 2024-09-12T22:50:14.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074528436000000003 2024-09-12T22:50:14.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:14.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242167+0000", 2024-09-12T22:50:14.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7670000000000006e-05 2024-09-12T22:50:14.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:14.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242306+0000", 2024-09-12T22:50:14.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000138703 2024-09-12T22:50:14.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:14.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254058+0000", 2024-09-12T22:50:14.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011752395000000001 2024-09-12T22:50:14.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:14.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260654+0000", 2024-09-12T22:50:14.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0065964700000000001 2024-09-12T22:50:14.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:14.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260699+0000", 2024-09-12T22:50:14.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5095000000000001e-05 2024-09-12T22:50:14.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:14.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260727+0000", 2024-09-12T22:50:14.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7963e-05 2024-09-12T22:50:14.794 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.794 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:14.794 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.795 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1931 3.8 3:17051619:::200.0000000f:head [write 974738~2728 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:14.795 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167657+0000", 2024-09-12T22:50:14.795 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.58112886, 2024-09-12T22:50:14.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.093133758999999997, 2024-09-12T22:50:14.795 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:14.795 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:14.795 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.795 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:14.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:14.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167657+0000", 2024-09-12T22:50:14.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:14.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167657+0000", 2024-09-12T22:50:14.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:14.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167658+0000", 2024-09-12T22:50:14.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2200000000000003e-07 2024-09-12T22:50:14.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:14.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167662+0000", 2024-09-12T22:50:14.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1489999999999996e-06 2024-09-12T22:50:14.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:14.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167673+0000", 2024-09-12T22:50:14.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0614e-05 2024-09-12T22:50:14.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167679+0000", 2024-09-12T22:50:14.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1500000000000004e-06 2024-09-12T22:50:14.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:14.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243054+0000", 2024-09-12T22:50:14.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075375027999999997 2024-09-12T22:50:14.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:14.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243134+0000", 2024-09-12T22:50:14.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0210000000000006e-05 2024-09-12T22:50:14.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:14.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243263+0000", 2024-09-12T22:50:14.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012919 2024-09-12T22:50:14.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:14.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254075+0000", 2024-09-12T22:50:14.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010811523 2024-09-12T22:50:14.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:14.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260733+0000", 2024-09-12T22:50:14.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.006658153 2024-09-12T22:50:14.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:14.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260756+0000", 2024-09-12T22:50:14.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2696000000000001e-05 2024-09-12T22:50:14.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:14.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260791+0000", 2024-09-12T22:50:14.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5324000000000003e-05 2024-09-12T22:50:14.800 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.801 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:14.801 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.801 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1932 3.8 3:17051619:::200.0000000f:head [write 977466~2771 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:14.801 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:50:14.801 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.580839178000002, 2024-09-12T22:50:14.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.092944115999999993, 2024-09-12T22:50:14.801 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:14.801 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:14.801 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.801 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:14.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:14.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:50:14.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:14.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:50:14.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:14.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:50:14.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8400000000000004e-07 2024-09-12T22:50:14.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:14.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167952+0000", 2024-09-12T22:50:14.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.138e-06 2024-09-12T22:50:14.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:14.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167961+0000", 2024-09-12T22:50:14.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7990000000000005e-06 2024-09-12T22:50:14.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167968+0000", 2024-09-12T22:50:14.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4400000000000002e-06 2024-09-12T22:50:14.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:14.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.244002+0000", 2024-09-12T22:50:14.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.076034300999999999 2024-09-12T22:50:14.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:14.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.244061+0000", 2024-09-12T22:50:14.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8356999999999997e-05 2024-09-12T22:50:14.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:14.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.244161+0000", 2024-09-12T22:50:14.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000100126 2024-09-12T22:50:14.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:14.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254099+0000", 2024-09-12T22:50:14.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0099384940000000008 2024-09-12T22:50:14.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:14.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260799+0000", 2024-09-12T22:50:14.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0066995029999999999 2024-09-12T22:50:14.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:14.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260851+0000", 2024-09-12T22:50:14.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1861999999999999e-05 2024-09-12T22:50:14.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:14.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260891+0000", 2024-09-12T22:50:14.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0411999999999999e-05 2024-09-12T22:50:14.807 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.807 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:14.807 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.807 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1933 3.8 3:17051619:::200.0000000f:head [write 980237~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:14.807 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167993+0000", 2024-09-12T22:50:14.807 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.580792675000001, 2024-09-12T22:50:14.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.092952307999999997, 2024-09-12T22:50:14.807 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:14.808 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:14.808 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.808 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:14.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:14.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167993+0000", 2024-09-12T22:50:14.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:14.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167993+0000", 2024-09-12T22:50:14.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:14.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167994+0000", 2024-09-12T22:50:14.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5000000000000003e-07 2024-09-12T22:50:14.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:14.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167997+0000", 2024-09-12T22:50:14.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5559999999999999e-06 2024-09-12T22:50:14.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:14.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168005+0000", 2024-09-12T22:50:14.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.588e-06 2024-09-12T22:50:14.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168011+0000", 2024-09-12T22:50:14.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7780000000000004e-06 2024-09-12T22:50:14.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:14.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.247983+0000", 2024-09-12T22:50:14.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079972090999999995 2024-09-12T22:50:14.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:14.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248038+0000", 2024-09-12T22:50:14.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4889999999999998e-05 2024-09-12T22:50:14.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:14.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248136+0000", 2024-09-12T22:50:14.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8271999999999997e-05 2024-09-12T22:50:14.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:14.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254134+0000", 2024-09-12T22:50:14.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005997751 2024-09-12T22:50:14.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:14.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260898+0000", 2024-09-12T22:50:14.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0067646429999999999 2024-09-12T22:50:14.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:14.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260923+0000", 2024-09-12T22:50:14.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4080999999999999e-05 2024-09-12T22:50:14.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:14.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260946+0000", 2024-09-12T22:50:14.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3108e-05 2024-09-12T22:50:14.813 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.813 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:14.813 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.813 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1934 3.8 3:17051619:::200.0000000f:head [write 982156~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:14.813 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:50:14.813 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.580767188999999, 2024-09-12T22:50:14.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.093517738000000003, 2024-09-12T22:50:14.814 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:14.814 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:14.814 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.814 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:14.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:14.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:50:14.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:14.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:50:14.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:14.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:50:14.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6800000000000001e-07 2024-09-12T22:50:14.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:14.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168029+0000", 2024-09-12T22:50:14.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9699999999999994e-06 2024-09-12T22:50:14.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:14.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168036+0000", 2024-09-12T22:50:14.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9800000000000001e-06 2024-09-12T22:50:14.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168041+0000", 2024-09-12T22:50:14.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0629999999999996e-06 2024-09-12T22:50:14.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:14.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248449+0000", 2024-09-12T22:50:14.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.080407948000000007 2024-09-12T22:50:14.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:14.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248491+0000", 2024-09-12T22:50:14.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2027999999999998e-05 2024-09-12T22:50:14.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:14.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248569+0000", 2024-09-12T22:50:14.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8077000000000005e-05 2024-09-12T22:50:14.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:14.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260950+0000", 2024-09-12T22:50:14.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012380901 2024-09-12T22:50:14.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:14.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.261473+0000", 2024-09-12T22:50:14.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00052241699999999996 2024-09-12T22:50:14.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:14.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.261507+0000", 2024-09-12T22:50:14.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4616000000000002e-05 2024-09-12T22:50:14.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:14.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.261537+0000", 2024-09-12T22:50:14.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9369999999999998e-05 2024-09-12T22:50:14.819 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.819 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:14.819 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.819 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1935 3.8 3:17051619:::200.0000000f:head [write 984074~1914 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:14.819 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:50:14.819 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.580737267, 2024-09-12T22:50:14.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.097660714999999995, 2024-09-12T22:50:14.820 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:14.820 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:14.820 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.820 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:14.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:14.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:50:14.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:14.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:50:14.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:14.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:50:14.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4400000000000001e-07 2024-09-12T22:50:14.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:14.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168052+0000", 2024-09-12T22:50:14.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.886e-06 2024-09-12T22:50:14.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:14.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168059+0000", 2024-09-12T22:50:14.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0489999999999998e-06 2024-09-12T22:50:14.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168081+0000", 2024-09-12T22:50:14.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1800000000000001e-05 2024-09-12T22:50:14.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:14.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.250512+0000", 2024-09-12T22:50:14.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.082431322000000001 2024-09-12T22:50:14.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:14.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.250621+0000", 2024-09-12T22:50:14.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010908600000000001 2024-09-12T22:50:14.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:14.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.250970+0000", 2024-09-12T22:50:14.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034828399999999997 2024-09-12T22:50:14.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:14.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265532+0000", 2024-09-12T22:50:14.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01456268 2024-09-12T22:50:14.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:14.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265614+0000", 2024-09-12T22:50:14.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1796000000000001e-05 2024-09-12T22:50:14.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:14.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265673+0000", 2024-09-12T22:50:14.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9314000000000002e-05 2024-09-12T22:50:14.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:14.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265709+0000", 2024-09-12T22:50:14.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6053999999999997e-05 2024-09-12T22:50:14.825 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.825 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:14.825 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.825 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1936 3.8 3:17051619:::200.0000000f:head [write 985988~2437 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:14.825 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.168095+0000", 2024-09-12T22:50:14.825 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.580690919999999, 2024-09-12T22:50:14.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.097789345999999999, 2024-09-12T22:50:14.826 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:14.826 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:14.826 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.826 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:14.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:14.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168095+0000", 2024-09-12T22:50:14.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:14.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168095+0000", 2024-09-12T22:50:14.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:14.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168096+0000", 2024-09-12T22:50:14.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7700000000000005e-07 2024-09-12T22:50:14.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:14.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168099+0000", 2024-09-12T22:50:14.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.422e-06 2024-09-12T22:50:14.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:14.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168106+0000", 2024-09-12T22:50:14.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6889999999999998e-06 2024-09-12T22:50:14.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168110+0000", 2024-09-12T22:50:14.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8470000000000003e-06 2024-09-12T22:50:14.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:14.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251622+0000", 2024-09-12T22:50:14.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.083511539999999995 2024-09-12T22:50:14.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:14.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251674+0000", 2024-09-12T22:50:14.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1678999999999998e-05 2024-09-12T22:50:14.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:14.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251744+0000", 2024-09-12T22:50:14.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0440999999999999e-05 2024-09-12T22:50:14.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:14.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265545+0000", 2024-09-12T22:50:14.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013801000000000001 2024-09-12T22:50:14.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:14.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265771+0000", 2024-09-12T22:50:14.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000225632 2024-09-12T22:50:14.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:14.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265835+0000", 2024-09-12T22:50:14.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4541000000000004e-05 2024-09-12T22:50:14.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:14.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265884+0000", 2024-09-12T22:50:14.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9078e-05 2024-09-12T22:50:14.831 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.831 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:14.831 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.831 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1937 3.8 3:17051619:::200.0000000f:head [write 988425~1920 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:14.831 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.171188+0000", 2024-09-12T22:50:14.832 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.577597549, 2024-09-12T22:50:14.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.094794626000000007, 2024-09-12T22:50:14.832 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:14.832 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:14.832 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.832 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:14.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:14.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171188+0000", 2024-09-12T22:50:14.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:14.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171188+0000", 2024-09-12T22:50:14.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:14.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171189+0000", 2024-09-12T22:50:14.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3200000000000003e-07 2024-09-12T22:50:14.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:14.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171194+0000", 2024-09-12T22:50:14.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2690000000000001e-06 2024-09-12T22:50:14.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:14.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171201+0000", 2024-09-12T22:50:14.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5310000000000004e-06 2024-09-12T22:50:14.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171206+0000", 2024-09-12T22:50:14.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7049999999999998e-06 2024-09-12T22:50:14.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:14.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254169+0000", 2024-09-12T22:50:14.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.082962835999999998 2024-09-12T22:50:14.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:14.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254263+0000", 2024-09-12T22:50:14.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3844999999999993e-05 2024-09-12T22:50:14.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:14.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254398+0000", 2024-09-12T22:50:14.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013560499999999999 2024-09-12T22:50:14.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:14.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265897+0000", 2024-09-12T22:50:14.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01149846 2024-09-12T22:50:14.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:14.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265922+0000", 2024-09-12T22:50:14.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5130000000000002e-05 2024-09-12T22:50:14.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:14.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265954+0000", 2024-09-12T22:50:14.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2512999999999999e-05 2024-09-12T22:50:14.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:14.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265983+0000", 2024-09-12T22:50:14.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8799999999999999e-05 2024-09-12T22:50:14.837 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.837 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:14.837 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.837 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1938 3.8 3:17051619:::200.0000000f:head [write 990345~2499 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:14.837 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:50:14.838 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.577557370000001, 2024-09-12T22:50:14.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.094864730999999994, 2024-09-12T22:50:14.838 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:14.838 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:14.838 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.838 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:14.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:14.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:50:14.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:14.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:50:14.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:14.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:50:14.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:50:14.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:14.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171242+0000", 2024-09-12T22:50:14.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3111e-05 2024-09-12T22:50:14.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:14.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171247+0000", 2024-09-12T22:50:14.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0939999999999998e-06 2024-09-12T22:50:14.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171251+0000", 2024-09-12T22:50:14.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.298e-06 2024-09-12T22:50:14.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:14.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254869+0000", 2024-09-12T22:50:14.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.083618681 2024-09-12T22:50:14.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:14.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254957+0000", 2024-09-12T22:50:14.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7783999999999998e-05 2024-09-12T22:50:14.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:14.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255093+0000", 2024-09-12T22:50:14.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013579600000000001 2024-09-12T22:50:14.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:14.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265997+0000", 2024-09-12T22:50:14.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010903777999999999 2024-09-12T22:50:14.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:14.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266047+0000", 2024-09-12T22:50:14.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0151999999999997e-05 2024-09-12T22:50:14.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:14.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266075+0000", 2024-09-12T22:50:14.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8082e-05 2024-09-12T22:50:14.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:14.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266093+0000", 2024-09-12T22:50:14.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8396000000000001e-05 2024-09-12T22:50:14.843 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.843 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:14.843 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.843 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1944 3.8 3:17051619:::200.0000000f:head [write 1037561~3947 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:14.843 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.186089+0000", 2024-09-12T22:50:14.843 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.562697119999999, 2024-09-12T22:50:14.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087755745999999996, 2024-09-12T22:50:14.844 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:14.844 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:14.844 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.844 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:14.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:14.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186089+0000", 2024-09-12T22:50:14.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:14.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186089+0000", 2024-09-12T22:50:14.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:14.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186090+0000", 2024-09-12T22:50:14.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1349999999999999e-06 2024-09-12T22:50:14.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:14.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186098+0000", 2024-09-12T22:50:14.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8390000000000007e-06 2024-09-12T22:50:14.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:14.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186106+0000", 2024-09-12T22:50:14.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4619999999999996e-06 2024-09-12T22:50:14.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186111+0000", 2024-09-12T22:50:14.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.057e-06 2024-09-12T22:50:14.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:14.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.264543+0000", 2024-09-12T22:50:14.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078432044000000006 2024-09-12T22:50:14.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:14.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.264617+0000", 2024-09-12T22:50:14.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3789999999999997e-05 2024-09-12T22:50:14.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:14.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.264760+0000", 2024-09-12T22:50:14.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014318499999999999 2024-09-12T22:50:14.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:14.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268441+0000", 2024-09-12T22:50:14.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036809360000000001 2024-09-12T22:50:14.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:14.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273776+0000", 2024-09-12T22:50:14.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053346449999999998 2024-09-12T22:50:14.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:14.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273807+0000", 2024-09-12T22:50:14.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1352000000000001e-05 2024-09-12T22:50:14.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:14.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273845+0000", 2024-09-12T22:50:14.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7301000000000001e-05 2024-09-12T22:50:14.849 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.849 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:14.849 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.849 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1945 3.8 3:17051619:::200.0000000f:head [write 1041508~10144 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:14.849 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:50:14.850 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.562420348, 2024-09-12T22:50:14.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087573128, 2024-09-12T22:50:14.850 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:14.850 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:14.850 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.850 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:14.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:14.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:50:14.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:14.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:50:14.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:14.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:50:14.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1600000000000001e-07 2024-09-12T22:50:14.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:14.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186377+0000", 2024-09-12T22:50:14.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0301e-05 2024-09-12T22:50:14.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:14.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186386+0000", 2024-09-12T22:50:14.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5619999999999993e-06 2024-09-12T22:50:14.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186393+0000", 2024-09-12T22:50:14.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7150000000000001e-06 2024-09-12T22:50:14.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:14.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266725+0000", 2024-09-12T22:50:14.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.080331893000000001 2024-09-12T22:50:14.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:14.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266799+0000", 2024-09-12T22:50:14.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4086999999999997e-05 2024-09-12T22:50:14.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:14.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266904+0000", 2024-09-12T22:50:14.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105475 2024-09-12T22:50:14.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:14.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273882+0000", 2024-09-12T22:50:14.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069773780000000002 2024-09-12T22:50:14.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:14.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273889+0000", 2024-09-12T22:50:14.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1049999999999997e-06 2024-09-12T22:50:14.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:14.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273916+0000", 2024-09-12T22:50:14.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6716e-05 2024-09-12T22:50:14.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:14.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273939+0000", 2024-09-12T22:50:14.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3180000000000002e-05 2024-09-12T22:50:14.855 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.855 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:14.856 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.856 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1946 3.8 3:17051619:::200.0000000f:head [write 1051652~3875 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:14.856 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.186888+0000", 2024-09-12T22:50:14.856 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.561898069000001, 2024-09-12T22:50:14.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087165134000000005, 2024-09-12T22:50:14.856 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:14.856 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:14.856 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.856 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:14.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:14.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186888+0000", 2024-09-12T22:50:14.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:14.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186888+0000", 2024-09-12T22:50:14.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:14.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186889+0000", 2024-09-12T22:50:14.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2500000000000005e-07 2024-09-12T22:50:14.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:14.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186894+0000", 2024-09-12T22:50:14.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3900000000000001e-06 2024-09-12T22:50:14.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:14.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186901+0000", 2024-09-12T22:50:14.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5649999999999998e-06 2024-09-12T22:50:14.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186906+0000", 2024-09-12T22:50:14.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0390000000000004e-06 2024-09-12T22:50:14.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:14.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.267852+0000", 2024-09-12T22:50:14.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.080946389999999993 2024-09-12T22:50:14.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:14.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.267910+0000", 2024-09-12T22:50:14.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7655999999999998e-05 2024-09-12T22:50:14.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:14.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.267981+0000", 2024-09-12T22:50:14.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0916999999999999e-05 2024-09-12T22:50:14.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:14.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273944+0000", 2024-09-12T22:50:14.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0059635570000000004 2024-09-12T22:50:14.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:14.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273993+0000", 2024-09-12T22:50:14.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8350000000000003e-05 2024-09-12T22:50:14.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:14.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274022+0000", 2024-09-12T22:50:14.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9899999999999998e-05 2024-09-12T22:50:14.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:14.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274053+0000", 2024-09-12T22:50:14.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0645000000000002e-05 2024-09-12T22:50:14.862 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.862 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:14.862 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.862 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1947 3.8 3:17051619:::200.0000000f:head [write 1055527~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:14.862 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.187014+0000", 2024-09-12T22:50:14.862 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.561771835000002, 2024-09-12T22:50:14.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087114608999999996, 2024-09-12T22:50:14.862 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:14.862 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:14.863 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.863 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:14.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:14.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187014+0000", 2024-09-12T22:50:14.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:14.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187014+0000", 2024-09-12T22:50:14.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:14.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187015+0000", 2024-09-12T22:50:14.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1500000000000004e-07 2024-09-12T22:50:14.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:14.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187018+0000", 2024-09-12T22:50:14.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.033e-06 2024-09-12T22:50:14.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:14.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187023+0000", 2024-09-12T22:50:14.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7550000000000002e-06 2024-09-12T22:50:14.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187026+0000", 2024-09-12T22:50:14.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2710000000000001e-06 2024-09-12T22:50:14.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:14.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268462+0000", 2024-09-12T22:50:14.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.081435699 2024-09-12T22:50:14.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:14.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268507+0000", 2024-09-12T22:50:14.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5643999999999999e-05 2024-09-12T22:50:14.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:14.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268597+0000", 2024-09-12T22:50:14.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0112999999999996e-05 2024-09-12T22:50:14.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:14.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273947+0000", 2024-09-12T22:50:14.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053501859999999998 2024-09-12T22:50:14.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:14.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274083+0000", 2024-09-12T22:50:14.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013525500000000001 2024-09-12T22:50:14.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:14.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274109+0000", 2024-09-12T22:50:14.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6352000000000001e-05 2024-09-12T22:50:14.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:14.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274129+0000", 2024-09-12T22:50:14.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9686000000000001e-05 2024-09-12T22:50:14.868 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.868 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:14.868 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.868 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1948 3.8 3:17051619:::200.0000000f:head [write 1057443~1896 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:14.868 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.189230+0000", 2024-09-12T22:50:14.868 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.559556022999999, 2024-09-12T22:50:14.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.085028962999999999, 2024-09-12T22:50:14.869 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:14.869 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:14.869 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:14.869 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:14.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:14.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189230+0000", 2024-09-12T22:50:14.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:14.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189230+0000", 2024-09-12T22:50:14.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:14.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:14.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189231+0000", 2024-09-12T22:50:14.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1399999999999996e-07 2024-09-12T22:50:14.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:14.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189235+0000", 2024-09-12T22:50:14.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5970000000000002e-06 2024-09-12T22:50:14.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:14.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189242+0000", 2024-09-12T22:50:14.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8510000000000001e-06 2024-09-12T22:50:14.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:14.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189247+0000", 2024-09-12T22:50:14.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4800000000000003e-06 2024-09-12T22:50:14.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:14.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268908+0000", 2024-09-12T22:50:14.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079660983000000005 2024-09-12T22:50:14.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:14.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268967+0000", 2024-09-12T22:50:14.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9595000000000001e-05 2024-09-12T22:50:14.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:14.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.269040+0000", 2024-09-12T22:50:14.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2643000000000002e-05 2024-09-12T22:50:14.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:14.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273950+0000", 2024-09-12T22:50:14.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049105329999999999 2024-09-12T22:50:14.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:14.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274199+0000", 2024-09-12T22:50:14.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024824999999999999 2024-09-12T22:50:14.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:14.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274226+0000", 2024-09-12T22:50:14.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7602000000000001e-05 2024-09-12T22:50:14.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:14.874 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:14.874 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:14.874 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274259+0000", 2024-09-12T22:50:14.874 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2614999999999999e-05 2024-09-12T22:50:14.874 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.874 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:14.874 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.874 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:14.874 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:14.874 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:50:14.876 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:14.875+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:14.876 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:50:14.976 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:14.975+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:14.981 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:50:14.981 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:50:14.982 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:50:14.982 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:50:14.990 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:50:15.077 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:15.076+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:15.132 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:50:15.132 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:50:15.132 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:50:15.132 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:50:15.133 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:50:15.141 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:50:15.178 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:15.177+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:15.245 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:50:15.245 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:50:15.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:50:15.245 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:50:15.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.246 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12403 4.0 4:0146e0d0:::100000031d4.00000000:head [write 0~4194304 [2@3733965]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:15.246 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:55.747692+0000", 2024-09-12T22:50:15.246 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.495518587999999, 2024-09-12T22:50:15.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.22362137500000001, 2024-09-12T22:50:15.246 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:15.246 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:15.246 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:15.246 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:15.246 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:15.246 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:15.246 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12403 2024-09-12T22:50:15.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.246 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:15.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:15.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.747692+0000", 2024-09-12T22:50:15.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:15.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.747692+0000", 2024-09-12T22:50:15.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:15.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.747693+0000", 2024-09-12T22:50:15.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3799999999999996e-07 2024-09-12T22:50:15.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:15.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959640+0000", 2024-09-12T22:50:15.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.21194702000000001 2024-09-12T22:50:15.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:15.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959660+0000", 2024-09-12T22:50:15.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9939e-05 2024-09-12T22:50:15.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:15.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959668+0000", 2024-09-12T22:50:15.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1669999999999999e-06 2024-09-12T22:50:15.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:15.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959764+0000", 2024-09-12T22:50:15.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5315000000000005e-05 2024-09-12T22:50:15.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:15.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959865+0000", 2024-09-12T22:50:15.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101618 2024-09-12T22:50:15.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:15.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.971224+0000", 2024-09-12T22:50:15.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011358541999999999 2024-09-12T22:50:15.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:15.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.971261+0000", 2024-09-12T22:50:15.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7092999999999999e-05 2024-09-12T22:50:15.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:15.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.971314+0000", 2024-09-12T22:50:15.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2843000000000002e-05 2024-09-12T22:50:15.251 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.251 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:15.251 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.251 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:12503 4.15 e56/17 4:ab29d13f:::100000033b1.00000000:head v 56'161, mlcod=55'159)", 2024-09-12T22:50:15.251 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:50:15.252 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.212605110999998, 2024-09-12T22:50:15.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.043668640000000002, 2024-09-12T22:50:15.252 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:15.252 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:15.252 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:15.252 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:15.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:15.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:50:15.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:15.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:50:15.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:15.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:50:15.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:50:15.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:15.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039768+0000", 2024-09-12T22:50:15.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0091617190000000005 2024-09-12T22:50:15.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:15.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039781+0000", 2024-09-12T22:50:15.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2829e-05 2024-09-12T22:50:15.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:15.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039789+0000", 2024-09-12T22:50:15.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9340000000000006e-06 2024-09-12T22:50:15.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:15.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039846+0000", 2024-09-12T22:50:15.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6762999999999998e-05 2024-09-12T22:50:15.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:15.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039897+0000", 2024-09-12T22:50:15.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1517000000000002e-05 2024-09-12T22:50:15.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:15.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074225+0000", 2024-09-12T22:50:15.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034328138000000001 2024-09-12T22:50:15.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:15.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074274+0000", 2024-09-12T22:50:15.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9255999999999997e-05 2024-09-12T22:50:15.256 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.256 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:15.256 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.256 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12508 4.2d 4:b7b19b64:::10000003230.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:15.257 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.037293+0000", 2024-09-12T22:50:15.257 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.205917935999999, 2024-09-12T22:50:15.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.037399772999999997, 2024-09-12T22:50:15.257 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:15.257 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:15.257 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:15.257 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:15.257 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:15.257 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:15.257 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12508 2024-09-12T22:50:15.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.258 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:15.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:15.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037293+0000", 2024-09-12T22:50:15.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:15.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037293+0000", 2024-09-12T22:50:15.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:15.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037294+0000", 2024-09-12T22:50:15.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4899999999999995e-07 2024-09-12T22:50:15.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:15.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042701+0000", 2024-09-12T22:50:15.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054069419999999997 2024-09-12T22:50:15.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:15.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042712+0000", 2024-09-12T22:50:15.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.171e-05 2024-09-12T22:50:15.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:15.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042719+0000", 2024-09-12T22:50:15.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1189999999999999e-06 2024-09-12T22:50:15.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:15.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042759+0000", 2024-09-12T22:50:15.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9478999999999999e-05 2024-09-12T22:50:15.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:15.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042827+0000", 2024-09-12T22:50:15.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8435999999999993e-05 2024-09-12T22:50:15.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:15.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042965+0000", 2024-09-12T22:50:15.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000137723 2024-09-12T22:50:15.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:15.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.058351+0000", 2024-09-12T22:50:15.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015385902 2024-09-12T22:50:15.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:15.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074620+0000", 2024-09-12T22:50:15.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016269018 2024-09-12T22:50:15.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:15.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074657+0000", 2024-09-12T22:50:15.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6619999999999998e-05 2024-09-12T22:50:15.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:15.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074693+0000", 2024-09-12T22:50:15.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6174999999999998e-05 2024-09-12T22:50:15.263 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.263 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:15.263 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.264 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12516 4.21 4:858ae08d:::100000030eb.00000000:head [write 0~4194304 [3@1582458]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:15.264 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.045143+0000", 2024-09-12T22:50:15.264 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.198067647999999, 2024-09-12T22:50:15.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.039721657, 2024-09-12T22:50:15.264 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:15.264 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:15.264 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:15.264 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:15.264 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:15.264 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:15.264 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12516 2024-09-12T22:50:15.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.265 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:15.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:15.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.045143+0000", 2024-09-12T22:50:15.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:15.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.045143+0000", 2024-09-12T22:50:15.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:15.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.045144+0000", 2024-09-12T22:50:15.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2900000000000002e-07 2024-09-12T22:50:15.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:15.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049506+0000", 2024-09-12T22:50:15.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043620280000000004 2024-09-12T22:50:15.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:15.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049517+0000", 2024-09-12T22:50:15.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0726e-05 2024-09-12T22:50:15.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:15.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049522+0000", 2024-09-12T22:50:15.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3730000000000001e-06 2024-09-12T22:50:15.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:15.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049583+0000", 2024-09-12T22:50:15.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1254999999999995e-05 2024-09-12T22:50:15.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:15.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049645+0000", 2024-09-12T22:50:15.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1988000000000003e-05 2024-09-12T22:50:15.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:15.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049731+0000", 2024-09-12T22:50:15.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6040999999999998e-05 2024-09-12T22:50:15.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:15.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.064126+0000", 2024-09-12T22:50:15.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01439497 2024-09-12T22:50:15.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:15.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.084785+0000", 2024-09-12T22:50:15.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020658972000000001 2024-09-12T22:50:15.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:15.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.084829+0000", 2024-09-12T22:50:15.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3869000000000003e-05 2024-09-12T22:50:15.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:15.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.084865+0000", 2024-09-12T22:50:15.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5605999999999998e-05 2024-09-12T22:50:15.270 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.270 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:15.270 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.270 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1354 3.18 3:1e8917d7:::200.0000000e:head [write 498872~14494 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:15.270 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.048337+0000", 2024-09-12T22:50:15.270 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.194873729000001, 2024-09-12T22:50:15.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034292491000000001, 2024-09-12T22:50:15.270 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:15.270 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:15.271 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:15.271 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:15.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:15.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048337+0000", 2024-09-12T22:50:15.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:15.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048337+0000", 2024-09-12T22:50:15.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:15.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048339+0000", 2024-09-12T22:50:15.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.409e-06 2024-09-12T22:50:15.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:15.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048360+0000", 2024-09-12T22:50:15.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1659999999999999e-05 2024-09-12T22:50:15.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:15.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048370+0000", 2024-09-12T22:50:15.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.611e-06 2024-09-12T22:50:15.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:15.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048376+0000", 2024-09-12T22:50:15.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5479999999999998e-06 2024-09-12T22:50:15.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:15.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048440+0000", 2024-09-12T22:50:15.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3367000000000005e-05 2024-09-12T22:50:15.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:15.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048557+0000", 2024-09-12T22:50:15.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116983 2024-09-12T22:50:15.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:15.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048719+0000", 2024-09-12T22:50:15.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016250499999999999 2024-09-12T22:50:15.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:15.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.058763+0000", 2024-09-12T22:50:15.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010043948 2024-09-12T22:50:15.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:15.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082499+0000", 2024-09-12T22:50:15.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023735320000000001 2024-09-12T22:50:15.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:15.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082561+0000", 2024-09-12T22:50:15.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2490000000000006e-05 2024-09-12T22:50:15.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:15.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082630+0000", 2024-09-12T22:50:15.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8650000000000002e-05 2024-09-12T22:50:15.276 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.276 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:15.276 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.276 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12517 4.1a 4:5a8c04dd:::10000003276.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:15.276 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.049539+0000", 2024-09-12T22:50:15.276 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.193671967, 2024-09-12T22:50:15.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.036068957999999998, 2024-09-12T22:50:15.276 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:15.276 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:15.276 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:15.277 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:15.277 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:15.277 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:15.277 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12517 2024-09-12T22:50:15.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.277 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:15.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:15.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049539+0000", 2024-09-12T22:50:15.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:15.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049539+0000", 2024-09-12T22:50:15.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:15.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049540+0000", 2024-09-12T22:50:15.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1299999999999999e-07 2024-09-12T22:50:15.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:15.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054581+0000", 2024-09-12T22:50:15.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005041167 2024-09-12T22:50:15.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:15.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054593+0000", 2024-09-12T22:50:15.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1943000000000001e-05 2024-09-12T22:50:15.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:15.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054598+0000", 2024-09-12T22:50:15.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6500000000000001e-06 2024-09-12T22:50:15.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:15.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054658+0000", 2024-09-12T22:50:15.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9898999999999997e-05 2024-09-12T22:50:15.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:15.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054800+0000", 2024-09-12T22:50:15.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014187100000000001 2024-09-12T22:50:15.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:15.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.085456+0000", 2024-09-12T22:50:15.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.030655452 2024-09-12T22:50:15.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:15.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.085533+0000", 2024-09-12T22:50:15.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7478999999999995e-05 2024-09-12T22:50:15.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:15.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.085608+0000", 2024-09-12T22:50:15.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4684000000000005e-05 2024-09-12T22:50:15.281 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.282 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:15.282 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.282 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12677 4.10 4:0b7ac23f:::10000003457.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:15.282 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:50:15.282 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.013797171, 2024-09-12T22:50:15.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033661045000000001, 2024-09-12T22:50:15.282 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:15.282 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:15.282 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:15.282 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:15.282 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:15.283 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:15.283 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12677 2024-09-12T22:50:15.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.283 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:15.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:15.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:50:15.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:15.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:50:15.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:15.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:50:15.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0100000000000005e-07 2024-09-12T22:50:15.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:15.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.237295+0000", 2024-09-12T22:50:15.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078803290000000002 2024-09-12T22:50:15.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:15.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.237307+0000", 2024-09-12T22:50:15.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2339e-05 2024-09-12T22:50:15.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:15.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.237312+0000", 2024-09-12T22:50:15.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9089999999999999e-06 2024-09-12T22:50:15.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:15.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.239034+0000", 2024-09-12T22:50:15.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001722424 2024-09-12T22:50:15.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:15.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.239129+0000", 2024-09-12T22:50:15.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4486000000000003e-05 2024-09-12T22:50:15.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:15.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.239206+0000", 2024-09-12T22:50:15.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7146999999999998e-05 2024-09-12T22:50:15.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:15.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.255921+0000", 2024-09-12T22:50:15.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016714685 2024-09-12T22:50:15.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:15.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.263025+0000", 2024-09-12T22:50:15.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071042470000000002 2024-09-12T22:50:15.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:15.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.263052+0000", 2024-09-12T22:50:15.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7195e-05 2024-09-12T22:50:15.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:15.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.263075+0000", 2024-09-12T22:50:15.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2782999999999999e-05 2024-09-12T22:50:15.288 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.288 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:15.288 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.288 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12979 4.1e 4:78503759:::10000003406.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:15.289 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:50:15.289 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.678110374999999, 2024-09-12T22:50:15.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032861456999999997, 2024-09-12T22:50:15.289 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:15.289 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:15.289 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:15.289 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:15.289 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:15.289 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:15.289 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12979 2024-09-12T22:50:15.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.289 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:15.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:15.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:50:15.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:15.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:50:15.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:15.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:50:15.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9999999999999998e-07 2024-09-12T22:50:15.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:15.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573365+0000", 2024-09-12T22:50:15.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082644229999999999 2024-09-12T22:50:15.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:15.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573379+0000", 2024-09-12T22:50:15.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3322999999999999e-05 2024-09-12T22:50:15.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:15.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573386+0000", 2024-09-12T22:50:15.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.199e-06 2024-09-12T22:50:15.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:15.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573464+0000", 2024-09-12T22:50:15.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7931999999999999e-05 2024-09-12T22:50:15.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:15.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573713+0000", 2024-09-12T22:50:15.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024922200000000001 2024-09-12T22:50:15.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:15.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.597870+0000", 2024-09-12T22:50:15.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024157221999999999 2024-09-12T22:50:15.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:15.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.597926+0000", 2024-09-12T22:50:15.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5838000000000003e-05 2024-09-12T22:50:15.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:15.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.597962+0000", 2024-09-12T22:50:15.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5898000000000001e-05 2024-09-12T22:50:15.294 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.294 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:15.294 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.295 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:13017 4.3b e56/17 4:deb39c3c:::1000000315d.00000000:head v 56'194, mlcod=56'192)", 2024-09-12T22:50:15.295 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.600876+0000", 2024-09-12T22:50:15.295 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.642334899000002, 2024-09-12T22:50:15.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038152448999999998, 2024-09-12T22:50:15.295 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:15.295 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:15.295 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:15.295 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:15.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:15.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.600876+0000", 2024-09-12T22:50:15.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:15.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.600876+0000", 2024-09-12T22:50:15.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:15.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.600877+0000", 2024-09-12T22:50:15.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:50:15.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:15.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609737+0000", 2024-09-12T22:50:15.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088599089999999991 2024-09-12T22:50:15.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:15.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609748+0000", 2024-09-12T22:50:15.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1355999999999999e-05 2024-09-12T22:50:15.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:15.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609757+0000", 2024-09-12T22:50:15.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9190000000000005e-06 2024-09-12T22:50:15.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:15.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609801+0000", 2024-09-12T22:50:15.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4019e-05 2024-09-12T22:50:15.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:15.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609816+0000", 2024-09-12T22:50:15.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5226e-05 2024-09-12T22:50:15.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:15.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.638985+0000", 2024-09-12T22:50:15.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029168537000000001 2024-09-12T22:50:15.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:15.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.639028+0000", 2024-09-12T22:50:15.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3847000000000002e-05 2024-09-12T22:50:15.300 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.300 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:15.300 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.300 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13032 4.7 4:e102bf81:::1000000359e.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:15.300 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.616553+0000", 2024-09-12T22:50:15.300 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.626658046999999, 2024-09-12T22:50:15.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032471027999999999, 2024-09-12T22:50:15.300 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:15.301 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:15.301 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:15.301 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:15.301 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:15.301 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:15.301 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13032 2024-09-12T22:50:15.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.301 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:15.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:15.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.616553+0000", 2024-09-12T22:50:15.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:15.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.616553+0000", 2024-09-12T22:50:15.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:15.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.616554+0000", 2024-09-12T22:50:15.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0100000000000004e-07 2024-09-12T22:50:15.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:15.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621405+0000", 2024-09-12T22:50:15.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0048517480000000003 2024-09-12T22:50:15.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:15.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621416+0000", 2024-09-12T22:50:15.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0264e-05 2024-09-12T22:50:15.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:15.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621446+0000", 2024-09-12T22:50:15.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0849000000000002e-05 2024-09-12T22:50:15.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:15.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621494+0000", 2024-09-12T22:50:15.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7018000000000003e-05 2024-09-12T22:50:15.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:15.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621590+0000", 2024-09-12T22:50:15.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6632999999999995e-05 2024-09-12T22:50:15.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:15.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621680+0000", 2024-09-12T22:50:15.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9704999999999996e-05 2024-09-12T22:50:15.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:15.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.639248+0000", 2024-09-12T22:50:15.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017568548 2024-09-12T22:50:15.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:15.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.648944+0000", 2024-09-12T22:50:15.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0096954659999999998 2024-09-12T22:50:15.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:15.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.648992+0000", 2024-09-12T22:50:15.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8059999999999997e-05 2024-09-12T22:50:15.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:15.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.649024+0000", 2024-09-12T22:50:15.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1936000000000001e-05 2024-09-12T22:50:15.306 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.306 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:15.306 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.306 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13428 4.37 4:eeed8456:::1000000321a.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:15.307 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.064666+0000", 2024-09-12T22:50:15.307 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.178544768999998, 2024-09-12T22:50:15.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033441308000000003, 2024-09-12T22:50:15.307 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:15.307 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:15.307 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:15.307 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:15.307 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:15.307 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:15.307 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13428 2024-09-12T22:50:15.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.307 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:15.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:15.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.064666+0000", 2024-09-12T22:50:15.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:15.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.064666+0000", 2024-09-12T22:50:15.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:15.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.064668+0000", 2024-09-12T22:50:15.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4160000000000001e-06 2024-09-12T22:50:15.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:15.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071829+0000", 2024-09-12T22:50:15.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071611390000000004 2024-09-12T22:50:15.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:15.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071840+0000", 2024-09-12T22:50:15.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1369000000000001e-05 2024-09-12T22:50:15.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:15.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071847+0000", 2024-09-12T22:50:15.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0960000000000003e-06 2024-09-12T22:50:15.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:15.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071904+0000", 2024-09-12T22:50:15.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7309000000000003e-05 2024-09-12T22:50:15.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:15.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.072051+0000", 2024-09-12T22:50:15.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014625 2024-09-12T22:50:15.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:15.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.072194+0000", 2024-09-12T22:50:15.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014379799999999999 2024-09-12T22:50:15.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:15.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.079527+0000", 2024-09-12T22:50:15.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007332674 2024-09-12T22:50:15.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:15.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.098048+0000", 2024-09-12T22:50:15.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018521174000000001 2024-09-12T22:50:15.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:15.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.098081+0000", 2024-09-12T22:50:15.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2910999999999997e-05 2024-09-12T22:50:15.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:15.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.098107+0000", 2024-09-12T22:50:15.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6171999999999999e-05 2024-09-12T22:50:15.312 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.312 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:15.312 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.313 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13472 4.12 4:4b0bd9b8:::100000033b0.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:15.313 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.113168+0000", 2024-09-12T22:50:15.313 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.130043069999999, 2024-09-12T22:50:15.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.039534103000000001, 2024-09-12T22:50:15.313 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:15.314 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:15.314 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:15.314 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:15.314 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:15.314 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:15.315 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13472 2024-09-12T22:50:15.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.315 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:15.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:15.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.113168+0000", 2024-09-12T22:50:15.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:15.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.113168+0000", 2024-09-12T22:50:15.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:15.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.113169+0000", 2024-09-12T22:50:15.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1960000000000001e-06 2024-09-12T22:50:15.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:15.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119849+0000", 2024-09-12T22:50:15.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0066801830000000001 2024-09-12T22:50:15.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:15.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119861+0000", 2024-09-12T22:50:15.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.199e-05 2024-09-12T22:50:15.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:15.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119866+0000", 2024-09-12T22:50:15.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8720000000000001e-06 2024-09-12T22:50:15.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:15.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119945+0000", 2024-09-12T22:50:15.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9268000000000001e-05 2024-09-12T22:50:15.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:15.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.120098+0000", 2024-09-12T22:50:15.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015299500000000001 2024-09-12T22:50:15.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:15.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.120218+0000", 2024-09-12T22:50:15.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011989099999999999 2024-09-12T22:50:15.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:15.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.140463+0000", 2024-09-12T22:50:15.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020244765000000001 2024-09-12T22:50:15.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:15.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.152629+0000", 2024-09-12T22:50:15.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012165601999999999 2024-09-12T22:50:15.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:15.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.152664+0000", 2024-09-12T22:50:15.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5599999999999998e-05 2024-09-12T22:50:15.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:15.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.152702+0000", 2024-09-12T22:50:15.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7741000000000003e-05 2024-09-12T22:50:15.320 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.320 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:15.320 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.320 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13484 4.2f 4:f62c2e43:::1000000349e.00000000:head [write 0~4194304 [2@3461078]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:15.320 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.125796+0000", 2024-09-12T22:50:15.321 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.117414706999998, 2024-09-12T22:50:15.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.036857236000000002, 2024-09-12T22:50:15.321 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:15.321 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:15.321 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:15.321 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:15.321 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:15.321 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:15.322 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13484 2024-09-12T22:50:15.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.322 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:15.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:15.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.125796+0000", 2024-09-12T22:50:15.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:15.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.125796+0000", 2024-09-12T22:50:15.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:15.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.125797+0000", 2024-09-12T22:50:15.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.108e-06 2024-09-12T22:50:15.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:15.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130725+0000", 2024-09-12T22:50:15.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049272949999999999 2024-09-12T22:50:15.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:15.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130739+0000", 2024-09-12T22:50:15.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4234e-05 2024-09-12T22:50:15.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:15.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130751+0000", 2024-09-12T22:50:15.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1848000000000001e-05 2024-09-12T22:50:15.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:15.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130816+0000", 2024-09-12T22:50:15.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5359999999999998e-05 2024-09-12T22:50:15.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:15.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130917+0000", 2024-09-12T22:50:15.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101178 2024-09-12T22:50:15.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:15.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.131058+0000", 2024-09-12T22:50:15.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140803 2024-09-12T22:50:15.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:15.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.153387+0000", 2024-09-12T22:50:15.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022328585000000001 2024-09-12T22:50:15.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:15.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.162465+0000", 2024-09-12T22:50:15.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090781360000000005 2024-09-12T22:50:15.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:15.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.162584+0000", 2024-09-12T22:50:15.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119634 2024-09-12T22:50:15.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:15.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.162653+0000", 2024-09-12T22:50:15.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9054999999999995e-05 2024-09-12T22:50:15.328 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.328 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:15.328 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.328 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13558 4.10 4:09df41af:::1000000333c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:15.329 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.229326+0000", 2024-09-12T22:50:15.329 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.013884878999999, 2024-09-12T22:50:15.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.039409786000000002, 2024-09-12T22:50:15.329 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:15.329 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:15.329 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:15.329 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:15.329 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:15.329 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:15.329 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13558 2024-09-12T22:50:15.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.329 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:15.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:15.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.229326+0000", 2024-09-12T22:50:15.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:15.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.229326+0000", 2024-09-12T22:50:15.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:15.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.229327+0000", 2024-09-12T22:50:15.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1200000000000002e-07 2024-09-12T22:50:15.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:15.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235243+0000", 2024-09-12T22:50:15.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059166310000000003 2024-09-12T22:50:15.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:15.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235255+0000", 2024-09-12T22:50:15.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1174e-05 2024-09-12T22:50:15.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:15.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235260+0000", 2024-09-12T22:50:15.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1749999999999996e-06 2024-09-12T22:50:15.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:15.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235295+0000", 2024-09-12T22:50:15.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4830999999999999e-05 2024-09-12T22:50:15.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:15.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235350+0000", 2024-09-12T22:50:15.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5092e-05 2024-09-12T22:50:15.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:15.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235426+0000", 2024-09-12T22:50:15.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6463000000000003e-05 2024-09-12T22:50:15.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:15.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.244772+0000", 2024-09-12T22:50:15.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0093457709999999992 2024-09-12T22:50:15.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:15.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.268679+0000", 2024-09-12T22:50:15.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023906788000000002 2024-09-12T22:50:15.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:15.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.268712+0000", 2024-09-12T22:50:15.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3701999999999997e-05 2024-09-12T22:50:15.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:15.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.268736+0000", 2024-09-12T22:50:15.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3447000000000001e-05 2024-09-12T22:50:15.335 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.335 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:15.335 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.335 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13747 4.1e 4:7aa36f33:::100000035ed.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:15.335 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.457376+0000", 2024-09-12T22:50:15.335 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 17.785834765000001, 2024-09-12T22:50:15.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.037057578000000001, 2024-09-12T22:50:15.336 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:15.336 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:15.336 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:15.336 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:15.336 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:15.336 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:15.336 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13747 2024-09-12T22:50:15.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.336 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:15.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:15.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.457376+0000", 2024-09-12T22:50:15.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:15.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.457376+0000", 2024-09-12T22:50:15.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:15.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.457377+0000", 2024-09-12T22:50:15.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1699999999999998e-07 2024-09-12T22:50:15.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:15.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464400+0000", 2024-09-12T22:50:15.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070235890000000002 2024-09-12T22:50:15.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:15.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464413+0000", 2024-09-12T22:50:15.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2397e-05 2024-09-12T22:50:15.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:15.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464418+0000", 2024-09-12T22:50:15.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5119999999999999e-06 2024-09-12T22:50:15.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:15.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464464+0000", 2024-09-12T22:50:15.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5976000000000002e-05 2024-09-12T22:50:15.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:15.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464529+0000", 2024-09-12T22:50:15.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5266999999999997e-05 2024-09-12T22:50:15.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:15.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.494315+0000", 2024-09-12T22:50:15.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029785329999999999 2024-09-12T22:50:15.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:15.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.494366+0000", 2024-09-12T22:50:15.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0903999999999999e-05 2024-09-12T22:50:15.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:15.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.494434+0000", 2024-09-12T22:50:15.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7985999999999996e-05 2024-09-12T22:50:15.341 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.341 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:15.341 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.341 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:13748 4.15 e56/17 4:ab1b03eb:::100000031a3.00000000:head v 56'173, mlcod=56'171)", 2024-09-12T22:50:15.341 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.462509+0000", 2024-09-12T22:50:15.341 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 17.780701718, 2024-09-12T22:50:15.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044366823, 2024-09-12T22:50:15.342 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:15.342 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:15.342 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:15.342 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:15.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:15.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.462509+0000", 2024-09-12T22:50:15.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:15.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.462509+0000", 2024-09-12T22:50:15.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:15.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.462509+0000", 2024-09-12T22:50:15.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7599999999999998e-07 2024-09-12T22:50:15.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:15.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471576+0000", 2024-09-12T22:50:15.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090665490000000001 2024-09-12T22:50:15.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:15.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471591+0000", 2024-09-12T22:50:15.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4566000000000001e-05 2024-09-12T22:50:15.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:15.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471600+0000", 2024-09-12T22:50:15.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1630000000000002e-06 2024-09-12T22:50:15.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:15.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471689+0000", 2024-09-12T22:50:15.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9591000000000003e-05 2024-09-12T22:50:15.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:15.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471735+0000", 2024-09-12T22:50:15.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5429000000000002e-05 2024-09-12T22:50:15.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:15.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.506851+0000", 2024-09-12T22:50:15.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035116238000000001 2024-09-12T22:50:15.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:15.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.506876+0000", 2024-09-12T22:50:15.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5011000000000002e-05 2024-09-12T22:50:15.346 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.346 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:15.346 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.346 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13753 4.30 4:0dea61b7:::100000036ed.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:15.346 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.464559+0000", 2024-09-12T22:50:15.346 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 17.778651718999999, 2024-09-12T22:50:15.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041415303000000001, 2024-09-12T22:50:15.346 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:15.346 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:15.347 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:15.347 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:15.347 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:15.347 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:15.347 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13753 2024-09-12T22:50:15.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.347 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:15.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:15.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464559+0000", 2024-09-12T22:50:15.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:15.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464559+0000", 2024-09-12T22:50:15.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:15.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464560+0000", 2024-09-12T22:50:15.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:50:15.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:15.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469861+0000", 2024-09-12T22:50:15.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053017139999999999 2024-09-12T22:50:15.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:15.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469878+0000", 2024-09-12T22:50:15.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6336000000000001e-05 2024-09-12T22:50:15.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:15.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469888+0000", 2024-09-12T22:50:15.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8320000000000001e-06 2024-09-12T22:50:15.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:15.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469950+0000", 2024-09-12T22:50:15.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1923999999999999e-05 2024-09-12T22:50:15.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:15.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.470059+0000", 2024-09-12T22:50:15.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109559 2024-09-12T22:50:15.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:15.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.505915+0000", 2024-09-12T22:50:15.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035855887000000003 2024-09-12T22:50:15.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:15.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.505939+0000", 2024-09-12T22:50:15.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3740999999999999e-05 2024-09-12T22:50:15.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:15.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.505974+0000", 2024-09-12T22:50:15.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5753999999999997e-05 2024-09-12T22:50:15.351 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.352 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:15.352 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.352 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13754 4.11 4:8a2f20b1:::10000003764.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:15.352 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.469921+0000", 2024-09-12T22:50:15.352 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 17.773289866999999, 2024-09-12T22:50:15.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034721670000000003, 2024-09-12T22:50:15.352 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:15.352 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:15.352 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:15.352 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:15.353 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:15.353 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:15.353 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13754 2024-09-12T22:50:15.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.353 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:15.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:15.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469921+0000", 2024-09-12T22:50:15.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:15.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469921+0000", 2024-09-12T22:50:15.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:15.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469922+0000", 2024-09-12T22:50:15.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.006e-06 2024-09-12T22:50:15.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:15.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474681+0000", 2024-09-12T22:50:15.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047588539999999999 2024-09-12T22:50:15.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:15.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474698+0000", 2024-09-12T22:50:15.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7368999999999999e-05 2024-09-12T22:50:15.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:15.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474709+0000", 2024-09-12T22:50:15.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0738e-05 2024-09-12T22:50:15.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:15.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474780+0000", 2024-09-12T22:50:15.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0622000000000002e-05 2024-09-12T22:50:15.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:15.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474954+0000", 2024-09-12T22:50:15.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017394399999999999 2024-09-12T22:50:15.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:15.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.504488+0000", 2024-09-12T22:50:15.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029534721999999999 2024-09-12T22:50:15.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:15.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.504553+0000", 2024-09-12T22:50:15.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4877999999999998e-05 2024-09-12T22:50:15.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:15.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.504643+0000", 2024-09-12T22:50:15.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9536999999999993e-05 2024-09-12T22:50:15.357 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.357 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:15.358 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.358 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13763 4.2d 4:b5937a57:::100000031de.00000000:head [write 0~4194304 [3@52474]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:15.358 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.474957+0000", 2024-09-12T22:50:15.358 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 17.768253624, 2024-09-12T22:50:15.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.057329167, 2024-09-12T22:50:15.358 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:15.358 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:15.358 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:15.358 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:15.358 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:15.358 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:15.359 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13763 2024-09-12T22:50:15.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.359 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:15.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:15.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474957+0000", 2024-09-12T22:50:15.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:15.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474957+0000", 2024-09-12T22:50:15.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:15.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474958+0000", 2024-09-12T22:50:15.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8299999999999997e-07 2024-09-12T22:50:15.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:15.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.478970+0000", 2024-09-12T22:50:15.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040121100000000002 2024-09-12T22:50:15.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:15.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.478983+0000", 2024-09-12T22:50:15.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.292e-05 2024-09-12T22:50:15.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:15.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.478992+0000", 2024-09-12T22:50:15.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3759999999999997e-06 2024-09-12T22:50:15.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:15.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.479048+0000", 2024-09-12T22:50:15.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5381999999999999e-05 2024-09-12T22:50:15.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:15.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.479124+0000", 2024-09-12T22:50:15.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6643999999999993e-05 2024-09-12T22:50:15.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:15.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.479230+0000", 2024-09-12T22:50:15.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010581099999999999 2024-09-12T22:50:15.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:15.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.506897+0000", 2024-09-12T22:50:15.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027666863999999999 2024-09-12T22:50:15.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:15.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.532175+0000", 2024-09-12T22:50:15.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.025278367 2024-09-12T22:50:15.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:15.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.532232+0000", 2024-09-12T22:50:15.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6455000000000001e-05 2024-09-12T22:50:15.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:15.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.532286+0000", 2024-09-12T22:50:15.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4654999999999998e-05 2024-09-12T22:50:15.364 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.364 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:15.364 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.364 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13803 4.4 4:228c5bc4:::10000003314.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:15.365 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.515814+0000", 2024-09-12T22:50:15.365 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 17.727397197999998, 2024-09-12T22:50:15.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034442453999999997, 2024-09-12T22:50:15.365 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:15.365 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:15.365 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:15.365 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:15.365 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:15.365 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:15.365 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13803 2024-09-12T22:50:15.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.365 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:15.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:15.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.515814+0000", 2024-09-12T22:50:15.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:15.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.515814+0000", 2024-09-12T22:50:15.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:15.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:15.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.515814+0000", 2024-09-12T22:50:15.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4799999999999998e-07 2024-09-12T22:50:15.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:15.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522580+0000", 2024-09-12T22:50:15.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0067656959999999999 2024-09-12T22:50:15.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:15.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522591+0000", 2024-09-12T22:50:15.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1206000000000001e-05 2024-09-12T22:50:15.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:15.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522597+0000", 2024-09-12T22:50:15.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1500000000000004e-06 2024-09-12T22:50:15.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:15.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522639+0000", 2024-09-12T22:50:15.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1767999999999997e-05 2024-09-12T22:50:15.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:15.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522689+0000", 2024-09-12T22:50:15.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9472999999999999e-05 2024-09-12T22:50:15.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:15.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522771+0000", 2024-09-12T22:50:15.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2738000000000006e-05 2024-09-12T22:50:15.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:15.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.529356+0000", 2024-09-12T22:50:15.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065850329999999997 2024-09-12T22:50:15.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:15.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.550206+0000", 2024-09-12T22:50:15.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020849755000000001 2024-09-12T22:50:15.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:15.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.550233+0000", 2024-09-12T22:50:15.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6990000000000001e-05 2024-09-12T22:50:15.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:15.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:15.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:15.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.550256+0000", 2024-09-12T22:50:15.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3096999999999999e-05 2024-09-12T22:50:15.371 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.371 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:15.371 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.371 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:15.371 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:15.371 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:50:15.373 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:15.372+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:15.373 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:50:15.456 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:50:15.474 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:15.473+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:15.478 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:50:15.478 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:50:15.478 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:50:15.478 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:50:15.487 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:50:15.575 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:15.574+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:15.594 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:50:15.595 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:50:15.613 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:50:15.613 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:50:15.613 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:50:15.617 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:50:15.617 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:50:15.629 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:15.630 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:15.638 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:50:15.676 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:15.676+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:15.740 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:15.740 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:15.749 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:50:15.753 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:50:15.778 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:15.777+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:15.857 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:15.857 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:15.866 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:50:15.910 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:15.909+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:15.969 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:15.969 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:15.978 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:50:15.979 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:15.979+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:16.080 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:16.079+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:16.121 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:16.121 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:16.129 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:50:16.181 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:16.180+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:16.236 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:16.236 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:16.245 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:50:16.282 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:16.281+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:16.383 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:16.382+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:16.388 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:16.388 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:16.397 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:50:16.484 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:16.484+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:16.541 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:16.541 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:16.549 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:50:16.593 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:16.592+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:16.653 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:16.653 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:16.662 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:50:16.703 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:16.702+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:16.762 INFO:teuthology.orchestra.run.smithi066.stderr:noscrub is unset 2024-09-12T22:50:16.787 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:16.786+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:16.806 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:16.806 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:16.816 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:50:16.888 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:16.887+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:16.919 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:16.919 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:16.928 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:50:16.989 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:16.988+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:17.031 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:17.032 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:17.040 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:50:17.125 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:17.124+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:17.184 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:17.184 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:17.191 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:17.190+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:17.192 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:50:17.293 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:17.292+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:17.336 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:17.336 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:17.345 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:50:17.394 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:17.393+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:17.449 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:17.449 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:17.457 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:50:17.488 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~106s 2024-09-12T22:50:17.494 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:17.493+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:17.524 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi066.front.sepia.ceph.com 2024-09-12T22:50:17.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:50:17.524 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T22:50:17.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:50:17.551 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2024-09-12T22:50:17.595 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-12T22:50:17.594+0000 7f4e85c4f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30320) UID: 0 2024-09-12T22:50:17.600 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:17.601 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:17.610 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:50:17.611 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T22:50:17.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:50:17.612 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T22:50:17.618 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:50:17.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:50:17.684 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link delete ceph-brx 2024-09-12T22:50:17.695 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-12T22:50:17.694+0000 7f9e4966f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30313) UID: 0 2024-09-12T22:50:17.715 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-12T22:50:17.715 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:50:17.724 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:50:17.790 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-12T22:50:17.799 INFO:tasks.thrashosds:joining thrashosds 2024-09-12T22:50:17.800 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0: {} 2024-09-12T22:50:17.800 INFO:teuthology.orchestra.run.smithi066.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:50:17.812 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1: {} 2024-09-12T22:50:17.813 INFO:teuthology.orchestra.run.smithi066.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:50:17.813 INFO:teuthology.orchestra.run.smithi066.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:50:17.816 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:50:17.817 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:50:17.829 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:50:17.829 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:50:17.829 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-09-12T22:50:17.829 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:50:17.838 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:50:17.940 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:50:17.940 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-09-12T22:50:17.940 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-09-12T22:50:17.940 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-09-12T22:50:17.940 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:50:17.949 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:50:18.053 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-12T22:50:18.053 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-09-12T22:50:18.054 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-09-12T22:50:18.054 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-09-12T22:50:18.054 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.054 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1923 3.8 3:17051619:::200.0000000f:head [write 935107~4527 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:18.054 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.157731+0000", 2024-09-12T22:50:18.054 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.893669940999999, 2024-09-12T22:50:18.054 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.085115956000000006, 2024-09-12T22:50:18.054 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:18.054 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:18.054 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.054 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:18.054 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.054 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:18.055 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157731+0000", 2024-09-12T22:50:18.055 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.055 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.055 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.055 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:18.055 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157731+0000", 2024-09-12T22:50:18.055 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.055 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.055 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.055 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:18.055 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157732+0000", 2024-09-12T22:50:18.055 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.99e-07 2024-09-12T22:50:18.055 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.055 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.056 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:18.056 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157737+0000", 2024-09-12T22:50:18.056 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6280000000000002e-06 2024-09-12T22:50:18.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.056 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.056 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:18.056 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157745+0000", 2024-09-12T22:50:18.056 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1749999999999999e-06 2024-09-12T22:50:18.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.056 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.056 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.056 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.157749+0000", 2024-09-12T22:50:18.056 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.946e-06 2024-09-12T22:50:18.057 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.057 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.057 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:18.057 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.236865+0000", 2024-09-12T22:50:18.057 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079116687000000005 2024-09-12T22:50:18.057 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.057 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.057 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:18.057 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.236929+0000", 2024-09-12T22:50:18.057 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3566999999999996e-05 2024-09-12T22:50:18.057 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.057 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.057 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:18.057 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237025+0000", 2024-09-12T22:50:18.058 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6620000000000007e-05 2024-09-12T22:50:18.058 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.058 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.058 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:18.058 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240342+0000", 2024-09-12T22:50:18.058 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033162539999999998 2024-09-12T22:50:18.058 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.058 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.058 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:18.058 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242737+0000", 2024-09-12T22:50:18.058 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023957370000000002 2024-09-12T22:50:18.058 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.058 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.058 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:18.059 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242797+0000", 2024-09-12T22:50:18.059 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9323000000000001e-05 2024-09-12T22:50:18.059 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.059 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.059 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:18.059 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242847+0000", 2024-09-12T22:50:18.059 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0319999999999999e-05 2024-09-12T22:50:18.059 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.059 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:18.059 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.059 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.059 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.059 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1924 3.8 3:17051619:::200.0000000f:head [write 939634~6106 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:18.060 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.159169+0000", 2024-09-12T22:50:18.060 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.892231721999998, 2024-09-12T22:50:18.060 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.083843601000000004, 2024-09-12T22:50:18.060 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:18.060 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:18.060 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.060 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:18.060 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.060 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:18.060 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159169+0000", 2024-09-12T22:50:18.060 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.060 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.060 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.061 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:18.061 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159169+0000", 2024-09-12T22:50:18.061 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.061 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.061 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.061 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:18.061 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159171+0000", 2024-09-12T22:50:18.061 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4959999999999999e-06 2024-09-12T22:50:18.061 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.061 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.061 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:18.061 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159182+0000", 2024-09-12T22:50:18.061 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1104000000000001e-05 2024-09-12T22:50:18.061 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.062 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.062 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:18.062 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159190+0000", 2024-09-12T22:50:18.062 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3520000000000007e-06 2024-09-12T22:50:18.062 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.062 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.062 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.062 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.159196+0000", 2024-09-12T22:50:18.062 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5690000000000004e-06 2024-09-12T22:50:18.062 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.062 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.062 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:18.062 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237476+0000", 2024-09-12T22:50:18.063 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078280197999999995 2024-09-12T22:50:18.063 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.063 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.063 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:18.063 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237530+0000", 2024-09-12T22:50:18.063 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4419000000000002e-05 2024-09-12T22:50:18.063 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.063 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.063 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:18.063 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.237593+0000", 2024-09-12T22:50:18.063 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2611000000000001e-05 2024-09-12T22:50:18.063 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.063 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.064 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:18.064 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242030+0000", 2024-09-12T22:50:18.064 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044367369999999996 2024-09-12T22:50:18.064 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.064 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.064 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:18.064 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242893+0000", 2024-09-12T22:50:18.064 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00086367400000000004 2024-09-12T22:50:18.064 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.064 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.064 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:18.064 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242956+0000", 2024-09-12T22:50:18.064 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2885999999999994e-05 2024-09-12T22:50:18.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.065 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.065 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:18.065 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243013+0000", 2024-09-12T22:50:18.065 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6555000000000003e-05 2024-09-12T22:50:18.065 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.065 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:18.065 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.065 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.065 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1925 3.8 3:17051619:::200.0000000f:head [write 945740~9955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:18.065 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.160395+0000", 2024-09-12T22:50:18.065 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.891006513000001, 2024-09-12T22:50:18.065 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.091200247999999998, 2024-09-12T22:50:18.066 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:18.066 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:18.066 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.066 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:18.066 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.066 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:18.066 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160395+0000", 2024-09-12T22:50:18.066 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.066 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.066 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.066 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:18.066 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160395+0000", 2024-09-12T22:50:18.066 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.066 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.067 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.067 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:18.067 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160396+0000", 2024-09-12T22:50:18.067 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1599999999999999e-06 2024-09-12T22:50:18.067 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.067 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.067 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:18.067 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160415+0000", 2024-09-12T22:50:18.067 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9680000000000001e-05 2024-09-12T22:50:18.067 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.067 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.067 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:18.067 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160428+0000", 2024-09-12T22:50:18.067 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2792999999999999e-05 2024-09-12T22:50:18.068 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.068 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.068 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.068 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160436+0000", 2024-09-12T22:50:18.068 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0399999999999993e-06 2024-09-12T22:50:18.068 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.068 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.068 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:18.068 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.238408+0000", 2024-09-12T22:50:18.068 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077971602000000001 2024-09-12T22:50:18.068 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.068 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.068 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:18.068 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.238504+0000", 2024-09-12T22:50:18.069 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6714999999999998e-05 2024-09-12T22:50:18.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.069 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:18.069 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.238687+0000", 2024-09-12T22:50:18.069 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000182795 2024-09-12T22:50:18.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.069 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:18.069 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242036+0000", 2024-09-12T22:50:18.069 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003348887 2024-09-12T22:50:18.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.070 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:18.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251510+0000", 2024-09-12T22:50:18.070 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094733679999999994 2024-09-12T22:50:18.070 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.070 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.070 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:18.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251543+0000", 2024-09-12T22:50:18.070 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2974e-05 2024-09-12T22:50:18.070 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.070 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.070 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:18.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251595+0000", 2024-09-12T22:50:18.070 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2234000000000002e-05 2024-09-12T22:50:18.070 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.070 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:18.071 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.071 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.071 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.071 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1926 3.8 3:17051619:::200.0000000f:head [write 955695~5281 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:18.071 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.160849+0000", 2024-09-12T22:50:18.071 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.890551558999999, 2024-09-12T22:50:18.071 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.094772633999999994, 2024-09-12T22:50:18.071 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:18.071 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:18.071 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.071 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:18.071 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.071 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:18.072 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160849+0000", 2024-09-12T22:50:18.072 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.072 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.072 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.072 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:18.072 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160849+0000", 2024-09-12T22:50:18.072 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.072 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.072 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.072 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:18.072 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160850+0000", 2024-09-12T22:50:18.072 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6700000000000002e-07 2024-09-12T22:50:18.072 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.072 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.073 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:18.073 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160858+0000", 2024-09-12T22:50:18.073 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5630000000000003e-06 2024-09-12T22:50:18.073 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.073 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.073 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:18.073 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160866+0000", 2024-09-12T22:50:18.073 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7570000000000004e-06 2024-09-12T22:50:18.073 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.073 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.073 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.073 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.160870+0000", 2024-09-12T22:50:18.073 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5929999999999999e-06 2024-09-12T22:50:18.073 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.074 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.074 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:18.074 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.239705+0000", 2024-09-12T22:50:18.074 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078834491000000007 2024-09-12T22:50:18.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.074 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.074 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:18.074 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.239764+0000", 2024-09-12T22:50:18.074 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9190000000000001e-05 2024-09-12T22:50:18.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.074 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.074 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:18.074 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.239851+0000", 2024-09-12T22:50:18.074 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7472999999999994e-05 2024-09-12T22:50:18.075 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.075 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.075 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:18.075 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254001+0000", 2024-09-12T22:50:18.075 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014149622000000001 2024-09-12T22:50:18.075 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.075 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.075 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:18.075 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255525+0000", 2024-09-12T22:50:18.075 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0015236500000000001 2024-09-12T22:50:18.075 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.075 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.075 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:18.076 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255567+0000", 2024-09-12T22:50:18.076 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2150999999999997e-05 2024-09-12T22:50:18.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.076 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.076 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:18.076 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255622+0000", 2024-09-12T22:50:18.076 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5276999999999999e-05 2024-09-12T22:50:18.076 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.076 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:18.076 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.076 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.076 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1927 3.8 3:17051619:::200.0000000f:head [write 960976~5828 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:18.076 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.164361+0000", 2024-09-12T22:50:18.077 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.887039862000002, 2024-09-12T22:50:18.077 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.091388523999999999, 2024-09-12T22:50:18.077 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:18.077 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:18.077 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.077 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:18.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.077 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:18.077 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164361+0000", 2024-09-12T22:50:18.077 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.077 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:18.077 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164361+0000", 2024-09-12T22:50:18.078 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.078 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.078 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.078 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:18.078 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164363+0000", 2024-09-12T22:50:18.078 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.389e-06 2024-09-12T22:50:18.078 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.078 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.078 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:18.078 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164370+0000", 2024-09-12T22:50:18.078 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.99e-06 2024-09-12T22:50:18.078 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.078 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.078 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:18.079 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164379+0000", 2024-09-12T22:50:18.079 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9499999999999996e-06 2024-09-12T22:50:18.079 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.079 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.079 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.079 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.164385+0000", 2024-09-12T22:50:18.079 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5879999999999997e-06 2024-09-12T22:50:18.079 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.079 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.079 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:18.079 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240385+0000", 2024-09-12T22:50:18.079 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075999995000000001 2024-09-12T22:50:18.079 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.079 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.080 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:18.080 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240533+0000", 2024-09-12T22:50:18.080 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014811699999999999 2024-09-12T22:50:18.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.080 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.080 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:18.080 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.240886+0000", 2024-09-12T22:50:18.080 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000352517 2024-09-12T22:50:18.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.080 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.080 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:18.080 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254024+0000", 2024-09-12T22:50:18.080 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013138047999999999 2024-09-12T22:50:18.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.081 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:18.081 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255629+0000", 2024-09-12T22:50:18.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001604949 2024-09-12T22:50:18.081 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.081 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:18.081 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255683+0000", 2024-09-12T22:50:18.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4035e-05 2024-09-12T22:50:18.081 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.081 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:18.081 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255750+0000", 2024-09-12T22:50:18.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6946000000000006e-05 2024-09-12T22:50:18.082 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.082 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:18.082 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.082 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.082 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1928 3.8 3:17051619:::200.0000000f:head [write 966804~6536 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:18.082 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167179+0000", 2024-09-12T22:50:18.082 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.884222063999999, 2024-09-12T22:50:18.082 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.089785880999999998, 2024-09-12T22:50:18.082 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:18.082 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:18.082 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.082 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:18.082 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.083 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:18.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167179+0000", 2024-09-12T22:50:18.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.083 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:18.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167179+0000", 2024-09-12T22:50:18.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.083 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:18.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167180+0000", 2024-09-12T22:50:18.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2869999999999999e-06 2024-09-12T22:50:18.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:18.084 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167192+0000", 2024-09-12T22:50:18.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.187e-05 2024-09-12T22:50:18.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:18.084 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167203+0000", 2024-09-12T22:50:18.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1076e-05 2024-09-12T22:50:18.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.084 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167210+0000", 2024-09-12T22:50:18.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1799999999999999e-06 2024-09-12T22:50:18.085 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.085 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.085 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:18.085 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.241518+0000", 2024-09-12T22:50:18.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074307845999999997 2024-09-12T22:50:18.085 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.085 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.085 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:18.085 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.241563+0000", 2024-09-12T22:50:18.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5138e-05 2024-09-12T22:50:18.085 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.085 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.085 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:18.086 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.241641+0000", 2024-09-12T22:50:18.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8016000000000007e-05 2024-09-12T22:50:18.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.086 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:18.086 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254041+0000", 2024-09-12T22:50:18.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012399666 2024-09-12T22:50:18.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.086 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:18.086 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.256880+0000", 2024-09-12T22:50:18.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0028390580000000002 2024-09-12T22:50:18.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:18.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.256918+0000", 2024-09-12T22:50:18.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7552999999999998e-05 2024-09-12T22:50:18.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:18.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.256965+0000", 2024-09-12T22:50:18.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7191000000000003e-05 2024-09-12T22:50:18.087 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.087 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:18.087 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.088 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1929 3.8 3:17051619:::200.0000000f:head [write 973340~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:18.088 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167521+0000", 2024-09-12T22:50:18.088 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.883879901, 2024-09-12T22:50:18.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.093206336000000001, 2024-09-12T22:50:18.088 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:18.088 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:18.088 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.088 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:18.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:18.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167521+0000", 2024-09-12T22:50:18.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:18.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167521+0000", 2024-09-12T22:50:18.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:18.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167522+0000", 2024-09-12T22:50:18.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8899999999999998e-07 2024-09-12T22:50:18.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:18.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167526+0000", 2024-09-12T22:50:18.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4490000000000001e-06 2024-09-12T22:50:18.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.090 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:18.090 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167544+0000", 2024-09-12T22:50:18.090 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7220000000000001e-05 2024-09-12T22:50:18.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.090 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.090 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167551+0000", 2024-09-12T22:50:18.090 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.046e-06 2024-09-12T22:50:18.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.090 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:18.091 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242079+0000", 2024-09-12T22:50:18.091 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074528436000000003 2024-09-12T22:50:18.091 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.091 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.091 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:18.091 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242167+0000", 2024-09-12T22:50:18.091 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7670000000000006e-05 2024-09-12T22:50:18.091 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.091 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.091 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:18.091 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.242306+0000", 2024-09-12T22:50:18.091 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000138703 2024-09-12T22:50:18.091 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.091 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:18.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254058+0000", 2024-09-12T22:50:18.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011752395000000001 2024-09-12T22:50:18.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:18.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260654+0000", 2024-09-12T22:50:18.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0065964700000000001 2024-09-12T22:50:18.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:18.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260699+0000", 2024-09-12T22:50:18.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5095000000000001e-05 2024-09-12T22:50:18.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:18.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260727+0000", 2024-09-12T22:50:18.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7963e-05 2024-09-12T22:50:18.093 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.093 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:18.093 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.093 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1931 3.8 3:17051619:::200.0000000f:head [write 974738~2728 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:18.093 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167657+0000", 2024-09-12T22:50:18.093 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.883743895999999, 2024-09-12T22:50:18.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.093133758999999997, 2024-09-12T22:50:18.094 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:18.094 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:18.094 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.094 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:18.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:18.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167657+0000", 2024-09-12T22:50:18.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:18.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167657+0000", 2024-09-12T22:50:18.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.095 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:18.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167658+0000", 2024-09-12T22:50:18.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2200000000000003e-07 2024-09-12T22:50:18.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.095 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:18.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167662+0000", 2024-09-12T22:50:18.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1489999999999996e-06 2024-09-12T22:50:18.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.095 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:18.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167673+0000", 2024-09-12T22:50:18.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0614e-05 2024-09-12T22:50:18.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167679+0000", 2024-09-12T22:50:18.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1500000000000004e-06 2024-09-12T22:50:18.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:18.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243054+0000", 2024-09-12T22:50:18.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075375027999999997 2024-09-12T22:50:18.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:18.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243134+0000", 2024-09-12T22:50:18.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0210000000000006e-05 2024-09-12T22:50:18.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:18.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.243263+0000", 2024-09-12T22:50:18.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012919 2024-09-12T22:50:18.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:18.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254075+0000", 2024-09-12T22:50:18.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010811523 2024-09-12T22:50:18.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:18.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260733+0000", 2024-09-12T22:50:18.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.006658153 2024-09-12T22:50:18.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:18.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260756+0000", 2024-09-12T22:50:18.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2696000000000001e-05 2024-09-12T22:50:18.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:18.099 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260791+0000", 2024-09-12T22:50:18.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5324000000000003e-05 2024-09-12T22:50:18.099 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.099 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:18.099 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.099 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1932 3.8 3:17051619:::200.0000000f:head [write 977466~2771 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:18.099 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:50:18.099 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.883454214, 2024-09-12T22:50:18.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.092944115999999993, 2024-09-12T22:50:18.099 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:18.099 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:18.099 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.100 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:18.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:18.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:50:18.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:18.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:50:18.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:18.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167947+0000", 2024-09-12T22:50:18.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8400000000000004e-07 2024-09-12T22:50:18.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:18.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167952+0000", 2024-09-12T22:50:18.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.138e-06 2024-09-12T22:50:18.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:18.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167961+0000", 2024-09-12T22:50:18.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7990000000000005e-06 2024-09-12T22:50:18.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.102 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167968+0000", 2024-09-12T22:50:18.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4400000000000002e-06 2024-09-12T22:50:18.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.102 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:18.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.244002+0000", 2024-09-12T22:50:18.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.076034300999999999 2024-09-12T22:50:18.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.102 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:18.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.244061+0000", 2024-09-12T22:50:18.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8356999999999997e-05 2024-09-12T22:50:18.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:18.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.244161+0000", 2024-09-12T22:50:18.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000100126 2024-09-12T22:50:18.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:18.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254099+0000", 2024-09-12T22:50:18.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0099384940000000008 2024-09-12T22:50:18.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:18.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260799+0000", 2024-09-12T22:50:18.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0066995029999999999 2024-09-12T22:50:18.104 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.104 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.104 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:18.104 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260851+0000", 2024-09-12T22:50:18.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1861999999999999e-05 2024-09-12T22:50:18.104 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.104 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.104 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:18.104 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260891+0000", 2024-09-12T22:50:18.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0411999999999999e-05 2024-09-12T22:50:18.104 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.104 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:18.105 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.105 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.105 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.105 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1933 3.8 3:17051619:::200.0000000f:head [write 980237~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:18.105 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.167993+0000", 2024-09-12T22:50:18.105 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.883407711, 2024-09-12T22:50:18.105 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.092952307999999997, 2024-09-12T22:50:18.105 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:18.105 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:18.105 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.105 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:18.105 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.105 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:18.105 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167993+0000", 2024-09-12T22:50:18.106 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.106 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.106 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:18.106 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167993+0000", 2024-09-12T22:50:18.106 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.106 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.106 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:18.106 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167994+0000", 2024-09-12T22:50:18.106 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5000000000000003e-07 2024-09-12T22:50:18.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.106 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.106 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:18.107 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.167997+0000", 2024-09-12T22:50:18.107 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5559999999999999e-06 2024-09-12T22:50:18.107 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.107 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.107 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:18.107 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168005+0000", 2024-09-12T22:50:18.107 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.588e-06 2024-09-12T22:50:18.107 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.107 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.107 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.107 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168011+0000", 2024-09-12T22:50:18.107 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7780000000000004e-06 2024-09-12T22:50:18.107 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.107 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.108 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:18.108 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.247983+0000", 2024-09-12T22:50:18.108 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079972090999999995 2024-09-12T22:50:18.108 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.108 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.108 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:18.108 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248038+0000", 2024-09-12T22:50:18.108 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4889999999999998e-05 2024-09-12T22:50:18.108 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.108 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.108 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:18.108 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248136+0000", 2024-09-12T22:50:18.108 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8271999999999997e-05 2024-09-12T22:50:18.109 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.109 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.109 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:18.109 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254134+0000", 2024-09-12T22:50:18.109 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005997751 2024-09-12T22:50:18.109 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.109 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.109 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:18.109 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260898+0000", 2024-09-12T22:50:18.109 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0067646429999999999 2024-09-12T22:50:18.109 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.109 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.109 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:18.109 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260923+0000", 2024-09-12T22:50:18.110 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4080999999999999e-05 2024-09-12T22:50:18.110 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.110 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.110 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:18.110 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260946+0000", 2024-09-12T22:50:18.110 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3108e-05 2024-09-12T22:50:18.110 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.110 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:18.110 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.110 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.110 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.110 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1934 3.8 3:17051619:::200.0000000f:head [write 982156~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:18.110 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:50:18.111 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.883382224999998, 2024-09-12T22:50:18.111 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.093517738000000003, 2024-09-12T22:50:18.111 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:18.111 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:18.111 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.111 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:18.111 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.111 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:18.111 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:50:18.111 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.111 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.111 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:18.111 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:50:18.112 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.112 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.112 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.112 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:18.112 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168019+0000", 2024-09-12T22:50:18.112 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6800000000000001e-07 2024-09-12T22:50:18.112 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.112 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.112 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:18.112 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168029+0000", 2024-09-12T22:50:18.112 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9699999999999994e-06 2024-09-12T22:50:18.112 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.112 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.112 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:18.113 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168036+0000", 2024-09-12T22:50:18.113 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9800000000000001e-06 2024-09-12T22:50:18.113 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.113 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.113 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.113 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168041+0000", 2024-09-12T22:50:18.113 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0629999999999996e-06 2024-09-12T22:50:18.113 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.113 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.113 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:18.113 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248449+0000", 2024-09-12T22:50:18.113 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.080407948000000007 2024-09-12T22:50:18.113 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.114 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.114 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:18.114 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248491+0000", 2024-09-12T22:50:18.114 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2027999999999998e-05 2024-09-12T22:50:18.114 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.114 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.114 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:18.114 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.248569+0000", 2024-09-12T22:50:18.114 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8077000000000005e-05 2024-09-12T22:50:18.114 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.114 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.114 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:18.114 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.260950+0000", 2024-09-12T22:50:18.114 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012380901 2024-09-12T22:50:18.115 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.115 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.115 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:18.115 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.261473+0000", 2024-09-12T22:50:18.115 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00052241699999999996 2024-09-12T22:50:18.115 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.115 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.115 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:18.115 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.261507+0000", 2024-09-12T22:50:18.115 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4616000000000002e-05 2024-09-12T22:50:18.115 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.115 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.115 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:18.115 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.261537+0000", 2024-09-12T22:50:18.116 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9369999999999998e-05 2024-09-12T22:50:18.116 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.116 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:18.116 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.116 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.116 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.116 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1935 3.8 3:17051619:::200.0000000f:head [write 984074~1914 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:18.116 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:50:18.116 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.883352302999999, 2024-09-12T22:50:18.116 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.097660714999999995, 2024-09-12T22:50:18.116 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:18.116 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:18.116 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.116 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:18.117 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.117 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:18.117 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:50:18.117 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.117 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.117 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.117 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:18.117 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:50:18.117 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.117 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.117 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.117 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:18.117 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168049+0000", 2024-09-12T22:50:18.118 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4400000000000001e-07 2024-09-12T22:50:18.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.118 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:18.118 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168052+0000", 2024-09-12T22:50:18.118 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.886e-06 2024-09-12T22:50:18.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.118 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:18.118 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168059+0000", 2024-09-12T22:50:18.118 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0489999999999998e-06 2024-09-12T22:50:18.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.118 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.118 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168081+0000", 2024-09-12T22:50:18.119 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1800000000000001e-05 2024-09-12T22:50:18.119 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.119 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.119 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:18.119 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.250512+0000", 2024-09-12T22:50:18.119 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.082431322000000001 2024-09-12T22:50:18.119 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.119 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.119 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:18.120 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.250621+0000", 2024-09-12T22:50:18.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010908600000000001 2024-09-12T22:50:18.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.120 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.120 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:18.120 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.250970+0000", 2024-09-12T22:50:18.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034828399999999997 2024-09-12T22:50:18.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.120 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.120 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:18.120 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265532+0000", 2024-09-12T22:50:18.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01456268 2024-09-12T22:50:18.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.121 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.121 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:18.121 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265614+0000", 2024-09-12T22:50:18.121 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1796000000000001e-05 2024-09-12T22:50:18.121 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.121 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.121 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:18.121 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265673+0000", 2024-09-12T22:50:18.121 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9314000000000002e-05 2024-09-12T22:50:18.121 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.121 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.121 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:18.121 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265709+0000", 2024-09-12T22:50:18.121 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6053999999999997e-05 2024-09-12T22:50:18.122 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.122 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:18.122 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.122 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1936 3.8 3:17051619:::200.0000000f:head [write 985988~2437 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:18.122 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.168095+0000", 2024-09-12T22:50:18.122 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.883305956000001, 2024-09-12T22:50:18.122 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.097789345999999999, 2024-09-12T22:50:18.122 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:18.122 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:18.122 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.122 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:18.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.123 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:18.123 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168095+0000", 2024-09-12T22:50:18.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.123 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:18.123 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168095+0000", 2024-09-12T22:50:18.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.123 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:18.123 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168096+0000", 2024-09-12T22:50:18.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7700000000000005e-07 2024-09-12T22:50:18.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:18.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168099+0000", 2024-09-12T22:50:18.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.422e-06 2024-09-12T22:50:18.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:18.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168106+0000", 2024-09-12T22:50:18.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6889999999999998e-06 2024-09-12T22:50:18.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.168110+0000", 2024-09-12T22:50:18.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8470000000000003e-06 2024-09-12T22:50:18.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.125 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:18.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251622+0000", 2024-09-12T22:50:18.125 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.083511539999999995 2024-09-12T22:50:18.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.125 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:18.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251674+0000", 2024-09-12T22:50:18.125 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1678999999999998e-05 2024-09-12T22:50:18.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.125 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:18.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.251744+0000", 2024-09-12T22:50:18.126 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0440999999999999e-05 2024-09-12T22:50:18.126 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.126 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.126 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:18.126 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265545+0000", 2024-09-12T22:50:18.126 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013801000000000001 2024-09-12T22:50:18.126 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.126 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.126 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:18.126 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265771+0000", 2024-09-12T22:50:18.126 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000225632 2024-09-12T22:50:18.126 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.126 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.126 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:18.127 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265835+0000", 2024-09-12T22:50:18.127 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4541000000000004e-05 2024-09-12T22:50:18.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.127 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.127 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:18.127 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265884+0000", 2024-09-12T22:50:18.127 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9078e-05 2024-09-12T22:50:18.127 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.127 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:18.127 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.127 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.128 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1937 3.8 3:17051619:::200.0000000f:head [write 988425~1920 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:18.128 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.171188+0000", 2024-09-12T22:50:18.128 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.880212584999999, 2024-09-12T22:50:18.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.094794626000000007, 2024-09-12T22:50:18.128 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:18.128 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:18.128 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.128 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:18.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:18.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171188+0000", 2024-09-12T22:50:18.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.129 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:18.129 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171188+0000", 2024-09-12T22:50:18.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.129 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:18.129 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171189+0000", 2024-09-12T22:50:18.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3200000000000003e-07 2024-09-12T22:50:18.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.129 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:18.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171194+0000", 2024-09-12T22:50:18.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2690000000000001e-06 2024-09-12T22:50:18.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:18.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171201+0000", 2024-09-12T22:50:18.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5310000000000004e-06 2024-09-12T22:50:18.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.131 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171206+0000", 2024-09-12T22:50:18.131 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7049999999999998e-06 2024-09-12T22:50:18.131 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.131 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.131 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:18.131 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254169+0000", 2024-09-12T22:50:18.131 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.082962835999999998 2024-09-12T22:50:18.131 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.131 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.131 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:18.131 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254263+0000", 2024-09-12T22:50:18.131 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3844999999999993e-05 2024-09-12T22:50:18.131 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.132 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:18.132 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254398+0000", 2024-09-12T22:50:18.132 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013560499999999999 2024-09-12T22:50:18.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.132 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:18.132 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265897+0000", 2024-09-12T22:50:18.132 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01149846 2024-09-12T22:50:18.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.132 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:18.132 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265922+0000", 2024-09-12T22:50:18.132 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5130000000000002e-05 2024-09-12T22:50:18.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:18.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265954+0000", 2024-09-12T22:50:18.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2512999999999999e-05 2024-09-12T22:50:18.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:18.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265983+0000", 2024-09-12T22:50:18.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8799999999999999e-05 2024-09-12T22:50:18.133 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.133 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:18.133 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.134 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1938 3.8 3:17051619:::200.0000000f:head [write 990345~2499 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:18.134 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:50:18.134 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.880172406, 2024-09-12T22:50:18.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.094864730999999994, 2024-09-12T22:50:18.134 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:18.134 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:18.134 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.134 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:18.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.134 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:18.134 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:50:18.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:18.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:50:18.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:18.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171229+0000", 2024-09-12T22:50:18.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:50:18.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:18.136 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171242+0000", 2024-09-12T22:50:18.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3111e-05 2024-09-12T22:50:18.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.136 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:18.136 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171247+0000", 2024-09-12T22:50:18.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0939999999999998e-06 2024-09-12T22:50:18.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.136 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.136 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.171251+0000", 2024-09-12T22:50:18.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.298e-06 2024-09-12T22:50:18.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:18.137 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254869+0000", 2024-09-12T22:50:18.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.083618681 2024-09-12T22:50:18.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:18.137 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.254957+0000", 2024-09-12T22:50:18.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7783999999999998e-05 2024-09-12T22:50:18.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:18.137 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.255093+0000", 2024-09-12T22:50:18.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013579600000000001 2024-09-12T22:50:18.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:18.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.265997+0000", 2024-09-12T22:50:18.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010903777999999999 2024-09-12T22:50:18.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:18.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266047+0000", 2024-09-12T22:50:18.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0151999999999997e-05 2024-09-12T22:50:18.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:18.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266075+0000", 2024-09-12T22:50:18.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8082e-05 2024-09-12T22:50:18.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:18.139 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266093+0000", 2024-09-12T22:50:18.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8396000000000001e-05 2024-09-12T22:50:18.139 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.139 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:18.139 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.139 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1944 3.8 3:17051619:::200.0000000f:head [write 1037561~3947 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:18.139 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.186089+0000", 2024-09-12T22:50:18.140 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.865312156000002, 2024-09-12T22:50:18.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087755745999999996, 2024-09-12T22:50:18.140 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:18.140 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:18.140 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.140 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:18.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.140 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:18.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186089+0000", 2024-09-12T22:50:18.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.140 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:18.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186089+0000", 2024-09-12T22:50:18.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:18.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186090+0000", 2024-09-12T22:50:18.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1349999999999999e-06 2024-09-12T22:50:18.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:18.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186098+0000", 2024-09-12T22:50:18.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8390000000000007e-06 2024-09-12T22:50:18.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:18.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186106+0000", 2024-09-12T22:50:18.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4619999999999996e-06 2024-09-12T22:50:18.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186111+0000", 2024-09-12T22:50:18.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.057e-06 2024-09-12T22:50:18.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:18.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.264543+0000", 2024-09-12T22:50:18.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078432044000000006 2024-09-12T22:50:18.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:18.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.264617+0000", 2024-09-12T22:50:18.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3789999999999997e-05 2024-09-12T22:50:18.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:18.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.264760+0000", 2024-09-12T22:50:18.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014318499999999999 2024-09-12T22:50:18.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:18.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268441+0000", 2024-09-12T22:50:18.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036809360000000001 2024-09-12T22:50:18.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:18.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273776+0000", 2024-09-12T22:50:18.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053346449999999998 2024-09-12T22:50:18.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:18.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273807+0000", 2024-09-12T22:50:18.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1352000000000001e-05 2024-09-12T22:50:18.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:18.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273845+0000", 2024-09-12T22:50:18.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7301000000000001e-05 2024-09-12T22:50:18.145 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.145 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:18.145 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.145 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1945 3.8 3:17051619:::200.0000000f:head [write 1041508~10144 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:18.145 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:50:18.145 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.865035383999999, 2024-09-12T22:50:18.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087573128, 2024-09-12T22:50:18.146 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:18.146 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:18.146 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.146 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:18.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:18.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:50:18.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:18.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:50:18.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:18.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186366+0000", 2024-09-12T22:50:18.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1600000000000001e-07 2024-09-12T22:50:18.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:18.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186377+0000", 2024-09-12T22:50:18.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0301e-05 2024-09-12T22:50:18.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:18.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186386+0000", 2024-09-12T22:50:18.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5619999999999993e-06 2024-09-12T22:50:18.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186393+0000", 2024-09-12T22:50:18.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7150000000000001e-06 2024-09-12T22:50:18.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:18.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266725+0000", 2024-09-12T22:50:18.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.080331893000000001 2024-09-12T22:50:18.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:18.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266799+0000", 2024-09-12T22:50:18.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4086999999999997e-05 2024-09-12T22:50:18.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:18.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.266904+0000", 2024-09-12T22:50:18.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105475 2024-09-12T22:50:18.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:18.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273882+0000", 2024-09-12T22:50:18.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069773780000000002 2024-09-12T22:50:18.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:18.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273889+0000", 2024-09-12T22:50:18.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1049999999999997e-06 2024-09-12T22:50:18.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:18.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273916+0000", 2024-09-12T22:50:18.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6716e-05 2024-09-12T22:50:18.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:18.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273939+0000", 2024-09-12T22:50:18.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3180000000000002e-05 2024-09-12T22:50:18.151 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.151 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:18.151 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.151 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1946 3.8 3:17051619:::200.0000000f:head [write 1051652~3875 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:18.151 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.186888+0000", 2024-09-12T22:50:18.151 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.864513105, 2024-09-12T22:50:18.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087165134000000005, 2024-09-12T22:50:18.152 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:18.152 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:18.152 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.152 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:18.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.152 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:18.152 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186888+0000", 2024-09-12T22:50:18.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.152 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:18.153 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186888+0000", 2024-09-12T22:50:18.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.153 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:18.153 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186889+0000", 2024-09-12T22:50:18.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2500000000000005e-07 2024-09-12T22:50:18.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.153 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:18.153 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186894+0000", 2024-09-12T22:50:18.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3900000000000001e-06 2024-09-12T22:50:18.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:18.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186901+0000", 2024-09-12T22:50:18.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5649999999999998e-06 2024-09-12T22:50:18.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.186906+0000", 2024-09-12T22:50:18.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0390000000000004e-06 2024-09-12T22:50:18.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:18.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.267852+0000", 2024-09-12T22:50:18.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.080946389999999993 2024-09-12T22:50:18.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:18.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.267910+0000", 2024-09-12T22:50:18.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7655999999999998e-05 2024-09-12T22:50:18.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:18.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.267981+0000", 2024-09-12T22:50:18.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0916999999999999e-05 2024-09-12T22:50:18.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:18.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273944+0000", 2024-09-12T22:50:18.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0059635570000000004 2024-09-12T22:50:18.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:18.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273993+0000", 2024-09-12T22:50:18.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8350000000000003e-05 2024-09-12T22:50:18.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:18.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274022+0000", 2024-09-12T22:50:18.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9899999999999998e-05 2024-09-12T22:50:18.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:18.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274053+0000", 2024-09-12T22:50:18.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0645000000000002e-05 2024-09-12T22:50:18.157 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.157 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:18.157 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.157 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1947 3.8 3:17051619:::200.0000000f:head [write 1055527~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:18.157 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.187014+0000", 2024-09-12T22:50:18.157 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.864386871000001, 2024-09-12T22:50:18.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.087114608999999996, 2024-09-12T22:50:18.157 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:18.158 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:18.158 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.158 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:18.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:18.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187014+0000", 2024-09-12T22:50:18.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:18.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187014+0000", 2024-09-12T22:50:18.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:18.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187015+0000", 2024-09-12T22:50:18.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1500000000000004e-07 2024-09-12T22:50:18.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:18.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187018+0000", 2024-09-12T22:50:18.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.033e-06 2024-09-12T22:50:18.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:18.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187023+0000", 2024-09-12T22:50:18.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7550000000000002e-06 2024-09-12T22:50:18.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.160 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.160 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.187026+0000", 2024-09-12T22:50:18.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2710000000000001e-06 2024-09-12T22:50:18.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.160 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:18.160 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268462+0000", 2024-09-12T22:50:18.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.081435699 2024-09-12T22:50:18.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.160 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:18.160 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268507+0000", 2024-09-12T22:50:18.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5643999999999999e-05 2024-09-12T22:50:18.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:18.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268597+0000", 2024-09-12T22:50:18.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0112999999999996e-05 2024-09-12T22:50:18.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:18.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273947+0000", 2024-09-12T22:50:18.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053501859999999998 2024-09-12T22:50:18.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:18.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274083+0000", 2024-09-12T22:50:18.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013525500000000001 2024-09-12T22:50:18.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:18.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274109+0000", 2024-09-12T22:50:18.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6352000000000001e-05 2024-09-12T22:50:18.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:18.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274129+0000", 2024-09-12T22:50:18.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9686000000000001e-05 2024-09-12T22:50:18.162 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.162 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:18.162 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.163 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1948 3.8 3:17051619:::200.0000000f:head [write 1057443~1896 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:18.163 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-09-12T22:49:57.189230+0000", 2024-09-12T22:50:18.163 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.862171059000001, 2024-09-12T22:50:18.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.085028962999999999, 2024-09-12T22:50:18.163 INFO:teuthology.orchestra.run.smithi087.stdout: "continuous": false, 2024-09-12T22:50:18.163 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-09-12T22:50:18.163 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.163 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-09-12T22:50:18.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.163 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-09-12T22:50:18.163 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189230+0000", 2024-09-12T22:50:18.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-09-12T22:50:18.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189230+0000", 2024-09-12T22:50:18.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-09-12T22:50:18.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-09-12T22:50:18.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189231+0000", 2024-09-12T22:50:18.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1399999999999996e-07 2024-09-12T22:50:18.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-09-12T22:50:18.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189235+0000", 2024-09-12T22:50:18.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5970000000000002e-06 2024-09-12T22:50:18.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-09-12T22:50:18.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189242+0000", 2024-09-12T22:50:18.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8510000000000001e-06 2024-09-12T22:50:18.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.189247+0000", 2024-09-12T22:50:18.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4800000000000003e-06 2024-09-12T22:50:18.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-09-12T22:50:18.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268908+0000", 2024-09-12T22:50:18.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079660983000000005 2024-09-12T22:50:18.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-09-12T22:50:18.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.268967+0000", 2024-09-12T22:50:18.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9595000000000001e-05 2024-09-12T22:50:18.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 1", 2024-09-12T22:50:18.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.269040+0000", 2024-09-12T22:50:18.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2643000000000002e-05 2024-09-12T22:50:18.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.167 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-09-12T22:50:18.167 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.273950+0000", 2024-09-12T22:50:18.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049105329999999999 2024-09-12T22:50:18.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.167 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:18.167 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274199+0000", 2024-09-12T22:50:18.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024824999999999999 2024-09-12T22:50:18.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.167 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-09-12T22:50:18.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274226+0000", 2024-09-12T22:50:18.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7602000000000001e-05 2024-09-12T22:50:18.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-12T22:50:18.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-12T22:50:18.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-09-12T22:50:18.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-09-12T22:49:57.274259+0000", 2024-09-12T22:50:18.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2614999999999999e-05 2024-09-12T22:50:18.168 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.168 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:18.168 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.168 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-12T22:50:18.168 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-12T22:50:18.168 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-12T22:50:18.170 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:50:18.274 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:50:18.274 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:50:18.274 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-12T22:50:18.274 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:50:18.283 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:50:18.384 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:50:18.385 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-12T22:50:18.385 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-12T22:50:18.385 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-12T22:50:18.385 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:50:18.393 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:50:18.498 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-12T22:50:18.498 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-12T22:50:18.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-12T22:50:18.498 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-12T22:50:18.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.498 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12403 4.0 4:0146e0d0:::100000031d4.00000000:head [write 0~4194304 [2@3733965]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:18.498 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:55.747692+0000", 2024-09-12T22:50:18.498 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.748045917999999, 2024-09-12T22:50:18.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.22362137500000001, 2024-09-12T22:50:18.498 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:18.499 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:18.499 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.499 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:18.499 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:18.499 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:18.499 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12403 2024-09-12T22:50:18.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.499 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:18.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:18.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.747692+0000", 2024-09-12T22:50:18.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:18.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.747692+0000", 2024-09-12T22:50:18.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:18.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.747693+0000", 2024-09-12T22:50:18.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3799999999999996e-07 2024-09-12T22:50:18.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:18.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959640+0000", 2024-09-12T22:50:18.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.21194702000000001 2024-09-12T22:50:18.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:18.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959660+0000", 2024-09-12T22:50:18.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9939e-05 2024-09-12T22:50:18.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959668+0000", 2024-09-12T22:50:18.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1669999999999999e-06 2024-09-12T22:50:18.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:18.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959764+0000", 2024-09-12T22:50:18.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5315000000000005e-05 2024-09-12T22:50:18.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:18.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.959865+0000", 2024-09-12T22:50:18.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101618 2024-09-12T22:50:18.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:18.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.971224+0000", 2024-09-12T22:50:18.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011358541999999999 2024-09-12T22:50:18.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:18.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.971261+0000", 2024-09-12T22:50:18.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7092999999999999e-05 2024-09-12T22:50:18.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:18.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:55.971314+0000", 2024-09-12T22:50:18.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2843000000000002e-05 2024-09-12T22:50:18.503 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.503 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:18.503 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.503 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:12503 4.15 e56/17 4:ab29d13f:::100000033b1.00000000:head v 56'161, mlcod=55'159)", 2024-09-12T22:50:18.504 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:50:18.504 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.465132441000002, 2024-09-12T22:50:18.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.043668640000000002, 2024-09-12T22:50:18.504 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:18.504 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:18.504 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.504 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:18.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:18.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:50:18.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:18.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:50:18.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:18.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.030606+0000", 2024-09-12T22:50:18.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:50:18.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:18.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039768+0000", 2024-09-12T22:50:18.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0091617190000000005 2024-09-12T22:50:18.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:18.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039781+0000", 2024-09-12T22:50:18.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2829e-05 2024-09-12T22:50:18.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039789+0000", 2024-09-12T22:50:18.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9340000000000006e-06 2024-09-12T22:50:18.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:18.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039846+0000", 2024-09-12T22:50:18.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6762999999999998e-05 2024-09-12T22:50:18.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:18.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.039897+0000", 2024-09-12T22:50:18.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1517000000000002e-05 2024-09-12T22:50:18.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:18.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074225+0000", 2024-09-12T22:50:18.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034328138000000001 2024-09-12T22:50:18.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:18.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074274+0000", 2024-09-12T22:50:18.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9255999999999997e-05 2024-09-12T22:50:18.508 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.508 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:18.508 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.508 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12508 4.2d 4:b7b19b64:::10000003230.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:18.508 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.037293+0000", 2024-09-12T22:50:18.508 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.458445265999998, 2024-09-12T22:50:18.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.037399772999999997, 2024-09-12T22:50:18.509 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:18.509 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:18.509 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.509 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:18.509 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:18.509 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:18.509 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12508 2024-09-12T22:50:18.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.509 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:18.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:18.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037293+0000", 2024-09-12T22:50:18.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:18.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037293+0000", 2024-09-12T22:50:18.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:18.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.037294+0000", 2024-09-12T22:50:18.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4899999999999995e-07 2024-09-12T22:50:18.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:18.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042701+0000", 2024-09-12T22:50:18.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054069419999999997 2024-09-12T22:50:18.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:18.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042712+0000", 2024-09-12T22:50:18.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.171e-05 2024-09-12T22:50:18.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042719+0000", 2024-09-12T22:50:18.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1189999999999999e-06 2024-09-12T22:50:18.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:18.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042759+0000", 2024-09-12T22:50:18.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9478999999999999e-05 2024-09-12T22:50:18.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:18.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042827+0000", 2024-09-12T22:50:18.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8435999999999993e-05 2024-09-12T22:50:18.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:18.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.042965+0000", 2024-09-12T22:50:18.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000137723 2024-09-12T22:50:18.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:18.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.058351+0000", 2024-09-12T22:50:18.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015385902 2024-09-12T22:50:18.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:18.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074620+0000", 2024-09-12T22:50:18.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016269018 2024-09-12T22:50:18.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:18.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074657+0000", 2024-09-12T22:50:18.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6619999999999998e-05 2024-09-12T22:50:18.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:18.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.074693+0000", 2024-09-12T22:50:18.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6174999999999998e-05 2024-09-12T22:50:18.514 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.514 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:18.514 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.514 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12516 4.21 4:858ae08d:::100000030eb.00000000:head [write 0~4194304 [3@1582458]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:18.514 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.045143+0000", 2024-09-12T22:50:18.514 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.450594978000002, 2024-09-12T22:50:18.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.039721657, 2024-09-12T22:50:18.515 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:18.515 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:18.515 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.515 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:18.515 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:18.515 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:18.515 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12516 2024-09-12T22:50:18.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.515 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:18.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:18.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.045143+0000", 2024-09-12T22:50:18.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:18.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.045143+0000", 2024-09-12T22:50:18.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:18.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.045144+0000", 2024-09-12T22:50:18.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2900000000000002e-07 2024-09-12T22:50:18.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:18.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049506+0000", 2024-09-12T22:50:18.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043620280000000004 2024-09-12T22:50:18.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:18.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049517+0000", 2024-09-12T22:50:18.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0726e-05 2024-09-12T22:50:18.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049522+0000", 2024-09-12T22:50:18.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3730000000000001e-06 2024-09-12T22:50:18.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:18.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049583+0000", 2024-09-12T22:50:18.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1254999999999995e-05 2024-09-12T22:50:18.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:18.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049645+0000", 2024-09-12T22:50:18.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1988000000000003e-05 2024-09-12T22:50:18.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:18.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049731+0000", 2024-09-12T22:50:18.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6040999999999998e-05 2024-09-12T22:50:18.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:18.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.064126+0000", 2024-09-12T22:50:18.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01439497 2024-09-12T22:50:18.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:18.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.084785+0000", 2024-09-12T22:50:18.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020658972000000001 2024-09-12T22:50:18.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:18.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.084829+0000", 2024-09-12T22:50:18.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3869000000000003e-05 2024-09-12T22:50:18.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:18.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.084865+0000", 2024-09-12T22:50:18.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5605999999999998e-05 2024-09-12T22:50:18.520 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.520 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:18.520 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.521 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:1354 3.18 3:1e8917d7:::200.0000000e:head [write 498872~14494 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:50:18.521 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.048337+0000", 2024-09-12T22:50:18.521 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.447401059000001, 2024-09-12T22:50:18.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034292491000000001, 2024-09-12T22:50:18.521 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:18.521 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:18.521 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.521 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:18.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:18.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048337+0000", 2024-09-12T22:50:18.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:18.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048337+0000", 2024-09-12T22:50:18.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:18.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048339+0000", 2024-09-12T22:50:18.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.409e-06 2024-09-12T22:50:18.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:18.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048360+0000", 2024-09-12T22:50:18.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1659999999999999e-05 2024-09-12T22:50:18.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:18.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048370+0000", 2024-09-12T22:50:18.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.611e-06 2024-09-12T22:50:18.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048376+0000", 2024-09-12T22:50:18.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5479999999999998e-06 2024-09-12T22:50:18.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:18.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048440+0000", 2024-09-12T22:50:18.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3367000000000005e-05 2024-09-12T22:50:18.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:18.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048557+0000", 2024-09-12T22:50:18.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116983 2024-09-12T22:50:18.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:18.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.048719+0000", 2024-09-12T22:50:18.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016250499999999999 2024-09-12T22:50:18.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:18.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.058763+0000", 2024-09-12T22:50:18.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010043948 2024-09-12T22:50:18.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:18.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082499+0000", 2024-09-12T22:50:18.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023735320000000001 2024-09-12T22:50:18.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:18.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082561+0000", 2024-09-12T22:50:18.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2490000000000006e-05 2024-09-12T22:50:18.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:18.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.082630+0000", 2024-09-12T22:50:18.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8650000000000002e-05 2024-09-12T22:50:18.526 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.526 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:18.526 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.526 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12517 4.1a 4:5a8c04dd:::10000003276.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:18.526 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.049539+0000", 2024-09-12T22:50:18.526 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.446199297, 2024-09-12T22:50:18.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.036068957999999998, 2024-09-12T22:50:18.526 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:18.526 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:18.527 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.527 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:18.527 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:18.527 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:18.527 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12517 2024-09-12T22:50:18.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.527 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:18.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:18.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049539+0000", 2024-09-12T22:50:18.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:18.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049539+0000", 2024-09-12T22:50:18.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:18.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.049540+0000", 2024-09-12T22:50:18.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1299999999999999e-07 2024-09-12T22:50:18.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:18.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054581+0000", 2024-09-12T22:50:18.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005041167 2024-09-12T22:50:18.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:18.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054593+0000", 2024-09-12T22:50:18.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1943000000000001e-05 2024-09-12T22:50:18.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054598+0000", 2024-09-12T22:50:18.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6500000000000001e-06 2024-09-12T22:50:18.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:18.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054658+0000", 2024-09-12T22:50:18.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9898999999999997e-05 2024-09-12T22:50:18.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:18.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.054800+0000", 2024-09-12T22:50:18.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014187100000000001 2024-09-12T22:50:18.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:18.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.085456+0000", 2024-09-12T22:50:18.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.030655452 2024-09-12T22:50:18.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:18.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.085533+0000", 2024-09-12T22:50:18.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7478999999999995e-05 2024-09-12T22:50:18.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:18.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.085608+0000", 2024-09-12T22:50:18.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4684000000000005e-05 2024-09-12T22:50:18.531 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.531 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:18.531 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.532 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12677 4.10 4:0b7ac23f:::10000003457.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:18.532 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:50:18.532 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.266324501, 2024-09-12T22:50:18.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033661045000000001, 2024-09-12T22:50:18.532 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:18.532 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:18.532 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.532 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:18.532 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:18.532 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:18.532 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12677 2024-09-12T22:50:18.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.532 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:18.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:18.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:50:18.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:18.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:50:18.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:18.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.229414+0000", 2024-09-12T22:50:18.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0100000000000005e-07 2024-09-12T22:50:18.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:18.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.237295+0000", 2024-09-12T22:50:18.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078803290000000002 2024-09-12T22:50:18.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:18.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.237307+0000", 2024-09-12T22:50:18.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2339e-05 2024-09-12T22:50:18.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.237312+0000", 2024-09-12T22:50:18.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9089999999999999e-06 2024-09-12T22:50:18.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:18.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.239034+0000", 2024-09-12T22:50:18.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001722424 2024-09-12T22:50:18.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:18.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.239129+0000", 2024-09-12T22:50:18.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4486000000000003e-05 2024-09-12T22:50:18.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:18.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.239206+0000", 2024-09-12T22:50:18.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7146999999999998e-05 2024-09-12T22:50:18.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:18.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.255921+0000", 2024-09-12T22:50:18.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016714685 2024-09-12T22:50:18.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:18.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.263025+0000", 2024-09-12T22:50:18.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071042470000000002 2024-09-12T22:50:18.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:18.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.263052+0000", 2024-09-12T22:50:18.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7195e-05 2024-09-12T22:50:18.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:18.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.263075+0000", 2024-09-12T22:50:18.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2782999999999999e-05 2024-09-12T22:50:18.537 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.537 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:18.537 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.537 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:12979 4.1e 4:78503759:::10000003406.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:18.538 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:50:18.538 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.930637704999999, 2024-09-12T22:50:18.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032861456999999997, 2024-09-12T22:50:18.538 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:18.538 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:18.538 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.538 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:18.538 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:18.538 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:18.538 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 12979 2024-09-12T22:50:18.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.538 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:18.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:18.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:50:18.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:18.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:50:18.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:18.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.565101+0000", 2024-09-12T22:50:18.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9999999999999998e-07 2024-09-12T22:50:18.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:18.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573365+0000", 2024-09-12T22:50:18.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0082644229999999999 2024-09-12T22:50:18.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:18.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573379+0000", 2024-09-12T22:50:18.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3322999999999999e-05 2024-09-12T22:50:18.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573386+0000", 2024-09-12T22:50:18.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.199e-06 2024-09-12T22:50:18.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:18.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573464+0000", 2024-09-12T22:50:18.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7931999999999999e-05 2024-09-12T22:50:18.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:18.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.573713+0000", 2024-09-12T22:50:18.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024922200000000001 2024-09-12T22:50:18.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:18.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.597870+0000", 2024-09-12T22:50:18.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024157221999999999 2024-09-12T22:50:18.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:18.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.597926+0000", 2024-09-12T22:50:18.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5838000000000003e-05 2024-09-12T22:50:18.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:18.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.597962+0000", 2024-09-12T22:50:18.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5898000000000001e-05 2024-09-12T22:50:18.542 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.542 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:18.543 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.543 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:13017 4.3b e56/17 4:deb39c3c:::1000000315d.00000000:head v 56'194, mlcod=56'192)", 2024-09-12T22:50:18.543 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.600876+0000", 2024-09-12T22:50:18.543 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.894862229000001, 2024-09-12T22:50:18.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.038152448999999998, 2024-09-12T22:50:18.543 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:18.543 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:18.543 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.543 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:18.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:18.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.600876+0000", 2024-09-12T22:50:18.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:18.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.600876+0000", 2024-09-12T22:50:18.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:18.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.600877+0000", 2024-09-12T22:50:18.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:50:18.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:18.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609737+0000", 2024-09-12T22:50:18.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088599089999999991 2024-09-12T22:50:18.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:18.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609748+0000", 2024-09-12T22:50:18.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1355999999999999e-05 2024-09-12T22:50:18.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609757+0000", 2024-09-12T22:50:18.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9190000000000005e-06 2024-09-12T22:50:18.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:18.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609801+0000", 2024-09-12T22:50:18.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4019e-05 2024-09-12T22:50:18.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:18.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.609816+0000", 2024-09-12T22:50:18.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5226e-05 2024-09-12T22:50:18.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:18.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.638985+0000", 2024-09-12T22:50:18.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029168537000000001 2024-09-12T22:50:18.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:18.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.639028+0000", 2024-09-12T22:50:18.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3847000000000002e-05 2024-09-12T22:50:18.547 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.547 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:18.547 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.547 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13032 4.7 4:e102bf81:::1000000359e.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:18.547 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:56.616553+0000", 2024-09-12T22:50:18.547 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.879185376999999, 2024-09-12T22:50:18.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.032471027999999999, 2024-09-12T22:50:18.548 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:18.548 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:18.548 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.548 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:18.548 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:18.548 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:18.548 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13032 2024-09-12T22:50:18.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.548 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:18.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:18.548 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.616553+0000", 2024-09-12T22:50:18.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:18.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.616553+0000", 2024-09-12T22:50:18.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:18.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.616554+0000", 2024-09-12T22:50:18.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0100000000000004e-07 2024-09-12T22:50:18.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:18.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621405+0000", 2024-09-12T22:50:18.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0048517480000000003 2024-09-12T22:50:18.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:18.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621416+0000", 2024-09-12T22:50:18.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0264e-05 2024-09-12T22:50:18.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621446+0000", 2024-09-12T22:50:18.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0849000000000002e-05 2024-09-12T22:50:18.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:18.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621494+0000", 2024-09-12T22:50:18.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7018000000000003e-05 2024-09-12T22:50:18.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:18.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621590+0000", 2024-09-12T22:50:18.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6632999999999995e-05 2024-09-12T22:50:18.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:18.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.621680+0000", 2024-09-12T22:50:18.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9704999999999996e-05 2024-09-12T22:50:18.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.552 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:18.552 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.639248+0000", 2024-09-12T22:50:18.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017568548 2024-09-12T22:50:18.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.552 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:18.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.648944+0000", 2024-09-12T22:50:18.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0096954659999999998 2024-09-12T22:50:18.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:18.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.648992+0000", 2024-09-12T22:50:18.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8059999999999997e-05 2024-09-12T22:50:18.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:18.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:56.649024+0000", 2024-09-12T22:50:18.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1936000000000001e-05 2024-09-12T22:50:18.553 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.553 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:18.554 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.554 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13428 4.37 4:eeed8456:::1000000321a.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:18.554 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.064666+0000", 2024-09-12T22:50:18.554 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.431072099000001, 2024-09-12T22:50:18.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033441308000000003, 2024-09-12T22:50:18.554 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:18.554 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:18.554 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.554 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:18.554 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:18.555 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:18.555 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13428 2024-09-12T22:50:18.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.555 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:18.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:18.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.064666+0000", 2024-09-12T22:50:18.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:18.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.064666+0000", 2024-09-12T22:50:18.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:18.556 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.064668+0000", 2024-09-12T22:50:18.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4160000000000001e-06 2024-09-12T22:50:18.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:18.556 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071829+0000", 2024-09-12T22:50:18.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071611390000000004 2024-09-12T22:50:18.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:18.557 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071840+0000", 2024-09-12T22:50:18.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1369000000000001e-05 2024-09-12T22:50:18.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.557 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.557 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071847+0000", 2024-09-12T22:50:18.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0960000000000003e-06 2024-09-12T22:50:18.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.557 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:18.557 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.071904+0000", 2024-09-12T22:50:18.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7309000000000003e-05 2024-09-12T22:50:18.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.558 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:18.558 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.072051+0000", 2024-09-12T22:50:18.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014625 2024-09-12T22:50:18.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.558 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:18.558 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.072194+0000", 2024-09-12T22:50:18.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014379799999999999 2024-09-12T22:50:18.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.558 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:18.558 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.079527+0000", 2024-09-12T22:50:18.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007332674 2024-09-12T22:50:18.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:18.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.098048+0000", 2024-09-12T22:50:18.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018521174000000001 2024-09-12T22:50:18.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:18.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.098081+0000", 2024-09-12T22:50:18.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2910999999999997e-05 2024-09-12T22:50:18.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:18.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.098107+0000", 2024-09-12T22:50:18.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6171999999999999e-05 2024-09-12T22:50:18.560 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.560 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:18.560 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.560 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13472 4.12 4:4b0bd9b8:::100000033b0.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:18.560 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.113168+0000", 2024-09-12T22:50:18.560 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.382570399999999, 2024-09-12T22:50:18.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.039534103000000001, 2024-09-12T22:50:18.560 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:18.560 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:18.560 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.561 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:18.561 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:18.561 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:18.561 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13472 2024-09-12T22:50:18.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.561 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:18.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:18.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.113168+0000", 2024-09-12T22:50:18.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:18.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.113168+0000", 2024-09-12T22:50:18.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:18.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.113169+0000", 2024-09-12T22:50:18.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1960000000000001e-06 2024-09-12T22:50:18.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:18.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119849+0000", 2024-09-12T22:50:18.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0066801830000000001 2024-09-12T22:50:18.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:18.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119861+0000", 2024-09-12T22:50:18.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.199e-05 2024-09-12T22:50:18.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119866+0000", 2024-09-12T22:50:18.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8720000000000001e-06 2024-09-12T22:50:18.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:18.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.119945+0000", 2024-09-12T22:50:18.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9268000000000001e-05 2024-09-12T22:50:18.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:18.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.120098+0000", 2024-09-12T22:50:18.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015299500000000001 2024-09-12T22:50:18.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:18.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.120218+0000", 2024-09-12T22:50:18.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011989099999999999 2024-09-12T22:50:18.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:18.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.140463+0000", 2024-09-12T22:50:18.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020244765000000001 2024-09-12T22:50:18.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:18.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.152629+0000", 2024-09-12T22:50:18.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012165601999999999 2024-09-12T22:50:18.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:18.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.152664+0000", 2024-09-12T22:50:18.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5599999999999998e-05 2024-09-12T22:50:18.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:18.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.152702+0000", 2024-09-12T22:50:18.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7741000000000003e-05 2024-09-12T22:50:18.566 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.566 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:18.566 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.566 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13484 4.2f 4:f62c2e43:::1000000349e.00000000:head [write 0~4194304 [2@3461078]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:18.566 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.125796+0000", 2024-09-12T22:50:18.566 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.369942037000001, 2024-09-12T22:50:18.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.036857236000000002, 2024-09-12T22:50:18.566 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:18.566 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:18.567 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.567 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:18.567 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:18.567 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:18.567 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13484 2024-09-12T22:50:18.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.567 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:18.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:18.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.125796+0000", 2024-09-12T22:50:18.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:18.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.125796+0000", 2024-09-12T22:50:18.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:18.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.125797+0000", 2024-09-12T22:50:18.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.108e-06 2024-09-12T22:50:18.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:18.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130725+0000", 2024-09-12T22:50:18.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049272949999999999 2024-09-12T22:50:18.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:18.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130739+0000", 2024-09-12T22:50:18.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4234e-05 2024-09-12T22:50:18.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130751+0000", 2024-09-12T22:50:18.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1848000000000001e-05 2024-09-12T22:50:18.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:18.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130816+0000", 2024-09-12T22:50:18.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5359999999999998e-05 2024-09-12T22:50:18.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.570 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:18.570 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.130917+0000", 2024-09-12T22:50:18.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101178 2024-09-12T22:50:18.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.570 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:18.570 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.131058+0000", 2024-09-12T22:50:18.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140803 2024-09-12T22:50:18.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:18.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.153387+0000", 2024-09-12T22:50:18.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022328585000000001 2024-09-12T22:50:18.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:18.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.162465+0000", 2024-09-12T22:50:18.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090781360000000005 2024-09-12T22:50:18.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:18.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.162584+0000", 2024-09-12T22:50:18.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119634 2024-09-12T22:50:18.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:18.572 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.162653+0000", 2024-09-12T22:50:18.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9054999999999995e-05 2024-09-12T22:50:18.572 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.572 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:18.572 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.572 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13558 4.10 4:09df41af:::1000000333c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:18.572 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.229326+0000", 2024-09-12T22:50:18.573 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.266412208999999, 2024-09-12T22:50:18.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.039409786000000002, 2024-09-12T22:50:18.573 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:18.573 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:18.573 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.573 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:18.573 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:18.573 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:18.573 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13558 2024-09-12T22:50:18.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.573 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:18.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:18.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.229326+0000", 2024-09-12T22:50:18.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:18.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.229326+0000", 2024-09-12T22:50:18.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:18.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.229327+0000", 2024-09-12T22:50:18.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1200000000000002e-07 2024-09-12T22:50:18.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.575 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:18.575 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235243+0000", 2024-09-12T22:50:18.575 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059166310000000003 2024-09-12T22:50:18.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.575 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:18.575 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235255+0000", 2024-09-12T22:50:18.575 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1174e-05 2024-09-12T22:50:18.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.575 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.575 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235260+0000", 2024-09-12T22:50:18.576 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1749999999999996e-06 2024-09-12T22:50:18.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.576 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.576 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:18.576 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235295+0000", 2024-09-12T22:50:18.576 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4830999999999999e-05 2024-09-12T22:50:18.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.576 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.576 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:18.576 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235350+0000", 2024-09-12T22:50:18.576 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5092e-05 2024-09-12T22:50:18.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.576 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.577 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:18.577 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.235426+0000", 2024-09-12T22:50:18.577 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6463000000000003e-05 2024-09-12T22:50:18.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.577 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:18.577 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.244772+0000", 2024-09-12T22:50:18.577 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0093457709999999992 2024-09-12T22:50:18.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.577 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:18.577 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.268679+0000", 2024-09-12T22:50:18.577 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023906788000000002 2024-09-12T22:50:18.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.578 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:18.578 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.268712+0000", 2024-09-12T22:50:18.578 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3701999999999997e-05 2024-09-12T22:50:18.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.578 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:18.578 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.268736+0000", 2024-09-12T22:50:18.578 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3447000000000001e-05 2024-09-12T22:50:18.578 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.578 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:18.578 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.579 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13747 4.1e 4:7aa36f33:::100000035ed.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:18.579 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.457376+0000", 2024-09-12T22:50:18.579 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.038362095, 2024-09-12T22:50:18.579 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.037057578000000001, 2024-09-12T22:50:18.579 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:18.579 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:18.579 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.579 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:18.579 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:18.579 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:18.579 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13747 2024-09-12T22:50:18.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.579 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:18.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.580 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:18.580 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.457376+0000", 2024-09-12T22:50:18.580 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.580 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:18.580 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.457376+0000", 2024-09-12T22:50:18.580 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.580 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:18.580 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.457377+0000", 2024-09-12T22:50:18.580 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1699999999999998e-07 2024-09-12T22:50:18.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.581 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:18.581 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464400+0000", 2024-09-12T22:50:18.581 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070235890000000002 2024-09-12T22:50:18.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.581 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:18.581 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464413+0000", 2024-09-12T22:50:18.581 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2397e-05 2024-09-12T22:50:18.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.581 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.581 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464418+0000", 2024-09-12T22:50:18.582 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5119999999999999e-06 2024-09-12T22:50:18.582 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.582 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:18.582 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464464+0000", 2024-09-12T22:50:18.582 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5976000000000002e-05 2024-09-12T22:50:18.582 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.582 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:18.582 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464529+0000", 2024-09-12T22:50:18.582 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5266999999999997e-05 2024-09-12T22:50:18.582 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.582 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:18.583 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.494315+0000", 2024-09-12T22:50:18.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029785329999999999 2024-09-12T22:50:18.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.583 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:18.583 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.494366+0000", 2024-09-12T22:50:18.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0903999999999999e-05 2024-09-12T22:50:18.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.583 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:18.583 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.494434+0000", 2024-09-12T22:50:18.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7985999999999996e-05 2024-09-12T22:50:18.583 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.583 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:18.584 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.584 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4459.0:13748 4.15 e56/17 4:ab1b03eb:::100000031a3.00000000:head v 56'173, mlcod=56'171)", 2024-09-12T22:50:18.584 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.462509+0000", 2024-09-12T22:50:18.584 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.033229047999999, 2024-09-12T22:50:18.584 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.044366823, 2024-09-12T22:50:18.584 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:18.584 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:18.584 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.584 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:18.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.584 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:18.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.462509+0000", 2024-09-12T22:50:18.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.585 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:18.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.462509+0000", 2024-09-12T22:50:18.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.585 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:18.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.462509+0000", 2024-09-12T22:50:18.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7599999999999998e-07 2024-09-12T22:50:18.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:18.586 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471576+0000", 2024-09-12T22:50:18.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090665490000000001 2024-09-12T22:50:18.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:18.586 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471591+0000", 2024-09-12T22:50:18.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4566000000000001e-05 2024-09-12T22:50:18.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.586 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471600+0000", 2024-09-12T22:50:18.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1630000000000002e-06 2024-09-12T22:50:18.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:18.587 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471689+0000", 2024-09-12T22:50:18.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9591000000000003e-05 2024-09-12T22:50:18.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:18.587 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.471735+0000", 2024-09-12T22:50:18.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5429000000000002e-05 2024-09-12T22:50:18.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:18.587 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.506851+0000", 2024-09-12T22:50:18.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035116238000000001 2024-09-12T22:50:18.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.588 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:18.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.506876+0000", 2024-09-12T22:50:18.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5011000000000002e-05 2024-09-12T22:50:18.588 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.588 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:18.588 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.588 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13753 4.30 4:0dea61b7:::100000036ed.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:18.588 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.464559+0000", 2024-09-12T22:50:18.588 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.031179048999999, 2024-09-12T22:50:18.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.041415303000000001, 2024-09-12T22:50:18.589 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:18.589 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:18.589 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.589 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:18.589 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:18.589 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:18.589 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13753 2024-09-12T22:50:18.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.589 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:18.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.589 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:18.589 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464559+0000", 2024-09-12T22:50:18.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:18.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464559+0000", 2024-09-12T22:50:18.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:18.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.464560+0000", 2024-09-12T22:50:18.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:50:18.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:18.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469861+0000", 2024-09-12T22:50:18.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053017139999999999 2024-09-12T22:50:18.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:18.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469878+0000", 2024-09-12T22:50:18.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6336000000000001e-05 2024-09-12T22:50:18.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469888+0000", 2024-09-12T22:50:18.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8320000000000001e-06 2024-09-12T22:50:18.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.592 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:18.592 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469950+0000", 2024-09-12T22:50:18.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1923999999999999e-05 2024-09-12T22:50:18.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.592 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:18.592 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.470059+0000", 2024-09-12T22:50:18.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109559 2024-09-12T22:50:18.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.592 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:18.592 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.505915+0000", 2024-09-12T22:50:18.593 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.035855887000000003 2024-09-12T22:50:18.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.593 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:18.593 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.505939+0000", 2024-09-12T22:50:18.593 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3740999999999999e-05 2024-09-12T22:50:18.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.593 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:18.593 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.505974+0000", 2024-09-12T22:50:18.593 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5753999999999997e-05 2024-09-12T22:50:18.593 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.593 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:18.594 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.594 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13754 4.11 4:8a2f20b1:::10000003764.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:18.594 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.469921+0000", 2024-09-12T22:50:18.594 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.025817196999999, 2024-09-12T22:50:18.594 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034721670000000003, 2024-09-12T22:50:18.594 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:18.594 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:18.594 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.594 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:18.594 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:18.594 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:18.594 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13754 2024-09-12T22:50:18.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.595 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:18.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:18.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469921+0000", 2024-09-12T22:50:18.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:18.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469921+0000", 2024-09-12T22:50:18.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:18.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.469922+0000", 2024-09-12T22:50:18.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.006e-06 2024-09-12T22:50:18.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:18.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474681+0000", 2024-09-12T22:50:18.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047588539999999999 2024-09-12T22:50:18.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:18.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474698+0000", 2024-09-12T22:50:18.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7368999999999999e-05 2024-09-12T22:50:18.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474709+0000", 2024-09-12T22:50:18.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0738e-05 2024-09-12T22:50:18.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:18.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474780+0000", 2024-09-12T22:50:18.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0622000000000002e-05 2024-09-12T22:50:18.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:18.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474954+0000", 2024-09-12T22:50:18.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017394399999999999 2024-09-12T22:50:18.598 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.598 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:18.598 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.504488+0000", 2024-09-12T22:50:18.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029534721999999999 2024-09-12T22:50:18.598 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.598 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:18.598 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.504553+0000", 2024-09-12T22:50:18.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4877999999999998e-05 2024-09-12T22:50:18.598 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:18.599 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.504643+0000", 2024-09-12T22:50:18.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9536999999999993e-05 2024-09-12T22:50:18.599 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.599 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:18.599 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.599 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13763 4.2d 4:b5937a57:::100000031de.00000000:head [write 0~4194304 [3@52474]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:18.599 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.474957+0000", 2024-09-12T22:50:18.599 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.020780953999999, 2024-09-12T22:50:18.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.057329167, 2024-09-12T22:50:18.599 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:18.600 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:18.600 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.600 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:18.600 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:18.600 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:18.600 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13763 2024-09-12T22:50:18.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.600 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:18.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:18.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474957+0000", 2024-09-12T22:50:18.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:18.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474957+0000", 2024-09-12T22:50:18.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:18.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.474958+0000", 2024-09-12T22:50:18.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8299999999999997e-07 2024-09-12T22:50:18.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:18.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.478970+0000", 2024-09-12T22:50:18.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040121100000000002 2024-09-12T22:50:18.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:18.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.478983+0000", 2024-09-12T22:50:18.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.292e-05 2024-09-12T22:50:18.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.478992+0000", 2024-09-12T22:50:18.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3759999999999997e-06 2024-09-12T22:50:18.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:18.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.479048+0000", 2024-09-12T22:50:18.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5381999999999999e-05 2024-09-12T22:50:18.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:18.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.479124+0000", 2024-09-12T22:50:18.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6643999999999993e-05 2024-09-12T22:50:18.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:18.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.479230+0000", 2024-09-12T22:50:18.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010581099999999999 2024-09-12T22:50:18.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:18.604 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.506897+0000", 2024-09-12T22:50:18.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027666863999999999 2024-09-12T22:50:18.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.604 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:18.604 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.532175+0000", 2024-09-12T22:50:18.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.025278367 2024-09-12T22:50:18.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.604 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:18.604 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.532232+0000", 2024-09-12T22:50:18.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6455000000000001e-05 2024-09-12T22:50:18.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:18.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.532286+0000", 2024-09-12T22:50:18.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4654999999999998e-05 2024-09-12T22:50:18.605 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.605 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:18.605 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.605 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4459.0:13803 4.4 4:228c5bc4:::10000003314.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:50:18.605 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-12T22:49:57.515814+0000", 2024-09-12T22:50:18.605 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 20.979924528000002, 2024-09-12T22:50:18.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.034442453999999997, 2024-09-12T22:50:18.605 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-12T22:50:18.606 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-12T22:50:18.606 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:50:18.606 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-12T22:50:18.606 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4459", 2024-09-12T22:50:18.606 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/4014885062", 2024-09-12T22:50:18.606 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 13803 2024-09-12T22:50:18.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.606 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-12T22:50:18.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-12T22:50:18.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.515814+0000", 2024-09-12T22:50:18.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-12T22:50:18.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.515814+0000", 2024-09-12T22:50:18.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-12T22:50:18.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-12T22:50:18.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.515814+0000", 2024-09-12T22:50:18.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4799999999999998e-07 2024-09-12T22:50:18.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-12T22:50:18.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522580+0000", 2024-09-12T22:50:18.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0067656959999999999 2024-09-12T22:50:18.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-12T22:50:18.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522591+0000", 2024-09-12T22:50:18.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1206000000000001e-05 2024-09-12T22:50:18.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-12T22:50:18.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522597+0000", 2024-09-12T22:50:18.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1500000000000004e-06 2024-09-12T22:50:18.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-12T22:50:18.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522639+0000", 2024-09-12T22:50:18.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1767999999999997e-05 2024-09-12T22:50:18.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-12T22:50:18.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522689+0000", 2024-09-12T22:50:18.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9472999999999999e-05 2024-09-12T22:50:18.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-12T22:50:18.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.522771+0000", 2024-09-12T22:50:18.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2738000000000006e-05 2024-09-12T22:50:18.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-12T22:50:18.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.529356+0000", 2024-09-12T22:50:18.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065850329999999997 2024-09-12T22:50:18.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:50:18.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.550206+0000", 2024-09-12T22:50:18.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020849755000000001 2024-09-12T22:50:18.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-12T22:50:18.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.550233+0000", 2024-09-12T22:50:18.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6990000000000001e-05 2024-09-12T22:50:18.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-12T22:50:18.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-12T22:50:18.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-12T22:50:18.611 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-12T22:49:57.550256+0000", 2024-09-12T22:50:18.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3096999999999999e-05 2024-09-12T22:50:18.611 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.611 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:18.611 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.611 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-12T22:50:18.611 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-12T22:50:18.611 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-12T22:50:18.778 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:50:19.770 INFO:teuthology.orchestra.run.smithi066.stderr:noscrub is unset 2024-09-12T22:50:19.785 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:50:20.773 INFO:teuthology.orchestra.run.smithi066.stderr:nodeep-scrub is unset 2024-09-12T22:50:23.294 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~112s 2024-09-12T22:50:29.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~117s 2024-09-12T22:50:34.909 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~123s 2024-09-12T22:50:40.718 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~129s 2024-09-12T22:50:41.303 DEBUG:teuthology.orchestra.console.smithi117:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ct                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 8F 44 63 GUID: 00000000 0000 0000 0000 0CC47AD8A88A DHCP.|                    DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| CLIENT IP: 172.21.15.117 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:8f:44:63)... Configuring (net0 0c:c4:7a:8f:44:63).... Configuring (net0 0c:c4:7a:8f:44:63)..... Configuring (net0 0c:c4:7a:8f:44:63)...... ok [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (5.14.0-505.el9.x86_64) 9  CentOS Stream (5.14.0-503.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-fbf6b6fa6cf04654a0e563f30ecbf43a) 9              The selected entry will be started automatically in 5s.   CentOS Stream (5.14.0-505.el9.x86_64) 9   CentOS Stream (5.14.0-503.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-fbf6b6fa6cf04654a0e563f30ecbf43a) 9            Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h       [ 0.000000] Linux version 5.14.0-505.el9.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc (GCC) 11.5.0 20240719 (Red Hat 11.5.0-2), GNU ld version 2.35.2-54.el9) #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 [ 0.000000] The list of certified hardware and cloud instances for Red Hat Enterprise Linux 9 can be viewed at the Red Hat Ecosystem Catalog, https://catalog.redhat.com. [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-505.el9.x86_64 root=UUID=fa8d2923-554d-41e2-ac4a-c752ff079ceb ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec1fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f74000-0x00000000798adfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ae000-0x0000000079d4afff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4b000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] APIC: Static calls initialized [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.755 MHz processor [ 0.000411] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000415] MTRR map: 5 entries (3 fixed + 2 variable; max 23), built from 10 variable MTRRs [ 0.000417] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000745] last_pfn = 0x78ec2 max_arch_pfn = 0x400000000 [ 0.006521] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.006530] Using GB pages for direct mapping [ 0.006703] RAMDISK: [mem 0x341fd000-0x360f6fff] [ 0.006705] ACPI: Early table checksum verification disabled [ 0.006707] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.006710] ACPI: XSDT 0x00000000798AE098 0000B4 (v01 01072009 AMI 00010013) [ 0.006715] ACPI: FACP 0x00000000798E15B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006719] ACPI: DSDT 0x00000000798AE1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.006721] ACPI: FACS 0x0000000079D49F80 000040 [ 0.006723] ACPI: APIC 0x00000000798E16C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006726] ACPI: FPDT 0x00000000798E1788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006728] ACPI: FIDT 0x00000000798E17D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006730] ACPI: SPMI 0x00000000798E1870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.006732] ACPI: MCFG 0x00000000798E18B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.006734] ACPI: UEFI 0x00000000798E18F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.006737] ACPI: HPET 0x00000000798E1938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006739] ACPI: WDDT 0x00000000798E1970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.006741] ACPI: SSDT 0x00000000798E19B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.006743] ACPI: SSDT 0x00000000798F8B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.006746] ACPI: SSDT 0x00000000798FB180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.006748] ACPI: PRAD 0x00000000798FB1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.006750] ACPI: DMAR 0x00000000798FB2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006752] ACPI: HEST 0x00000000798FB3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006754] ACPI: BERT 0x00000000798FB630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006757] ACPI: ERST 0x00000000798FB660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006759] ACPI: EINJ 0x00000000798FB890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006760] ACPI: Reserving FACP table memory at [mem 0x798e15b0-0x798e16bb] [ 0.006762] ACPI: Reserving DSDT table memory at [mem 0x798ae1e8-0x798e15ab] [ 0.006762] ACPI: Reserving FACS table memory at [mem 0x79d49f80-0x79d49fbf] [ 0.006763] ACPI: Reserving APIC table memory at [mem 0x798e16c0-0x798e1787] [ 0.006764] ACPI: Reserving FPDT table memory at [mem 0x798e1788-0x798e17cb] [ 0.006764] ACPI: Reserving FIDT table memory at [mem 0x798e17d0-0x798e186b] [ 0.006765] ACPI: Reserving SPMI table memory at [mem 0x798e1870-0x798e18af] [ 0.006765] ACPI: Reserving MCFG table memory at [mem 0x798e18b0-0x798e18eb] [ 0.006766] ACPI: Reserving UEFI table memory at [mem 0x798e18f0-0x798e1931] [ 0.006767] ACPI: Reserving HPET table memory at [mem 0x798e1938-0x798e196f] [ 0.006767] ACPI: Reserving WDDT table memory at [mem 0x798e1970-0x798e19af] [ 0.006768] ACPI: Reserving SSDT table memory at [mem 0x798e19b0-0x798f8b2e] [ 0.006768] ACPI: Reserving SSDT table memory at [mem 0x798f8b30-0x798fb17b] [ 0.006769] ACPI: Reserving SSDT table memory at [mem 0x798fb180-0x798fb1e3] [ 0.006769] ACPI: Reserving PRAD table memory at [mem 0x798fb1e8-0x798fb2e9] [ 0.006770] ACPI: Reserving DMAR table memory at [mem 0x798fb2f0-0x798fb3ab] [ 0.006771] ACPI: Reserving HEST table memory at [mem 0x798fb3b0-0x798fb62b] [ 0.006771] ACPI: Reserving BERT table memory at [mem 0x798fb630-0x798fb65f] [ 0.006772] ACPI: Reserving ERST table memory at [mem 0x798fb660-0x798fb88f] [ 0.006772] ACPI: Reserving EINJ table memory at [mem 0x798fb890-0x798fb9bf] [ 0.006818] No NUMA configuration found [ 0.006819] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.006827] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.006998] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32654MB) [ 0.007034] Zone ranges: [ 0.007035] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.007036] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.007037] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.007038] Device empty [ 0.007039] Movable zone start for each node [ 0.007041] Early memory node ranges [ 0.007041] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.007042] node 0: [mem 0x0000000000100000-0x0000000078ec1fff] [ 0.007043] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.007047] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.007051] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.007087] On node 0, zone DMA: 117 pages in unavailable ranges [ 0.011766] On node 0, zone Normal: 28990 pages in unavailable ranges [ 0.011877] ACPI: PM-Timer IO Port: 0x408 [ 0.011885] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.011886] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.011887] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.011887] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.011888] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.011888] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.011889] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.011890] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.011899] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.011903] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.011904] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.011906] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.011909] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.011910] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.011914] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.011919] CPU topo: Max. logical packages: 1 [ 0.011920] CPU topo: Max. logical dies: 1 [ 0.011920] CPU topo: Max. dies per package: 1 [ 0.011924] CPU topo: Max. threads per core: 2 [ 0.011925] CPU topo: Num. cores per package: 4 [ 0.011926] CPU topo: Num. threads per package: 8 [ 0.011926] CPU topo: Allowing 8 present CPUs plus 0 hotplug CPUs [ 0.011935] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.011936] PM: hibernation: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.011937] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.011938] PM: hibernation: Registered nosave memory: [mem 0x78ec2000-0x78f73fff] [ 0.011939] PM: hibernation: Registered nosave memory: [mem 0x78f74000-0x798adfff] [ 0.011939] PM: hibernation: Registered nosave memory: [mem 0x798ae000-0x79d4afff] [ 0.011940] PM: hibernation: Registered nosave memory: [mem 0x79d4b000-0x8fffffff] [ 0.011941] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.011941] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.011942] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.011942] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.011944] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.011945] Booting paravirtualized kernel on bare hardware [ 0.011947] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.016333] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.016550] percpu: Embedded 64 pages/cpu s225280 r8192 d28672 u262144 [ 0.016571] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-505.el9.x86_64 root=UUID=fa8d2923-554d-41e2-ac4a-c752ff079ceb ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.016622] Unknown kernel command line parameters "BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-505.el9.x86_64", will be passed to user space. [ 0.016638] random: crng init done [ 0.018817] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.019955] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.020058] Fallback order for Node 0: 0 [ 0.020061] Built 1 zonelists, mobility grouping on. Total pages: 8228742 [ 0.020062] Policy zone: Normal [ 0.020204] mem auto-init: stack:off, heap alloc:off, heap free:off [ 0.020212] software IO TLB: area num 8. [ 0.041192] Memory: 1751580K/33438000K available (16384K kernel code, 5657K rwdata, 12972K rodata, 3980K init, 5696K bss, 989844K reserved, 0K cma-reserved) [ 0.041294] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.041302] Kernel/User page tables isolation: enabled [ 0.041326] ftrace: allocating 48134 entries in 189 pages [ 0.048150] ftrace: allocated 189 pages with 6 groups [ 0.048671] Dynamic Preempt: voluntary [ 0.048713] rcu: Preemptible hierarchical RCU implementation. [ 0.048714] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.048715] Trampoline variant of Tasks RCU enabled. [ 0.048715] Rude variant of Tasks RCU enabled. [ 0.048716] Tracing variant of Tasks RCU enabled. [ 0.048716] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.048717] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.052189] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.052351] rcu: srcu_init: Setting srcu_struct sizes based on contention. [ 0.052457] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) [ 0.057700] Console: colour VGA+ 80x25 [ 0.057717] printk: console [ttyS1] enabled [ 1.112629] ACPI: Core revision 20230331 [ 1.116719] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.125850] APIC: Switch to symmetric I/O mode setup [ 1.130821] DMAR: Host address width 46 [ 1.134662] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.139979] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.147975] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 1.154242] DMAR: ATSR flags: 0x0 [ 1.157561] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.163829] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.170180] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.176533] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.181934] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.181935] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.196951] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.202252] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.208473] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.218856] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x327269b62a1, max_idle_ns: 440795362218 ns [ 1.229368] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.51 BogoMIPS (lpj=3499755) [ 1.230387] CPU0: Thermal monitoring enabled (TM1) [ 1.231422] process: using mwait in idle threads [ 1.232369] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.233367] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.234369] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.235368] Spectre V2 : Mitigation: Retpolines [ 1.236367] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.237367] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.238368] Speculative Store Bypass: Vulnerable [ 1.239372] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.240367] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.241367] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.242370] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.243367] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.244367] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.245368] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.246367] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.258939] Freeing SMP alternatives memory: 40K [ 1.259368] pid_max: default: 32768 minimum: 301 [ 1.260385] LSM: initializing lsm=lockdown,capability,yama,integrity,selinux,bpf [ 1.261372] Yama: becoming mindful. [ 1.262373] SELinux: Initializing. [ 1.263384] LSM support for eBPF active [ 1.264425] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.265405] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.369330] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.370470] RCU Tasks: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 1.371380] RCU Tasks Rude: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 1.372377] RCU Tasks Trace: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 1.373376] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.374368] ... version: 3 [ 1.375367] ... bit width: 48 [ 1.376367] ... generic registers: 4 [ 1.377367] ... value mask: 0000ffffffffffff [ 1.378367] ... max period: 00007fffffffffff [ 1.379367] ... fixed-purpose events: 3 [ 1.380367] ... event mask: 000000070000000f [ 1.381451] signal: max sigframe size: 1776 [ 1.382378] Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.383393] rcu: Hierarchical SRCU implementation. [ 1.383394] rcu: Max phase no-delay instances is 400. [ 1.386848] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.387434] smp: Bringing up secondary CPUs ... [ 1.388433] smpboot: x86: Booting SMP configuration: [ 1.388435] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 [ 1.391621] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.391621] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.391621] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.395412] smp: Brought up 1 node, 8 CPUs [ 1.395412] smpboot: Total of 8 processors activated (55996.08 BogoMIPS) [ 1.436386] node 0 deferred pages initialised in 38ms [ 1.438403] devtmpfs: initialized [ 1.438403] x86/mm: Memory block size: 128MB [ 1.439366] ACPI: PM: Registering ACPI NVS region [mem 0x798ae000-0x79d4afff] (4837376 bytes) [ 1.439366] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 1.439366] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.439366] pinctrl core: initialized pinctrl subsystem [ 1.444366] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.444368] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.444368] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.444368] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.444368] audit: initializing netlink subsys (disabled) [ 1.444379] audit: type=2000 audit(1726181413.235:1): state=initialized audit_enabled=0 res=1 [ 1.444437] thermal_sys: Registered thermal governor 'fair_share' [ 1.444438] thermal_sys: Registered thermal governor 'step_wise' [ 1.444438] thermal_sys: Registered thermal governor 'user_space' [ 1.445367] cpuidle: using governor menu [ 1.446386] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.446388] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.446444] PCI: ECAM [mem 0x80000000-0x8fffffff] (base 0x80000000) for domain 0000 [bus 00-ff] [ 1.446448] PCI: ECAM [mem 0x80000000-0x8fffffff] reserved as E820 entry [ 1.446457] PCI: Using configuration type 1 for base access [ 1.450395] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.450399] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages [ 1.450399] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page [ 1.450399] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages [ 1.450399] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page [ 1.451396] cryptd: max_cpu_qlen set to 1000 [ 1.451434] ACPI: Added _OSI(Module Device) [ 1.451435] ACPI: Added _OSI(Processor Device) [ 1.451436] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.451437] ACPI: Added _OSI(Processor Aggregator Device) [ 1.451437] ACPI: Added _OSI(Linux-Dell-Video) [ 1.451438] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.451438] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.455384] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.456366] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.456367] ACPI: Dynamic OEM Table Load: [ 1.475701] ACPI: _OSC evaluated successfully for all CPUs [ 1.475962] ACPI: Interpreter enabled [ 1.475971] ACPI: PM: (supports S0 S4 S5) [ 1.475972] ACPI: Using IOAPIC for interrupt routing [ 1.477476] HEST: Enabling Firmware First mode for corrected errors. [ 1.508123] HEST: Table parsing has been initialized. [ 1.508238] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.508241] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.508241] PCI: Using E820 reservations for host bridge windows [ 1.508679] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.530101] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.530106] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.531218] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.531749] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.531750] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.531779] PCI host bridge to bus 0000:ff [ 1.531780] pci_bus 0000:ff: root bus resource [bus ff] [ 1.531790] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 conventional PCI endpoint [ 1.531835] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 conventional PCI endpoint [ 1.531866] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 conventional PCI endpoint [ 1.531896] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 conventional PCI endpoint [ 1.531927] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 conventional PCI endpoint [ 1.531957] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 conventional PCI endpoint [ 1.531986] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 conventional PCI endpoint [ 1.532015] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 conventional PCI endpoint [ 1.532046] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 conventional PCI endpoint [ 1.532075] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 conventional PCI endpoint [ 1.532105] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 conventional PCI endpoint [ 1.532134] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 conventional PCI endpoint [ 1.532164] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 conventional PCI endpoint [ 1.532194] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 conventional PCI endpoint [ 1.532223] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 conventional PCI endpoint [ 1.532254] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 conventional PCI endpoint [ 1.532283] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 conventional PCI endpoint [ 1.532312] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 conventional PCI endpoint [ 1.532341] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 conventional PCI endpoint [ 1.532363] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 conventional PCI endpoint [ 1.532402] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.532464] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.532523] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.532583] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.532645] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.532705] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.532769] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 conventional PCI endpoint [ 1.532802] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 conventional PCI endpoint [ 1.532835] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.532877] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.532919] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.532961] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.533002] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 conventional PCI endpoint [ 1.533033] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 conventional PCI endpoint [ 1.533064] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 conventional PCI endpoint [ 1.533096] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 conventional PCI endpoint [ 1.533129] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.533172] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.533214] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.533257] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.533300] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 conventional PCI endpoint [ 1.533335] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 conventional PCI endpoint [ 1.533368] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 conventional PCI endpoint [ 1.533400] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 conventional PCI endpoint [ 1.533435] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 conventional PCI endpoint [ 1.533466] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 conventional PCI endpoint [ 1.533497] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 conventional PCI endpoint [ 1.533529] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 conventional PCI endpoint [ 1.533563] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 conventional PCI endpoint [ 1.533594] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 conventional PCI endpoint [ 1.533624] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 conventional PCI endpoint [ 1.533655] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 conventional PCI endpoint [ 1.533678] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 conventional PCI endpoint [ 1.533710] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 conventional PCI endpoint [ 1.533741] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 conventional PCI endpoint [ 1.535981] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 1.535984] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.536115] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.536357] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.536358] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.536767] PCI host bridge to bus 0000:00 [ 1.536769] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 1.536771] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 1.536772] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 1.536774] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 1.536775] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 1.536775] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 1.536776] pci_bus 0000:00: root bus resource [bus 00-fe] [ 1.536795] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 PCIe Root Port [ 1.536900] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 PCIe Root Port [ 1.536912] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.536949] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.537042] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 PCIe Root Port [ 1.537054] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.537056] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.537091] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.537181] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 PCIe Root Port [ 1.537192] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.537194] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.537196] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.537200] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.537231] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.537317] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.537325] pci 0000:00:04.0: BAR 0 [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.537405] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.537412] pci 0000:00:04.1: BAR 0 [mem 0xfb428000-0xfb42bfff 64bit] [ 1.537488] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.537496] pci 0000:00:04.2: BAR 0 [mem 0xfb424000-0xfb427fff 64bit] [ 1.537571] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.537578] pci 0000:00:04.3: BAR 0 [mem 0xfb420000-0xfb423fff 64bit] [ 1.537658] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.537666] pci 0000:00:04.4: BAR 0 [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.537739] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.537747] pci 0000:00:04.5: BAR 0 [mem 0xfb418000-0xfb41bfff 64bit] [ 1.537823] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.537831] pci 0000:00:04.6: BAR 0 [mem 0xfb414000-0xfb417fff 64bit] [ 1.537905] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.537913] pci 0000:00:04.7: BAR 0 [mem 0xfb410000-0xfb413fff 64bit] [ 1.537986] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.538048] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.538134] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.538190] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 PCIe Root Complex Integrated Endpoint [ 1.538196] p 0000:00:05.4: BAR 0 [mem 0xfb439000-0xfb439fff] [ 1.538275] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 PCIe Root Complex Integrated Endpoint [ 1.538516] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 conventional PCI endpoint [ 1.538536] pci 0000:00:11.4: BAR 0 [io 0xf110-0xf117] [ 1.538546] pci 0000:00:11.4: BAR 1 [io 0xf100-0xf103] [ 1.538557] pci 0000:00:11.4: BAR 2 [io 0xf0f0-0xf0f7] [ 1.538568] pci 0000:00:11.4: BAR 3 [io 0xf0e0-0xf0e3] [ 1.538579] pci 0000:00:11.4: BAR 4 [io 0xf020-0xf03f] [ 1.538590] pci 0000:00:11.4: BAR 5 [mem 0xfb438000-0xfb4387ff] [ 1.538648] pci 0000:00:11.4: PME# supported from D3hot [ 1.538728] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 conventional PCI endpoint [ 1.538753] pci 0000:00:14.0: BAR 0 [mem 0xfb400000-0xfb40ffff 64bit] [ 1.538840] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.538929] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 conventional PCI endpoint [ 1.538953] pci 0000:00:16.0: BAR 0 [mem 0xfb437000-0xfb43700f 64bit] [ 1.539041] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.539107] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 conventional PCI endpoint [ 1.539131] pci 0000:00:16.1: BAR 0 [mem 0xfb436000-0xfb43600f 64bit] [ 1.539219] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.539304] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 conventional PCI endpoint [ 1.539325] pci 0000:00:1a.0: BAR 0 [mem 0xfb434000-0xfb4343ff] [ 1.539443] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.539525] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 PCIe Root Port [ 1.539562] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.539654] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.539756] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 PCIe Root Port [ 1.539794] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.539798] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.539801] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.539889] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.539990] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 PCIe Root Port [ 1.540026] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.540031] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.540035] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.540123] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.540231] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 conventional PCI endpoint [ 1.540251] pci 0000:00:1d.0: BAR 0 [mem 0xfb433000-0xfb4333ff] [ 1.540368] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.540453] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 conventional PCI endpoint [ 1.540657] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 conventional PCI endpoint [ 1.540675] pci 0000:00:1f.2: BAR 0 [io 0xf070-0xf077] [ 1.540685] pci 0000:00:1f.2: BAR 1 [io 0xf060-0xf063] [ 1.540696] pci 0000:00:1f.2: BAR 2 [io 0xf050-0xf057] [ 1.540706] pci 0000:00:1f.2: BAR 3 [io 0xf040-0xf043] [ 1.540717] pci 0000:00:1f.2: BAR 4 [io 0xf000-0xf01f] [ 1.540728] pci 0000:00:1f.2: BAR 5 [mem 0xfb432000-0xfb4327ff] [ 1.540781] pci 0000:00:1f.2: PME# supported from D3hot [ 1.540843] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 conventional PCI endpoint [ 1.540866] pci 0000:00:1f.3: BAR 0 [mem 0xfb431000-0xfb4310ff 64bit] [ 1.540895] pci 0000:00:1f.3: BAR 4 [io 0x0580-0x059f] [ 1.541058] acpiphp: Slot [1] registered [ 1.541069] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.541173] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 PCIe Endpoint [ 1.541182] pci 0000:02:00.0: BAR 0 [mem 0xfb310000-0xfb313fff 64bit] [ 1.541199] pci 0000:02:00.0: ROM [mem 0xfb300000-0xfb30ffff pref] [ 1.541203] pci 0000:02:00.0: enabling Extended Tags [ 1.541308] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.541417] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.541428] pci 0000:03:00.0: BAR 0 [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.541432] pci 0000:03:00.0: BAR 2 [io 0xe020-0xe03f] [ 1.541442] pci 0000:03:00.0: BAR 4 [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.541447] pci 0000:03:00.0: ROM [mem 0xfb280000-0xfb2fffff pref] [ 1.541484] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.541501] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.541502] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 V0.0: VF BAR 3 [mf] [ 1.541512] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.541665] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.541675] pci 0000:03:00.1: BAR 0 [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.541680] pci 0000:03:00.1: BAR 2 [io 0xe000-0xe01f] [ 1.541690] pci 0000:03:00.1: BAR 4 [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.541694] pci 0000:03:00.1: ROM [mem 0xfb200000-0xfb27ffff pref] [ 1.541732] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.541745] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.541746] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.541755] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.541756] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0xtains BAR 3 for 00:00:03.0: PCI pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.542034] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 PCIe to PCI/PCI-X bridge [ 1.542106] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.542119] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.542124] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.542178] pci 0000:05:00.0: enabling Extended Tags [ 1.542302] pci 0000:05:00.0: supports D1 D2 [ 1.542303] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.542441] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.542528] pci_bus 0000:06: extended config space not accessible [ 1.542562] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 conventional PCI endpoint [ 1.542598] pci 0000:06:00.0: BAR 0 [mem 0xfa000000-0xfaffffff] [ 1.542618] pci 0000:06:00.0: BAR 1 [mem 0xfb000000-0xfb01ffff] [ 1.542636] pci 0000:06:00.0: BAR 2 [io 0xd000-0xd07f] [ 1.542735] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 1.542805] pci 0000:06:00.0: supports D1 D2 [ 1.542806] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.542963] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.541521] type 00 class 0x020000 PCIe Endpoint [ 1.543145] pci 0000:07:00.0: BAR 0 [mem 0xfb120000-0xfb13ffff] [ 1.543181] pci 0000:07:00.0: BAR 2 [io 0xc020-0xc03f] [ 1.543199] pci 0000:07:00.0: BAR 3 [mem 0xfb144000-0xfb147fff] [ 1.543436] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.543496] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.543497] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.543533] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.543534] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.543878] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.543912] pci 0000:07:00.1: BAR 0 [mem 0xfb100000-0xfb11ffff] [ 1.543948] 07:00.1: BAR 2 [io 0xc000-0xc01f] [ 1.543966] pci 0000:07:00.1: BAR 3 [mem 0xfb140000-0xfb143fff] [ 1.544196] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.544255] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.544256] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.544289] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.544290] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.544596] pci 0000:00:1c.bridge to [bus 07] [ 1.544608] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.545282] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.545314] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.545344] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.545375] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.545405] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.545405] ACPI: PCI: Interrupt link LNKE disabled [ 1.545435] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.545435] ACPI: PCI: Interrupt link LNKF disabled [ 1.545463] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.545464] ACPI: PCI: Interrupt link LNKG disabled [ 1.545493] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.545494] ACPI: PCI: Interrupt link LNKH disabled [ 1.546381] iommu: Default domain type: Translated [ 1.546381] iommu: DMA domain TLB invalidation policy: lazy mode [ 1.546435] SCSI subsystem initialized [ 1.546451] ACPI: bus type USB registered [ 1.546465] usbcore: registered new interface driver usbfs [ 1.546472] usbcore: registered new interface driver hub [ 1.546477] usbcore: registered new device driver usb [ 1.546497] pps_core: LinuxPPS API ver. 1 registered [ 1.546498] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 1.546499] PTP clock support registered [ 1.546513] EDAC MC: Ver: 3.0.0 [ 1.546522] NetLabel: Initializing [ 1.546523] NetLabel: domain hash size = 128 [ 1.546523] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 1.546537] NetLabel: unlabeled traffic allowed by default [ 1.546537] PCI: Using ACPI for IRQ routing [ 1.557404] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 1.557404] pci 0000:06:00.0: vgaarb: bridge control possible [ 1.557404] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 1.557404] vgaarb: loaded [ 1.557404] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 1.557404] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 1.564199] clocksource: Switched to clocksource tsc-early [ 1.572427] VFS: Disk quotas dquot_6.6.0 [ 1.572440] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.572502] pnp: PnP ACPI init [ 1.572936] system 00:01: [io 0x0500-0x057f] has been reserved [ 1.572939] system 00:01: [io 0x0400-0x047f] has been reserved [ 1.572941] system 00:01: [io 0x0580-0x059f] has been reserved [ 1.572943] system 00:01: [io 0x0600-0x061f] has been reserved [ 1.572945] system 00:01: [io 0x0880-0x0883] has been reserved [ 1.572946] system 00:01: [io 0x0800-0x081f] has been reserved [ 1.572948] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 1.572950] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 1.572952] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 1.572953] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 1.572955] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 1.572957] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 1.572958] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 1.573165] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 1.573167] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 1.573169] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 1.573170] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 1.573172] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 1.574119] pnp: PnP ACPI: found 5 devices [ 1.579803] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.579855] NET: Registered PF_INET protocol family [ 1.580022] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.582280] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 1.582309] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 1.582314] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.582531] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 1.582636] TCP: Hash tables configured (established 262144 bind 65536) [ 1.582748] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 1.582830] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.582887] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.582964] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 1.582968] NET: Registered PF_XDP protocol family [ 1.582991] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 1.583001] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref]: assigned [ 1.583003] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.583008] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.583010] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.583016] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.583017] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.583019] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.583019] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.583021] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.583022] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.583023] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.583024] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.583025] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.583026] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.583027] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.583028] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.583029] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.583030] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.583031] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.583032] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.583033] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.583035] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.583037] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.583038] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.583041] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.583054] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.583056] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.583064] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.583080] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.583082] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.583087] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.583097] pci 0000:07:00.0: VF BAR 0 [mem 0x90000000-0x9001ffff 64bit pref]: assigned [ 1.583106] pci 0000:07:00.0: VF BAR 3 [mem 0x90020000-0x9003ffff 64bit pref]: assigned [ 1.583112] pci 0000:07:00.1: VF BAR 0 [mem 0x90040000-0x9005ffff 64bit pref]: assigned [ 1.583118] pci 0000:07:00.1: VF BAR 3 [mem 0x90060000-0x9007ffff 64bit pref]: assigned [ 1.583124] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.583126] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.583131] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.583135] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 1.583141] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 1.583141] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.583143] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 1.583143] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.583144] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 1.583145] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 1.583146] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 1.583147] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 1.583148] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 1.583149] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 1.583149] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.583151] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 1.583151] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.583152] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 1.583153] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.583154] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 1.583155] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 1.583156] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 1.583313] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 1.600032] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x140 took 16166 usecs [ 1.617031] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x140 took 16585 usecs [ 1.617045] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 1.617079] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 1.617080] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 1.617086] ACPI: bus type thunderbolt registered [ 1.617087] Trying to unpack rootfs image as initramfs... [ 1.715620] Initialise system trusted keyrings [ 1.715632] Key type blacklist registered [ 1.715679] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 1.715692] zbud: loaded [ 1.861764] integrity: Platform Keyring initialized [ 1.861771] integrity: Machine keyring initialized [ 1.869844] NET: Registered PF_ALG protocol family [ 1.869848] xor: automatically using best checksumming function avx [ 1.869850] Key type asymmetric registered [ 1.869851] Asymmetric key parser 'x509' registered [ 1.869852] Running certificate verification selftests [ 1.880212] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 1.880683] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246) [ 1.880715] io scheduler mq-deadline registered [ 1.880717] io scheduler kyber registered [ 1.880727] io scheduler bfq registered [ 1.940211] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 1.940625] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 1.940825] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 1.941010] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 1.941167] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 1.941349] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 1.941513] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 1.941695] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 1.949468] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 1.968406] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 1.968429] ACPI: button: Power Button [PWRB] [ 1.968451] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 1.988935] Freeing initrd memory: 31720K [ 2.002156] ACPI: button: Power Button [PWRF] [ 2.036168] ERST: Error Record Serialization Table (ERST) support is initialized. [ 2.036170] pstore: Registered erst as persistent store backend [ 2.036298] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 2.036401] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 2.043398] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 2.052045] Non-volatile memory driver v1.3 [ 2.165886] rdac: device handler registered [ 2.165913] hp_sw: device handler registered [ 2.165914] emc: device handler registered [ 2.165931] alua: device handler registered [ 2.166215] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 2.166252] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 2.166266] ehci-pci 0000:00:1a.0: debug port 2 [ 2.170190] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 2.177020] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 2.177052] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.177054] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.177056] usb usb1: Product: EHCI Host Controller [ 2.177056] usb usb1: Manufacturer: Linux 5.14.0-505.el9.x86_64 ehci_hcd [ 2.177057] usb usb1: SerialNumber: 0000:00:1a.0 [ 2.177146] hub 1-0:1.0: USB hub found [ 2.177150] hub 1-0:1.0: 2 ports detected [ 2.177257] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 2.177295] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 2.178380] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 2.178626] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 2.178626] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 2.178658] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 2.178660] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 2.178662] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 4 [ 2.178677] ehci-pci 0000:00:1d.0: debug port 2 [ 2.178689] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.178691] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.178692] usb usb2: Product: xHCI Host Controller [ 2.178692] usb usb2: Manufacturer: Linux 5.14.0-505.el9.x86_64 xhci-hcd [ 2.178693] usb usb2: SerialNumber: 0000:00:14.0 [ 2.178784] hub 2-0:1.0: USB hub found [ 2.178815] hub 2-0:1.0: 15 ports detected [ 2.181247] usb usb3: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.14 [ 2.181249] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.181251] usb usb3: Product: xHCI Host Controller [ 2.181251] usb usb3: Manufacturer: Linux 5.14.0-505.el9.x86_64 xhci-hcd [ 2.181252] usb usb3: SerialNumber: 0000:00:14.0 [ 2.181316] hub 3-0:1.0: USB hub found [ 2.181334] hub 3-0:1.0: 6 ports detected [ 2.182594] usbcore: registered new interface driver usbserial_generic [ 2.182598] usbserial: USB Serial support registered for generic [ 2.182601] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 2.182626] i8042: PNP: No PS/2 controller found. [ 2.182652] mousedev: PS/2 mouse device common for all mice [ 2.182711] rtc_cmos 00:00: RTC can wake from S4 [ 2.182984] rtc_cmos 00:00: registered as rtc0 [ 2.183034] rtc_cmos 00:00: setting system clock to 2024-09-12T22:50:16 UTC (1726181416) [ 2.183059] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 2.189022] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 2.189053] usb usb4: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.189055] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.189056] usb usb4: Product: EHCI Host Controller [ 2.189057] usb usb4: Manufacturer: Linux 5.14.0-505.el9.x86_64 ehci_hcd [ 2.189058] usb usb4: SerialNumber: 0000:00:1d.0 [ 2.189136] hub 4-0:1.0: USB hub found [ 2.189139] hub 4-0:1.0: 2 ports detected [ 2.193588] intel_pstate: Intel P-state driver initializing [ 2.263636] hid: raw HID events driver (C) Jiri Kosina [ 2.263679] usbcore: registered new interface driver usbhid [ 2.263680] usbhid: USB HID core driver [ 2.263712] drop_monitor: Initializing network drop monitor service [ 2.274560] Initializing XFRM netlink socket [ 2.274581] NET: Registered PF_INET6 protocol family [ 2.279442] Segment Routing with IPv6 [ 2.279459] NET: Registered PF_PACKET protocol family [ 2.279481] mpls_gso: MPLS GSO support [ 2.324093] microcode: Current revision: 0x0b000010 [ 2.346267] resctrl: L3 allocation detected [ 2.346268] resctrl: L3 monitoring detected [ 2.346281] IPI shorthand broadcast: enabled [ 2.346285] AVX2 version of gcm_enc/dec engaged. [ 2.409192] AES CTR mode by8 optimization enabled [ 2.409348] sched_clock: Marking stable (1252000616, 1156988106)->(2894036590, -485047868) [ 2.419031] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 2.427890] registered taskstats version 1 [ 2.442994] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 2.443035] usb 4-1: new high-speed USB device number 2 using ehci-pci [ 2.446609] Loading compiled-in X.509 certificates [ 2.447195] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: d7d2edb13bc4136035087569dd0b474add53ff98' [ 2.447547] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 2.447873] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 2.448064] Loaded X.509 cert 'RH-IMA-CA: Red Hat IMA CA: fb31825dd0e073685b264e3038963673f753959a' [ 2.448076] Loaded X.509 cert 'Nvidia GPU OOT signing 001: 55e1cef88193e60419f0b0ec379c49f77545acf0' [ 2.450543] page_owner is disabled [ 2.450777] pstore: Using crash dump compression: deflate [ 2.450788] Key type big_key registered [ 2.555383] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 2.555386] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.555659] hub 1-1:1.0: USB hub found [ 2.555756] hub 1-1:1.0: 6 ports detected [ 2.565286] Key type encrypted registered [ 2.565293] ima: No TPM chip found, activating TPM-bypass! [ 2.565299] Loading compiled-in module X.509 certificates [ 2.565584] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: d7d2edb13bc4136035087569dd0b474add53ff98' [ 2.565586] ima: Allocated hash algorithm: sha256 [ 2.565594] ima: No architecture policies found [ 2.565602] evm: Initialising EVM extended attributes: [ 2.565602] evm: security.selinux [ 2.565603] evm: security.SMACK64 (disabled) [ 2.565603] evm: security.SMACK64EXEC (disabled) [ 2.565604] evm: security.SMACK64TRANSMUTE (disabled) [ 2.565604] evm: security.SMACK64MMAP (disabled) [ 2.565605] evm: security.apparmor (disabled) [ 2.565605] evm: security.ima [ 2.565605] evm: security.capability [ 2.565606] evm: HMAC attrs: 0x1 [ 2.574384] usb 4-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 2.574388] usb 4-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.574556] hub 4-1:1.0: USB hub found [ 2.574632] hub 4-1:1.0: 8 ports detected [ 2.596958] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 2.596961] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.620668] hub 2-12:1.0: USB hub found [ 2.626644] hub 2-12:1.0: 4 ports detected [ 2.649025] tsc: Refined TSC clocksource calibration: 3499.992 MHz [ 2.649029] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x327349661d8, max_idle_ns: 440795222604 ns [ 2.651810] clocksource: Switched to clocksource tsc [ 2.941017] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd [ 3.077412] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 3.077415] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 3.135716] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ 3.187134] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 3.197461] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 3.197541] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 5.049245] clk: Disabling unused clocks [ 5.054053] Freeing unused decrypted memory: 2028K [ 5.059295] Freeing unused kernel image (initmem) memory: 3980K [ 5.059345] Write protecting the kernel read-only data: 30720k [ 5.071330] Freeing unused kernel image (rodata/data gap) memory: 1364K [ 5.115655] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.115657] x86/mm: Checking user space page tables [ 5.152228] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.152253] Run /init as init process [ 5.165050] systemd[1]: systemd 252-45.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 5.165152] systemd[1]: Detected architecture x86-64. [ 5.165154] systemd[1]: Running in initrd. Welcome to CentOS Stream 9 dracut-057-70.git20240819.el9 (Initramfs)! [ 5.216114] systemd[1]: Hostname set to . [ 5.274120] systemd[1]: Queued start job for default target Initrd Default Target. [ 5.274237] systemd[1]: Reached target Initrd /usr File System. [ OK ] Reached target Initrd /usr File System. [ 5.296113] systemd[1]: Reached target Local File Systems. [ OK ] Reached target Local File Systems. [ 5.310137] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ 5.322067] systemd[1]: Reached target Swaps. [ OK ] Reached target Swaps. [ 5.333130] systemd[1]: Reached target Timer Units. [ OK ] Reached target Timer Units. [ 5.345115] systemd[1]: Listening on D-Bus System Message Bus Socket. [ OK ] Listening on D-Bus System Message Bus Socket. [ 5.360183] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 5.374327] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 5.386152] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 5.400265] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 5.414121] systemd[1]: Reached target Socket Units. [ OK ] Reached target Socket Units. [ 5.432680] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 5.448158] systemd[1]: Starting Journal Service... Starting Journal Service... [ 5.460723] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 5.473658] systemd[1]: Starting Create System Users... Starting Creat[ 5.480279] fuse: init (API version 7.36) e System Users... [ 5.489647] systemd[1]: Starting Setup Virtual Console... Starting Setup Virtual Console... [ 5.502730] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Modules. Starting Apply Kernel Variables... [ OK ] Finished Setup Virtual Console. [ OK ] Finished Apply Kernel Variables. Starting dracut cmdline hook... [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... Starting Create Volatile Files and Directories... [ OK ] Finished dracut cmdline hook. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Finished Create Volatile Files and Directories. Starting dracut pre-udev hook... [ OK ] Finished dracut pre-udev hook. Starting Rule-based Manager for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. Starting Coldplug All udev Devices... [ OK ] Finished Coldplug All udev Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Network. Starting dracu[ 5.867185] dca service started, version 1.12.1 t initqueue hook... Starting Show Plymouth Boot Screen... [ OK ] Started Show Plymouth Boot Screen. [ OK ] Started Forward Password Requests to Plymouth[ 5.910469] igb: Intel(R) Gigabit Ethernet Network Driver [ 5.910474] igb: Copyright (c) 2007-2014 Intel Corporation. Directory Watch. [ OK ] Reached target Path Units. [ [ 5.929292] ahci 0000:00:11.4: AHCI vers 0001.0300, 32 command slots, 6 Gbps, SATA mode OK ] Reache[ 5.929298] ahci 0000:00:11.4: 4/4 ports implemented (port mask 0xf) [ 5.929300] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst d target [0;1;3[ 5.940026] scsi host0: ahci [ 5.940176] scsi host1: ahci [ 5.944705] scsi host2: ahci 9mBasic System[[ 5.944823] scsi host3: ahci [ 5.944898] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 50 lpm-pol 0 [ 5.944901] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 50 lpm-pol 0 [ 5.944903] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 50 lpm-pol 0 0m. [ 5.944905] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 50 lpm-pol 0 [ 5.945240] ahci 0000:00:1f.2: AHCI vers 0001.0300, 32 command slots, 6 Gbps, SATA mode [ 5.945244] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) [ 5.945246] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.960413] scsi host4: ahci [ 5.960528] scsi host5: ahci [ 5.960675] scsi host6: ahci [ 5.960786] scsi host7: ahci [ 5.960928] scsi host8: ahci [ 5.961043] scsi host9: ahci [ 5.961093] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 51 lpm-pol 0 [ 5.961096] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 51 lpm-pol 0 [ 5.961098] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 51 lpm-pol 0 [ 5.961100] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 51 lpm-pol 0 [ 5.961103] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 51 lpm-pol 0 [ 5.961106] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 51 lpm-pol 0 [ 5.974324] igb 0000:07:00.0: added PHC on eth0 [ 5.974351] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.974352] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:a8:8a [ 5.974429] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.974429] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.035473] igb 0000:07:00.1: added PHC on eth1 [ 6.035518] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 6.035519] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:a8:8b [ 6.035603] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 6.035604] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.066286] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 6.066288] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 6.165587] nvme nvme0: pci function 0000:02:00.0 [ 6.167574] nvme nvme0: 8/0/0 default/read/poll queues [ 6.175440] ACPI: bus type drm_connector registered [ 6.254711] ata4: SATA link down (SStatus 0 SControl 300) [ 6.254751] ata3: SATA link down (SStatus 0 SControl 300) [ 6.260153] ata1: SATA link down (SStatus 0 SControl 300) [ 6.262710] ata2: SATA link down (SStatus 0 SControl 300) [ 6.270060] ata7: SATA link down (SStatus 0 SControl 300) [ 6.270108] ata6: SATA link down (SStatus 0 SControl 300) [ 6.270131] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.270261] ata8: SATA link down (SStatus 0 SControl 300) [ 6.270283] ata10: SATA link down (SStatus 0 SControl 300) [ 6.270307] ata9: SATA link down (SStatus 0 SControl 300) [ 6.271138] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 6.271641] ata5.00: NCQ Send/Recv Log not supported [ 6.271643] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.273073] ata5.00: NCQ Send/Recv Log not supported [ 6.273077] ata5.00: configured for UDMA/133 [ 6.273188] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 6.295077] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.350462] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.362779] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.369459] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.369476] sd 4:0:0:0: [sda] Write Protect is off [ 6.369494] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.369515] sd 4:0:0:0: [sda] Preferred minimum I/O size 512 bytes [ 6.385116] sda: sda1 [ 6.385179] sd 4:0:0:0: [sda] Attached SCSI removable disk [ 6.405099] ast 0000:06:00.0: vgaarb: deactivate vga console [ 6.414047] Console: switching to colour dummy device 80x25 [ 6.414186] ast 0000:06:00.0: Using P2A bridge for configuration [ 6.414189] ast 0000:06:00.0: AST 2400 detected [ 6.414238] ast 0000:06:00.0: [drm] Using analog VGA [ 6.414248] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 6.414405] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 6.420124] fbcon: astdrmfb (fb0) is primary device [ 6.450170] Console: switching to colour frame buffer device 128x48 [ 6.467339] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 7.206361] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.206653] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.206735] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 7.206736] ixgbe 0000:03:00.0: 0c:c4:7a:8f:44:62 [ 7.209796] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.366279] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.366568] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.366650] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.366652] ixgbe 0000:03:00.1: 0c:c4:7a:8f:44:63 [ 7.369649] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.385624] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 7.409240] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ OK ] Finished dracut initqueue hook. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting File System Check on /dev…2923-554d-41e2-ac4a-c752ff079ceb... [ OK ] Finished File System Check on /dev…8d2923-554d-41e2-ac4a-c752ff079ceb. Mounting /sysroot... [ 7.651850] EXT4-fs (sda1): mounted filesystem fa8d2923-554d-41e2-ac4a-c752ff079ceb ro with ordered data mode. Quota mode: none. [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Mountpoints Configured in the Real Root... [ OK ] Finished Mountpoints Configured in the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Finished dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Network. [ OK ] Stopped target Timer Units. [ OK ] Closed D-Bus System Message Bus Socket. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Initrd /usr File System. [ OK ] Stopped target Path Units. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Preparation for Remote File Systems. [ OK ] Stopped target Slice Units. [ OK ] Stopped target Socket Units. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swaps. [ OK ] Stopped dracut initqueue hook. Starting Plymouth switch root service... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Load Kernel Modules. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped Coldplug All udev Devices. Stopping Rule-based Manager for Device Events and Files... [ OK ] Stopped Rule-based Manager for Device Events and Files. [ OK ] Finished Cleaning Up and Shutting Down Daemons. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. Starting Cleanup udev Database... [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create List of Static Device Nodes. [ OK ] Stopped Create System Users. [ OK ] Finished Clean[ 7.965828] systemd-journald[280]: Received SIGTERM from PID 1 (systemd). up udev Database. [ OK ] Reached target Switch Root. [ OK ] Finished Plymouth switch root service. Starting Switch Root... [ 8.526730] SELinux: policy capability network_peer_controls=1 [ 8.526737] SELinux: policy capability open_perms=1 [ 8.526738] SELinux: policy capability extended_socket_class=1 [ 8.526739] SELinux: policy capability always_check_network=0 [ 8.526740] SELinux: policy capability cgroup_seclabel=1 [ 8.526740] SELinux: policy capability nnp_nosuid_transition=1 [ 8.526741] SELinux: policy capability genfs_seclabel_symlinks=1 [ 8.568737] audit: type=1403 audit(1726181422.884:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 8.579129] systemd[1]: Successfully loaded SELinux policy in 115.033ms. [ 8.645046] systemd[1]: Relabelled /dev, /dev/shm, /run, /sys/fs/cgroup in 27.501ms. [ 8.658903] systemd[1]: systemd 252-45.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 8.659050] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 9! [ 9.591148] systemd[1]: initrd-switch-root.service: Deactivated successfully. [ 9.591306] systemd[1]: Stopped Switch Root. [ 9.598590] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 9.598879] systemd[1]: Created slice Slice /system/getty. [ 9.602881] systemd[1]: Created slice Slice /system/modprobe. [ 9.611731] systemd[1]: Created slice Slice /system/serial-getty. [ OK [[ 9.629018] systemd[1]: Created slice Slice /system/sshd-keygen. 0m] Stopped [0;[ 9.636450] systemd[1]: Created slice User and Session Slice. 1;39mSwitch Root[ 9.643347] systemd[1]: Dispatch Password Requests to Console Directory Watch was skipped because of an unmet condition check (ConditionPathExists=!/run/plymouth/pid). [ 9.643446] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ 9.659942] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ 9.667212] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ 9.676575] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ 9.686893] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ 9.697227] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ 9.707552] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ 9.717895] systemd[1]: Reached target ceph target allowing to start/stop all ceph-rbd-mirror@.service instances at once. [ 9.728563] systemd[1]: Reached target Local Encrypted Volumes. [ 9.739509] systemd[1]: Stopped target Switch Root. [ 9.745416] systemd[1]: Stopped target Initrd File Systems. [ 9.750278] systemd[1]: Stopped target Initrd Root File System. [ 9.755845] systemd[1]: Reached target Local Integrity Protected Volumes. [ 9.761771] systemd[1]: Reached target Path Units. [ 9.768545] systemd[1]: Reached target Slice Units. [ 9.773322] systemd[1]: Reached target Swaps. [ 9.778190] systemd[1]: Reached target Local Verity Protected Volumes. [ 9.782882] systemd[1]: Listening on Device-mapper event daemon FIFOs. . [[ 9.796239] systemd[1]: Listening on LVM2 poll daemon socket. OK ] Created slice Slice /system/getty. [ OK ] Created slice [ 9.810513] systemd[1]: Listening on RPCbind Server Activation Socket. [ 9.810576] systemd[1]: Reached target RPC Port Mapper. Slice /system/modprobe. [ OK ] Created slice Slice /system/[ 9.829855] systemd[1]: Listening on Process Core Dump Socket. [ 9.829984] systemd[1]: Listening on initctl Compatibility Named Pipe. serial-getty[ 9.844463] systemd[1]: Listening on udev Control Socket. [ 9.844710] systemd[1]: Listening on udev Kernel Socket. [ 9.851074] systemd[1]: Mounting Huge Pages File System... . [ OK[ 9.861837] systemd[1]: Mounting POSIX Message Queue File System... [ 9.862685] systemd[1]: Mounting Kernel Debug File System... ] Created [ 9.875145] systemd[1]: Mounting Kernel Trace File System... slice S[ 9.881457] systemd[1]: Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab). lice /system/sshd-keygen. [ OK ] Created slice User and Session Slice. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Set up automount Arbitrary Executa…ormats File System Automount Point. [ OK ] Reached t[ 9.924129] systemd[1]: Starting Create List of Static Device Nodes... arget c[ 9.924949] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... [ 9.932401] systemd[1]: Starting Load Kernel Module configfs... eph target allow[ 9.944360] systemd[1]: Starting Load Kernel Module drm... in…eph-mon@.se[ 9.949983] systemd[1]: Starting Load Kernel Module fuse... rvice instances [ 9.963799] systemd[1]: Starting Read and set NIS domainname from /etc/sysconfig/network... at once. [[ 9.972856] systemd[1]: plymouth-switch-root.service: Deactivated successfully.  OK [0[ 9.972904] systemd[1]: Stopped Plymouth switch root service. m] Reached targe[ 9.981597] systemd[1]: Stopped Journal Service. t ceph [ 9.995250] systemd[1]: Starting Journal Service... target allowin…eph-mds@.service instances at once. [ OK ] R[ 10.006882] systemd[1]: Starting Load Kernel Modules... eached target [[ 10.013706] systemd[1]: Starting Generate network units from Kernel command line... 0;1;39mceph targ[ 10.022065] systemd[1]: TPM2 PCR Machine ID Measurement was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/StubPcrKernelImage-4a67b082-0a4c-41cf-b6c7-440b29bb8c4f). et allowin…eph[ 10.022886] systemd[1]: Starting Remount Root and Kernel File Systems... -mgr@.service in[ 10.041970] systemd[1]: Repartition Root Disk was skipped because no trigger condition checks were met. stances at once[ 10.043126] systemd[1]: Starting Coldplug All udev Devices... [0m. [ [ 10.051445] systemd[1]: Mounted Huge Pages File System. OK ] Reach[ 10.061030] systemd[1]: Mounted POSIX Message Queue File System. ed target [0;1;[ 10.068138] systemd[1]: Mounted Kernel Debug File System. 39mceph target a[ 10.074701] systemd[1]: Mounted Kernel Trace File System. llowin…eph-osd[ 10.082146] systemd[1]: Started Journal Service. @.service instances at once. [ OK ] Reached target ceph target allowin…radosgw@.service instances at once. [ OK ] Reached target ceph target allowin…-mirror@.service instances at once. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Stoppe[ 10.131691] EXT4-fs (sda1): re-mounted fa8d2923-554d-41e2-ac4a-c752ff079ceb r/w. Quota mode: none. d target Switch Root. [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. [ OK ] Reached target Local Integrity Protected Volumes. [ OK ] Reached target [ 10.166243] systemd-journald[575]: Received client request to flush runtime journal. [0;1;39mPath Units. [ OK ] Reached target Slice Units. [ OK ] Reached target Swaps. [ OK ] Reached target Local Verity Protected Volumes. [ OK ] Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Listening on udev Control Socket. [ OK ] Listening on udev Kernel Socket. Mounting Huge Pages File System... Mounting POSIX Message Queue File System... Mounting Kernel Debug File System... Mounting Kernel Trace File System... Starting Create List of Static Device Nodes... Starting Monitoring of LVM2 mirror…ing dmeventd or progress polling... Starting Load Kernel Module configfs... Starting Load Kernel Module drm... Starting Load Kernel Module fuse... Starting Read and set NIS domainname from /etc/sysconfig/network... [ OK ] Stopped Plymouth switch root service. [ OK ] Stopped Journal Service. Starting Journal Service... Starting Load Kernel Modules... Starting Generate network units from Kernel command line... Starting Remount Root and Kernel File Systems... Starting [0[ 10.341698] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 10.341719] device-mapper: uevent: version 1.0.3 ;1;39mColdplug A[ 10.341805] device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com ll udev Devices... [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Started Journal Service. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Read and set NIS domainname from /etc/sysconfig/network. [ OK ] Finished Generate network units from Kernel command line. [ OK ] Reached target Preparation for Network. [ OK ] Finished Remount Root and Kernel File Systems. Starting Flush Journal to Persistent Storage... Starting Load/Save OS Random Seed... Starting Create Static Device Nodes in /dev... [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Modules. Mounting FUSE Control File System... Mounting Kernel Configuration File System... Starting Apply Kernel Variables... [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Coldplug All udev Devices. [ OK ] Finished Load/Save OS Random Seed. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Monitoring of LVM2 mirror…using dmeventd or progress polling. [ OK ] Finished Create Static Device Nodes in /dev. Starting Rule-based Manager for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Tell Plymouth To Write Out Runtime Data... Starting Automatic Boot Loader Update... Starting Create Volatile Files and Directories... Starting Load Kernel Module configfs... Starting Load Kernel Module fuse... [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module fuse. [ 10.766584] IPMI message handler: version 39.2 [ 10.776115] ipmi device interface [ 10.806410] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 10.849426] power_meter ACPI000D:00: Found ACPI power meter. [ 10.849472] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 10.849477] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info(). [ OK ] Finished Automatic Boot Loader Upda[ 10.879183] mei_me 0000:00:16.0: Device doesn't have valid ME Interface te. [[0;3[ 10.879362] ioatdma: Intel(R) QuickData Technology Driver 5.00 2m OK ] Fi[ 10.894148] ipmi_si: IPMI System Interface driver nished [ 10.894173] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS Tell Plymouth To[ 10.894176] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 Write Out Runti[ 10.894179] ipmi_si: Adding SMBIOS-specified kcs state machine me Data. [ 10.894246] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 10.894409] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 10.894485] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 10.895383] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 10.895386] ipmi_si: Adding ACPI-specified kcs state machine [ 10.895462] i2c i2c-3: 2/8 memory slots populated (from DMI) [ 10.895522] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 10.895559] igb 0000:07:00.0: DCA enabled [ 10.895582] igb 0000:07:00.1: DCA enabled [ 10.982759] iTCO_vendor_support: vendor-support=0 [ 10.989979] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 10.989985] RAPL PMU: hw unit of domain package 2^-14 Joules [ 10.989992] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 10.991425] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 11.038856] iTCO_wdt iTCO_wdt.1.auto: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 11.042726] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) [ 11.081496] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ OK ] Started /usr/sbin/lvm vgchange -aay --autoactivation event vg_nvme. [ OK ] Finished Create Volatile Files and Directories. Mounting RPC Pipe File System... Starting Security Auditing Service... Starting RPC Bind... [ 11.237310] ipmi_si IPI0001:00: IPMI kcs interface initialized [ 11.248514] ipmi_ssif: IPMI SSIF Interface driver [ OK ] Found device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... [ 11.306982] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 11.306985] EDAC sbridge: Ver: 1.1.2 [ 11.310681] RPC: Registered named UNIX socket transport module. [ 11.310683] RPC: Registered udp transport module. [ 11.310684] RPC: Registered tcp transport module. [ 11.310684] RPC: Registered tcp-with-tls transport module. [ 11.310685] RPC: Registered tcp NFSv4.1 backchannel transport module. [ OK ] Mounted RPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ OK ] Started RPC Bind. [ 11.397153] intel_rapl_common: Found RAPL domain package [ 11.397163] intel_rapl_common: Found RAPL domain dram [ OK ] Started Security Auditing Service. Starting Record System Boot/Shutdown in UTMP... [ 11.627758] SGI XFS with ACLs, security attributes, scrub, quota, no debug enabled [ 11.636075] XFS (dm-4): Deprecated V4 format (crc=0) will not be supported beginning with RHEL10 [ 11.636176] XFS (dm-4): Mounting V4 Filesystem 386d13cc-f844-4e1c-87a9-f97feb03064d [ 11.640420] XFS (dm-4): Ending clean mount [ 11.640457] xfs filesystem being mounted at /var/lib/ceph supports timestamps until 2038 (0x7fffffff) [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Mounted /var/lib/ceph. [ OK ] Reached target System Initialization. [ OK ] Started Daily rotation of log files. [ OK ] Started Updates mlocate database every day. [ OK ] Started Run system activity accounting tool every 10 minutes. [ OK ] Started Generate summary of yesterday's process accounting. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Listening on SSSD Kerberos Cache Manager responder socket. [ OK ] Reached target Socket Units. Starting D-Bus System Message Bus... [ OK ] Started D-Bus System Message Bus. [ OK ] Reached target Basic System. Starting Network Manager... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target allowin…l ceph*@.service instances at once. Starting NTP client/server... Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started Machine Check Exception Logging Daemon. Starting Self Monitoring and Reporting Technology (SMART) Daemon... [ OK ] Reached target sshd-keygen.target. [ OK ] Reached target User and Group Name Lookups. Starting Resets System Activity Logs... Starting User Login Management... [ OK ] Finished Restore /run/initramfs on shutdown. [ OK ] Started User Login Management. [ OK ] Finished Resets System Activity Logs. [ OK ] Started Self Monitoring and Reporting Technology (SMART) Daemon. [ OK ] Started NTP client/server. Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 13.262850] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 13.419749] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Network Manager Wait Online... Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... [ 13.646063] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started Deferred execution scheduler. [ OK ] Started Command Scheduler. [ 13.834055] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 13.834181] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [* ] A start job is running for Network Manager Wait Online (6s / no limit) M [** ] A start job is running for Network Manager Wait Online (7s / no limit) M [*** ] A start job is running for Network Manager Wait Online (7s / no limit) M [ *** ] A start job is running for Network Manager Wait Online (8s / no limit) M [ *** ] A start job is running for Network Manager Wait Online (8s / no limit) M [ ***] A start job is running for Network Manager Wait Online (9s / no limit) M [ **] A start job is running for Network Manager Wait Online (9s / no limit) M [ OK ] Finished Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... [ OK ] Started Nagios Remote Plugin Executor. Starting /etc/rc.d/rc.local Compatibility... Starting Notify NFS peers of a restart... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. + myips=172.21.15.117 + attempts=1 + sleep 1 [ OK ] Started System Logging Service. [ 20.375414] block sda: the capability attribute has been deprecated. + '[' 172.21.15.117 '!=' '' ']' + set -e + '[' -n 172.21.15.117 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.117 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.117 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' Starting SETroubleshoot daemon for…ocessing new SELinux denial logs... + newhostname=smithi117.front.sepia.ceph.com + '[' -n smithi117.front.sepia.ceph.com ']' + hostname smithi117.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi117 + echo smithi117 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.117 smithi117.front.sepia.ceph.com smithi117/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... CentOS Stream 9 Kernel 5.14.0-505.el9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-09-12T22:50:41.304 DEBUG:teuthology.orchestra.console.smithi117:expect after: smithi117 login: 2024-09-12T22:50:41.358 DEBUG:teuthology.orchestra.console.smithi117:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ct                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 8F 44 63 GUID: 00000000 0000 0000 0000 0CC47AD8A88A DHCP.|                    DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| CLIENT IP: 172.21.15.117 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:8f:44:63)... Configuring (net0 0c:c4:7a:8f:44:63).... Configuring (net0 0c:c4:7a:8f:44:63)..... Configuring (net0 0c:c4:7a:8f:44:63)...... ok [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (5.14.0-505.el9.x86_64) 9  CentOS Stream (5.14.0-503.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-fbf6b6fa6cf04654a0e563f30ecbf43a) 9              The selected entry will be started automatically in 5s.   CentOS Stream (5.14.0-505.el9.x86_64) 9   CentOS Stream (5.14.0-503.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-fbf6b6fa6cf04654a0e563f30ecbf43a) 9            Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h       [ 0.000000] Linux version 5.14.0-505.el9.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc (GCC) 11.5.0 20240719 (Red Hat 11.5.0-2), GNU ld version 2.35.2-54.el9) #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 [ 0.000000] The list of certified hardware and cloud instances for Red Hat Enterprise Linux 9 can be viewed at the Red Hat Ecosystem Catalog, https://catalog.redhat.com. [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-505.el9.x86_64 root=UUID=fa8d2923-554d-41e2-ac4a-c752ff079ceb ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec1fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f74000-0x00000000798adfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ae000-0x0000000079d4afff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4b000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] APIC: Static calls initialized [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.755 MHz processor [ 0.000411] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000415] MTRR map: 5 entries (3 fixed + 2 variable; max 23), built from 10 variable MTRRs [ 0.000417] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000745] last_pfn = 0x78ec2 max_arch_pfn = 0x400000000 [ 0.006521] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.006530] Using GB pages for direct mapping [ 0.006703] RAMDISK: [mem 0x341fd000-0x360f6fff] [ 0.006705] ACPI: Early table checksum verification disabled [ 0.006707] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.006710] ACPI: XSDT 0x00000000798AE098 0000B4 (v01 01072009 AMI 00010013) [ 0.006715] ACPI: FACP 0x00000000798E15B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006719] ACPI: DSDT 0x00000000798AE1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.006721] ACPI: FACS 0x0000000079D49F80 000040 [ 0.006723] ACPI: APIC 0x00000000798E16C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006726] ACPI: FPDT 0x00000000798E1788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006728] ACPI: FIDT 0x00000000798E17D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006730] ACPI: SPMI 0x00000000798E1870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.006732] ACPI: MCFG 0x00000000798E18B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.006734] ACPI: UEFI 0x00000000798E18F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.006737] ACPI: HPET 0x00000000798E1938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006739] ACPI: WDDT 0x00000000798E1970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.006741] ACPI: SSDT 0x00000000798E19B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.006743] ACPI: SSDT 0x00000000798F8B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.006746] ACPI: SSDT 0x00000000798FB180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.006748] ACPI: PRAD 0x00000000798FB1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.006750] ACPI: DMAR 0x00000000798FB2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006752] ACPI: HEST 0x00000000798FB3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006754] ACPI: BERT 0x00000000798FB630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006757] ACPI: ERST 0x00000000798FB660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006759] ACPI: EINJ 0x00000000798FB890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006760] ACPI: Reserving FACP table memory at [mem 0x798e15b0-0x798e16bb] [ 0.006762] ACPI: Reserving DSDT table memory at [mem 0x798ae1e8-0x798e15ab] [ 0.006762] ACPI: Reserving FACS table memory at [mem 0x79d49f80-0x79d49fbf] [ 0.006763] ACPI: Reserving APIC table memory at [mem 0x798e16c0-0x798e1787] [ 0.006764] ACPI: Reserving FPDT table memory at [mem 0x798e1788-0x798e17cb] [ 0.006764] ACPI: Reserving FIDT table memory at [mem 0x798e17d0-0x798e186b] [ 0.006765] ACPI: Reserving SPMI table memory at [mem 0x798e1870-0x798e18af] [ 0.006765] ACPI: Reserving MCFG table memory at [mem 0x798e18b0-0x798e18eb] [ 0.006766] ACPI: Reserving UEFI table memory at [mem 0x798e18f0-0x798e1931] [ 0.006767] ACPI: Reserving HPET table memory at [mem 0x798e1938-0x798e196f] [ 0.006767] ACPI: Reserving WDDT table memory at [mem 0x798e1970-0x798e19af] [ 0.006768] ACPI: Reserving SSDT table memory at [mem 0x798e19b0-0x798f8b2e] [ 0.006768] ACPI: Reserving SSDT table memory at [mem 0x798f8b30-0x798fb17b] [ 0.006769] ACPI: Reserving SSDT table memory at [mem 0x798fb180-0x798fb1e3] [ 0.006769] ACPI: Reserving PRAD table memory at [mem 0x798fb1e8-0x798fb2e9] [ 0.006770] ACPI: Reserving DMAR table memory at [mem 0x798fb2f0-0x798fb3ab] [ 0.006771] ACPI: Reserving HEST table memory at [mem 0x798fb3b0-0x798fb62b] [ 0.006771] ACPI: Reserving BERT table memory at [mem 0x798fb630-0x798fb65f] [ 0.006772] ACPI: Reserving ERST table memory at [mem 0x798fb660-0x798fb88f] [ 0.006772] ACPI: Reserving EINJ table memory at [mem 0x798fb890-0x798fb9bf] [ 0.006818] No NUMA configuration found [ 0.006819] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.006827] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.006998] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32654MB) [ 0.007034] Zone ranges: [ 0.007035] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.007036] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.007037] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.007038] Device empty [ 0.007039] Movable zone start for each node [ 0.007041] Early memory node ranges [ 0.007041] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.007042] node 0: [mem 0x0000000000100000-0x0000000078ec1fff] [ 0.007043] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.007047] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.007051] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.007087] On node 0, zone DMA: 117 pages in unavailable ranges [ 0.011766] On node 0, zone Normal: 28990 pages in unavailable ranges [ 0.011877] ACPI: PM-Timer IO Port: 0x408 [ 0.011885] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.011886] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.011887] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.011887] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.011888] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.011888] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.011889] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.011890] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.011899] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.011903] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.011904] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.011906] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.011909] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.011910] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.011914] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.011919] CPU topo: Max. logical packages: 1 [ 0.011920] CPU topo: Max. logical dies: 1 [ 0.011920] CPU topo: Max. dies per package: 1 [ 0.011924] CPU topo: Max. threads per core: 2 [ 0.011925] CPU topo: Num. cores per package: 4 [ 0.011926] CPU topo: Num. threads per package: 8 [ 0.011926] CPU topo: Allowing 8 present CPUs plus 0 hotplug CPUs [ 0.011935] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.011936] PM: hibernation: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.011937] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.011938] PM: hibernation: Registered nosave memory: [mem 0x78ec2000-0x78f73fff] [ 0.011939] PM: hibernation: Registered nosave memory: [mem 0x78f74000-0x798adfff] [ 0.011939] PM: hibernation: Registered nosave memory: [mem 0x798ae000-0x79d4afff] [ 0.011940] PM: hibernation: Registered nosave memory: [mem 0x79d4b000-0x8fffffff] [ 0.011941] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.011941] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.011942] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.011942] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.011944] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.011945] Booting paravirtualized kernel on bare hardware [ 0.011947] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.016333] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.016550] percpu: Embedded 64 pages/cpu s225280 r8192 d28672 u262144 [ 0.016571] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-505.el9.x86_64 root=UUID=fa8d2923-554d-41e2-ac4a-c752ff079ceb ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.016622] Unknown kernel command line parameters "BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-505.el9.x86_64", will be passed to user space. [ 0.016638] random: crng init done [ 0.018817] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.019955] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.020058] Fallback order for Node 0: 0 [ 0.020061] Built 1 zonelists, mobility grouping on. Total pages: 8228742 [ 0.020062] Policy zone: Normal [ 0.020204] mem auto-init: stack:off, heap alloc:off, heap free:off [ 0.020212] software IO TLB: area num 8. [ 0.041192] Memory: 1751580K/33438000K available (16384K kernel code, 5657K rwdata, 12972K rodata, 3980K init, 5696K bss, 989844K reserved, 0K cma-reserved) [ 0.041294] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.041302] Kernel/User page tables isolation: enabled [ 0.041326] ftrace: allocating 48134 entries in 189 pages [ 0.048150] ftrace: allocated 189 pages with 6 groups [ 0.048671] Dynamic Preempt: voluntary [ 0.048713] rcu: Preemptible hierarchical RCU implementation. [ 0.048714] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.048715] Trampoline variant of Tasks RCU enabled. [ 0.048715] Rude variant of Tasks RCU enabled. [ 0.048716] Tracing variant of Tasks RCU enabled. [ 0.048716] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.048717] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.052189] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.052351] rcu: srcu_init: Setting srcu_struct sizes based on contention. [ 0.052457] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) [ 0.057700] Console: colour VGA+ 80x25 [ 0.057717] printk: console [ttyS1] enabled [ 1.112629] ACPI: Core revision 20230331 [ 1.116719] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.125850] APIC: Switch to symmetric I/O mode setup [ 1.130821] DMAR: Host address width 46 [ 1.134662] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.139979] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.147975] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 1.154242] DMAR: ATSR flags: 0x0 [ 1.157561] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.163829] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.170180] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.176533] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.181934] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.181935] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.196951] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.202252] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.208473] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.218856] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x327269b62a1, max_idle_ns: 440795362218 ns [ 1.229368] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.51 BogoMIPS (lpj=3499755) [ 1.230387] CPU0: Thermal monitoring enabled (TM1) [ 1.231422] process: using mwait in idle threads [ 1.232369] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.233367] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.234369] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.235368] Spectre V2 : Mitigation: Retpolines [ 1.236367] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.237367] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.238368] Speculative Store Bypass: Vulnerable [ 1.239372] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.240367] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.241367] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.242370] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.243367] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.244367] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.245368] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.246367] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.258939] Freeing SMP alternatives memory: 40K [ 1.259368] pid_max: default: 32768 minimum: 301 [ 1.260385] LSM: initializing lsm=lockdown,capability,yama,integrity,selinux,bpf [ 1.261372] Yama: becoming mindful. [ 1.262373] SELinux: Initializing. [ 1.263384] LSM support for eBPF active [ 1.264425] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.265405] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.369330] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.370470] RCU Tasks: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 1.371380] RCU Tasks Rude: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 1.372377] RCU Tasks Trace: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 1.373376] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.374368] ... version: 3 [ 1.375367] ... bit width: 48 [ 1.376367] ... generic registers: 4 [ 1.377367] ... value mask: 0000ffffffffffff [ 1.378367] ... max period: 00007fffffffffff [ 1.379367] ... fixed-purpose events: 3 [ 1.380367] ... event mask: 000000070000000f [ 1.381451] signal: max sigframe size: 1776 [ 1.382378] Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.383393] rcu: Hierarchical SRCU implementation. [ 1.383394] rcu: Max phase no-delay instances is 400. [ 1.386848] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.387434] smp: Bringing up secondary CPUs ... [ 1.388433] smpboot: x86: Booting SMP configuration: [ 1.388435] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 [ 1.391621] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.391621] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.391621] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.395412] smp: Brought up 1 node, 8 CPUs [ 1.395412] smpboot: Total of 8 processors activated (55996.08 BogoMIPS) [ 1.436386] node 0 deferred pages initialised in 38ms [ 1.438403] devtmpfs: initialized [ 1.438403] x86/mm: Memory block size: 128MB [ 1.439366] ACPI: PM: Registering ACPI NVS region [mem 0x798ae000-0x79d4afff] (4837376 bytes) [ 1.439366] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 1.439366] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.439366] pinctrl core: initialized pinctrl subsystem [ 1.444366] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.444368] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.444368] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.444368] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.444368] audit: initializing netlink subsys (disabled) [ 1.444379] audit: type=2000 audit(1726181413.235:1): state=initialized audit_enabled=0 res=1 [ 1.444437] thermal_sys: Registered thermal governor 'fair_share' [ 1.444438] thermal_sys: Registered thermal governor 'step_wise' [ 1.444438] thermal_sys: Registered thermal governor 'user_space' [ 1.445367] cpuidle: using governor menu [ 1.446386] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.446388] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.446444] PCI: ECAM [mem 0x80000000-0x8fffffff] (base 0x80000000) for domain 0000 [bus 00-ff] [ 1.446448] PCI: ECAM [mem 0x80000000-0x8fffffff] reserved as E820 entry [ 1.446457] PCI: Using configuration type 1 for base access [ 1.450395] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.450399] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages [ 1.450399] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page [ 1.450399] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages [ 1.450399] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page [ 1.451396] cryptd: max_cpu_qlen set to 1000 [ 1.451434] ACPI: Added _OSI(Module Device) [ 1.451435] ACPI: Added _OSI(Processor Device) [ 1.451436] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.451437] ACPI: Added _OSI(Processor Aggregator Device) [ 1.451437] ACPI: Added _OSI(Linux-Dell-Video) [ 1.451438] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.451438] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.455384] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.456366] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.456367] ACPI: Dynamic OEM Table Load: [ 1.475701] ACPI: _OSC evaluated successfully for all CPUs [ 1.475962] ACPI: Interpreter enabled [ 1.475971] ACPI: PM: (supports S0 S4 S5) [ 1.475972] ACPI: Using IOAPIC for interrupt routing [ 1.477476] HEST: Enabling Firmware First mode for corrected errors. [ 1.508123] HEST: Table parsing has been initialized. [ 1.508238] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.508241] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.508241] PCI: Using E820 reservations for host bridge windows [ 1.508679] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.530101] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.530106] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.531218] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.531749] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.531750] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.531779] PCI host bridge to bus 0000:ff [ 1.531780] pci_bus 0000:ff: root bus resource [bus ff] [ 1.531790] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 conventional PCI endpoint [ 1.531835] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 conventional PCI endpoint [ 1.531866] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 conventional PCI endpoint [ 1.531896] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 conventional PCI endpoint [ 1.531927] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 conventional PCI endpoint [ 1.531957] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 conventional PCI endpoint [ 1.531986] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 conventional PCI endpoint [ 1.532015] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 conventional PCI endpoint [ 1.532046] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 conventional PCI endpoint [ 1.532075] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 conventional PCI endpoint [ 1.532105] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 conventional PCI endpoint [ 1.532134] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 conventional PCI endpoint [ 1.532164] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 conventional PCI endpoint [ 1.532194] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 conventional PCI endpoint [ 1.532223] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 conventional PCI endpoint [ 1.532254] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 conventional PCI endpoint [ 1.532283] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 conventional PCI endpoint [ 1.532312] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 conventional PCI endpoint [ 1.532341] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 conventional PCI endpoint [ 1.532363] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 conventional PCI endpoint [ 1.532402] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.532464] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.532523] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.532583] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.532645] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.532705] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.532769] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 conventional PCI endpoint [ 1.532802] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 conventional PCI endpoint [ 1.532835] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.532877] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.532919] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.532961] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.533002] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 conventional PCI endpoint [ 1.533033] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 conventional PCI endpoint [ 1.533064] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 conventional PCI endpoint [ 1.533096] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 conventional PCI endpoint [ 1.533129] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.533172] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.533214] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.533257] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.533300] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 conventional PCI endpoint [ 1.533335] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 conventional PCI endpoint [ 1.533368] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 conventional PCI endpoint [ 1.533400] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 conventional PCI endpoint [ 1.533435] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 conventional PCI endpoint [ 1.533466] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 conventional PCI endpoint [ 1.533497] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 conventional PCI endpoint [ 1.533529] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 conventional PCI endpoint [ 1.533563] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 conventional PCI endpoint [ 1.533594] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 conventional PCI endpoint [ 1.533624] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 conventional PCI endpoint [ 1.533655] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 conventional PCI endpoint [ 1.533678] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 conventional PCI endpoint [ 1.533710] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 conventional PCI endpoint [ 1.533741] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 conventional PCI endpoint [ 1.535981] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 1.535984] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.536115] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.536357] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.536358] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.536767] PCI host bridge to bus 0000:00 [ 1.536769] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 1.536771] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 1.536772] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 1.536774] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 1.536775] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 1.536775] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 1.536776] pci_bus 0000:00: root bus resource [bus 00-fe] [ 1.536795] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 PCIe Root Port [ 1.536900] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 PCIe Root Port [ 1.536912] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.536949] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.537042] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 PCIe Root Port [ 1.537054] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.537056] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.537091] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.537181] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 PCIe Root Port [ 1.537192] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.537194] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.537196] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.537200] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.537231] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.537317] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.537325] pci 0000:00:04.0: BAR 0 [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.537405] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.537412] pci 0000:00:04.1: BAR 0 [mem 0xfb428000-0xfb42bfff 64bit] [ 1.537488] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.537496] pci 0000:00:04.2: BAR 0 [mem 0xfb424000-0xfb427fff 64bit] [ 1.537571] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.537578] pci 0000:00:04.3: BAR 0 [mem 0xfb420000-0xfb423fff 64bit] [ 1.537658] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.537666] pci 0000:00:04.4: BAR 0 [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.537739] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.537747] pci 0000:00:04.5: BAR 0 [mem 0xfb418000-0xfb41bfff 64bit] [ 1.537823] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.537831] pci 0000:00:04.6: BAR 0 [mem 0xfb414000-0xfb417fff 64bit] [ 1.537905] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.537913] pci 0000:00:04.7: BAR 0 [mem 0xfb410000-0xfb413fff 64bit] [ 1.537986] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.538048] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.538134] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.538190] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 PCIe Root Complex Integrated Endpoint [ 1.538196] p 0000:00:05.4: BAR 0 [mem 0xfb439000-0xfb439fff] [ 1.538275] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 PCIe Root Complex Integrated Endpoint [ 1.538516] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 conventional PCI endpoint [ 1.538536] pci 0000:00:11.4: BAR 0 [io 0xf110-0xf117] [ 1.538546] pci 0000:00:11.4: BAR 1 [io 0xf100-0xf103] [ 1.538557] pci 0000:00:11.4: BAR 2 [io 0xf0f0-0xf0f7] [ 1.538568] pci 0000:00:11.4: BAR 3 [io 0xf0e0-0xf0e3] [ 1.538579] pci 0000:00:11.4: BAR 4 [io 0xf020-0xf03f] [ 1.538590] pci 0000:00:11.4: BAR 5 [mem 0xfb438000-0xfb4387ff] [ 1.538648] pci 0000:00:11.4: PME# supported from D3hot [ 1.538728] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 conventional PCI endpoint [ 1.538753] pci 0000:00:14.0: BAR 0 [mem 0xfb400000-0xfb40ffff 64bit] [ 1.538840] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.538929] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 conventional PCI endpoint [ 1.538953] pci 0000:00:16.0: BAR 0 [mem 0xfb437000-0xfb43700f 64bit] [ 1.539041] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.539107] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 conventional PCI endpoint [ 1.539131] pci 0000:00:16.1: BAR 0 [mem 0xfb436000-0xfb43600f 64bit] [ 1.539219] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.539304] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 conventional PCI endpoint [ 1.539325] pci 0000:00:1a.0: BAR 0 [mem 0xfb434000-0xfb4343ff] [ 1.539443] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.539525] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 PCIe Root Port [ 1.539562] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.539654] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.539756] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 PCIe Root Port [ 1.539794] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.539798] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.539801] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.539889] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.539990] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 PCIe Root Port [ 1.540026] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.540031] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.540035] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.540123] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.540231] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 conventional PCI endpoint [ 1.540251] pci 0000:00:1d.0: BAR 0 [mem 0xfb433000-0xfb4333ff] [ 1.540368] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.540453] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 conventional PCI endpoint [ 1.540657] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 conventional PCI endpoint [ 1.540675] pci 0000:00:1f.2: BAR 0 [io 0xf070-0xf077] [ 1.540685] pci 0000:00:1f.2: BAR 1 [io 0xf060-0xf063] [ 1.540696] pci 0000:00:1f.2: BAR 2 [io 0xf050-0xf057] [ 1.540706] pci 0000:00:1f.2: BAR 3 [io 0xf040-0xf043] [ 1.540717] pci 0000:00:1f.2: BAR 4 [io 0xf000-0xf01f] [ 1.540728] pci 0000:00:1f.2: BAR 5 [mem 0xfb432000-0xfb4327ff] [ 1.540781] pci 0000:00:1f.2: PME# supported from D3hot [ 1.540843] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 conventional PCI endpoint [ 1.540866] pci 0000:00:1f.3: BAR 0 [mem 0xfb431000-0xfb4310ff 64bit] [ 1.540895] pci 0000:00:1f.3: BAR 4 [io 0x0580-0x059f] [ 1.541058] acpiphp: Slot [1] registered [ 1.541069] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.541173] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 PCIe Endpoint [ 1.541182] pci 0000:02:00.0: BAR 0 [mem 0xfb310000-0xfb313fff 64bit] [ 1.541199] pci 0000:02:00.0: ROM [mem 0xfb300000-0xfb30ffff pref] [ 1.541203] pci 0000:02:00.0: enabling Extended Tags [ 1.541308] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.541417] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.541428] pci 0000:03:00.0: BAR 0 [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.541432] pci 0000:03:00.0: BAR 2 [io 0xe020-0xe03f] [ 1.541442] pci 0000:03:00.0: BAR 4 [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.541447] pci 0000:03:00.0: ROM [mem 0xfb280000-0xfb2fffff pref] [ 1.541484] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.541501] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.541502] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 V0.0: VF BAR 3 [mf] [ 1.541512] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.541665] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.541675] pci 0000:03:00.1: BAR 0 [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.541680] pci 0000:03:00.1: BAR 2 [io 0xe000-0xe01f] [ 1.541690] pci 0000:03:00.1: BAR 4 [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.541694] pci 0000:03:00.1: ROM [mem 0xfb200000-0xfb27ffff pref] [ 1.541732] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.541745] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.541746] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.541755] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.541756] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0xtains BAR 3 for 00:00:03.0: PCI pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.542034] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 PCIe to PCI/PCI-X bridge [ 1.542106] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.542119] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.542124] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.542178] pci 0000:05:00.0: enabling Extended Tags [ 1.542302] pci 0000:05:00.0: supports D1 D2 [ 1.542303] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.542441] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.542528] pci_bus 0000:06: extended config space not accessible [ 1.542562] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 conventional PCI endpoint [ 1.542598] pci 0000:06:00.0: BAR 0 [mem 0xfa000000-0xfaffffff] [ 1.542618] pci 0000:06:00.0: BAR 1 [mem 0xfb000000-0xfb01ffff] [ 1.542636] pci 0000:06:00.0: BAR 2 [io 0xd000-0xd07f] [ 1.542735] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 1.542805] pci 0000:06:00.0: supports D1 D2 [ 1.542806] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.542963] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.541521] type 00 class 0x020000 PCIe Endpoint [ 1.543145] pci 0000:07:00.0: BAR 0 [mem 0xfb120000-0xfb13ffff] [ 1.543181] pci 0000:07:00.0: BAR 2 [io 0xc020-0xc03f] [ 1.543199] pci 0000:07:00.0: BAR 3 [mem 0xfb144000-0xfb147fff] [ 1.543436] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.543496] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.543497] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.543533] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.543534] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.543878] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.543912] pci 0000:07:00.1: BAR 0 [mem 0xfb100000-0xfb11ffff] [ 1.543948] 07:00.1: BAR 2 [io 0xc000-0xc01f] [ 1.543966] pci 0000:07:00.1: BAR 3 [mem 0xfb140000-0xfb143fff] [ 1.544196] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.544255] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.544256] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.544289] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.544290] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.544596] pci 0000:00:1c.bridge to [bus 07] [ 1.544608] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.545282] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.545314] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.545344] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.545375] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.545405] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.545405] ACPI: PCI: Interrupt link LNKE disabled [ 1.545435] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.545435] ACPI: PCI: Interrupt link LNKF disabled [ 1.545463] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.545464] ACPI: PCI: Interrupt link LNKG disabled [ 1.545493] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.545494] ACPI: PCI: Interrupt link LNKH disabled [ 1.546381] iommu: Default domain type: Translated [ 1.546381] iommu: DMA domain TLB invalidation policy: lazy mode [ 1.546435] SCSI subsystem initialized [ 1.546451] ACPI: bus type USB registered [ 1.546465] usbcore: registered new interface driver usbfs [ 1.546472] usbcore: registered new interface driver hub [ 1.546477] usbcore: registered new device driver usb [ 1.546497] pps_core: LinuxPPS API ver. 1 registered [ 1.546498] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 1.546499] PTP clock support registered [ 1.546513] EDAC MC: Ver: 3.0.0 [ 1.546522] NetLabel: Initializing [ 1.546523] NetLabel: domain hash size = 128 [ 1.546523] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 1.546537] NetLabel: unlabeled traffic allowed by default [ 1.546537] PCI: Using ACPI for IRQ routing [ 1.557404] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 1.557404] pci 0000:06:00.0: vgaarb: bridge control possible [ 1.557404] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 1.557404] vgaarb: loaded [ 1.557404] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 1.557404] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 1.564199] clocksource: Switched to clocksource tsc-early [ 1.572427] VFS: Disk quotas dquot_6.6.0 [ 1.572440] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.572502] pnp: PnP ACPI init [ 1.572936] system 00:01: [io 0x0500-0x057f] has been reserved [ 1.572939] system 00:01: [io 0x0400-0x047f] has been reserved [ 1.572941] system 00:01: [io 0x0580-0x059f] has been reserved [ 1.572943] system 00:01: [io 0x0600-0x061f] has been reserved [ 1.572945] system 00:01: [io 0x0880-0x0883] has been reserved [ 1.572946] system 00:01: [io 0x0800-0x081f] has been reserved [ 1.572948] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 1.572950] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 1.572952] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 1.572953] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 1.572955] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 1.572957] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 1.572958] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 1.573165] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 1.573167] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 1.573169] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 1.573170] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 1.573172] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 1.574119] pnp: PnP ACPI: found 5 devices [ 1.579803] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.579855] NET: Registered PF_INET protocol family [ 1.580022] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.582280] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 1.582309] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 1.582314] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.582531] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 1.582636] TCP: Hash tables configured (established 262144 bind 65536) [ 1.582748] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 1.582830] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.582887] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.582964] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 1.582968] NET: Registered PF_XDP protocol family [ 1.582991] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 1.583001] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref]: assigned [ 1.583003] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.583008] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.583010] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.583016] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.583017] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.583019] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.583019] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.583021] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.583022] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.583023] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.583024] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.583025] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.583026] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.583027] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.583028] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.583029] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.583030] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.583031] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.583032] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.583033] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.583035] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.583037] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.583038] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.583041] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.583054] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.583056] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.583064] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.583080] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.583082] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.583087] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.583097] pci 0000:07:00.0: VF BAR 0 [mem 0x90000000-0x9001ffff 64bit pref]: assigned [ 1.583106] pci 0000:07:00.0: VF BAR 3 [mem 0x90020000-0x9003ffff 64bit pref]: assigned [ 1.583112] pci 0000:07:00.1: VF BAR 0 [mem 0x90040000-0x9005ffff 64bit pref]: assigned [ 1.583118] pci 0000:07:00.1: VF BAR 3 [mem 0x90060000-0x9007ffff 64bit pref]: assigned [ 1.583124] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.583126] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.583131] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.583135] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 1.583141] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 1.583141] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.583143] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 1.583143] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.583144] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 1.583145] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 1.583146] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 1.583147] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 1.583148] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 1.583149] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 1.583149] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.583151] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 1.583151] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.583152] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 1.583153] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.583154] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 1.583155] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 1.583156] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 1.583313] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 1.600032] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x140 took 16166 usecs [ 1.617031] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x140 took 16585 usecs [ 1.617045] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 1.617079] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 1.617080] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 1.617086] ACPI: bus type thunderbolt registered [ 1.617087] Trying to unpack rootfs image as initramfs... [ 1.715620] Initialise system trusted keyrings [ 1.715632] Key type blacklist registered [ 1.715679] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 1.715692] zbud: loaded [ 1.861764] integrity: Platform Keyring initialized [ 1.861771] integrity: Machine keyring initialized [ 1.869844] NET: Registered PF_ALG protocol family [ 1.869848] xor: automatically using best checksumming function avx [ 1.869850] Key type asymmetric registered [ 1.869851] Asymmetric key parser 'x509' registered [ 1.869852] Running certificate verification selftests [ 1.880212] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 1.880683] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246) [ 1.880715] io scheduler mq-deadline registered [ 1.880717] io scheduler kyber registered [ 1.880727] io scheduler bfq registered [ 1.940211] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 1.940625] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 1.940825] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 1.941010] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 1.941167] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 1.941349] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 1.941513] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 1.941695] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 1.949468] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 1.968406] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 1.968429] ACPI: button: Power Button [PWRB] [ 1.968451] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 1.988935] Freeing initrd memory: 31720K [ 2.002156] ACPI: button: Power Button [PWRF] [ 2.036168] ERST: Error Record Serialization Table (ERST) support is initialized. [ 2.036170] pstore: Registered erst as persistent store backend [ 2.036298] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 2.036401] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 2.043398] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 2.052045] Non-volatile memory driver v1.3 [ 2.165886] rdac: device handler registered [ 2.165913] hp_sw: device handler registered [ 2.165914] emc: device handler registered [ 2.165931] alua: device handler registered [ 2.166215] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 2.166252] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 2.166266] ehci-pci 0000:00:1a.0: debug port 2 [ 2.170190] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 2.177020] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 2.177052] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.177054] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.177056] usb usb1: Product: EHCI Host Controller [ 2.177056] usb usb1: Manufacturer: Linux 5.14.0-505.el9.x86_64 ehci_hcd [ 2.177057] usb usb1: SerialNumber: 0000:00:1a.0 [ 2.177146] hub 1-0:1.0: USB hub found [ 2.177150] hub 1-0:1.0: 2 ports detected [ 2.177257] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 2.177295] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 2.178380] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 2.178626] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 2.178626] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 2.178658] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 2.178660] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 2.178662] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 4 [ 2.178677] ehci-pci 0000:00:1d.0: debug port 2 [ 2.178689] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.178691] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.178692] usb usb2: Product: xHCI Host Controller [ 2.178692] usb usb2: Manufacturer: Linux 5.14.0-505.el9.x86_64 xhci-hcd [ 2.178693] usb usb2: SerialNumber: 0000:00:14.0 [ 2.178784] hub 2-0:1.0: USB hub found [ 2.178815] hub 2-0:1.0: 15 ports detected [ 2.181247] usb usb3: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.14 [ 2.181249] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.181251] usb usb3: Product: xHCI Host Controller [ 2.181251] usb usb3: Manufacturer: Linux 5.14.0-505.el9.x86_64 xhci-hcd [ 2.181252] usb usb3: SerialNumber: 0000:00:14.0 [ 2.181316] hub 3-0:1.0: USB hub found [ 2.181334] hub 3-0:1.0: 6 ports detected [ 2.182594] usbcore: registered new interface driver usbserial_generic [ 2.182598] usbserial: USB Serial support registered for generic [ 2.182601] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 2.182626] i8042: PNP: No PS/2 controller found. [ 2.182652] mousedev: PS/2 mouse device common for all mice [ 2.182711] rtc_cmos 00:00: RTC can wake from S4 [ 2.182984] rtc_cmos 00:00: registered as rtc0 [ 2.183034] rtc_cmos 00:00: setting system clock to 2024-09-12T22:50:16 UTC (1726181416) [ 2.183059] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 2.189022] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 2.189053] usb usb4: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.189055] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.189056] usb usb4: Product: EHCI Host Controller [ 2.189057] usb usb4: Manufacturer: Linux 5.14.0-505.el9.x86_64 ehci_hcd [ 2.189058] usb usb4: SerialNumber: 0000:00:1d.0 [ 2.189136] hub 4-0:1.0: USB hub found [ 2.189139] hub 4-0:1.0: 2 ports detected [ 2.193588] intel_pstate: Intel P-state driver initializing [ 2.263636] hid: raw HID events driver (C) Jiri Kosina [ 2.263679] usbcore: registered new interface driver usbhid [ 2.263680] usbhid: USB HID core driver [ 2.263712] drop_monitor: Initializing network drop monitor service [ 2.274560] Initializing XFRM netlink socket [ 2.274581] NET: Registered PF_INET6 protocol family [ 2.279442] Segment Routing with IPv6 [ 2.279459] NET: Registered PF_PACKET protocol family [ 2.279481] mpls_gso: MPLS GSO support [ 2.324093] microcode: Current revision: 0x0b000010 [ 2.346267] resctrl: L3 allocation detected [ 2.346268] resctrl: L3 monitoring detected [ 2.346281] IPI shorthand broadcast: enabled [ 2.346285] AVX2 version of gcm_enc/dec engaged. [ 2.409192] AES CTR mode by8 optimization enabled [ 2.409348] sched_clock: Marking stable (1252000616, 1156988106)->(2894036590, -485047868) [ 2.419031] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 2.427890] registered taskstats version 1 [ 2.442994] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 2.443035] usb 4-1: new high-speed USB device number 2 using ehci-pci [ 2.446609] Loading compiled-in X.509 certificates [ 2.447195] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: d7d2edb13bc4136035087569dd0b474add53ff98' [ 2.447547] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 2.447873] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 2.448064] Loaded X.509 cert 'RH-IMA-CA: Red Hat IMA CA: fb31825dd0e073685b264e3038963673f753959a' [ 2.448076] Loaded X.509 cert 'Nvidia GPU OOT signing 001: 55e1cef88193e60419f0b0ec379c49f77545acf0' [ 2.450543] page_owner is disabled [ 2.450777] pstore: Using crash dump compression: deflate [ 2.450788] Key type big_key registered [ 2.555383] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 2.555386] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.555659] hub 1-1:1.0: USB hub found [ 2.555756] hub 1-1:1.0: 6 ports detected [ 2.565286] Key type encrypted registered [ 2.565293] ima: No TPM chip found, activating TPM-bypass! [ 2.565299] Loading compiled-in module X.509 certificates [ 2.565584] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: d7d2edb13bc4136035087569dd0b474add53ff98' [ 2.565586] ima: Allocated hash algorithm: sha256 [ 2.565594] ima: No architecture policies found [ 2.565602] evm: Initialising EVM extended attributes: [ 2.565602] evm: security.selinux [ 2.565603] evm: security.SMACK64 (disabled) [ 2.565603] evm: security.SMACK64EXEC (disabled) [ 2.565604] evm: security.SMACK64TRANSMUTE (disabled) [ 2.565604] evm: security.SMACK64MMAP (disabled) [ 2.565605] evm: security.apparmor (disabled) [ 2.565605] evm: security.ima [ 2.565605] evm: security.capability [ 2.565606] evm: HMAC attrs: 0x1 [ 2.574384] usb 4-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 2.574388] usb 4-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.574556] hub 4-1:1.0: USB hub found [ 2.574632] hub 4-1:1.0: 8 ports detected [ 2.596958] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 2.596961] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.620668] hub 2-12:1.0: USB hub found [ 2.626644] hub 2-12:1.0: 4 ports detected [ 2.649025] tsc: Refined TSC clocksource calibration: 3499.992 MHz [ 2.649029] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x327349661d8, max_idle_ns: 440795222604 ns [ 2.651810] clocksource: Switched to clocksource tsc [ 2.941017] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd [ 3.077412] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 3.077415] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 3.135716] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ 3.187134] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 3.197461] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 3.197541] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 5.049245] clk: Disabling unused clocks [ 5.054053] Freeing unused decrypted memory: 2028K [ 5.059295] Freeing unused kernel image (initmem) memory: 3980K [ 5.059345] Write protecting the kernel read-only data: 30720k [ 5.071330] Freeing unused kernel image (rodata/data gap) memory: 1364K [ 5.115655] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.115657] x86/mm: Checking user space page tables [ 5.152228] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.152253] Run /init as init process [ 5.165050] systemd[1]: systemd 252-45.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 5.165152] systemd[1]: Detected architecture x86-64. [ 5.165154] systemd[1]: Running in initrd. Welcome to CentOS Stream 9 dracut-057-70.git20240819.el9 (Initramfs)! [ 5.216114] systemd[1]: Hostname set to . [ 5.274120] systemd[1]: Queued start job for default target Initrd Default Target. [ 5.274237] systemd[1]: Reached target Initrd /usr File System. [ OK ] Reached target Initrd /usr File System. [ 5.296113] systemd[1]: Reached target Local File Systems. [ OK ] Reached target Local File Systems. [ 5.310137] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ 5.322067] systemd[1]: Reached target Swaps. [ OK ] Reached target Swaps. [ 5.333130] systemd[1]: Reached target Timer Units. [ OK ] Reached target Timer Units. [ 5.345115] systemd[1]: Listening on D-Bus System Message Bus Socket. [ OK ] Listening on D-Bus System Message Bus Socket. [ 5.360183] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 5.374327] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 5.386152] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 5.400265] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 5.414121] systemd[1]: Reached target Socket Units. [ OK ] Reached target Socket Units. [ 5.432680] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 5.448158] systemd[1]: Starting Journal Service... Starting Journal Service... [ 5.460723] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 5.473658] systemd[1]: Starting Create System Users... Starting Creat[ 5.480279] fuse: init (API version 7.36) e System Users... [ 5.489647] systemd[1]: Starting Setup Virtual Console... Starting Setup Virtual Console... [ 5.502730] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Modules. Starting Apply Kernel Variables... [ OK ] Finished Setup Virtual Console. [ OK ] Finished Apply Kernel Variables. Starting dracut cmdline hook... [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... Starting Create Volatile Files and Directories... [ OK ] Finished dracut cmdline hook. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Finished Create Volatile Files and Directories. Starting dracut pre-udev hook... [ OK ] Finished dracut pre-udev hook. Starting Rule-based Manager for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. Starting Coldplug All udev Devices... [ OK ] Finished Coldplug All udev Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Network. Starting dracu[ 5.867185] dca service started, version 1.12.1 t initqueue hook... Starting Show Plymouth Boot Screen... [ OK ] Started Show Plymouth Boot Screen. [ OK ] Started Forward Password Requests to Plymouth[ 5.910469] igb: Intel(R) Gigabit Ethernet Network Driver [ 5.910474] igb: Copyright (c) 2007-2014 Intel Corporation. Directory Watch. [ OK ] Reached target Path Units. [ [ 5.929292] ahci 0000:00:11.4: AHCI vers 0001.0300, 32 command slots, 6 Gbps, SATA mode OK ] Reache[ 5.929298] ahci 0000:00:11.4: 4/4 ports implemented (port mask 0xf) [ 5.929300] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst d target [0;1;3[ 5.940026] scsi host0: ahci [ 5.940176] scsi host1: ahci [ 5.944705] scsi host2: ahci 9mBasic System[[ 5.944823] scsi host3: ahci [ 5.944898] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 50 lpm-pol 0 [ 5.944901] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 50 lpm-pol 0 [ 5.944903] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 50 lpm-pol 0 0m. [ 5.944905] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 50 lpm-pol 0 [ 5.945240] ahci 0000:00:1f.2: AHCI vers 0001.0300, 32 command slots, 6 Gbps, SATA mode [ 5.945244] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) [ 5.945246] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.960413] scsi host4: ahci [ 5.960528] scsi host5: ahci [ 5.960675] scsi host6: ahci [ 5.960786] scsi host7: ahci [ 5.960928] scsi host8: ahci [ 5.961043] scsi host9: ahci [ 5.961093] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 51 lpm-pol 0 [ 5.961096] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 51 lpm-pol 0 [ 5.961098] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 51 lpm-pol 0 [ 5.961100] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 51 lpm-pol 0 [ 5.961103] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 51 lpm-pol 0 [ 5.961106] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 51 lpm-pol 0 [ 5.974324] igb 0000:07:00.0: added PHC on eth0 [ 5.974351] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.974352] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:a8:8a [ 5.974429] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.974429] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.035473] igb 0000:07:00.1: added PHC on eth1 [ 6.035518] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 6.035519] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:a8:8b [ 6.035603] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 6.035604] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.066286] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 6.066288] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 6.165587] nvme nvme0: pci function 0000:02:00.0 [ 6.167574] nvme nvme0: 8/0/0 default/read/poll queues [ 6.175440] ACPI: bus type drm_connector registered [ 6.254711] ata4: SATA link down (SStatus 0 SControl 300) [ 6.254751] ata3: SATA link down (SStatus 0 SControl 300) [ 6.260153] ata1: SATA link down (SStatus 0 SControl 300) [ 6.262710] ata2: SATA link down (SStatus 0 SControl 300) [ 6.270060] ata7: SATA link down (SStatus 0 SControl 300) [ 6.270108] ata6: SATA link down (SStatus 0 SControl 300) [ 6.270131] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.270261] ata8: SATA link down (SStatus 0 SControl 300) [ 6.270283] ata10: SATA link down (SStatus 0 SControl 300) [ 6.270307] ata9: SATA link down (SStatus 0 SControl 300) [ 6.271138] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 6.271641] ata5.00: NCQ Send/Recv Log not supported [ 6.271643] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.273073] ata5.00: NCQ Send/Recv Log not supported [ 6.273077] ata5.00: configured for UDMA/133 [ 6.273188] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 6.295077] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.350462] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.362779] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.369459] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.369476] sd 4:0:0:0: [sda] Write Protect is off [ 6.369494] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.369515] sd 4:0:0:0: [sda] Preferred minimum I/O size 512 bytes [ 6.385116] sda: sda1 [ 6.385179] sd 4:0:0:0: [sda] Attached SCSI removable disk [ 6.405099] ast 0000:06:00.0: vgaarb: deactivate vga console [ 6.414047] Console: switching to colour dummy device 80x25 [ 6.414186] ast 0000:06:00.0: Using P2A bridge for configuration [ 6.414189] ast 0000:06:00.0: AST 2400 detected [ 6.414238] ast 0000:06:00.0: [drm] Using analog VGA [ 6.414248] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 6.414405] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 6.420124] fbcon: astdrmfb (fb0) is primary device [ 6.450170] Console: switching to colour frame buffer device 128x48 [ 6.467339] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 7.206361] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.206653] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.206735] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 7.206736] ixgbe 0000:03:00.0: 0c:c4:7a:8f:44:62 [ 7.209796] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.366279] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.366568] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.366650] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.366652] ixgbe 0000:03:00.1: 0c:c4:7a:8f:44:63 [ 7.369649] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.385624] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 7.409240] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ OK ] Finished dracut initqueue hook. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting File System Check on /dev…2923-554d-41e2-ac4a-c752ff079ceb... [ OK ] Finished File System Check on /dev…8d2923-554d-41e2-ac4a-c752ff079ceb. Mounting /sysroot... [ 7.651850] EXT4-fs (sda1): mounted filesystem fa8d2923-554d-41e2-ac4a-c752ff079ceb ro with ordered data mode. Quota mode: none. [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Mountpoints Configured in the Real Root... [ OK ] Finished Mountpoints Configured in the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Finished dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Network. [ OK ] Stopped target Timer Units. [ OK ] Closed D-Bus System Message Bus Socket. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Initrd /usr File System. [ OK ] Stopped target Path Units. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Preparation for Remote File Systems. [ OK ] Stopped target Slice Units. [ OK ] Stopped target Socket Units. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swaps. [ OK ] Stopped dracut initqueue hook. Starting Plymouth switch root service... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Load Kernel Modules. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped Coldplug All udev Devices. Stopping Rule-based Manager for Device Events and Files... [ OK ] Stopped Rule-based Manager for Device Events and Files. [ OK ] Finished Cleaning Up and Shutting Down Daemons. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. Starting Cleanup udev Database... [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create List of Static Device Nodes. [ OK ] Stopped Create System Users. [ OK ] Finished Clean[ 7.965828] systemd-journald[280]: Received SIGTERM from PID 1 (systemd). up udev Database. [ OK ] Reached target Switch Root. [ OK ] Finished Plymouth switch root service. Starting Switch Root... [ 8.526730] SELinux: policy capability network_peer_controls=1 [ 8.526737] SELinux: policy capability open_perms=1 [ 8.526738] SELinux: policy capability extended_socket_class=1 [ 8.526739] SELinux: policy capability always_check_network=0 [ 8.526740] SELinux: policy capability cgroup_seclabel=1 [ 8.526740] SELinux: policy capability nnp_nosuid_transition=1 [ 8.526741] SELinux: policy capability genfs_seclabel_symlinks=1 [ 8.568737] audit: type=1403 audit(1726181422.884:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 8.579129] systemd[1]: Successfully loaded SELinux policy in 115.033ms. [ 8.645046] systemd[1]: Relabelled /dev, /dev/shm, /run, /sys/fs/cgroup in 27.501ms. [ 8.658903] systemd[1]: systemd 252-45.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 8.659050] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 9! [ 9.591148] systemd[1]: initrd-switch-root.service: Deactivated successfully. [ 9.591306] systemd[1]: Stopped Switch Root. [ 9.598590] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 9.598879] systemd[1]: Created slice Slice /system/getty. [ 9.602881] systemd[1]: Created slice Slice /system/modprobe. [ 9.611731] systemd[1]: Created slice Slice /system/serial-getty. [ OK [[ 9.629018] systemd[1]: Created slice Slice /system/sshd-keygen. 0m] Stopped [0;[ 9.636450] systemd[1]: Created slice User and Session Slice. 1;39mSwitch Root[ 9.643347] systemd[1]: Dispatch Password Requests to Console Directory Watch was skipped because of an unmet condition check (ConditionPathExists=!/run/plymouth/pid). [ 9.643446] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ 9.659942] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ 9.667212] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ 9.676575] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ 9.686893] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ 9.697227] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ 9.707552] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ 9.717895] systemd[1]: Reached target ceph target allowing to start/stop all ceph-rbd-mirror@.service instances at once. [ 9.728563] systemd[1]: Reached target Local Encrypted Volumes. [ 9.739509] systemd[1]: Stopped target Switch Root. [ 9.745416] systemd[1]: Stopped target Initrd File Systems. [ 9.750278] systemd[1]: Stopped target Initrd Root File System. [ 9.755845] systemd[1]: Reached target Local Integrity Protected Volumes. [ 9.761771] systemd[1]: Reached target Path Units. [ 9.768545] systemd[1]: Reached target Slice Units. [ 9.773322] systemd[1]: Reached target Swaps. [ 9.778190] systemd[1]: Reached target Local Verity Protected Volumes. [ 9.782882] systemd[1]: Listening on Device-mapper event daemon FIFOs. . [[ 9.796239] systemd[1]: Listening on LVM2 poll daemon socket. OK ] Created slice Slice /system/getty. [ OK ] Created slice [ 9.810513] systemd[1]: Listening on RPCbind Server Activation Socket. [ 9.810576] systemd[1]: Reached target RPC Port Mapper. Slice /system/modprobe. [ OK ] Created slice Slice /system/[ 9.829855] systemd[1]: Listening on Process Core Dump Socket. [ 9.829984] systemd[1]: Listening on initctl Compatibility Named Pipe. serial-getty[ 9.844463] systemd[1]: Listening on udev Control Socket. [ 9.844710] systemd[1]: Listening on udev Kernel Socket. [ 9.851074] systemd[1]: Mounting Huge Pages File System... . [ OK[ 9.861837] systemd[1]: Mounting POSIX Message Queue File System... [ 9.862685] systemd[1]: Mounting Kernel Debug File System... ] Created [ 9.875145] systemd[1]: Mounting Kernel Trace File System... slice S[ 9.881457] systemd[1]: Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab). lice /system/sshd-keygen. [ OK ] Created slice User and Session Slice. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Set up automount Arbitrary Executa…ormats File System Automount Point. [ OK ] Reached t[ 9.924129] systemd[1]: Starting Create List of Static Device Nodes... arget c[ 9.924949] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... [ 9.932401] systemd[1]: Starting Load Kernel Module configfs... eph target allow[ 9.944360] systemd[1]: Starting Load Kernel Module drm... in…eph-mon@.se[ 9.949983] systemd[1]: Starting Load Kernel Module fuse... rvice instances [ 9.963799] systemd[1]: Starting Read and set NIS domainname from /etc/sysconfig/network... at once. [[ 9.972856] systemd[1]: plymouth-switch-root.service: Deactivated successfully.  OK [0[ 9.972904] systemd[1]: Stopped Plymouth switch root service. m] Reached targe[ 9.981597] systemd[1]: Stopped Journal Service. t ceph [ 9.995250] systemd[1]: Starting Journal Service... target allowin…eph-mds@.service instances at once. [ OK ] R[ 10.006882] systemd[1]: Starting Load Kernel Modules... eached target [[ 10.013706] systemd[1]: Starting Generate network units from Kernel command line... 0;1;39mceph targ[ 10.022065] systemd[1]: TPM2 PCR Machine ID Measurement was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/StubPcrKernelImage-4a67b082-0a4c-41cf-b6c7-440b29bb8c4f). et allowin…eph[ 10.022886] systemd[1]: Starting Remount Root and Kernel File Systems... -mgr@.service in[ 10.041970] systemd[1]: Repartition Root Disk was skipped because no trigger condition checks were met. stances at once[ 10.043126] systemd[1]: Starting Coldplug All udev Devices... [0m. [ [ 10.051445] systemd[1]: Mounted Huge Pages File System. OK ] Reach[ 10.061030] systemd[1]: Mounted POSIX Message Queue File System. ed target [0;1;[ 10.068138] systemd[1]: Mounted Kernel Debug File System. 39mceph target a[ 10.074701] systemd[1]: Mounted Kernel Trace File System. llowin…eph-osd[ 10.082146] systemd[1]: Started Journal Service. @.service instances at once. [ OK ] Reached target ceph target allowin…radosgw@.service instances at once. [ OK ] Reached target ceph target allowin…-mirror@.service instances at once. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Stoppe[ 10.131691] EXT4-fs (sda1): re-mounted fa8d2923-554d-41e2-ac4a-c752ff079ceb r/w. Quota mode: none. d target Switch Root. [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. [ OK ] Reached target Local Integrity Protected Volumes. [ OK ] Reached target [ 10.166243] systemd-journald[575]: Received client request to flush runtime journal. [0;1;39mPath Units. [ OK ] Reached target Slice Units. [ OK ] Reached target Swaps. [ OK ] Reached target Local Verity Protected Volumes. [ OK ] Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Listening on udev Control Socket. [ OK ] Listening on udev Kernel Socket. Mounting Huge Pages File System... Mounting POSIX Message Queue File System... Mounting Kernel Debug File System... Mounting Kernel Trace File System... Starting Create List of Static Device Nodes... Starting Monitoring of LVM2 mirror…ing dmeventd or progress polling... Starting Load Kernel Module configfs... Starting Load Kernel Module drm... Starting Load Kernel Module fuse... Starting Read and set NIS domainname from /etc/sysconfig/network... [ OK ] Stopped Plymouth switch root service. [ OK ] Stopped Journal Service. Starting Journal Service... Starting Load Kernel Modules... Starting Generate network units from Kernel command line... Starting Remount Root and Kernel File Systems... Starting [0[ 10.341698] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 10.341719] device-mapper: uevent: version 1.0.3 ;1;39mColdplug A[ 10.341805] device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com ll udev Devices... [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Started Journal Service. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Read and set NIS domainname from /etc/sysconfig/network. [ OK ] Finished Generate network units from Kernel command line. [ OK ] Reached target Preparation for Network. [ OK ] Finished Remount Root and Kernel File Systems. Starting Flush Journal to Persistent Storage... Starting Load/Save OS Random Seed... Starting Create Static Device Nodes in /dev... [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Modules. Mounting FUSE Control File System... Mounting Kernel Configuration File System... Starting Apply Kernel Variables... [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Coldplug All udev Devices. [ OK ] Finished Load/Save OS Random Seed. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Monitoring of LVM2 mirror…using dmeventd or progress polling. [ OK ] Finished Create Static Device Nodes in /dev. Starting Rule-based Manager for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Tell Plymouth To Write Out Runtime Data... Starting Automatic Boot Loader Update... Starting Create Volatile Files and Directories... Starting Load Kernel Module configfs... Starting Load Kernel Module fuse... [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module fuse. [ 10.766584] IPMI message handler: version 39.2 [ 10.776115] ipmi device interface [ 10.806410] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 10.849426] power_meter ACPI000D:00: Found ACPI power meter. [ 10.849472] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 10.849477] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info(). [ OK ] Finished Automatic Boot Loader Upda[ 10.879183] mei_me 0000:00:16.0: Device doesn't have valid ME Interface te. [[0;3[ 10.879362] ioatdma: Intel(R) QuickData Technology Driver 5.00 2m OK ] Fi[ 10.894148] ipmi_si: IPMI System Interface driver nished [ 10.894173] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS Tell Plymouth To[ 10.894176] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 Write Out Runti[ 10.894179] ipmi_si: Adding SMBIOS-specified kcs state machine me Data. [ 10.894246] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 10.894409] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 10.894485] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 10.895383] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 10.895386] ipmi_si: Adding ACPI-specified kcs state machine [ 10.895462] i2c i2c-3: 2/8 memory slots populated (from DMI) [ 10.895522] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 10.895559] igb 0000:07:00.0: DCA enabled [ 10.895582] igb 0000:07:00.1: DCA enabled [ 10.982759] iTCO_vendor_support: vendor-support=0 [ 10.989979] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 10.989985] RAPL PMU: hw unit of domain package 2^-14 Joules [ 10.989992] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 10.991425] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 11.038856] iTCO_wdt iTCO_wdt.1.auto: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 11.042726] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) [ 11.081496] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ OK ] Started /usr/sbin/lvm vgchange -aay --autoactivation event vg_nvme. [ OK ] Finished Create Volatile Files and Directories. Mounting RPC Pipe File System... Starting Security Auditing Service... Starting RPC Bind... [ 11.237310] ipmi_si IPI0001:00: IPMI kcs interface initialized [ 11.248514] ipmi_ssif: IPMI SSIF Interface driver [ OK ] Found device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... [ 11.306982] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 11.306985] EDAC sbridge: Ver: 1.1.2 [ 11.310681] RPC: Registered named UNIX socket transport module. [ 11.310683] RPC: Registered udp transport module. [ 11.310684] RPC: Registered tcp transport module. [ 11.310684] RPC: Registered tcp-with-tls transport module. [ 11.310685] RPC: Registered tcp NFSv4.1 backchannel transport module. [ OK ] Mounted RPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ OK ] Started RPC Bind. [ 11.397153] intel_rapl_common: Found RAPL domain package [ 11.397163] intel_rapl_common: Found RAPL domain dram [ OK ] Started Security Auditing Service. Starting Record System Boot/Shutdown in UTMP... [ 11.627758] SGI XFS with ACLs, security attributes, scrub, quota, no debug enabled [ 11.636075] XFS (dm-4): Deprecated V4 format (crc=0) will not be supported beginning with RHEL10 [ 11.636176] XFS (dm-4): Mounting V4 Filesystem 386d13cc-f844-4e1c-87a9-f97feb03064d [ 11.640420] XFS (dm-4): Ending clean mount [ 11.640457] xfs filesystem being mounted at /var/lib/ceph supports timestamps until 2038 (0x7fffffff) [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Mounted /var/lib/ceph. [ OK ] Reached target System Initialization. [ OK ] Started Daily rotation of log files. [ OK ] Started Updates mlocate database every day. [ OK ] Started Run system activity accounting tool every 10 minutes. [ OK ] Started Generate summary of yesterday's process accounting. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Listening on SSSD Kerberos Cache Manager responder socket. [ OK ] Reached target Socket Units. Starting D-Bus System Message Bus... [ OK ] Started D-Bus System Message Bus. [ OK ] Reached target Basic System. Starting Network Manager... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target allowin…l ceph*@.service instances at once. Starting NTP client/server... Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started Machine Check Exception Logging Daemon. Starting Self Monitoring and Reporting Technology (SMART) Daemon... [ OK ] Reached target sshd-keygen.target. [ OK ] Reached target User and Group Name Lookups. Starting Resets System Activity Logs... Starting User Login Management... [ OK ] Finished Restore /run/initramfs on shutdown. [ OK ] Started User Login Management. [ OK ] Finished Resets System Activity Logs. [ OK ] Started Self Monitoring and Reporting Technology (SMART) Daemon. [ OK ] Started NTP client/server. Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 13.262850] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 13.419749] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Network Manager Wait Online... Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... [ 13.646063] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started Deferred execution scheduler. [ OK ] Started Command Scheduler. [ 13.834055] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 13.834181] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [* ] A start job is running for Network Manager Wait Online (6s / no limit) M [** ] A start job is running for Network Manager Wait Online (7s / no limit) M [*** ] A start job is running for Network Manager Wait Online (7s / no limit) M [ *** ] A start job is running for Network Manager Wait Online (8s / no limit) M [ *** ] A start job is running for Network Manager Wait Online (8s / no limit) M [ ***] A start job is running for Network Manager Wait Online (9s / no limit) M [ **] A start job is running for Network Manager Wait Online (9s / no limit) M [ OK ] Finished Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... [ OK ] Started Nagios Remote Plugin Executor. Starting /etc/rc.d/rc.local Compatibility... Starting Notify NFS peers of a restart... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. + myips=172.21.15.117 + attempts=1 + sleep 1 [ OK ] Started System Logging Service. [ 20.375414] block sda: the capability attribute has been deprecated. + '[' 172.21.15.117 '!=' '' ']' + set -e + '[' -n 172.21.15.117 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.117 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.117 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' Starting SETroubleshoot daemon for…ocessing new SELinux denial logs... + newhostname=smithi117.front.sepia.ceph.com + '[' -n smithi117.front.sepia.ceph.com ']' + hostname smithi117.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi117 + echo smithi117 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.117 smithi117.front.sepia.ceph.com smithi117/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... CentOS Stream 9 Kernel 5.14.0-505.el9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi117 login: [disconnect] 2024-09-12T22:50:41.460 INFO:teuthology.misc:Re-opening connections... 2024-09-12T22:50:41.460 INFO:teuthology.misc:trying to connect to ubuntu@smithi117.front.sepia.ceph.com 2024-09-12T22:50:41.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-12T22:50:41.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:50:42.188 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-09-12T22:50:42.738 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-12T22:50:42.738 DEBUG:teuthology.misc:waited 1.2780568599700928 2024-09-12T22:50:43.739 DEBUG:tasks.ceph_manager:Mounting data for osd.2 on ubuntu@smithi117.front.sepia.ceph.com 2024-09-12T22:50:43.740 INFO:tasks.ceph_manager:Mounting osd.2: dev: ubuntu@smithi117.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-2, type: xfs, options: ['noatime'] 2024-09-12T22:50:43.740 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-12T22:50:43.840 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T22:50:43.882 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T22:50:43.882 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T22:50:43.925 INFO:tasks.ceph.osd.2:Started 2024-09-12T22:50:43.925 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:50:44.036 INFO:teuthology.orchestra.run.smithi117.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-09-12T22:50:44.039 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T22:50:44.039 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-09-12T22:50:45.749 INFO:tasks.ceph.osd.2.smithi117.stderr:2024-09-12T22:50:45.747+0000 7fe9c22f1640 -1 Falling back to public interface 2024-09-12T22:50:46.625 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-12T22:50:49.040 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:50:49.147 INFO:teuthology.orchestra.run.smithi117.stderr:no valid command found; 10 closest matches: 2024-09-12T22:50:49.148 INFO:teuthology.orchestra.run.smithi117.stderr:0 2024-09-12T22:50:49.148 INFO:teuthology.orchestra.run.smithi117.stderr:1 2024-09-12T22:50:49.148 INFO:teuthology.orchestra.run.smithi117.stderr:2 2024-09-12T22:50:49.148 INFO:teuthology.orchestra.run.smithi117.stderr:abort 2024-09-12T22:50:49.148 INFO:teuthology.orchestra.run.smithi117.stderr:assert 2024-09-12T22:50:49.148 INFO:teuthology.orchestra.run.smithi117.stderr:bluestore allocator dump block 2024-09-12T22:50:49.148 INFO:teuthology.orchestra.run.smithi117.stderr:bluestore allocator fragmentation block 2024-09-12T22:50:49.148 INFO:teuthology.orchestra.run.smithi117.stderr:bluestore allocator fragmentation histogram block [] [] 2024-09-12T22:50:49.148 INFO:teuthology.orchestra.run.smithi117.stderr:bluestore allocator score block 2024-09-12T22:50:49.148 INFO:teuthology.orchestra.run.smithi117.stderr:config diff 2024-09-12T22:50:49.148 INFO:teuthology.orchestra.run.smithi117.stderr:admin_socket: invalid command 2024-09-12T22:50:49.150 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T22:50:49.150 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-09-12T22:50:50.147 INFO:tasks.ceph.osd.2.smithi117.stderr:2024-09-12T22:50:50.146+0000 7fe9c22f1640 -1 osd.2 22 log_to_monitors true 2024-09-12T22:50:50.885 INFO:tasks.ceph.osd.2.smithi117.stderr:2024-09-12T22:50:50.883+0000 7fe9b608f640 -1 osd.2 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T22:50:54.151 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:50:54.266 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-12T22:50:54.266 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2024-09-12T22:50:54.266 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2024-09-12T22:50:54.266 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-12T22:50:59.275 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-12T22:50:59.407 INFO:teuthology.orchestra.run.smithi066.stdout:mon.a: {} 2024-09-12T22:50:59.407 INFO:teuthology.orchestra.run.smithi066.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T22:50:59.416 INFO:teuthology.orchestra.run.smithi066.stdout:mon.b: {} 2024-09-12T22:50:59.416 INFO:teuthology.orchestra.run.smithi066.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T22:50:59.425 INFO:teuthology.orchestra.run.smithi066.stdout:mon.c: {} 2024-09-12T22:50:59.425 INFO:teuthology.orchestra.run.smithi066.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T22:50:59.436 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-12T22:51:00.694 INFO:teuthology.orchestra.run.smithi066.stderr:reweighted osd.0 to 1 (10000) 2024-09-12T22:51:00.712 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-12T22:51:01.701 INFO:teuthology.orchestra.run.smithi066.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-12T22:51:01.717 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-12T22:51:02.697 INFO:teuthology.orchestra.run.smithi066.stderr:reweighted osd.1 to 1 (10000) 2024-09-12T22:51:02.716 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-12T22:51:03.702 INFO:teuthology.orchestra.run.smithi066.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-12T22:51:03.718 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-12T22:51:04.722 INFO:teuthology.orchestra.run.smithi066.stderr:reweighted osd.2 to 1 (10000) 2024-09-12T22:51:04.738 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-12T22:51:05.725 INFO:teuthology.orchestra.run.smithi066.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-12T22:51:05.742 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-12T22:51:05.742 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-12T22:51:05.742 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-12T22:51:05.742 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-12T22:51:05.742 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T22:51:05.743 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:51:06.039 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:51:06.039 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":81,"fsid":"5714c6a5-034c-4330-a57b-d22492ad8e43","created":"2024-09-12T22:47:43.881551+0000","modified":"2024-09-12T22:51:05.718993+0000","last_up_change":"2024-09-12T22:50:51.815832+0000","last_in_change":"2024-09-12T22:47:44.690260+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:47:54.168813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:47:58.920007+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:48:03.033410+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:48:03.489928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ed48fb2-48c2-4ecb-9306-372a05b08cee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6801","nonce":1747255146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6803","nonce":1747255146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6807","nonce":1747255146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6805","nonce":1747255146}]},"public_addr":"172.21.15.87:6801/1747255146","cluster_addr":"172.21.15.87:6803/1747255146","heartbeat_back_addr":"172.21.15.87:6807/1747255146","heartbeat_front_addr":"172.21.15.87:6805/1747255146","state":["exists","up"]},{"osd":1,"uuid":"af934313-a6b4-4e15-9818-6fc3fb71b949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6801","nonce":1159429503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6803","nonce":1159429503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6807","nonce":1159429503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6805","nonce":1159429503}]},"public_addr":"172.21.15.99:6801/1159429503","cluster_addr":"172.21.15.99:6803/1159429503","heartbeat_back_addr":"172.21.15.99:6807/1159429503","heartbeat_front_addr":"172.21.15.99:6805/1159429503","state":["exists","up"]},{"osd":2,"uuid":"185ee2bd-8c37-4de1-b6ef-2988144d1470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":22,"up_from":67,"up_thru":78,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":448789353},{"type":"v1","addr":"172.21.15.117:6801","nonce":448789353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":448789353},{"type":"v1","addr":"172.21.15.117:6803","nonce":448789353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":448789353},{"type":"v1","addr":"172.21.15.117:6807","nonce":448789353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":448789353},{"type":"v1","addr":"172.21.15.117:6805","nonce":448789353}]},"public_addr":"172.21.15.117:6801/448789353","cluster_addr":"172.21.15.117:6803/448789353","heartbeat_back_addr":"172.21.15.117:6807/448789353","heartbeat_front_addr":"172.21.15.117:6805/448789353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:47:51.816709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:47:51.376989+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:47:51.833489+0000","dead_epoch":22}],"pg_upmap":[{"pgid":"3.1e","osds":[0,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:51:06.052 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T22:51:06.052 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:51:06.342 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:51:06.343 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":81,"fsid":"5714c6a5-034c-4330-a57b-d22492ad8e43","created":"2024-09-12T22:47:43.881551+0000","modified":"2024-09-12T22:51:05.718993+0000","last_up_change":"2024-09-12T22:50:51.815832+0000","last_in_change":"2024-09-12T22:47:44.690260+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:47:54.168813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:47:58.920007+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:48:03.033410+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:48:03.489928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ed48fb2-48c2-4ecb-9306-372a05b08cee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6801","nonce":1747255146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6803","nonce":1747255146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6807","nonce":1747255146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6805","nonce":1747255146}]},"public_addr":"172.21.15.87:6801/1747255146","cluster_addr":"172.21.15.87:6803/1747255146","heartbeat_back_addr":"172.21.15.87:6807/1747255146","heartbeat_front_addr":"172.21.15.87:6805/1747255146","state":["exists","up"]},{"osd":1,"uuid":"af934313-a6b4-4e15-9818-6fc3fb71b949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6801","nonce":1159429503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6803","nonce":1159429503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6807","nonce":1159429503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6805","nonce":1159429503}]},"public_addr":"172.21.15.99:6801/1159429503","cluster_addr":"172.21.15.99:6803/1159429503","heartbeat_back_addr":"172.21.15.99:6807/1159429503","heartbeat_front_addr":"172.21.15.99:6805/1159429503","state":["exists","up"]},{"osd":2,"uuid":"185ee2bd-8c37-4de1-b6ef-2988144d1470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":22,"up_from":67,"up_thru":78,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":448789353},{"type":"v1","addr":"172.21.15.117:6801","nonce":448789353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":448789353},{"type":"v1","addr":"172.21.15.117:6803","nonce":448789353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":448789353},{"type":"v1","addr":"172.21.15.117:6807","nonce":448789353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":448789353},{"type":"v1","addr":"172.21.15.117:6805","nonce":448789353}]},"public_addr":"172.21.15.117:6801/448789353","cluster_addr":"172.21.15.117:6803/448789353","heartbeat_back_addr":"172.21.15.117:6807/448789353","heartbeat_front_addr":"172.21.15.117:6805/448789353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:47:51.816709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:47:51.376989+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:47:51.833489+0000","dead_epoch":22}],"pg_upmap":[{"pgid":"3.1e","osds":[0,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:51:06.356 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T22:51:06.357 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T22:51:06.357 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T22:51:06.500 INFO:teuthology.orchestra.run.smithi066.stdout:34359738409 2024-09-12T22:51:06.501 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T22:51:06.521 INFO:teuthology.orchestra.run.smithi066.stdout:34359738411 2024-09-12T22:51:06.521 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T22:51:06.522 INFO:teuthology.orchestra.run.smithi066.stdout:287762808837 2024-09-12T22:51:06.522 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T22:51:06.803 INFO:teuthology.orchestra.run.smithi066.stdout:34359738408 2024-09-12T22:51:06.817 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738409 got 34359738408 for osd.1 2024-09-12T22:51:06.861 INFO:teuthology.orchestra.run.smithi066.stdout:287762808836 2024-09-12T22:51:06.864 INFO:teuthology.orchestra.run.smithi066.stdout:34359738410 2024-09-12T22:51:06.875 INFO:tasks.ceph.ceph_manager.ceph:need seq 287762808837 got 287762808836 for osd.2 2024-09-12T22:51:06.878 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738411 got 34359738410 for osd.0 2024-09-12T22:51:07.817 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T22:51:07.876 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T22:51:07.878 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T22:51:08.140 INFO:teuthology.orchestra.run.smithi066.stdout:34359738408 2024-09-12T22:51:08.154 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738409 got 34359738408 for osd.1 2024-09-12T22:51:08.186 INFO:teuthology.orchestra.run.smithi066.stdout:34359738410 2024-09-12T22:51:08.186 INFO:teuthology.orchestra.run.smithi066.stdout:287762808836 2024-09-12T22:51:08.200 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738411 got 34359738410 for osd.0 2024-09-12T22:51:08.201 INFO:tasks.ceph.ceph_manager.ceph:need seq 287762808837 got 287762808836 for osd.2 2024-09-12T22:51:09.155 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T22:51:09.201 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T22:51:09.202 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T22:51:09.482 INFO:teuthology.orchestra.run.smithi066.stdout:34359738409 2024-09-12T22:51:09.496 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738409 got 34359738409 for osd.1 2024-09-12T22:51:09.496 DEBUG:teuthology.parallel:result is None 2024-09-12T22:51:09.531 INFO:teuthology.orchestra.run.smithi066.stdout:34359738411 2024-09-12T22:51:09.541 INFO:teuthology.orchestra.run.smithi066.stdout:287762808837 2024-09-12T22:51:09.546 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738411 got 34359738411 for osd.0 2024-09-12T22:51:09.546 DEBUG:teuthology.parallel:result is None 2024-09-12T22:51:09.556 INFO:tasks.ceph.ceph_manager.ceph:need seq 287762808837 got 287762808837 for osd.2 2024-09-12T22:51:09.556 DEBUG:teuthology.parallel:result is None 2024-09-12T22:51:09.556 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-12T22:51:09.557 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:51:09.893 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:51:09.895 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-09-12T22:51:09.904 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2024-09-12T22:51:08.176370+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127956543,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":2923,"num_read_kb":1407056,"num_write":29321,"num_write_kb":4392913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7366,"num_bytes_recovered":93806220,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33140,"ondisk_log_size":33140,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":493140,"kb_used_data":252056,"kb_used_omap":10,"kb_used_meta":241013,"kb_avail":282622380,"statfs":{"total":289910292480,"available":289405317120,"internally_reserved":0,"allocated":258105344,"data_stored":256916668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10354,"internal_metadata":246798222},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1970,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2529,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.474088"},"pg_stats":[{"pgid":"4.3f","version":"61'404","reported_seq":563,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724420+0000","last_change":"2024-09-12T22:48:05.174190+0000","last_active":"2024-09-12T22:51:05.724420+0000","last_peered":"2024-09-12T22:51:05.724420+0000","last_clean":"2024-09-12T22:51:05.724420+0000","last_became_active":"2024-09-12T22:48:05.172964+0000","last_became_peered":"2024-09-12T22:48:05.172964+0000","last_unstale":"2024-09-12T22:51:05.724420+0000","last_undegraded":"2024-09-12T22:51:05.724420+0000","last_fullsized":"2024-09-12T22:51:05.724420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:49.868891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9582,"num_write":371,"num_write_kb":42180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"61'425","reported_seq":633,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724097+0000","last_change":"2024-09-12T22:48:05.173045+0000","last_active":"2024-09-12T22:51:05.724097+0000","last_peered":"2024-09-12T22:51:05.724097+0000","last_clean":"2024-09-12T22:51:05.724097+0000","last_became_active":"2024-09-12T22:48:05.172684+0000","last_became_peered":"2024-09-12T22:48:05.172684+0000","last_unstale":"2024-09-12T22:51:05.724097+0000","last_undegraded":"2024-09-12T22:51:05.724097+0000","last_fullsized":"2024-09-12T22:51:05.724097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:51.360504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":40466,"num_write":394,"num_write_kb":96045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"61'385","reported_seq":516,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723911+0000","last_change":"2024-09-12T22:51:00.703306+0000","last_active":"2024-09-12T22:51:05.723911+0000","last_peered":"2024-09-12T22:51:05.723911+0000","last_clean":"2024-09-12T22:51:05.723911+0000","last_became_active":"2024-09-12T22:51:00.700490+0000","last_became_peered":"2024-09-12T22:51:00.700490+0000","last_unstale":"2024-09-12T22:51:05.723911+0000","last_undegraded":"2024-09-12T22:51:05.723911+0000","last_fullsized":"2024-09-12T22:51:05.723911+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:16.055859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":7348,"num_write":352,"num_write_kb":34517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"61'395","reported_seq":563,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723474+0000","last_change":"2024-09-12T22:51:02.711764+0000","last_active":"2024-09-12T22:51:05.723474+0000","last_peered":"2024-09-12T22:51:05.723474+0000","last_clean":"2024-09-12T22:51:05.723474+0000","last_became_active":"2024-09-12T22:51:02.708216+0000","last_became_peered":"2024-09-12T22:51:02.708216+0000","last_unstale":"2024-09-12T22:51:05.723474+0000","last_undegraded":"2024-09-12T22:51:05.723474+0000","last_fullsized":"2024-09-12T22:51:05.723474+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:24.442976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":25803,"num_write":361,"num_write_kb":71646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"61'410","reported_seq":573,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723888+0000","last_change":"2024-09-12T22:48:05.170306+0000","last_active":"2024-09-12T22:51:05.723888+0000","last_peered":"2024-09-12T22:51:05.723888+0000","last_clean":"2024-09-12T22:51:05.723888+0000","last_became_active":"2024-09-12T22:48:05.169940+0000","last_became_peered":"2024-09-12T22:48:05.169940+0000","last_unstale":"2024-09-12T22:51:05.723888+0000","last_undegraded":"2024-09-12T22:51:05.723888+0000","last_fullsized":"2024-09-12T22:51:05.723888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:52.341512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":20544,"num_write":387,"num_write_kb":55745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"61'384","reported_seq":499,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723190+0000","last_change":"2024-09-12T22:51:03.706817+0000","last_active":"2024-09-12T22:51:05.723190+0000","last_peered":"2024-09-12T22:51:05.723190+0000","last_clean":"2024-09-12T22:51:05.723190+0000","last_became_active":"2024-09-12T22:51:03.704293+0000","last_became_peered":"2024-09-12T22:51:03.704293+0000","last_unstale":"2024-09-12T22:51:05.723190+0000","last_undegraded":"2024-09-12T22:51:05.723190+0000","last_fullsized":"2024-09-12T22:51:05.723190+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:07.148926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5069,"num_write":355,"num_write_kb":38430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"61'461","reported_seq":656,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723091+0000","last_change":"2024-09-12T22:50:56.858810+0000","last_active":"2024-09-12T22:51:05.723091+0000","last_peered":"2024-09-12T22:51:05.723091+0000","last_clean":"2024-09-12T22:51:05.723091+0000","last_became_active":"2024-09-12T22:50:56.856720+0000","last_became_peered":"2024-09-12T22:50:56.856720+0000","last_unstale":"2024-09-12T22:51:05.723091+0000","last_undegraded":"2024-09-12T22:51:05.723091+0000","last_fullsized":"2024-09-12T22:51:05.723091+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:21.599293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":30574,"num_write":435,"num_write_kb":92996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"61'385","reported_seq":518,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722895+0000","last_change":"2024-09-12T22:51:00.703157+0000","last_active":"2024-09-12T22:51:05.722895+0000","last_peered":"2024-09-12T22:51:05.722895+0000","last_clean":"2024-09-12T22:51:05.722895+0000","last_became_active":"2024-09-12T22:51:00.700472+0000","last_became_peered":"2024-09-12T22:51:00.700472+0000","last_unstale":"2024-09-12T22:51:05.722895+0000","last_undegraded":"2024-09-12T22:51:05.722895+0000","last_fullsized":"2024-09-12T22:51:05.722895+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:07.616061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9031,"num_write":340,"num_write_kb":84729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"61'435","reported_seq":585,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343462+0000","last_change":"2024-09-12T22:48:05.178445+0000","last_active":"2024-09-12T22:51:06.343462+0000","last_peered":"2024-09-12T22:51:06.343462+0000","last_clean":"2024-09-12T22:51:06.343462+0000","last_became_active":"2024-09-12T22:48:05.177284+0000","last_became_peered":"2024-09-12T22:48:05.177284+0000","last_unstale":"2024-09-12T22:51:06.343462+0000","last_undegraded":"2024-09-12T22:51:06.343462+0000","last_fullsized":"2024-09-12T22:51:06.343462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:45.140060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8316,"num_write":403,"num_write_kb":71851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"61'443","reported_seq":648,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724176+0000","last_change":"2024-09-12T22:48:05.172480+0000","last_active":"2024-09-12T22:51:05.724176+0000","last_peered":"2024-09-12T22:51:05.724176+0000","last_clean":"2024-09-12T22:51:05.724176+0000","last_became_active":"2024-09-12T22:48:05.171686+0000","last_became_peered":"2024-09-12T22:48:05.171686+0000","last_unstale":"2024-09-12T22:51:05.724176+0000","last_undegraded":"2024-09-12T22:51:05.724176+0000","last_fullsized":"2024-09-12T22:51:05.724176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:56.158813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40751,"num_write":407,"num_write_kb":116626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"61'383","reported_seq":509,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723914+0000","last_change":"2024-09-12T22:51:02.712354+0000","last_active":"2024-09-12T22:51:05.723914+0000","last_peered":"2024-09-12T22:51:05.723914+0000","last_clean":"2024-09-12T22:51:05.723914+0000","last_became_active":"2024-09-12T22:51:02.710579+0000","last_became_peered":"2024-09-12T22:51:02.710579+0000","last_unstale":"2024-09-12T22:51:05.723914+0000","last_undegraded":"2024-09-12T22:51:05.723914+0000","last_fullsized":"2024-09-12T22:51:05.723914+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:58:11.483150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5475,"num_write":365,"num_write_kb":63204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"61'366","reported_seq":891,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723891+0000","last_change":"2024-09-12T22:50:58.699684+0000","last_active":"2024-09-12T22:51:05.723891+0000","last_peered":"2024-09-12T22:51:05.723891+0000","last_clean":"2024-09-12T22:51:05.723891+0000","last_became_active":"2024-09-12T22:50:58.698711+0000","last_became_peered":"2024-09-12T22:50:58.698711+0000","last_unstale":"2024-09-12T22:51:05.723891+0000","last_undegraded":"2024-09-12T22:51:05.723891+0000","last_fullsized":"2024-09-12T22:51:05.723891+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:47.507555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":35222,"num_write":342,"num_write_kb":74947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"61'434","reported_seq":622,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723644+0000","last_change":"2024-09-12T22:48:05.171356+0000","last_active":"2024-09-12T22:51:05.723644+0000","last_peered":"2024-09-12T22:51:05.723644+0000","last_clean":"2024-09-12T22:51:05.723644+0000","last_became_active":"2024-09-12T22:48:05.170794+0000","last_became_peered":"2024-09-12T22:48:05.170794+0000","last_unstale":"2024-09-12T22:51:05.723644+0000","last_undegraded":"2024-09-12T22:51:05.723644+0000","last_fullsized":"2024-09-12T22:51:05.723644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:42:56.969660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":19623,"num_write":389,"num_write_kb":83457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"61'432","reported_seq":601,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723150+0000","last_change":"2024-09-12T22:50:58.702236+0000","last_active":"2024-09-12T22:51:05.723150+0000","last_peered":"2024-09-12T22:51:05.723150+0000","last_clean":"2024-09-12T22:51:05.723150+0000","last_became_active":"2024-09-12T22:50:58.700107+0000","last_became_peered":"2024-09-12T22:50:58.700107+0000","last_unstale":"2024-09-12T22:51:05.723150+0000","last_undegraded":"2024-09-12T22:51:05.723150+0000","last_fullsized":"2024-09-12T22:51:05.723150+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:29.112353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":23332,"num_write":401,"num_write_kb":75871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"61'406","reported_seq":573,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723029+0000","last_change":"2024-09-12T22:50:55.852257+0000","last_active":"2024-09-12T22:51:05.723029+0000","last_peered":"2024-09-12T22:51:05.723029+0000","last_clean":"2024-09-12T22:51:05.723029+0000","last_became_active":"2024-09-12T22:50:55.849568+0000","last_became_peered":"2024-09-12T22:50:55.849568+0000","last_unstale":"2024-09-12T22:51:05.723029+0000","last_undegraded":"2024-09-12T22:51:05.723029+0000","last_fullsized":"2024-09-12T22:51:05.723029+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:49.995990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":18162,"num_write":365,"num_write_kb":58919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"61'444","reported_seq":575,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723061+0000","last_change":"2024-09-12T22:51:01.704325+0000","last_active":"2024-09-12T22:51:05.723061+0000","last_peered":"2024-09-12T22:51:05.723061+0000","last_clean":"2024-09-12T22:51:05.723061+0000","last_became_active":"2024-09-12T22:51:01.700744+0000","last_became_peered":"2024-09-12T22:51:01.700744+0000","last_unstale":"2024-09-12T22:51:05.723061+0000","last_undegraded":"2024-09-12T22:51:05.723061+0000","last_fullsized":"2024-09-12T22:51:05.723061+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:00.747671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":410,"num_write_kb":63144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"61'443","reported_seq":616,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343794+0000","last_change":"2024-09-12T22:48:05.178721+0000","last_active":"2024-09-12T22:51:06.343794+0000","last_peered":"2024-09-12T22:51:06.343794+0000","last_clean":"2024-09-12T22:51:06.343794+0000","last_became_active":"2024-09-12T22:48:05.177965+0000","last_became_peered":"2024-09-12T22:48:05.177965+0000","last_unstale":"2024-09-12T22:51:06.343794+0000","last_undegraded":"2024-09-12T22:51:06.343794+0000","last_fullsized":"2024-09-12T22:51:06.343794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:32.288419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":14687,"num_write":408,"num_write_kb":80026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"61'439","reported_seq":665,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724329+0000","last_change":"2024-09-12T22:48:05.171053+0000","last_active":"2024-09-12T22:51:05.724329+0000","last_peered":"2024-09-12T22:51:05.724329+0000","last_clean":"2024-09-12T22:51:05.724329+0000","last_became_active":"2024-09-12T22:48:05.170578+0000","last_became_peered":"2024-09-12T22:48:05.170578+0000","last_unstale":"2024-09-12T22:51:05.724329+0000","last_undegraded":"2024-09-12T22:51:05.724329+0000","last_fullsized":"2024-09-12T22:51:05.724329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:58.991752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":47063,"num_write":400,"num_write_kb":100535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"61'444","reported_seq":660,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343268+0000","last_change":"2024-09-12T22:48:05.177369+0000","last_active":"2024-09-12T22:51:06.343268+0000","last_peered":"2024-09-12T22:51:06.343268+0000","last_clean":"2024-09-12T22:51:06.343268+0000","last_became_active":"2024-09-12T22:48:05.176680+0000","last_became_peered":"2024-09-12T22:48:05.176680+0000","last_unstale":"2024-09-12T22:51:06.343268+0000","last_undegraded":"2024-09-12T22:51:06.343268+0000","last_fullsized":"2024-09-12T22:51:06.343268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:25.143572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":42758,"num_write":403,"num_write_kb":67827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"61'433","reported_seq":570,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723656+0000","last_change":"2024-09-12T22:51:02.711577+0000","last_active":"2024-09-12T22:51:05.723656+0000","last_peered":"2024-09-12T22:51:05.723656+0000","last_clean":"2024-09-12T22:51:05.723656+0000","last_became_active":"2024-09-12T22:51:02.708090+0000","last_became_peered":"2024-09-12T22:51:02.708090+0000","last_unstale":"2024-09-12T22:51:05.723656+0000","last_undegraded":"2024-09-12T22:51:05.723656+0000","last_fullsized":"2024-09-12T22:51:05.723656+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:32.441902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":10750,"num_write":397,"num_write_kb":34708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"61'413","reported_seq":588,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723473+0000","last_change":"2024-09-12T22:50:58.702132+0000","last_active":"2024-09-12T22:51:05.723473+0000","last_peered":"2024-09-12T22:51:05.723473+0000","last_clean":"2024-09-12T22:51:05.723473+0000","last_became_active":"2024-09-12T22:50:58.699982+0000","last_became_peered":"2024-09-12T22:50:58.699982+0000","last_unstale":"2024-09-12T22:51:05.723473+0000","last_undegraded":"2024-09-12T22:51:05.723473+0000","last_fullsized":"2024-09-12T22:51:05.723473+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:03.458952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":25621,"num_write":385,"num_write_kb":63908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"61'462","reported_seq":1066,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723490+0000","last_change":"2024-09-12T22:50:58.701216+0000","last_active":"2024-09-12T22:51:05.723490+0000","last_peered":"2024-09-12T22:51:05.723490+0000","last_clean":"2024-09-12T22:51:05.723490+0000","last_became_active":"2024-09-12T22:50:58.700047+0000","last_became_peered":"2024-09-12T22:50:58.700047+0000","last_unstale":"2024-09-12T22:51:05.723490+0000","last_undegraded":"2024-09-12T22:51:05.723490+0000","last_fullsized":"2024-09-12T22:51:05.723490+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:51.010136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28920,"num_write":428,"num_write_kb":76277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"61'413","reported_seq":948,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342393+0000","last_change":"2024-09-12T22:50:57.861973+0000","last_active":"2024-09-12T22:51:06.342393+0000","last_peered":"2024-09-12T22:51:06.342393+0000","last_clean":"2024-09-12T22:51:06.342393+0000","last_became_active":"2024-09-12T22:50:57.860819+0000","last_became_peered":"2024-09-12T22:50:57.860819+0000","last_unstale":"2024-09-12T22:51:06.342393+0000","last_undegraded":"2024-09-12T22:51:06.342393+0000","last_fullsized":"2024-09-12T22:51:06.342393+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:52.977617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":14661,"num_write":381,"num_write_kb":72596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"61'475","reported_seq":680,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723273+0000","last_change":"2024-09-12T22:48:05.172794+0000","last_active":"2024-09-12T22:51:05.723273+0000","last_peered":"2024-09-12T22:51:05.723273+0000","last_clean":"2024-09-12T22:51:05.723273+0000","last_became_active":"2024-09-12T22:48:05.172437+0000","last_became_peered":"2024-09-12T22:48:05.172437+0000","last_unstale":"2024-09-12T22:51:05.723273+0000","last_undegraded":"2024-09-12T22:51:05.723273+0000","last_fullsized":"2024-09-12T22:51:05.723273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:54:44.278646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":32397,"num_write":452,"num_write_kb":105406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"61'413","reported_seq":963,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724480+0000","last_change":"2024-09-12T22:51:02.709686+0000","last_active":"2024-09-12T22:51:05.724480+0000","last_peered":"2024-09-12T22:51:05.724480+0000","last_clean":"2024-09-12T22:51:05.724480+0000","last_became_active":"2024-09-12T22:51:02.708084+0000","last_became_peered":"2024-09-12T22:51:02.708084+0000","last_unstale":"2024-09-12T22:51:05.724480+0000","last_undegraded":"2024-09-12T22:51:05.724480+0000","last_fullsized":"2024-09-12T22:51:05.724480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:27.765575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4773,"num_write":395,"num_write_kb":21871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"61'453","reported_seq":1027,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343514+0000","last_change":"2024-09-12T22:50:58.700787+0000","last_active":"2024-09-12T22:51:06.343514+0000","last_peered":"2024-09-12T22:51:06.343514+0000","last_clean":"2024-09-12T22:51:06.343514+0000","last_became_active":"2024-09-12T22:50:58.699585+0000","last_became_peered":"2024-09-12T22:50:58.699585+0000","last_unstale":"2024-09-12T22:51:06.343514+0000","last_undegraded":"2024-09-12T22:51:06.343514+0000","last_fullsized":"2024-09-12T22:51:06.343514+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:44.083029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18201,"num_write":409,"num_write_kb":47008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"61'402","reported_seq":571,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723791+0000","last_change":"2024-09-12T22:51:01.704826+0000","last_active":"2024-09-12T22:51:05.723791+0000","last_peered":"2024-09-12T22:51:05.723791+0000","last_clean":"2024-09-12T22:51:05.723791+0000","last_became_active":"2024-09-12T22:51:01.701850+0000","last_became_peered":"2024-09-12T22:51:01.701850+0000","last_unstale":"2024-09-12T22:51:05.723791+0000","last_undegraded":"2024-09-12T22:51:05.723791+0000","last_fullsized":"2024-09-12T22:51:05.723791+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:44:29.380608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":21641,"num_write":372,"num_write_kb":63613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"61'436","reported_seq":1073,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724130+0000","last_change":"2024-09-12T22:50:59.703836+0000","last_active":"2024-09-12T22:51:05.724130+0000","last_peered":"2024-09-12T22:51:05.724130+0000","last_clean":"2024-09-12T22:51:05.724130+0000","last_became_active":"2024-09-12T22:50:59.702766+0000","last_became_peered":"2024-09-12T22:50:59.702766+0000","last_unstale":"2024-09-12T22:51:05.724130+0000","last_undegraded":"2024-09-12T22:51:05.724130+0000","last_fullsized":"2024-09-12T22:51:05.724130+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:52.977617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":65550,"num_write":412,"num_write_kb":134233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"61'393","reported_seq":590,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343137+0000","last_change":"2024-09-12T22:48:05.177176+0000","last_active":"2024-09-12T22:51:06.343137+0000","last_peered":"2024-09-12T22:51:06.343137+0000","last_clean":"2024-09-12T22:51:06.343137+0000","last_became_active":"2024-09-12T22:48:05.176735+0000","last_became_peered":"2024-09-12T22:48:05.176735+0000","last_unstale":"2024-09-12T22:51:06.343137+0000","last_undegraded":"2024-09-12T22:51:06.343137+0000","last_fullsized":"2024-09-12T22:51:06.343137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:51.360504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":36009,"num_write":361,"num_write_kb":71487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"61'456","reported_seq":1019,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723644+0000","last_change":"2024-09-12T22:51:00.699523+0000","last_active":"2024-09-12T22:51:05.723644+0000","last_peered":"2024-09-12T22:51:05.723644+0000","last_clean":"2024-09-12T22:51:05.723644+0000","last_became_active":"2024-09-12T22:51:00.698377+0000","last_became_peered":"2024-09-12T22:51:00.698377+0000","last_unstale":"2024-09-12T22:51:05.723644+0000","last_undegraded":"2024-09-12T22:51:05.723644+0000","last_fullsized":"2024-09-12T22:51:05.723644+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:04:47.810227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4316,"num_write":417,"num_write_kb":34284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"61'440","reported_seq":614,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342570+0000","last_change":"2024-09-12T22:48:05.176878+0000","last_active":"2024-09-12T22:51:06.342570+0000","last_peered":"2024-09-12T22:51:06.342570+0000","last_clean":"2024-09-12T22:51:06.342570+0000","last_became_active":"2024-09-12T22:48:05.176327+0000","last_became_peered":"2024-09-12T22:48:05.176327+0000","last_unstale":"2024-09-12T22:51:06.342570+0000","last_undegraded":"2024-09-12T22:51:06.342570+0000","last_fullsized":"2024-09-12T22:51:06.342570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:11.781766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15052,"num_write":399,"num_write_kb":71703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"61'424","reported_seq":582,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722737+0000","last_change":"2024-09-12T22:51:01.704366+0000","last_active":"2024-09-12T22:51:05.722737+0000","last_peered":"2024-09-12T22:51:05.722737+0000","last_clean":"2024-09-12T22:51:05.722737+0000","last_became_active":"2024-09-12T22:51:01.700878+0000","last_became_peered":"2024-09-12T22:51:01.700878+0000","last_unstale":"2024-09-12T22:51:05.722737+0000","last_undegraded":"2024-09-12T22:51:05.722737+0000","last_fullsized":"2024-09-12T22:51:05.722737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:57.250980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25587,"num_write":397,"num_write_kb":46651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"61'384","reported_seq":545,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724020+0000","last_change":"2024-09-12T22:48:05.171573+0000","last_active":"2024-09-12T22:51:05.724020+0000","last_peered":"2024-09-12T22:51:05.724020+0000","last_clean":"2024-09-12T22:51:05.724020+0000","last_became_active":"2024-09-12T22:48:05.171036+0000","last_became_peered":"2024-09-12T22:48:05.171036+0000","last_unstale":"2024-09-12T22:51:05.724020+0000","last_undegraded":"2024-09-12T22:51:05.724020+0000","last_fullsized":"2024-09-12T22:51:05.724020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:27:07.558853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9715,"num_write":345,"num_write_kb":63048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"61'450","reported_seq":585,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723240+0000","last_change":"2024-09-12T22:50:55.851831+0000","last_active":"2024-09-12T22:51:05.723240+0000","last_peered":"2024-09-12T22:51:05.723240+0000","last_clean":"2024-09-12T22:51:05.723240+0000","last_became_active":"2024-09-12T22:50:55.851443+0000","last_became_peered":"2024-09-12T22:50:55.851443+0000","last_unstale":"2024-09-12T22:51:05.723240+0000","last_undegraded":"2024-09-12T22:51:05.723240+0000","last_fullsized":"2024-09-12T22:51:05.723240+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:25:19.575346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":387,"num_write_kb":8369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"61'389","reported_seq":568,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724238+0000","last_change":"2024-09-12T22:48:05.173585+0000","last_active":"2024-09-12T22:51:05.724238+0000","last_peered":"2024-09-12T22:51:05.724238+0000","last_clean":"2024-09-12T22:51:05.724238+0000","last_became_active":"2024-09-12T22:48:05.172801+0000","last_became_peered":"2024-09-12T22:48:05.172801+0000","last_unstale":"2024-09-12T22:51:05.724238+0000","last_undegraded":"2024-09-12T22:51:05.724238+0000","last_fullsized":"2024-09-12T22:51:05.724238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:45.140060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":21115,"num_write":354,"num_write_kb":59128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"61'60","reported_seq":206,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342908+0000","last_change":"2024-09-12T22:50:52.860336+0000","last_active":"2024-09-12T22:51:06.342908+0000","last_peered":"2024-09-12T22:51:06.342908+0000","last_clean":"2024-09-12T22:51:06.342908+0000","last_became_active":"2024-09-12T22:50:52.859975+0000","last_became_peered":"2024-09-12T22:50:52.859975+0000","last_unstale":"2024-09-12T22:51:06.342908+0000","last_undegraded":"2024-09-12T22:51:06.342908+0000","last_fullsized":"2024-09-12T22:51:06.342908+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:14.260183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"61'433","reported_seq":997,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342401+0000","last_change":"2024-09-12T22:50:57.863647+0000","last_active":"2024-09-12T22:51:06.342401+0000","last_peered":"2024-09-12T22:51:06.342401+0000","last_clean":"2024-09-12T22:51:06.342401+0000","last_became_active":"2024-09-12T22:50:57.861719+0000","last_became_peered":"2024-09-12T22:50:57.861719+0000","last_unstale":"2024-09-12T22:51:06.342401+0000","last_undegraded":"2024-09-12T22:51:06.342401+0000","last_fullsized":"2024-09-12T22:51:06.342401+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:04:47.810227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17599,"num_write":404,"num_write_kb":59440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"61'63","reported_seq":209,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723521+0000","last_change":"2024-09-12T22:50:52.857615+0000","last_active":"2024-09-12T22:51:05.723521+0000","last_peered":"2024-09-12T22:51:05.723521+0000","last_clean":"2024-09-12T22:51:05.723521+0000","last_became_active":"2024-09-12T22:50:52.857343+0000","last_became_peered":"2024-09-12T22:50:52.857343+0000","last_unstale":"2024-09-12T22:51:05.723521+0000","last_undegraded":"2024-09-12T22:51:05.723521+0000","last_fullsized":"2024-09-12T22:51:05.723521+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:44.095690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"61'407","reported_seq":932,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343467+0000","last_change":"2024-09-12T22:50:55.853362+0000","last_active":"2024-09-12T22:51:06.343467+0000","last_peered":"2024-09-12T22:51:06.343467+0000","last_clean":"2024-09-12T22:51:06.343467+0000","last_became_active":"2024-09-12T22:50:55.851934+0000","last_became_peered":"2024-09-12T22:50:55.851934+0000","last_unstale":"2024-09-12T22:51:06.343467+0000","last_undegraded":"2024-09-12T22:51:06.343467+0000","last_fullsized":"2024-09-12T22:51:06.343467+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:51.010136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":24842,"num_write":378,"num_write_kb":79144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"61'62","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722703+0000","last_change":"2024-09-12T22:50:52.859828+0000","last_active":"2024-09-12T22:51:05.722703+0000","last_peered":"2024-09-12T22:51:05.722703+0000","last_clean":"2024-09-12T22:51:05.722703+0000","last_became_active":"2024-09-12T22:50:52.858911+0000","last_became_peered":"2024-09-12T22:50:52.858911+0000","last_unstale":"2024-09-12T22:51:05.722703+0000","last_undegraded":"2024-09-12T22:51:05.722703+0000","last_fullsized":"2024-09-12T22:51:05.722703+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:44.358340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"61'152","reported_seq":288,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723962+0000","last_change":"2024-09-12T22:50:55.851865+0000","last_active":"2024-09-12T22:51:05.723962+0000","last_peered":"2024-09-12T22:51:05.723962+0000","last_clean":"2024-09-12T22:51:05.723962+0000","last_became_active":"2024-09-12T22:50:55.851050+0000","last_became_peered":"2024-09-12T22:50:55.851050+0000","last_unstale":"2024-09-12T22:51:05.723962+0000","last_undegraded":"2024-09-12T22:51:05.723962+0000","last_fullsized":"2024-09-12T22:51:05.723962+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:31:24.219732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"61'392","reported_seq":890,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723334+0000","last_change":"2024-09-12T22:50:56.855073+0000","last_active":"2024-09-12T22:51:05.723334+0000","last_peered":"2024-09-12T22:51:05.723334+0000","last_clean":"2024-09-12T22:51:05.723334+0000","last_became_active":"2024-09-12T22:50:56.853383+0000","last_became_peered":"2024-09-12T22:50:56.853383+0000","last_unstale":"2024-09-12T22:51:05.723334+0000","last_undegraded":"2024-09-12T22:51:05.723334+0000","last_fullsized":"2024-09-12T22:51:05.723334+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:18.644500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":9675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"61'237","reported_seq":390,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724440+0000","last_change":"2024-09-12T22:50:55.852418+0000","last_active":"2024-09-12T22:51:05.724440+0000","last_peered":"2024-09-12T22:51:05.724440+0000","last_clean":"2024-09-12T22:51:05.724440+0000","last_became_active":"2024-09-12T22:50:55.852034+0000","last_became_peered":"2024-09-12T22:50:55.852034+0000","last_unstale":"2024-09-12T22:51:05.724440+0000","last_undegraded":"2024-09-12T22:51:05.724440+0000","last_fullsized":"2024-09-12T22:51:05.724440+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:47.161147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"61'464","reported_seq":637,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723400+0000","last_change":"2024-09-12T22:48:05.171143+0000","last_active":"2024-09-12T22:51:05.723400+0000","last_peered":"2024-09-12T22:51:05.723400+0000","last_clean":"2024-09-12T22:51:05.723400+0000","last_became_active":"2024-09-12T22:48:05.170374+0000","last_became_peered":"2024-09-12T22:48:05.170374+0000","last_unstale":"2024-09-12T22:51:05.723400+0000","last_undegraded":"2024-09-12T22:51:05.723400+0000","last_fullsized":"2024-09-12T22:51:05.723400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:15.887977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15522,"num_write":440,"num_write_kb":60335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"61'470","reported_seq":606,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723638+0000","last_change":"2024-09-12T22:50:55.852447+0000","last_active":"2024-09-12T22:51:05.723638+0000","last_peered":"2024-09-12T22:51:05.723638+0000","last_clean":"2024-09-12T22:51:05.723638+0000","last_became_active":"2024-09-12T22:50:55.852074+0000","last_became_peered":"2024-09-12T22:50:55.852074+0000","last_unstale":"2024-09-12T22:51:05.723638+0000","last_undegraded":"2024-09-12T22:51:05.723638+0000","last_fullsized":"2024-09-12T22:51:05.723638+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:24.010030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":4267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"61'449","reported_seq":636,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723253+0000","last_change":"2024-09-12T22:51:00.701817+0000","last_active":"2024-09-12T22:51:05.723253+0000","last_peered":"2024-09-12T22:51:05.723253+0000","last_clean":"2024-09-12T22:51:05.723253+0000","last_became_active":"2024-09-12T22:51:00.699592+0000","last_became_peered":"2024-09-12T22:51:00.699592+0000","last_unstale":"2024-09-12T22:51:05.723253+0000","last_undegraded":"2024-09-12T22:51:05.723253+0000","last_fullsized":"2024-09-12T22:51:05.723253+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:11.924779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":36634,"num_write":415,"num_write_kb":84238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"61'52","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723477+0000","last_change":"2024-09-12T22:50:52.857863+0000","last_active":"2024-09-12T22:51:05.723477+0000","last_peered":"2024-09-12T22:51:05.723477+0000","last_clean":"2024-09-12T22:51:05.723477+0000","last_became_active":"2024-09-12T22:50:52.857342+0000","last_became_peered":"2024-09-12T22:50:52.857342+0000","last_unstale":"2024-09-12T22:51:05.723477+0000","last_undegraded":"2024-09-12T22:51:05.723477+0000","last_fullsized":"2024-09-12T22:51:05.723477+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:59.906052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"61'434","reported_seq":1027,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343139+0000","last_change":"2024-09-12T22:50:58.701303+0000","last_active":"2024-09-12T22:51:06.343139+0000","last_peered":"2024-09-12T22:51:06.343139+0000","last_clean":"2024-09-12T22:51:06.343139+0000","last_became_active":"2024-09-12T22:50:58.700178+0000","last_became_peered":"2024-09-12T22:50:58.700178+0000","last_unstale":"2024-09-12T22:51:06.343139+0000","last_undegraded":"2024-09-12T22:51:06.343139+0000","last_fullsized":"2024-09-12T22:51:06.343139+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:13:37.634120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":39364,"num_write":402,"num_write_kb":59313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"61'194","reported_seq":349,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343266+0000","last_change":"2024-09-12T22:50:55.852827+0000","last_active":"2024-09-12T22:51:06.343266+0000","last_peered":"2024-09-12T22:51:06.343266+0000","last_clean":"2024-09-12T22:51:06.343266+0000","last_became_active":"2024-09-12T22:50:55.852479+0000","last_became_peered":"2024-09-12T22:50:55.852479+0000","last_unstale":"2024-09-12T22:51:06.343266+0000","last_undegraded":"2024-09-12T22:51:06.343266+0000","last_fullsized":"2024-09-12T22:51:06.343266+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:17.642880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"61'457","reported_seq":591,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723790+0000","last_change":"2024-09-12T22:51:03.707374+0000","last_active":"2024-09-12T22:51:05.723790+0000","last_peered":"2024-09-12T22:51:05.723790+0000","last_clean":"2024-09-12T22:51:05.723790+0000","last_became_active":"2024-09-12T22:51:03.704514+0000","last_became_peered":"2024-09-12T22:51:03.704514+0000","last_unstale":"2024-09-12T22:51:05.723790+0000","last_undegraded":"2024-09-12T22:51:05.723790+0000","last_fullsized":"2024-09-12T22:51:05.723790+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:13.942017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10832,"num_write":419,"num_write_kb":34901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"61'106","reported_seq":232,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722915+0000","last_change":"2024-09-12T22:50:55.851086+0000","last_active":"2024-09-12T22:51:05.722915+0000","last_peered":"2024-09-12T22:51:05.722915+0000","last_clean":"2024-09-12T22:51:05.722915+0000","last_became_active":"2024-09-12T22:50:55.850764+0000","last_became_peered":"2024-09-12T22:50:55.850764+0000","last_unstale":"2024-09-12T22:51:05.722915+0000","last_undegraded":"2024-09-12T22:51:05.722915+0000","last_fullsized":"2024-09-12T22:51:05.722915+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:26.058872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"61'431","reported_seq":571,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723616+0000","last_change":"2024-09-12T22:51:02.710383+0000","last_active":"2024-09-12T22:51:05.723616+0000","last_peered":"2024-09-12T22:51:05.723616+0000","last_clean":"2024-09-12T22:51:05.723616+0000","last_became_active":"2024-09-12T22:51:02.707646+0000","last_became_peered":"2024-09-12T22:51:02.707646+0000","last_unstale":"2024-09-12T22:51:05.723616+0000","last_undegraded":"2024-09-12T22:51:05.723616+0000","last_fullsized":"2024-09-12T22:51:05.723616+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:41.956076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":10443,"num_write":392,"num_write_kb":63957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"61'49","reported_seq":195,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723628+0000","last_change":"2024-09-12T22:50:52.857609+0000","last_active":"2024-09-12T22:51:05.723628+0000","last_peered":"2024-09-12T22:51:05.723628+0000","last_clean":"2024-09-12T22:51:05.723628+0000","last_became_active":"2024-09-12T22:50:52.857301+0000","last_became_peered":"2024-09-12T22:50:52.857301+0000","last_unstale":"2024-09-12T22:51:05.723628+0000","last_undegraded":"2024-09-12T22:51:05.723628+0000","last_fullsized":"2024-09-12T22:51:05.723628+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:43.328264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"61'351","reported_seq":475,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723979+0000","last_change":"2024-09-12T22:50:56.855396+0000","last_active":"2024-09-12T22:51:05.723979+0000","last_peered":"2024-09-12T22:51:05.723979+0000","last_clean":"2024-09-12T22:51:05.723979+0000","last_became_active":"2024-09-12T22:50:56.853610+0000","last_became_peered":"2024-09-12T22:50:56.853610+0000","last_unstale":"2024-09-12T22:51:05.723979+0000","last_undegraded":"2024-09-12T22:51:05.723979+0000","last_fullsized":"2024-09-12T22:51:05.723979+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:01.946701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":137,"num_write":315,"num_write_kb":37943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"61'588","reported_seq":727,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723397+0000","last_change":"2024-09-12T22:48:04.174281+0000","last_active":"2024-09-12T22:51:05.723397+0000","last_peered":"2024-09-12T22:51:05.723397+0000","last_clean":"2024-09-12T22:51:05.723397+0000","last_became_active":"2024-09-12T22:48:04.173942+0000","last_became_peered":"2024-09-12T22:48:04.173942+0000","last_unstale":"2024-09-12T22:51:05.723397+0000","last_undegraded":"2024-09-12T22:51:05.723397+0000","last_fullsized":"2024-09-12T22:51:05.723397+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:19:38.546747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":4334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"61'400","reported_seq":560,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343593+0000","last_change":"2024-09-12T22:48:05.178246+0000","last_active":"2024-09-12T22:51:06.343593+0000","last_peered":"2024-09-12T22:51:06.343593+0000","last_clean":"2024-09-12T22:51:06.343593+0000","last_became_active":"2024-09-12T22:48:05.176813+0000","last_became_peered":"2024-09-12T22:48:05.176813+0000","last_unstale":"2024-09-12T22:51:06.343593+0000","last_undegraded":"2024-09-12T22:51:06.343593+0000","last_fullsized":"2024-09-12T22:51:06.343593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:58.991752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":9179,"num_write":363,"num_write_kb":67046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":242,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722613+0000","last_change":"2024-09-12T22:50:52.860243+0000","last_active":"2024-09-12T22:51:05.722613+0000","last_peered":"2024-09-12T22:51:05.722613+0000","last_clean":"2024-09-12T22:51:05.722613+0000","last_became_active":"2024-09-12T22:50:52.859754+0000","last_became_peered":"2024-09-12T22:50:52.859754+0000","last_unstale":"2024-09-12T22:51:05.722613+0000","last_undegraded":"2024-09-12T22:51:05.722613+0000","last_fullsized":"2024-09-12T22:51:05.722613+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:55.016634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:55.016634+0000","last_clean_scrub_stamp":"2024-09-12T22:47:55.016634+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:41:30.207577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722981+0000","last_change":"2024-09-12T22:50:52.858727+0000","last_active":"2024-09-12T22:51:05.722981+0000","last_peered":"2024-09-12T22:51:05.722981+0000","last_clean":"2024-09-12T22:51:05.722981+0000","last_became_active":"2024-09-12T22:50:52.857759+0000","last_became_peered":"2024-09-12T22:50:52.857759+0000","last_unstale":"2024-09-12T22:51:05.722981+0000","last_undegraded":"2024-09-12T22:51:05.722981+0000","last_fullsized":"2024-09-12T22:51:05.722981+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:52.160461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"61'506","reported_seq":645,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343027+0000","last_change":"2024-09-12T22:48:04.169704+0000","last_active":"2024-09-12T22:51:06.343027+0000","last_peered":"2024-09-12T22:51:06.343027+0000","last_clean":"2024-09-12T22:51:06.343027+0000","last_became_active":"2024-09-12T22:48:04.169474+0000","last_became_peered":"2024-09-12T22:48:04.169474+0000","last_unstale":"2024-09-12T22:51:06.343027+0000","last_undegraded":"2024-09-12T22:51:06.343027+0000","last_fullsized":"2024-09-12T22:51:06.343027+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:00.271198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":444,"num_write_kb":8407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"61'422","reported_seq":595,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723784+0000","last_change":"2024-09-12T22:51:00.700237+0000","last_active":"2024-09-12T22:51:05.723784+0000","last_peered":"2024-09-12T22:51:05.723784+0000","last_clean":"2024-09-12T22:51:05.723784+0000","last_became_active":"2024-09-12T22:51:00.698391+0000","last_became_peered":"2024-09-12T22:51:00.698391+0000","last_unstale":"2024-09-12T22:51:05.723784+0000","last_undegraded":"2024-09-12T22:51:05.723784+0000","last_fullsized":"2024-09-12T22:51:05.723784+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:19.299721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":38484,"num_write":383,"num_write_kb":67099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722904+0000","last_change":"2024-09-12T22:50:52.859530+0000","last_active":"2024-09-12T22:51:05.722904+0000","last_peered":"2024-09-12T22:51:05.722904+0000","last_clean":"2024-09-12T22:51:05.722904+0000","last_became_active":"2024-09-12T22:50:52.858480+0000","last_became_peered":"2024-09-12T22:50:52.858480+0000","last_unstale":"2024-09-12T22:51:05.722904+0000","last_undegraded":"2024-09-12T22:51:05.722904+0000","last_fullsized":"2024-09-12T22:51:05.722904+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:28:23.416675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"61'107","reported_seq":304,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342800+0000","last_change":"2024-09-12T22:50:55.853291+0000","last_active":"2024-09-12T22:51:06.342800+0000","last_peered":"2024-09-12T22:51:06.342800+0000","last_clean":"2024-09-12T22:51:06.342800+0000","last_became_active":"2024-09-12T22:50:55.852965+0000","last_became_peered":"2024-09-12T22:50:55.852965+0000","last_unstale":"2024-09-12T22:51:06.342800+0000","last_undegraded":"2024-09-12T22:51:06.342800+0000","last_fullsized":"2024-09-12T22:51:06.342800+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:46.505934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1463793,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":1459,"num_write":45,"num_write_kb":1459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1463793,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"61'436","reported_seq":618,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724236+0000","last_change":"2024-09-12T22:48:05.171819+0000","last_active":"2024-09-12T22:51:05.724236+0000","last_peered":"2024-09-12T22:51:05.724236+0000","last_clean":"2024-09-12T22:51:05.724236+0000","last_became_active":"2024-09-12T22:48:05.171293+0000","last_became_peered":"2024-09-12T22:48:05.171293+0000","last_unstale":"2024-09-12T22:51:05.724236+0000","last_undegraded":"2024-09-12T22:51:05.724236+0000","last_fullsized":"2024-09-12T22:51:05.724236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:01.401542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":27936,"num_write":401,"num_write_kb":51013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342933+0000","last_change":"2024-09-12T22:48:02.045209+0000","last_active":"2024-09-12T22:51:06.342933+0000","last_peered":"2024-09-12T22:51:06.342933+0000","last_clean":"2024-09-12T22:51:06.342933+0000","last_became_active":"2024-09-12T22:48:00.042007+0000","last_became_peered":"2024-09-12T22:48:00.042007+0000","last_unstale":"2024-09-12T22:51:06.342933+0000","last_undegraded":"2024-09-12T22:51:06.342933+0000","last_fullsized":"2024-09-12T22:51:06.342933+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:13.536542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036893100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"61'357","reported_seq":511,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723507+0000","last_change":"2024-09-12T22:50:55.852384+0000","last_active":"2024-09-12T22:51:05.723507+0000","last_peered":"2024-09-12T22:51:05.723507+0000","last_clean":"2024-09-12T22:51:05.723507+0000","last_became_active":"2024-09-12T22:50:55.852029+0000","last_became_peered":"2024-09-12T22:50:55.852029+0000","last_unstale":"2024-09-12T22:51:05.723507+0000","last_undegraded":"2024-09-12T22:51:05.723507+0000","last_fullsized":"2024-09-12T22:51:05.723507+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:59.415555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":8307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"61'343","reported_seq":503,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343598+0000","last_change":"2024-09-12T22:48:05.178865+0000","last_active":"2024-09-12T22:51:06.343598+0000","last_peered":"2024-09-12T22:51:06.343598+0000","last_clean":"2024-09-12T22:51:06.343598+0000","last_became_active":"2024-09-12T22:48:05.178010+0000","last_became_peered":"2024-09-12T22:48:05.178010+0000","last_unstale":"2024-09-12T22:51:06.343598+0000","last_undegraded":"2024-09-12T22:51:06.343598+0000","last_fullsized":"2024-09-12T22:51:06.343598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:30.120804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":6704,"num_write":316,"num_write_kb":42458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":70,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722797+0000","last_change":"2024-09-12T22:50:52.858195+0000","last_active":"2024-09-12T22:51:05.722797+0000","last_peered":"2024-09-12T22:51:05.722797+0000","last_clean":"2024-09-12T22:51:05.722797+0000","last_became_active":"2024-09-12T22:50:52.857746+0000","last_became_peered":"2024-09-12T22:50:52.857746+0000","last_unstale":"2024-09-12T22:51:05.722797+0000","last_undegraded":"2024-09-12T22:51:05.722797+0000","last_fullsized":"2024-09-12T22:51:05.722797+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:10:52.096897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052714799999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"61'78","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723018+0000","last_change":"2024-09-12T22:50:52.858808+0000","last_active":"2024-09-12T22:51:05.723018+0000","last_peered":"2024-09-12T22:51:05.723018+0000","last_clean":"2024-09-12T22:51:05.723018+0000","last_became_active":"2024-09-12T22:50:52.858372+0000","last_became_peered":"2024-09-12T22:50:52.858372+0000","last_unstale":"2024-09-12T22:51:05.723018+0000","last_undegraded":"2024-09-12T22:51:05.723018+0000","last_fullsized":"2024-09-12T22:51:05.723018+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:44.345055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"61'404","reported_seq":614,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343369+0000","last_change":"2024-09-12T22:48:05.177561+0000","last_active":"2024-09-12T22:51:06.343369+0000","last_peered":"2024-09-12T22:51:06.343369+0000","last_clean":"2024-09-12T22:51:06.343369+0000","last_became_active":"2024-09-12T22:48:05.177164+0000","last_became_peered":"2024-09-12T22:48:05.177164+0000","last_unstale":"2024-09-12T22:51:06.343369+0000","last_undegraded":"2024-09-12T22:51:06.343369+0000","last_fullsized":"2024-09-12T22:51:06.343369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:24.124647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":35084,"num_write":365,"num_write_kb":71560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"61'269","reported_seq":395,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723416+0000","last_change":"2024-09-12T22:50:55.850951+0000","last_active":"2024-09-12T22:51:05.723416+0000","last_peered":"2024-09-12T22:51:05.723416+0000","last_clean":"2024-09-12T22:51:05.723416+0000","last_became_active":"2024-09-12T22:50:55.850689+0000","last_became_peered":"2024-09-12T22:50:55.850689+0000","last_unstale":"2024-09-12T22:51:05.723416+0000","last_undegraded":"2024-09-12T22:51:05.723416+0000","last_fullsized":"2024-09-12T22:51:05.723416+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:11:37.856958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":4189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343491+0000","last_change":"2024-09-12T22:48:02.045324+0000","last_active":"2024-09-12T22:51:06.343491+0000","last_peered":"2024-09-12T22:51:06.343491+0000","last_clean":"2024-09-12T22:51:06.343491+0000","last_became_active":"2024-09-12T22:48:00.042132+0000","last_became_peered":"2024-09-12T22:48:00.042132+0000","last_unstale":"2024-09-12T22:51:06.343491+0000","last_undegraded":"2024-09-12T22:51:06.343491+0000","last_fullsized":"2024-09-12T22:51:06.343491+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:24.673019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047590600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"61'362","reported_seq":851,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723496+0000","last_change":"2024-09-12T22:50:59.708186+0000","last_active":"2024-09-12T22:51:05.723496+0000","last_peered":"2024-09-12T22:51:05.723496+0000","last_clean":"2024-09-12T22:51:05.723496+0000","last_became_active":"2024-09-12T22:50:59.707126+0000","last_became_peered":"2024-09-12T22:50:59.707126+0000","last_unstale":"2024-09-12T22:51:05.723496+0000","last_undegraded":"2024-09-12T22:51:05.723496+0000","last_fullsized":"2024-09-12T22:51:05.723496+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:08:37.272462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":10445,"num_write":331,"num_write_kb":30096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"61'56","reported_seq":195,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343401+0000","last_change":"2024-09-12T22:48:04.169109+0000","last_active":"2024-09-12T22:51:06.343401+0000","last_peered":"2024-09-12T22:51:06.343401+0000","last_clean":"2024-09-12T22:51:06.343401+0000","last_became_active":"2024-09-12T22:48:04.168655+0000","last_became_peered":"2024-09-12T22:48:04.168655+0000","last_unstale":"2024-09-12T22:51:06.343401+0000","last_undegraded":"2024-09-12T22:51:06.343401+0000","last_fullsized":"2024-09-12T22:51:06.343401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:02.879935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724478+0000","last_change":"2024-09-12T22:48:02.045390+0000","last_active":"2024-09-12T22:51:05.724478+0000","last_peered":"2024-09-12T22:51:05.724478+0000","last_clean":"2024-09-12T22:51:05.724478+0000","last_became_active":"2024-09-12T22:48:00.045356+0000","last_became_peered":"2024-09-12T22:48:00.045356+0000","last_unstale":"2024-09-12T22:51:05.724478+0000","last_undegraded":"2024-09-12T22:51:05.724478+0000","last_fullsized":"2024-09-12T22:51:05.724478+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:32.072080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040621599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"61'408","reported_seq":982,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723709+0000","last_change":"2024-09-12T22:50:57.864738+0000","last_active":"2024-09-12T22:51:05.723709+0000","last_peered":"2024-09-12T22:51:05.723709+0000","last_clean":"2024-09-12T22:51:05.723709+0000","last_became_active":"2024-09-12T22:50:57.863486+0000","last_became_peered":"2024-09-12T22:50:57.863486+0000","last_unstale":"2024-09-12T22:51:05.723709+0000","last_undegraded":"2024-09-12T22:51:05.723709+0000","last_fullsized":"2024-09-12T22:51:05.723709+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:06:04.268528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":42311,"num_write":379,"num_write_kb":75412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"61'61","reported_seq":200,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343872+0000","last_change":"2024-09-12T22:48:04.168635+0000","last_active":"2024-09-12T22:51:06.343872+0000","last_peered":"2024-09-12T22:51:06.343872+0000","last_clean":"2024-09-12T22:51:06.343872+0000","last_became_active":"2024-09-12T22:48:04.168244+0000","last_became_peered":"2024-09-12T22:48:04.168244+0000","last_unstale":"2024-09-12T22:51:06.343872+0000","last_undegraded":"2024-09-12T22:51:06.343872+0000","last_fullsized":"2024-09-12T22:51:06.343872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:56.929490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343640+0000","last_change":"2024-09-12T22:48:02.045428+0000","last_active":"2024-09-12T22:51:06.343640+0000","last_peered":"2024-09-12T22:51:06.343640+0000","last_clean":"2024-09-12T22:51:06.343640+0000","last_became_active":"2024-09-12T22:48:00.040536+0000","last_became_peered":"2024-09-12T22:48:00.040536+0000","last_unstale":"2024-09-12T22:51:06.343640+0000","last_undegraded":"2024-09-12T22:51:06.343640+0000","last_fullsized":"2024-09-12T22:51:06.343640+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:33.150497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057699499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"61'430","reported_seq":990,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342744+0000","last_change":"2024-09-12T22:51:01.701692+0000","last_active":"2024-09-12T22:51:06.342744+0000","last_peered":"2024-09-12T22:51:06.342744+0000","last_clean":"2024-09-12T22:51:06.342744+0000","last_became_active":"2024-09-12T22:51:01.700292+0000","last_became_peered":"2024-09-12T22:51:01.700292+0000","last_unstale":"2024-09-12T22:51:06.342744+0000","last_undegraded":"2024-09-12T22:51:06.342744+0000","last_fullsized":"2024-09-12T22:51:06.342744+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:25.931698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":26700,"num_write":399,"num_write_kb":55331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"63'114","reported_seq":267,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343600+0000","last_change":"2024-09-12T22:50:55.852342+0000","last_active":"2024-09-12T22:51:06.343600+0000","last_peered":"2024-09-12T22:51:06.343600+0000","last_clean":"2024-09-12T22:51:06.343600+0000","last_became_active":"2024-09-12T22:50:55.851975+0000","last_became_peered":"2024-09-12T22:50:55.851975+0000","last_unstale":"2024-09-12T22:51:06.343600+0000","last_undegraded":"2024-09-12T22:51:06.343600+0000","last_fullsized":"2024-09-12T22:51:06.343600+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:42.555311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":1201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723698+0000","last_change":"2024-09-12T22:50:52.857531+0000","last_active":"2024-09-12T22:51:05.723698+0000","last_peered":"2024-09-12T22:51:05.723698+0000","last_clean":"2024-09-12T22:51:05.723698+0000","last_became_active":"2024-09-12T22:50:52.856757+0000","last_became_peered":"2024-09-12T22:50:52.856757+0000","last_unstale":"2024-09-12T22:51:05.723698+0000","last_undegraded":"2024-09-12T22:51:05.723698+0000","last_fullsized":"2024-09-12T22:51:05.723698+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:14.353873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"61'406","reported_seq":929,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723396+0000","last_change":"2024-09-12T22:50:56.855069+0000","last_active":"2024-09-12T22:51:05.723396+0000","last_peered":"2024-09-12T22:51:05.723396+0000","last_clean":"2024-09-12T22:51:05.723396+0000","last_became_active":"2024-09-12T22:50:56.853376+0000","last_became_peered":"2024-09-12T22:50:56.853376+0000","last_unstale":"2024-09-12T22:51:05.723396+0000","last_undegraded":"2024-09-12T22:51:05.723396+0000","last_fullsized":"2024-09-12T22:51:05.723396+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:43.556932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17112,"num_write":373,"num_write_kb":79947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"61'378","reported_seq":533,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723357+0000","last_change":"2024-09-12T22:50:57.863154+0000","last_active":"2024-09-12T22:51:05.723357+0000","last_peered":"2024-09-12T22:51:05.723357+0000","last_clean":"2024-09-12T22:51:05.723357+0000","last_became_active":"2024-09-12T22:50:57.861280+0000","last_became_peered":"2024-09-12T22:50:57.861280+0000","last_unstale":"2024-09-12T22:51:05.723357+0000","last_undegraded":"2024-09-12T22:51:05.723357+0000","last_fullsized":"2024-09-12T22:51:05.723357+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:13.015760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15048,"num_write":339,"num_write_kb":35238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"63'249","reported_seq":391,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723315+0000","last_change":"2024-09-12T22:50:55.849742+0000","last_active":"2024-09-12T22:51:05.723315+0000","last_peered":"2024-09-12T22:51:05.723315+0000","last_clean":"2024-09-12T22:51:05.723315+0000","last_became_active":"2024-09-12T22:50:55.849531+0000","last_became_peered":"2024-09-12T22:50:55.849531+0000","last_unstale":"2024-09-12T22:51:05.723315+0000","last_undegraded":"2024-09-12T22:51:05.723315+0000","last_fullsized":"2024-09-12T22:51:05.723315+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:32.676988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8461053,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":8364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8456257,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"61'405","reported_seq":569,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342826+0000","last_change":"2024-09-12T22:48:05.176779+0000","last_active":"2024-09-12T22:51:06.342826+0000","last_peered":"2024-09-12T22:51:06.342826+0000","last_clean":"2024-09-12T22:51:06.342826+0000","last_became_active":"2024-09-12T22:48:05.176344+0000","last_became_peered":"2024-09-12T22:48:05.176344+0000","last_unstale":"2024-09-12T22:51:06.342826+0000","last_undegraded":"2024-09-12T22:51:06.342826+0000","last_fullsized":"2024-09-12T22:51:06.342826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:35.645286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":25018,"num_write":372,"num_write_kb":42936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"61'85","reported_seq":236,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724390+0000","last_change":"2024-09-12T22:50:52.905108+0000","last_active":"2024-09-12T22:51:05.724390+0000","last_peered":"2024-09-12T22:51:05.724390+0000","last_clean":"2024-09-12T22:51:05.724390+0000","last_became_active":"2024-09-12T22:50:52.861594+0000","last_became_peered":"2024-09-12T22:50:52.861594+0000","last_unstale":"2024-09-12T22:51:05.724390+0000","last_undegraded":"2024-09-12T22:51:05.724390+0000","last_fullsized":"2024-09-12T22:51:05.724390+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:49.196178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"61'213","reported_seq":338,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723895+0000","last_change":"2024-09-12T22:50:55.852154+0000","last_active":"2024-09-12T22:51:05.723895+0000","last_peered":"2024-09-12T22:51:05.723895+0000","last_clean":"2024-09-12T22:51:05.723895+0000","last_became_active":"2024-09-12T22:50:55.851798+0000","last_became_peered":"2024-09-12T22:50:55.851798+0000","last_unstale":"2024-09-12T22:51:05.723895+0000","last_undegraded":"2024-09-12T22:51:05.723895+0000","last_fullsized":"2024-09-12T22:51:05.723895+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:03:29.463409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":4171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"61'478","reported_seq":1107,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342630+0000","last_change":"2024-09-12T22:50:56.856443+0000","last_active":"2024-09-12T22:51:06.342630+0000","last_peered":"2024-09-12T22:51:06.342630+0000","last_clean":"2024-09-12T22:51:06.342630+0000","last_became_active":"2024-09-12T22:50:56.855150+0000","last_became_peered":"2024-09-12T22:50:56.855150+0000","last_unstale":"2024-09-12T22:51:06.342630+0000","last_undegraded":"2024-09-12T22:51:06.342630+0000","last_fullsized":"2024-09-12T22:51:06.342630+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:11.194706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":41320,"num_write":445,"num_write_kb":84826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":209,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"61'55","reported_seq":201,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343774+0000","last_change":"2024-09-12T22:50:52.859702+0000","last_active":"2024-09-12T22:51:06.343774+0000","last_peered":"2024-09-12T22:51:06.343774+0000","last_clean":"2024-09-12T22:51:06.343774+0000","last_became_active":"2024-09-12T22:50:52.859296+0000","last_became_peered":"2024-09-12T22:50:52.859296+0000","last_unstale":"2024-09-12T22:51:06.343774+0000","last_undegraded":"2024-09-12T22:51:06.343774+0000","last_fullsized":"2024-09-12T22:51:06.343774+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:14.180904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"61'447","reported_seq":634,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342672+0000","last_change":"2024-09-12T22:48:05.169648+0000","last_active":"2024-09-12T22:51:06.342672+0000","last_peered":"2024-09-12T22:51:06.342672+0000","last_clean":"2024-09-12T22:51:06.342672+0000","last_became_active":"2024-09-12T22:48:05.168356+0000","last_became_peered":"2024-09-12T22:48:05.168356+0000","last_unstale":"2024-09-12T22:51:06.342672+0000","last_undegraded":"2024-09-12T22:51:06.342672+0000","last_fullsized":"2024-09-12T22:51:06.342672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:52.341512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25877,"num_write":417,"num_write_kb":39269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"61'371","reported_seq":888,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724516+0000","last_change":"2024-09-12T22:51:02.709645+0000","last_active":"2024-09-12T22:51:05.724516+0000","last_peered":"2024-09-12T22:51:05.724516+0000","last_clean":"2024-09-12T22:51:05.724516+0000","last_became_active":"2024-09-12T22:51:02.708091+0000","last_became_peered":"2024-09-12T22:51:02.708091+0000","last_unstale":"2024-09-12T22:51:05.724516+0000","last_undegraded":"2024-09-12T22:51:05.724516+0000","last_fullsized":"2024-09-12T22:51:05.724516+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:13:37.634120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20950,"num_write":339,"num_write_kb":39207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"61'601","reported_seq":740,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342822+0000","last_change":"2024-09-12T22:48:04.169111+0000","last_active":"2024-09-12T22:51:06.342822+0000","last_peered":"2024-09-12T22:51:06.342822+0000","last_clean":"2024-09-12T22:51:06.342822+0000","last_became_active":"2024-09-12T22:48:04.168743+0000","last_became_peered":"2024-09-12T22:48:04.168743+0000","last_unstale":"2024-09-12T22:51:06.342822+0000","last_undegraded":"2024-09-12T22:51:06.342822+0000","last_fullsized":"2024-09-12T22:51:06.342822+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:43.709660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":535,"num_write_kb":8445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"61'438","reported_seq":978,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342401+0000","last_change":"2024-09-12T22:50:57.863618+0000","last_active":"2024-09-12T22:51:06.342401+0000","last_peered":"2024-09-12T22:51:06.342401+0000","last_clean":"2024-09-12T22:51:06.342401+0000","last_became_active":"2024-09-12T22:50:57.861695+0000","last_became_peered":"2024-09-12T22:50:57.861695+0000","last_unstale":"2024-09-12T22:51:06.342401+0000","last_undegraded":"2024-09-12T22:51:06.342401+0000","last_fullsized":"2024-09-12T22:51:06.342401+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:08:37.272462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":16921,"num_write":411,"num_write_kb":146790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"61'185","reported_seq":337,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342787+0000","last_change":"2024-09-12T22:50:55.853288+0000","last_active":"2024-09-12T22:51:06.342787+0000","last_peered":"2024-09-12T22:51:06.342787+0000","last_clean":"2024-09-12T22:51:06.342787+0000","last_became_active":"2024-09-12T22:50:55.852796+0000","last_became_peered":"2024-09-12T22:50:55.852796+0000","last_unstale":"2024-09-12T22:51:06.342787+0000","last_undegraded":"2024-09-12T22:51:06.342787+0000","last_fullsized":"2024-09-12T22:51:06.342787+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:06:03.266907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"61'386","reported_seq":886,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724136+0000","last_change":"2024-09-12T22:51:01.702122+0000","last_active":"2024-09-12T22:51:05.724136+0000","last_peered":"2024-09-12T22:51:05.724136+0000","last_clean":"2024-09-12T22:51:05.724136+0000","last_became_active":"2024-09-12T22:51:01.701006+0000","last_became_peered":"2024-09-12T22:51:01.701006+0000","last_unstale":"2024-09-12T22:51:05.724136+0000","last_undegraded":"2024-09-12T22:51:05.724136+0000","last_fullsized":"2024-09-12T22:51:05.724136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:44.083029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":21487,"num_write":344,"num_write_kb":72645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"61'180","reported_seq":319,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723786+0000","last_change":"2024-09-12T22:48:04.174205+0000","last_active":"2024-09-12T22:51:05.723786+0000","last_peered":"2024-09-12T22:51:05.723786+0000","last_clean":"2024-09-12T22:51:05.723786+0000","last_became_active":"2024-09-12T22:48:04.173902+0000","last_became_peered":"2024-09-12T22:48:04.173902+0000","last_unstale":"2024-09-12T22:51:05.723786+0000","last_undegraded":"2024-09-12T22:51:05.723786+0000","last_fullsized":"2024-09-12T22:51:05.723786+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:43:39.709214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":12355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"61'396","reported_seq":552,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723907+0000","last_change":"2024-09-12T22:48:05.172917+0000","last_active":"2024-09-12T22:51:05.723907+0000","last_peered":"2024-09-12T22:51:05.723907+0000","last_clean":"2024-09-12T22:51:05.723907+0000","last_became_active":"2024-09-12T22:48:05.172493+0000","last_became_peered":"2024-09-12T22:48:05.172493+0000","last_unstale":"2024-09-12T22:51:05.723907+0000","last_undegraded":"2024-09-12T22:51:05.723907+0000","last_fullsized":"2024-09-12T22:51:05.723907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:35.645286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9980,"num_write":370,"num_write_kb":80321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"61'64","reported_seq":215,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723864+0000","last_change":"2024-09-12T22:50:52.884955+0000","last_active":"2024-09-12T22:51:05.723864+0000","last_peered":"2024-09-12T22:51:05.723864+0000","last_clean":"2024-09-12T22:51:05.723864+0000","last_became_active":"2024-09-12T22:50:52.858938+0000","last_became_peered":"2024-09-12T22:50:52.858938+0000","last_unstale":"2024-09-12T22:51:05.723864+0000","last_undegraded":"2024-09-12T22:51:05.723864+0000","last_fullsized":"2024-09-12T22:51:05.723864+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:24.405738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"61'370","reported_seq":515,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723307+0000","last_change":"2024-09-12T22:50:59.705667+0000","last_active":"2024-09-12T22:51:05.723307+0000","last_peered":"2024-09-12T22:51:05.723307+0000","last_clean":"2024-09-12T22:51:05.723307+0000","last_became_active":"2024-09-12T22:50:59.704074+0000","last_became_peered":"2024-09-12T22:50:59.704074+0000","last_unstale":"2024-09-12T22:51:05.723307+0000","last_undegraded":"2024-09-12T22:51:05.723307+0000","last_fullsized":"2024-09-12T22:51:05.723307+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:59.243155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16468,"num_write":341,"num_write_kb":50344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"61'187","reported_seq":321,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723342+0000","last_change":"2024-09-12T22:50:55.851804+0000","last_active":"2024-09-12T22:51:05.723342+0000","last_peered":"2024-09-12T22:51:05.723342+0000","last_clean":"2024-09-12T22:51:05.723342+0000","last_became_active":"2024-09-12T22:50:55.851467+0000","last_became_peered":"2024-09-12T22:50:55.851467+0000","last_unstale":"2024-09-12T22:51:05.723342+0000","last_undegraded":"2024-09-12T22:51:05.723342+0000","last_fullsized":"2024-09-12T22:51:05.723342+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:05.608780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"61'438","reported_seq":636,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723016+0000","last_change":"2024-09-12T22:50:59.706857+0000","last_active":"2024-09-12T22:51:05.723016+0000","last_peered":"2024-09-12T22:51:05.723016+0000","last_clean":"2024-09-12T22:51:05.723016+0000","last_became_active":"2024-09-12T22:50:59.703786+0000","last_became_peered":"2024-09-12T22:50:59.703786+0000","last_unstale":"2024-09-12T22:51:05.723016+0000","last_undegraded":"2024-09-12T22:51:05.723016+0000","last_fullsized":"2024-09-12T22:51:05.723016+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:52:45.535138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":38460,"num_write":412,"num_write_kb":96626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"61'185","reported_seq":342,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724254+0000","last_change":"2024-09-12T22:50:55.853065+0000","last_active":"2024-09-12T22:51:05.724254+0000","last_peered":"2024-09-12T22:51:05.724254+0000","last_clean":"2024-09-12T22:51:05.724254+0000","last_became_active":"2024-09-12T22:50:55.852654+0000","last_became_peered":"2024-09-12T22:50:55.852654+0000","last_unstale":"2024-09-12T22:51:05.724254+0000","last_undegraded":"2024-09-12T22:51:05.724254+0000","last_fullsized":"2024-09-12T22:51:05.724254+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:17.101030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":12349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"61'418","reported_seq":599,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723714+0000","last_change":"2024-09-12T22:48:05.171815+0000","last_active":"2024-09-12T22:51:05.723714+0000","last_peered":"2024-09-12T22:51:05.723714+0000","last_clean":"2024-09-12T22:51:05.723714+0000","last_became_active":"2024-09-12T22:48:05.171361+0000","last_became_peered":"2024-09-12T22:48:05.171361+0000","last_unstale":"2024-09-12T22:51:05.723714+0000","last_undegraded":"2024-09-12T22:51:05.723714+0000","last_fullsized":"2024-09-12T22:51:05.723714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:28.873036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":27427,"num_write":388,"num_write_kb":67745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"61'159","reported_seq":285,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724366+0000","last_change":"2024-09-12T22:50:55.852290+0000","last_active":"2024-09-12T22:51:05.724366+0000","last_peered":"2024-09-12T22:51:05.724366+0000","last_clean":"2024-09-12T22:51:05.724366+0000","last_became_active":"2024-09-12T22:50:55.851948+0000","last_became_peered":"2024-09-12T22:50:55.851948+0000","last_unstale":"2024-09-12T22:51:05.724366+0000","last_undegraded":"2024-09-12T22:51:05.724366+0000","last_fullsized":"2024-09-12T22:51:05.724366+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:14.260183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"61'479","reported_seq":652,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723053+0000","last_change":"2024-09-12T22:51:03.707091+0000","last_active":"2024-09-12T22:51:05.723053+0000","last_peered":"2024-09-12T22:51:05.723053+0000","last_clean":"2024-09-12T22:51:05.723053+0000","last_became_active":"2024-09-12T22:51:03.704137+0000","last_became_peered":"2024-09-12T22:51:03.704137+0000","last_unstale":"2024-09-12T22:51:05.723053+0000","last_undegraded":"2024-09-12T22:51:05.723053+0000","last_fullsized":"2024-09-12T22:51:05.723053+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:27:47.351934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":26793,"num_write":459,"num_write_kb":138325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"61'49","reported_seq":200,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343704+0000","last_change":"2024-09-12T22:50:52.903138+0000","last_active":"2024-09-12T22:51:06.343704+0000","last_peered":"2024-09-12T22:51:06.343704+0000","last_clean":"2024-09-12T22:51:06.343704+0000","last_became_active":"2024-09-12T22:50:52.859983+0000","last_became_peered":"2024-09-12T22:50:52.859983+0000","last_unstale":"2024-09-12T22:51:06.343704+0000","last_undegraded":"2024-09-12T22:51:06.343704+0000","last_fullsized":"2024-09-12T22:51:06.343704+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:59.415555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2742,"num_read_kb":1405479,"num_write":24656,"num_write_kb":4261796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7339,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26737,"ondisk_log_size":26737,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127366156,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":45,"num_read_kb":1459,"num_write":4460,"num_write_kb":127655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":93806220,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254799872,"data_stored":254732312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5569,"internal_metadata":0},"log_size":6243,"ondisk_log_size":6243,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":67,"seq":287762808837,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150992,"kb_used_data":92924,"kb_used_omap":6,"kb_used_meta":58041,"kb_avail":94220848,"statfs":{"total":96636764160,"available":96482148352,"internally_reserved":0,"allocated":95154176,"data_stored":94739479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7164,"internal_metadata":59433988},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738409,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":169444,"kb_used_data":75856,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94202396,"statfs":{"total":96636764160,"available":96463253504,"internally_reserved":0,"allocated":77676544,"data_stored":77295007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738411,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":172704,"kb_used_data":83276,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94199136,"statfs":{"total":96636764160,"available":96459915264,"internally_reserved":0,"allocated":85274624,"data_stored":84882182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83980288,"data_stored":83958707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":76972032,"data_stored":76961881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":93847552,"data_stored":93811724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5569,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:51:09.909 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:51:10.238 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:51:10.240 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-09-12T22:51:10.250 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2024-09-12T22:51:10.176776+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127956543,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":2923,"num_read_kb":1407056,"num_write":29321,"num_write_kb":4392913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7366,"num_bytes_recovered":93806220,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33140,"ondisk_log_size":33140,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":493164,"kb_used_data":252072,"kb_used_omap":10,"kb_used_meta":241013,"kb_avail":282622356,"statfs":{"total":289910292480,"available":289405292544,"internally_reserved":0,"allocated":258121728,"data_stored":256925190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10354,"internal_metadata":246798222},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1970,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2529,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.477824"},"pg_stats":[{"pgid":"4.3f","version":"61'404","reported_seq":563,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724420+0000","last_change":"2024-09-12T22:48:05.174190+0000","last_active":"2024-09-12T22:51:05.724420+0000","last_peered":"2024-09-12T22:51:05.724420+0000","last_clean":"2024-09-12T22:51:05.724420+0000","last_became_active":"2024-09-12T22:48:05.172964+0000","last_became_peered":"2024-09-12T22:48:05.172964+0000","last_unstale":"2024-09-12T22:51:05.724420+0000","last_undegraded":"2024-09-12T22:51:05.724420+0000","last_fullsized":"2024-09-12T22:51:05.724420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:49.868891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9582,"num_write":371,"num_write_kb":42180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"61'425","reported_seq":633,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724097+0000","last_change":"2024-09-12T22:48:05.173045+0000","last_active":"2024-09-12T22:51:05.724097+0000","last_peered":"2024-09-12T22:51:05.724097+0000","last_clean":"2024-09-12T22:51:05.724097+0000","last_became_active":"2024-09-12T22:48:05.172684+0000","last_became_peered":"2024-09-12T22:48:05.172684+0000","last_unstale":"2024-09-12T22:51:05.724097+0000","last_undegraded":"2024-09-12T22:51:05.724097+0000","last_fullsized":"2024-09-12T22:51:05.724097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:51.360504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":40466,"num_write":394,"num_write_kb":96045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"61'385","reported_seq":516,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723911+0000","last_change":"2024-09-12T22:51:00.703306+0000","last_active":"2024-09-12T22:51:05.723911+0000","last_peered":"2024-09-12T22:51:05.723911+0000","last_clean":"2024-09-12T22:51:05.723911+0000","last_became_active":"2024-09-12T22:51:00.700490+0000","last_became_peered":"2024-09-12T22:51:00.700490+0000","last_unstale":"2024-09-12T22:51:05.723911+0000","last_undegraded":"2024-09-12T22:51:05.723911+0000","last_fullsized":"2024-09-12T22:51:05.723911+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:16.055859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":7348,"num_write":352,"num_write_kb":34517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"61'395","reported_seq":563,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723474+0000","last_change":"2024-09-12T22:51:02.711764+0000","last_active":"2024-09-12T22:51:05.723474+0000","last_peered":"2024-09-12T22:51:05.723474+0000","last_clean":"2024-09-12T22:51:05.723474+0000","last_became_active":"2024-09-12T22:51:02.708216+0000","last_became_peered":"2024-09-12T22:51:02.708216+0000","last_unstale":"2024-09-12T22:51:05.723474+0000","last_undegraded":"2024-09-12T22:51:05.723474+0000","last_fullsized":"2024-09-12T22:51:05.723474+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:24.442976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":25803,"num_write":361,"num_write_kb":71646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"61'410","reported_seq":573,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723888+0000","last_change":"2024-09-12T22:48:05.170306+0000","last_active":"2024-09-12T22:51:05.723888+0000","last_peered":"2024-09-12T22:51:05.723888+0000","last_clean":"2024-09-12T22:51:05.723888+0000","last_became_active":"2024-09-12T22:48:05.169940+0000","last_became_peered":"2024-09-12T22:48:05.169940+0000","last_unstale":"2024-09-12T22:51:05.723888+0000","last_undegraded":"2024-09-12T22:51:05.723888+0000","last_fullsized":"2024-09-12T22:51:05.723888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:52.341512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":20544,"num_write":387,"num_write_kb":55745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"61'384","reported_seq":499,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723190+0000","last_change":"2024-09-12T22:51:03.706817+0000","last_active":"2024-09-12T22:51:05.723190+0000","last_peered":"2024-09-12T22:51:05.723190+0000","last_clean":"2024-09-12T22:51:05.723190+0000","last_became_active":"2024-09-12T22:51:03.704293+0000","last_became_peered":"2024-09-12T22:51:03.704293+0000","last_unstale":"2024-09-12T22:51:05.723190+0000","last_undegraded":"2024-09-12T22:51:05.723190+0000","last_fullsized":"2024-09-12T22:51:05.723190+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:07.148926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5069,"num_write":355,"num_write_kb":38430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"61'461","reported_seq":656,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723091+0000","last_change":"2024-09-12T22:50:56.858810+0000","last_active":"2024-09-12T22:51:05.723091+0000","last_peered":"2024-09-12T22:51:05.723091+0000","last_clean":"2024-09-12T22:51:05.723091+0000","last_became_active":"2024-09-12T22:50:56.856720+0000","last_became_peered":"2024-09-12T22:50:56.856720+0000","last_unstale":"2024-09-12T22:51:05.723091+0000","last_undegraded":"2024-09-12T22:51:05.723091+0000","last_fullsized":"2024-09-12T22:51:05.723091+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:21.599293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":30574,"num_write":435,"num_write_kb":92996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"61'385","reported_seq":518,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722895+0000","last_change":"2024-09-12T22:51:00.703157+0000","last_active":"2024-09-12T22:51:05.722895+0000","last_peered":"2024-09-12T22:51:05.722895+0000","last_clean":"2024-09-12T22:51:05.722895+0000","last_became_active":"2024-09-12T22:51:00.700472+0000","last_became_peered":"2024-09-12T22:51:00.700472+0000","last_unstale":"2024-09-12T22:51:05.722895+0000","last_undegraded":"2024-09-12T22:51:05.722895+0000","last_fullsized":"2024-09-12T22:51:05.722895+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:07.616061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9031,"num_write":340,"num_write_kb":84729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"61'435","reported_seq":585,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343462+0000","last_change":"2024-09-12T22:48:05.178445+0000","last_active":"2024-09-12T22:51:06.343462+0000","last_peered":"2024-09-12T22:51:06.343462+0000","last_clean":"2024-09-12T22:51:06.343462+0000","last_became_active":"2024-09-12T22:48:05.177284+0000","last_became_peered":"2024-09-12T22:48:05.177284+0000","last_unstale":"2024-09-12T22:51:06.343462+0000","last_undegraded":"2024-09-12T22:51:06.343462+0000","last_fullsized":"2024-09-12T22:51:06.343462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:45.140060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8316,"num_write":403,"num_write_kb":71851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"61'443","reported_seq":648,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724176+0000","last_change":"2024-09-12T22:48:05.172480+0000","last_active":"2024-09-12T22:51:05.724176+0000","last_peered":"2024-09-12T22:51:05.724176+0000","last_clean":"2024-09-12T22:51:05.724176+0000","last_became_active":"2024-09-12T22:48:05.171686+0000","last_became_peered":"2024-09-12T22:48:05.171686+0000","last_unstale":"2024-09-12T22:51:05.724176+0000","last_undegraded":"2024-09-12T22:51:05.724176+0000","last_fullsized":"2024-09-12T22:51:05.724176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:56.158813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40751,"num_write":407,"num_write_kb":116626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"61'383","reported_seq":509,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723914+0000","last_change":"2024-09-12T22:51:02.712354+0000","last_active":"2024-09-12T22:51:05.723914+0000","last_peered":"2024-09-12T22:51:05.723914+0000","last_clean":"2024-09-12T22:51:05.723914+0000","last_became_active":"2024-09-12T22:51:02.710579+0000","last_became_peered":"2024-09-12T22:51:02.710579+0000","last_unstale":"2024-09-12T22:51:05.723914+0000","last_undegraded":"2024-09-12T22:51:05.723914+0000","last_fullsized":"2024-09-12T22:51:05.723914+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:58:11.483150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5475,"num_write":365,"num_write_kb":63204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"61'366","reported_seq":891,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723891+0000","last_change":"2024-09-12T22:50:58.699684+0000","last_active":"2024-09-12T22:51:05.723891+0000","last_peered":"2024-09-12T22:51:05.723891+0000","last_clean":"2024-09-12T22:51:05.723891+0000","last_became_active":"2024-09-12T22:50:58.698711+0000","last_became_peered":"2024-09-12T22:50:58.698711+0000","last_unstale":"2024-09-12T22:51:05.723891+0000","last_undegraded":"2024-09-12T22:51:05.723891+0000","last_fullsized":"2024-09-12T22:51:05.723891+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:47.507555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":35222,"num_write":342,"num_write_kb":74947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"61'434","reported_seq":622,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723644+0000","last_change":"2024-09-12T22:48:05.171356+0000","last_active":"2024-09-12T22:51:05.723644+0000","last_peered":"2024-09-12T22:51:05.723644+0000","last_clean":"2024-09-12T22:51:05.723644+0000","last_became_active":"2024-09-12T22:48:05.170794+0000","last_became_peered":"2024-09-12T22:48:05.170794+0000","last_unstale":"2024-09-12T22:51:05.723644+0000","last_undegraded":"2024-09-12T22:51:05.723644+0000","last_fullsized":"2024-09-12T22:51:05.723644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:42:56.969660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":19623,"num_write":389,"num_write_kb":83457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"61'432","reported_seq":601,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723150+0000","last_change":"2024-09-12T22:50:58.702236+0000","last_active":"2024-09-12T22:51:05.723150+0000","last_peered":"2024-09-12T22:51:05.723150+0000","last_clean":"2024-09-12T22:51:05.723150+0000","last_became_active":"2024-09-12T22:50:58.700107+0000","last_became_peered":"2024-09-12T22:50:58.700107+0000","last_unstale":"2024-09-12T22:51:05.723150+0000","last_undegraded":"2024-09-12T22:51:05.723150+0000","last_fullsized":"2024-09-12T22:51:05.723150+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:29.112353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":23332,"num_write":401,"num_write_kb":75871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"61'406","reported_seq":573,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723029+0000","last_change":"2024-09-12T22:50:55.852257+0000","last_active":"2024-09-12T22:51:05.723029+0000","last_peered":"2024-09-12T22:51:05.723029+0000","last_clean":"2024-09-12T22:51:05.723029+0000","last_became_active":"2024-09-12T22:50:55.849568+0000","last_became_peered":"2024-09-12T22:50:55.849568+0000","last_unstale":"2024-09-12T22:51:05.723029+0000","last_undegraded":"2024-09-12T22:51:05.723029+0000","last_fullsized":"2024-09-12T22:51:05.723029+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:49.995990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":18162,"num_write":365,"num_write_kb":58919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"61'444","reported_seq":575,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723061+0000","last_change":"2024-09-12T22:51:01.704325+0000","last_active":"2024-09-12T22:51:05.723061+0000","last_peered":"2024-09-12T22:51:05.723061+0000","last_clean":"2024-09-12T22:51:05.723061+0000","last_became_active":"2024-09-12T22:51:01.700744+0000","last_became_peered":"2024-09-12T22:51:01.700744+0000","last_unstale":"2024-09-12T22:51:05.723061+0000","last_undegraded":"2024-09-12T22:51:05.723061+0000","last_fullsized":"2024-09-12T22:51:05.723061+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:00.747671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":410,"num_write_kb":63144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"61'443","reported_seq":616,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343794+0000","last_change":"2024-09-12T22:48:05.178721+0000","last_active":"2024-09-12T22:51:06.343794+0000","last_peered":"2024-09-12T22:51:06.343794+0000","last_clean":"2024-09-12T22:51:06.343794+0000","last_became_active":"2024-09-12T22:48:05.177965+0000","last_became_peered":"2024-09-12T22:48:05.177965+0000","last_unstale":"2024-09-12T22:51:06.343794+0000","last_undegraded":"2024-09-12T22:51:06.343794+0000","last_fullsized":"2024-09-12T22:51:06.343794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:32.288419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":14687,"num_write":408,"num_write_kb":80026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"61'439","reported_seq":665,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724329+0000","last_change":"2024-09-12T22:48:05.171053+0000","last_active":"2024-09-12T22:51:05.724329+0000","last_peered":"2024-09-12T22:51:05.724329+0000","last_clean":"2024-09-12T22:51:05.724329+0000","last_became_active":"2024-09-12T22:48:05.170578+0000","last_became_peered":"2024-09-12T22:48:05.170578+0000","last_unstale":"2024-09-12T22:51:05.724329+0000","last_undegraded":"2024-09-12T22:51:05.724329+0000","last_fullsized":"2024-09-12T22:51:05.724329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:58.991752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":47063,"num_write":400,"num_write_kb":100535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"61'444","reported_seq":660,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343268+0000","last_change":"2024-09-12T22:48:05.177369+0000","last_active":"2024-09-12T22:51:06.343268+0000","last_peered":"2024-09-12T22:51:06.343268+0000","last_clean":"2024-09-12T22:51:06.343268+0000","last_became_active":"2024-09-12T22:48:05.176680+0000","last_became_peered":"2024-09-12T22:48:05.176680+0000","last_unstale":"2024-09-12T22:51:06.343268+0000","last_undegraded":"2024-09-12T22:51:06.343268+0000","last_fullsized":"2024-09-12T22:51:06.343268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:25.143572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":42758,"num_write":403,"num_write_kb":67827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"61'433","reported_seq":570,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723656+0000","last_change":"2024-09-12T22:51:02.711577+0000","last_active":"2024-09-12T22:51:05.723656+0000","last_peered":"2024-09-12T22:51:05.723656+0000","last_clean":"2024-09-12T22:51:05.723656+0000","last_became_active":"2024-09-12T22:51:02.708090+0000","last_became_peered":"2024-09-12T22:51:02.708090+0000","last_unstale":"2024-09-12T22:51:05.723656+0000","last_undegraded":"2024-09-12T22:51:05.723656+0000","last_fullsized":"2024-09-12T22:51:05.723656+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:32.441902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":10750,"num_write":397,"num_write_kb":34708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"61'413","reported_seq":588,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723473+0000","last_change":"2024-09-12T22:50:58.702132+0000","last_active":"2024-09-12T22:51:05.723473+0000","last_peered":"2024-09-12T22:51:05.723473+0000","last_clean":"2024-09-12T22:51:05.723473+0000","last_became_active":"2024-09-12T22:50:58.699982+0000","last_became_peered":"2024-09-12T22:50:58.699982+0000","last_unstale":"2024-09-12T22:51:05.723473+0000","last_undegraded":"2024-09-12T22:51:05.723473+0000","last_fullsized":"2024-09-12T22:51:05.723473+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:03.458952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":25621,"num_write":385,"num_write_kb":63908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"61'462","reported_seq":1066,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723490+0000","last_change":"2024-09-12T22:50:58.701216+0000","last_active":"2024-09-12T22:51:05.723490+0000","last_peered":"2024-09-12T22:51:05.723490+0000","last_clean":"2024-09-12T22:51:05.723490+0000","last_became_active":"2024-09-12T22:50:58.700047+0000","last_became_peered":"2024-09-12T22:50:58.700047+0000","last_unstale":"2024-09-12T22:51:05.723490+0000","last_undegraded":"2024-09-12T22:51:05.723490+0000","last_fullsized":"2024-09-12T22:51:05.723490+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:51.010136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28920,"num_write":428,"num_write_kb":76277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"61'413","reported_seq":948,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342393+0000","last_change":"2024-09-12T22:50:57.861973+0000","last_active":"2024-09-12T22:51:06.342393+0000","last_peered":"2024-09-12T22:51:06.342393+0000","last_clean":"2024-09-12T22:51:06.342393+0000","last_became_active":"2024-09-12T22:50:57.860819+0000","last_became_peered":"2024-09-12T22:50:57.860819+0000","last_unstale":"2024-09-12T22:51:06.342393+0000","last_undegraded":"2024-09-12T22:51:06.342393+0000","last_fullsized":"2024-09-12T22:51:06.342393+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:52.977617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":14661,"num_write":381,"num_write_kb":72596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"61'475","reported_seq":680,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723273+0000","last_change":"2024-09-12T22:48:05.172794+0000","last_active":"2024-09-12T22:51:05.723273+0000","last_peered":"2024-09-12T22:51:05.723273+0000","last_clean":"2024-09-12T22:51:05.723273+0000","last_became_active":"2024-09-12T22:48:05.172437+0000","last_became_peered":"2024-09-12T22:48:05.172437+0000","last_unstale":"2024-09-12T22:51:05.723273+0000","last_undegraded":"2024-09-12T22:51:05.723273+0000","last_fullsized":"2024-09-12T22:51:05.723273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:54:44.278646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":32397,"num_write":452,"num_write_kb":105406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"61'413","reported_seq":963,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724480+0000","last_change":"2024-09-12T22:51:02.709686+0000","last_active":"2024-09-12T22:51:05.724480+0000","last_peered":"2024-09-12T22:51:05.724480+0000","last_clean":"2024-09-12T22:51:05.724480+0000","last_became_active":"2024-09-12T22:51:02.708084+0000","last_became_peered":"2024-09-12T22:51:02.708084+0000","last_unstale":"2024-09-12T22:51:05.724480+0000","last_undegraded":"2024-09-12T22:51:05.724480+0000","last_fullsized":"2024-09-12T22:51:05.724480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:27.765575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4773,"num_write":395,"num_write_kb":21871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"61'453","reported_seq":1027,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343514+0000","last_change":"2024-09-12T22:50:58.700787+0000","last_active":"2024-09-12T22:51:06.343514+0000","last_peered":"2024-09-12T22:51:06.343514+0000","last_clean":"2024-09-12T22:51:06.343514+0000","last_became_active":"2024-09-12T22:50:58.699585+0000","last_became_peered":"2024-09-12T22:50:58.699585+0000","last_unstale":"2024-09-12T22:51:06.343514+0000","last_undegraded":"2024-09-12T22:51:06.343514+0000","last_fullsized":"2024-09-12T22:51:06.343514+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:44.083029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18201,"num_write":409,"num_write_kb":47008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"61'402","reported_seq":571,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723791+0000","last_change":"2024-09-12T22:51:01.704826+0000","last_active":"2024-09-12T22:51:05.723791+0000","last_peered":"2024-09-12T22:51:05.723791+0000","last_clean":"2024-09-12T22:51:05.723791+0000","last_became_active":"2024-09-12T22:51:01.701850+0000","last_became_peered":"2024-09-12T22:51:01.701850+0000","last_unstale":"2024-09-12T22:51:05.723791+0000","last_undegraded":"2024-09-12T22:51:05.723791+0000","last_fullsized":"2024-09-12T22:51:05.723791+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:44:29.380608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":21641,"num_write":372,"num_write_kb":63613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"61'436","reported_seq":1073,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724130+0000","last_change":"2024-09-12T22:50:59.703836+0000","last_active":"2024-09-12T22:51:05.724130+0000","last_peered":"2024-09-12T22:51:05.724130+0000","last_clean":"2024-09-12T22:51:05.724130+0000","last_became_active":"2024-09-12T22:50:59.702766+0000","last_became_peered":"2024-09-12T22:50:59.702766+0000","last_unstale":"2024-09-12T22:51:05.724130+0000","last_undegraded":"2024-09-12T22:51:05.724130+0000","last_fullsized":"2024-09-12T22:51:05.724130+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:52.977617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":65550,"num_write":412,"num_write_kb":134233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"61'393","reported_seq":590,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343137+0000","last_change":"2024-09-12T22:48:05.177176+0000","last_active":"2024-09-12T22:51:06.343137+0000","last_peered":"2024-09-12T22:51:06.343137+0000","last_clean":"2024-09-12T22:51:06.343137+0000","last_became_active":"2024-09-12T22:48:05.176735+0000","last_became_peered":"2024-09-12T22:48:05.176735+0000","last_unstale":"2024-09-12T22:51:06.343137+0000","last_undegraded":"2024-09-12T22:51:06.343137+0000","last_fullsized":"2024-09-12T22:51:06.343137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:51.360504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":36009,"num_write":361,"num_write_kb":71487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"61'456","reported_seq":1019,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723644+0000","last_change":"2024-09-12T22:51:00.699523+0000","last_active":"2024-09-12T22:51:05.723644+0000","last_peered":"2024-09-12T22:51:05.723644+0000","last_clean":"2024-09-12T22:51:05.723644+0000","last_became_active":"2024-09-12T22:51:00.698377+0000","last_became_peered":"2024-09-12T22:51:00.698377+0000","last_unstale":"2024-09-12T22:51:05.723644+0000","last_undegraded":"2024-09-12T22:51:05.723644+0000","last_fullsized":"2024-09-12T22:51:05.723644+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:04:47.810227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4316,"num_write":417,"num_write_kb":34284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"61'440","reported_seq":614,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342570+0000","last_change":"2024-09-12T22:48:05.176878+0000","last_active":"2024-09-12T22:51:06.342570+0000","last_peered":"2024-09-12T22:51:06.342570+0000","last_clean":"2024-09-12T22:51:06.342570+0000","last_became_active":"2024-09-12T22:48:05.176327+0000","last_became_peered":"2024-09-12T22:48:05.176327+0000","last_unstale":"2024-09-12T22:51:06.342570+0000","last_undegraded":"2024-09-12T22:51:06.342570+0000","last_fullsized":"2024-09-12T22:51:06.342570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:11.781766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15052,"num_write":399,"num_write_kb":71703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"61'424","reported_seq":582,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722737+0000","last_change":"2024-09-12T22:51:01.704366+0000","last_active":"2024-09-12T22:51:05.722737+0000","last_peered":"2024-09-12T22:51:05.722737+0000","last_clean":"2024-09-12T22:51:05.722737+0000","last_became_active":"2024-09-12T22:51:01.700878+0000","last_became_peered":"2024-09-12T22:51:01.700878+0000","last_unstale":"2024-09-12T22:51:05.722737+0000","last_undegraded":"2024-09-12T22:51:05.722737+0000","last_fullsized":"2024-09-12T22:51:05.722737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:57.250980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25587,"num_write":397,"num_write_kb":46651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"61'384","reported_seq":545,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724020+0000","last_change":"2024-09-12T22:48:05.171573+0000","last_active":"2024-09-12T22:51:05.724020+0000","last_peered":"2024-09-12T22:51:05.724020+0000","last_clean":"2024-09-12T22:51:05.724020+0000","last_became_active":"2024-09-12T22:48:05.171036+0000","last_became_peered":"2024-09-12T22:48:05.171036+0000","last_unstale":"2024-09-12T22:51:05.724020+0000","last_undegraded":"2024-09-12T22:51:05.724020+0000","last_fullsized":"2024-09-12T22:51:05.724020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:27:07.558853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9715,"num_write":345,"num_write_kb":63048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"61'450","reported_seq":585,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723240+0000","last_change":"2024-09-12T22:50:55.851831+0000","last_active":"2024-09-12T22:51:05.723240+0000","last_peered":"2024-09-12T22:51:05.723240+0000","last_clean":"2024-09-12T22:51:05.723240+0000","last_became_active":"2024-09-12T22:50:55.851443+0000","last_became_peered":"2024-09-12T22:50:55.851443+0000","last_unstale":"2024-09-12T22:51:05.723240+0000","last_undegraded":"2024-09-12T22:51:05.723240+0000","last_fullsized":"2024-09-12T22:51:05.723240+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:25:19.575346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":387,"num_write_kb":8369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"61'389","reported_seq":568,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724238+0000","last_change":"2024-09-12T22:48:05.173585+0000","last_active":"2024-09-12T22:51:05.724238+0000","last_peered":"2024-09-12T22:51:05.724238+0000","last_clean":"2024-09-12T22:51:05.724238+0000","last_became_active":"2024-09-12T22:48:05.172801+0000","last_became_peered":"2024-09-12T22:48:05.172801+0000","last_unstale":"2024-09-12T22:51:05.724238+0000","last_undegraded":"2024-09-12T22:51:05.724238+0000","last_fullsized":"2024-09-12T22:51:05.724238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:45.140060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":21115,"num_write":354,"num_write_kb":59128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"61'60","reported_seq":206,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342908+0000","last_change":"2024-09-12T22:50:52.860336+0000","last_active":"2024-09-12T22:51:06.342908+0000","last_peered":"2024-09-12T22:51:06.342908+0000","last_clean":"2024-09-12T22:51:06.342908+0000","last_became_active":"2024-09-12T22:50:52.859975+0000","last_became_peered":"2024-09-12T22:50:52.859975+0000","last_unstale":"2024-09-12T22:51:06.342908+0000","last_undegraded":"2024-09-12T22:51:06.342908+0000","last_fullsized":"2024-09-12T22:51:06.342908+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:14.260183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"61'433","reported_seq":997,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342401+0000","last_change":"2024-09-12T22:50:57.863647+0000","last_active":"2024-09-12T22:51:06.342401+0000","last_peered":"2024-09-12T22:51:06.342401+0000","last_clean":"2024-09-12T22:51:06.342401+0000","last_became_active":"2024-09-12T22:50:57.861719+0000","last_became_peered":"2024-09-12T22:50:57.861719+0000","last_unstale":"2024-09-12T22:51:06.342401+0000","last_undegraded":"2024-09-12T22:51:06.342401+0000","last_fullsized":"2024-09-12T22:51:06.342401+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:04:47.810227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17599,"num_write":404,"num_write_kb":59440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"61'63","reported_seq":209,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723521+0000","last_change":"2024-09-12T22:50:52.857615+0000","last_active":"2024-09-12T22:51:05.723521+0000","last_peered":"2024-09-12T22:51:05.723521+0000","last_clean":"2024-09-12T22:51:05.723521+0000","last_became_active":"2024-09-12T22:50:52.857343+0000","last_became_peered":"2024-09-12T22:50:52.857343+0000","last_unstale":"2024-09-12T22:51:05.723521+0000","last_undegraded":"2024-09-12T22:51:05.723521+0000","last_fullsized":"2024-09-12T22:51:05.723521+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:44.095690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"61'407","reported_seq":932,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343467+0000","last_change":"2024-09-12T22:50:55.853362+0000","last_active":"2024-09-12T22:51:06.343467+0000","last_peered":"2024-09-12T22:51:06.343467+0000","last_clean":"2024-09-12T22:51:06.343467+0000","last_became_active":"2024-09-12T22:50:55.851934+0000","last_became_peered":"2024-09-12T22:50:55.851934+0000","last_unstale":"2024-09-12T22:51:06.343467+0000","last_undegraded":"2024-09-12T22:51:06.343467+0000","last_fullsized":"2024-09-12T22:51:06.343467+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:51.010136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":24842,"num_write":378,"num_write_kb":79144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"61'62","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722703+0000","last_change":"2024-09-12T22:50:52.859828+0000","last_active":"2024-09-12T22:51:05.722703+0000","last_peered":"2024-09-12T22:51:05.722703+0000","last_clean":"2024-09-12T22:51:05.722703+0000","last_became_active":"2024-09-12T22:50:52.858911+0000","last_became_peered":"2024-09-12T22:50:52.858911+0000","last_unstale":"2024-09-12T22:51:05.722703+0000","last_undegraded":"2024-09-12T22:51:05.722703+0000","last_fullsized":"2024-09-12T22:51:05.722703+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:44.358340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"61'152","reported_seq":288,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723962+0000","last_change":"2024-09-12T22:50:55.851865+0000","last_active":"2024-09-12T22:51:05.723962+0000","last_peered":"2024-09-12T22:51:05.723962+0000","last_clean":"2024-09-12T22:51:05.723962+0000","last_became_active":"2024-09-12T22:50:55.851050+0000","last_became_peered":"2024-09-12T22:50:55.851050+0000","last_unstale":"2024-09-12T22:51:05.723962+0000","last_undegraded":"2024-09-12T22:51:05.723962+0000","last_fullsized":"2024-09-12T22:51:05.723962+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:31:24.219732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"61'392","reported_seq":890,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723334+0000","last_change":"2024-09-12T22:50:56.855073+0000","last_active":"2024-09-12T22:51:05.723334+0000","last_peered":"2024-09-12T22:51:05.723334+0000","last_clean":"2024-09-12T22:51:05.723334+0000","last_became_active":"2024-09-12T22:50:56.853383+0000","last_became_peered":"2024-09-12T22:50:56.853383+0000","last_unstale":"2024-09-12T22:51:05.723334+0000","last_undegraded":"2024-09-12T22:51:05.723334+0000","last_fullsized":"2024-09-12T22:51:05.723334+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:18.644500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":9675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"61'237","reported_seq":390,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724440+0000","last_change":"2024-09-12T22:50:55.852418+0000","last_active":"2024-09-12T22:51:05.724440+0000","last_peered":"2024-09-12T22:51:05.724440+0000","last_clean":"2024-09-12T22:51:05.724440+0000","last_became_active":"2024-09-12T22:50:55.852034+0000","last_became_peered":"2024-09-12T22:50:55.852034+0000","last_unstale":"2024-09-12T22:51:05.724440+0000","last_undegraded":"2024-09-12T22:51:05.724440+0000","last_fullsized":"2024-09-12T22:51:05.724440+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:47.161147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"61'464","reported_seq":637,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723400+0000","last_change":"2024-09-12T22:48:05.171143+0000","last_active":"2024-09-12T22:51:05.723400+0000","last_peered":"2024-09-12T22:51:05.723400+0000","last_clean":"2024-09-12T22:51:05.723400+0000","last_became_active":"2024-09-12T22:48:05.170374+0000","last_became_peered":"2024-09-12T22:48:05.170374+0000","last_unstale":"2024-09-12T22:51:05.723400+0000","last_undegraded":"2024-09-12T22:51:05.723400+0000","last_fullsized":"2024-09-12T22:51:05.723400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:15.887977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15522,"num_write":440,"num_write_kb":60335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"61'470","reported_seq":606,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723638+0000","last_change":"2024-09-12T22:50:55.852447+0000","last_active":"2024-09-12T22:51:05.723638+0000","last_peered":"2024-09-12T22:51:05.723638+0000","last_clean":"2024-09-12T22:51:05.723638+0000","last_became_active":"2024-09-12T22:50:55.852074+0000","last_became_peered":"2024-09-12T22:50:55.852074+0000","last_unstale":"2024-09-12T22:51:05.723638+0000","last_undegraded":"2024-09-12T22:51:05.723638+0000","last_fullsized":"2024-09-12T22:51:05.723638+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:24.010030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":4267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"61'449","reported_seq":636,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723253+0000","last_change":"2024-09-12T22:51:00.701817+0000","last_active":"2024-09-12T22:51:05.723253+0000","last_peered":"2024-09-12T22:51:05.723253+0000","last_clean":"2024-09-12T22:51:05.723253+0000","last_became_active":"2024-09-12T22:51:00.699592+0000","last_became_peered":"2024-09-12T22:51:00.699592+0000","last_unstale":"2024-09-12T22:51:05.723253+0000","last_undegraded":"2024-09-12T22:51:05.723253+0000","last_fullsized":"2024-09-12T22:51:05.723253+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:11.924779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":36634,"num_write":415,"num_write_kb":84238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"61'52","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723477+0000","last_change":"2024-09-12T22:50:52.857863+0000","last_active":"2024-09-12T22:51:05.723477+0000","last_peered":"2024-09-12T22:51:05.723477+0000","last_clean":"2024-09-12T22:51:05.723477+0000","last_became_active":"2024-09-12T22:50:52.857342+0000","last_became_peered":"2024-09-12T22:50:52.857342+0000","last_unstale":"2024-09-12T22:51:05.723477+0000","last_undegraded":"2024-09-12T22:51:05.723477+0000","last_fullsized":"2024-09-12T22:51:05.723477+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:59.906052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"61'434","reported_seq":1027,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343139+0000","last_change":"2024-09-12T22:50:58.701303+0000","last_active":"2024-09-12T22:51:06.343139+0000","last_peered":"2024-09-12T22:51:06.343139+0000","last_clean":"2024-09-12T22:51:06.343139+0000","last_became_active":"2024-09-12T22:50:58.700178+0000","last_became_peered":"2024-09-12T22:50:58.700178+0000","last_unstale":"2024-09-12T22:51:06.343139+0000","last_undegraded":"2024-09-12T22:51:06.343139+0000","last_fullsized":"2024-09-12T22:51:06.343139+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:13:37.634120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":39364,"num_write":402,"num_write_kb":59313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"61'194","reported_seq":349,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343266+0000","last_change":"2024-09-12T22:50:55.852827+0000","last_active":"2024-09-12T22:51:06.343266+0000","last_peered":"2024-09-12T22:51:06.343266+0000","last_clean":"2024-09-12T22:51:06.343266+0000","last_became_active":"2024-09-12T22:50:55.852479+0000","last_became_peered":"2024-09-12T22:50:55.852479+0000","last_unstale":"2024-09-12T22:51:06.343266+0000","last_undegraded":"2024-09-12T22:51:06.343266+0000","last_fullsized":"2024-09-12T22:51:06.343266+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:17.642880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"61'457","reported_seq":591,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723790+0000","last_change":"2024-09-12T22:51:03.707374+0000","last_active":"2024-09-12T22:51:05.723790+0000","last_peered":"2024-09-12T22:51:05.723790+0000","last_clean":"2024-09-12T22:51:05.723790+0000","last_became_active":"2024-09-12T22:51:03.704514+0000","last_became_peered":"2024-09-12T22:51:03.704514+0000","last_unstale":"2024-09-12T22:51:05.723790+0000","last_undegraded":"2024-09-12T22:51:05.723790+0000","last_fullsized":"2024-09-12T22:51:05.723790+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:13.942017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10832,"num_write":419,"num_write_kb":34901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"61'106","reported_seq":232,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722915+0000","last_change":"2024-09-12T22:50:55.851086+0000","last_active":"2024-09-12T22:51:05.722915+0000","last_peered":"2024-09-12T22:51:05.722915+0000","last_clean":"2024-09-12T22:51:05.722915+0000","last_became_active":"2024-09-12T22:50:55.850764+0000","last_became_peered":"2024-09-12T22:50:55.850764+0000","last_unstale":"2024-09-12T22:51:05.722915+0000","last_undegraded":"2024-09-12T22:51:05.722915+0000","last_fullsized":"2024-09-12T22:51:05.722915+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:26.058872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"61'431","reported_seq":571,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723616+0000","last_change":"2024-09-12T22:51:02.710383+0000","last_active":"2024-09-12T22:51:05.723616+0000","last_peered":"2024-09-12T22:51:05.723616+0000","last_clean":"2024-09-12T22:51:05.723616+0000","last_became_active":"2024-09-12T22:51:02.707646+0000","last_became_peered":"2024-09-12T22:51:02.707646+0000","last_unstale":"2024-09-12T22:51:05.723616+0000","last_undegraded":"2024-09-12T22:51:05.723616+0000","last_fullsized":"2024-09-12T22:51:05.723616+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:41.956076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":10443,"num_write":392,"num_write_kb":63957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"61'49","reported_seq":195,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723628+0000","last_change":"2024-09-12T22:50:52.857609+0000","last_active":"2024-09-12T22:51:05.723628+0000","last_peered":"2024-09-12T22:51:05.723628+0000","last_clean":"2024-09-12T22:51:05.723628+0000","last_became_active":"2024-09-12T22:50:52.857301+0000","last_became_peered":"2024-09-12T22:50:52.857301+0000","last_unstale":"2024-09-12T22:51:05.723628+0000","last_undegraded":"2024-09-12T22:51:05.723628+0000","last_fullsized":"2024-09-12T22:51:05.723628+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:43.328264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"61'351","reported_seq":475,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723979+0000","last_change":"2024-09-12T22:50:56.855396+0000","last_active":"2024-09-12T22:51:05.723979+0000","last_peered":"2024-09-12T22:51:05.723979+0000","last_clean":"2024-09-12T22:51:05.723979+0000","last_became_active":"2024-09-12T22:50:56.853610+0000","last_became_peered":"2024-09-12T22:50:56.853610+0000","last_unstale":"2024-09-12T22:51:05.723979+0000","last_undegraded":"2024-09-12T22:51:05.723979+0000","last_fullsized":"2024-09-12T22:51:05.723979+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:01.946701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":137,"num_write":315,"num_write_kb":37943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"61'588","reported_seq":727,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723397+0000","last_change":"2024-09-12T22:48:04.174281+0000","last_active":"2024-09-12T22:51:05.723397+0000","last_peered":"2024-09-12T22:51:05.723397+0000","last_clean":"2024-09-12T22:51:05.723397+0000","last_became_active":"2024-09-12T22:48:04.173942+0000","last_became_peered":"2024-09-12T22:48:04.173942+0000","last_unstale":"2024-09-12T22:51:05.723397+0000","last_undegraded":"2024-09-12T22:51:05.723397+0000","last_fullsized":"2024-09-12T22:51:05.723397+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:19:38.546747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":4334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"61'400","reported_seq":560,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343593+0000","last_change":"2024-09-12T22:48:05.178246+0000","last_active":"2024-09-12T22:51:06.343593+0000","last_peered":"2024-09-12T22:51:06.343593+0000","last_clean":"2024-09-12T22:51:06.343593+0000","last_became_active":"2024-09-12T22:48:05.176813+0000","last_became_peered":"2024-09-12T22:48:05.176813+0000","last_unstale":"2024-09-12T22:51:06.343593+0000","last_undegraded":"2024-09-12T22:51:06.343593+0000","last_fullsized":"2024-09-12T22:51:06.343593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:58.991752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":9179,"num_write":363,"num_write_kb":67046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":242,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722613+0000","last_change":"2024-09-12T22:50:52.860243+0000","last_active":"2024-09-12T22:51:05.722613+0000","last_peered":"2024-09-12T22:51:05.722613+0000","last_clean":"2024-09-12T22:51:05.722613+0000","last_became_active":"2024-09-12T22:50:52.859754+0000","last_became_peered":"2024-09-12T22:50:52.859754+0000","last_unstale":"2024-09-12T22:51:05.722613+0000","last_undegraded":"2024-09-12T22:51:05.722613+0000","last_fullsized":"2024-09-12T22:51:05.722613+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:55.016634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:55.016634+0000","last_clean_scrub_stamp":"2024-09-12T22:47:55.016634+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:41:30.207577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722981+0000","last_change":"2024-09-12T22:50:52.858727+0000","last_active":"2024-09-12T22:51:05.722981+0000","last_peered":"2024-09-12T22:51:05.722981+0000","last_clean":"2024-09-12T22:51:05.722981+0000","last_became_active":"2024-09-12T22:50:52.857759+0000","last_became_peered":"2024-09-12T22:50:52.857759+0000","last_unstale":"2024-09-12T22:51:05.722981+0000","last_undegraded":"2024-09-12T22:51:05.722981+0000","last_fullsized":"2024-09-12T22:51:05.722981+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:52.160461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"61'506","reported_seq":645,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343027+0000","last_change":"2024-09-12T22:48:04.169704+0000","last_active":"2024-09-12T22:51:06.343027+0000","last_peered":"2024-09-12T22:51:06.343027+0000","last_clean":"2024-09-12T22:51:06.343027+0000","last_became_active":"2024-09-12T22:48:04.169474+0000","last_became_peered":"2024-09-12T22:48:04.169474+0000","last_unstale":"2024-09-12T22:51:06.343027+0000","last_undegraded":"2024-09-12T22:51:06.343027+0000","last_fullsized":"2024-09-12T22:51:06.343027+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:00.271198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":444,"num_write_kb":8407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"61'422","reported_seq":595,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723784+0000","last_change":"2024-09-12T22:51:00.700237+0000","last_active":"2024-09-12T22:51:05.723784+0000","last_peered":"2024-09-12T22:51:05.723784+0000","last_clean":"2024-09-12T22:51:05.723784+0000","last_became_active":"2024-09-12T22:51:00.698391+0000","last_became_peered":"2024-09-12T22:51:00.698391+0000","last_unstale":"2024-09-12T22:51:05.723784+0000","last_undegraded":"2024-09-12T22:51:05.723784+0000","last_fullsized":"2024-09-12T22:51:05.723784+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:19.299721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":38484,"num_write":383,"num_write_kb":67099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722904+0000","last_change":"2024-09-12T22:50:52.859530+0000","last_active":"2024-09-12T22:51:05.722904+0000","last_peered":"2024-09-12T22:51:05.722904+0000","last_clean":"2024-09-12T22:51:05.722904+0000","last_became_active":"2024-09-12T22:50:52.858480+0000","last_became_peered":"2024-09-12T22:50:52.858480+0000","last_unstale":"2024-09-12T22:51:05.722904+0000","last_undegraded":"2024-09-12T22:51:05.722904+0000","last_fullsized":"2024-09-12T22:51:05.722904+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:28:23.416675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"61'107","reported_seq":304,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342800+0000","last_change":"2024-09-12T22:50:55.853291+0000","last_active":"2024-09-12T22:51:06.342800+0000","last_peered":"2024-09-12T22:51:06.342800+0000","last_clean":"2024-09-12T22:51:06.342800+0000","last_became_active":"2024-09-12T22:50:55.852965+0000","last_became_peered":"2024-09-12T22:50:55.852965+0000","last_unstale":"2024-09-12T22:51:06.342800+0000","last_undegraded":"2024-09-12T22:51:06.342800+0000","last_fullsized":"2024-09-12T22:51:06.342800+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:46.505934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1463793,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":1459,"num_write":45,"num_write_kb":1459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1463793,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"61'436","reported_seq":618,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724236+0000","last_change":"2024-09-12T22:48:05.171819+0000","last_active":"2024-09-12T22:51:05.724236+0000","last_peered":"2024-09-12T22:51:05.724236+0000","last_clean":"2024-09-12T22:51:05.724236+0000","last_became_active":"2024-09-12T22:48:05.171293+0000","last_became_peered":"2024-09-12T22:48:05.171293+0000","last_unstale":"2024-09-12T22:51:05.724236+0000","last_undegraded":"2024-09-12T22:51:05.724236+0000","last_fullsized":"2024-09-12T22:51:05.724236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:01.401542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":27936,"num_write":401,"num_write_kb":51013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342933+0000","last_change":"2024-09-12T22:48:02.045209+0000","last_active":"2024-09-12T22:51:06.342933+0000","last_peered":"2024-09-12T22:51:06.342933+0000","last_clean":"2024-09-12T22:51:06.342933+0000","last_became_active":"2024-09-12T22:48:00.042007+0000","last_became_peered":"2024-09-12T22:48:00.042007+0000","last_unstale":"2024-09-12T22:51:06.342933+0000","last_undegraded":"2024-09-12T22:51:06.342933+0000","last_fullsized":"2024-09-12T22:51:06.342933+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:13.536542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036893100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"61'357","reported_seq":511,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723507+0000","last_change":"2024-09-12T22:50:55.852384+0000","last_active":"2024-09-12T22:51:05.723507+0000","last_peered":"2024-09-12T22:51:05.723507+0000","last_clean":"2024-09-12T22:51:05.723507+0000","last_became_active":"2024-09-12T22:50:55.852029+0000","last_became_peered":"2024-09-12T22:50:55.852029+0000","last_unstale":"2024-09-12T22:51:05.723507+0000","last_undegraded":"2024-09-12T22:51:05.723507+0000","last_fullsized":"2024-09-12T22:51:05.723507+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:59.415555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":8307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"61'343","reported_seq":503,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343598+0000","last_change":"2024-09-12T22:48:05.178865+0000","last_active":"2024-09-12T22:51:06.343598+0000","last_peered":"2024-09-12T22:51:06.343598+0000","last_clean":"2024-09-12T22:51:06.343598+0000","last_became_active":"2024-09-12T22:48:05.178010+0000","last_became_peered":"2024-09-12T22:48:05.178010+0000","last_unstale":"2024-09-12T22:51:06.343598+0000","last_undegraded":"2024-09-12T22:51:06.343598+0000","last_fullsized":"2024-09-12T22:51:06.343598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:30.120804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":6704,"num_write":316,"num_write_kb":42458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":70,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722797+0000","last_change":"2024-09-12T22:50:52.858195+0000","last_active":"2024-09-12T22:51:05.722797+0000","last_peered":"2024-09-12T22:51:05.722797+0000","last_clean":"2024-09-12T22:51:05.722797+0000","last_became_active":"2024-09-12T22:50:52.857746+0000","last_became_peered":"2024-09-12T22:50:52.857746+0000","last_unstale":"2024-09-12T22:51:05.722797+0000","last_undegraded":"2024-09-12T22:51:05.722797+0000","last_fullsized":"2024-09-12T22:51:05.722797+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:10:52.096897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052714799999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"61'78","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723018+0000","last_change":"2024-09-12T22:50:52.858808+0000","last_active":"2024-09-12T22:51:05.723018+0000","last_peered":"2024-09-12T22:51:05.723018+0000","last_clean":"2024-09-12T22:51:05.723018+0000","last_became_active":"2024-09-12T22:50:52.858372+0000","last_became_peered":"2024-09-12T22:50:52.858372+0000","last_unstale":"2024-09-12T22:51:05.723018+0000","last_undegraded":"2024-09-12T22:51:05.723018+0000","last_fullsized":"2024-09-12T22:51:05.723018+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:44.345055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"61'404","reported_seq":614,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343369+0000","last_change":"2024-09-12T22:48:05.177561+0000","last_active":"2024-09-12T22:51:06.343369+0000","last_peered":"2024-09-12T22:51:06.343369+0000","last_clean":"2024-09-12T22:51:06.343369+0000","last_became_active":"2024-09-12T22:48:05.177164+0000","last_became_peered":"2024-09-12T22:48:05.177164+0000","last_unstale":"2024-09-12T22:51:06.343369+0000","last_undegraded":"2024-09-12T22:51:06.343369+0000","last_fullsized":"2024-09-12T22:51:06.343369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:24.124647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":35084,"num_write":365,"num_write_kb":71560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"61'269","reported_seq":395,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723416+0000","last_change":"2024-09-12T22:50:55.850951+0000","last_active":"2024-09-12T22:51:05.723416+0000","last_peered":"2024-09-12T22:51:05.723416+0000","last_clean":"2024-09-12T22:51:05.723416+0000","last_became_active":"2024-09-12T22:50:55.850689+0000","last_became_peered":"2024-09-12T22:50:55.850689+0000","last_unstale":"2024-09-12T22:51:05.723416+0000","last_undegraded":"2024-09-12T22:51:05.723416+0000","last_fullsized":"2024-09-12T22:51:05.723416+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:11:37.856958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":4189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343491+0000","last_change":"2024-09-12T22:48:02.045324+0000","last_active":"2024-09-12T22:51:06.343491+0000","last_peered":"2024-09-12T22:51:06.343491+0000","last_clean":"2024-09-12T22:51:06.343491+0000","last_became_active":"2024-09-12T22:48:00.042132+0000","last_became_peered":"2024-09-12T22:48:00.042132+0000","last_unstale":"2024-09-12T22:51:06.343491+0000","last_undegraded":"2024-09-12T22:51:06.343491+0000","last_fullsized":"2024-09-12T22:51:06.343491+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:24.673019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047590600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"61'362","reported_seq":851,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723496+0000","last_change":"2024-09-12T22:50:59.708186+0000","last_active":"2024-09-12T22:51:05.723496+0000","last_peered":"2024-09-12T22:51:05.723496+0000","last_clean":"2024-09-12T22:51:05.723496+0000","last_became_active":"2024-09-12T22:50:59.707126+0000","last_became_peered":"2024-09-12T22:50:59.707126+0000","last_unstale":"2024-09-12T22:51:05.723496+0000","last_undegraded":"2024-09-12T22:51:05.723496+0000","last_fullsized":"2024-09-12T22:51:05.723496+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:08:37.272462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":10445,"num_write":331,"num_write_kb":30096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"61'56","reported_seq":195,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343401+0000","last_change":"2024-09-12T22:48:04.169109+0000","last_active":"2024-09-12T22:51:06.343401+0000","last_peered":"2024-09-12T22:51:06.343401+0000","last_clean":"2024-09-12T22:51:06.343401+0000","last_became_active":"2024-09-12T22:48:04.168655+0000","last_became_peered":"2024-09-12T22:48:04.168655+0000","last_unstale":"2024-09-12T22:51:06.343401+0000","last_undegraded":"2024-09-12T22:51:06.343401+0000","last_fullsized":"2024-09-12T22:51:06.343401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:02.879935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724478+0000","last_change":"2024-09-12T22:48:02.045390+0000","last_active":"2024-09-12T22:51:05.724478+0000","last_peered":"2024-09-12T22:51:05.724478+0000","last_clean":"2024-09-12T22:51:05.724478+0000","last_became_active":"2024-09-12T22:48:00.045356+0000","last_became_peered":"2024-09-12T22:48:00.045356+0000","last_unstale":"2024-09-12T22:51:05.724478+0000","last_undegraded":"2024-09-12T22:51:05.724478+0000","last_fullsized":"2024-09-12T22:51:05.724478+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:32.072080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040621599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"61'408","reported_seq":982,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723709+0000","last_change":"2024-09-12T22:50:57.864738+0000","last_active":"2024-09-12T22:51:05.723709+0000","last_peered":"2024-09-12T22:51:05.723709+0000","last_clean":"2024-09-12T22:51:05.723709+0000","last_became_active":"2024-09-12T22:50:57.863486+0000","last_became_peered":"2024-09-12T22:50:57.863486+0000","last_unstale":"2024-09-12T22:51:05.723709+0000","last_undegraded":"2024-09-12T22:51:05.723709+0000","last_fullsized":"2024-09-12T22:51:05.723709+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:06:04.268528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":42311,"num_write":379,"num_write_kb":75412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"61'61","reported_seq":200,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343872+0000","last_change":"2024-09-12T22:48:04.168635+0000","last_active":"2024-09-12T22:51:06.343872+0000","last_peered":"2024-09-12T22:51:06.343872+0000","last_clean":"2024-09-12T22:51:06.343872+0000","last_became_active":"2024-09-12T22:48:04.168244+0000","last_became_peered":"2024-09-12T22:48:04.168244+0000","last_unstale":"2024-09-12T22:51:06.343872+0000","last_undegraded":"2024-09-12T22:51:06.343872+0000","last_fullsized":"2024-09-12T22:51:06.343872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:56.929490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343640+0000","last_change":"2024-09-12T22:48:02.045428+0000","last_active":"2024-09-12T22:51:06.343640+0000","last_peered":"2024-09-12T22:51:06.343640+0000","last_clean":"2024-09-12T22:51:06.343640+0000","last_became_active":"2024-09-12T22:48:00.040536+0000","last_became_peered":"2024-09-12T22:48:00.040536+0000","last_unstale":"2024-09-12T22:51:06.343640+0000","last_undegraded":"2024-09-12T22:51:06.343640+0000","last_fullsized":"2024-09-12T22:51:06.343640+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:33.150497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057699499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"61'430","reported_seq":990,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342744+0000","last_change":"2024-09-12T22:51:01.701692+0000","last_active":"2024-09-12T22:51:06.342744+0000","last_peered":"2024-09-12T22:51:06.342744+0000","last_clean":"2024-09-12T22:51:06.342744+0000","last_became_active":"2024-09-12T22:51:01.700292+0000","last_became_peered":"2024-09-12T22:51:01.700292+0000","last_unstale":"2024-09-12T22:51:06.342744+0000","last_undegraded":"2024-09-12T22:51:06.342744+0000","last_fullsized":"2024-09-12T22:51:06.342744+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:25.931698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":26700,"num_write":399,"num_write_kb":55331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"63'114","reported_seq":267,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343600+0000","last_change":"2024-09-12T22:50:55.852342+0000","last_active":"2024-09-12T22:51:06.343600+0000","last_peered":"2024-09-12T22:51:06.343600+0000","last_clean":"2024-09-12T22:51:06.343600+0000","last_became_active":"2024-09-12T22:50:55.851975+0000","last_became_peered":"2024-09-12T22:50:55.851975+0000","last_unstale":"2024-09-12T22:51:06.343600+0000","last_undegraded":"2024-09-12T22:51:06.343600+0000","last_fullsized":"2024-09-12T22:51:06.343600+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:42.555311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":1201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723698+0000","last_change":"2024-09-12T22:50:52.857531+0000","last_active":"2024-09-12T22:51:05.723698+0000","last_peered":"2024-09-12T22:51:05.723698+0000","last_clean":"2024-09-12T22:51:05.723698+0000","last_became_active":"2024-09-12T22:50:52.856757+0000","last_became_peered":"2024-09-12T22:50:52.856757+0000","last_unstale":"2024-09-12T22:51:05.723698+0000","last_undegraded":"2024-09-12T22:51:05.723698+0000","last_fullsized":"2024-09-12T22:51:05.723698+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:14.353873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"61'406","reported_seq":929,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723396+0000","last_change":"2024-09-12T22:50:56.855069+0000","last_active":"2024-09-12T22:51:05.723396+0000","last_peered":"2024-09-12T22:51:05.723396+0000","last_clean":"2024-09-12T22:51:05.723396+0000","last_became_active":"2024-09-12T22:50:56.853376+0000","last_became_peered":"2024-09-12T22:50:56.853376+0000","last_unstale":"2024-09-12T22:51:05.723396+0000","last_undegraded":"2024-09-12T22:51:05.723396+0000","last_fullsized":"2024-09-12T22:51:05.723396+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:43.556932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17112,"num_write":373,"num_write_kb":79947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"61'378","reported_seq":533,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723357+0000","last_change":"2024-09-12T22:50:57.863154+0000","last_active":"2024-09-12T22:51:05.723357+0000","last_peered":"2024-09-12T22:51:05.723357+0000","last_clean":"2024-09-12T22:51:05.723357+0000","last_became_active":"2024-09-12T22:50:57.861280+0000","last_became_peered":"2024-09-12T22:50:57.861280+0000","last_unstale":"2024-09-12T22:51:05.723357+0000","last_undegraded":"2024-09-12T22:51:05.723357+0000","last_fullsized":"2024-09-12T22:51:05.723357+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:13.015760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15048,"num_write":339,"num_write_kb":35238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"63'249","reported_seq":391,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723315+0000","last_change":"2024-09-12T22:50:55.849742+0000","last_active":"2024-09-12T22:51:05.723315+0000","last_peered":"2024-09-12T22:51:05.723315+0000","last_clean":"2024-09-12T22:51:05.723315+0000","last_became_active":"2024-09-12T22:50:55.849531+0000","last_became_peered":"2024-09-12T22:50:55.849531+0000","last_unstale":"2024-09-12T22:51:05.723315+0000","last_undegraded":"2024-09-12T22:51:05.723315+0000","last_fullsized":"2024-09-12T22:51:05.723315+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:32.676988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8461053,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":8364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8456257,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"61'405","reported_seq":569,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342826+0000","last_change":"2024-09-12T22:48:05.176779+0000","last_active":"2024-09-12T22:51:06.342826+0000","last_peered":"2024-09-12T22:51:06.342826+0000","last_clean":"2024-09-12T22:51:06.342826+0000","last_became_active":"2024-09-12T22:48:05.176344+0000","last_became_peered":"2024-09-12T22:48:05.176344+0000","last_unstale":"2024-09-12T22:51:06.342826+0000","last_undegraded":"2024-09-12T22:51:06.342826+0000","last_fullsized":"2024-09-12T22:51:06.342826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:35.645286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":25018,"num_write":372,"num_write_kb":42936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"61'85","reported_seq":236,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724390+0000","last_change":"2024-09-12T22:50:52.905108+0000","last_active":"2024-09-12T22:51:05.724390+0000","last_peered":"2024-09-12T22:51:05.724390+0000","last_clean":"2024-09-12T22:51:05.724390+0000","last_became_active":"2024-09-12T22:50:52.861594+0000","last_became_peered":"2024-09-12T22:50:52.861594+0000","last_unstale":"2024-09-12T22:51:05.724390+0000","last_undegraded":"2024-09-12T22:51:05.724390+0000","last_fullsized":"2024-09-12T22:51:05.724390+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:49.196178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"61'213","reported_seq":338,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723895+0000","last_change":"2024-09-12T22:50:55.852154+0000","last_active":"2024-09-12T22:51:05.723895+0000","last_peered":"2024-09-12T22:51:05.723895+0000","last_clean":"2024-09-12T22:51:05.723895+0000","last_became_active":"2024-09-12T22:50:55.851798+0000","last_became_peered":"2024-09-12T22:50:55.851798+0000","last_unstale":"2024-09-12T22:51:05.723895+0000","last_undegraded":"2024-09-12T22:51:05.723895+0000","last_fullsized":"2024-09-12T22:51:05.723895+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:03:29.463409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":4171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"61'478","reported_seq":1107,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342630+0000","last_change":"2024-09-12T22:50:56.856443+0000","last_active":"2024-09-12T22:51:06.342630+0000","last_peered":"2024-09-12T22:51:06.342630+0000","last_clean":"2024-09-12T22:51:06.342630+0000","last_became_active":"2024-09-12T22:50:56.855150+0000","last_became_peered":"2024-09-12T22:50:56.855150+0000","last_unstale":"2024-09-12T22:51:06.342630+0000","last_undegraded":"2024-09-12T22:51:06.342630+0000","last_fullsized":"2024-09-12T22:51:06.342630+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:11.194706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":41320,"num_write":445,"num_write_kb":84826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":209,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"61'55","reported_seq":201,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343774+0000","last_change":"2024-09-12T22:50:52.859702+0000","last_active":"2024-09-12T22:51:06.343774+0000","last_peered":"2024-09-12T22:51:06.343774+0000","last_clean":"2024-09-12T22:51:06.343774+0000","last_became_active":"2024-09-12T22:50:52.859296+0000","last_became_peered":"2024-09-12T22:50:52.859296+0000","last_unstale":"2024-09-12T22:51:06.343774+0000","last_undegraded":"2024-09-12T22:51:06.343774+0000","last_fullsized":"2024-09-12T22:51:06.343774+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:14.180904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"61'447","reported_seq":634,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342672+0000","last_change":"2024-09-12T22:48:05.169648+0000","last_active":"2024-09-12T22:51:06.342672+0000","last_peered":"2024-09-12T22:51:06.342672+0000","last_clean":"2024-09-12T22:51:06.342672+0000","last_became_active":"2024-09-12T22:48:05.168356+0000","last_became_peered":"2024-09-12T22:48:05.168356+0000","last_unstale":"2024-09-12T22:51:06.342672+0000","last_undegraded":"2024-09-12T22:51:06.342672+0000","last_fullsized":"2024-09-12T22:51:06.342672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:52.341512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25877,"num_write":417,"num_write_kb":39269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"61'371","reported_seq":888,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724516+0000","last_change":"2024-09-12T22:51:02.709645+0000","last_active":"2024-09-12T22:51:05.724516+0000","last_peered":"2024-09-12T22:51:05.724516+0000","last_clean":"2024-09-12T22:51:05.724516+0000","last_became_active":"2024-09-12T22:51:02.708091+0000","last_became_peered":"2024-09-12T22:51:02.708091+0000","last_unstale":"2024-09-12T22:51:05.724516+0000","last_undegraded":"2024-09-12T22:51:05.724516+0000","last_fullsized":"2024-09-12T22:51:05.724516+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:13:37.634120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20950,"num_write":339,"num_write_kb":39207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"61'601","reported_seq":740,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342822+0000","last_change":"2024-09-12T22:48:04.169111+0000","last_active":"2024-09-12T22:51:06.342822+0000","last_peered":"2024-09-12T22:51:06.342822+0000","last_clean":"2024-09-12T22:51:06.342822+0000","last_became_active":"2024-09-12T22:48:04.168743+0000","last_became_peered":"2024-09-12T22:48:04.168743+0000","last_unstale":"2024-09-12T22:51:06.342822+0000","last_undegraded":"2024-09-12T22:51:06.342822+0000","last_fullsized":"2024-09-12T22:51:06.342822+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:43.709660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":535,"num_write_kb":8445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"61'438","reported_seq":978,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342401+0000","last_change":"2024-09-12T22:50:57.863618+0000","last_active":"2024-09-12T22:51:06.342401+0000","last_peered":"2024-09-12T22:51:06.342401+0000","last_clean":"2024-09-12T22:51:06.342401+0000","last_became_active":"2024-09-12T22:50:57.861695+0000","last_became_peered":"2024-09-12T22:50:57.861695+0000","last_unstale":"2024-09-12T22:51:06.342401+0000","last_undegraded":"2024-09-12T22:51:06.342401+0000","last_fullsized":"2024-09-12T22:51:06.342401+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:08:37.272462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":16921,"num_write":411,"num_write_kb":146790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"61'185","reported_seq":337,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342787+0000","last_change":"2024-09-12T22:50:55.853288+0000","last_active":"2024-09-12T22:51:06.342787+0000","last_peered":"2024-09-12T22:51:06.342787+0000","last_clean":"2024-09-12T22:51:06.342787+0000","last_became_active":"2024-09-12T22:50:55.852796+0000","last_became_peered":"2024-09-12T22:50:55.852796+0000","last_unstale":"2024-09-12T22:51:06.342787+0000","last_undegraded":"2024-09-12T22:51:06.342787+0000","last_fullsized":"2024-09-12T22:51:06.342787+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:06:03.266907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"61'386","reported_seq":886,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724136+0000","last_change":"2024-09-12T22:51:01.702122+0000","last_active":"2024-09-12T22:51:05.724136+0000","last_peered":"2024-09-12T22:51:05.724136+0000","last_clean":"2024-09-12T22:51:05.724136+0000","last_became_active":"2024-09-12T22:51:01.701006+0000","last_became_peered":"2024-09-12T22:51:01.701006+0000","last_unstale":"2024-09-12T22:51:05.724136+0000","last_undegraded":"2024-09-12T22:51:05.724136+0000","last_fullsized":"2024-09-12T22:51:05.724136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:44.083029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":21487,"num_write":344,"num_write_kb":72645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"61'180","reported_seq":319,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723786+0000","last_change":"2024-09-12T22:48:04.174205+0000","last_active":"2024-09-12T22:51:05.723786+0000","last_peered":"2024-09-12T22:51:05.723786+0000","last_clean":"2024-09-12T22:51:05.723786+0000","last_became_active":"2024-09-12T22:48:04.173902+0000","last_became_peered":"2024-09-12T22:48:04.173902+0000","last_unstale":"2024-09-12T22:51:05.723786+0000","last_undegraded":"2024-09-12T22:51:05.723786+0000","last_fullsized":"2024-09-12T22:51:05.723786+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:43:39.709214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":12355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"61'396","reported_seq":552,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723907+0000","last_change":"2024-09-12T22:48:05.172917+0000","last_active":"2024-09-12T22:51:05.723907+0000","last_peered":"2024-09-12T22:51:05.723907+0000","last_clean":"2024-09-12T22:51:05.723907+0000","last_became_active":"2024-09-12T22:48:05.172493+0000","last_became_peered":"2024-09-12T22:48:05.172493+0000","last_unstale":"2024-09-12T22:51:05.723907+0000","last_undegraded":"2024-09-12T22:51:05.723907+0000","last_fullsized":"2024-09-12T22:51:05.723907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:35.645286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9980,"num_write":370,"num_write_kb":80321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"61'64","reported_seq":215,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723864+0000","last_change":"2024-09-12T22:50:52.884955+0000","last_active":"2024-09-12T22:51:05.723864+0000","last_peered":"2024-09-12T22:51:05.723864+0000","last_clean":"2024-09-12T22:51:05.723864+0000","last_became_active":"2024-09-12T22:50:52.858938+0000","last_became_peered":"2024-09-12T22:50:52.858938+0000","last_unstale":"2024-09-12T22:51:05.723864+0000","last_undegraded":"2024-09-12T22:51:05.723864+0000","last_fullsized":"2024-09-12T22:51:05.723864+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:24.405738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"61'370","reported_seq":515,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723307+0000","last_change":"2024-09-12T22:50:59.705667+0000","last_active":"2024-09-12T22:51:05.723307+0000","last_peered":"2024-09-12T22:51:05.723307+0000","last_clean":"2024-09-12T22:51:05.723307+0000","last_became_active":"2024-09-12T22:50:59.704074+0000","last_became_peered":"2024-09-12T22:50:59.704074+0000","last_unstale":"2024-09-12T22:51:05.723307+0000","last_undegraded":"2024-09-12T22:51:05.723307+0000","last_fullsized":"2024-09-12T22:51:05.723307+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:59.243155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16468,"num_write":341,"num_write_kb":50344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"61'187","reported_seq":321,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723342+0000","last_change":"2024-09-12T22:50:55.851804+0000","last_active":"2024-09-12T22:51:05.723342+0000","last_peered":"2024-09-12T22:51:05.723342+0000","last_clean":"2024-09-12T22:51:05.723342+0000","last_became_active":"2024-09-12T22:50:55.851467+0000","last_became_peered":"2024-09-12T22:50:55.851467+0000","last_unstale":"2024-09-12T22:51:05.723342+0000","last_undegraded":"2024-09-12T22:51:05.723342+0000","last_fullsized":"2024-09-12T22:51:05.723342+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:05.608780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"61'438","reported_seq":636,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723016+0000","last_change":"2024-09-12T22:50:59.706857+0000","last_active":"2024-09-12T22:51:05.723016+0000","last_peered":"2024-09-12T22:51:05.723016+0000","last_clean":"2024-09-12T22:51:05.723016+0000","last_became_active":"2024-09-12T22:50:59.703786+0000","last_became_peered":"2024-09-12T22:50:59.703786+0000","last_unstale":"2024-09-12T22:51:05.723016+0000","last_undegraded":"2024-09-12T22:51:05.723016+0000","last_fullsized":"2024-09-12T22:51:05.723016+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:52:45.535138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":38460,"num_write":412,"num_write_kb":96626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"61'185","reported_seq":342,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724254+0000","last_change":"2024-09-12T22:50:55.853065+0000","last_active":"2024-09-12T22:51:05.724254+0000","last_peered":"2024-09-12T22:51:05.724254+0000","last_clean":"2024-09-12T22:51:05.724254+0000","last_became_active":"2024-09-12T22:50:55.852654+0000","last_became_peered":"2024-09-12T22:50:55.852654+0000","last_unstale":"2024-09-12T22:51:05.724254+0000","last_undegraded":"2024-09-12T22:51:05.724254+0000","last_fullsized":"2024-09-12T22:51:05.724254+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:17.101030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":12349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"61'418","reported_seq":599,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723714+0000","last_change":"2024-09-12T22:48:05.171815+0000","last_active":"2024-09-12T22:51:05.723714+0000","last_peered":"2024-09-12T22:51:05.723714+0000","last_clean":"2024-09-12T22:51:05.723714+0000","last_became_active":"2024-09-12T22:48:05.171361+0000","last_became_peered":"2024-09-12T22:48:05.171361+0000","last_unstale":"2024-09-12T22:51:05.723714+0000","last_undegraded":"2024-09-12T22:51:05.723714+0000","last_fullsized":"2024-09-12T22:51:05.723714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:28.873036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":27427,"num_write":388,"num_write_kb":67745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"61'159","reported_seq":285,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724366+0000","last_change":"2024-09-12T22:50:55.852290+0000","last_active":"2024-09-12T22:51:05.724366+0000","last_peered":"2024-09-12T22:51:05.724366+0000","last_clean":"2024-09-12T22:51:05.724366+0000","last_became_active":"2024-09-12T22:50:55.851948+0000","last_became_peered":"2024-09-12T22:50:55.851948+0000","last_unstale":"2024-09-12T22:51:05.724366+0000","last_undegraded":"2024-09-12T22:51:05.724366+0000","last_fullsized":"2024-09-12T22:51:05.724366+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:14.260183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"61'479","reported_seq":652,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723053+0000","last_change":"2024-09-12T22:51:03.707091+0000","last_active":"2024-09-12T22:51:05.723053+0000","last_peered":"2024-09-12T22:51:05.723053+0000","last_clean":"2024-09-12T22:51:05.723053+0000","last_became_active":"2024-09-12T22:51:03.704137+0000","last_became_peered":"2024-09-12T22:51:03.704137+0000","last_unstale":"2024-09-12T22:51:05.723053+0000","last_undegraded":"2024-09-12T22:51:05.723053+0000","last_fullsized":"2024-09-12T22:51:05.723053+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:27:47.351934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":26793,"num_write":459,"num_write_kb":138325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"61'49","reported_seq":200,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343704+0000","last_change":"2024-09-12T22:50:52.903138+0000","last_active":"2024-09-12T22:51:06.343704+0000","last_peered":"2024-09-12T22:51:06.343704+0000","last_clean":"2024-09-12T22:51:06.343704+0000","last_became_active":"2024-09-12T22:50:52.859983+0000","last_became_peered":"2024-09-12T22:50:52.859983+0000","last_unstale":"2024-09-12T22:51:06.343704+0000","last_undegraded":"2024-09-12T22:51:06.343704+0000","last_fullsized":"2024-09-12T22:51:06.343704+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:59.415555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2742,"num_read_kb":1405479,"num_write":24656,"num_write_kb":4261796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7339,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26737,"ondisk_log_size":26737,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127366156,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":45,"num_read_kb":1459,"num_write":4460,"num_write_kb":127655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":93806220,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254799872,"data_stored":254732312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5569,"internal_metadata":0},"log_size":6243,"ondisk_log_size":6243,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":67,"seq":287762808837,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150992,"kb_used_data":92924,"kb_used_omap":6,"kb_used_meta":58041,"kb_avail":94220848,"statfs":{"total":96636764160,"available":96482148352,"internally_reserved":0,"allocated":95154176,"data_stored":94739479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7164,"internal_metadata":59433988},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738410,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":169456,"kb_used_data":75864,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94202384,"statfs":{"total":96636764160,"available":96463241216,"internally_reserved":0,"allocated":77684736,"data_stored":77299268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738412,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":172716,"kb_used_data":83284,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94199124,"statfs":{"total":96636764160,"available":96459902976,"internally_reserved":0,"allocated":85282816,"data_stored":84886443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83980288,"data_stored":83958707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":76972032,"data_stored":76961881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":93847552,"data_stored":93811724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5569,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:51:10.254 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-12T22:51:10.255 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-12T22:51:10.597 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T22:51:10.610 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T22:51:10.610 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:51:10.904 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:51:10.906 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-09-12T22:51:10.915 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2024-09-12T22:51:10.176776+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127956543,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":2923,"num_read_kb":1407056,"num_write":29321,"num_write_kb":4392913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7366,"num_bytes_recovered":93806220,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33140,"ondisk_log_size":33140,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":493164,"kb_used_data":252072,"kb_used_omap":10,"kb_used_meta":241013,"kb_avail":282622356,"statfs":{"total":289910292480,"available":289405292544,"internally_reserved":0,"allocated":258121728,"data_stored":256925190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10354,"internal_metadata":246798222},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1970,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2529,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.477824"},"pg_stats":[{"pgid":"4.3f","version":"61'404","reported_seq":563,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724420+0000","last_change":"2024-09-12T22:48:05.174190+0000","last_active":"2024-09-12T22:51:05.724420+0000","last_peered":"2024-09-12T22:51:05.724420+0000","last_clean":"2024-09-12T22:51:05.724420+0000","last_became_active":"2024-09-12T22:48:05.172964+0000","last_became_peered":"2024-09-12T22:48:05.172964+0000","last_unstale":"2024-09-12T22:51:05.724420+0000","last_undegraded":"2024-09-12T22:51:05.724420+0000","last_fullsized":"2024-09-12T22:51:05.724420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:49.868891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9582,"num_write":371,"num_write_kb":42180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"61'425","reported_seq":633,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724097+0000","last_change":"2024-09-12T22:48:05.173045+0000","last_active":"2024-09-12T22:51:05.724097+0000","last_peered":"2024-09-12T22:51:05.724097+0000","last_clean":"2024-09-12T22:51:05.724097+0000","last_became_active":"2024-09-12T22:48:05.172684+0000","last_became_peered":"2024-09-12T22:48:05.172684+0000","last_unstale":"2024-09-12T22:51:05.724097+0000","last_undegraded":"2024-09-12T22:51:05.724097+0000","last_fullsized":"2024-09-12T22:51:05.724097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:51.360504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":40466,"num_write":394,"num_write_kb":96045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"61'385","reported_seq":516,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723911+0000","last_change":"2024-09-12T22:51:00.703306+0000","last_active":"2024-09-12T22:51:05.723911+0000","last_peered":"2024-09-12T22:51:05.723911+0000","last_clean":"2024-09-12T22:51:05.723911+0000","last_became_active":"2024-09-12T22:51:00.700490+0000","last_became_peered":"2024-09-12T22:51:00.700490+0000","last_unstale":"2024-09-12T22:51:05.723911+0000","last_undegraded":"2024-09-12T22:51:05.723911+0000","last_fullsized":"2024-09-12T22:51:05.723911+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:16.055859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":7348,"num_write":352,"num_write_kb":34517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"61'395","reported_seq":563,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723474+0000","last_change":"2024-09-12T22:51:02.711764+0000","last_active":"2024-09-12T22:51:05.723474+0000","last_peered":"2024-09-12T22:51:05.723474+0000","last_clean":"2024-09-12T22:51:05.723474+0000","last_became_active":"2024-09-12T22:51:02.708216+0000","last_became_peered":"2024-09-12T22:51:02.708216+0000","last_unstale":"2024-09-12T22:51:05.723474+0000","last_undegraded":"2024-09-12T22:51:05.723474+0000","last_fullsized":"2024-09-12T22:51:05.723474+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:24.442976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":25803,"num_write":361,"num_write_kb":71646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"61'410","reported_seq":573,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723888+0000","last_change":"2024-09-12T22:48:05.170306+0000","last_active":"2024-09-12T22:51:05.723888+0000","last_peered":"2024-09-12T22:51:05.723888+0000","last_clean":"2024-09-12T22:51:05.723888+0000","last_became_active":"2024-09-12T22:48:05.169940+0000","last_became_peered":"2024-09-12T22:48:05.169940+0000","last_unstale":"2024-09-12T22:51:05.723888+0000","last_undegraded":"2024-09-12T22:51:05.723888+0000","last_fullsized":"2024-09-12T22:51:05.723888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:52.341512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":20544,"num_write":387,"num_write_kb":55745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"61'384","reported_seq":499,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723190+0000","last_change":"2024-09-12T22:51:03.706817+0000","last_active":"2024-09-12T22:51:05.723190+0000","last_peered":"2024-09-12T22:51:05.723190+0000","last_clean":"2024-09-12T22:51:05.723190+0000","last_became_active":"2024-09-12T22:51:03.704293+0000","last_became_peered":"2024-09-12T22:51:03.704293+0000","last_unstale":"2024-09-12T22:51:05.723190+0000","last_undegraded":"2024-09-12T22:51:05.723190+0000","last_fullsized":"2024-09-12T22:51:05.723190+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:07.148926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5069,"num_write":355,"num_write_kb":38430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"61'461","reported_seq":656,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723091+0000","last_change":"2024-09-12T22:50:56.858810+0000","last_active":"2024-09-12T22:51:05.723091+0000","last_peered":"2024-09-12T22:51:05.723091+0000","last_clean":"2024-09-12T22:51:05.723091+0000","last_became_active":"2024-09-12T22:50:56.856720+0000","last_became_peered":"2024-09-12T22:50:56.856720+0000","last_unstale":"2024-09-12T22:51:05.723091+0000","last_undegraded":"2024-09-12T22:51:05.723091+0000","last_fullsized":"2024-09-12T22:51:05.723091+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:21.599293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":30574,"num_write":435,"num_write_kb":92996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"61'385","reported_seq":518,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722895+0000","last_change":"2024-09-12T22:51:00.703157+0000","last_active":"2024-09-12T22:51:05.722895+0000","last_peered":"2024-09-12T22:51:05.722895+0000","last_clean":"2024-09-12T22:51:05.722895+0000","last_became_active":"2024-09-12T22:51:00.700472+0000","last_became_peered":"2024-09-12T22:51:00.700472+0000","last_unstale":"2024-09-12T22:51:05.722895+0000","last_undegraded":"2024-09-12T22:51:05.722895+0000","last_fullsized":"2024-09-12T22:51:05.722895+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:07.616061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9031,"num_write":340,"num_write_kb":84729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"61'435","reported_seq":585,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343462+0000","last_change":"2024-09-12T22:48:05.178445+0000","last_active":"2024-09-12T22:51:06.343462+0000","last_peered":"2024-09-12T22:51:06.343462+0000","last_clean":"2024-09-12T22:51:06.343462+0000","last_became_active":"2024-09-12T22:48:05.177284+0000","last_became_peered":"2024-09-12T22:48:05.177284+0000","last_unstale":"2024-09-12T22:51:06.343462+0000","last_undegraded":"2024-09-12T22:51:06.343462+0000","last_fullsized":"2024-09-12T22:51:06.343462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:45.140060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8316,"num_write":403,"num_write_kb":71851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"61'443","reported_seq":648,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724176+0000","last_change":"2024-09-12T22:48:05.172480+0000","last_active":"2024-09-12T22:51:05.724176+0000","last_peered":"2024-09-12T22:51:05.724176+0000","last_clean":"2024-09-12T22:51:05.724176+0000","last_became_active":"2024-09-12T22:48:05.171686+0000","last_became_peered":"2024-09-12T22:48:05.171686+0000","last_unstale":"2024-09-12T22:51:05.724176+0000","last_undegraded":"2024-09-12T22:51:05.724176+0000","last_fullsized":"2024-09-12T22:51:05.724176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:56.158813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40751,"num_write":407,"num_write_kb":116626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"61'383","reported_seq":509,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723914+0000","last_change":"2024-09-12T22:51:02.712354+0000","last_active":"2024-09-12T22:51:05.723914+0000","last_peered":"2024-09-12T22:51:05.723914+0000","last_clean":"2024-09-12T22:51:05.723914+0000","last_became_active":"2024-09-12T22:51:02.710579+0000","last_became_peered":"2024-09-12T22:51:02.710579+0000","last_unstale":"2024-09-12T22:51:05.723914+0000","last_undegraded":"2024-09-12T22:51:05.723914+0000","last_fullsized":"2024-09-12T22:51:05.723914+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:58:11.483150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5475,"num_write":365,"num_write_kb":63204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"61'366","reported_seq":891,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723891+0000","last_change":"2024-09-12T22:50:58.699684+0000","last_active":"2024-09-12T22:51:05.723891+0000","last_peered":"2024-09-12T22:51:05.723891+0000","last_clean":"2024-09-12T22:51:05.723891+0000","last_became_active":"2024-09-12T22:50:58.698711+0000","last_became_peered":"2024-09-12T22:50:58.698711+0000","last_unstale":"2024-09-12T22:51:05.723891+0000","last_undegraded":"2024-09-12T22:51:05.723891+0000","last_fullsized":"2024-09-12T22:51:05.723891+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:47.507555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":35222,"num_write":342,"num_write_kb":74947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"61'434","reported_seq":622,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723644+0000","last_change":"2024-09-12T22:48:05.171356+0000","last_active":"2024-09-12T22:51:05.723644+0000","last_peered":"2024-09-12T22:51:05.723644+0000","last_clean":"2024-09-12T22:51:05.723644+0000","last_became_active":"2024-09-12T22:48:05.170794+0000","last_became_peered":"2024-09-12T22:48:05.170794+0000","last_unstale":"2024-09-12T22:51:05.723644+0000","last_undegraded":"2024-09-12T22:51:05.723644+0000","last_fullsized":"2024-09-12T22:51:05.723644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:42:56.969660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":19623,"num_write":389,"num_write_kb":83457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"61'432","reported_seq":601,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723150+0000","last_change":"2024-09-12T22:50:58.702236+0000","last_active":"2024-09-12T22:51:05.723150+0000","last_peered":"2024-09-12T22:51:05.723150+0000","last_clean":"2024-09-12T22:51:05.723150+0000","last_became_active":"2024-09-12T22:50:58.700107+0000","last_became_peered":"2024-09-12T22:50:58.700107+0000","last_unstale":"2024-09-12T22:51:05.723150+0000","last_undegraded":"2024-09-12T22:51:05.723150+0000","last_fullsized":"2024-09-12T22:51:05.723150+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:29.112353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":23332,"num_write":401,"num_write_kb":75871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"61'406","reported_seq":573,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723029+0000","last_change":"2024-09-12T22:50:55.852257+0000","last_active":"2024-09-12T22:51:05.723029+0000","last_peered":"2024-09-12T22:51:05.723029+0000","last_clean":"2024-09-12T22:51:05.723029+0000","last_became_active":"2024-09-12T22:50:55.849568+0000","last_became_peered":"2024-09-12T22:50:55.849568+0000","last_unstale":"2024-09-12T22:51:05.723029+0000","last_undegraded":"2024-09-12T22:51:05.723029+0000","last_fullsized":"2024-09-12T22:51:05.723029+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:49.995990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":18162,"num_write":365,"num_write_kb":58919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"61'444","reported_seq":575,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723061+0000","last_change":"2024-09-12T22:51:01.704325+0000","last_active":"2024-09-12T22:51:05.723061+0000","last_peered":"2024-09-12T22:51:05.723061+0000","last_clean":"2024-09-12T22:51:05.723061+0000","last_became_active":"2024-09-12T22:51:01.700744+0000","last_became_peered":"2024-09-12T22:51:01.700744+0000","last_unstale":"2024-09-12T22:51:05.723061+0000","last_undegraded":"2024-09-12T22:51:05.723061+0000","last_fullsized":"2024-09-12T22:51:05.723061+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:00.747671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":410,"num_write_kb":63144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"61'443","reported_seq":616,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343794+0000","last_change":"2024-09-12T22:48:05.178721+0000","last_active":"2024-09-12T22:51:06.343794+0000","last_peered":"2024-09-12T22:51:06.343794+0000","last_clean":"2024-09-12T22:51:06.343794+0000","last_became_active":"2024-09-12T22:48:05.177965+0000","last_became_peered":"2024-09-12T22:48:05.177965+0000","last_unstale":"2024-09-12T22:51:06.343794+0000","last_undegraded":"2024-09-12T22:51:06.343794+0000","last_fullsized":"2024-09-12T22:51:06.343794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:32.288419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":14687,"num_write":408,"num_write_kb":80026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"61'439","reported_seq":665,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724329+0000","last_change":"2024-09-12T22:48:05.171053+0000","last_active":"2024-09-12T22:51:05.724329+0000","last_peered":"2024-09-12T22:51:05.724329+0000","last_clean":"2024-09-12T22:51:05.724329+0000","last_became_active":"2024-09-12T22:48:05.170578+0000","last_became_peered":"2024-09-12T22:48:05.170578+0000","last_unstale":"2024-09-12T22:51:05.724329+0000","last_undegraded":"2024-09-12T22:51:05.724329+0000","last_fullsized":"2024-09-12T22:51:05.724329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:58.991752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":47063,"num_write":400,"num_write_kb":100535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"61'444","reported_seq":660,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343268+0000","last_change":"2024-09-12T22:48:05.177369+0000","last_active":"2024-09-12T22:51:06.343268+0000","last_peered":"2024-09-12T22:51:06.343268+0000","last_clean":"2024-09-12T22:51:06.343268+0000","last_became_active":"2024-09-12T22:48:05.176680+0000","last_became_peered":"2024-09-12T22:48:05.176680+0000","last_unstale":"2024-09-12T22:51:06.343268+0000","last_undegraded":"2024-09-12T22:51:06.343268+0000","last_fullsized":"2024-09-12T22:51:06.343268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:25.143572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":42758,"num_write":403,"num_write_kb":67827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"61'433","reported_seq":570,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723656+0000","last_change":"2024-09-12T22:51:02.711577+0000","last_active":"2024-09-12T22:51:05.723656+0000","last_peered":"2024-09-12T22:51:05.723656+0000","last_clean":"2024-09-12T22:51:05.723656+0000","last_became_active":"2024-09-12T22:51:02.708090+0000","last_became_peered":"2024-09-12T22:51:02.708090+0000","last_unstale":"2024-09-12T22:51:05.723656+0000","last_undegraded":"2024-09-12T22:51:05.723656+0000","last_fullsized":"2024-09-12T22:51:05.723656+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:32.441902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":10750,"num_write":397,"num_write_kb":34708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"61'413","reported_seq":588,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723473+0000","last_change":"2024-09-12T22:50:58.702132+0000","last_active":"2024-09-12T22:51:05.723473+0000","last_peered":"2024-09-12T22:51:05.723473+0000","last_clean":"2024-09-12T22:51:05.723473+0000","last_became_active":"2024-09-12T22:50:58.699982+0000","last_became_peered":"2024-09-12T22:50:58.699982+0000","last_unstale":"2024-09-12T22:51:05.723473+0000","last_undegraded":"2024-09-12T22:51:05.723473+0000","last_fullsized":"2024-09-12T22:51:05.723473+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:03.458952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":25621,"num_write":385,"num_write_kb":63908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"61'462","reported_seq":1066,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723490+0000","last_change":"2024-09-12T22:50:58.701216+0000","last_active":"2024-09-12T22:51:05.723490+0000","last_peered":"2024-09-12T22:51:05.723490+0000","last_clean":"2024-09-12T22:51:05.723490+0000","last_became_active":"2024-09-12T22:50:58.700047+0000","last_became_peered":"2024-09-12T22:50:58.700047+0000","last_unstale":"2024-09-12T22:51:05.723490+0000","last_undegraded":"2024-09-12T22:51:05.723490+0000","last_fullsized":"2024-09-12T22:51:05.723490+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:51.010136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28920,"num_write":428,"num_write_kb":76277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"61'413","reported_seq":948,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342393+0000","last_change":"2024-09-12T22:50:57.861973+0000","last_active":"2024-09-12T22:51:06.342393+0000","last_peered":"2024-09-12T22:51:06.342393+0000","last_clean":"2024-09-12T22:51:06.342393+0000","last_became_active":"2024-09-12T22:50:57.860819+0000","last_became_peered":"2024-09-12T22:50:57.860819+0000","last_unstale":"2024-09-12T22:51:06.342393+0000","last_undegraded":"2024-09-12T22:51:06.342393+0000","last_fullsized":"2024-09-12T22:51:06.342393+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:52.977617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":14661,"num_write":381,"num_write_kb":72596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"61'475","reported_seq":680,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723273+0000","last_change":"2024-09-12T22:48:05.172794+0000","last_active":"2024-09-12T22:51:05.723273+0000","last_peered":"2024-09-12T22:51:05.723273+0000","last_clean":"2024-09-12T22:51:05.723273+0000","last_became_active":"2024-09-12T22:48:05.172437+0000","last_became_peered":"2024-09-12T22:48:05.172437+0000","last_unstale":"2024-09-12T22:51:05.723273+0000","last_undegraded":"2024-09-12T22:51:05.723273+0000","last_fullsized":"2024-09-12T22:51:05.723273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:54:44.278646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":32397,"num_write":452,"num_write_kb":105406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"61'413","reported_seq":963,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724480+0000","last_change":"2024-09-12T22:51:02.709686+0000","last_active":"2024-09-12T22:51:05.724480+0000","last_peered":"2024-09-12T22:51:05.724480+0000","last_clean":"2024-09-12T22:51:05.724480+0000","last_became_active":"2024-09-12T22:51:02.708084+0000","last_became_peered":"2024-09-12T22:51:02.708084+0000","last_unstale":"2024-09-12T22:51:05.724480+0000","last_undegraded":"2024-09-12T22:51:05.724480+0000","last_fullsized":"2024-09-12T22:51:05.724480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:27.765575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4773,"num_write":395,"num_write_kb":21871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"61'453","reported_seq":1027,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343514+0000","last_change":"2024-09-12T22:50:58.700787+0000","last_active":"2024-09-12T22:51:06.343514+0000","last_peered":"2024-09-12T22:51:06.343514+0000","last_clean":"2024-09-12T22:51:06.343514+0000","last_became_active":"2024-09-12T22:50:58.699585+0000","last_became_peered":"2024-09-12T22:50:58.699585+0000","last_unstale":"2024-09-12T22:51:06.343514+0000","last_undegraded":"2024-09-12T22:51:06.343514+0000","last_fullsized":"2024-09-12T22:51:06.343514+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:44.083029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18201,"num_write":409,"num_write_kb":47008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"61'402","reported_seq":571,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723791+0000","last_change":"2024-09-12T22:51:01.704826+0000","last_active":"2024-09-12T22:51:05.723791+0000","last_peered":"2024-09-12T22:51:05.723791+0000","last_clean":"2024-09-12T22:51:05.723791+0000","last_became_active":"2024-09-12T22:51:01.701850+0000","last_became_peered":"2024-09-12T22:51:01.701850+0000","last_unstale":"2024-09-12T22:51:05.723791+0000","last_undegraded":"2024-09-12T22:51:05.723791+0000","last_fullsized":"2024-09-12T22:51:05.723791+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:44:29.380608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":21641,"num_write":372,"num_write_kb":63613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"61'436","reported_seq":1073,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724130+0000","last_change":"2024-09-12T22:50:59.703836+0000","last_active":"2024-09-12T22:51:05.724130+0000","last_peered":"2024-09-12T22:51:05.724130+0000","last_clean":"2024-09-12T22:51:05.724130+0000","last_became_active":"2024-09-12T22:50:59.702766+0000","last_became_peered":"2024-09-12T22:50:59.702766+0000","last_unstale":"2024-09-12T22:51:05.724130+0000","last_undegraded":"2024-09-12T22:51:05.724130+0000","last_fullsized":"2024-09-12T22:51:05.724130+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:52.977617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":65550,"num_write":412,"num_write_kb":134233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"61'393","reported_seq":590,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343137+0000","last_change":"2024-09-12T22:48:05.177176+0000","last_active":"2024-09-12T22:51:06.343137+0000","last_peered":"2024-09-12T22:51:06.343137+0000","last_clean":"2024-09-12T22:51:06.343137+0000","last_became_active":"2024-09-12T22:48:05.176735+0000","last_became_peered":"2024-09-12T22:48:05.176735+0000","last_unstale":"2024-09-12T22:51:06.343137+0000","last_undegraded":"2024-09-12T22:51:06.343137+0000","last_fullsized":"2024-09-12T22:51:06.343137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:51.360504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":36009,"num_write":361,"num_write_kb":71487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"61'456","reported_seq":1019,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723644+0000","last_change":"2024-09-12T22:51:00.699523+0000","last_active":"2024-09-12T22:51:05.723644+0000","last_peered":"2024-09-12T22:51:05.723644+0000","last_clean":"2024-09-12T22:51:05.723644+0000","last_became_active":"2024-09-12T22:51:00.698377+0000","last_became_peered":"2024-09-12T22:51:00.698377+0000","last_unstale":"2024-09-12T22:51:05.723644+0000","last_undegraded":"2024-09-12T22:51:05.723644+0000","last_fullsized":"2024-09-12T22:51:05.723644+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:04:47.810227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4316,"num_write":417,"num_write_kb":34284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"61'440","reported_seq":614,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342570+0000","last_change":"2024-09-12T22:48:05.176878+0000","last_active":"2024-09-12T22:51:06.342570+0000","last_peered":"2024-09-12T22:51:06.342570+0000","last_clean":"2024-09-12T22:51:06.342570+0000","last_became_active":"2024-09-12T22:48:05.176327+0000","last_became_peered":"2024-09-12T22:48:05.176327+0000","last_unstale":"2024-09-12T22:51:06.342570+0000","last_undegraded":"2024-09-12T22:51:06.342570+0000","last_fullsized":"2024-09-12T22:51:06.342570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:11.781766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15052,"num_write":399,"num_write_kb":71703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"61'424","reported_seq":582,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722737+0000","last_change":"2024-09-12T22:51:01.704366+0000","last_active":"2024-09-12T22:51:05.722737+0000","last_peered":"2024-09-12T22:51:05.722737+0000","last_clean":"2024-09-12T22:51:05.722737+0000","last_became_active":"2024-09-12T22:51:01.700878+0000","last_became_peered":"2024-09-12T22:51:01.700878+0000","last_unstale":"2024-09-12T22:51:05.722737+0000","last_undegraded":"2024-09-12T22:51:05.722737+0000","last_fullsized":"2024-09-12T22:51:05.722737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:57.250980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25587,"num_write":397,"num_write_kb":46651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"61'384","reported_seq":545,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724020+0000","last_change":"2024-09-12T22:48:05.171573+0000","last_active":"2024-09-12T22:51:05.724020+0000","last_peered":"2024-09-12T22:51:05.724020+0000","last_clean":"2024-09-12T22:51:05.724020+0000","last_became_active":"2024-09-12T22:48:05.171036+0000","last_became_peered":"2024-09-12T22:48:05.171036+0000","last_unstale":"2024-09-12T22:51:05.724020+0000","last_undegraded":"2024-09-12T22:51:05.724020+0000","last_fullsized":"2024-09-12T22:51:05.724020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:27:07.558853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9715,"num_write":345,"num_write_kb":63048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"61'450","reported_seq":585,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723240+0000","last_change":"2024-09-12T22:50:55.851831+0000","last_active":"2024-09-12T22:51:05.723240+0000","last_peered":"2024-09-12T22:51:05.723240+0000","last_clean":"2024-09-12T22:51:05.723240+0000","last_became_active":"2024-09-12T22:50:55.851443+0000","last_became_peered":"2024-09-12T22:50:55.851443+0000","last_unstale":"2024-09-12T22:51:05.723240+0000","last_undegraded":"2024-09-12T22:51:05.723240+0000","last_fullsized":"2024-09-12T22:51:05.723240+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:25:19.575346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":387,"num_write_kb":8369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"61'389","reported_seq":568,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724238+0000","last_change":"2024-09-12T22:48:05.173585+0000","last_active":"2024-09-12T22:51:05.724238+0000","last_peered":"2024-09-12T22:51:05.724238+0000","last_clean":"2024-09-12T22:51:05.724238+0000","last_became_active":"2024-09-12T22:48:05.172801+0000","last_became_peered":"2024-09-12T22:48:05.172801+0000","last_unstale":"2024-09-12T22:51:05.724238+0000","last_undegraded":"2024-09-12T22:51:05.724238+0000","last_fullsized":"2024-09-12T22:51:05.724238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:45.140060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":21115,"num_write":354,"num_write_kb":59128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"61'60","reported_seq":206,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342908+0000","last_change":"2024-09-12T22:50:52.860336+0000","last_active":"2024-09-12T22:51:06.342908+0000","last_peered":"2024-09-12T22:51:06.342908+0000","last_clean":"2024-09-12T22:51:06.342908+0000","last_became_active":"2024-09-12T22:50:52.859975+0000","last_became_peered":"2024-09-12T22:50:52.859975+0000","last_unstale":"2024-09-12T22:51:06.342908+0000","last_undegraded":"2024-09-12T22:51:06.342908+0000","last_fullsized":"2024-09-12T22:51:06.342908+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:14.260183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"61'433","reported_seq":997,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342401+0000","last_change":"2024-09-12T22:50:57.863647+0000","last_active":"2024-09-12T22:51:06.342401+0000","last_peered":"2024-09-12T22:51:06.342401+0000","last_clean":"2024-09-12T22:51:06.342401+0000","last_became_active":"2024-09-12T22:50:57.861719+0000","last_became_peered":"2024-09-12T22:50:57.861719+0000","last_unstale":"2024-09-12T22:51:06.342401+0000","last_undegraded":"2024-09-12T22:51:06.342401+0000","last_fullsized":"2024-09-12T22:51:06.342401+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:04:47.810227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17599,"num_write":404,"num_write_kb":59440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"61'63","reported_seq":209,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723521+0000","last_change":"2024-09-12T22:50:52.857615+0000","last_active":"2024-09-12T22:51:05.723521+0000","last_peered":"2024-09-12T22:51:05.723521+0000","last_clean":"2024-09-12T22:51:05.723521+0000","last_became_active":"2024-09-12T22:50:52.857343+0000","last_became_peered":"2024-09-12T22:50:52.857343+0000","last_unstale":"2024-09-12T22:51:05.723521+0000","last_undegraded":"2024-09-12T22:51:05.723521+0000","last_fullsized":"2024-09-12T22:51:05.723521+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:44.095690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"61'407","reported_seq":932,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343467+0000","last_change":"2024-09-12T22:50:55.853362+0000","last_active":"2024-09-12T22:51:06.343467+0000","last_peered":"2024-09-12T22:51:06.343467+0000","last_clean":"2024-09-12T22:51:06.343467+0000","last_became_active":"2024-09-12T22:50:55.851934+0000","last_became_peered":"2024-09-12T22:50:55.851934+0000","last_unstale":"2024-09-12T22:51:06.343467+0000","last_undegraded":"2024-09-12T22:51:06.343467+0000","last_fullsized":"2024-09-12T22:51:06.343467+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:51.010136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":24842,"num_write":378,"num_write_kb":79144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"61'62","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722703+0000","last_change":"2024-09-12T22:50:52.859828+0000","last_active":"2024-09-12T22:51:05.722703+0000","last_peered":"2024-09-12T22:51:05.722703+0000","last_clean":"2024-09-12T22:51:05.722703+0000","last_became_active":"2024-09-12T22:50:52.858911+0000","last_became_peered":"2024-09-12T22:50:52.858911+0000","last_unstale":"2024-09-12T22:51:05.722703+0000","last_undegraded":"2024-09-12T22:51:05.722703+0000","last_fullsized":"2024-09-12T22:51:05.722703+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:44.358340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"61'152","reported_seq":288,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723962+0000","last_change":"2024-09-12T22:50:55.851865+0000","last_active":"2024-09-12T22:51:05.723962+0000","last_peered":"2024-09-12T22:51:05.723962+0000","last_clean":"2024-09-12T22:51:05.723962+0000","last_became_active":"2024-09-12T22:50:55.851050+0000","last_became_peered":"2024-09-12T22:50:55.851050+0000","last_unstale":"2024-09-12T22:51:05.723962+0000","last_undegraded":"2024-09-12T22:51:05.723962+0000","last_fullsized":"2024-09-12T22:51:05.723962+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:31:24.219732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"61'392","reported_seq":890,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723334+0000","last_change":"2024-09-12T22:50:56.855073+0000","last_active":"2024-09-12T22:51:05.723334+0000","last_peered":"2024-09-12T22:51:05.723334+0000","last_clean":"2024-09-12T22:51:05.723334+0000","last_became_active":"2024-09-12T22:50:56.853383+0000","last_became_peered":"2024-09-12T22:50:56.853383+0000","last_unstale":"2024-09-12T22:51:05.723334+0000","last_undegraded":"2024-09-12T22:51:05.723334+0000","last_fullsized":"2024-09-12T22:51:05.723334+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:18.644500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":9675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"61'237","reported_seq":390,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724440+0000","last_change":"2024-09-12T22:50:55.852418+0000","last_active":"2024-09-12T22:51:05.724440+0000","last_peered":"2024-09-12T22:51:05.724440+0000","last_clean":"2024-09-12T22:51:05.724440+0000","last_became_active":"2024-09-12T22:50:55.852034+0000","last_became_peered":"2024-09-12T22:50:55.852034+0000","last_unstale":"2024-09-12T22:51:05.724440+0000","last_undegraded":"2024-09-12T22:51:05.724440+0000","last_fullsized":"2024-09-12T22:51:05.724440+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:47.161147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"61'464","reported_seq":637,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723400+0000","last_change":"2024-09-12T22:48:05.171143+0000","last_active":"2024-09-12T22:51:05.723400+0000","last_peered":"2024-09-12T22:51:05.723400+0000","last_clean":"2024-09-12T22:51:05.723400+0000","last_became_active":"2024-09-12T22:48:05.170374+0000","last_became_peered":"2024-09-12T22:48:05.170374+0000","last_unstale":"2024-09-12T22:51:05.723400+0000","last_undegraded":"2024-09-12T22:51:05.723400+0000","last_fullsized":"2024-09-12T22:51:05.723400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:15.887977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15522,"num_write":440,"num_write_kb":60335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"61'470","reported_seq":606,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723638+0000","last_change":"2024-09-12T22:50:55.852447+0000","last_active":"2024-09-12T22:51:05.723638+0000","last_peered":"2024-09-12T22:51:05.723638+0000","last_clean":"2024-09-12T22:51:05.723638+0000","last_became_active":"2024-09-12T22:50:55.852074+0000","last_became_peered":"2024-09-12T22:50:55.852074+0000","last_unstale":"2024-09-12T22:51:05.723638+0000","last_undegraded":"2024-09-12T22:51:05.723638+0000","last_fullsized":"2024-09-12T22:51:05.723638+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:24.010030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":4267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"61'449","reported_seq":636,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723253+0000","last_change":"2024-09-12T22:51:00.701817+0000","last_active":"2024-09-12T22:51:05.723253+0000","last_peered":"2024-09-12T22:51:05.723253+0000","last_clean":"2024-09-12T22:51:05.723253+0000","last_became_active":"2024-09-12T22:51:00.699592+0000","last_became_peered":"2024-09-12T22:51:00.699592+0000","last_unstale":"2024-09-12T22:51:05.723253+0000","last_undegraded":"2024-09-12T22:51:05.723253+0000","last_fullsized":"2024-09-12T22:51:05.723253+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:11.924779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":36634,"num_write":415,"num_write_kb":84238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"61'52","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723477+0000","last_change":"2024-09-12T22:50:52.857863+0000","last_active":"2024-09-12T22:51:05.723477+0000","last_peered":"2024-09-12T22:51:05.723477+0000","last_clean":"2024-09-12T22:51:05.723477+0000","last_became_active":"2024-09-12T22:50:52.857342+0000","last_became_peered":"2024-09-12T22:50:52.857342+0000","last_unstale":"2024-09-12T22:51:05.723477+0000","last_undegraded":"2024-09-12T22:51:05.723477+0000","last_fullsized":"2024-09-12T22:51:05.723477+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:59.906052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"61'434","reported_seq":1027,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343139+0000","last_change":"2024-09-12T22:50:58.701303+0000","last_active":"2024-09-12T22:51:06.343139+0000","last_peered":"2024-09-12T22:51:06.343139+0000","last_clean":"2024-09-12T22:51:06.343139+0000","last_became_active":"2024-09-12T22:50:58.700178+0000","last_became_peered":"2024-09-12T22:50:58.700178+0000","last_unstale":"2024-09-12T22:51:06.343139+0000","last_undegraded":"2024-09-12T22:51:06.343139+0000","last_fullsized":"2024-09-12T22:51:06.343139+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:13:37.634120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":39364,"num_write":402,"num_write_kb":59313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"61'194","reported_seq":349,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343266+0000","last_change":"2024-09-12T22:50:55.852827+0000","last_active":"2024-09-12T22:51:06.343266+0000","last_peered":"2024-09-12T22:51:06.343266+0000","last_clean":"2024-09-12T22:51:06.343266+0000","last_became_active":"2024-09-12T22:50:55.852479+0000","last_became_peered":"2024-09-12T22:50:55.852479+0000","last_unstale":"2024-09-12T22:51:06.343266+0000","last_undegraded":"2024-09-12T22:51:06.343266+0000","last_fullsized":"2024-09-12T22:51:06.343266+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:17.642880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"61'457","reported_seq":591,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723790+0000","last_change":"2024-09-12T22:51:03.707374+0000","last_active":"2024-09-12T22:51:05.723790+0000","last_peered":"2024-09-12T22:51:05.723790+0000","last_clean":"2024-09-12T22:51:05.723790+0000","last_became_active":"2024-09-12T22:51:03.704514+0000","last_became_peered":"2024-09-12T22:51:03.704514+0000","last_unstale":"2024-09-12T22:51:05.723790+0000","last_undegraded":"2024-09-12T22:51:05.723790+0000","last_fullsized":"2024-09-12T22:51:05.723790+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:13.942017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10832,"num_write":419,"num_write_kb":34901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"61'106","reported_seq":232,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722915+0000","last_change":"2024-09-12T22:50:55.851086+0000","last_active":"2024-09-12T22:51:05.722915+0000","last_peered":"2024-09-12T22:51:05.722915+0000","last_clean":"2024-09-12T22:51:05.722915+0000","last_became_active":"2024-09-12T22:50:55.850764+0000","last_became_peered":"2024-09-12T22:50:55.850764+0000","last_unstale":"2024-09-12T22:51:05.722915+0000","last_undegraded":"2024-09-12T22:51:05.722915+0000","last_fullsized":"2024-09-12T22:51:05.722915+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:26.058872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"61'431","reported_seq":571,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723616+0000","last_change":"2024-09-12T22:51:02.710383+0000","last_active":"2024-09-12T22:51:05.723616+0000","last_peered":"2024-09-12T22:51:05.723616+0000","last_clean":"2024-09-12T22:51:05.723616+0000","last_became_active":"2024-09-12T22:51:02.707646+0000","last_became_peered":"2024-09-12T22:51:02.707646+0000","last_unstale":"2024-09-12T22:51:05.723616+0000","last_undegraded":"2024-09-12T22:51:05.723616+0000","last_fullsized":"2024-09-12T22:51:05.723616+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:41.956076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":10443,"num_write":392,"num_write_kb":63957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"61'49","reported_seq":195,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723628+0000","last_change":"2024-09-12T22:50:52.857609+0000","last_active":"2024-09-12T22:51:05.723628+0000","last_peered":"2024-09-12T22:51:05.723628+0000","last_clean":"2024-09-12T22:51:05.723628+0000","last_became_active":"2024-09-12T22:50:52.857301+0000","last_became_peered":"2024-09-12T22:50:52.857301+0000","last_unstale":"2024-09-12T22:51:05.723628+0000","last_undegraded":"2024-09-12T22:51:05.723628+0000","last_fullsized":"2024-09-12T22:51:05.723628+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:43.328264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"61'351","reported_seq":475,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723979+0000","last_change":"2024-09-12T22:50:56.855396+0000","last_active":"2024-09-12T22:51:05.723979+0000","last_peered":"2024-09-12T22:51:05.723979+0000","last_clean":"2024-09-12T22:51:05.723979+0000","last_became_active":"2024-09-12T22:50:56.853610+0000","last_became_peered":"2024-09-12T22:50:56.853610+0000","last_unstale":"2024-09-12T22:51:05.723979+0000","last_undegraded":"2024-09-12T22:51:05.723979+0000","last_fullsized":"2024-09-12T22:51:05.723979+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:01.946701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":137,"num_write":315,"num_write_kb":37943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"61'588","reported_seq":727,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723397+0000","last_change":"2024-09-12T22:48:04.174281+0000","last_active":"2024-09-12T22:51:05.723397+0000","last_peered":"2024-09-12T22:51:05.723397+0000","last_clean":"2024-09-12T22:51:05.723397+0000","last_became_active":"2024-09-12T22:48:04.173942+0000","last_became_peered":"2024-09-12T22:48:04.173942+0000","last_unstale":"2024-09-12T22:51:05.723397+0000","last_undegraded":"2024-09-12T22:51:05.723397+0000","last_fullsized":"2024-09-12T22:51:05.723397+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:19:38.546747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":4334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"61'400","reported_seq":560,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343593+0000","last_change":"2024-09-12T22:48:05.178246+0000","last_active":"2024-09-12T22:51:06.343593+0000","last_peered":"2024-09-12T22:51:06.343593+0000","last_clean":"2024-09-12T22:51:06.343593+0000","last_became_active":"2024-09-12T22:48:05.176813+0000","last_became_peered":"2024-09-12T22:48:05.176813+0000","last_unstale":"2024-09-12T22:51:06.343593+0000","last_undegraded":"2024-09-12T22:51:06.343593+0000","last_fullsized":"2024-09-12T22:51:06.343593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:58.991752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":9179,"num_write":363,"num_write_kb":67046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":242,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722613+0000","last_change":"2024-09-12T22:50:52.860243+0000","last_active":"2024-09-12T22:51:05.722613+0000","last_peered":"2024-09-12T22:51:05.722613+0000","last_clean":"2024-09-12T22:51:05.722613+0000","last_became_active":"2024-09-12T22:50:52.859754+0000","last_became_peered":"2024-09-12T22:50:52.859754+0000","last_unstale":"2024-09-12T22:51:05.722613+0000","last_undegraded":"2024-09-12T22:51:05.722613+0000","last_fullsized":"2024-09-12T22:51:05.722613+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:55.016634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:55.016634+0000","last_clean_scrub_stamp":"2024-09-12T22:47:55.016634+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:41:30.207577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722981+0000","last_change":"2024-09-12T22:50:52.858727+0000","last_active":"2024-09-12T22:51:05.722981+0000","last_peered":"2024-09-12T22:51:05.722981+0000","last_clean":"2024-09-12T22:51:05.722981+0000","last_became_active":"2024-09-12T22:50:52.857759+0000","last_became_peered":"2024-09-12T22:50:52.857759+0000","last_unstale":"2024-09-12T22:51:05.722981+0000","last_undegraded":"2024-09-12T22:51:05.722981+0000","last_fullsized":"2024-09-12T22:51:05.722981+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:52.160461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"61'506","reported_seq":645,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343027+0000","last_change":"2024-09-12T22:48:04.169704+0000","last_active":"2024-09-12T22:51:06.343027+0000","last_peered":"2024-09-12T22:51:06.343027+0000","last_clean":"2024-09-12T22:51:06.343027+0000","last_became_active":"2024-09-12T22:48:04.169474+0000","last_became_peered":"2024-09-12T22:48:04.169474+0000","last_unstale":"2024-09-12T22:51:06.343027+0000","last_undegraded":"2024-09-12T22:51:06.343027+0000","last_fullsized":"2024-09-12T22:51:06.343027+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:00.271198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":444,"num_write_kb":8407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"61'422","reported_seq":595,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723784+0000","last_change":"2024-09-12T22:51:00.700237+0000","last_active":"2024-09-12T22:51:05.723784+0000","last_peered":"2024-09-12T22:51:05.723784+0000","last_clean":"2024-09-12T22:51:05.723784+0000","last_became_active":"2024-09-12T22:51:00.698391+0000","last_became_peered":"2024-09-12T22:51:00.698391+0000","last_unstale":"2024-09-12T22:51:05.723784+0000","last_undegraded":"2024-09-12T22:51:05.723784+0000","last_fullsized":"2024-09-12T22:51:05.723784+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:19.299721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":38484,"num_write":383,"num_write_kb":67099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722904+0000","last_change":"2024-09-12T22:50:52.859530+0000","last_active":"2024-09-12T22:51:05.722904+0000","last_peered":"2024-09-12T22:51:05.722904+0000","last_clean":"2024-09-12T22:51:05.722904+0000","last_became_active":"2024-09-12T22:50:52.858480+0000","last_became_peered":"2024-09-12T22:50:52.858480+0000","last_unstale":"2024-09-12T22:51:05.722904+0000","last_undegraded":"2024-09-12T22:51:05.722904+0000","last_fullsized":"2024-09-12T22:51:05.722904+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:28:23.416675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"61'107","reported_seq":304,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342800+0000","last_change":"2024-09-12T22:50:55.853291+0000","last_active":"2024-09-12T22:51:06.342800+0000","last_peered":"2024-09-12T22:51:06.342800+0000","last_clean":"2024-09-12T22:51:06.342800+0000","last_became_active":"2024-09-12T22:50:55.852965+0000","last_became_peered":"2024-09-12T22:50:55.852965+0000","last_unstale":"2024-09-12T22:51:06.342800+0000","last_undegraded":"2024-09-12T22:51:06.342800+0000","last_fullsized":"2024-09-12T22:51:06.342800+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:46.505934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1463793,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":1459,"num_write":45,"num_write_kb":1459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1463793,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"61'436","reported_seq":618,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724236+0000","last_change":"2024-09-12T22:48:05.171819+0000","last_active":"2024-09-12T22:51:05.724236+0000","last_peered":"2024-09-12T22:51:05.724236+0000","last_clean":"2024-09-12T22:51:05.724236+0000","last_became_active":"2024-09-12T22:48:05.171293+0000","last_became_peered":"2024-09-12T22:48:05.171293+0000","last_unstale":"2024-09-12T22:51:05.724236+0000","last_undegraded":"2024-09-12T22:51:05.724236+0000","last_fullsized":"2024-09-12T22:51:05.724236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:01.401542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":27936,"num_write":401,"num_write_kb":51013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342933+0000","last_change":"2024-09-12T22:48:02.045209+0000","last_active":"2024-09-12T22:51:06.342933+0000","last_peered":"2024-09-12T22:51:06.342933+0000","last_clean":"2024-09-12T22:51:06.342933+0000","last_became_active":"2024-09-12T22:48:00.042007+0000","last_became_peered":"2024-09-12T22:48:00.042007+0000","last_unstale":"2024-09-12T22:51:06.342933+0000","last_undegraded":"2024-09-12T22:51:06.342933+0000","last_fullsized":"2024-09-12T22:51:06.342933+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:13.536542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036893100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"61'357","reported_seq":511,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723507+0000","last_change":"2024-09-12T22:50:55.852384+0000","last_active":"2024-09-12T22:51:05.723507+0000","last_peered":"2024-09-12T22:51:05.723507+0000","last_clean":"2024-09-12T22:51:05.723507+0000","last_became_active":"2024-09-12T22:50:55.852029+0000","last_became_peered":"2024-09-12T22:50:55.852029+0000","last_unstale":"2024-09-12T22:51:05.723507+0000","last_undegraded":"2024-09-12T22:51:05.723507+0000","last_fullsized":"2024-09-12T22:51:05.723507+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:59.415555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":8307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"61'343","reported_seq":503,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343598+0000","last_change":"2024-09-12T22:48:05.178865+0000","last_active":"2024-09-12T22:51:06.343598+0000","last_peered":"2024-09-12T22:51:06.343598+0000","last_clean":"2024-09-12T22:51:06.343598+0000","last_became_active":"2024-09-12T22:48:05.178010+0000","last_became_peered":"2024-09-12T22:48:05.178010+0000","last_unstale":"2024-09-12T22:51:06.343598+0000","last_undegraded":"2024-09-12T22:51:06.343598+0000","last_fullsized":"2024-09-12T22:51:06.343598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:30.120804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":6704,"num_write":316,"num_write_kb":42458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":70,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722797+0000","last_change":"2024-09-12T22:50:52.858195+0000","last_active":"2024-09-12T22:51:05.722797+0000","last_peered":"2024-09-12T22:51:05.722797+0000","last_clean":"2024-09-12T22:51:05.722797+0000","last_became_active":"2024-09-12T22:50:52.857746+0000","last_became_peered":"2024-09-12T22:50:52.857746+0000","last_unstale":"2024-09-12T22:51:05.722797+0000","last_undegraded":"2024-09-12T22:51:05.722797+0000","last_fullsized":"2024-09-12T22:51:05.722797+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:10:52.096897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052714799999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"61'78","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723018+0000","last_change":"2024-09-12T22:50:52.858808+0000","last_active":"2024-09-12T22:51:05.723018+0000","last_peered":"2024-09-12T22:51:05.723018+0000","last_clean":"2024-09-12T22:51:05.723018+0000","last_became_active":"2024-09-12T22:50:52.858372+0000","last_became_peered":"2024-09-12T22:50:52.858372+0000","last_unstale":"2024-09-12T22:51:05.723018+0000","last_undegraded":"2024-09-12T22:51:05.723018+0000","last_fullsized":"2024-09-12T22:51:05.723018+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:44.345055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"61'404","reported_seq":614,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343369+0000","last_change":"2024-09-12T22:48:05.177561+0000","last_active":"2024-09-12T22:51:06.343369+0000","last_peered":"2024-09-12T22:51:06.343369+0000","last_clean":"2024-09-12T22:51:06.343369+0000","last_became_active":"2024-09-12T22:48:05.177164+0000","last_became_peered":"2024-09-12T22:48:05.177164+0000","last_unstale":"2024-09-12T22:51:06.343369+0000","last_undegraded":"2024-09-12T22:51:06.343369+0000","last_fullsized":"2024-09-12T22:51:06.343369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:24.124647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":35084,"num_write":365,"num_write_kb":71560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"61'269","reported_seq":395,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723416+0000","last_change":"2024-09-12T22:50:55.850951+0000","last_active":"2024-09-12T22:51:05.723416+0000","last_peered":"2024-09-12T22:51:05.723416+0000","last_clean":"2024-09-12T22:51:05.723416+0000","last_became_active":"2024-09-12T22:50:55.850689+0000","last_became_peered":"2024-09-12T22:50:55.850689+0000","last_unstale":"2024-09-12T22:51:05.723416+0000","last_undegraded":"2024-09-12T22:51:05.723416+0000","last_fullsized":"2024-09-12T22:51:05.723416+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:11:37.856958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":4189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343491+0000","last_change":"2024-09-12T22:48:02.045324+0000","last_active":"2024-09-12T22:51:06.343491+0000","last_peered":"2024-09-12T22:51:06.343491+0000","last_clean":"2024-09-12T22:51:06.343491+0000","last_became_active":"2024-09-12T22:48:00.042132+0000","last_became_peered":"2024-09-12T22:48:00.042132+0000","last_unstale":"2024-09-12T22:51:06.343491+0000","last_undegraded":"2024-09-12T22:51:06.343491+0000","last_fullsized":"2024-09-12T22:51:06.343491+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:24.673019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047590600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"61'362","reported_seq":851,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723496+0000","last_change":"2024-09-12T22:50:59.708186+0000","last_active":"2024-09-12T22:51:05.723496+0000","last_peered":"2024-09-12T22:51:05.723496+0000","last_clean":"2024-09-12T22:51:05.723496+0000","last_became_active":"2024-09-12T22:50:59.707126+0000","last_became_peered":"2024-09-12T22:50:59.707126+0000","last_unstale":"2024-09-12T22:51:05.723496+0000","last_undegraded":"2024-09-12T22:51:05.723496+0000","last_fullsized":"2024-09-12T22:51:05.723496+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:08:37.272462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":10445,"num_write":331,"num_write_kb":30096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"61'56","reported_seq":195,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343401+0000","last_change":"2024-09-12T22:48:04.169109+0000","last_active":"2024-09-12T22:51:06.343401+0000","last_peered":"2024-09-12T22:51:06.343401+0000","last_clean":"2024-09-12T22:51:06.343401+0000","last_became_active":"2024-09-12T22:48:04.168655+0000","last_became_peered":"2024-09-12T22:48:04.168655+0000","last_unstale":"2024-09-12T22:51:06.343401+0000","last_undegraded":"2024-09-12T22:51:06.343401+0000","last_fullsized":"2024-09-12T22:51:06.343401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:02.879935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724478+0000","last_change":"2024-09-12T22:48:02.045390+0000","last_active":"2024-09-12T22:51:05.724478+0000","last_peered":"2024-09-12T22:51:05.724478+0000","last_clean":"2024-09-12T22:51:05.724478+0000","last_became_active":"2024-09-12T22:48:00.045356+0000","last_became_peered":"2024-09-12T22:48:00.045356+0000","last_unstale":"2024-09-12T22:51:05.724478+0000","last_undegraded":"2024-09-12T22:51:05.724478+0000","last_fullsized":"2024-09-12T22:51:05.724478+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:32.072080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040621599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"61'408","reported_seq":982,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723709+0000","last_change":"2024-09-12T22:50:57.864738+0000","last_active":"2024-09-12T22:51:05.723709+0000","last_peered":"2024-09-12T22:51:05.723709+0000","last_clean":"2024-09-12T22:51:05.723709+0000","last_became_active":"2024-09-12T22:50:57.863486+0000","last_became_peered":"2024-09-12T22:50:57.863486+0000","last_unstale":"2024-09-12T22:51:05.723709+0000","last_undegraded":"2024-09-12T22:51:05.723709+0000","last_fullsized":"2024-09-12T22:51:05.723709+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:06:04.268528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":42311,"num_write":379,"num_write_kb":75412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"61'61","reported_seq":200,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343872+0000","last_change":"2024-09-12T22:48:04.168635+0000","last_active":"2024-09-12T22:51:06.343872+0000","last_peered":"2024-09-12T22:51:06.343872+0000","last_clean":"2024-09-12T22:51:06.343872+0000","last_became_active":"2024-09-12T22:48:04.168244+0000","last_became_peered":"2024-09-12T22:48:04.168244+0000","last_unstale":"2024-09-12T22:51:06.343872+0000","last_undegraded":"2024-09-12T22:51:06.343872+0000","last_fullsized":"2024-09-12T22:51:06.343872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:56.929490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343640+0000","last_change":"2024-09-12T22:48:02.045428+0000","last_active":"2024-09-12T22:51:06.343640+0000","last_peered":"2024-09-12T22:51:06.343640+0000","last_clean":"2024-09-12T22:51:06.343640+0000","last_became_active":"2024-09-12T22:48:00.040536+0000","last_became_peered":"2024-09-12T22:48:00.040536+0000","last_unstale":"2024-09-12T22:51:06.343640+0000","last_undegraded":"2024-09-12T22:51:06.343640+0000","last_fullsized":"2024-09-12T22:51:06.343640+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:33.150497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057699499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"61'430","reported_seq":990,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342744+0000","last_change":"2024-09-12T22:51:01.701692+0000","last_active":"2024-09-12T22:51:06.342744+0000","last_peered":"2024-09-12T22:51:06.342744+0000","last_clean":"2024-09-12T22:51:06.342744+0000","last_became_active":"2024-09-12T22:51:01.700292+0000","last_became_peered":"2024-09-12T22:51:01.700292+0000","last_unstale":"2024-09-12T22:51:06.342744+0000","last_undegraded":"2024-09-12T22:51:06.342744+0000","last_fullsized":"2024-09-12T22:51:06.342744+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:25.931698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":26700,"num_write":399,"num_write_kb":55331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"63'114","reported_seq":267,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343600+0000","last_change":"2024-09-12T22:50:55.852342+0000","last_active":"2024-09-12T22:51:06.343600+0000","last_peered":"2024-09-12T22:51:06.343600+0000","last_clean":"2024-09-12T22:51:06.343600+0000","last_became_active":"2024-09-12T22:50:55.851975+0000","last_became_peered":"2024-09-12T22:50:55.851975+0000","last_unstale":"2024-09-12T22:51:06.343600+0000","last_undegraded":"2024-09-12T22:51:06.343600+0000","last_fullsized":"2024-09-12T22:51:06.343600+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:42.555311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":1201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723698+0000","last_change":"2024-09-12T22:50:52.857531+0000","last_active":"2024-09-12T22:51:05.723698+0000","last_peered":"2024-09-12T22:51:05.723698+0000","last_clean":"2024-09-12T22:51:05.723698+0000","last_became_active":"2024-09-12T22:50:52.856757+0000","last_became_peered":"2024-09-12T22:50:52.856757+0000","last_unstale":"2024-09-12T22:51:05.723698+0000","last_undegraded":"2024-09-12T22:51:05.723698+0000","last_fullsized":"2024-09-12T22:51:05.723698+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:14.353873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"61'406","reported_seq":929,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723396+0000","last_change":"2024-09-12T22:50:56.855069+0000","last_active":"2024-09-12T22:51:05.723396+0000","last_peered":"2024-09-12T22:51:05.723396+0000","last_clean":"2024-09-12T22:51:05.723396+0000","last_became_active":"2024-09-12T22:50:56.853376+0000","last_became_peered":"2024-09-12T22:50:56.853376+0000","last_unstale":"2024-09-12T22:51:05.723396+0000","last_undegraded":"2024-09-12T22:51:05.723396+0000","last_fullsized":"2024-09-12T22:51:05.723396+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:43.556932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17112,"num_write":373,"num_write_kb":79947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"61'378","reported_seq":533,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723357+0000","last_change":"2024-09-12T22:50:57.863154+0000","last_active":"2024-09-12T22:51:05.723357+0000","last_peered":"2024-09-12T22:51:05.723357+0000","last_clean":"2024-09-12T22:51:05.723357+0000","last_became_active":"2024-09-12T22:50:57.861280+0000","last_became_peered":"2024-09-12T22:50:57.861280+0000","last_unstale":"2024-09-12T22:51:05.723357+0000","last_undegraded":"2024-09-12T22:51:05.723357+0000","last_fullsized":"2024-09-12T22:51:05.723357+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:13.015760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15048,"num_write":339,"num_write_kb":35238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"63'249","reported_seq":391,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723315+0000","last_change":"2024-09-12T22:50:55.849742+0000","last_active":"2024-09-12T22:51:05.723315+0000","last_peered":"2024-09-12T22:51:05.723315+0000","last_clean":"2024-09-12T22:51:05.723315+0000","last_became_active":"2024-09-12T22:50:55.849531+0000","last_became_peered":"2024-09-12T22:50:55.849531+0000","last_unstale":"2024-09-12T22:51:05.723315+0000","last_undegraded":"2024-09-12T22:51:05.723315+0000","last_fullsized":"2024-09-12T22:51:05.723315+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:32.676988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8461053,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":8364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8456257,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"61'405","reported_seq":569,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342826+0000","last_change":"2024-09-12T22:48:05.176779+0000","last_active":"2024-09-12T22:51:06.342826+0000","last_peered":"2024-09-12T22:51:06.342826+0000","last_clean":"2024-09-12T22:51:06.342826+0000","last_became_active":"2024-09-12T22:48:05.176344+0000","last_became_peered":"2024-09-12T22:48:05.176344+0000","last_unstale":"2024-09-12T22:51:06.342826+0000","last_undegraded":"2024-09-12T22:51:06.342826+0000","last_fullsized":"2024-09-12T22:51:06.342826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:35.645286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":25018,"num_write":372,"num_write_kb":42936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"61'85","reported_seq":236,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724390+0000","last_change":"2024-09-12T22:50:52.905108+0000","last_active":"2024-09-12T22:51:05.724390+0000","last_peered":"2024-09-12T22:51:05.724390+0000","last_clean":"2024-09-12T22:51:05.724390+0000","last_became_active":"2024-09-12T22:50:52.861594+0000","last_became_peered":"2024-09-12T22:50:52.861594+0000","last_unstale":"2024-09-12T22:51:05.724390+0000","last_undegraded":"2024-09-12T22:51:05.724390+0000","last_fullsized":"2024-09-12T22:51:05.724390+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:49.196178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"61'213","reported_seq":338,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723895+0000","last_change":"2024-09-12T22:50:55.852154+0000","last_active":"2024-09-12T22:51:05.723895+0000","last_peered":"2024-09-12T22:51:05.723895+0000","last_clean":"2024-09-12T22:51:05.723895+0000","last_became_active":"2024-09-12T22:50:55.851798+0000","last_became_peered":"2024-09-12T22:50:55.851798+0000","last_unstale":"2024-09-12T22:51:05.723895+0000","last_undegraded":"2024-09-12T22:51:05.723895+0000","last_fullsized":"2024-09-12T22:51:05.723895+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:03:29.463409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":4171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"61'478","reported_seq":1107,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342630+0000","last_change":"2024-09-12T22:50:56.856443+0000","last_active":"2024-09-12T22:51:06.342630+0000","last_peered":"2024-09-12T22:51:06.342630+0000","last_clean":"2024-09-12T22:51:06.342630+0000","last_became_active":"2024-09-12T22:50:56.855150+0000","last_became_peered":"2024-09-12T22:50:56.855150+0000","last_unstale":"2024-09-12T22:51:06.342630+0000","last_undegraded":"2024-09-12T22:51:06.342630+0000","last_fullsized":"2024-09-12T22:51:06.342630+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:11.194706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":41320,"num_write":445,"num_write_kb":84826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":209,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"61'55","reported_seq":201,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343774+0000","last_change":"2024-09-12T22:50:52.859702+0000","last_active":"2024-09-12T22:51:06.343774+0000","last_peered":"2024-09-12T22:51:06.343774+0000","last_clean":"2024-09-12T22:51:06.343774+0000","last_became_active":"2024-09-12T22:50:52.859296+0000","last_became_peered":"2024-09-12T22:50:52.859296+0000","last_unstale":"2024-09-12T22:51:06.343774+0000","last_undegraded":"2024-09-12T22:51:06.343774+0000","last_fullsized":"2024-09-12T22:51:06.343774+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:14.180904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"61'447","reported_seq":634,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342672+0000","last_change":"2024-09-12T22:48:05.169648+0000","last_active":"2024-09-12T22:51:06.342672+0000","last_peered":"2024-09-12T22:51:06.342672+0000","last_clean":"2024-09-12T22:51:06.342672+0000","last_became_active":"2024-09-12T22:48:05.168356+0000","last_became_peered":"2024-09-12T22:48:05.168356+0000","last_unstale":"2024-09-12T22:51:06.342672+0000","last_undegraded":"2024-09-12T22:51:06.342672+0000","last_fullsized":"2024-09-12T22:51:06.342672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:52.341512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25877,"num_write":417,"num_write_kb":39269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"61'371","reported_seq":888,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724516+0000","last_change":"2024-09-12T22:51:02.709645+0000","last_active":"2024-09-12T22:51:05.724516+0000","last_peered":"2024-09-12T22:51:05.724516+0000","last_clean":"2024-09-12T22:51:05.724516+0000","last_became_active":"2024-09-12T22:51:02.708091+0000","last_became_peered":"2024-09-12T22:51:02.708091+0000","last_unstale":"2024-09-12T22:51:05.724516+0000","last_undegraded":"2024-09-12T22:51:05.724516+0000","last_fullsized":"2024-09-12T22:51:05.724516+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:13:37.634120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20950,"num_write":339,"num_write_kb":39207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"61'601","reported_seq":740,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342822+0000","last_change":"2024-09-12T22:48:04.169111+0000","last_active":"2024-09-12T22:51:06.342822+0000","last_peered":"2024-09-12T22:51:06.342822+0000","last_clean":"2024-09-12T22:51:06.342822+0000","last_became_active":"2024-09-12T22:48:04.168743+0000","last_became_peered":"2024-09-12T22:48:04.168743+0000","last_unstale":"2024-09-12T22:51:06.342822+0000","last_undegraded":"2024-09-12T22:51:06.342822+0000","last_fullsized":"2024-09-12T22:51:06.342822+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:43.709660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":535,"num_write_kb":8445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"61'438","reported_seq":978,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342401+0000","last_change":"2024-09-12T22:50:57.863618+0000","last_active":"2024-09-12T22:51:06.342401+0000","last_peered":"2024-09-12T22:51:06.342401+0000","last_clean":"2024-09-12T22:51:06.342401+0000","last_became_active":"2024-09-12T22:50:57.861695+0000","last_became_peered":"2024-09-12T22:50:57.861695+0000","last_unstale":"2024-09-12T22:51:06.342401+0000","last_undegraded":"2024-09-12T22:51:06.342401+0000","last_fullsized":"2024-09-12T22:51:06.342401+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:08:37.272462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":16921,"num_write":411,"num_write_kb":146790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"61'185","reported_seq":337,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342787+0000","last_change":"2024-09-12T22:50:55.853288+0000","last_active":"2024-09-12T22:51:06.342787+0000","last_peered":"2024-09-12T22:51:06.342787+0000","last_clean":"2024-09-12T22:51:06.342787+0000","last_became_active":"2024-09-12T22:50:55.852796+0000","last_became_peered":"2024-09-12T22:50:55.852796+0000","last_unstale":"2024-09-12T22:51:06.342787+0000","last_undegraded":"2024-09-12T22:51:06.342787+0000","last_fullsized":"2024-09-12T22:51:06.342787+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:06:03.266907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"61'386","reported_seq":886,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724136+0000","last_change":"2024-09-12T22:51:01.702122+0000","last_active":"2024-09-12T22:51:05.724136+0000","last_peered":"2024-09-12T22:51:05.724136+0000","last_clean":"2024-09-12T22:51:05.724136+0000","last_became_active":"2024-09-12T22:51:01.701006+0000","last_became_peered":"2024-09-12T22:51:01.701006+0000","last_unstale":"2024-09-12T22:51:05.724136+0000","last_undegraded":"2024-09-12T22:51:05.724136+0000","last_fullsized":"2024-09-12T22:51:05.724136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:44.083029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":21487,"num_write":344,"num_write_kb":72645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"61'180","reported_seq":319,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723786+0000","last_change":"2024-09-12T22:48:04.174205+0000","last_active":"2024-09-12T22:51:05.723786+0000","last_peered":"2024-09-12T22:51:05.723786+0000","last_clean":"2024-09-12T22:51:05.723786+0000","last_became_active":"2024-09-12T22:48:04.173902+0000","last_became_peered":"2024-09-12T22:48:04.173902+0000","last_unstale":"2024-09-12T22:51:05.723786+0000","last_undegraded":"2024-09-12T22:51:05.723786+0000","last_fullsized":"2024-09-12T22:51:05.723786+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:43:39.709214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":12355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"61'396","reported_seq":552,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723907+0000","last_change":"2024-09-12T22:48:05.172917+0000","last_active":"2024-09-12T22:51:05.723907+0000","last_peered":"2024-09-12T22:51:05.723907+0000","last_clean":"2024-09-12T22:51:05.723907+0000","last_became_active":"2024-09-12T22:48:05.172493+0000","last_became_peered":"2024-09-12T22:48:05.172493+0000","last_unstale":"2024-09-12T22:51:05.723907+0000","last_undegraded":"2024-09-12T22:51:05.723907+0000","last_fullsized":"2024-09-12T22:51:05.723907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:35.645286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9980,"num_write":370,"num_write_kb":80321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"61'64","reported_seq":215,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723864+0000","last_change":"2024-09-12T22:50:52.884955+0000","last_active":"2024-09-12T22:51:05.723864+0000","last_peered":"2024-09-12T22:51:05.723864+0000","last_clean":"2024-09-12T22:51:05.723864+0000","last_became_active":"2024-09-12T22:50:52.858938+0000","last_became_peered":"2024-09-12T22:50:52.858938+0000","last_unstale":"2024-09-12T22:51:05.723864+0000","last_undegraded":"2024-09-12T22:51:05.723864+0000","last_fullsized":"2024-09-12T22:51:05.723864+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:24.405738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"61'370","reported_seq":515,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723307+0000","last_change":"2024-09-12T22:50:59.705667+0000","last_active":"2024-09-12T22:51:05.723307+0000","last_peered":"2024-09-12T22:51:05.723307+0000","last_clean":"2024-09-12T22:51:05.723307+0000","last_became_active":"2024-09-12T22:50:59.704074+0000","last_became_peered":"2024-09-12T22:50:59.704074+0000","last_unstale":"2024-09-12T22:51:05.723307+0000","last_undegraded":"2024-09-12T22:51:05.723307+0000","last_fullsized":"2024-09-12T22:51:05.723307+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:59.243155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16468,"num_write":341,"num_write_kb":50344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"61'187","reported_seq":321,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723342+0000","last_change":"2024-09-12T22:50:55.851804+0000","last_active":"2024-09-12T22:51:05.723342+0000","last_peered":"2024-09-12T22:51:05.723342+0000","last_clean":"2024-09-12T22:51:05.723342+0000","last_became_active":"2024-09-12T22:50:55.851467+0000","last_became_peered":"2024-09-12T22:50:55.851467+0000","last_unstale":"2024-09-12T22:51:05.723342+0000","last_undegraded":"2024-09-12T22:51:05.723342+0000","last_fullsized":"2024-09-12T22:51:05.723342+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:05.608780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"61'438","reported_seq":636,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723016+0000","last_change":"2024-09-12T22:50:59.706857+0000","last_active":"2024-09-12T22:51:05.723016+0000","last_peered":"2024-09-12T22:51:05.723016+0000","last_clean":"2024-09-12T22:51:05.723016+0000","last_became_active":"2024-09-12T22:50:59.703786+0000","last_became_peered":"2024-09-12T22:50:59.703786+0000","last_unstale":"2024-09-12T22:51:05.723016+0000","last_undegraded":"2024-09-12T22:51:05.723016+0000","last_fullsized":"2024-09-12T22:51:05.723016+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:52:45.535138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":38460,"num_write":412,"num_write_kb":96626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"61'185","reported_seq":342,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724254+0000","last_change":"2024-09-12T22:50:55.853065+0000","last_active":"2024-09-12T22:51:05.724254+0000","last_peered":"2024-09-12T22:51:05.724254+0000","last_clean":"2024-09-12T22:51:05.724254+0000","last_became_active":"2024-09-12T22:50:55.852654+0000","last_became_peered":"2024-09-12T22:50:55.852654+0000","last_unstale":"2024-09-12T22:51:05.724254+0000","last_undegraded":"2024-09-12T22:51:05.724254+0000","last_fullsized":"2024-09-12T22:51:05.724254+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:17.101030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":12349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"61'418","reported_seq":599,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723714+0000","last_change":"2024-09-12T22:48:05.171815+0000","last_active":"2024-09-12T22:51:05.723714+0000","last_peered":"2024-09-12T22:51:05.723714+0000","last_clean":"2024-09-12T22:51:05.723714+0000","last_became_active":"2024-09-12T22:48:05.171361+0000","last_became_peered":"2024-09-12T22:48:05.171361+0000","last_unstale":"2024-09-12T22:51:05.723714+0000","last_undegraded":"2024-09-12T22:51:05.723714+0000","last_fullsized":"2024-09-12T22:51:05.723714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:28.873036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":27427,"num_write":388,"num_write_kb":67745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"61'159","reported_seq":285,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724366+0000","last_change":"2024-09-12T22:50:55.852290+0000","last_active":"2024-09-12T22:51:05.724366+0000","last_peered":"2024-09-12T22:51:05.724366+0000","last_clean":"2024-09-12T22:51:05.724366+0000","last_became_active":"2024-09-12T22:50:55.851948+0000","last_became_peered":"2024-09-12T22:50:55.851948+0000","last_unstale":"2024-09-12T22:51:05.724366+0000","last_undegraded":"2024-09-12T22:51:05.724366+0000","last_fullsized":"2024-09-12T22:51:05.724366+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:14.260183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"61'479","reported_seq":652,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723053+0000","last_change":"2024-09-12T22:51:03.707091+0000","last_active":"2024-09-12T22:51:05.723053+0000","last_peered":"2024-09-12T22:51:05.723053+0000","last_clean":"2024-09-12T22:51:05.723053+0000","last_became_active":"2024-09-12T22:51:03.704137+0000","last_became_peered":"2024-09-12T22:51:03.704137+0000","last_unstale":"2024-09-12T22:51:05.723053+0000","last_undegraded":"2024-09-12T22:51:05.723053+0000","last_fullsized":"2024-09-12T22:51:05.723053+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:27:47.351934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":26793,"num_write":459,"num_write_kb":138325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"61'49","reported_seq":200,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343704+0000","last_change":"2024-09-12T22:50:52.903138+0000","last_active":"2024-09-12T22:51:06.343704+0000","last_peered":"2024-09-12T22:51:06.343704+0000","last_clean":"2024-09-12T22:51:06.343704+0000","last_became_active":"2024-09-12T22:50:52.859983+0000","last_became_peered":"2024-09-12T22:50:52.859983+0000","last_unstale":"2024-09-12T22:51:06.343704+0000","last_undegraded":"2024-09-12T22:51:06.343704+0000","last_fullsized":"2024-09-12T22:51:06.343704+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:59.415555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2742,"num_read_kb":1405479,"num_write":24656,"num_write_kb":4261796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7339,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26737,"ondisk_log_size":26737,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127366156,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":45,"num_read_kb":1459,"num_write":4460,"num_write_kb":127655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":93806220,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254799872,"data_stored":254732312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5569,"internal_metadata":0},"log_size":6243,"ondisk_log_size":6243,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":67,"seq":287762808837,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150992,"kb_used_data":92924,"kb_used_omap":6,"kb_used_meta":58041,"kb_avail":94220848,"statfs":{"total":96636764160,"available":96482148352,"internally_reserved":0,"allocated":95154176,"data_stored":94739479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7164,"internal_metadata":59433988},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738410,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":169456,"kb_used_data":75864,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94202384,"statfs":{"total":96636764160,"available":96463241216,"internally_reserved":0,"allocated":77684736,"data_stored":77299268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738412,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":172716,"kb_used_data":83284,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94199124,"statfs":{"total":96636764160,"available":96459902976,"internally_reserved":0,"allocated":85282816,"data_stored":84886443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83980288,"data_stored":83958707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":76972032,"data_stored":76961881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":93847552,"data_stored":93811724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5569,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:51:10.920 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:51:11.250 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:51:11.252 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-09-12T22:51:11.261 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2024-09-12T22:51:10.176776+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127956543,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":2923,"num_read_kb":1407056,"num_write":29321,"num_write_kb":4392913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7366,"num_bytes_recovered":93806220,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33140,"ondisk_log_size":33140,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":493164,"kb_used_data":252072,"kb_used_omap":10,"kb_used_meta":241013,"kb_avail":282622356,"statfs":{"total":289910292480,"available":289405292544,"internally_reserved":0,"allocated":258121728,"data_stored":256925190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10354,"internal_metadata":246798222},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1970,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2529,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.477824"},"pg_stats":[{"pgid":"4.3f","version":"61'404","reported_seq":563,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724420+0000","last_change":"2024-09-12T22:48:05.174190+0000","last_active":"2024-09-12T22:51:05.724420+0000","last_peered":"2024-09-12T22:51:05.724420+0000","last_clean":"2024-09-12T22:51:05.724420+0000","last_became_active":"2024-09-12T22:48:05.172964+0000","last_became_peered":"2024-09-12T22:48:05.172964+0000","last_unstale":"2024-09-12T22:51:05.724420+0000","last_undegraded":"2024-09-12T22:51:05.724420+0000","last_fullsized":"2024-09-12T22:51:05.724420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:49.868891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9582,"num_write":371,"num_write_kb":42180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"61'425","reported_seq":633,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724097+0000","last_change":"2024-09-12T22:48:05.173045+0000","last_active":"2024-09-12T22:51:05.724097+0000","last_peered":"2024-09-12T22:51:05.724097+0000","last_clean":"2024-09-12T22:51:05.724097+0000","last_became_active":"2024-09-12T22:48:05.172684+0000","last_became_peered":"2024-09-12T22:48:05.172684+0000","last_unstale":"2024-09-12T22:51:05.724097+0000","last_undegraded":"2024-09-12T22:51:05.724097+0000","last_fullsized":"2024-09-12T22:51:05.724097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:51.360504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":40466,"num_write":394,"num_write_kb":96045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"61'385","reported_seq":516,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723911+0000","last_change":"2024-09-12T22:51:00.703306+0000","last_active":"2024-09-12T22:51:05.723911+0000","last_peered":"2024-09-12T22:51:05.723911+0000","last_clean":"2024-09-12T22:51:05.723911+0000","last_became_active":"2024-09-12T22:51:00.700490+0000","last_became_peered":"2024-09-12T22:51:00.700490+0000","last_unstale":"2024-09-12T22:51:05.723911+0000","last_undegraded":"2024-09-12T22:51:05.723911+0000","last_fullsized":"2024-09-12T22:51:05.723911+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:16.055859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":7348,"num_write":352,"num_write_kb":34517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"61'395","reported_seq":563,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723474+0000","last_change":"2024-09-12T22:51:02.711764+0000","last_active":"2024-09-12T22:51:05.723474+0000","last_peered":"2024-09-12T22:51:05.723474+0000","last_clean":"2024-09-12T22:51:05.723474+0000","last_became_active":"2024-09-12T22:51:02.708216+0000","last_became_peered":"2024-09-12T22:51:02.708216+0000","last_unstale":"2024-09-12T22:51:05.723474+0000","last_undegraded":"2024-09-12T22:51:05.723474+0000","last_fullsized":"2024-09-12T22:51:05.723474+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:24.442976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":25803,"num_write":361,"num_write_kb":71646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"61'410","reported_seq":573,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723888+0000","last_change":"2024-09-12T22:48:05.170306+0000","last_active":"2024-09-12T22:51:05.723888+0000","last_peered":"2024-09-12T22:51:05.723888+0000","last_clean":"2024-09-12T22:51:05.723888+0000","last_became_active":"2024-09-12T22:48:05.169940+0000","last_became_peered":"2024-09-12T22:48:05.169940+0000","last_unstale":"2024-09-12T22:51:05.723888+0000","last_undegraded":"2024-09-12T22:51:05.723888+0000","last_fullsized":"2024-09-12T22:51:05.723888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:52.341512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":20544,"num_write":387,"num_write_kb":55745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"61'384","reported_seq":499,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723190+0000","last_change":"2024-09-12T22:51:03.706817+0000","last_active":"2024-09-12T22:51:05.723190+0000","last_peered":"2024-09-12T22:51:05.723190+0000","last_clean":"2024-09-12T22:51:05.723190+0000","last_became_active":"2024-09-12T22:51:03.704293+0000","last_became_peered":"2024-09-12T22:51:03.704293+0000","last_unstale":"2024-09-12T22:51:05.723190+0000","last_undegraded":"2024-09-12T22:51:05.723190+0000","last_fullsized":"2024-09-12T22:51:05.723190+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:07.148926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5069,"num_write":355,"num_write_kb":38430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"61'461","reported_seq":656,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723091+0000","last_change":"2024-09-12T22:50:56.858810+0000","last_active":"2024-09-12T22:51:05.723091+0000","last_peered":"2024-09-12T22:51:05.723091+0000","last_clean":"2024-09-12T22:51:05.723091+0000","last_became_active":"2024-09-12T22:50:56.856720+0000","last_became_peered":"2024-09-12T22:50:56.856720+0000","last_unstale":"2024-09-12T22:51:05.723091+0000","last_undegraded":"2024-09-12T22:51:05.723091+0000","last_fullsized":"2024-09-12T22:51:05.723091+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:21.599293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":30574,"num_write":435,"num_write_kb":92996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"61'385","reported_seq":518,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722895+0000","last_change":"2024-09-12T22:51:00.703157+0000","last_active":"2024-09-12T22:51:05.722895+0000","last_peered":"2024-09-12T22:51:05.722895+0000","last_clean":"2024-09-12T22:51:05.722895+0000","last_became_active":"2024-09-12T22:51:00.700472+0000","last_became_peered":"2024-09-12T22:51:00.700472+0000","last_unstale":"2024-09-12T22:51:05.722895+0000","last_undegraded":"2024-09-12T22:51:05.722895+0000","last_fullsized":"2024-09-12T22:51:05.722895+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:07.616061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9031,"num_write":340,"num_write_kb":84729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"61'435","reported_seq":585,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343462+0000","last_change":"2024-09-12T22:48:05.178445+0000","last_active":"2024-09-12T22:51:06.343462+0000","last_peered":"2024-09-12T22:51:06.343462+0000","last_clean":"2024-09-12T22:51:06.343462+0000","last_became_active":"2024-09-12T22:48:05.177284+0000","last_became_peered":"2024-09-12T22:48:05.177284+0000","last_unstale":"2024-09-12T22:51:06.343462+0000","last_undegraded":"2024-09-12T22:51:06.343462+0000","last_fullsized":"2024-09-12T22:51:06.343462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:45.140060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8316,"num_write":403,"num_write_kb":71851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"61'443","reported_seq":648,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724176+0000","last_change":"2024-09-12T22:48:05.172480+0000","last_active":"2024-09-12T22:51:05.724176+0000","last_peered":"2024-09-12T22:51:05.724176+0000","last_clean":"2024-09-12T22:51:05.724176+0000","last_became_active":"2024-09-12T22:48:05.171686+0000","last_became_peered":"2024-09-12T22:48:05.171686+0000","last_unstale":"2024-09-12T22:51:05.724176+0000","last_undegraded":"2024-09-12T22:51:05.724176+0000","last_fullsized":"2024-09-12T22:51:05.724176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:56.158813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40751,"num_write":407,"num_write_kb":116626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"61'383","reported_seq":509,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723914+0000","last_change":"2024-09-12T22:51:02.712354+0000","last_active":"2024-09-12T22:51:05.723914+0000","last_peered":"2024-09-12T22:51:05.723914+0000","last_clean":"2024-09-12T22:51:05.723914+0000","last_became_active":"2024-09-12T22:51:02.710579+0000","last_became_peered":"2024-09-12T22:51:02.710579+0000","last_unstale":"2024-09-12T22:51:05.723914+0000","last_undegraded":"2024-09-12T22:51:05.723914+0000","last_fullsized":"2024-09-12T22:51:05.723914+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:58:11.483150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5475,"num_write":365,"num_write_kb":63204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"61'366","reported_seq":891,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723891+0000","last_change":"2024-09-12T22:50:58.699684+0000","last_active":"2024-09-12T22:51:05.723891+0000","last_peered":"2024-09-12T22:51:05.723891+0000","last_clean":"2024-09-12T22:51:05.723891+0000","last_became_active":"2024-09-12T22:50:58.698711+0000","last_became_peered":"2024-09-12T22:50:58.698711+0000","last_unstale":"2024-09-12T22:51:05.723891+0000","last_undegraded":"2024-09-12T22:51:05.723891+0000","last_fullsized":"2024-09-12T22:51:05.723891+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:47.507555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":35222,"num_write":342,"num_write_kb":74947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"61'434","reported_seq":622,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723644+0000","last_change":"2024-09-12T22:48:05.171356+0000","last_active":"2024-09-12T22:51:05.723644+0000","last_peered":"2024-09-12T22:51:05.723644+0000","last_clean":"2024-09-12T22:51:05.723644+0000","last_became_active":"2024-09-12T22:48:05.170794+0000","last_became_peered":"2024-09-12T22:48:05.170794+0000","last_unstale":"2024-09-12T22:51:05.723644+0000","last_undegraded":"2024-09-12T22:51:05.723644+0000","last_fullsized":"2024-09-12T22:51:05.723644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:42:56.969660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":19623,"num_write":389,"num_write_kb":83457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"61'432","reported_seq":601,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723150+0000","last_change":"2024-09-12T22:50:58.702236+0000","last_active":"2024-09-12T22:51:05.723150+0000","last_peered":"2024-09-12T22:51:05.723150+0000","last_clean":"2024-09-12T22:51:05.723150+0000","last_became_active":"2024-09-12T22:50:58.700107+0000","last_became_peered":"2024-09-12T22:50:58.700107+0000","last_unstale":"2024-09-12T22:51:05.723150+0000","last_undegraded":"2024-09-12T22:51:05.723150+0000","last_fullsized":"2024-09-12T22:51:05.723150+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:29.112353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":23332,"num_write":401,"num_write_kb":75871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"61'406","reported_seq":573,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723029+0000","last_change":"2024-09-12T22:50:55.852257+0000","last_active":"2024-09-12T22:51:05.723029+0000","last_peered":"2024-09-12T22:51:05.723029+0000","last_clean":"2024-09-12T22:51:05.723029+0000","last_became_active":"2024-09-12T22:50:55.849568+0000","last_became_peered":"2024-09-12T22:50:55.849568+0000","last_unstale":"2024-09-12T22:51:05.723029+0000","last_undegraded":"2024-09-12T22:51:05.723029+0000","last_fullsized":"2024-09-12T22:51:05.723029+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:49.995990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":18162,"num_write":365,"num_write_kb":58919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"61'444","reported_seq":575,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723061+0000","last_change":"2024-09-12T22:51:01.704325+0000","last_active":"2024-09-12T22:51:05.723061+0000","last_peered":"2024-09-12T22:51:05.723061+0000","last_clean":"2024-09-12T22:51:05.723061+0000","last_became_active":"2024-09-12T22:51:01.700744+0000","last_became_peered":"2024-09-12T22:51:01.700744+0000","last_unstale":"2024-09-12T22:51:05.723061+0000","last_undegraded":"2024-09-12T22:51:05.723061+0000","last_fullsized":"2024-09-12T22:51:05.723061+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:00.747671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":410,"num_write_kb":63144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"61'443","reported_seq":616,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343794+0000","last_change":"2024-09-12T22:48:05.178721+0000","last_active":"2024-09-12T22:51:06.343794+0000","last_peered":"2024-09-12T22:51:06.343794+0000","last_clean":"2024-09-12T22:51:06.343794+0000","last_became_active":"2024-09-12T22:48:05.177965+0000","last_became_peered":"2024-09-12T22:48:05.177965+0000","last_unstale":"2024-09-12T22:51:06.343794+0000","last_undegraded":"2024-09-12T22:51:06.343794+0000","last_fullsized":"2024-09-12T22:51:06.343794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:32.288419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":14687,"num_write":408,"num_write_kb":80026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"61'439","reported_seq":665,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724329+0000","last_change":"2024-09-12T22:48:05.171053+0000","last_active":"2024-09-12T22:51:05.724329+0000","last_peered":"2024-09-12T22:51:05.724329+0000","last_clean":"2024-09-12T22:51:05.724329+0000","last_became_active":"2024-09-12T22:48:05.170578+0000","last_became_peered":"2024-09-12T22:48:05.170578+0000","last_unstale":"2024-09-12T22:51:05.724329+0000","last_undegraded":"2024-09-12T22:51:05.724329+0000","last_fullsized":"2024-09-12T22:51:05.724329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:58.991752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":47063,"num_write":400,"num_write_kb":100535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"61'444","reported_seq":660,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343268+0000","last_change":"2024-09-12T22:48:05.177369+0000","last_active":"2024-09-12T22:51:06.343268+0000","last_peered":"2024-09-12T22:51:06.343268+0000","last_clean":"2024-09-12T22:51:06.343268+0000","last_became_active":"2024-09-12T22:48:05.176680+0000","last_became_peered":"2024-09-12T22:48:05.176680+0000","last_unstale":"2024-09-12T22:51:06.343268+0000","last_undegraded":"2024-09-12T22:51:06.343268+0000","last_fullsized":"2024-09-12T22:51:06.343268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:25.143572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":42758,"num_write":403,"num_write_kb":67827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"61'433","reported_seq":570,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723656+0000","last_change":"2024-09-12T22:51:02.711577+0000","last_active":"2024-09-12T22:51:05.723656+0000","last_peered":"2024-09-12T22:51:05.723656+0000","last_clean":"2024-09-12T22:51:05.723656+0000","last_became_active":"2024-09-12T22:51:02.708090+0000","last_became_peered":"2024-09-12T22:51:02.708090+0000","last_unstale":"2024-09-12T22:51:05.723656+0000","last_undegraded":"2024-09-12T22:51:05.723656+0000","last_fullsized":"2024-09-12T22:51:05.723656+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:32.441902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":10750,"num_write":397,"num_write_kb":34708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"61'413","reported_seq":588,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723473+0000","last_change":"2024-09-12T22:50:58.702132+0000","last_active":"2024-09-12T22:51:05.723473+0000","last_peered":"2024-09-12T22:51:05.723473+0000","last_clean":"2024-09-12T22:51:05.723473+0000","last_became_active":"2024-09-12T22:50:58.699982+0000","last_became_peered":"2024-09-12T22:50:58.699982+0000","last_unstale":"2024-09-12T22:51:05.723473+0000","last_undegraded":"2024-09-12T22:51:05.723473+0000","last_fullsized":"2024-09-12T22:51:05.723473+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:03.458952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":25621,"num_write":385,"num_write_kb":63908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"61'462","reported_seq":1066,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723490+0000","last_change":"2024-09-12T22:50:58.701216+0000","last_active":"2024-09-12T22:51:05.723490+0000","last_peered":"2024-09-12T22:51:05.723490+0000","last_clean":"2024-09-12T22:51:05.723490+0000","last_became_active":"2024-09-12T22:50:58.700047+0000","last_became_peered":"2024-09-12T22:50:58.700047+0000","last_unstale":"2024-09-12T22:51:05.723490+0000","last_undegraded":"2024-09-12T22:51:05.723490+0000","last_fullsized":"2024-09-12T22:51:05.723490+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:51.010136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28920,"num_write":428,"num_write_kb":76277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"61'413","reported_seq":948,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342393+0000","last_change":"2024-09-12T22:50:57.861973+0000","last_active":"2024-09-12T22:51:06.342393+0000","last_peered":"2024-09-12T22:51:06.342393+0000","last_clean":"2024-09-12T22:51:06.342393+0000","last_became_active":"2024-09-12T22:50:57.860819+0000","last_became_peered":"2024-09-12T22:50:57.860819+0000","last_unstale":"2024-09-12T22:51:06.342393+0000","last_undegraded":"2024-09-12T22:51:06.342393+0000","last_fullsized":"2024-09-12T22:51:06.342393+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:52.977617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":14661,"num_write":381,"num_write_kb":72596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"61'475","reported_seq":680,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723273+0000","last_change":"2024-09-12T22:48:05.172794+0000","last_active":"2024-09-12T22:51:05.723273+0000","last_peered":"2024-09-12T22:51:05.723273+0000","last_clean":"2024-09-12T22:51:05.723273+0000","last_became_active":"2024-09-12T22:48:05.172437+0000","last_became_peered":"2024-09-12T22:48:05.172437+0000","last_unstale":"2024-09-12T22:51:05.723273+0000","last_undegraded":"2024-09-12T22:51:05.723273+0000","last_fullsized":"2024-09-12T22:51:05.723273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:54:44.278646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":32397,"num_write":452,"num_write_kb":105406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"61'413","reported_seq":963,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724480+0000","last_change":"2024-09-12T22:51:02.709686+0000","last_active":"2024-09-12T22:51:05.724480+0000","last_peered":"2024-09-12T22:51:05.724480+0000","last_clean":"2024-09-12T22:51:05.724480+0000","last_became_active":"2024-09-12T22:51:02.708084+0000","last_became_peered":"2024-09-12T22:51:02.708084+0000","last_unstale":"2024-09-12T22:51:05.724480+0000","last_undegraded":"2024-09-12T22:51:05.724480+0000","last_fullsized":"2024-09-12T22:51:05.724480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:27.765575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4773,"num_write":395,"num_write_kb":21871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"61'453","reported_seq":1027,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343514+0000","last_change":"2024-09-12T22:50:58.700787+0000","last_active":"2024-09-12T22:51:06.343514+0000","last_peered":"2024-09-12T22:51:06.343514+0000","last_clean":"2024-09-12T22:51:06.343514+0000","last_became_active":"2024-09-12T22:50:58.699585+0000","last_became_peered":"2024-09-12T22:50:58.699585+0000","last_unstale":"2024-09-12T22:51:06.343514+0000","last_undegraded":"2024-09-12T22:51:06.343514+0000","last_fullsized":"2024-09-12T22:51:06.343514+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:44.083029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18201,"num_write":409,"num_write_kb":47008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"61'402","reported_seq":571,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723791+0000","last_change":"2024-09-12T22:51:01.704826+0000","last_active":"2024-09-12T22:51:05.723791+0000","last_peered":"2024-09-12T22:51:05.723791+0000","last_clean":"2024-09-12T22:51:05.723791+0000","last_became_active":"2024-09-12T22:51:01.701850+0000","last_became_peered":"2024-09-12T22:51:01.701850+0000","last_unstale":"2024-09-12T22:51:05.723791+0000","last_undegraded":"2024-09-12T22:51:05.723791+0000","last_fullsized":"2024-09-12T22:51:05.723791+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:44:29.380608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":21641,"num_write":372,"num_write_kb":63613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"61'436","reported_seq":1073,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724130+0000","last_change":"2024-09-12T22:50:59.703836+0000","last_active":"2024-09-12T22:51:05.724130+0000","last_peered":"2024-09-12T22:51:05.724130+0000","last_clean":"2024-09-12T22:51:05.724130+0000","last_became_active":"2024-09-12T22:50:59.702766+0000","last_became_peered":"2024-09-12T22:50:59.702766+0000","last_unstale":"2024-09-12T22:51:05.724130+0000","last_undegraded":"2024-09-12T22:51:05.724130+0000","last_fullsized":"2024-09-12T22:51:05.724130+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:52.977617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":65550,"num_write":412,"num_write_kb":134233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"61'393","reported_seq":590,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343137+0000","last_change":"2024-09-12T22:48:05.177176+0000","last_active":"2024-09-12T22:51:06.343137+0000","last_peered":"2024-09-12T22:51:06.343137+0000","last_clean":"2024-09-12T22:51:06.343137+0000","last_became_active":"2024-09-12T22:48:05.176735+0000","last_became_peered":"2024-09-12T22:48:05.176735+0000","last_unstale":"2024-09-12T22:51:06.343137+0000","last_undegraded":"2024-09-12T22:51:06.343137+0000","last_fullsized":"2024-09-12T22:51:06.343137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:51.360504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":36009,"num_write":361,"num_write_kb":71487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"61'456","reported_seq":1019,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723644+0000","last_change":"2024-09-12T22:51:00.699523+0000","last_active":"2024-09-12T22:51:05.723644+0000","last_peered":"2024-09-12T22:51:05.723644+0000","last_clean":"2024-09-12T22:51:05.723644+0000","last_became_active":"2024-09-12T22:51:00.698377+0000","last_became_peered":"2024-09-12T22:51:00.698377+0000","last_unstale":"2024-09-12T22:51:05.723644+0000","last_undegraded":"2024-09-12T22:51:05.723644+0000","last_fullsized":"2024-09-12T22:51:05.723644+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:04:47.810227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4316,"num_write":417,"num_write_kb":34284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"61'440","reported_seq":614,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342570+0000","last_change":"2024-09-12T22:48:05.176878+0000","last_active":"2024-09-12T22:51:06.342570+0000","last_peered":"2024-09-12T22:51:06.342570+0000","last_clean":"2024-09-12T22:51:06.342570+0000","last_became_active":"2024-09-12T22:48:05.176327+0000","last_became_peered":"2024-09-12T22:48:05.176327+0000","last_unstale":"2024-09-12T22:51:06.342570+0000","last_undegraded":"2024-09-12T22:51:06.342570+0000","last_fullsized":"2024-09-12T22:51:06.342570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:11.781766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15052,"num_write":399,"num_write_kb":71703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"61'424","reported_seq":582,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722737+0000","last_change":"2024-09-12T22:51:01.704366+0000","last_active":"2024-09-12T22:51:05.722737+0000","last_peered":"2024-09-12T22:51:05.722737+0000","last_clean":"2024-09-12T22:51:05.722737+0000","last_became_active":"2024-09-12T22:51:01.700878+0000","last_became_peered":"2024-09-12T22:51:01.700878+0000","last_unstale":"2024-09-12T22:51:05.722737+0000","last_undegraded":"2024-09-12T22:51:05.722737+0000","last_fullsized":"2024-09-12T22:51:05.722737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:57.250980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25587,"num_write":397,"num_write_kb":46651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"61'384","reported_seq":545,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724020+0000","last_change":"2024-09-12T22:48:05.171573+0000","last_active":"2024-09-12T22:51:05.724020+0000","last_peered":"2024-09-12T22:51:05.724020+0000","last_clean":"2024-09-12T22:51:05.724020+0000","last_became_active":"2024-09-12T22:48:05.171036+0000","last_became_peered":"2024-09-12T22:48:05.171036+0000","last_unstale":"2024-09-12T22:51:05.724020+0000","last_undegraded":"2024-09-12T22:51:05.724020+0000","last_fullsized":"2024-09-12T22:51:05.724020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:27:07.558853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9715,"num_write":345,"num_write_kb":63048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"61'450","reported_seq":585,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723240+0000","last_change":"2024-09-12T22:50:55.851831+0000","last_active":"2024-09-12T22:51:05.723240+0000","last_peered":"2024-09-12T22:51:05.723240+0000","last_clean":"2024-09-12T22:51:05.723240+0000","last_became_active":"2024-09-12T22:50:55.851443+0000","last_became_peered":"2024-09-12T22:50:55.851443+0000","last_unstale":"2024-09-12T22:51:05.723240+0000","last_undegraded":"2024-09-12T22:51:05.723240+0000","last_fullsized":"2024-09-12T22:51:05.723240+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:25:19.575346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":387,"num_write_kb":8369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"61'389","reported_seq":568,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724238+0000","last_change":"2024-09-12T22:48:05.173585+0000","last_active":"2024-09-12T22:51:05.724238+0000","last_peered":"2024-09-12T22:51:05.724238+0000","last_clean":"2024-09-12T22:51:05.724238+0000","last_became_active":"2024-09-12T22:48:05.172801+0000","last_became_peered":"2024-09-12T22:48:05.172801+0000","last_unstale":"2024-09-12T22:51:05.724238+0000","last_undegraded":"2024-09-12T22:51:05.724238+0000","last_fullsized":"2024-09-12T22:51:05.724238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:45.140060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":21115,"num_write":354,"num_write_kb":59128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"61'60","reported_seq":206,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342908+0000","last_change":"2024-09-12T22:50:52.860336+0000","last_active":"2024-09-12T22:51:06.342908+0000","last_peered":"2024-09-12T22:51:06.342908+0000","last_clean":"2024-09-12T22:51:06.342908+0000","last_became_active":"2024-09-12T22:50:52.859975+0000","last_became_peered":"2024-09-12T22:50:52.859975+0000","last_unstale":"2024-09-12T22:51:06.342908+0000","last_undegraded":"2024-09-12T22:51:06.342908+0000","last_fullsized":"2024-09-12T22:51:06.342908+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:14.260183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"61'433","reported_seq":997,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342401+0000","last_change":"2024-09-12T22:50:57.863647+0000","last_active":"2024-09-12T22:51:06.342401+0000","last_peered":"2024-09-12T22:51:06.342401+0000","last_clean":"2024-09-12T22:51:06.342401+0000","last_became_active":"2024-09-12T22:50:57.861719+0000","last_became_peered":"2024-09-12T22:50:57.861719+0000","last_unstale":"2024-09-12T22:51:06.342401+0000","last_undegraded":"2024-09-12T22:51:06.342401+0000","last_fullsized":"2024-09-12T22:51:06.342401+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:04:47.810227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17599,"num_write":404,"num_write_kb":59440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"61'63","reported_seq":209,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723521+0000","last_change":"2024-09-12T22:50:52.857615+0000","last_active":"2024-09-12T22:51:05.723521+0000","last_peered":"2024-09-12T22:51:05.723521+0000","last_clean":"2024-09-12T22:51:05.723521+0000","last_became_active":"2024-09-12T22:50:52.857343+0000","last_became_peered":"2024-09-12T22:50:52.857343+0000","last_unstale":"2024-09-12T22:51:05.723521+0000","last_undegraded":"2024-09-12T22:51:05.723521+0000","last_fullsized":"2024-09-12T22:51:05.723521+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:44.095690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"61'407","reported_seq":932,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343467+0000","last_change":"2024-09-12T22:50:55.853362+0000","last_active":"2024-09-12T22:51:06.343467+0000","last_peered":"2024-09-12T22:51:06.343467+0000","last_clean":"2024-09-12T22:51:06.343467+0000","last_became_active":"2024-09-12T22:50:55.851934+0000","last_became_peered":"2024-09-12T22:50:55.851934+0000","last_unstale":"2024-09-12T22:51:06.343467+0000","last_undegraded":"2024-09-12T22:51:06.343467+0000","last_fullsized":"2024-09-12T22:51:06.343467+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:51.010136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":24842,"num_write":378,"num_write_kb":79144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"61'62","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722703+0000","last_change":"2024-09-12T22:50:52.859828+0000","last_active":"2024-09-12T22:51:05.722703+0000","last_peered":"2024-09-12T22:51:05.722703+0000","last_clean":"2024-09-12T22:51:05.722703+0000","last_became_active":"2024-09-12T22:50:52.858911+0000","last_became_peered":"2024-09-12T22:50:52.858911+0000","last_unstale":"2024-09-12T22:51:05.722703+0000","last_undegraded":"2024-09-12T22:51:05.722703+0000","last_fullsized":"2024-09-12T22:51:05.722703+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:44.358340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"61'152","reported_seq":288,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723962+0000","last_change":"2024-09-12T22:50:55.851865+0000","last_active":"2024-09-12T22:51:05.723962+0000","last_peered":"2024-09-12T22:51:05.723962+0000","last_clean":"2024-09-12T22:51:05.723962+0000","last_became_active":"2024-09-12T22:50:55.851050+0000","last_became_peered":"2024-09-12T22:50:55.851050+0000","last_unstale":"2024-09-12T22:51:05.723962+0000","last_undegraded":"2024-09-12T22:51:05.723962+0000","last_fullsized":"2024-09-12T22:51:05.723962+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:31:24.219732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"61'392","reported_seq":890,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723334+0000","last_change":"2024-09-12T22:50:56.855073+0000","last_active":"2024-09-12T22:51:05.723334+0000","last_peered":"2024-09-12T22:51:05.723334+0000","last_clean":"2024-09-12T22:51:05.723334+0000","last_became_active":"2024-09-12T22:50:56.853383+0000","last_became_peered":"2024-09-12T22:50:56.853383+0000","last_unstale":"2024-09-12T22:51:05.723334+0000","last_undegraded":"2024-09-12T22:51:05.723334+0000","last_fullsized":"2024-09-12T22:51:05.723334+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:18.644500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":9675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"61'237","reported_seq":390,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724440+0000","last_change":"2024-09-12T22:50:55.852418+0000","last_active":"2024-09-12T22:51:05.724440+0000","last_peered":"2024-09-12T22:51:05.724440+0000","last_clean":"2024-09-12T22:51:05.724440+0000","last_became_active":"2024-09-12T22:50:55.852034+0000","last_became_peered":"2024-09-12T22:50:55.852034+0000","last_unstale":"2024-09-12T22:51:05.724440+0000","last_undegraded":"2024-09-12T22:51:05.724440+0000","last_fullsized":"2024-09-12T22:51:05.724440+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:47.161147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"61'464","reported_seq":637,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723400+0000","last_change":"2024-09-12T22:48:05.171143+0000","last_active":"2024-09-12T22:51:05.723400+0000","last_peered":"2024-09-12T22:51:05.723400+0000","last_clean":"2024-09-12T22:51:05.723400+0000","last_became_active":"2024-09-12T22:48:05.170374+0000","last_became_peered":"2024-09-12T22:48:05.170374+0000","last_unstale":"2024-09-12T22:51:05.723400+0000","last_undegraded":"2024-09-12T22:51:05.723400+0000","last_fullsized":"2024-09-12T22:51:05.723400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:15.887977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15522,"num_write":440,"num_write_kb":60335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"61'470","reported_seq":606,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723638+0000","last_change":"2024-09-12T22:50:55.852447+0000","last_active":"2024-09-12T22:51:05.723638+0000","last_peered":"2024-09-12T22:51:05.723638+0000","last_clean":"2024-09-12T22:51:05.723638+0000","last_became_active":"2024-09-12T22:50:55.852074+0000","last_became_peered":"2024-09-12T22:50:55.852074+0000","last_unstale":"2024-09-12T22:51:05.723638+0000","last_undegraded":"2024-09-12T22:51:05.723638+0000","last_fullsized":"2024-09-12T22:51:05.723638+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:24.010030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":4267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"61'449","reported_seq":636,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723253+0000","last_change":"2024-09-12T22:51:00.701817+0000","last_active":"2024-09-12T22:51:05.723253+0000","last_peered":"2024-09-12T22:51:05.723253+0000","last_clean":"2024-09-12T22:51:05.723253+0000","last_became_active":"2024-09-12T22:51:00.699592+0000","last_became_peered":"2024-09-12T22:51:00.699592+0000","last_unstale":"2024-09-12T22:51:05.723253+0000","last_undegraded":"2024-09-12T22:51:05.723253+0000","last_fullsized":"2024-09-12T22:51:05.723253+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:11.924779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":36634,"num_write":415,"num_write_kb":84238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"61'52","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723477+0000","last_change":"2024-09-12T22:50:52.857863+0000","last_active":"2024-09-12T22:51:05.723477+0000","last_peered":"2024-09-12T22:51:05.723477+0000","last_clean":"2024-09-12T22:51:05.723477+0000","last_became_active":"2024-09-12T22:50:52.857342+0000","last_became_peered":"2024-09-12T22:50:52.857342+0000","last_unstale":"2024-09-12T22:51:05.723477+0000","last_undegraded":"2024-09-12T22:51:05.723477+0000","last_fullsized":"2024-09-12T22:51:05.723477+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:59.906052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"61'434","reported_seq":1027,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343139+0000","last_change":"2024-09-12T22:50:58.701303+0000","last_active":"2024-09-12T22:51:06.343139+0000","last_peered":"2024-09-12T22:51:06.343139+0000","last_clean":"2024-09-12T22:51:06.343139+0000","last_became_active":"2024-09-12T22:50:58.700178+0000","last_became_peered":"2024-09-12T22:50:58.700178+0000","last_unstale":"2024-09-12T22:51:06.343139+0000","last_undegraded":"2024-09-12T22:51:06.343139+0000","last_fullsized":"2024-09-12T22:51:06.343139+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:13:37.634120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":39364,"num_write":402,"num_write_kb":59313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"61'194","reported_seq":349,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343266+0000","last_change":"2024-09-12T22:50:55.852827+0000","last_active":"2024-09-12T22:51:06.343266+0000","last_peered":"2024-09-12T22:51:06.343266+0000","last_clean":"2024-09-12T22:51:06.343266+0000","last_became_active":"2024-09-12T22:50:55.852479+0000","last_became_peered":"2024-09-12T22:50:55.852479+0000","last_unstale":"2024-09-12T22:51:06.343266+0000","last_undegraded":"2024-09-12T22:51:06.343266+0000","last_fullsized":"2024-09-12T22:51:06.343266+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:17.642880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"61'457","reported_seq":591,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723790+0000","last_change":"2024-09-12T22:51:03.707374+0000","last_active":"2024-09-12T22:51:05.723790+0000","last_peered":"2024-09-12T22:51:05.723790+0000","last_clean":"2024-09-12T22:51:05.723790+0000","last_became_active":"2024-09-12T22:51:03.704514+0000","last_became_peered":"2024-09-12T22:51:03.704514+0000","last_unstale":"2024-09-12T22:51:05.723790+0000","last_undegraded":"2024-09-12T22:51:05.723790+0000","last_fullsized":"2024-09-12T22:51:05.723790+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:13.942017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10832,"num_write":419,"num_write_kb":34901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"61'106","reported_seq":232,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722915+0000","last_change":"2024-09-12T22:50:55.851086+0000","last_active":"2024-09-12T22:51:05.722915+0000","last_peered":"2024-09-12T22:51:05.722915+0000","last_clean":"2024-09-12T22:51:05.722915+0000","last_became_active":"2024-09-12T22:50:55.850764+0000","last_became_peered":"2024-09-12T22:50:55.850764+0000","last_unstale":"2024-09-12T22:51:05.722915+0000","last_undegraded":"2024-09-12T22:51:05.722915+0000","last_fullsized":"2024-09-12T22:51:05.722915+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:26.058872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"61'431","reported_seq":571,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723616+0000","last_change":"2024-09-12T22:51:02.710383+0000","last_active":"2024-09-12T22:51:05.723616+0000","last_peered":"2024-09-12T22:51:05.723616+0000","last_clean":"2024-09-12T22:51:05.723616+0000","last_became_active":"2024-09-12T22:51:02.707646+0000","last_became_peered":"2024-09-12T22:51:02.707646+0000","last_unstale":"2024-09-12T22:51:05.723616+0000","last_undegraded":"2024-09-12T22:51:05.723616+0000","last_fullsized":"2024-09-12T22:51:05.723616+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:41.956076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":10443,"num_write":392,"num_write_kb":63957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"61'49","reported_seq":195,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723628+0000","last_change":"2024-09-12T22:50:52.857609+0000","last_active":"2024-09-12T22:51:05.723628+0000","last_peered":"2024-09-12T22:51:05.723628+0000","last_clean":"2024-09-12T22:51:05.723628+0000","last_became_active":"2024-09-12T22:50:52.857301+0000","last_became_peered":"2024-09-12T22:50:52.857301+0000","last_unstale":"2024-09-12T22:51:05.723628+0000","last_undegraded":"2024-09-12T22:51:05.723628+0000","last_fullsized":"2024-09-12T22:51:05.723628+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:43.328264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"61'351","reported_seq":475,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723979+0000","last_change":"2024-09-12T22:50:56.855396+0000","last_active":"2024-09-12T22:51:05.723979+0000","last_peered":"2024-09-12T22:51:05.723979+0000","last_clean":"2024-09-12T22:51:05.723979+0000","last_became_active":"2024-09-12T22:50:56.853610+0000","last_became_peered":"2024-09-12T22:50:56.853610+0000","last_unstale":"2024-09-12T22:51:05.723979+0000","last_undegraded":"2024-09-12T22:51:05.723979+0000","last_fullsized":"2024-09-12T22:51:05.723979+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:01.946701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":137,"num_write":315,"num_write_kb":37943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"61'588","reported_seq":727,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723397+0000","last_change":"2024-09-12T22:48:04.174281+0000","last_active":"2024-09-12T22:51:05.723397+0000","last_peered":"2024-09-12T22:51:05.723397+0000","last_clean":"2024-09-12T22:51:05.723397+0000","last_became_active":"2024-09-12T22:48:04.173942+0000","last_became_peered":"2024-09-12T22:48:04.173942+0000","last_unstale":"2024-09-12T22:51:05.723397+0000","last_undegraded":"2024-09-12T22:51:05.723397+0000","last_fullsized":"2024-09-12T22:51:05.723397+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:19:38.546747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":4334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"61'400","reported_seq":560,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343593+0000","last_change":"2024-09-12T22:48:05.178246+0000","last_active":"2024-09-12T22:51:06.343593+0000","last_peered":"2024-09-12T22:51:06.343593+0000","last_clean":"2024-09-12T22:51:06.343593+0000","last_became_active":"2024-09-12T22:48:05.176813+0000","last_became_peered":"2024-09-12T22:48:05.176813+0000","last_unstale":"2024-09-12T22:51:06.343593+0000","last_undegraded":"2024-09-12T22:51:06.343593+0000","last_fullsized":"2024-09-12T22:51:06.343593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:58.991752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":9179,"num_write":363,"num_write_kb":67046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":242,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722613+0000","last_change":"2024-09-12T22:50:52.860243+0000","last_active":"2024-09-12T22:51:05.722613+0000","last_peered":"2024-09-12T22:51:05.722613+0000","last_clean":"2024-09-12T22:51:05.722613+0000","last_became_active":"2024-09-12T22:50:52.859754+0000","last_became_peered":"2024-09-12T22:50:52.859754+0000","last_unstale":"2024-09-12T22:51:05.722613+0000","last_undegraded":"2024-09-12T22:51:05.722613+0000","last_fullsized":"2024-09-12T22:51:05.722613+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:55.016634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:55.016634+0000","last_clean_scrub_stamp":"2024-09-12T22:47:55.016634+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:41:30.207577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722981+0000","last_change":"2024-09-12T22:50:52.858727+0000","last_active":"2024-09-12T22:51:05.722981+0000","last_peered":"2024-09-12T22:51:05.722981+0000","last_clean":"2024-09-12T22:51:05.722981+0000","last_became_active":"2024-09-12T22:50:52.857759+0000","last_became_peered":"2024-09-12T22:50:52.857759+0000","last_unstale":"2024-09-12T22:51:05.722981+0000","last_undegraded":"2024-09-12T22:51:05.722981+0000","last_fullsized":"2024-09-12T22:51:05.722981+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:52.160461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"61'506","reported_seq":645,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343027+0000","last_change":"2024-09-12T22:48:04.169704+0000","last_active":"2024-09-12T22:51:06.343027+0000","last_peered":"2024-09-12T22:51:06.343027+0000","last_clean":"2024-09-12T22:51:06.343027+0000","last_became_active":"2024-09-12T22:48:04.169474+0000","last_became_peered":"2024-09-12T22:48:04.169474+0000","last_unstale":"2024-09-12T22:51:06.343027+0000","last_undegraded":"2024-09-12T22:51:06.343027+0000","last_fullsized":"2024-09-12T22:51:06.343027+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:00.271198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":444,"num_write_kb":8407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"61'422","reported_seq":595,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723784+0000","last_change":"2024-09-12T22:51:00.700237+0000","last_active":"2024-09-12T22:51:05.723784+0000","last_peered":"2024-09-12T22:51:05.723784+0000","last_clean":"2024-09-12T22:51:05.723784+0000","last_became_active":"2024-09-12T22:51:00.698391+0000","last_became_peered":"2024-09-12T22:51:00.698391+0000","last_unstale":"2024-09-12T22:51:05.723784+0000","last_undegraded":"2024-09-12T22:51:05.723784+0000","last_fullsized":"2024-09-12T22:51:05.723784+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:19.299721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":38484,"num_write":383,"num_write_kb":67099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722904+0000","last_change":"2024-09-12T22:50:52.859530+0000","last_active":"2024-09-12T22:51:05.722904+0000","last_peered":"2024-09-12T22:51:05.722904+0000","last_clean":"2024-09-12T22:51:05.722904+0000","last_became_active":"2024-09-12T22:50:52.858480+0000","last_became_peered":"2024-09-12T22:50:52.858480+0000","last_unstale":"2024-09-12T22:51:05.722904+0000","last_undegraded":"2024-09-12T22:51:05.722904+0000","last_fullsized":"2024-09-12T22:51:05.722904+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:28:23.416675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"61'107","reported_seq":304,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342800+0000","last_change":"2024-09-12T22:50:55.853291+0000","last_active":"2024-09-12T22:51:06.342800+0000","last_peered":"2024-09-12T22:51:06.342800+0000","last_clean":"2024-09-12T22:51:06.342800+0000","last_became_active":"2024-09-12T22:50:55.852965+0000","last_became_peered":"2024-09-12T22:50:55.852965+0000","last_unstale":"2024-09-12T22:51:06.342800+0000","last_undegraded":"2024-09-12T22:51:06.342800+0000","last_fullsized":"2024-09-12T22:51:06.342800+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:46.505934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1463793,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":1459,"num_write":45,"num_write_kb":1459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1463793,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"61'436","reported_seq":618,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724236+0000","last_change":"2024-09-12T22:48:05.171819+0000","last_active":"2024-09-12T22:51:05.724236+0000","last_peered":"2024-09-12T22:51:05.724236+0000","last_clean":"2024-09-12T22:51:05.724236+0000","last_became_active":"2024-09-12T22:48:05.171293+0000","last_became_peered":"2024-09-12T22:48:05.171293+0000","last_unstale":"2024-09-12T22:51:05.724236+0000","last_undegraded":"2024-09-12T22:51:05.724236+0000","last_fullsized":"2024-09-12T22:51:05.724236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:01.401542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":27936,"num_write":401,"num_write_kb":51013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342933+0000","last_change":"2024-09-12T22:48:02.045209+0000","last_active":"2024-09-12T22:51:06.342933+0000","last_peered":"2024-09-12T22:51:06.342933+0000","last_clean":"2024-09-12T22:51:06.342933+0000","last_became_active":"2024-09-12T22:48:00.042007+0000","last_became_peered":"2024-09-12T22:48:00.042007+0000","last_unstale":"2024-09-12T22:51:06.342933+0000","last_undegraded":"2024-09-12T22:51:06.342933+0000","last_fullsized":"2024-09-12T22:51:06.342933+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:13.536542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036893100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"61'357","reported_seq":511,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723507+0000","last_change":"2024-09-12T22:50:55.852384+0000","last_active":"2024-09-12T22:51:05.723507+0000","last_peered":"2024-09-12T22:51:05.723507+0000","last_clean":"2024-09-12T22:51:05.723507+0000","last_became_active":"2024-09-12T22:50:55.852029+0000","last_became_peered":"2024-09-12T22:50:55.852029+0000","last_unstale":"2024-09-12T22:51:05.723507+0000","last_undegraded":"2024-09-12T22:51:05.723507+0000","last_fullsized":"2024-09-12T22:51:05.723507+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:59.415555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":8307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"61'343","reported_seq":503,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343598+0000","last_change":"2024-09-12T22:48:05.178865+0000","last_active":"2024-09-12T22:51:06.343598+0000","last_peered":"2024-09-12T22:51:06.343598+0000","last_clean":"2024-09-12T22:51:06.343598+0000","last_became_active":"2024-09-12T22:48:05.178010+0000","last_became_peered":"2024-09-12T22:48:05.178010+0000","last_unstale":"2024-09-12T22:51:06.343598+0000","last_undegraded":"2024-09-12T22:51:06.343598+0000","last_fullsized":"2024-09-12T22:51:06.343598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:30.120804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":6704,"num_write":316,"num_write_kb":42458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":70,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722797+0000","last_change":"2024-09-12T22:50:52.858195+0000","last_active":"2024-09-12T22:51:05.722797+0000","last_peered":"2024-09-12T22:51:05.722797+0000","last_clean":"2024-09-12T22:51:05.722797+0000","last_became_active":"2024-09-12T22:50:52.857746+0000","last_became_peered":"2024-09-12T22:50:52.857746+0000","last_unstale":"2024-09-12T22:51:05.722797+0000","last_undegraded":"2024-09-12T22:51:05.722797+0000","last_fullsized":"2024-09-12T22:51:05.722797+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:10:52.096897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052714799999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"61'78","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723018+0000","last_change":"2024-09-12T22:50:52.858808+0000","last_active":"2024-09-12T22:51:05.723018+0000","last_peered":"2024-09-12T22:51:05.723018+0000","last_clean":"2024-09-12T22:51:05.723018+0000","last_became_active":"2024-09-12T22:50:52.858372+0000","last_became_peered":"2024-09-12T22:50:52.858372+0000","last_unstale":"2024-09-12T22:51:05.723018+0000","last_undegraded":"2024-09-12T22:51:05.723018+0000","last_fullsized":"2024-09-12T22:51:05.723018+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:44.345055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"61'404","reported_seq":614,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343369+0000","last_change":"2024-09-12T22:48:05.177561+0000","last_active":"2024-09-12T22:51:06.343369+0000","last_peered":"2024-09-12T22:51:06.343369+0000","last_clean":"2024-09-12T22:51:06.343369+0000","last_became_active":"2024-09-12T22:48:05.177164+0000","last_became_peered":"2024-09-12T22:48:05.177164+0000","last_unstale":"2024-09-12T22:51:06.343369+0000","last_undegraded":"2024-09-12T22:51:06.343369+0000","last_fullsized":"2024-09-12T22:51:06.343369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:24.124647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":35084,"num_write":365,"num_write_kb":71560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"61'269","reported_seq":395,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723416+0000","last_change":"2024-09-12T22:50:55.850951+0000","last_active":"2024-09-12T22:51:05.723416+0000","last_peered":"2024-09-12T22:51:05.723416+0000","last_clean":"2024-09-12T22:51:05.723416+0000","last_became_active":"2024-09-12T22:50:55.850689+0000","last_became_peered":"2024-09-12T22:50:55.850689+0000","last_unstale":"2024-09-12T22:51:05.723416+0000","last_undegraded":"2024-09-12T22:51:05.723416+0000","last_fullsized":"2024-09-12T22:51:05.723416+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:11:37.856958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":4189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343491+0000","last_change":"2024-09-12T22:48:02.045324+0000","last_active":"2024-09-12T22:51:06.343491+0000","last_peered":"2024-09-12T22:51:06.343491+0000","last_clean":"2024-09-12T22:51:06.343491+0000","last_became_active":"2024-09-12T22:48:00.042132+0000","last_became_peered":"2024-09-12T22:48:00.042132+0000","last_unstale":"2024-09-12T22:51:06.343491+0000","last_undegraded":"2024-09-12T22:51:06.343491+0000","last_fullsized":"2024-09-12T22:51:06.343491+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:24.673019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047590600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"61'362","reported_seq":851,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723496+0000","last_change":"2024-09-12T22:50:59.708186+0000","last_active":"2024-09-12T22:51:05.723496+0000","last_peered":"2024-09-12T22:51:05.723496+0000","last_clean":"2024-09-12T22:51:05.723496+0000","last_became_active":"2024-09-12T22:50:59.707126+0000","last_became_peered":"2024-09-12T22:50:59.707126+0000","last_unstale":"2024-09-12T22:51:05.723496+0000","last_undegraded":"2024-09-12T22:51:05.723496+0000","last_fullsized":"2024-09-12T22:51:05.723496+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:08:37.272462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":10445,"num_write":331,"num_write_kb":30096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"61'56","reported_seq":195,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343401+0000","last_change":"2024-09-12T22:48:04.169109+0000","last_active":"2024-09-12T22:51:06.343401+0000","last_peered":"2024-09-12T22:51:06.343401+0000","last_clean":"2024-09-12T22:51:06.343401+0000","last_became_active":"2024-09-12T22:48:04.168655+0000","last_became_peered":"2024-09-12T22:48:04.168655+0000","last_unstale":"2024-09-12T22:51:06.343401+0000","last_undegraded":"2024-09-12T22:51:06.343401+0000","last_fullsized":"2024-09-12T22:51:06.343401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:02.879935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724478+0000","last_change":"2024-09-12T22:48:02.045390+0000","last_active":"2024-09-12T22:51:05.724478+0000","last_peered":"2024-09-12T22:51:05.724478+0000","last_clean":"2024-09-12T22:51:05.724478+0000","last_became_active":"2024-09-12T22:48:00.045356+0000","last_became_peered":"2024-09-12T22:48:00.045356+0000","last_unstale":"2024-09-12T22:51:05.724478+0000","last_undegraded":"2024-09-12T22:51:05.724478+0000","last_fullsized":"2024-09-12T22:51:05.724478+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:32.072080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040621599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"61'408","reported_seq":982,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723709+0000","last_change":"2024-09-12T22:50:57.864738+0000","last_active":"2024-09-12T22:51:05.723709+0000","last_peered":"2024-09-12T22:51:05.723709+0000","last_clean":"2024-09-12T22:51:05.723709+0000","last_became_active":"2024-09-12T22:50:57.863486+0000","last_became_peered":"2024-09-12T22:50:57.863486+0000","last_unstale":"2024-09-12T22:51:05.723709+0000","last_undegraded":"2024-09-12T22:51:05.723709+0000","last_fullsized":"2024-09-12T22:51:05.723709+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:06:04.268528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":42311,"num_write":379,"num_write_kb":75412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"61'61","reported_seq":200,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343872+0000","last_change":"2024-09-12T22:48:04.168635+0000","last_active":"2024-09-12T22:51:06.343872+0000","last_peered":"2024-09-12T22:51:06.343872+0000","last_clean":"2024-09-12T22:51:06.343872+0000","last_became_active":"2024-09-12T22:48:04.168244+0000","last_became_peered":"2024-09-12T22:48:04.168244+0000","last_unstale":"2024-09-12T22:51:06.343872+0000","last_undegraded":"2024-09-12T22:51:06.343872+0000","last_fullsized":"2024-09-12T22:51:06.343872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:56.929490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343640+0000","last_change":"2024-09-12T22:48:02.045428+0000","last_active":"2024-09-12T22:51:06.343640+0000","last_peered":"2024-09-12T22:51:06.343640+0000","last_clean":"2024-09-12T22:51:06.343640+0000","last_became_active":"2024-09-12T22:48:00.040536+0000","last_became_peered":"2024-09-12T22:48:00.040536+0000","last_unstale":"2024-09-12T22:51:06.343640+0000","last_undegraded":"2024-09-12T22:51:06.343640+0000","last_fullsized":"2024-09-12T22:51:06.343640+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:33.150497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057699499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"61'430","reported_seq":990,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342744+0000","last_change":"2024-09-12T22:51:01.701692+0000","last_active":"2024-09-12T22:51:06.342744+0000","last_peered":"2024-09-12T22:51:06.342744+0000","last_clean":"2024-09-12T22:51:06.342744+0000","last_became_active":"2024-09-12T22:51:01.700292+0000","last_became_peered":"2024-09-12T22:51:01.700292+0000","last_unstale":"2024-09-12T22:51:06.342744+0000","last_undegraded":"2024-09-12T22:51:06.342744+0000","last_fullsized":"2024-09-12T22:51:06.342744+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:25.931698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":26700,"num_write":399,"num_write_kb":55331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"63'114","reported_seq":267,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343600+0000","last_change":"2024-09-12T22:50:55.852342+0000","last_active":"2024-09-12T22:51:06.343600+0000","last_peered":"2024-09-12T22:51:06.343600+0000","last_clean":"2024-09-12T22:51:06.343600+0000","last_became_active":"2024-09-12T22:50:55.851975+0000","last_became_peered":"2024-09-12T22:50:55.851975+0000","last_unstale":"2024-09-12T22:51:06.343600+0000","last_undegraded":"2024-09-12T22:51:06.343600+0000","last_fullsized":"2024-09-12T22:51:06.343600+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:42.555311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":1201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723698+0000","last_change":"2024-09-12T22:50:52.857531+0000","last_active":"2024-09-12T22:51:05.723698+0000","last_peered":"2024-09-12T22:51:05.723698+0000","last_clean":"2024-09-12T22:51:05.723698+0000","last_became_active":"2024-09-12T22:50:52.856757+0000","last_became_peered":"2024-09-12T22:50:52.856757+0000","last_unstale":"2024-09-12T22:51:05.723698+0000","last_undegraded":"2024-09-12T22:51:05.723698+0000","last_fullsized":"2024-09-12T22:51:05.723698+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:14.353873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"61'406","reported_seq":929,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723396+0000","last_change":"2024-09-12T22:50:56.855069+0000","last_active":"2024-09-12T22:51:05.723396+0000","last_peered":"2024-09-12T22:51:05.723396+0000","last_clean":"2024-09-12T22:51:05.723396+0000","last_became_active":"2024-09-12T22:50:56.853376+0000","last_became_peered":"2024-09-12T22:50:56.853376+0000","last_unstale":"2024-09-12T22:51:05.723396+0000","last_undegraded":"2024-09-12T22:51:05.723396+0000","last_fullsized":"2024-09-12T22:51:05.723396+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:43.556932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17112,"num_write":373,"num_write_kb":79947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"61'378","reported_seq":533,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723357+0000","last_change":"2024-09-12T22:50:57.863154+0000","last_active":"2024-09-12T22:51:05.723357+0000","last_peered":"2024-09-12T22:51:05.723357+0000","last_clean":"2024-09-12T22:51:05.723357+0000","last_became_active":"2024-09-12T22:50:57.861280+0000","last_became_peered":"2024-09-12T22:50:57.861280+0000","last_unstale":"2024-09-12T22:51:05.723357+0000","last_undegraded":"2024-09-12T22:51:05.723357+0000","last_fullsized":"2024-09-12T22:51:05.723357+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:13.015760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15048,"num_write":339,"num_write_kb":35238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"63'249","reported_seq":391,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723315+0000","last_change":"2024-09-12T22:50:55.849742+0000","last_active":"2024-09-12T22:51:05.723315+0000","last_peered":"2024-09-12T22:51:05.723315+0000","last_clean":"2024-09-12T22:51:05.723315+0000","last_became_active":"2024-09-12T22:50:55.849531+0000","last_became_peered":"2024-09-12T22:50:55.849531+0000","last_unstale":"2024-09-12T22:51:05.723315+0000","last_undegraded":"2024-09-12T22:51:05.723315+0000","last_fullsized":"2024-09-12T22:51:05.723315+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:32.676988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8461053,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":8364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8456257,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"61'405","reported_seq":569,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342826+0000","last_change":"2024-09-12T22:48:05.176779+0000","last_active":"2024-09-12T22:51:06.342826+0000","last_peered":"2024-09-12T22:51:06.342826+0000","last_clean":"2024-09-12T22:51:06.342826+0000","last_became_active":"2024-09-12T22:48:05.176344+0000","last_became_peered":"2024-09-12T22:48:05.176344+0000","last_unstale":"2024-09-12T22:51:06.342826+0000","last_undegraded":"2024-09-12T22:51:06.342826+0000","last_fullsized":"2024-09-12T22:51:06.342826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:35.645286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":25018,"num_write":372,"num_write_kb":42936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"61'85","reported_seq":236,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724390+0000","last_change":"2024-09-12T22:50:52.905108+0000","last_active":"2024-09-12T22:51:05.724390+0000","last_peered":"2024-09-12T22:51:05.724390+0000","last_clean":"2024-09-12T22:51:05.724390+0000","last_became_active":"2024-09-12T22:50:52.861594+0000","last_became_peered":"2024-09-12T22:50:52.861594+0000","last_unstale":"2024-09-12T22:51:05.724390+0000","last_undegraded":"2024-09-12T22:51:05.724390+0000","last_fullsized":"2024-09-12T22:51:05.724390+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:49.196178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"61'213","reported_seq":338,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723895+0000","last_change":"2024-09-12T22:50:55.852154+0000","last_active":"2024-09-12T22:51:05.723895+0000","last_peered":"2024-09-12T22:51:05.723895+0000","last_clean":"2024-09-12T22:51:05.723895+0000","last_became_active":"2024-09-12T22:50:55.851798+0000","last_became_peered":"2024-09-12T22:50:55.851798+0000","last_unstale":"2024-09-12T22:51:05.723895+0000","last_undegraded":"2024-09-12T22:51:05.723895+0000","last_fullsized":"2024-09-12T22:51:05.723895+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:03:29.463409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":4171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"61'478","reported_seq":1107,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342630+0000","last_change":"2024-09-12T22:50:56.856443+0000","last_active":"2024-09-12T22:51:06.342630+0000","last_peered":"2024-09-12T22:51:06.342630+0000","last_clean":"2024-09-12T22:51:06.342630+0000","last_became_active":"2024-09-12T22:50:56.855150+0000","last_became_peered":"2024-09-12T22:50:56.855150+0000","last_unstale":"2024-09-12T22:51:06.342630+0000","last_undegraded":"2024-09-12T22:51:06.342630+0000","last_fullsized":"2024-09-12T22:51:06.342630+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:11.194706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":41320,"num_write":445,"num_write_kb":84826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":209,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"61'55","reported_seq":201,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343774+0000","last_change":"2024-09-12T22:50:52.859702+0000","last_active":"2024-09-12T22:51:06.343774+0000","last_peered":"2024-09-12T22:51:06.343774+0000","last_clean":"2024-09-12T22:51:06.343774+0000","last_became_active":"2024-09-12T22:50:52.859296+0000","last_became_peered":"2024-09-12T22:50:52.859296+0000","last_unstale":"2024-09-12T22:51:06.343774+0000","last_undegraded":"2024-09-12T22:51:06.343774+0000","last_fullsized":"2024-09-12T22:51:06.343774+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:14.180904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"61'447","reported_seq":634,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342672+0000","last_change":"2024-09-12T22:48:05.169648+0000","last_active":"2024-09-12T22:51:06.342672+0000","last_peered":"2024-09-12T22:51:06.342672+0000","last_clean":"2024-09-12T22:51:06.342672+0000","last_became_active":"2024-09-12T22:48:05.168356+0000","last_became_peered":"2024-09-12T22:48:05.168356+0000","last_unstale":"2024-09-12T22:51:06.342672+0000","last_undegraded":"2024-09-12T22:51:06.342672+0000","last_fullsized":"2024-09-12T22:51:06.342672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:52.341512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25877,"num_write":417,"num_write_kb":39269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"61'371","reported_seq":888,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724516+0000","last_change":"2024-09-12T22:51:02.709645+0000","last_active":"2024-09-12T22:51:05.724516+0000","last_peered":"2024-09-12T22:51:05.724516+0000","last_clean":"2024-09-12T22:51:05.724516+0000","last_became_active":"2024-09-12T22:51:02.708091+0000","last_became_peered":"2024-09-12T22:51:02.708091+0000","last_unstale":"2024-09-12T22:51:05.724516+0000","last_undegraded":"2024-09-12T22:51:05.724516+0000","last_fullsized":"2024-09-12T22:51:05.724516+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:13:37.634120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20950,"num_write":339,"num_write_kb":39207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"61'601","reported_seq":740,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342822+0000","last_change":"2024-09-12T22:48:04.169111+0000","last_active":"2024-09-12T22:51:06.342822+0000","last_peered":"2024-09-12T22:51:06.342822+0000","last_clean":"2024-09-12T22:51:06.342822+0000","last_became_active":"2024-09-12T22:48:04.168743+0000","last_became_peered":"2024-09-12T22:48:04.168743+0000","last_unstale":"2024-09-12T22:51:06.342822+0000","last_undegraded":"2024-09-12T22:51:06.342822+0000","last_fullsized":"2024-09-12T22:51:06.342822+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:43.709660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":535,"num_write_kb":8445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"61'438","reported_seq":978,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342401+0000","last_change":"2024-09-12T22:50:57.863618+0000","last_active":"2024-09-12T22:51:06.342401+0000","last_peered":"2024-09-12T22:51:06.342401+0000","last_clean":"2024-09-12T22:51:06.342401+0000","last_became_active":"2024-09-12T22:50:57.861695+0000","last_became_peered":"2024-09-12T22:50:57.861695+0000","last_unstale":"2024-09-12T22:51:06.342401+0000","last_undegraded":"2024-09-12T22:51:06.342401+0000","last_fullsized":"2024-09-12T22:51:06.342401+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:08:37.272462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":16921,"num_write":411,"num_write_kb":146790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"61'185","reported_seq":337,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342787+0000","last_change":"2024-09-12T22:50:55.853288+0000","last_active":"2024-09-12T22:51:06.342787+0000","last_peered":"2024-09-12T22:51:06.342787+0000","last_clean":"2024-09-12T22:51:06.342787+0000","last_became_active":"2024-09-12T22:50:55.852796+0000","last_became_peered":"2024-09-12T22:50:55.852796+0000","last_unstale":"2024-09-12T22:51:06.342787+0000","last_undegraded":"2024-09-12T22:51:06.342787+0000","last_fullsized":"2024-09-12T22:51:06.342787+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:06:03.266907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"61'386","reported_seq":886,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724136+0000","last_change":"2024-09-12T22:51:01.702122+0000","last_active":"2024-09-12T22:51:05.724136+0000","last_peered":"2024-09-12T22:51:05.724136+0000","last_clean":"2024-09-12T22:51:05.724136+0000","last_became_active":"2024-09-12T22:51:01.701006+0000","last_became_peered":"2024-09-12T22:51:01.701006+0000","last_unstale":"2024-09-12T22:51:05.724136+0000","last_undegraded":"2024-09-12T22:51:05.724136+0000","last_fullsized":"2024-09-12T22:51:05.724136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:44.083029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":21487,"num_write":344,"num_write_kb":72645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"61'180","reported_seq":319,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723786+0000","last_change":"2024-09-12T22:48:04.174205+0000","last_active":"2024-09-12T22:51:05.723786+0000","last_peered":"2024-09-12T22:51:05.723786+0000","last_clean":"2024-09-12T22:51:05.723786+0000","last_became_active":"2024-09-12T22:48:04.173902+0000","last_became_peered":"2024-09-12T22:48:04.173902+0000","last_unstale":"2024-09-12T22:51:05.723786+0000","last_undegraded":"2024-09-12T22:51:05.723786+0000","last_fullsized":"2024-09-12T22:51:05.723786+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:43:39.709214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":12355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"61'396","reported_seq":552,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723907+0000","last_change":"2024-09-12T22:48:05.172917+0000","last_active":"2024-09-12T22:51:05.723907+0000","last_peered":"2024-09-12T22:51:05.723907+0000","last_clean":"2024-09-12T22:51:05.723907+0000","last_became_active":"2024-09-12T22:48:05.172493+0000","last_became_peered":"2024-09-12T22:48:05.172493+0000","last_unstale":"2024-09-12T22:51:05.723907+0000","last_undegraded":"2024-09-12T22:51:05.723907+0000","last_fullsized":"2024-09-12T22:51:05.723907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:35.645286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9980,"num_write":370,"num_write_kb":80321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"61'64","reported_seq":215,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723864+0000","last_change":"2024-09-12T22:50:52.884955+0000","last_active":"2024-09-12T22:51:05.723864+0000","last_peered":"2024-09-12T22:51:05.723864+0000","last_clean":"2024-09-12T22:51:05.723864+0000","last_became_active":"2024-09-12T22:50:52.858938+0000","last_became_peered":"2024-09-12T22:50:52.858938+0000","last_unstale":"2024-09-12T22:51:05.723864+0000","last_undegraded":"2024-09-12T22:51:05.723864+0000","last_fullsized":"2024-09-12T22:51:05.723864+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:24.405738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"61'370","reported_seq":515,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723307+0000","last_change":"2024-09-12T22:50:59.705667+0000","last_active":"2024-09-12T22:51:05.723307+0000","last_peered":"2024-09-12T22:51:05.723307+0000","last_clean":"2024-09-12T22:51:05.723307+0000","last_became_active":"2024-09-12T22:50:59.704074+0000","last_became_peered":"2024-09-12T22:50:59.704074+0000","last_unstale":"2024-09-12T22:51:05.723307+0000","last_undegraded":"2024-09-12T22:51:05.723307+0000","last_fullsized":"2024-09-12T22:51:05.723307+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:59.243155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16468,"num_write":341,"num_write_kb":50344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"61'187","reported_seq":321,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723342+0000","last_change":"2024-09-12T22:50:55.851804+0000","last_active":"2024-09-12T22:51:05.723342+0000","last_peered":"2024-09-12T22:51:05.723342+0000","last_clean":"2024-09-12T22:51:05.723342+0000","last_became_active":"2024-09-12T22:50:55.851467+0000","last_became_peered":"2024-09-12T22:50:55.851467+0000","last_unstale":"2024-09-12T22:51:05.723342+0000","last_undegraded":"2024-09-12T22:51:05.723342+0000","last_fullsized":"2024-09-12T22:51:05.723342+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:05.608780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"61'438","reported_seq":636,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723016+0000","last_change":"2024-09-12T22:50:59.706857+0000","last_active":"2024-09-12T22:51:05.723016+0000","last_peered":"2024-09-12T22:51:05.723016+0000","last_clean":"2024-09-12T22:51:05.723016+0000","last_became_active":"2024-09-12T22:50:59.703786+0000","last_became_peered":"2024-09-12T22:50:59.703786+0000","last_unstale":"2024-09-12T22:51:05.723016+0000","last_undegraded":"2024-09-12T22:51:05.723016+0000","last_fullsized":"2024-09-12T22:51:05.723016+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:52:45.535138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":38460,"num_write":412,"num_write_kb":96626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"61'185","reported_seq":342,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724254+0000","last_change":"2024-09-12T22:50:55.853065+0000","last_active":"2024-09-12T22:51:05.724254+0000","last_peered":"2024-09-12T22:51:05.724254+0000","last_clean":"2024-09-12T22:51:05.724254+0000","last_became_active":"2024-09-12T22:50:55.852654+0000","last_became_peered":"2024-09-12T22:50:55.852654+0000","last_unstale":"2024-09-12T22:51:05.724254+0000","last_undegraded":"2024-09-12T22:51:05.724254+0000","last_fullsized":"2024-09-12T22:51:05.724254+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:17.101030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":12349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"61'418","reported_seq":599,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723714+0000","last_change":"2024-09-12T22:48:05.171815+0000","last_active":"2024-09-12T22:51:05.723714+0000","last_peered":"2024-09-12T22:51:05.723714+0000","last_clean":"2024-09-12T22:51:05.723714+0000","last_became_active":"2024-09-12T22:48:05.171361+0000","last_became_peered":"2024-09-12T22:48:05.171361+0000","last_unstale":"2024-09-12T22:51:05.723714+0000","last_undegraded":"2024-09-12T22:51:05.723714+0000","last_fullsized":"2024-09-12T22:51:05.723714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:28.873036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":27427,"num_write":388,"num_write_kb":67745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"61'159","reported_seq":285,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724366+0000","last_change":"2024-09-12T22:50:55.852290+0000","last_active":"2024-09-12T22:51:05.724366+0000","last_peered":"2024-09-12T22:51:05.724366+0000","last_clean":"2024-09-12T22:51:05.724366+0000","last_became_active":"2024-09-12T22:50:55.851948+0000","last_became_peered":"2024-09-12T22:50:55.851948+0000","last_unstale":"2024-09-12T22:51:05.724366+0000","last_undegraded":"2024-09-12T22:51:05.724366+0000","last_fullsized":"2024-09-12T22:51:05.724366+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:14.260183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"61'479","reported_seq":652,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723053+0000","last_change":"2024-09-12T22:51:03.707091+0000","last_active":"2024-09-12T22:51:05.723053+0000","last_peered":"2024-09-12T22:51:05.723053+0000","last_clean":"2024-09-12T22:51:05.723053+0000","last_became_active":"2024-09-12T22:51:03.704137+0000","last_became_peered":"2024-09-12T22:51:03.704137+0000","last_unstale":"2024-09-12T22:51:05.723053+0000","last_undegraded":"2024-09-12T22:51:05.723053+0000","last_fullsized":"2024-09-12T22:51:05.723053+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:27:47.351934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":26793,"num_write":459,"num_write_kb":138325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"61'49","reported_seq":200,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343704+0000","last_change":"2024-09-12T22:50:52.903138+0000","last_active":"2024-09-12T22:51:06.343704+0000","last_peered":"2024-09-12T22:51:06.343704+0000","last_clean":"2024-09-12T22:51:06.343704+0000","last_became_active":"2024-09-12T22:50:52.859983+0000","last_became_peered":"2024-09-12T22:50:52.859983+0000","last_unstale":"2024-09-12T22:51:06.343704+0000","last_undegraded":"2024-09-12T22:51:06.343704+0000","last_fullsized":"2024-09-12T22:51:06.343704+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:59.415555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2742,"num_read_kb":1405479,"num_write":24656,"num_write_kb":4261796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7339,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26737,"ondisk_log_size":26737,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127366156,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":45,"num_read_kb":1459,"num_write":4460,"num_write_kb":127655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":93806220,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254799872,"data_stored":254732312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5569,"internal_metadata":0},"log_size":6243,"ondisk_log_size":6243,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":67,"seq":287762808837,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150992,"kb_used_data":92924,"kb_used_omap":6,"kb_used_meta":58041,"kb_avail":94220848,"statfs":{"total":96636764160,"available":96482148352,"internally_reserved":0,"allocated":95154176,"data_stored":94739479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7164,"internal_metadata":59433988},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738410,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":169456,"kb_used_data":75864,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94202384,"statfs":{"total":96636764160,"available":96463241216,"internally_reserved":0,"allocated":77684736,"data_stored":77299268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738412,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":172716,"kb_used_data":83284,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94199124,"statfs":{"total":96636764160,"available":96459902976,"internally_reserved":0,"allocated":85282816,"data_stored":84886443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83980288,"data_stored":83958707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":76972032,"data_stored":76961881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":93847552,"data_stored":93811724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5569,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:51:11.265 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T22:51:11.266 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:51:11.594 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:51:11.596 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-09-12T22:51:11.605 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2024-09-12T22:51:10.176776+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127956543,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":2923,"num_read_kb":1407056,"num_write":29321,"num_write_kb":4392913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7366,"num_bytes_recovered":93806220,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33140,"ondisk_log_size":33140,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":493164,"kb_used_data":252072,"kb_used_omap":10,"kb_used_meta":241013,"kb_avail":282622356,"statfs":{"total":289910292480,"available":289405292544,"internally_reserved":0,"allocated":258121728,"data_stored":256925190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10354,"internal_metadata":246798222},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1970,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2529,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.477824"},"pg_stats":[{"pgid":"4.3f","version":"61'404","reported_seq":563,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724420+0000","last_change":"2024-09-12T22:48:05.174190+0000","last_active":"2024-09-12T22:51:05.724420+0000","last_peered":"2024-09-12T22:51:05.724420+0000","last_clean":"2024-09-12T22:51:05.724420+0000","last_became_active":"2024-09-12T22:48:05.172964+0000","last_became_peered":"2024-09-12T22:48:05.172964+0000","last_unstale":"2024-09-12T22:51:05.724420+0000","last_undegraded":"2024-09-12T22:51:05.724420+0000","last_fullsized":"2024-09-12T22:51:05.724420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:49.868891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9582,"num_write":371,"num_write_kb":42180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"61'425","reported_seq":633,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724097+0000","last_change":"2024-09-12T22:48:05.173045+0000","last_active":"2024-09-12T22:51:05.724097+0000","last_peered":"2024-09-12T22:51:05.724097+0000","last_clean":"2024-09-12T22:51:05.724097+0000","last_became_active":"2024-09-12T22:48:05.172684+0000","last_became_peered":"2024-09-12T22:48:05.172684+0000","last_unstale":"2024-09-12T22:51:05.724097+0000","last_undegraded":"2024-09-12T22:51:05.724097+0000","last_fullsized":"2024-09-12T22:51:05.724097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:51.360504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":40466,"num_write":394,"num_write_kb":96045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"61'385","reported_seq":516,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723911+0000","last_change":"2024-09-12T22:51:00.703306+0000","last_active":"2024-09-12T22:51:05.723911+0000","last_peered":"2024-09-12T22:51:05.723911+0000","last_clean":"2024-09-12T22:51:05.723911+0000","last_became_active":"2024-09-12T22:51:00.700490+0000","last_became_peered":"2024-09-12T22:51:00.700490+0000","last_unstale":"2024-09-12T22:51:05.723911+0000","last_undegraded":"2024-09-12T22:51:05.723911+0000","last_fullsized":"2024-09-12T22:51:05.723911+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:16.055859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":7348,"num_write":352,"num_write_kb":34517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"61'395","reported_seq":563,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723474+0000","last_change":"2024-09-12T22:51:02.711764+0000","last_active":"2024-09-12T22:51:05.723474+0000","last_peered":"2024-09-12T22:51:05.723474+0000","last_clean":"2024-09-12T22:51:05.723474+0000","last_became_active":"2024-09-12T22:51:02.708216+0000","last_became_peered":"2024-09-12T22:51:02.708216+0000","last_unstale":"2024-09-12T22:51:05.723474+0000","last_undegraded":"2024-09-12T22:51:05.723474+0000","last_fullsized":"2024-09-12T22:51:05.723474+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:24.442976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":25803,"num_write":361,"num_write_kb":71646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"61'410","reported_seq":573,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723888+0000","last_change":"2024-09-12T22:48:05.170306+0000","last_active":"2024-09-12T22:51:05.723888+0000","last_peered":"2024-09-12T22:51:05.723888+0000","last_clean":"2024-09-12T22:51:05.723888+0000","last_became_active":"2024-09-12T22:48:05.169940+0000","last_became_peered":"2024-09-12T22:48:05.169940+0000","last_unstale":"2024-09-12T22:51:05.723888+0000","last_undegraded":"2024-09-12T22:51:05.723888+0000","last_fullsized":"2024-09-12T22:51:05.723888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:52.341512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":20544,"num_write":387,"num_write_kb":55745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"61'384","reported_seq":499,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723190+0000","last_change":"2024-09-12T22:51:03.706817+0000","last_active":"2024-09-12T22:51:05.723190+0000","last_peered":"2024-09-12T22:51:05.723190+0000","last_clean":"2024-09-12T22:51:05.723190+0000","last_became_active":"2024-09-12T22:51:03.704293+0000","last_became_peered":"2024-09-12T22:51:03.704293+0000","last_unstale":"2024-09-12T22:51:05.723190+0000","last_undegraded":"2024-09-12T22:51:05.723190+0000","last_fullsized":"2024-09-12T22:51:05.723190+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:07.148926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5069,"num_write":355,"num_write_kb":38430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"61'461","reported_seq":656,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723091+0000","last_change":"2024-09-12T22:50:56.858810+0000","last_active":"2024-09-12T22:51:05.723091+0000","last_peered":"2024-09-12T22:51:05.723091+0000","last_clean":"2024-09-12T22:51:05.723091+0000","last_became_active":"2024-09-12T22:50:56.856720+0000","last_became_peered":"2024-09-12T22:50:56.856720+0000","last_unstale":"2024-09-12T22:51:05.723091+0000","last_undegraded":"2024-09-12T22:51:05.723091+0000","last_fullsized":"2024-09-12T22:51:05.723091+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:21.599293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":30574,"num_write":435,"num_write_kb":92996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"61'385","reported_seq":518,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722895+0000","last_change":"2024-09-12T22:51:00.703157+0000","last_active":"2024-09-12T22:51:05.722895+0000","last_peered":"2024-09-12T22:51:05.722895+0000","last_clean":"2024-09-12T22:51:05.722895+0000","last_became_active":"2024-09-12T22:51:00.700472+0000","last_became_peered":"2024-09-12T22:51:00.700472+0000","last_unstale":"2024-09-12T22:51:05.722895+0000","last_undegraded":"2024-09-12T22:51:05.722895+0000","last_fullsized":"2024-09-12T22:51:05.722895+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:07.616061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9031,"num_write":340,"num_write_kb":84729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"61'435","reported_seq":585,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343462+0000","last_change":"2024-09-12T22:48:05.178445+0000","last_active":"2024-09-12T22:51:06.343462+0000","last_peered":"2024-09-12T22:51:06.343462+0000","last_clean":"2024-09-12T22:51:06.343462+0000","last_became_active":"2024-09-12T22:48:05.177284+0000","last_became_peered":"2024-09-12T22:48:05.177284+0000","last_unstale":"2024-09-12T22:51:06.343462+0000","last_undegraded":"2024-09-12T22:51:06.343462+0000","last_fullsized":"2024-09-12T22:51:06.343462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:45.140060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8316,"num_write":403,"num_write_kb":71851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"61'443","reported_seq":648,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724176+0000","last_change":"2024-09-12T22:48:05.172480+0000","last_active":"2024-09-12T22:51:05.724176+0000","last_peered":"2024-09-12T22:51:05.724176+0000","last_clean":"2024-09-12T22:51:05.724176+0000","last_became_active":"2024-09-12T22:48:05.171686+0000","last_became_peered":"2024-09-12T22:48:05.171686+0000","last_unstale":"2024-09-12T22:51:05.724176+0000","last_undegraded":"2024-09-12T22:51:05.724176+0000","last_fullsized":"2024-09-12T22:51:05.724176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:56.158813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40751,"num_write":407,"num_write_kb":116626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"61'383","reported_seq":509,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723914+0000","last_change":"2024-09-12T22:51:02.712354+0000","last_active":"2024-09-12T22:51:05.723914+0000","last_peered":"2024-09-12T22:51:05.723914+0000","last_clean":"2024-09-12T22:51:05.723914+0000","last_became_active":"2024-09-12T22:51:02.710579+0000","last_became_peered":"2024-09-12T22:51:02.710579+0000","last_unstale":"2024-09-12T22:51:05.723914+0000","last_undegraded":"2024-09-12T22:51:05.723914+0000","last_fullsized":"2024-09-12T22:51:05.723914+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:58:11.483150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5475,"num_write":365,"num_write_kb":63204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"61'366","reported_seq":891,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723891+0000","last_change":"2024-09-12T22:50:58.699684+0000","last_active":"2024-09-12T22:51:05.723891+0000","last_peered":"2024-09-12T22:51:05.723891+0000","last_clean":"2024-09-12T22:51:05.723891+0000","last_became_active":"2024-09-12T22:50:58.698711+0000","last_became_peered":"2024-09-12T22:50:58.698711+0000","last_unstale":"2024-09-12T22:51:05.723891+0000","last_undegraded":"2024-09-12T22:51:05.723891+0000","last_fullsized":"2024-09-12T22:51:05.723891+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:47.507555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":35222,"num_write":342,"num_write_kb":74947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"61'434","reported_seq":622,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723644+0000","last_change":"2024-09-12T22:48:05.171356+0000","last_active":"2024-09-12T22:51:05.723644+0000","last_peered":"2024-09-12T22:51:05.723644+0000","last_clean":"2024-09-12T22:51:05.723644+0000","last_became_active":"2024-09-12T22:48:05.170794+0000","last_became_peered":"2024-09-12T22:48:05.170794+0000","last_unstale":"2024-09-12T22:51:05.723644+0000","last_undegraded":"2024-09-12T22:51:05.723644+0000","last_fullsized":"2024-09-12T22:51:05.723644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:42:56.969660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":19623,"num_write":389,"num_write_kb":83457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"61'432","reported_seq":601,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723150+0000","last_change":"2024-09-12T22:50:58.702236+0000","last_active":"2024-09-12T22:51:05.723150+0000","last_peered":"2024-09-12T22:51:05.723150+0000","last_clean":"2024-09-12T22:51:05.723150+0000","last_became_active":"2024-09-12T22:50:58.700107+0000","last_became_peered":"2024-09-12T22:50:58.700107+0000","last_unstale":"2024-09-12T22:51:05.723150+0000","last_undegraded":"2024-09-12T22:51:05.723150+0000","last_fullsized":"2024-09-12T22:51:05.723150+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:29.112353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":23332,"num_write":401,"num_write_kb":75871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"61'406","reported_seq":573,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723029+0000","last_change":"2024-09-12T22:50:55.852257+0000","last_active":"2024-09-12T22:51:05.723029+0000","last_peered":"2024-09-12T22:51:05.723029+0000","last_clean":"2024-09-12T22:51:05.723029+0000","last_became_active":"2024-09-12T22:50:55.849568+0000","last_became_peered":"2024-09-12T22:50:55.849568+0000","last_unstale":"2024-09-12T22:51:05.723029+0000","last_undegraded":"2024-09-12T22:51:05.723029+0000","last_fullsized":"2024-09-12T22:51:05.723029+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:49.995990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":18162,"num_write":365,"num_write_kb":58919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"61'444","reported_seq":575,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723061+0000","last_change":"2024-09-12T22:51:01.704325+0000","last_active":"2024-09-12T22:51:05.723061+0000","last_peered":"2024-09-12T22:51:05.723061+0000","last_clean":"2024-09-12T22:51:05.723061+0000","last_became_active":"2024-09-12T22:51:01.700744+0000","last_became_peered":"2024-09-12T22:51:01.700744+0000","last_unstale":"2024-09-12T22:51:05.723061+0000","last_undegraded":"2024-09-12T22:51:05.723061+0000","last_fullsized":"2024-09-12T22:51:05.723061+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:00.747671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":410,"num_write_kb":63144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"61'443","reported_seq":616,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343794+0000","last_change":"2024-09-12T22:48:05.178721+0000","last_active":"2024-09-12T22:51:06.343794+0000","last_peered":"2024-09-12T22:51:06.343794+0000","last_clean":"2024-09-12T22:51:06.343794+0000","last_became_active":"2024-09-12T22:48:05.177965+0000","last_became_peered":"2024-09-12T22:48:05.177965+0000","last_unstale":"2024-09-12T22:51:06.343794+0000","last_undegraded":"2024-09-12T22:51:06.343794+0000","last_fullsized":"2024-09-12T22:51:06.343794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:32.288419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":14687,"num_write":408,"num_write_kb":80026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"61'439","reported_seq":665,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724329+0000","last_change":"2024-09-12T22:48:05.171053+0000","last_active":"2024-09-12T22:51:05.724329+0000","last_peered":"2024-09-12T22:51:05.724329+0000","last_clean":"2024-09-12T22:51:05.724329+0000","last_became_active":"2024-09-12T22:48:05.170578+0000","last_became_peered":"2024-09-12T22:48:05.170578+0000","last_unstale":"2024-09-12T22:51:05.724329+0000","last_undegraded":"2024-09-12T22:51:05.724329+0000","last_fullsized":"2024-09-12T22:51:05.724329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:58.991752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":47063,"num_write":400,"num_write_kb":100535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"61'444","reported_seq":660,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343268+0000","last_change":"2024-09-12T22:48:05.177369+0000","last_active":"2024-09-12T22:51:06.343268+0000","last_peered":"2024-09-12T22:51:06.343268+0000","last_clean":"2024-09-12T22:51:06.343268+0000","last_became_active":"2024-09-12T22:48:05.176680+0000","last_became_peered":"2024-09-12T22:48:05.176680+0000","last_unstale":"2024-09-12T22:51:06.343268+0000","last_undegraded":"2024-09-12T22:51:06.343268+0000","last_fullsized":"2024-09-12T22:51:06.343268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:25.143572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":42758,"num_write":403,"num_write_kb":67827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"61'433","reported_seq":570,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723656+0000","last_change":"2024-09-12T22:51:02.711577+0000","last_active":"2024-09-12T22:51:05.723656+0000","last_peered":"2024-09-12T22:51:05.723656+0000","last_clean":"2024-09-12T22:51:05.723656+0000","last_became_active":"2024-09-12T22:51:02.708090+0000","last_became_peered":"2024-09-12T22:51:02.708090+0000","last_unstale":"2024-09-12T22:51:05.723656+0000","last_undegraded":"2024-09-12T22:51:05.723656+0000","last_fullsized":"2024-09-12T22:51:05.723656+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:32.441902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":10750,"num_write":397,"num_write_kb":34708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"61'413","reported_seq":588,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723473+0000","last_change":"2024-09-12T22:50:58.702132+0000","last_active":"2024-09-12T22:51:05.723473+0000","last_peered":"2024-09-12T22:51:05.723473+0000","last_clean":"2024-09-12T22:51:05.723473+0000","last_became_active":"2024-09-12T22:50:58.699982+0000","last_became_peered":"2024-09-12T22:50:58.699982+0000","last_unstale":"2024-09-12T22:51:05.723473+0000","last_undegraded":"2024-09-12T22:51:05.723473+0000","last_fullsized":"2024-09-12T22:51:05.723473+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:03.458952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":25621,"num_write":385,"num_write_kb":63908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"61'462","reported_seq":1066,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723490+0000","last_change":"2024-09-12T22:50:58.701216+0000","last_active":"2024-09-12T22:51:05.723490+0000","last_peered":"2024-09-12T22:51:05.723490+0000","last_clean":"2024-09-12T22:51:05.723490+0000","last_became_active":"2024-09-12T22:50:58.700047+0000","last_became_peered":"2024-09-12T22:50:58.700047+0000","last_unstale":"2024-09-12T22:51:05.723490+0000","last_undegraded":"2024-09-12T22:51:05.723490+0000","last_fullsized":"2024-09-12T22:51:05.723490+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:51.010136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28920,"num_write":428,"num_write_kb":76277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"61'413","reported_seq":948,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342393+0000","last_change":"2024-09-12T22:50:57.861973+0000","last_active":"2024-09-12T22:51:06.342393+0000","last_peered":"2024-09-12T22:51:06.342393+0000","last_clean":"2024-09-12T22:51:06.342393+0000","last_became_active":"2024-09-12T22:50:57.860819+0000","last_became_peered":"2024-09-12T22:50:57.860819+0000","last_unstale":"2024-09-12T22:51:06.342393+0000","last_undegraded":"2024-09-12T22:51:06.342393+0000","last_fullsized":"2024-09-12T22:51:06.342393+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:52.977617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":14661,"num_write":381,"num_write_kb":72596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"61'475","reported_seq":680,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723273+0000","last_change":"2024-09-12T22:48:05.172794+0000","last_active":"2024-09-12T22:51:05.723273+0000","last_peered":"2024-09-12T22:51:05.723273+0000","last_clean":"2024-09-12T22:51:05.723273+0000","last_became_active":"2024-09-12T22:48:05.172437+0000","last_became_peered":"2024-09-12T22:48:05.172437+0000","last_unstale":"2024-09-12T22:51:05.723273+0000","last_undegraded":"2024-09-12T22:51:05.723273+0000","last_fullsized":"2024-09-12T22:51:05.723273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:54:44.278646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":32397,"num_write":452,"num_write_kb":105406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"61'413","reported_seq":963,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724480+0000","last_change":"2024-09-12T22:51:02.709686+0000","last_active":"2024-09-12T22:51:05.724480+0000","last_peered":"2024-09-12T22:51:05.724480+0000","last_clean":"2024-09-12T22:51:05.724480+0000","last_became_active":"2024-09-12T22:51:02.708084+0000","last_became_peered":"2024-09-12T22:51:02.708084+0000","last_unstale":"2024-09-12T22:51:05.724480+0000","last_undegraded":"2024-09-12T22:51:05.724480+0000","last_fullsized":"2024-09-12T22:51:05.724480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:27.765575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4773,"num_write":395,"num_write_kb":21871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"61'453","reported_seq":1027,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343514+0000","last_change":"2024-09-12T22:50:58.700787+0000","last_active":"2024-09-12T22:51:06.343514+0000","last_peered":"2024-09-12T22:51:06.343514+0000","last_clean":"2024-09-12T22:51:06.343514+0000","last_became_active":"2024-09-12T22:50:58.699585+0000","last_became_peered":"2024-09-12T22:50:58.699585+0000","last_unstale":"2024-09-12T22:51:06.343514+0000","last_undegraded":"2024-09-12T22:51:06.343514+0000","last_fullsized":"2024-09-12T22:51:06.343514+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:44.083029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18201,"num_write":409,"num_write_kb":47008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"61'402","reported_seq":571,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723791+0000","last_change":"2024-09-12T22:51:01.704826+0000","last_active":"2024-09-12T22:51:05.723791+0000","last_peered":"2024-09-12T22:51:05.723791+0000","last_clean":"2024-09-12T22:51:05.723791+0000","last_became_active":"2024-09-12T22:51:01.701850+0000","last_became_peered":"2024-09-12T22:51:01.701850+0000","last_unstale":"2024-09-12T22:51:05.723791+0000","last_undegraded":"2024-09-12T22:51:05.723791+0000","last_fullsized":"2024-09-12T22:51:05.723791+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:44:29.380608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":21641,"num_write":372,"num_write_kb":63613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"61'436","reported_seq":1073,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724130+0000","last_change":"2024-09-12T22:50:59.703836+0000","last_active":"2024-09-12T22:51:05.724130+0000","last_peered":"2024-09-12T22:51:05.724130+0000","last_clean":"2024-09-12T22:51:05.724130+0000","last_became_active":"2024-09-12T22:50:59.702766+0000","last_became_peered":"2024-09-12T22:50:59.702766+0000","last_unstale":"2024-09-12T22:51:05.724130+0000","last_undegraded":"2024-09-12T22:51:05.724130+0000","last_fullsized":"2024-09-12T22:51:05.724130+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:52.977617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":65550,"num_write":412,"num_write_kb":134233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"61'393","reported_seq":590,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343137+0000","last_change":"2024-09-12T22:48:05.177176+0000","last_active":"2024-09-12T22:51:06.343137+0000","last_peered":"2024-09-12T22:51:06.343137+0000","last_clean":"2024-09-12T22:51:06.343137+0000","last_became_active":"2024-09-12T22:48:05.176735+0000","last_became_peered":"2024-09-12T22:48:05.176735+0000","last_unstale":"2024-09-12T22:51:06.343137+0000","last_undegraded":"2024-09-12T22:51:06.343137+0000","last_fullsized":"2024-09-12T22:51:06.343137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:51.360504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":36009,"num_write":361,"num_write_kb":71487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"61'456","reported_seq":1019,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723644+0000","last_change":"2024-09-12T22:51:00.699523+0000","last_active":"2024-09-12T22:51:05.723644+0000","last_peered":"2024-09-12T22:51:05.723644+0000","last_clean":"2024-09-12T22:51:05.723644+0000","last_became_active":"2024-09-12T22:51:00.698377+0000","last_became_peered":"2024-09-12T22:51:00.698377+0000","last_unstale":"2024-09-12T22:51:05.723644+0000","last_undegraded":"2024-09-12T22:51:05.723644+0000","last_fullsized":"2024-09-12T22:51:05.723644+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:04:47.810227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4316,"num_write":417,"num_write_kb":34284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"61'440","reported_seq":614,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342570+0000","last_change":"2024-09-12T22:48:05.176878+0000","last_active":"2024-09-12T22:51:06.342570+0000","last_peered":"2024-09-12T22:51:06.342570+0000","last_clean":"2024-09-12T22:51:06.342570+0000","last_became_active":"2024-09-12T22:48:05.176327+0000","last_became_peered":"2024-09-12T22:48:05.176327+0000","last_unstale":"2024-09-12T22:51:06.342570+0000","last_undegraded":"2024-09-12T22:51:06.342570+0000","last_fullsized":"2024-09-12T22:51:06.342570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:11.781766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15052,"num_write":399,"num_write_kb":71703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"61'424","reported_seq":582,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722737+0000","last_change":"2024-09-12T22:51:01.704366+0000","last_active":"2024-09-12T22:51:05.722737+0000","last_peered":"2024-09-12T22:51:05.722737+0000","last_clean":"2024-09-12T22:51:05.722737+0000","last_became_active":"2024-09-12T22:51:01.700878+0000","last_became_peered":"2024-09-12T22:51:01.700878+0000","last_unstale":"2024-09-12T22:51:05.722737+0000","last_undegraded":"2024-09-12T22:51:05.722737+0000","last_fullsized":"2024-09-12T22:51:05.722737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:57.250980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25587,"num_write":397,"num_write_kb":46651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"61'384","reported_seq":545,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724020+0000","last_change":"2024-09-12T22:48:05.171573+0000","last_active":"2024-09-12T22:51:05.724020+0000","last_peered":"2024-09-12T22:51:05.724020+0000","last_clean":"2024-09-12T22:51:05.724020+0000","last_became_active":"2024-09-12T22:48:05.171036+0000","last_became_peered":"2024-09-12T22:48:05.171036+0000","last_unstale":"2024-09-12T22:51:05.724020+0000","last_undegraded":"2024-09-12T22:51:05.724020+0000","last_fullsized":"2024-09-12T22:51:05.724020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:27:07.558853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9715,"num_write":345,"num_write_kb":63048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"61'450","reported_seq":585,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723240+0000","last_change":"2024-09-12T22:50:55.851831+0000","last_active":"2024-09-12T22:51:05.723240+0000","last_peered":"2024-09-12T22:51:05.723240+0000","last_clean":"2024-09-12T22:51:05.723240+0000","last_became_active":"2024-09-12T22:50:55.851443+0000","last_became_peered":"2024-09-12T22:50:55.851443+0000","last_unstale":"2024-09-12T22:51:05.723240+0000","last_undegraded":"2024-09-12T22:51:05.723240+0000","last_fullsized":"2024-09-12T22:51:05.723240+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:25:19.575346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":387,"num_write_kb":8369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"61'389","reported_seq":568,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724238+0000","last_change":"2024-09-12T22:48:05.173585+0000","last_active":"2024-09-12T22:51:05.724238+0000","last_peered":"2024-09-12T22:51:05.724238+0000","last_clean":"2024-09-12T22:51:05.724238+0000","last_became_active":"2024-09-12T22:48:05.172801+0000","last_became_peered":"2024-09-12T22:48:05.172801+0000","last_unstale":"2024-09-12T22:51:05.724238+0000","last_undegraded":"2024-09-12T22:51:05.724238+0000","last_fullsized":"2024-09-12T22:51:05.724238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:45.140060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":21115,"num_write":354,"num_write_kb":59128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"61'60","reported_seq":206,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342908+0000","last_change":"2024-09-12T22:50:52.860336+0000","last_active":"2024-09-12T22:51:06.342908+0000","last_peered":"2024-09-12T22:51:06.342908+0000","last_clean":"2024-09-12T22:51:06.342908+0000","last_became_active":"2024-09-12T22:50:52.859975+0000","last_became_peered":"2024-09-12T22:50:52.859975+0000","last_unstale":"2024-09-12T22:51:06.342908+0000","last_undegraded":"2024-09-12T22:51:06.342908+0000","last_fullsized":"2024-09-12T22:51:06.342908+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:14.260183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"61'433","reported_seq":997,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342401+0000","last_change":"2024-09-12T22:50:57.863647+0000","last_active":"2024-09-12T22:51:06.342401+0000","last_peered":"2024-09-12T22:51:06.342401+0000","last_clean":"2024-09-12T22:51:06.342401+0000","last_became_active":"2024-09-12T22:50:57.861719+0000","last_became_peered":"2024-09-12T22:50:57.861719+0000","last_unstale":"2024-09-12T22:51:06.342401+0000","last_undegraded":"2024-09-12T22:51:06.342401+0000","last_fullsized":"2024-09-12T22:51:06.342401+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:04:47.810227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17599,"num_write":404,"num_write_kb":59440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"61'63","reported_seq":209,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723521+0000","last_change":"2024-09-12T22:50:52.857615+0000","last_active":"2024-09-12T22:51:05.723521+0000","last_peered":"2024-09-12T22:51:05.723521+0000","last_clean":"2024-09-12T22:51:05.723521+0000","last_became_active":"2024-09-12T22:50:52.857343+0000","last_became_peered":"2024-09-12T22:50:52.857343+0000","last_unstale":"2024-09-12T22:51:05.723521+0000","last_undegraded":"2024-09-12T22:51:05.723521+0000","last_fullsized":"2024-09-12T22:51:05.723521+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:44.095690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"61'407","reported_seq":932,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343467+0000","last_change":"2024-09-12T22:50:55.853362+0000","last_active":"2024-09-12T22:51:06.343467+0000","last_peered":"2024-09-12T22:51:06.343467+0000","last_clean":"2024-09-12T22:51:06.343467+0000","last_became_active":"2024-09-12T22:50:55.851934+0000","last_became_peered":"2024-09-12T22:50:55.851934+0000","last_unstale":"2024-09-12T22:51:06.343467+0000","last_undegraded":"2024-09-12T22:51:06.343467+0000","last_fullsized":"2024-09-12T22:51:06.343467+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:51.010136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":24842,"num_write":378,"num_write_kb":79144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"61'62","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722703+0000","last_change":"2024-09-12T22:50:52.859828+0000","last_active":"2024-09-12T22:51:05.722703+0000","last_peered":"2024-09-12T22:51:05.722703+0000","last_clean":"2024-09-12T22:51:05.722703+0000","last_became_active":"2024-09-12T22:50:52.858911+0000","last_became_peered":"2024-09-12T22:50:52.858911+0000","last_unstale":"2024-09-12T22:51:05.722703+0000","last_undegraded":"2024-09-12T22:51:05.722703+0000","last_fullsized":"2024-09-12T22:51:05.722703+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:44.358340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"61'152","reported_seq":288,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723962+0000","last_change":"2024-09-12T22:50:55.851865+0000","last_active":"2024-09-12T22:51:05.723962+0000","last_peered":"2024-09-12T22:51:05.723962+0000","last_clean":"2024-09-12T22:51:05.723962+0000","last_became_active":"2024-09-12T22:50:55.851050+0000","last_became_peered":"2024-09-12T22:50:55.851050+0000","last_unstale":"2024-09-12T22:51:05.723962+0000","last_undegraded":"2024-09-12T22:51:05.723962+0000","last_fullsized":"2024-09-12T22:51:05.723962+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:31:24.219732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"61'392","reported_seq":890,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723334+0000","last_change":"2024-09-12T22:50:56.855073+0000","last_active":"2024-09-12T22:51:05.723334+0000","last_peered":"2024-09-12T22:51:05.723334+0000","last_clean":"2024-09-12T22:51:05.723334+0000","last_became_active":"2024-09-12T22:50:56.853383+0000","last_became_peered":"2024-09-12T22:50:56.853383+0000","last_unstale":"2024-09-12T22:51:05.723334+0000","last_undegraded":"2024-09-12T22:51:05.723334+0000","last_fullsized":"2024-09-12T22:51:05.723334+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:18.644500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":9675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"61'237","reported_seq":390,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724440+0000","last_change":"2024-09-12T22:50:55.852418+0000","last_active":"2024-09-12T22:51:05.724440+0000","last_peered":"2024-09-12T22:51:05.724440+0000","last_clean":"2024-09-12T22:51:05.724440+0000","last_became_active":"2024-09-12T22:50:55.852034+0000","last_became_peered":"2024-09-12T22:50:55.852034+0000","last_unstale":"2024-09-12T22:51:05.724440+0000","last_undegraded":"2024-09-12T22:51:05.724440+0000","last_fullsized":"2024-09-12T22:51:05.724440+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:47.161147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"61'464","reported_seq":637,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723400+0000","last_change":"2024-09-12T22:48:05.171143+0000","last_active":"2024-09-12T22:51:05.723400+0000","last_peered":"2024-09-12T22:51:05.723400+0000","last_clean":"2024-09-12T22:51:05.723400+0000","last_became_active":"2024-09-12T22:48:05.170374+0000","last_became_peered":"2024-09-12T22:48:05.170374+0000","last_unstale":"2024-09-12T22:51:05.723400+0000","last_undegraded":"2024-09-12T22:51:05.723400+0000","last_fullsized":"2024-09-12T22:51:05.723400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:15.887977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15522,"num_write":440,"num_write_kb":60335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"61'470","reported_seq":606,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723638+0000","last_change":"2024-09-12T22:50:55.852447+0000","last_active":"2024-09-12T22:51:05.723638+0000","last_peered":"2024-09-12T22:51:05.723638+0000","last_clean":"2024-09-12T22:51:05.723638+0000","last_became_active":"2024-09-12T22:50:55.852074+0000","last_became_peered":"2024-09-12T22:50:55.852074+0000","last_unstale":"2024-09-12T22:51:05.723638+0000","last_undegraded":"2024-09-12T22:51:05.723638+0000","last_fullsized":"2024-09-12T22:51:05.723638+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:24.010030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":4267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"61'449","reported_seq":636,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723253+0000","last_change":"2024-09-12T22:51:00.701817+0000","last_active":"2024-09-12T22:51:05.723253+0000","last_peered":"2024-09-12T22:51:05.723253+0000","last_clean":"2024-09-12T22:51:05.723253+0000","last_became_active":"2024-09-12T22:51:00.699592+0000","last_became_peered":"2024-09-12T22:51:00.699592+0000","last_unstale":"2024-09-12T22:51:05.723253+0000","last_undegraded":"2024-09-12T22:51:05.723253+0000","last_fullsized":"2024-09-12T22:51:05.723253+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:11.924779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":36634,"num_write":415,"num_write_kb":84238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"61'52","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723477+0000","last_change":"2024-09-12T22:50:52.857863+0000","last_active":"2024-09-12T22:51:05.723477+0000","last_peered":"2024-09-12T22:51:05.723477+0000","last_clean":"2024-09-12T22:51:05.723477+0000","last_became_active":"2024-09-12T22:50:52.857342+0000","last_became_peered":"2024-09-12T22:50:52.857342+0000","last_unstale":"2024-09-12T22:51:05.723477+0000","last_undegraded":"2024-09-12T22:51:05.723477+0000","last_fullsized":"2024-09-12T22:51:05.723477+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:59.906052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"61'434","reported_seq":1027,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343139+0000","last_change":"2024-09-12T22:50:58.701303+0000","last_active":"2024-09-12T22:51:06.343139+0000","last_peered":"2024-09-12T22:51:06.343139+0000","last_clean":"2024-09-12T22:51:06.343139+0000","last_became_active":"2024-09-12T22:50:58.700178+0000","last_became_peered":"2024-09-12T22:50:58.700178+0000","last_unstale":"2024-09-12T22:51:06.343139+0000","last_undegraded":"2024-09-12T22:51:06.343139+0000","last_fullsized":"2024-09-12T22:51:06.343139+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:13:37.634120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":39364,"num_write":402,"num_write_kb":59313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"61'194","reported_seq":349,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343266+0000","last_change":"2024-09-12T22:50:55.852827+0000","last_active":"2024-09-12T22:51:06.343266+0000","last_peered":"2024-09-12T22:51:06.343266+0000","last_clean":"2024-09-12T22:51:06.343266+0000","last_became_active":"2024-09-12T22:50:55.852479+0000","last_became_peered":"2024-09-12T22:50:55.852479+0000","last_unstale":"2024-09-12T22:51:06.343266+0000","last_undegraded":"2024-09-12T22:51:06.343266+0000","last_fullsized":"2024-09-12T22:51:06.343266+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:17.642880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"61'457","reported_seq":591,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723790+0000","last_change":"2024-09-12T22:51:03.707374+0000","last_active":"2024-09-12T22:51:05.723790+0000","last_peered":"2024-09-12T22:51:05.723790+0000","last_clean":"2024-09-12T22:51:05.723790+0000","last_became_active":"2024-09-12T22:51:03.704514+0000","last_became_peered":"2024-09-12T22:51:03.704514+0000","last_unstale":"2024-09-12T22:51:05.723790+0000","last_undegraded":"2024-09-12T22:51:05.723790+0000","last_fullsized":"2024-09-12T22:51:05.723790+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:13.942017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10832,"num_write":419,"num_write_kb":34901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"61'106","reported_seq":232,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722915+0000","last_change":"2024-09-12T22:50:55.851086+0000","last_active":"2024-09-12T22:51:05.722915+0000","last_peered":"2024-09-12T22:51:05.722915+0000","last_clean":"2024-09-12T22:51:05.722915+0000","last_became_active":"2024-09-12T22:50:55.850764+0000","last_became_peered":"2024-09-12T22:50:55.850764+0000","last_unstale":"2024-09-12T22:51:05.722915+0000","last_undegraded":"2024-09-12T22:51:05.722915+0000","last_fullsized":"2024-09-12T22:51:05.722915+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:26.058872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"61'431","reported_seq":571,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723616+0000","last_change":"2024-09-12T22:51:02.710383+0000","last_active":"2024-09-12T22:51:05.723616+0000","last_peered":"2024-09-12T22:51:05.723616+0000","last_clean":"2024-09-12T22:51:05.723616+0000","last_became_active":"2024-09-12T22:51:02.707646+0000","last_became_peered":"2024-09-12T22:51:02.707646+0000","last_unstale":"2024-09-12T22:51:05.723616+0000","last_undegraded":"2024-09-12T22:51:05.723616+0000","last_fullsized":"2024-09-12T22:51:05.723616+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:41.956076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":10443,"num_write":392,"num_write_kb":63957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"61'49","reported_seq":195,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723628+0000","last_change":"2024-09-12T22:50:52.857609+0000","last_active":"2024-09-12T22:51:05.723628+0000","last_peered":"2024-09-12T22:51:05.723628+0000","last_clean":"2024-09-12T22:51:05.723628+0000","last_became_active":"2024-09-12T22:50:52.857301+0000","last_became_peered":"2024-09-12T22:50:52.857301+0000","last_unstale":"2024-09-12T22:51:05.723628+0000","last_undegraded":"2024-09-12T22:51:05.723628+0000","last_fullsized":"2024-09-12T22:51:05.723628+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:43.328264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"61'351","reported_seq":475,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723979+0000","last_change":"2024-09-12T22:50:56.855396+0000","last_active":"2024-09-12T22:51:05.723979+0000","last_peered":"2024-09-12T22:51:05.723979+0000","last_clean":"2024-09-12T22:51:05.723979+0000","last_became_active":"2024-09-12T22:50:56.853610+0000","last_became_peered":"2024-09-12T22:50:56.853610+0000","last_unstale":"2024-09-12T22:51:05.723979+0000","last_undegraded":"2024-09-12T22:51:05.723979+0000","last_fullsized":"2024-09-12T22:51:05.723979+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:01.946701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":137,"num_write":315,"num_write_kb":37943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"61'588","reported_seq":727,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723397+0000","last_change":"2024-09-12T22:48:04.174281+0000","last_active":"2024-09-12T22:51:05.723397+0000","last_peered":"2024-09-12T22:51:05.723397+0000","last_clean":"2024-09-12T22:51:05.723397+0000","last_became_active":"2024-09-12T22:48:04.173942+0000","last_became_peered":"2024-09-12T22:48:04.173942+0000","last_unstale":"2024-09-12T22:51:05.723397+0000","last_undegraded":"2024-09-12T22:51:05.723397+0000","last_fullsized":"2024-09-12T22:51:05.723397+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:19:38.546747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":4334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"61'400","reported_seq":560,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343593+0000","last_change":"2024-09-12T22:48:05.178246+0000","last_active":"2024-09-12T22:51:06.343593+0000","last_peered":"2024-09-12T22:51:06.343593+0000","last_clean":"2024-09-12T22:51:06.343593+0000","last_became_active":"2024-09-12T22:48:05.176813+0000","last_became_peered":"2024-09-12T22:48:05.176813+0000","last_unstale":"2024-09-12T22:51:06.343593+0000","last_undegraded":"2024-09-12T22:51:06.343593+0000","last_fullsized":"2024-09-12T22:51:06.343593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:58.991752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":9179,"num_write":363,"num_write_kb":67046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":242,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722613+0000","last_change":"2024-09-12T22:50:52.860243+0000","last_active":"2024-09-12T22:51:05.722613+0000","last_peered":"2024-09-12T22:51:05.722613+0000","last_clean":"2024-09-12T22:51:05.722613+0000","last_became_active":"2024-09-12T22:50:52.859754+0000","last_became_peered":"2024-09-12T22:50:52.859754+0000","last_unstale":"2024-09-12T22:51:05.722613+0000","last_undegraded":"2024-09-12T22:51:05.722613+0000","last_fullsized":"2024-09-12T22:51:05.722613+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:55.016634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:55.016634+0000","last_clean_scrub_stamp":"2024-09-12T22:47:55.016634+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:41:30.207577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722981+0000","last_change":"2024-09-12T22:50:52.858727+0000","last_active":"2024-09-12T22:51:05.722981+0000","last_peered":"2024-09-12T22:51:05.722981+0000","last_clean":"2024-09-12T22:51:05.722981+0000","last_became_active":"2024-09-12T22:50:52.857759+0000","last_became_peered":"2024-09-12T22:50:52.857759+0000","last_unstale":"2024-09-12T22:51:05.722981+0000","last_undegraded":"2024-09-12T22:51:05.722981+0000","last_fullsized":"2024-09-12T22:51:05.722981+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:52.160461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"61'506","reported_seq":645,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343027+0000","last_change":"2024-09-12T22:48:04.169704+0000","last_active":"2024-09-12T22:51:06.343027+0000","last_peered":"2024-09-12T22:51:06.343027+0000","last_clean":"2024-09-12T22:51:06.343027+0000","last_became_active":"2024-09-12T22:48:04.169474+0000","last_became_peered":"2024-09-12T22:48:04.169474+0000","last_unstale":"2024-09-12T22:51:06.343027+0000","last_undegraded":"2024-09-12T22:51:06.343027+0000","last_fullsized":"2024-09-12T22:51:06.343027+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:00.271198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":444,"num_write_kb":8407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"61'422","reported_seq":595,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723784+0000","last_change":"2024-09-12T22:51:00.700237+0000","last_active":"2024-09-12T22:51:05.723784+0000","last_peered":"2024-09-12T22:51:05.723784+0000","last_clean":"2024-09-12T22:51:05.723784+0000","last_became_active":"2024-09-12T22:51:00.698391+0000","last_became_peered":"2024-09-12T22:51:00.698391+0000","last_unstale":"2024-09-12T22:51:05.723784+0000","last_undegraded":"2024-09-12T22:51:05.723784+0000","last_fullsized":"2024-09-12T22:51:05.723784+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:19.299721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":38484,"num_write":383,"num_write_kb":67099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722904+0000","last_change":"2024-09-12T22:50:52.859530+0000","last_active":"2024-09-12T22:51:05.722904+0000","last_peered":"2024-09-12T22:51:05.722904+0000","last_clean":"2024-09-12T22:51:05.722904+0000","last_became_active":"2024-09-12T22:50:52.858480+0000","last_became_peered":"2024-09-12T22:50:52.858480+0000","last_unstale":"2024-09-12T22:51:05.722904+0000","last_undegraded":"2024-09-12T22:51:05.722904+0000","last_fullsized":"2024-09-12T22:51:05.722904+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:28:23.416675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"61'107","reported_seq":304,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342800+0000","last_change":"2024-09-12T22:50:55.853291+0000","last_active":"2024-09-12T22:51:06.342800+0000","last_peered":"2024-09-12T22:51:06.342800+0000","last_clean":"2024-09-12T22:51:06.342800+0000","last_became_active":"2024-09-12T22:50:55.852965+0000","last_became_peered":"2024-09-12T22:50:55.852965+0000","last_unstale":"2024-09-12T22:51:06.342800+0000","last_undegraded":"2024-09-12T22:51:06.342800+0000","last_fullsized":"2024-09-12T22:51:06.342800+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:46.505934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1463793,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":1459,"num_write":45,"num_write_kb":1459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1463793,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"61'436","reported_seq":618,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724236+0000","last_change":"2024-09-12T22:48:05.171819+0000","last_active":"2024-09-12T22:51:05.724236+0000","last_peered":"2024-09-12T22:51:05.724236+0000","last_clean":"2024-09-12T22:51:05.724236+0000","last_became_active":"2024-09-12T22:48:05.171293+0000","last_became_peered":"2024-09-12T22:48:05.171293+0000","last_unstale":"2024-09-12T22:51:05.724236+0000","last_undegraded":"2024-09-12T22:51:05.724236+0000","last_fullsized":"2024-09-12T22:51:05.724236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:01.401542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":27936,"num_write":401,"num_write_kb":51013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342933+0000","last_change":"2024-09-12T22:48:02.045209+0000","last_active":"2024-09-12T22:51:06.342933+0000","last_peered":"2024-09-12T22:51:06.342933+0000","last_clean":"2024-09-12T22:51:06.342933+0000","last_became_active":"2024-09-12T22:48:00.042007+0000","last_became_peered":"2024-09-12T22:48:00.042007+0000","last_unstale":"2024-09-12T22:51:06.342933+0000","last_undegraded":"2024-09-12T22:51:06.342933+0000","last_fullsized":"2024-09-12T22:51:06.342933+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:13.536542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036893100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"61'357","reported_seq":511,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723507+0000","last_change":"2024-09-12T22:50:55.852384+0000","last_active":"2024-09-12T22:51:05.723507+0000","last_peered":"2024-09-12T22:51:05.723507+0000","last_clean":"2024-09-12T22:51:05.723507+0000","last_became_active":"2024-09-12T22:50:55.852029+0000","last_became_peered":"2024-09-12T22:50:55.852029+0000","last_unstale":"2024-09-12T22:51:05.723507+0000","last_undegraded":"2024-09-12T22:51:05.723507+0000","last_fullsized":"2024-09-12T22:51:05.723507+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:59.415555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":8307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"61'343","reported_seq":503,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343598+0000","last_change":"2024-09-12T22:48:05.178865+0000","last_active":"2024-09-12T22:51:06.343598+0000","last_peered":"2024-09-12T22:51:06.343598+0000","last_clean":"2024-09-12T22:51:06.343598+0000","last_became_active":"2024-09-12T22:48:05.178010+0000","last_became_peered":"2024-09-12T22:48:05.178010+0000","last_unstale":"2024-09-12T22:51:06.343598+0000","last_undegraded":"2024-09-12T22:51:06.343598+0000","last_fullsized":"2024-09-12T22:51:06.343598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:30.120804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":6704,"num_write":316,"num_write_kb":42458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":70,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722797+0000","last_change":"2024-09-12T22:50:52.858195+0000","last_active":"2024-09-12T22:51:05.722797+0000","last_peered":"2024-09-12T22:51:05.722797+0000","last_clean":"2024-09-12T22:51:05.722797+0000","last_became_active":"2024-09-12T22:50:52.857746+0000","last_became_peered":"2024-09-12T22:50:52.857746+0000","last_unstale":"2024-09-12T22:51:05.722797+0000","last_undegraded":"2024-09-12T22:51:05.722797+0000","last_fullsized":"2024-09-12T22:51:05.722797+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:10:52.096897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052714799999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"61'78","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723018+0000","last_change":"2024-09-12T22:50:52.858808+0000","last_active":"2024-09-12T22:51:05.723018+0000","last_peered":"2024-09-12T22:51:05.723018+0000","last_clean":"2024-09-12T22:51:05.723018+0000","last_became_active":"2024-09-12T22:50:52.858372+0000","last_became_peered":"2024-09-12T22:50:52.858372+0000","last_unstale":"2024-09-12T22:51:05.723018+0000","last_undegraded":"2024-09-12T22:51:05.723018+0000","last_fullsized":"2024-09-12T22:51:05.723018+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:44.345055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"61'404","reported_seq":614,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343369+0000","last_change":"2024-09-12T22:48:05.177561+0000","last_active":"2024-09-12T22:51:06.343369+0000","last_peered":"2024-09-12T22:51:06.343369+0000","last_clean":"2024-09-12T22:51:06.343369+0000","last_became_active":"2024-09-12T22:48:05.177164+0000","last_became_peered":"2024-09-12T22:48:05.177164+0000","last_unstale":"2024-09-12T22:51:06.343369+0000","last_undegraded":"2024-09-12T22:51:06.343369+0000","last_fullsized":"2024-09-12T22:51:06.343369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:24.124647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":35084,"num_write":365,"num_write_kb":71560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"61'269","reported_seq":395,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723416+0000","last_change":"2024-09-12T22:50:55.850951+0000","last_active":"2024-09-12T22:51:05.723416+0000","last_peered":"2024-09-12T22:51:05.723416+0000","last_clean":"2024-09-12T22:51:05.723416+0000","last_became_active":"2024-09-12T22:50:55.850689+0000","last_became_peered":"2024-09-12T22:50:55.850689+0000","last_unstale":"2024-09-12T22:51:05.723416+0000","last_undegraded":"2024-09-12T22:51:05.723416+0000","last_fullsized":"2024-09-12T22:51:05.723416+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:11:37.856958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":4189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343491+0000","last_change":"2024-09-12T22:48:02.045324+0000","last_active":"2024-09-12T22:51:06.343491+0000","last_peered":"2024-09-12T22:51:06.343491+0000","last_clean":"2024-09-12T22:51:06.343491+0000","last_became_active":"2024-09-12T22:48:00.042132+0000","last_became_peered":"2024-09-12T22:48:00.042132+0000","last_unstale":"2024-09-12T22:51:06.343491+0000","last_undegraded":"2024-09-12T22:51:06.343491+0000","last_fullsized":"2024-09-12T22:51:06.343491+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:24.673019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047590600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"61'362","reported_seq":851,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723496+0000","last_change":"2024-09-12T22:50:59.708186+0000","last_active":"2024-09-12T22:51:05.723496+0000","last_peered":"2024-09-12T22:51:05.723496+0000","last_clean":"2024-09-12T22:51:05.723496+0000","last_became_active":"2024-09-12T22:50:59.707126+0000","last_became_peered":"2024-09-12T22:50:59.707126+0000","last_unstale":"2024-09-12T22:51:05.723496+0000","last_undegraded":"2024-09-12T22:51:05.723496+0000","last_fullsized":"2024-09-12T22:51:05.723496+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:08:37.272462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":10445,"num_write":331,"num_write_kb":30096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"61'56","reported_seq":195,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343401+0000","last_change":"2024-09-12T22:48:04.169109+0000","last_active":"2024-09-12T22:51:06.343401+0000","last_peered":"2024-09-12T22:51:06.343401+0000","last_clean":"2024-09-12T22:51:06.343401+0000","last_became_active":"2024-09-12T22:48:04.168655+0000","last_became_peered":"2024-09-12T22:48:04.168655+0000","last_unstale":"2024-09-12T22:51:06.343401+0000","last_undegraded":"2024-09-12T22:51:06.343401+0000","last_fullsized":"2024-09-12T22:51:06.343401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:02.879935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724478+0000","last_change":"2024-09-12T22:48:02.045390+0000","last_active":"2024-09-12T22:51:05.724478+0000","last_peered":"2024-09-12T22:51:05.724478+0000","last_clean":"2024-09-12T22:51:05.724478+0000","last_became_active":"2024-09-12T22:48:00.045356+0000","last_became_peered":"2024-09-12T22:48:00.045356+0000","last_unstale":"2024-09-12T22:51:05.724478+0000","last_undegraded":"2024-09-12T22:51:05.724478+0000","last_fullsized":"2024-09-12T22:51:05.724478+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:32.072080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040621599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"61'408","reported_seq":982,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723709+0000","last_change":"2024-09-12T22:50:57.864738+0000","last_active":"2024-09-12T22:51:05.723709+0000","last_peered":"2024-09-12T22:51:05.723709+0000","last_clean":"2024-09-12T22:51:05.723709+0000","last_became_active":"2024-09-12T22:50:57.863486+0000","last_became_peered":"2024-09-12T22:50:57.863486+0000","last_unstale":"2024-09-12T22:51:05.723709+0000","last_undegraded":"2024-09-12T22:51:05.723709+0000","last_fullsized":"2024-09-12T22:51:05.723709+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:06:04.268528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":42311,"num_write":379,"num_write_kb":75412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"61'61","reported_seq":200,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343872+0000","last_change":"2024-09-12T22:48:04.168635+0000","last_active":"2024-09-12T22:51:06.343872+0000","last_peered":"2024-09-12T22:51:06.343872+0000","last_clean":"2024-09-12T22:51:06.343872+0000","last_became_active":"2024-09-12T22:48:04.168244+0000","last_became_peered":"2024-09-12T22:48:04.168244+0000","last_unstale":"2024-09-12T22:51:06.343872+0000","last_undegraded":"2024-09-12T22:51:06.343872+0000","last_fullsized":"2024-09-12T22:51:06.343872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:56.929490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343640+0000","last_change":"2024-09-12T22:48:02.045428+0000","last_active":"2024-09-12T22:51:06.343640+0000","last_peered":"2024-09-12T22:51:06.343640+0000","last_clean":"2024-09-12T22:51:06.343640+0000","last_became_active":"2024-09-12T22:48:00.040536+0000","last_became_peered":"2024-09-12T22:48:00.040536+0000","last_unstale":"2024-09-12T22:51:06.343640+0000","last_undegraded":"2024-09-12T22:51:06.343640+0000","last_fullsized":"2024-09-12T22:51:06.343640+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:33.150497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057699499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"61'430","reported_seq":990,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342744+0000","last_change":"2024-09-12T22:51:01.701692+0000","last_active":"2024-09-12T22:51:06.342744+0000","last_peered":"2024-09-12T22:51:06.342744+0000","last_clean":"2024-09-12T22:51:06.342744+0000","last_became_active":"2024-09-12T22:51:01.700292+0000","last_became_peered":"2024-09-12T22:51:01.700292+0000","last_unstale":"2024-09-12T22:51:06.342744+0000","last_undegraded":"2024-09-12T22:51:06.342744+0000","last_fullsized":"2024-09-12T22:51:06.342744+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:25.931698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":26700,"num_write":399,"num_write_kb":55331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"63'114","reported_seq":267,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343600+0000","last_change":"2024-09-12T22:50:55.852342+0000","last_active":"2024-09-12T22:51:06.343600+0000","last_peered":"2024-09-12T22:51:06.343600+0000","last_clean":"2024-09-12T22:51:06.343600+0000","last_became_active":"2024-09-12T22:50:55.851975+0000","last_became_peered":"2024-09-12T22:50:55.851975+0000","last_unstale":"2024-09-12T22:51:06.343600+0000","last_undegraded":"2024-09-12T22:51:06.343600+0000","last_fullsized":"2024-09-12T22:51:06.343600+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:42.555311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":1201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723698+0000","last_change":"2024-09-12T22:50:52.857531+0000","last_active":"2024-09-12T22:51:05.723698+0000","last_peered":"2024-09-12T22:51:05.723698+0000","last_clean":"2024-09-12T22:51:05.723698+0000","last_became_active":"2024-09-12T22:50:52.856757+0000","last_became_peered":"2024-09-12T22:50:52.856757+0000","last_unstale":"2024-09-12T22:51:05.723698+0000","last_undegraded":"2024-09-12T22:51:05.723698+0000","last_fullsized":"2024-09-12T22:51:05.723698+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:14.353873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"61'406","reported_seq":929,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723396+0000","last_change":"2024-09-12T22:50:56.855069+0000","last_active":"2024-09-12T22:51:05.723396+0000","last_peered":"2024-09-12T22:51:05.723396+0000","last_clean":"2024-09-12T22:51:05.723396+0000","last_became_active":"2024-09-12T22:50:56.853376+0000","last_became_peered":"2024-09-12T22:50:56.853376+0000","last_unstale":"2024-09-12T22:51:05.723396+0000","last_undegraded":"2024-09-12T22:51:05.723396+0000","last_fullsized":"2024-09-12T22:51:05.723396+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:43.556932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17112,"num_write":373,"num_write_kb":79947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"61'378","reported_seq":533,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723357+0000","last_change":"2024-09-12T22:50:57.863154+0000","last_active":"2024-09-12T22:51:05.723357+0000","last_peered":"2024-09-12T22:51:05.723357+0000","last_clean":"2024-09-12T22:51:05.723357+0000","last_became_active":"2024-09-12T22:50:57.861280+0000","last_became_peered":"2024-09-12T22:50:57.861280+0000","last_unstale":"2024-09-12T22:51:05.723357+0000","last_undegraded":"2024-09-12T22:51:05.723357+0000","last_fullsized":"2024-09-12T22:51:05.723357+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:13.015760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15048,"num_write":339,"num_write_kb":35238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"63'249","reported_seq":391,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723315+0000","last_change":"2024-09-12T22:50:55.849742+0000","last_active":"2024-09-12T22:51:05.723315+0000","last_peered":"2024-09-12T22:51:05.723315+0000","last_clean":"2024-09-12T22:51:05.723315+0000","last_became_active":"2024-09-12T22:50:55.849531+0000","last_became_peered":"2024-09-12T22:50:55.849531+0000","last_unstale":"2024-09-12T22:51:05.723315+0000","last_undegraded":"2024-09-12T22:51:05.723315+0000","last_fullsized":"2024-09-12T22:51:05.723315+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:32.676988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8461053,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":8364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8456257,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"61'405","reported_seq":569,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342826+0000","last_change":"2024-09-12T22:48:05.176779+0000","last_active":"2024-09-12T22:51:06.342826+0000","last_peered":"2024-09-12T22:51:06.342826+0000","last_clean":"2024-09-12T22:51:06.342826+0000","last_became_active":"2024-09-12T22:48:05.176344+0000","last_became_peered":"2024-09-12T22:48:05.176344+0000","last_unstale":"2024-09-12T22:51:06.342826+0000","last_undegraded":"2024-09-12T22:51:06.342826+0000","last_fullsized":"2024-09-12T22:51:06.342826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:35.645286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":25018,"num_write":372,"num_write_kb":42936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"61'85","reported_seq":236,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724390+0000","last_change":"2024-09-12T22:50:52.905108+0000","last_active":"2024-09-12T22:51:05.724390+0000","last_peered":"2024-09-12T22:51:05.724390+0000","last_clean":"2024-09-12T22:51:05.724390+0000","last_became_active":"2024-09-12T22:50:52.861594+0000","last_became_peered":"2024-09-12T22:50:52.861594+0000","last_unstale":"2024-09-12T22:51:05.724390+0000","last_undegraded":"2024-09-12T22:51:05.724390+0000","last_fullsized":"2024-09-12T22:51:05.724390+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:49.196178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"61'213","reported_seq":338,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723895+0000","last_change":"2024-09-12T22:50:55.852154+0000","last_active":"2024-09-12T22:51:05.723895+0000","last_peered":"2024-09-12T22:51:05.723895+0000","last_clean":"2024-09-12T22:51:05.723895+0000","last_became_active":"2024-09-12T22:50:55.851798+0000","last_became_peered":"2024-09-12T22:50:55.851798+0000","last_unstale":"2024-09-12T22:51:05.723895+0000","last_undegraded":"2024-09-12T22:51:05.723895+0000","last_fullsized":"2024-09-12T22:51:05.723895+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:03:29.463409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":4171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"61'478","reported_seq":1107,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342630+0000","last_change":"2024-09-12T22:50:56.856443+0000","last_active":"2024-09-12T22:51:06.342630+0000","last_peered":"2024-09-12T22:51:06.342630+0000","last_clean":"2024-09-12T22:51:06.342630+0000","last_became_active":"2024-09-12T22:50:56.855150+0000","last_became_peered":"2024-09-12T22:50:56.855150+0000","last_unstale":"2024-09-12T22:51:06.342630+0000","last_undegraded":"2024-09-12T22:51:06.342630+0000","last_fullsized":"2024-09-12T22:51:06.342630+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:11.194706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":41320,"num_write":445,"num_write_kb":84826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":209,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"61'55","reported_seq":201,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343774+0000","last_change":"2024-09-12T22:50:52.859702+0000","last_active":"2024-09-12T22:51:06.343774+0000","last_peered":"2024-09-12T22:51:06.343774+0000","last_clean":"2024-09-12T22:51:06.343774+0000","last_became_active":"2024-09-12T22:50:52.859296+0000","last_became_peered":"2024-09-12T22:50:52.859296+0000","last_unstale":"2024-09-12T22:51:06.343774+0000","last_undegraded":"2024-09-12T22:51:06.343774+0000","last_fullsized":"2024-09-12T22:51:06.343774+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:14.180904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"61'447","reported_seq":634,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342672+0000","last_change":"2024-09-12T22:48:05.169648+0000","last_active":"2024-09-12T22:51:06.342672+0000","last_peered":"2024-09-12T22:51:06.342672+0000","last_clean":"2024-09-12T22:51:06.342672+0000","last_became_active":"2024-09-12T22:48:05.168356+0000","last_became_peered":"2024-09-12T22:48:05.168356+0000","last_unstale":"2024-09-12T22:51:06.342672+0000","last_undegraded":"2024-09-12T22:51:06.342672+0000","last_fullsized":"2024-09-12T22:51:06.342672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:52.341512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25877,"num_write":417,"num_write_kb":39269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"61'371","reported_seq":888,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724516+0000","last_change":"2024-09-12T22:51:02.709645+0000","last_active":"2024-09-12T22:51:05.724516+0000","last_peered":"2024-09-12T22:51:05.724516+0000","last_clean":"2024-09-12T22:51:05.724516+0000","last_became_active":"2024-09-12T22:51:02.708091+0000","last_became_peered":"2024-09-12T22:51:02.708091+0000","last_unstale":"2024-09-12T22:51:05.724516+0000","last_undegraded":"2024-09-12T22:51:05.724516+0000","last_fullsized":"2024-09-12T22:51:05.724516+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:13:37.634120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20950,"num_write":339,"num_write_kb":39207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"61'601","reported_seq":740,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342822+0000","last_change":"2024-09-12T22:48:04.169111+0000","last_active":"2024-09-12T22:51:06.342822+0000","last_peered":"2024-09-12T22:51:06.342822+0000","last_clean":"2024-09-12T22:51:06.342822+0000","last_became_active":"2024-09-12T22:48:04.168743+0000","last_became_peered":"2024-09-12T22:48:04.168743+0000","last_unstale":"2024-09-12T22:51:06.342822+0000","last_undegraded":"2024-09-12T22:51:06.342822+0000","last_fullsized":"2024-09-12T22:51:06.342822+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:43.709660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":535,"num_write_kb":8445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"61'438","reported_seq":978,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342401+0000","last_change":"2024-09-12T22:50:57.863618+0000","last_active":"2024-09-12T22:51:06.342401+0000","last_peered":"2024-09-12T22:51:06.342401+0000","last_clean":"2024-09-12T22:51:06.342401+0000","last_became_active":"2024-09-12T22:50:57.861695+0000","last_became_peered":"2024-09-12T22:50:57.861695+0000","last_unstale":"2024-09-12T22:51:06.342401+0000","last_undegraded":"2024-09-12T22:51:06.342401+0000","last_fullsized":"2024-09-12T22:51:06.342401+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:08:37.272462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":16921,"num_write":411,"num_write_kb":146790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"61'185","reported_seq":337,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342787+0000","last_change":"2024-09-12T22:50:55.853288+0000","last_active":"2024-09-12T22:51:06.342787+0000","last_peered":"2024-09-12T22:51:06.342787+0000","last_clean":"2024-09-12T22:51:06.342787+0000","last_became_active":"2024-09-12T22:50:55.852796+0000","last_became_peered":"2024-09-12T22:50:55.852796+0000","last_unstale":"2024-09-12T22:51:06.342787+0000","last_undegraded":"2024-09-12T22:51:06.342787+0000","last_fullsized":"2024-09-12T22:51:06.342787+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:06:03.266907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"61'386","reported_seq":886,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724136+0000","last_change":"2024-09-12T22:51:01.702122+0000","last_active":"2024-09-12T22:51:05.724136+0000","last_peered":"2024-09-12T22:51:05.724136+0000","last_clean":"2024-09-12T22:51:05.724136+0000","last_became_active":"2024-09-12T22:51:01.701006+0000","last_became_peered":"2024-09-12T22:51:01.701006+0000","last_unstale":"2024-09-12T22:51:05.724136+0000","last_undegraded":"2024-09-12T22:51:05.724136+0000","last_fullsized":"2024-09-12T22:51:05.724136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:44.083029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":21487,"num_write":344,"num_write_kb":72645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"61'180","reported_seq":319,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723786+0000","last_change":"2024-09-12T22:48:04.174205+0000","last_active":"2024-09-12T22:51:05.723786+0000","last_peered":"2024-09-12T22:51:05.723786+0000","last_clean":"2024-09-12T22:51:05.723786+0000","last_became_active":"2024-09-12T22:48:04.173902+0000","last_became_peered":"2024-09-12T22:48:04.173902+0000","last_unstale":"2024-09-12T22:51:05.723786+0000","last_undegraded":"2024-09-12T22:51:05.723786+0000","last_fullsized":"2024-09-12T22:51:05.723786+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:43:39.709214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":12355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"61'396","reported_seq":552,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723907+0000","last_change":"2024-09-12T22:48:05.172917+0000","last_active":"2024-09-12T22:51:05.723907+0000","last_peered":"2024-09-12T22:51:05.723907+0000","last_clean":"2024-09-12T22:51:05.723907+0000","last_became_active":"2024-09-12T22:48:05.172493+0000","last_became_peered":"2024-09-12T22:48:05.172493+0000","last_unstale":"2024-09-12T22:51:05.723907+0000","last_undegraded":"2024-09-12T22:51:05.723907+0000","last_fullsized":"2024-09-12T22:51:05.723907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:35.645286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9980,"num_write":370,"num_write_kb":80321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"61'64","reported_seq":215,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723864+0000","last_change":"2024-09-12T22:50:52.884955+0000","last_active":"2024-09-12T22:51:05.723864+0000","last_peered":"2024-09-12T22:51:05.723864+0000","last_clean":"2024-09-12T22:51:05.723864+0000","last_became_active":"2024-09-12T22:50:52.858938+0000","last_became_peered":"2024-09-12T22:50:52.858938+0000","last_unstale":"2024-09-12T22:51:05.723864+0000","last_undegraded":"2024-09-12T22:51:05.723864+0000","last_fullsized":"2024-09-12T22:51:05.723864+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:24.405738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"61'370","reported_seq":515,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723307+0000","last_change":"2024-09-12T22:50:59.705667+0000","last_active":"2024-09-12T22:51:05.723307+0000","last_peered":"2024-09-12T22:51:05.723307+0000","last_clean":"2024-09-12T22:51:05.723307+0000","last_became_active":"2024-09-12T22:50:59.704074+0000","last_became_peered":"2024-09-12T22:50:59.704074+0000","last_unstale":"2024-09-12T22:51:05.723307+0000","last_undegraded":"2024-09-12T22:51:05.723307+0000","last_fullsized":"2024-09-12T22:51:05.723307+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:59.243155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16468,"num_write":341,"num_write_kb":50344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"61'187","reported_seq":321,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723342+0000","last_change":"2024-09-12T22:50:55.851804+0000","last_active":"2024-09-12T22:51:05.723342+0000","last_peered":"2024-09-12T22:51:05.723342+0000","last_clean":"2024-09-12T22:51:05.723342+0000","last_became_active":"2024-09-12T22:50:55.851467+0000","last_became_peered":"2024-09-12T22:50:55.851467+0000","last_unstale":"2024-09-12T22:51:05.723342+0000","last_undegraded":"2024-09-12T22:51:05.723342+0000","last_fullsized":"2024-09-12T22:51:05.723342+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:05.608780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"61'438","reported_seq":636,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723016+0000","last_change":"2024-09-12T22:50:59.706857+0000","last_active":"2024-09-12T22:51:05.723016+0000","last_peered":"2024-09-12T22:51:05.723016+0000","last_clean":"2024-09-12T22:51:05.723016+0000","last_became_active":"2024-09-12T22:50:59.703786+0000","last_became_peered":"2024-09-12T22:50:59.703786+0000","last_unstale":"2024-09-12T22:51:05.723016+0000","last_undegraded":"2024-09-12T22:51:05.723016+0000","last_fullsized":"2024-09-12T22:51:05.723016+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:52:45.535138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":38460,"num_write":412,"num_write_kb":96626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"61'185","reported_seq":342,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724254+0000","last_change":"2024-09-12T22:50:55.853065+0000","last_active":"2024-09-12T22:51:05.724254+0000","last_peered":"2024-09-12T22:51:05.724254+0000","last_clean":"2024-09-12T22:51:05.724254+0000","last_became_active":"2024-09-12T22:50:55.852654+0000","last_became_peered":"2024-09-12T22:50:55.852654+0000","last_unstale":"2024-09-12T22:51:05.724254+0000","last_undegraded":"2024-09-12T22:51:05.724254+0000","last_fullsized":"2024-09-12T22:51:05.724254+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:17.101030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":12349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"61'418","reported_seq":599,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723714+0000","last_change":"2024-09-12T22:48:05.171815+0000","last_active":"2024-09-12T22:51:05.723714+0000","last_peered":"2024-09-12T22:51:05.723714+0000","last_clean":"2024-09-12T22:51:05.723714+0000","last_became_active":"2024-09-12T22:48:05.171361+0000","last_became_peered":"2024-09-12T22:48:05.171361+0000","last_unstale":"2024-09-12T22:51:05.723714+0000","last_undegraded":"2024-09-12T22:51:05.723714+0000","last_fullsized":"2024-09-12T22:51:05.723714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:28.873036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":27427,"num_write":388,"num_write_kb":67745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"61'159","reported_seq":285,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724366+0000","last_change":"2024-09-12T22:50:55.852290+0000","last_active":"2024-09-12T22:51:05.724366+0000","last_peered":"2024-09-12T22:51:05.724366+0000","last_clean":"2024-09-12T22:51:05.724366+0000","last_became_active":"2024-09-12T22:50:55.851948+0000","last_became_peered":"2024-09-12T22:50:55.851948+0000","last_unstale":"2024-09-12T22:51:05.724366+0000","last_undegraded":"2024-09-12T22:51:05.724366+0000","last_fullsized":"2024-09-12T22:51:05.724366+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:14.260183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"61'479","reported_seq":652,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723053+0000","last_change":"2024-09-12T22:51:03.707091+0000","last_active":"2024-09-12T22:51:05.723053+0000","last_peered":"2024-09-12T22:51:05.723053+0000","last_clean":"2024-09-12T22:51:05.723053+0000","last_became_active":"2024-09-12T22:51:03.704137+0000","last_became_peered":"2024-09-12T22:51:03.704137+0000","last_unstale":"2024-09-12T22:51:05.723053+0000","last_undegraded":"2024-09-12T22:51:05.723053+0000","last_fullsized":"2024-09-12T22:51:05.723053+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:27:47.351934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":26793,"num_write":459,"num_write_kb":138325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"61'49","reported_seq":200,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343704+0000","last_change":"2024-09-12T22:50:52.903138+0000","last_active":"2024-09-12T22:51:06.343704+0000","last_peered":"2024-09-12T22:51:06.343704+0000","last_clean":"2024-09-12T22:51:06.343704+0000","last_became_active":"2024-09-12T22:50:52.859983+0000","last_became_peered":"2024-09-12T22:50:52.859983+0000","last_unstale":"2024-09-12T22:51:06.343704+0000","last_undegraded":"2024-09-12T22:51:06.343704+0000","last_fullsized":"2024-09-12T22:51:06.343704+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:59.415555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2742,"num_read_kb":1405479,"num_write":24656,"num_write_kb":4261796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7339,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26737,"ondisk_log_size":26737,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127366156,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":45,"num_read_kb":1459,"num_write":4460,"num_write_kb":127655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":93806220,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254799872,"data_stored":254732312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5569,"internal_metadata":0},"log_size":6243,"ondisk_log_size":6243,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":67,"seq":287762808837,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150992,"kb_used_data":92924,"kb_used_omap":6,"kb_used_meta":58041,"kb_avail":94220848,"statfs":{"total":96636764160,"available":96482148352,"internally_reserved":0,"allocated":95154176,"data_stored":94739479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7164,"internal_metadata":59433988},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738410,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":169456,"kb_used_data":75864,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94202384,"statfs":{"total":96636764160,"available":96463241216,"internally_reserved":0,"allocated":77684736,"data_stored":77299268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738412,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":172716,"kb_used_data":83284,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94199124,"statfs":{"total":96636764160,"available":96459902976,"internally_reserved":0,"allocated":85282816,"data_stored":84886443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83980288,"data_stored":83958707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":76972032,"data_stored":76961881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":93847552,"data_stored":93811724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5569,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:51:11.610 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:51:11.938 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:51:11.938 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":81,"fsid":"5714c6a5-034c-4330-a57b-d22492ad8e43","created":"2024-09-12T22:47:43.881551+0000","modified":"2024-09-12T22:51:05.718993+0000","last_up_change":"2024-09-12T22:50:51.815832+0000","last_in_change":"2024-09-12T22:47:44.690260+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:47:54.168813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:47:58.920007+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:48:03.033410+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:48:03.489928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ed48fb2-48c2-4ecb-9306-372a05b08cee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6801","nonce":1747255146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6803","nonce":1747255146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6807","nonce":1747255146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6805","nonce":1747255146}]},"public_addr":"172.21.15.87:6801/1747255146","cluster_addr":"172.21.15.87:6803/1747255146","heartbeat_back_addr":"172.21.15.87:6807/1747255146","heartbeat_front_addr":"172.21.15.87:6805/1747255146","state":["exists","up"]},{"osd":1,"uuid":"af934313-a6b4-4e15-9818-6fc3fb71b949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6801","nonce":1159429503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6803","nonce":1159429503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6807","nonce":1159429503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6805","nonce":1159429503}]},"public_addr":"172.21.15.99:6801/1159429503","cluster_addr":"172.21.15.99:6803/1159429503","heartbeat_back_addr":"172.21.15.99:6807/1159429503","heartbeat_front_addr":"172.21.15.99:6805/1159429503","state":["exists","up"]},{"osd":2,"uuid":"185ee2bd-8c37-4de1-b6ef-2988144d1470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":22,"up_from":67,"up_thru":78,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":448789353},{"type":"v1","addr":"172.21.15.117:6801","nonce":448789353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":448789353},{"type":"v1","addr":"172.21.15.117:6803","nonce":448789353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":448789353},{"type":"v1","addr":"172.21.15.117:6807","nonce":448789353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":448789353},{"type":"v1","addr":"172.21.15.117:6805","nonce":448789353}]},"public_addr":"172.21.15.117:6801/448789353","cluster_addr":"172.21.15.117:6803/448789353","heartbeat_back_addr":"172.21.15.117:6807/448789353","heartbeat_front_addr":"172.21.15.117:6805/448789353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:47:51.816709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:47:51.376989+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:47:51.833489+0000","dead_epoch":22}],"pg_upmap":[{"pgid":"3.1e","osds":[0,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:51:12.953 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T22:51:12.953 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T22:51:13.094 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T22:51:13.094 INFO:teuthology.orchestra.run.smithi066.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T22:51:13.094 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T22:51:13.106 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T22:51:13.396 INFO:teuthology.orchestra.run.smithi066.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T22:51:13.409 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T22:51:13.409 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T22:51:13.537 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T22:51:13.537 INFO:teuthology.orchestra.run.smithi066.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T22:51:13.537 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T22:51:13.548 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T22:51:13.836 INFO:teuthology.orchestra.run.smithi066.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T22:51:13.850 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T22:51:13.850 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T22:51:13.977 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T22:51:13.978 INFO:teuthology.orchestra.run.smithi066.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-12T22:51:13.978 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T22:51:13.989 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T22:51:14.278 INFO:teuthology.orchestra.run.smithi066.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T22:51:14.291 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:51:14.584 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:51:14.586 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-09-12T22:51:14.595 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2024-09-12T22:51:14.177566+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127956543,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":2923,"num_read_kb":1407056,"num_write":29321,"num_write_kb":4392913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7366,"num_bytes_recovered":93806220,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33140,"ondisk_log_size":33140,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":493164,"kb_used_data":252072,"kb_used_omap":10,"kb_used_meta":241013,"kb_avail":282622356,"statfs":{"total":289910292480,"available":289405292544,"internally_reserved":0,"allocated":258121728,"data_stored":256925190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10354,"internal_metadata":246798222},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1276,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1835,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.457681"},"pg_stats":[{"pgid":"4.3f","version":"61'404","reported_seq":563,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724420+0000","last_change":"2024-09-12T22:48:05.174190+0000","last_active":"2024-09-12T22:51:05.724420+0000","last_peered":"2024-09-12T22:51:05.724420+0000","last_clean":"2024-09-12T22:51:05.724420+0000","last_became_active":"2024-09-12T22:48:05.172964+0000","last_became_peered":"2024-09-12T22:48:05.172964+0000","last_unstale":"2024-09-12T22:51:05.724420+0000","last_undegraded":"2024-09-12T22:51:05.724420+0000","last_fullsized":"2024-09-12T22:51:05.724420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:49.868891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9582,"num_write":371,"num_write_kb":42180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"61'425","reported_seq":633,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724097+0000","last_change":"2024-09-12T22:48:05.173045+0000","last_active":"2024-09-12T22:51:05.724097+0000","last_peered":"2024-09-12T22:51:05.724097+0000","last_clean":"2024-09-12T22:51:05.724097+0000","last_became_active":"2024-09-12T22:48:05.172684+0000","last_became_peered":"2024-09-12T22:48:05.172684+0000","last_unstale":"2024-09-12T22:51:05.724097+0000","last_undegraded":"2024-09-12T22:51:05.724097+0000","last_fullsized":"2024-09-12T22:51:05.724097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:51.360504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":40466,"num_write":394,"num_write_kb":96045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"61'385","reported_seq":516,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723911+0000","last_change":"2024-09-12T22:51:00.703306+0000","last_active":"2024-09-12T22:51:05.723911+0000","last_peered":"2024-09-12T22:51:05.723911+0000","last_clean":"2024-09-12T22:51:05.723911+0000","last_became_active":"2024-09-12T22:51:00.700490+0000","last_became_peered":"2024-09-12T22:51:00.700490+0000","last_unstale":"2024-09-12T22:51:05.723911+0000","last_undegraded":"2024-09-12T22:51:05.723911+0000","last_fullsized":"2024-09-12T22:51:05.723911+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:16.055859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":7348,"num_write":352,"num_write_kb":34517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"61'395","reported_seq":563,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723474+0000","last_change":"2024-09-12T22:51:02.711764+0000","last_active":"2024-09-12T22:51:05.723474+0000","last_peered":"2024-09-12T22:51:05.723474+0000","last_clean":"2024-09-12T22:51:05.723474+0000","last_became_active":"2024-09-12T22:51:02.708216+0000","last_became_peered":"2024-09-12T22:51:02.708216+0000","last_unstale":"2024-09-12T22:51:05.723474+0000","last_undegraded":"2024-09-12T22:51:05.723474+0000","last_fullsized":"2024-09-12T22:51:05.723474+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:24.442976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":25803,"num_write":361,"num_write_kb":71646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"61'410","reported_seq":573,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723888+0000","last_change":"2024-09-12T22:48:05.170306+0000","last_active":"2024-09-12T22:51:05.723888+0000","last_peered":"2024-09-12T22:51:05.723888+0000","last_clean":"2024-09-12T22:51:05.723888+0000","last_became_active":"2024-09-12T22:48:05.169940+0000","last_became_peered":"2024-09-12T22:48:05.169940+0000","last_unstale":"2024-09-12T22:51:05.723888+0000","last_undegraded":"2024-09-12T22:51:05.723888+0000","last_fullsized":"2024-09-12T22:51:05.723888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:52.341512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":20544,"num_write":387,"num_write_kb":55745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"61'384","reported_seq":499,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723190+0000","last_change":"2024-09-12T22:51:03.706817+0000","last_active":"2024-09-12T22:51:05.723190+0000","last_peered":"2024-09-12T22:51:05.723190+0000","last_clean":"2024-09-12T22:51:05.723190+0000","last_became_active":"2024-09-12T22:51:03.704293+0000","last_became_peered":"2024-09-12T22:51:03.704293+0000","last_unstale":"2024-09-12T22:51:05.723190+0000","last_undegraded":"2024-09-12T22:51:05.723190+0000","last_fullsized":"2024-09-12T22:51:05.723190+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:07.148926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5069,"num_write":355,"num_write_kb":38430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"61'461","reported_seq":656,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723091+0000","last_change":"2024-09-12T22:50:56.858810+0000","last_active":"2024-09-12T22:51:05.723091+0000","last_peered":"2024-09-12T22:51:05.723091+0000","last_clean":"2024-09-12T22:51:05.723091+0000","last_became_active":"2024-09-12T22:50:56.856720+0000","last_became_peered":"2024-09-12T22:50:56.856720+0000","last_unstale":"2024-09-12T22:51:05.723091+0000","last_undegraded":"2024-09-12T22:51:05.723091+0000","last_fullsized":"2024-09-12T22:51:05.723091+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:21.599293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":30574,"num_write":435,"num_write_kb":92996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"61'385","reported_seq":518,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722895+0000","last_change":"2024-09-12T22:51:00.703157+0000","last_active":"2024-09-12T22:51:05.722895+0000","last_peered":"2024-09-12T22:51:05.722895+0000","last_clean":"2024-09-12T22:51:05.722895+0000","last_became_active":"2024-09-12T22:51:00.700472+0000","last_became_peered":"2024-09-12T22:51:00.700472+0000","last_unstale":"2024-09-12T22:51:05.722895+0000","last_undegraded":"2024-09-12T22:51:05.722895+0000","last_fullsized":"2024-09-12T22:51:05.722895+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:07.616061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9031,"num_write":340,"num_write_kb":84729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"61'435","reported_seq":586,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343543+0000","last_change":"2024-09-12T22:48:05.178445+0000","last_active":"2024-09-12T22:51:06.343543+0000","last_peered":"2024-09-12T22:51:06.343543+0000","last_clean":"2024-09-12T22:51:06.343543+0000","last_became_active":"2024-09-12T22:48:05.177284+0000","last_became_peered":"2024-09-12T22:48:05.177284+0000","last_unstale":"2024-09-12T22:51:06.343543+0000","last_undegraded":"2024-09-12T22:51:06.343543+0000","last_fullsized":"2024-09-12T22:51:06.343543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8316,"num_write":403,"num_write_kb":71851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"61'443","reported_seq":648,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724176+0000","last_change":"2024-09-12T22:48:05.172480+0000","last_active":"2024-09-12T22:51:05.724176+0000","last_peered":"2024-09-12T22:51:05.724176+0000","last_clean":"2024-09-12T22:51:05.724176+0000","last_became_active":"2024-09-12T22:48:05.171686+0000","last_became_peered":"2024-09-12T22:48:05.171686+0000","last_unstale":"2024-09-12T22:51:05.724176+0000","last_undegraded":"2024-09-12T22:51:05.724176+0000","last_fullsized":"2024-09-12T22:51:05.724176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:56.158813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40751,"num_write":407,"num_write_kb":116626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"61'383","reported_seq":509,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723914+0000","last_change":"2024-09-12T22:51:02.712354+0000","last_active":"2024-09-12T22:51:05.723914+0000","last_peered":"2024-09-12T22:51:05.723914+0000","last_clean":"2024-09-12T22:51:05.723914+0000","last_became_active":"2024-09-12T22:51:02.710579+0000","last_became_peered":"2024-09-12T22:51:02.710579+0000","last_unstale":"2024-09-12T22:51:05.723914+0000","last_undegraded":"2024-09-12T22:51:05.723914+0000","last_fullsized":"2024-09-12T22:51:05.723914+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:58:11.483150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5475,"num_write":365,"num_write_kb":63204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"61'366","reported_seq":891,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723891+0000","last_change":"2024-09-12T22:50:58.699684+0000","last_active":"2024-09-12T22:51:05.723891+0000","last_peered":"2024-09-12T22:51:05.723891+0000","last_clean":"2024-09-12T22:51:05.723891+0000","last_became_active":"2024-09-12T22:50:58.698711+0000","last_became_peered":"2024-09-12T22:50:58.698711+0000","last_unstale":"2024-09-12T22:51:05.723891+0000","last_undegraded":"2024-09-12T22:51:05.723891+0000","last_fullsized":"2024-09-12T22:51:05.723891+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:47.507555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":35222,"num_write":342,"num_write_kb":74947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"61'434","reported_seq":622,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723644+0000","last_change":"2024-09-12T22:48:05.171356+0000","last_active":"2024-09-12T22:51:05.723644+0000","last_peered":"2024-09-12T22:51:05.723644+0000","last_clean":"2024-09-12T22:51:05.723644+0000","last_became_active":"2024-09-12T22:48:05.170794+0000","last_became_peered":"2024-09-12T22:48:05.170794+0000","last_unstale":"2024-09-12T22:51:05.723644+0000","last_undegraded":"2024-09-12T22:51:05.723644+0000","last_fullsized":"2024-09-12T22:51:05.723644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:42:56.969660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":19623,"num_write":389,"num_write_kb":83457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"61'432","reported_seq":601,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723150+0000","last_change":"2024-09-12T22:50:58.702236+0000","last_active":"2024-09-12T22:51:05.723150+0000","last_peered":"2024-09-12T22:51:05.723150+0000","last_clean":"2024-09-12T22:51:05.723150+0000","last_became_active":"2024-09-12T22:50:58.700107+0000","last_became_peered":"2024-09-12T22:50:58.700107+0000","last_unstale":"2024-09-12T22:51:05.723150+0000","last_undegraded":"2024-09-12T22:51:05.723150+0000","last_fullsized":"2024-09-12T22:51:05.723150+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:29.112353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":23332,"num_write":401,"num_write_kb":75871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"61'406","reported_seq":573,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723029+0000","last_change":"2024-09-12T22:50:55.852257+0000","last_active":"2024-09-12T22:51:05.723029+0000","last_peered":"2024-09-12T22:51:05.723029+0000","last_clean":"2024-09-12T22:51:05.723029+0000","last_became_active":"2024-09-12T22:50:55.849568+0000","last_became_peered":"2024-09-12T22:50:55.849568+0000","last_unstale":"2024-09-12T22:51:05.723029+0000","last_undegraded":"2024-09-12T22:51:05.723029+0000","last_fullsized":"2024-09-12T22:51:05.723029+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:49.995990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":18162,"num_write":365,"num_write_kb":58919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"61'444","reported_seq":575,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723061+0000","last_change":"2024-09-12T22:51:01.704325+0000","last_active":"2024-09-12T22:51:05.723061+0000","last_peered":"2024-09-12T22:51:05.723061+0000","last_clean":"2024-09-12T22:51:05.723061+0000","last_became_active":"2024-09-12T22:51:01.700744+0000","last_became_peered":"2024-09-12T22:51:01.700744+0000","last_unstale":"2024-09-12T22:51:05.723061+0000","last_undegraded":"2024-09-12T22:51:05.723061+0000","last_fullsized":"2024-09-12T22:51:05.723061+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:00.747671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":410,"num_write_kb":63144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"61'443","reported_seq":617,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343836+0000","last_change":"2024-09-12T22:48:05.178721+0000","last_active":"2024-09-12T22:51:06.343836+0000","last_peered":"2024-09-12T22:51:06.343836+0000","last_clean":"2024-09-12T22:51:06.343836+0000","last_became_active":"2024-09-12T22:48:05.177965+0000","last_became_peered":"2024-09-12T22:48:05.177965+0000","last_unstale":"2024-09-12T22:51:06.343836+0000","last_undegraded":"2024-09-12T22:51:06.343836+0000","last_fullsized":"2024-09-12T22:51:06.343836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":14687,"num_write":408,"num_write_kb":80026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"61'439","reported_seq":665,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724329+0000","last_change":"2024-09-12T22:48:05.171053+0000","last_active":"2024-09-12T22:51:05.724329+0000","last_peered":"2024-09-12T22:51:05.724329+0000","last_clean":"2024-09-12T22:51:05.724329+0000","last_became_active":"2024-09-12T22:48:05.170578+0000","last_became_peered":"2024-09-12T22:48:05.170578+0000","last_unstale":"2024-09-12T22:51:05.724329+0000","last_undegraded":"2024-09-12T22:51:05.724329+0000","last_fullsized":"2024-09-12T22:51:05.724329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:58.991752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":47063,"num_write":400,"num_write_kb":100535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"61'444","reported_seq":661,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343326+0000","last_change":"2024-09-12T22:48:05.177369+0000","last_active":"2024-09-12T22:51:06.343326+0000","last_peered":"2024-09-12T22:51:06.343326+0000","last_clean":"2024-09-12T22:51:06.343326+0000","last_became_active":"2024-09-12T22:48:05.176680+0000","last_became_peered":"2024-09-12T22:48:05.176680+0000","last_unstale":"2024-09-12T22:51:06.343326+0000","last_undegraded":"2024-09-12T22:51:06.343326+0000","last_fullsized":"2024-09-12T22:51:06.343326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":42758,"num_write":403,"num_write_kb":67827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"61'433","reported_seq":570,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723656+0000","last_change":"2024-09-12T22:51:02.711577+0000","last_active":"2024-09-12T22:51:05.723656+0000","last_peered":"2024-09-12T22:51:05.723656+0000","last_clean":"2024-09-12T22:51:05.723656+0000","last_became_active":"2024-09-12T22:51:02.708090+0000","last_became_peered":"2024-09-12T22:51:02.708090+0000","last_unstale":"2024-09-12T22:51:05.723656+0000","last_undegraded":"2024-09-12T22:51:05.723656+0000","last_fullsized":"2024-09-12T22:51:05.723656+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:32.441902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":10750,"num_write":397,"num_write_kb":34708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"61'413","reported_seq":588,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723473+0000","last_change":"2024-09-12T22:50:58.702132+0000","last_active":"2024-09-12T22:51:05.723473+0000","last_peered":"2024-09-12T22:51:05.723473+0000","last_clean":"2024-09-12T22:51:05.723473+0000","last_became_active":"2024-09-12T22:50:58.699982+0000","last_became_peered":"2024-09-12T22:50:58.699982+0000","last_unstale":"2024-09-12T22:51:05.723473+0000","last_undegraded":"2024-09-12T22:51:05.723473+0000","last_fullsized":"2024-09-12T22:51:05.723473+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:03.458952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":25621,"num_write":385,"num_write_kb":63908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"61'462","reported_seq":1066,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723490+0000","last_change":"2024-09-12T22:50:58.701216+0000","last_active":"2024-09-12T22:51:05.723490+0000","last_peered":"2024-09-12T22:51:05.723490+0000","last_clean":"2024-09-12T22:51:05.723490+0000","last_became_active":"2024-09-12T22:50:58.700047+0000","last_became_peered":"2024-09-12T22:50:58.700047+0000","last_unstale":"2024-09-12T22:51:05.723490+0000","last_undegraded":"2024-09-12T22:51:05.723490+0000","last_fullsized":"2024-09-12T22:51:05.723490+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:51.010136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28920,"num_write":428,"num_write_kb":76277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"61'413","reported_seq":949,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342456+0000","last_change":"2024-09-12T22:50:57.861973+0000","last_active":"2024-09-12T22:51:06.342456+0000","last_peered":"2024-09-12T22:51:06.342456+0000","last_clean":"2024-09-12T22:51:06.342456+0000","last_became_active":"2024-09-12T22:50:57.860819+0000","last_became_peered":"2024-09-12T22:50:57.860819+0000","last_unstale":"2024-09-12T22:51:06.342456+0000","last_undegraded":"2024-09-12T22:51:06.342456+0000","last_fullsized":"2024-09-12T22:51:06.342456+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":14661,"num_write":381,"num_write_kb":72596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"61'475","reported_seq":680,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723273+0000","last_change":"2024-09-12T22:48:05.172794+0000","last_active":"2024-09-12T22:51:05.723273+0000","last_peered":"2024-09-12T22:51:05.723273+0000","last_clean":"2024-09-12T22:51:05.723273+0000","last_became_active":"2024-09-12T22:48:05.172437+0000","last_became_peered":"2024-09-12T22:48:05.172437+0000","last_unstale":"2024-09-12T22:51:05.723273+0000","last_undegraded":"2024-09-12T22:51:05.723273+0000","last_fullsized":"2024-09-12T22:51:05.723273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:54:44.278646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":32397,"num_write":452,"num_write_kb":105406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"61'413","reported_seq":963,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724480+0000","last_change":"2024-09-12T22:51:02.709686+0000","last_active":"2024-09-12T22:51:05.724480+0000","last_peered":"2024-09-12T22:51:05.724480+0000","last_clean":"2024-09-12T22:51:05.724480+0000","last_became_active":"2024-09-12T22:51:02.708084+0000","last_became_peered":"2024-09-12T22:51:02.708084+0000","last_unstale":"2024-09-12T22:51:05.724480+0000","last_undegraded":"2024-09-12T22:51:05.724480+0000","last_fullsized":"2024-09-12T22:51:05.724480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:27.765575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4773,"num_write":395,"num_write_kb":21871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"61'453","reported_seq":1028,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343580+0000","last_change":"2024-09-12T22:50:58.700787+0000","last_active":"2024-09-12T22:51:06.343580+0000","last_peered":"2024-09-12T22:51:06.343580+0000","last_clean":"2024-09-12T22:51:06.343580+0000","last_became_active":"2024-09-12T22:50:58.699585+0000","last_became_peered":"2024-09-12T22:50:58.699585+0000","last_unstale":"2024-09-12T22:51:06.343580+0000","last_undegraded":"2024-09-12T22:51:06.343580+0000","last_fullsized":"2024-09-12T22:51:06.343580+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18201,"num_write":409,"num_write_kb":47008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"61'402","reported_seq":571,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723791+0000","last_change":"2024-09-12T22:51:01.704826+0000","last_active":"2024-09-12T22:51:05.723791+0000","last_peered":"2024-09-12T22:51:05.723791+0000","last_clean":"2024-09-12T22:51:05.723791+0000","last_became_active":"2024-09-12T22:51:01.701850+0000","last_became_peered":"2024-09-12T22:51:01.701850+0000","last_unstale":"2024-09-12T22:51:05.723791+0000","last_undegraded":"2024-09-12T22:51:05.723791+0000","last_fullsized":"2024-09-12T22:51:05.723791+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:44:29.380608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":21641,"num_write":372,"num_write_kb":63613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"61'436","reported_seq":1073,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724130+0000","last_change":"2024-09-12T22:50:59.703836+0000","last_active":"2024-09-12T22:51:05.724130+0000","last_peered":"2024-09-12T22:51:05.724130+0000","last_clean":"2024-09-12T22:51:05.724130+0000","last_became_active":"2024-09-12T22:50:59.702766+0000","last_became_peered":"2024-09-12T22:50:59.702766+0000","last_unstale":"2024-09-12T22:51:05.724130+0000","last_undegraded":"2024-09-12T22:51:05.724130+0000","last_fullsized":"2024-09-12T22:51:05.724130+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:52.977617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":65550,"num_write":412,"num_write_kb":134233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"61'393","reported_seq":591,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343200+0000","last_change":"2024-09-12T22:48:05.177176+0000","last_active":"2024-09-12T22:51:06.343200+0000","last_peered":"2024-09-12T22:51:06.343200+0000","last_clean":"2024-09-12T22:51:06.343200+0000","last_became_active":"2024-09-12T22:48:05.176735+0000","last_became_peered":"2024-09-12T22:48:05.176735+0000","last_unstale":"2024-09-12T22:51:06.343200+0000","last_undegraded":"2024-09-12T22:51:06.343200+0000","last_fullsized":"2024-09-12T22:51:06.343200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":36009,"num_write":361,"num_write_kb":71487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"61'456","reported_seq":1019,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723644+0000","last_change":"2024-09-12T22:51:00.699523+0000","last_active":"2024-09-12T22:51:05.723644+0000","last_peered":"2024-09-12T22:51:05.723644+0000","last_clean":"2024-09-12T22:51:05.723644+0000","last_became_active":"2024-09-12T22:51:00.698377+0000","last_became_peered":"2024-09-12T22:51:00.698377+0000","last_unstale":"2024-09-12T22:51:05.723644+0000","last_undegraded":"2024-09-12T22:51:05.723644+0000","last_fullsized":"2024-09-12T22:51:05.723644+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:04:47.810227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4316,"num_write":417,"num_write_kb":34284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"61'440","reported_seq":615,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342621+0000","last_change":"2024-09-12T22:48:05.176878+0000","last_active":"2024-09-12T22:51:06.342621+0000","last_peered":"2024-09-12T22:51:06.342621+0000","last_clean":"2024-09-12T22:51:06.342621+0000","last_became_active":"2024-09-12T22:48:05.176327+0000","last_became_peered":"2024-09-12T22:48:05.176327+0000","last_unstale":"2024-09-12T22:51:06.342621+0000","last_undegraded":"2024-09-12T22:51:06.342621+0000","last_fullsized":"2024-09-12T22:51:06.342621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15052,"num_write":399,"num_write_kb":71703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"61'424","reported_seq":582,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722737+0000","last_change":"2024-09-12T22:51:01.704366+0000","last_active":"2024-09-12T22:51:05.722737+0000","last_peered":"2024-09-12T22:51:05.722737+0000","last_clean":"2024-09-12T22:51:05.722737+0000","last_became_active":"2024-09-12T22:51:01.700878+0000","last_became_peered":"2024-09-12T22:51:01.700878+0000","last_unstale":"2024-09-12T22:51:05.722737+0000","last_undegraded":"2024-09-12T22:51:05.722737+0000","last_fullsized":"2024-09-12T22:51:05.722737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:57.250980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25587,"num_write":397,"num_write_kb":46651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"61'384","reported_seq":545,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724020+0000","last_change":"2024-09-12T22:48:05.171573+0000","last_active":"2024-09-12T22:51:05.724020+0000","last_peered":"2024-09-12T22:51:05.724020+0000","last_clean":"2024-09-12T22:51:05.724020+0000","last_became_active":"2024-09-12T22:48:05.171036+0000","last_became_peered":"2024-09-12T22:48:05.171036+0000","last_unstale":"2024-09-12T22:51:05.724020+0000","last_undegraded":"2024-09-12T22:51:05.724020+0000","last_fullsized":"2024-09-12T22:51:05.724020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:27:07.558853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9715,"num_write":345,"num_write_kb":63048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"61'450","reported_seq":585,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723240+0000","last_change":"2024-09-12T22:50:55.851831+0000","last_active":"2024-09-12T22:51:05.723240+0000","last_peered":"2024-09-12T22:51:05.723240+0000","last_clean":"2024-09-12T22:51:05.723240+0000","last_became_active":"2024-09-12T22:50:55.851443+0000","last_became_peered":"2024-09-12T22:50:55.851443+0000","last_unstale":"2024-09-12T22:51:05.723240+0000","last_undegraded":"2024-09-12T22:51:05.723240+0000","last_fullsized":"2024-09-12T22:51:05.723240+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:25:19.575346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":387,"num_write_kb":8369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"61'389","reported_seq":568,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724238+0000","last_change":"2024-09-12T22:48:05.173585+0000","last_active":"2024-09-12T22:51:05.724238+0000","last_peered":"2024-09-12T22:51:05.724238+0000","last_clean":"2024-09-12T22:51:05.724238+0000","last_became_active":"2024-09-12T22:48:05.172801+0000","last_became_peered":"2024-09-12T22:48:05.172801+0000","last_unstale":"2024-09-12T22:51:05.724238+0000","last_undegraded":"2024-09-12T22:51:05.724238+0000","last_fullsized":"2024-09-12T22:51:05.724238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:45.140060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":21115,"num_write":354,"num_write_kb":59128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"61'60","reported_seq":207,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342963+0000","last_change":"2024-09-12T22:50:52.860336+0000","last_active":"2024-09-12T22:51:06.342963+0000","last_peered":"2024-09-12T22:51:06.342963+0000","last_clean":"2024-09-12T22:51:06.342963+0000","last_became_active":"2024-09-12T22:50:52.859975+0000","last_became_peered":"2024-09-12T22:50:52.859975+0000","last_unstale":"2024-09-12T22:51:06.342963+0000","last_undegraded":"2024-09-12T22:51:06.342963+0000","last_fullsized":"2024-09-12T22:51:06.342963+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"61'433","reported_seq":998,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342484+0000","last_change":"2024-09-12T22:50:57.863647+0000","last_active":"2024-09-12T22:51:06.342484+0000","last_peered":"2024-09-12T22:51:06.342484+0000","last_clean":"2024-09-12T22:51:06.342484+0000","last_became_active":"2024-09-12T22:50:57.861719+0000","last_became_peered":"2024-09-12T22:50:57.861719+0000","last_unstale":"2024-09-12T22:51:06.342484+0000","last_undegraded":"2024-09-12T22:51:06.342484+0000","last_fullsized":"2024-09-12T22:51:06.342484+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17599,"num_write":404,"num_write_kb":59440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"61'63","reported_seq":209,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723521+0000","last_change":"2024-09-12T22:50:52.857615+0000","last_active":"2024-09-12T22:51:05.723521+0000","last_peered":"2024-09-12T22:51:05.723521+0000","last_clean":"2024-09-12T22:51:05.723521+0000","last_became_active":"2024-09-12T22:50:52.857343+0000","last_became_peered":"2024-09-12T22:50:52.857343+0000","last_unstale":"2024-09-12T22:51:05.723521+0000","last_undegraded":"2024-09-12T22:51:05.723521+0000","last_fullsized":"2024-09-12T22:51:05.723521+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:44.095690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"61'407","reported_seq":933,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343525+0000","last_change":"2024-09-12T22:50:55.853362+0000","last_active":"2024-09-12T22:51:06.343525+0000","last_peered":"2024-09-12T22:51:06.343525+0000","last_clean":"2024-09-12T22:51:06.343525+0000","last_became_active":"2024-09-12T22:50:55.851934+0000","last_became_peered":"2024-09-12T22:50:55.851934+0000","last_unstale":"2024-09-12T22:51:06.343525+0000","last_undegraded":"2024-09-12T22:51:06.343525+0000","last_fullsized":"2024-09-12T22:51:06.343525+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":24842,"num_write":378,"num_write_kb":79144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"61'62","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722703+0000","last_change":"2024-09-12T22:50:52.859828+0000","last_active":"2024-09-12T22:51:05.722703+0000","last_peered":"2024-09-12T22:51:05.722703+0000","last_clean":"2024-09-12T22:51:05.722703+0000","last_became_active":"2024-09-12T22:50:52.858911+0000","last_became_peered":"2024-09-12T22:50:52.858911+0000","last_unstale":"2024-09-12T22:51:05.722703+0000","last_undegraded":"2024-09-12T22:51:05.722703+0000","last_fullsized":"2024-09-12T22:51:05.722703+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:44.358340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"61'152","reported_seq":288,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723962+0000","last_change":"2024-09-12T22:50:55.851865+0000","last_active":"2024-09-12T22:51:05.723962+0000","last_peered":"2024-09-12T22:51:05.723962+0000","last_clean":"2024-09-12T22:51:05.723962+0000","last_became_active":"2024-09-12T22:50:55.851050+0000","last_became_peered":"2024-09-12T22:50:55.851050+0000","last_unstale":"2024-09-12T22:51:05.723962+0000","last_undegraded":"2024-09-12T22:51:05.723962+0000","last_fullsized":"2024-09-12T22:51:05.723962+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:31:24.219732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"61'392","reported_seq":890,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723334+0000","last_change":"2024-09-12T22:50:56.855073+0000","last_active":"2024-09-12T22:51:05.723334+0000","last_peered":"2024-09-12T22:51:05.723334+0000","last_clean":"2024-09-12T22:51:05.723334+0000","last_became_active":"2024-09-12T22:50:56.853383+0000","last_became_peered":"2024-09-12T22:50:56.853383+0000","last_unstale":"2024-09-12T22:51:05.723334+0000","last_undegraded":"2024-09-12T22:51:05.723334+0000","last_fullsized":"2024-09-12T22:51:05.723334+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:18.644500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":9675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"61'237","reported_seq":390,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724440+0000","last_change":"2024-09-12T22:50:55.852418+0000","last_active":"2024-09-12T22:51:05.724440+0000","last_peered":"2024-09-12T22:51:05.724440+0000","last_clean":"2024-09-12T22:51:05.724440+0000","last_became_active":"2024-09-12T22:50:55.852034+0000","last_became_peered":"2024-09-12T22:50:55.852034+0000","last_unstale":"2024-09-12T22:51:05.724440+0000","last_undegraded":"2024-09-12T22:51:05.724440+0000","last_fullsized":"2024-09-12T22:51:05.724440+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:47.161147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"61'464","reported_seq":637,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723400+0000","last_change":"2024-09-12T22:48:05.171143+0000","last_active":"2024-09-12T22:51:05.723400+0000","last_peered":"2024-09-12T22:51:05.723400+0000","last_clean":"2024-09-12T22:51:05.723400+0000","last_became_active":"2024-09-12T22:48:05.170374+0000","last_became_peered":"2024-09-12T22:48:05.170374+0000","last_unstale":"2024-09-12T22:51:05.723400+0000","last_undegraded":"2024-09-12T22:51:05.723400+0000","last_fullsized":"2024-09-12T22:51:05.723400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:15.887977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15522,"num_write":440,"num_write_kb":60335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"61'470","reported_seq":606,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723638+0000","last_change":"2024-09-12T22:50:55.852447+0000","last_active":"2024-09-12T22:51:05.723638+0000","last_peered":"2024-09-12T22:51:05.723638+0000","last_clean":"2024-09-12T22:51:05.723638+0000","last_became_active":"2024-09-12T22:50:55.852074+0000","last_became_peered":"2024-09-12T22:50:55.852074+0000","last_unstale":"2024-09-12T22:51:05.723638+0000","last_undegraded":"2024-09-12T22:51:05.723638+0000","last_fullsized":"2024-09-12T22:51:05.723638+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:24.010030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":4267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"61'449","reported_seq":636,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723253+0000","last_change":"2024-09-12T22:51:00.701817+0000","last_active":"2024-09-12T22:51:05.723253+0000","last_peered":"2024-09-12T22:51:05.723253+0000","last_clean":"2024-09-12T22:51:05.723253+0000","last_became_active":"2024-09-12T22:51:00.699592+0000","last_became_peered":"2024-09-12T22:51:00.699592+0000","last_unstale":"2024-09-12T22:51:05.723253+0000","last_undegraded":"2024-09-12T22:51:05.723253+0000","last_fullsized":"2024-09-12T22:51:05.723253+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:11.924779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":36634,"num_write":415,"num_write_kb":84238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"61'52","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723477+0000","last_change":"2024-09-12T22:50:52.857863+0000","last_active":"2024-09-12T22:51:05.723477+0000","last_peered":"2024-09-12T22:51:05.723477+0000","last_clean":"2024-09-12T22:51:05.723477+0000","last_became_active":"2024-09-12T22:50:52.857342+0000","last_became_peered":"2024-09-12T22:50:52.857342+0000","last_unstale":"2024-09-12T22:51:05.723477+0000","last_undegraded":"2024-09-12T22:51:05.723477+0000","last_fullsized":"2024-09-12T22:51:05.723477+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:59.906052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"61'434","reported_seq":1028,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343199+0000","last_change":"2024-09-12T22:50:58.701303+0000","last_active":"2024-09-12T22:51:06.343199+0000","last_peered":"2024-09-12T22:51:06.343199+0000","last_clean":"2024-09-12T22:51:06.343199+0000","last_became_active":"2024-09-12T22:50:58.700178+0000","last_became_peered":"2024-09-12T22:50:58.700178+0000","last_unstale":"2024-09-12T22:51:06.343199+0000","last_undegraded":"2024-09-12T22:51:06.343199+0000","last_fullsized":"2024-09-12T22:51:06.343199+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":39364,"num_write":402,"num_write_kb":59313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"61'194","reported_seq":350,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343354+0000","last_change":"2024-09-12T22:50:55.852827+0000","last_active":"2024-09-12T22:51:06.343354+0000","last_peered":"2024-09-12T22:51:06.343354+0000","last_clean":"2024-09-12T22:51:06.343354+0000","last_became_active":"2024-09-12T22:50:55.852479+0000","last_became_peered":"2024-09-12T22:50:55.852479+0000","last_unstale":"2024-09-12T22:51:06.343354+0000","last_undegraded":"2024-09-12T22:51:06.343354+0000","last_fullsized":"2024-09-12T22:51:06.343354+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"61'457","reported_seq":591,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723790+0000","last_change":"2024-09-12T22:51:03.707374+0000","last_active":"2024-09-12T22:51:05.723790+0000","last_peered":"2024-09-12T22:51:05.723790+0000","last_clean":"2024-09-12T22:51:05.723790+0000","last_became_active":"2024-09-12T22:51:03.704514+0000","last_became_peered":"2024-09-12T22:51:03.704514+0000","last_unstale":"2024-09-12T22:51:05.723790+0000","last_undegraded":"2024-09-12T22:51:05.723790+0000","last_fullsized":"2024-09-12T22:51:05.723790+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:13.942017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10832,"num_write":419,"num_write_kb":34901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"61'106","reported_seq":232,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722915+0000","last_change":"2024-09-12T22:50:55.851086+0000","last_active":"2024-09-12T22:51:05.722915+0000","last_peered":"2024-09-12T22:51:05.722915+0000","last_clean":"2024-09-12T22:51:05.722915+0000","last_became_active":"2024-09-12T22:50:55.850764+0000","last_became_peered":"2024-09-12T22:50:55.850764+0000","last_unstale":"2024-09-12T22:51:05.722915+0000","last_undegraded":"2024-09-12T22:51:05.722915+0000","last_fullsized":"2024-09-12T22:51:05.722915+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:26.058872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"61'431","reported_seq":571,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723616+0000","last_change":"2024-09-12T22:51:02.710383+0000","last_active":"2024-09-12T22:51:05.723616+0000","last_peered":"2024-09-12T22:51:05.723616+0000","last_clean":"2024-09-12T22:51:05.723616+0000","last_became_active":"2024-09-12T22:51:02.707646+0000","last_became_peered":"2024-09-12T22:51:02.707646+0000","last_unstale":"2024-09-12T22:51:05.723616+0000","last_undegraded":"2024-09-12T22:51:05.723616+0000","last_fullsized":"2024-09-12T22:51:05.723616+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:41.956076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":10443,"num_write":392,"num_write_kb":63957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"61'49","reported_seq":195,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723628+0000","last_change":"2024-09-12T22:50:52.857609+0000","last_active":"2024-09-12T22:51:05.723628+0000","last_peered":"2024-09-12T22:51:05.723628+0000","last_clean":"2024-09-12T22:51:05.723628+0000","last_became_active":"2024-09-12T22:50:52.857301+0000","last_became_peered":"2024-09-12T22:50:52.857301+0000","last_unstale":"2024-09-12T22:51:05.723628+0000","last_undegraded":"2024-09-12T22:51:05.723628+0000","last_fullsized":"2024-09-12T22:51:05.723628+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:43.328264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"61'351","reported_seq":475,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723979+0000","last_change":"2024-09-12T22:50:56.855396+0000","last_active":"2024-09-12T22:51:05.723979+0000","last_peered":"2024-09-12T22:51:05.723979+0000","last_clean":"2024-09-12T22:51:05.723979+0000","last_became_active":"2024-09-12T22:50:56.853610+0000","last_became_peered":"2024-09-12T22:50:56.853610+0000","last_unstale":"2024-09-12T22:51:05.723979+0000","last_undegraded":"2024-09-12T22:51:05.723979+0000","last_fullsized":"2024-09-12T22:51:05.723979+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:01.946701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":137,"num_write":315,"num_write_kb":37943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"61'588","reported_seq":727,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723397+0000","last_change":"2024-09-12T22:48:04.174281+0000","last_active":"2024-09-12T22:51:05.723397+0000","last_peered":"2024-09-12T22:51:05.723397+0000","last_clean":"2024-09-12T22:51:05.723397+0000","last_became_active":"2024-09-12T22:48:04.173942+0000","last_became_peered":"2024-09-12T22:48:04.173942+0000","last_unstale":"2024-09-12T22:51:05.723397+0000","last_undegraded":"2024-09-12T22:51:05.723397+0000","last_fullsized":"2024-09-12T22:51:05.723397+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:19:38.546747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":4334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"61'400","reported_seq":561,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343647+0000","last_change":"2024-09-12T22:48:05.178246+0000","last_active":"2024-09-12T22:51:06.343647+0000","last_peered":"2024-09-12T22:51:06.343647+0000","last_clean":"2024-09-12T22:51:06.343647+0000","last_became_active":"2024-09-12T22:48:05.176813+0000","last_became_peered":"2024-09-12T22:48:05.176813+0000","last_unstale":"2024-09-12T22:51:06.343647+0000","last_undegraded":"2024-09-12T22:51:06.343647+0000","last_fullsized":"2024-09-12T22:51:06.343647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":9179,"num_write":363,"num_write_kb":67046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":242,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722613+0000","last_change":"2024-09-12T22:50:52.860243+0000","last_active":"2024-09-12T22:51:05.722613+0000","last_peered":"2024-09-12T22:51:05.722613+0000","last_clean":"2024-09-12T22:51:05.722613+0000","last_became_active":"2024-09-12T22:50:52.859754+0000","last_became_peered":"2024-09-12T22:50:52.859754+0000","last_unstale":"2024-09-12T22:51:05.722613+0000","last_undegraded":"2024-09-12T22:51:05.722613+0000","last_fullsized":"2024-09-12T22:51:05.722613+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:55.016634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:55.016634+0000","last_clean_scrub_stamp":"2024-09-12T22:47:55.016634+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:41:30.207577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722981+0000","last_change":"2024-09-12T22:50:52.858727+0000","last_active":"2024-09-12T22:51:05.722981+0000","last_peered":"2024-09-12T22:51:05.722981+0000","last_clean":"2024-09-12T22:51:05.722981+0000","last_became_active":"2024-09-12T22:50:52.857759+0000","last_became_peered":"2024-09-12T22:50:52.857759+0000","last_unstale":"2024-09-12T22:51:05.722981+0000","last_undegraded":"2024-09-12T22:51:05.722981+0000","last_fullsized":"2024-09-12T22:51:05.722981+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:52.160461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"61'506","reported_seq":646,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343127+0000","last_change":"2024-09-12T22:48:04.169704+0000","last_active":"2024-09-12T22:51:06.343127+0000","last_peered":"2024-09-12T22:51:06.343127+0000","last_clean":"2024-09-12T22:51:06.343127+0000","last_became_active":"2024-09-12T22:48:04.169474+0000","last_became_peered":"2024-09-12T22:48:04.169474+0000","last_unstale":"2024-09-12T22:51:06.343127+0000","last_undegraded":"2024-09-12T22:51:06.343127+0000","last_fullsized":"2024-09-12T22:51:06.343127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":444,"num_write_kb":8407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"61'422","reported_seq":595,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723784+0000","last_change":"2024-09-12T22:51:00.700237+0000","last_active":"2024-09-12T22:51:05.723784+0000","last_peered":"2024-09-12T22:51:05.723784+0000","last_clean":"2024-09-12T22:51:05.723784+0000","last_became_active":"2024-09-12T22:51:00.698391+0000","last_became_peered":"2024-09-12T22:51:00.698391+0000","last_unstale":"2024-09-12T22:51:05.723784+0000","last_undegraded":"2024-09-12T22:51:05.723784+0000","last_fullsized":"2024-09-12T22:51:05.723784+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:19.299721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":38484,"num_write":383,"num_write_kb":67099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722904+0000","last_change":"2024-09-12T22:50:52.859530+0000","last_active":"2024-09-12T22:51:05.722904+0000","last_peered":"2024-09-12T22:51:05.722904+0000","last_clean":"2024-09-12T22:51:05.722904+0000","last_became_active":"2024-09-12T22:50:52.858480+0000","last_became_peered":"2024-09-12T22:50:52.858480+0000","last_unstale":"2024-09-12T22:51:05.722904+0000","last_undegraded":"2024-09-12T22:51:05.722904+0000","last_fullsized":"2024-09-12T22:51:05.722904+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:28:23.416675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"61'107","reported_seq":305,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342861+0000","last_change":"2024-09-12T22:50:55.853291+0000","last_active":"2024-09-12T22:51:06.342861+0000","last_peered":"2024-09-12T22:51:06.342861+0000","last_clean":"2024-09-12T22:51:06.342861+0000","last_became_active":"2024-09-12T22:50:55.852965+0000","last_became_peered":"2024-09-12T22:50:55.852965+0000","last_unstale":"2024-09-12T22:51:06.342861+0000","last_undegraded":"2024-09-12T22:51:06.342861+0000","last_fullsized":"2024-09-12T22:51:06.342861+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1463793,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":1459,"num_write":45,"num_write_kb":1459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1463793,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"61'436","reported_seq":618,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724236+0000","last_change":"2024-09-12T22:48:05.171819+0000","last_active":"2024-09-12T22:51:05.724236+0000","last_peered":"2024-09-12T22:51:05.724236+0000","last_clean":"2024-09-12T22:51:05.724236+0000","last_became_active":"2024-09-12T22:48:05.171293+0000","last_became_peered":"2024-09-12T22:48:05.171293+0000","last_unstale":"2024-09-12T22:51:05.724236+0000","last_undegraded":"2024-09-12T22:51:05.724236+0000","last_fullsized":"2024-09-12T22:51:05.724236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:01.401542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":27936,"num_write":401,"num_write_kb":51013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":153,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342981+0000","last_change":"2024-09-12T22:48:02.045209+0000","last_active":"2024-09-12T22:51:06.342981+0000","last_peered":"2024-09-12T22:51:06.342981+0000","last_clean":"2024-09-12T22:51:06.342981+0000","last_became_active":"2024-09-12T22:48:00.042007+0000","last_became_peered":"2024-09-12T22:48:00.042007+0000","last_unstale":"2024-09-12T22:51:06.342981+0000","last_undegraded":"2024-09-12T22:51:06.342981+0000","last_fullsized":"2024-09-12T22:51:06.342981+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036893100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"61'357","reported_seq":511,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723507+0000","last_change":"2024-09-12T22:50:55.852384+0000","last_active":"2024-09-12T22:51:05.723507+0000","last_peered":"2024-09-12T22:51:05.723507+0000","last_clean":"2024-09-12T22:51:05.723507+0000","last_became_active":"2024-09-12T22:50:55.852029+0000","last_became_peered":"2024-09-12T22:50:55.852029+0000","last_unstale":"2024-09-12T22:51:05.723507+0000","last_undegraded":"2024-09-12T22:51:05.723507+0000","last_fullsized":"2024-09-12T22:51:05.723507+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:59.415555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":8307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"61'343","reported_seq":504,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343650+0000","last_change":"2024-09-12T22:48:05.178865+0000","last_active":"2024-09-12T22:51:06.343650+0000","last_peered":"2024-09-12T22:51:06.343650+0000","last_clean":"2024-09-12T22:51:06.343650+0000","last_became_active":"2024-09-12T22:48:05.178010+0000","last_became_peered":"2024-09-12T22:48:05.178010+0000","last_unstale":"2024-09-12T22:51:06.343650+0000","last_undegraded":"2024-09-12T22:51:06.343650+0000","last_fullsized":"2024-09-12T22:51:06.343650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":6704,"num_write":316,"num_write_kb":42458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":70,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722797+0000","last_change":"2024-09-12T22:50:52.858195+0000","last_active":"2024-09-12T22:51:05.722797+0000","last_peered":"2024-09-12T22:51:05.722797+0000","last_clean":"2024-09-12T22:51:05.722797+0000","last_became_active":"2024-09-12T22:50:52.857746+0000","last_became_peered":"2024-09-12T22:50:52.857746+0000","last_unstale":"2024-09-12T22:51:05.722797+0000","last_undegraded":"2024-09-12T22:51:05.722797+0000","last_fullsized":"2024-09-12T22:51:05.722797+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:10:52.096897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052714799999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"61'78","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723018+0000","last_change":"2024-09-12T22:50:52.858808+0000","last_active":"2024-09-12T22:51:05.723018+0000","last_peered":"2024-09-12T22:51:05.723018+0000","last_clean":"2024-09-12T22:51:05.723018+0000","last_became_active":"2024-09-12T22:50:52.858372+0000","last_became_peered":"2024-09-12T22:50:52.858372+0000","last_unstale":"2024-09-12T22:51:05.723018+0000","last_undegraded":"2024-09-12T22:51:05.723018+0000","last_fullsized":"2024-09-12T22:51:05.723018+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:44.345055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"61'404","reported_seq":615,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343431+0000","last_change":"2024-09-12T22:48:05.177561+0000","last_active":"2024-09-12T22:51:06.343431+0000","last_peered":"2024-09-12T22:51:06.343431+0000","last_clean":"2024-09-12T22:51:06.343431+0000","last_became_active":"2024-09-12T22:48:05.177164+0000","last_became_peered":"2024-09-12T22:48:05.177164+0000","last_unstale":"2024-09-12T22:51:06.343431+0000","last_undegraded":"2024-09-12T22:51:06.343431+0000","last_fullsized":"2024-09-12T22:51:06.343431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":35084,"num_write":365,"num_write_kb":71560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"61'269","reported_seq":395,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723416+0000","last_change":"2024-09-12T22:50:55.850951+0000","last_active":"2024-09-12T22:51:05.723416+0000","last_peered":"2024-09-12T22:51:05.723416+0000","last_clean":"2024-09-12T22:51:05.723416+0000","last_became_active":"2024-09-12T22:50:55.850689+0000","last_became_peered":"2024-09-12T22:50:55.850689+0000","last_unstale":"2024-09-12T22:51:05.723416+0000","last_undegraded":"2024-09-12T22:51:05.723416+0000","last_fullsized":"2024-09-12T22:51:05.723416+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:11:37.856958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":4189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":153,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343524+0000","last_change":"2024-09-12T22:48:02.045324+0000","last_active":"2024-09-12T22:51:06.343524+0000","last_peered":"2024-09-12T22:51:06.343524+0000","last_clean":"2024-09-12T22:51:06.343524+0000","last_became_active":"2024-09-12T22:48:00.042132+0000","last_became_peered":"2024-09-12T22:48:00.042132+0000","last_unstale":"2024-09-12T22:51:06.343524+0000","last_undegraded":"2024-09-12T22:51:06.343524+0000","last_fullsized":"2024-09-12T22:51:06.343524+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047590600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"61'362","reported_seq":851,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723496+0000","last_change":"2024-09-12T22:50:59.708186+0000","last_active":"2024-09-12T22:51:05.723496+0000","last_peered":"2024-09-12T22:51:05.723496+0000","last_clean":"2024-09-12T22:51:05.723496+0000","last_became_active":"2024-09-12T22:50:59.707126+0000","last_became_peered":"2024-09-12T22:50:59.707126+0000","last_unstale":"2024-09-12T22:51:05.723496+0000","last_undegraded":"2024-09-12T22:51:05.723496+0000","last_fullsized":"2024-09-12T22:51:05.723496+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:08:37.272462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":10445,"num_write":331,"num_write_kb":30096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"61'56","reported_seq":196,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343461+0000","last_change":"2024-09-12T22:48:04.169109+0000","last_active":"2024-09-12T22:51:06.343461+0000","last_peered":"2024-09-12T22:51:06.343461+0000","last_clean":"2024-09-12T22:51:06.343461+0000","last_became_active":"2024-09-12T22:48:04.168655+0000","last_became_peered":"2024-09-12T22:48:04.168655+0000","last_unstale":"2024-09-12T22:51:06.343461+0000","last_undegraded":"2024-09-12T22:51:06.343461+0000","last_fullsized":"2024-09-12T22:51:06.343461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724478+0000","last_change":"2024-09-12T22:48:02.045390+0000","last_active":"2024-09-12T22:51:05.724478+0000","last_peered":"2024-09-12T22:51:05.724478+0000","last_clean":"2024-09-12T22:51:05.724478+0000","last_became_active":"2024-09-12T22:48:00.045356+0000","last_became_peered":"2024-09-12T22:48:00.045356+0000","last_unstale":"2024-09-12T22:51:05.724478+0000","last_undegraded":"2024-09-12T22:51:05.724478+0000","last_fullsized":"2024-09-12T22:51:05.724478+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:32.072080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040621599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"61'408","reported_seq":982,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723709+0000","last_change":"2024-09-12T22:50:57.864738+0000","last_active":"2024-09-12T22:51:05.723709+0000","last_peered":"2024-09-12T22:51:05.723709+0000","last_clean":"2024-09-12T22:51:05.723709+0000","last_became_active":"2024-09-12T22:50:57.863486+0000","last_became_peered":"2024-09-12T22:50:57.863486+0000","last_unstale":"2024-09-12T22:51:05.723709+0000","last_undegraded":"2024-09-12T22:51:05.723709+0000","last_fullsized":"2024-09-12T22:51:05.723709+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:06:04.268528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":42311,"num_write":379,"num_write_kb":75412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"61'61","reported_seq":201,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343926+0000","last_change":"2024-09-12T22:48:04.168635+0000","last_active":"2024-09-12T22:51:06.343926+0000","last_peered":"2024-09-12T22:51:06.343926+0000","last_clean":"2024-09-12T22:51:06.343926+0000","last_became_active":"2024-09-12T22:48:04.168244+0000","last_became_peered":"2024-09-12T22:48:04.168244+0000","last_unstale":"2024-09-12T22:51:06.343926+0000","last_undegraded":"2024-09-12T22:51:06.343926+0000","last_fullsized":"2024-09-12T22:51:06.343926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":153,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343679+0000","last_change":"2024-09-12T22:48:02.045428+0000","last_active":"2024-09-12T22:51:06.343679+0000","last_peered":"2024-09-12T22:51:06.343679+0000","last_clean":"2024-09-12T22:51:06.343679+0000","last_became_active":"2024-09-12T22:48:00.040536+0000","last_became_peered":"2024-09-12T22:48:00.040536+0000","last_unstale":"2024-09-12T22:51:06.343679+0000","last_undegraded":"2024-09-12T22:51:06.343679+0000","last_fullsized":"2024-09-12T22:51:06.343679+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057699499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"61'430","reported_seq":991,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342801+0000","last_change":"2024-09-12T22:51:01.701692+0000","last_active":"2024-09-12T22:51:06.342801+0000","last_peered":"2024-09-12T22:51:06.342801+0000","last_clean":"2024-09-12T22:51:06.342801+0000","last_became_active":"2024-09-12T22:51:01.700292+0000","last_became_peered":"2024-09-12T22:51:01.700292+0000","last_unstale":"2024-09-12T22:51:06.342801+0000","last_undegraded":"2024-09-12T22:51:06.342801+0000","last_fullsized":"2024-09-12T22:51:06.342801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":26700,"num_write":399,"num_write_kb":55331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"63'114","reported_seq":268,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343634+0000","last_change":"2024-09-12T22:50:55.852342+0000","last_active":"2024-09-12T22:51:06.343634+0000","last_peered":"2024-09-12T22:51:06.343634+0000","last_clean":"2024-09-12T22:51:06.343634+0000","last_became_active":"2024-09-12T22:50:55.851975+0000","last_became_peered":"2024-09-12T22:50:55.851975+0000","last_unstale":"2024-09-12T22:51:06.343634+0000","last_undegraded":"2024-09-12T22:51:06.343634+0000","last_fullsized":"2024-09-12T22:51:06.343634+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":1201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723698+0000","last_change":"2024-09-12T22:50:52.857531+0000","last_active":"2024-09-12T22:51:05.723698+0000","last_peered":"2024-09-12T22:51:05.723698+0000","last_clean":"2024-09-12T22:51:05.723698+0000","last_became_active":"2024-09-12T22:50:52.856757+0000","last_became_peered":"2024-09-12T22:50:52.856757+0000","last_unstale":"2024-09-12T22:51:05.723698+0000","last_undegraded":"2024-09-12T22:51:05.723698+0000","last_fullsized":"2024-09-12T22:51:05.723698+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:14.353873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"61'406","reported_seq":929,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723396+0000","last_change":"2024-09-12T22:50:56.855069+0000","last_active":"2024-09-12T22:51:05.723396+0000","last_peered":"2024-09-12T22:51:05.723396+0000","last_clean":"2024-09-12T22:51:05.723396+0000","last_became_active":"2024-09-12T22:50:56.853376+0000","last_became_peered":"2024-09-12T22:50:56.853376+0000","last_unstale":"2024-09-12T22:51:05.723396+0000","last_undegraded":"2024-09-12T22:51:05.723396+0000","last_fullsized":"2024-09-12T22:51:05.723396+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:43.556932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17112,"num_write":373,"num_write_kb":79947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"61'378","reported_seq":533,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723357+0000","last_change":"2024-09-12T22:50:57.863154+0000","last_active":"2024-09-12T22:51:05.723357+0000","last_peered":"2024-09-12T22:51:05.723357+0000","last_clean":"2024-09-12T22:51:05.723357+0000","last_became_active":"2024-09-12T22:50:57.861280+0000","last_became_peered":"2024-09-12T22:50:57.861280+0000","last_unstale":"2024-09-12T22:51:05.723357+0000","last_undegraded":"2024-09-12T22:51:05.723357+0000","last_fullsized":"2024-09-12T22:51:05.723357+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:13.015760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15048,"num_write":339,"num_write_kb":35238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"63'249","reported_seq":391,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723315+0000","last_change":"2024-09-12T22:50:55.849742+0000","last_active":"2024-09-12T22:51:05.723315+0000","last_peered":"2024-09-12T22:51:05.723315+0000","last_clean":"2024-09-12T22:51:05.723315+0000","last_became_active":"2024-09-12T22:50:55.849531+0000","last_became_peered":"2024-09-12T22:50:55.849531+0000","last_unstale":"2024-09-12T22:51:05.723315+0000","last_undegraded":"2024-09-12T22:51:05.723315+0000","last_fullsized":"2024-09-12T22:51:05.723315+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:32.676988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8461053,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":8364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8456257,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"61'405","reported_seq":570,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342888+0000","last_change":"2024-09-12T22:48:05.176779+0000","last_active":"2024-09-12T22:51:06.342888+0000","last_peered":"2024-09-12T22:51:06.342888+0000","last_clean":"2024-09-12T22:51:06.342888+0000","last_became_active":"2024-09-12T22:48:05.176344+0000","last_became_peered":"2024-09-12T22:48:05.176344+0000","last_unstale":"2024-09-12T22:51:06.342888+0000","last_undegraded":"2024-09-12T22:51:06.342888+0000","last_fullsized":"2024-09-12T22:51:06.342888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":25018,"num_write":372,"num_write_kb":42936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"61'85","reported_seq":236,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724390+0000","last_change":"2024-09-12T22:50:52.905108+0000","last_active":"2024-09-12T22:51:05.724390+0000","last_peered":"2024-09-12T22:51:05.724390+0000","last_clean":"2024-09-12T22:51:05.724390+0000","last_became_active":"2024-09-12T22:50:52.861594+0000","last_became_peered":"2024-09-12T22:50:52.861594+0000","last_unstale":"2024-09-12T22:51:05.724390+0000","last_undegraded":"2024-09-12T22:51:05.724390+0000","last_fullsized":"2024-09-12T22:51:05.724390+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:49.196178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"61'213","reported_seq":338,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723895+0000","last_change":"2024-09-12T22:50:55.852154+0000","last_active":"2024-09-12T22:51:05.723895+0000","last_peered":"2024-09-12T22:51:05.723895+0000","last_clean":"2024-09-12T22:51:05.723895+0000","last_became_active":"2024-09-12T22:50:55.851798+0000","last_became_peered":"2024-09-12T22:50:55.851798+0000","last_unstale":"2024-09-12T22:51:05.723895+0000","last_undegraded":"2024-09-12T22:51:05.723895+0000","last_fullsized":"2024-09-12T22:51:05.723895+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:03:29.463409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":4171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"61'478","reported_seq":1108,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342686+0000","last_change":"2024-09-12T22:50:56.856443+0000","last_active":"2024-09-12T22:51:06.342686+0000","last_peered":"2024-09-12T22:51:06.342686+0000","last_clean":"2024-09-12T22:51:06.342686+0000","last_became_active":"2024-09-12T22:50:56.855150+0000","last_became_peered":"2024-09-12T22:50:56.855150+0000","last_unstale":"2024-09-12T22:51:06.342686+0000","last_undegraded":"2024-09-12T22:51:06.342686+0000","last_fullsized":"2024-09-12T22:51:06.342686+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":41320,"num_write":445,"num_write_kb":84826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":209,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"61'55","reported_seq":202,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343819+0000","last_change":"2024-09-12T22:50:52.859702+0000","last_active":"2024-09-12T22:51:06.343819+0000","last_peered":"2024-09-12T22:51:06.343819+0000","last_clean":"2024-09-12T22:51:06.343819+0000","last_became_active":"2024-09-12T22:50:52.859296+0000","last_became_peered":"2024-09-12T22:50:52.859296+0000","last_unstale":"2024-09-12T22:51:06.343819+0000","last_undegraded":"2024-09-12T22:51:06.343819+0000","last_fullsized":"2024-09-12T22:51:06.343819+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"61'447","reported_seq":635,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342752+0000","last_change":"2024-09-12T22:48:05.169648+0000","last_active":"2024-09-12T22:51:06.342752+0000","last_peered":"2024-09-12T22:51:06.342752+0000","last_clean":"2024-09-12T22:51:06.342752+0000","last_became_active":"2024-09-12T22:48:05.168356+0000","last_became_peered":"2024-09-12T22:48:05.168356+0000","last_unstale":"2024-09-12T22:51:06.342752+0000","last_undegraded":"2024-09-12T22:51:06.342752+0000","last_fullsized":"2024-09-12T22:51:06.342752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25877,"num_write":417,"num_write_kb":39269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"61'371","reported_seq":888,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724516+0000","last_change":"2024-09-12T22:51:02.709645+0000","last_active":"2024-09-12T22:51:05.724516+0000","last_peered":"2024-09-12T22:51:05.724516+0000","last_clean":"2024-09-12T22:51:05.724516+0000","last_became_active":"2024-09-12T22:51:02.708091+0000","last_became_peered":"2024-09-12T22:51:02.708091+0000","last_unstale":"2024-09-12T22:51:05.724516+0000","last_undegraded":"2024-09-12T22:51:05.724516+0000","last_fullsized":"2024-09-12T22:51:05.724516+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:13:37.634120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20950,"num_write":339,"num_write_kb":39207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"61'601","reported_seq":741,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342911+0000","last_change":"2024-09-12T22:48:04.169111+0000","last_active":"2024-09-12T22:51:06.342911+0000","last_peered":"2024-09-12T22:51:06.342911+0000","last_clean":"2024-09-12T22:51:06.342911+0000","last_became_active":"2024-09-12T22:48:04.168743+0000","last_became_peered":"2024-09-12T22:48:04.168743+0000","last_unstale":"2024-09-12T22:51:06.342911+0000","last_undegraded":"2024-09-12T22:51:06.342911+0000","last_fullsized":"2024-09-12T22:51:06.342911+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":535,"num_write_kb":8445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"61'438","reported_seq":979,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342466+0000","last_change":"2024-09-12T22:50:57.863618+0000","last_active":"2024-09-12T22:51:06.342466+0000","last_peered":"2024-09-12T22:51:06.342466+0000","last_clean":"2024-09-12T22:51:06.342466+0000","last_became_active":"2024-09-12T22:50:57.861695+0000","last_became_peered":"2024-09-12T22:50:57.861695+0000","last_unstale":"2024-09-12T22:51:06.342466+0000","last_undegraded":"2024-09-12T22:51:06.342466+0000","last_fullsized":"2024-09-12T22:51:06.342466+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":16921,"num_write":411,"num_write_kb":146790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"61'185","reported_seq":338,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342844+0000","last_change":"2024-09-12T22:50:55.853288+0000","last_active":"2024-09-12T22:51:06.342844+0000","last_peered":"2024-09-12T22:51:06.342844+0000","last_clean":"2024-09-12T22:51:06.342844+0000","last_became_active":"2024-09-12T22:50:55.852796+0000","last_became_peered":"2024-09-12T22:50:55.852796+0000","last_unstale":"2024-09-12T22:51:06.342844+0000","last_undegraded":"2024-09-12T22:51:06.342844+0000","last_fullsized":"2024-09-12T22:51:06.342844+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"61'386","reported_seq":886,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724136+0000","last_change":"2024-09-12T22:51:01.702122+0000","last_active":"2024-09-12T22:51:05.724136+0000","last_peered":"2024-09-12T22:51:05.724136+0000","last_clean":"2024-09-12T22:51:05.724136+0000","last_became_active":"2024-09-12T22:51:01.701006+0000","last_became_peered":"2024-09-12T22:51:01.701006+0000","last_unstale":"2024-09-12T22:51:05.724136+0000","last_undegraded":"2024-09-12T22:51:05.724136+0000","last_fullsized":"2024-09-12T22:51:05.724136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:44.083029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":21487,"num_write":344,"num_write_kb":72645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"61'180","reported_seq":319,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723786+0000","last_change":"2024-09-12T22:48:04.174205+0000","last_active":"2024-09-12T22:51:05.723786+0000","last_peered":"2024-09-12T22:51:05.723786+0000","last_clean":"2024-09-12T22:51:05.723786+0000","last_became_active":"2024-09-12T22:48:04.173902+0000","last_became_peered":"2024-09-12T22:48:04.173902+0000","last_unstale":"2024-09-12T22:51:05.723786+0000","last_undegraded":"2024-09-12T22:51:05.723786+0000","last_fullsized":"2024-09-12T22:51:05.723786+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:43:39.709214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":12355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"61'396","reported_seq":552,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723907+0000","last_change":"2024-09-12T22:48:05.172917+0000","last_active":"2024-09-12T22:51:05.723907+0000","last_peered":"2024-09-12T22:51:05.723907+0000","last_clean":"2024-09-12T22:51:05.723907+0000","last_became_active":"2024-09-12T22:48:05.172493+0000","last_became_peered":"2024-09-12T22:48:05.172493+0000","last_unstale":"2024-09-12T22:51:05.723907+0000","last_undegraded":"2024-09-12T22:51:05.723907+0000","last_fullsized":"2024-09-12T22:51:05.723907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:35.645286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9980,"num_write":370,"num_write_kb":80321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"61'64","reported_seq":215,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723864+0000","last_change":"2024-09-12T22:50:52.884955+0000","last_active":"2024-09-12T22:51:05.723864+0000","last_peered":"2024-09-12T22:51:05.723864+0000","last_clean":"2024-09-12T22:51:05.723864+0000","last_became_active":"2024-09-12T22:50:52.858938+0000","last_became_peered":"2024-09-12T22:50:52.858938+0000","last_unstale":"2024-09-12T22:51:05.723864+0000","last_undegraded":"2024-09-12T22:51:05.723864+0000","last_fullsized":"2024-09-12T22:51:05.723864+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:24.405738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"61'370","reported_seq":515,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723307+0000","last_change":"2024-09-12T22:50:59.705667+0000","last_active":"2024-09-12T22:51:05.723307+0000","last_peered":"2024-09-12T22:51:05.723307+0000","last_clean":"2024-09-12T22:51:05.723307+0000","last_became_active":"2024-09-12T22:50:59.704074+0000","last_became_peered":"2024-09-12T22:50:59.704074+0000","last_unstale":"2024-09-12T22:51:05.723307+0000","last_undegraded":"2024-09-12T22:51:05.723307+0000","last_fullsized":"2024-09-12T22:51:05.723307+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:59.243155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16468,"num_write":341,"num_write_kb":50344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"61'187","reported_seq":321,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723342+0000","last_change":"2024-09-12T22:50:55.851804+0000","last_active":"2024-09-12T22:51:05.723342+0000","last_peered":"2024-09-12T22:51:05.723342+0000","last_clean":"2024-09-12T22:51:05.723342+0000","last_became_active":"2024-09-12T22:50:55.851467+0000","last_became_peered":"2024-09-12T22:50:55.851467+0000","last_unstale":"2024-09-12T22:51:05.723342+0000","last_undegraded":"2024-09-12T22:51:05.723342+0000","last_fullsized":"2024-09-12T22:51:05.723342+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:05.608780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"61'438","reported_seq":636,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723016+0000","last_change":"2024-09-12T22:50:59.706857+0000","last_active":"2024-09-12T22:51:05.723016+0000","last_peered":"2024-09-12T22:51:05.723016+0000","last_clean":"2024-09-12T22:51:05.723016+0000","last_became_active":"2024-09-12T22:50:59.703786+0000","last_became_peered":"2024-09-12T22:50:59.703786+0000","last_unstale":"2024-09-12T22:51:05.723016+0000","last_undegraded":"2024-09-12T22:51:05.723016+0000","last_fullsized":"2024-09-12T22:51:05.723016+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:52:45.535138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":38460,"num_write":412,"num_write_kb":96626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"61'185","reported_seq":342,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724254+0000","last_change":"2024-09-12T22:50:55.853065+0000","last_active":"2024-09-12T22:51:05.724254+0000","last_peered":"2024-09-12T22:51:05.724254+0000","last_clean":"2024-09-12T22:51:05.724254+0000","last_became_active":"2024-09-12T22:50:55.852654+0000","last_became_peered":"2024-09-12T22:50:55.852654+0000","last_unstale":"2024-09-12T22:51:05.724254+0000","last_undegraded":"2024-09-12T22:51:05.724254+0000","last_fullsized":"2024-09-12T22:51:05.724254+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:17.101030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":12349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"61'418","reported_seq":599,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723714+0000","last_change":"2024-09-12T22:48:05.171815+0000","last_active":"2024-09-12T22:51:05.723714+0000","last_peered":"2024-09-12T22:51:05.723714+0000","last_clean":"2024-09-12T22:51:05.723714+0000","last_became_active":"2024-09-12T22:48:05.171361+0000","last_became_peered":"2024-09-12T22:48:05.171361+0000","last_unstale":"2024-09-12T22:51:05.723714+0000","last_undegraded":"2024-09-12T22:51:05.723714+0000","last_fullsized":"2024-09-12T22:51:05.723714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:28.873036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":27427,"num_write":388,"num_write_kb":67745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"61'159","reported_seq":285,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724366+0000","last_change":"2024-09-12T22:50:55.852290+0000","last_active":"2024-09-12T22:51:05.724366+0000","last_peered":"2024-09-12T22:51:05.724366+0000","last_clean":"2024-09-12T22:51:05.724366+0000","last_became_active":"2024-09-12T22:50:55.851948+0000","last_became_peered":"2024-09-12T22:50:55.851948+0000","last_unstale":"2024-09-12T22:51:05.724366+0000","last_undegraded":"2024-09-12T22:51:05.724366+0000","last_fullsized":"2024-09-12T22:51:05.724366+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:14.260183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"61'479","reported_seq":652,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723053+0000","last_change":"2024-09-12T22:51:03.707091+0000","last_active":"2024-09-12T22:51:05.723053+0000","last_peered":"2024-09-12T22:51:05.723053+0000","last_clean":"2024-09-12T22:51:05.723053+0000","last_became_active":"2024-09-12T22:51:03.704137+0000","last_became_peered":"2024-09-12T22:51:03.704137+0000","last_unstale":"2024-09-12T22:51:05.723053+0000","last_undegraded":"2024-09-12T22:51:05.723053+0000","last_fullsized":"2024-09-12T22:51:05.723053+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:27:47.351934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":26793,"num_write":459,"num_write_kb":138325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"61'49","reported_seq":201,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343747+0000","last_change":"2024-09-12T22:50:52.903138+0000","last_active":"2024-09-12T22:51:06.343747+0000","last_peered":"2024-09-12T22:51:06.343747+0000","last_clean":"2024-09-12T22:51:06.343747+0000","last_became_active":"2024-09-12T22:50:52.859983+0000","last_became_peered":"2024-09-12T22:50:52.859983+0000","last_unstale":"2024-09-12T22:51:06.343747+0000","last_undegraded":"2024-09-12T22:51:06.343747+0000","last_fullsized":"2024-09-12T22:51:06.343747+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2742,"num_read_kb":1405479,"num_write":24656,"num_write_kb":4261796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7339,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26737,"ondisk_log_size":26737,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127366156,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":45,"num_read_kb":1459,"num_write":4460,"num_write_kb":127655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":93806220,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254799872,"data_stored":254732312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5569,"internal_metadata":0},"log_size":6243,"ondisk_log_size":6243,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":67,"seq":287762808838,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150992,"kb_used_data":92924,"kb_used_omap":6,"kb_used_meta":58041,"kb_avail":94220848,"statfs":{"total":96636764160,"available":96482148352,"internally_reserved":0,"allocated":95154176,"data_stored":94739479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7164,"internal_metadata":59433988},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738411,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":169456,"kb_used_data":75864,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94202384,"statfs":{"total":96636764160,"available":96463241216,"internally_reserved":0,"allocated":77684736,"data_stored":77299268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738412,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":172716,"kb_used_data":83284,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94199124,"statfs":{"total":96636764160,"available":96459902976,"internally_reserved":0,"allocated":85282816,"data_stored":84886443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83980288,"data_stored":83958707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":76972032,"data_stored":76961881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":93847552,"data_stored":93811724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5569,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:51:14.603 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.603 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.603 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.603 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.604 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.604 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.604 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.604 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.604 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.604 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.604 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.604 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.605 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.605 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.605 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.605 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.605 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.605 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.605 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.606 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.606 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.606 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.606 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.606 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.606 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.606 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.606 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.606 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.607 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.607 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.607 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.607 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.607 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.607 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.607 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.607 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.607 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.608 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.608 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.608 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.608 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.608 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.608 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.608 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.608 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.609 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.609 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.609 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.609 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.609 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.609 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.609 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.610 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.610 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.610 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.610 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.610 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T22:47:55.016634+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=47, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.610 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T22:47:59.028872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=47, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.610 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.610 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.610 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T22:47:59.028872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=47, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.611 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.611 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.611 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T22:47:59.028872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=47, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.611 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.611 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.611 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T22:47:59.028872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=47, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.611 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.611 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.611 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.612 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T22:47:59.028872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=47, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.612 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.612 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.612 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T22:47:59.028872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=47, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.612 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.612 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.612 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T22:47:59.028872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=47, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.612 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.613 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.613 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T22:47:59.028872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=47, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.613 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.613 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.613 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.613 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.613 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.613 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.613 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.614 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.614 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.614 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.614 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.614 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.614 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.615 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.616 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.616 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.616 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.616 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.616 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.616 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.616 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.616 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.616 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.617 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.617 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:14.617 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T22:51:34.618 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:51:34.936 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:51:35.224 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-09-12T22:51:35.226 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2024-09-12T22:51:34.181344+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127956543,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":2923,"num_read_kb":1407056,"num_write":29321,"num_write_kb":4392913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7366,"num_bytes_recovered":93806220,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33169,"ondisk_log_size":33169,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":493144,"kb_used_data":252072,"kb_used_omap":10,"kb_used_meta":241013,"kb_avail":282622376,"statfs":{"total":289910292480,"available":289405313024,"internally_reserved":0,"allocated":258121728,"data_stored":256925190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10354,"internal_metadata":246798222},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002273"},"pg_stats":[{"pgid":"4.3f","version":"61'404","reported_seq":572,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:17.547756+0000","last_change":"2024-09-12T22:51:17.547783+0000","last_active":"2024-09-12T22:51:17.547756+0000","last_peered":"2024-09-12T22:51:17.547756+0000","last_clean":"2024-09-12T22:51:17.547756+0000","last_became_active":"2024-09-12T22:48:05.172964+0000","last_became_peered":"2024-09-12T22:48:05.172964+0000","last_unstale":"2024-09-12T22:51:17.547756+0000","last_undegraded":"2024-09-12T22:51:17.547756+0000","last_fullsized":"2024-09-12T22:51:17.547756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'404","last_scrub_stamp":"2024-09-12T22:51:17.547649+0000","last_deep_scrub":"61'404","last_deep_scrub_stamp":"2024-09-12T22:51:17.547649+0000","last_clean_scrub_stamp":"2024-09-12T22:51:17.547649+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:03:32.488397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9582,"num_write":371,"num_write_kb":42180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"61'425","reported_seq":642,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:21.520920+0000","last_change":"2024-09-12T22:51:21.520960+0000","last_active":"2024-09-12T22:51:21.520920+0000","last_peered":"2024-09-12T22:51:21.520920+0000","last_clean":"2024-09-12T22:51:21.520920+0000","last_became_active":"2024-09-12T22:48:05.172684+0000","last_became_peered":"2024-09-12T22:48:05.172684+0000","last_unstale":"2024-09-12T22:51:21.520920+0000","last_undegraded":"2024-09-12T22:51:21.520920+0000","last_fullsized":"2024-09-12T22:51:21.520920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'425","last_scrub_stamp":"2024-09-12T22:51:21.520763+0000","last_deep_scrub":"61'425","last_deep_scrub_stamp":"2024-09-12T22:51:21.520763+0000","last_clean_scrub_stamp":"2024-09-12T22:51:21.520763+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:08.747037+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":40466,"num_write":394,"num_write_kb":96045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"61'385","reported_seq":525,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:16.998541+0000","last_change":"2024-09-12T22:51:16.998566+0000","last_active":"2024-09-12T22:51:16.998541+0000","last_peered":"2024-09-12T22:51:16.998541+0000","last_clean":"2024-09-12T22:51:16.998541+0000","last_became_active":"2024-09-12T22:51:00.700490+0000","last_became_peered":"2024-09-12T22:51:00.700490+0000","last_unstale":"2024-09-12T22:51:16.998541+0000","last_undegraded":"2024-09-12T22:51:16.998541+0000","last_fullsized":"2024-09-12T22:51:16.998541+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'385","last_scrub_stamp":"2024-09-12T22:51:16.998452+0000","last_deep_scrub":"61'385","last_deep_scrub_stamp":"2024-09-12T22:51:16.998452+0000","last_clean_scrub_stamp":"2024-09-12T22:51:16.998452+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:25.166404+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":7348,"num_write":352,"num_write_kb":34517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"61'395","reported_seq":564,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723544+0000","last_change":"2024-09-12T22:51:02.711764+0000","last_active":"2024-09-12T22:51:05.723544+0000","last_peered":"2024-09-12T22:51:05.723544+0000","last_clean":"2024-09-12T22:51:05.723544+0000","last_became_active":"2024-09-12T22:51:02.708216+0000","last_became_peered":"2024-09-12T22:51:02.708216+0000","last_unstale":"2024-09-12T22:51:05.723544+0000","last_undegraded":"2024-09-12T22:51:05.723544+0000","last_fullsized":"2024-09-12T22:51:05.723544+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":25803,"num_write":361,"num_write_kb":71646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"61'410","reported_seq":574,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723963+0000","last_change":"2024-09-12T22:48:05.170306+0000","last_active":"2024-09-12T22:51:05.723963+0000","last_peered":"2024-09-12T22:51:05.723963+0000","last_clean":"2024-09-12T22:51:05.723963+0000","last_became_active":"2024-09-12T22:48:05.169940+0000","last_became_peered":"2024-09-12T22:48:05.169940+0000","last_unstale":"2024-09-12T22:51:05.723963+0000","last_undegraded":"2024-09-12T22:51:05.723963+0000","last_fullsized":"2024-09-12T22:51:05.723963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":20544,"num_write":387,"num_write_kb":55745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"61'384","reported_seq":500,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723252+0000","last_change":"2024-09-12T22:51:03.706817+0000","last_active":"2024-09-12T22:51:05.723252+0000","last_peered":"2024-09-12T22:51:05.723252+0000","last_clean":"2024-09-12T22:51:05.723252+0000","last_became_active":"2024-09-12T22:51:03.704293+0000","last_became_peered":"2024-09-12T22:51:03.704293+0000","last_unstale":"2024-09-12T22:51:05.723252+0000","last_undegraded":"2024-09-12T22:51:05.723252+0000","last_fullsized":"2024-09-12T22:51:05.723252+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5069,"num_write":355,"num_write_kb":38430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"61'461","reported_seq":665,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:24.933889+0000","last_change":"2024-09-12T22:51:24.933916+0000","last_active":"2024-09-12T22:51:24.933889+0000","last_peered":"2024-09-12T22:51:24.933889+0000","last_clean":"2024-09-12T22:51:24.933889+0000","last_became_active":"2024-09-12T22:50:56.856720+0000","last_became_peered":"2024-09-12T22:50:56.856720+0000","last_unstale":"2024-09-12T22:51:24.933889+0000","last_undegraded":"2024-09-12T22:51:24.933889+0000","last_fullsized":"2024-09-12T22:51:24.933889+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'461","last_scrub_stamp":"2024-09-12T22:51:24.933802+0000","last_deep_scrub":"61'461","last_deep_scrub_stamp":"2024-09-12T22:51:24.933802+0000","last_clean_scrub_stamp":"2024-09-12T22:51:24.933802+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:19:33.581183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":30574,"num_write":435,"num_write_kb":92996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"61'385","reported_seq":527,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:18.026449+0000","last_change":"2024-09-12T22:51:18.026473+0000","last_active":"2024-09-12T22:51:18.026449+0000","last_peered":"2024-09-12T22:51:18.026449+0000","last_clean":"2024-09-12T22:51:18.026449+0000","last_became_active":"2024-09-12T22:51:00.700472+0000","last_became_peered":"2024-09-12T22:51:00.700472+0000","last_unstale":"2024-09-12T22:51:18.026449+0000","last_undegraded":"2024-09-12T22:51:18.026449+0000","last_fullsized":"2024-09-12T22:51:18.026449+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'385","last_scrub_stamp":"2024-09-12T22:51:18.026325+0000","last_deep_scrub":"61'385","last_deep_scrub_stamp":"2024-09-12T22:51:18.026325+0000","last_clean_scrub_stamp":"2024-09-12T22:51:18.026325+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:33.411721+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9031,"num_write":340,"num_write_kb":84729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"61'435","reported_seq":594,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:17.493544+0000","last_change":"2024-09-12T22:51:17.493570+0000","last_active":"2024-09-12T22:51:17.493544+0000","last_peered":"2024-09-12T22:51:17.493544+0000","last_clean":"2024-09-12T22:51:17.493544+0000","last_became_active":"2024-09-12T22:48:05.177284+0000","last_became_peered":"2024-09-12T22:48:05.177284+0000","last_unstale":"2024-09-12T22:51:17.493544+0000","last_undegraded":"2024-09-12T22:51:17.493544+0000","last_fullsized":"2024-09-12T22:51:17.493544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'435","last_scrub_stamp":"2024-09-12T22:51:17.493458+0000","last_deep_scrub":"61'435","last_deep_scrub_stamp":"2024-09-12T22:51:17.493458+0000","last_clean_scrub_stamp":"2024-09-12T22:51:17.493458+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:21.403217+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8316,"num_write":403,"num_write_kb":71851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"61'443","reported_seq":657,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:27.442616+0000","last_change":"2024-09-12T22:51:27.442641+0000","last_active":"2024-09-12T22:51:27.442616+0000","last_peered":"2024-09-12T22:51:27.442616+0000","last_clean":"2024-09-12T22:51:27.442616+0000","last_became_active":"2024-09-12T22:48:05.171686+0000","last_became_peered":"2024-09-12T22:48:05.171686+0000","last_unstale":"2024-09-12T22:51:27.442616+0000","last_undegraded":"2024-09-12T22:51:27.442616+0000","last_fullsized":"2024-09-12T22:51:27.442616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'443","last_scrub_stamp":"2024-09-12T22:51:27.442524+0000","last_deep_scrub":"61'443","last_deep_scrub_stamp":"2024-09-12T22:51:27.442524+0000","last_clean_scrub_stamp":"2024-09-12T22:51:27.442524+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:24.651831+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40751,"num_write":407,"num_write_kb":116626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"61'383","reported_seq":510,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723970+0000","last_change":"2024-09-12T22:51:02.712354+0000","last_active":"2024-09-12T22:51:05.723970+0000","last_peered":"2024-09-12T22:51:05.723970+0000","last_clean":"2024-09-12T22:51:05.723970+0000","last_became_active":"2024-09-12T22:51:02.710579+0000","last_became_peered":"2024-09-12T22:51:02.710579+0000","last_unstale":"2024-09-12T22:51:05.723970+0000","last_undegraded":"2024-09-12T22:51:05.723970+0000","last_fullsized":"2024-09-12T22:51:05.723970+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5475,"num_write":365,"num_write_kb":63204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"61'366","reported_seq":900,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:14.539254+0000","last_change":"2024-09-12T22:51:14.539280+0000","last_active":"2024-09-12T22:51:14.539254+0000","last_peered":"2024-09-12T22:51:14.539254+0000","last_clean":"2024-09-12T22:51:14.539254+0000","last_became_active":"2024-09-12T22:50:58.698711+0000","last_became_peered":"2024-09-12T22:50:58.698711+0000","last_unstale":"2024-09-12T22:51:14.539254+0000","last_undegraded":"2024-09-12T22:51:14.539254+0000","last_fullsized":"2024-09-12T22:51:14.539254+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'366","last_scrub_stamp":"2024-09-12T22:51:14.539130+0000","last_deep_scrub":"61'366","last_deep_scrub_stamp":"2024-09-12T22:51:14.539130+0000","last_clean_scrub_stamp":"2024-09-12T22:51:14.539130+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:42.502517+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":35222,"num_write":342,"num_write_kb":74947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"61'434","reported_seq":623,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723763+0000","last_change":"2024-09-12T22:48:05.171356+0000","last_active":"2024-09-12T22:51:05.723763+0000","last_peered":"2024-09-12T22:51:05.723763+0000","last_clean":"2024-09-12T22:51:05.723763+0000","last_became_active":"2024-09-12T22:48:05.170794+0000","last_became_peered":"2024-09-12T22:48:05.170794+0000","last_unstale":"2024-09-12T22:51:05.723763+0000","last_undegraded":"2024-09-12T22:51:05.723763+0000","last_fullsized":"2024-09-12T22:51:05.723763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":19623,"num_write":389,"num_write_kb":83457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"61'432","reported_seq":602,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723196+0000","last_change":"2024-09-12T22:50:58.702236+0000","last_active":"2024-09-12T22:51:05.723196+0000","last_peered":"2024-09-12T22:51:05.723196+0000","last_clean":"2024-09-12T22:51:05.723196+0000","last_became_active":"2024-09-12T22:50:58.700107+0000","last_became_peered":"2024-09-12T22:50:58.700107+0000","last_unstale":"2024-09-12T22:51:05.723196+0000","last_undegraded":"2024-09-12T22:51:05.723196+0000","last_fullsized":"2024-09-12T22:51:05.723196+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":23332,"num_write":401,"num_write_kb":75871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"61'406","reported_seq":582,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:22.007624+0000","last_change":"2024-09-12T22:51:22.007658+0000","last_active":"2024-09-12T22:51:22.007624+0000","last_peered":"2024-09-12T22:51:22.007624+0000","last_clean":"2024-09-12T22:51:22.007624+0000","last_became_active":"2024-09-12T22:50:55.849568+0000","last_became_peered":"2024-09-12T22:50:55.849568+0000","last_unstale":"2024-09-12T22:51:22.007624+0000","last_undegraded":"2024-09-12T22:51:22.007624+0000","last_fullsized":"2024-09-12T22:51:22.007624+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'406","last_scrub_stamp":"2024-09-12T22:51:22.007494+0000","last_deep_scrub":"61'406","last_deep_scrub_stamp":"2024-09-12T22:51:22.007494+0000","last_clean_scrub_stamp":"2024-09-12T22:51:22.007494+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:28:45.134382+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":18162,"num_write":365,"num_write_kb":58919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"61'444","reported_seq":584,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:16.031447+0000","last_change":"2024-09-12T22:51:16.031494+0000","last_active":"2024-09-12T22:51:16.031447+0000","last_peered":"2024-09-12T22:51:16.031447+0000","last_clean":"2024-09-12T22:51:16.031447+0000","last_became_active":"2024-09-12T22:51:01.700744+0000","last_became_peered":"2024-09-12T22:51:01.700744+0000","last_unstale":"2024-09-12T22:51:16.031447+0000","last_undegraded":"2024-09-12T22:51:16.031447+0000","last_fullsized":"2024-09-12T22:51:16.031447+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'444","last_scrub_stamp":"2024-09-12T22:51:16.031333+0000","last_deep_scrub":"61'444","last_deep_scrub_stamp":"2024-09-12T22:51:16.031333+0000","last_clean_scrub_stamp":"2024-09-12T22:51:16.031333+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:38.746367+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":410,"num_write_kb":63144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"61'443","reported_seq":625,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:15.477254+0000","last_change":"2024-09-12T22:51:15.477280+0000","last_active":"2024-09-12T22:51:15.477254+0000","last_peered":"2024-09-12T22:51:15.477254+0000","last_clean":"2024-09-12T22:51:15.477254+0000","last_became_active":"2024-09-12T22:48:05.177965+0000","last_became_peered":"2024-09-12T22:48:05.177965+0000","last_unstale":"2024-09-12T22:51:15.477254+0000","last_undegraded":"2024-09-12T22:51:15.477254+0000","last_fullsized":"2024-09-12T22:51:15.477254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'443","last_scrub_stamp":"2024-09-12T22:51:15.477164+0000","last_deep_scrub":"61'443","last_deep_scrub_stamp":"2024-09-12T22:51:15.477164+0000","last_clean_scrub_stamp":"2024-09-12T22:51:15.477164+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:21.477261+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":14687,"num_write":408,"num_write_kb":80026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"61'439","reported_seq":666,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724378+0000","last_change":"2024-09-12T22:48:05.171053+0000","last_active":"2024-09-12T22:51:05.724378+0000","last_peered":"2024-09-12T22:51:05.724378+0000","last_clean":"2024-09-12T22:51:05.724378+0000","last_became_active":"2024-09-12T22:48:05.170578+0000","last_became_peered":"2024-09-12T22:48:05.170578+0000","last_unstale":"2024-09-12T22:51:05.724378+0000","last_undegraded":"2024-09-12T22:51:05.724378+0000","last_fullsized":"2024-09-12T22:51:05.724378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":47063,"num_write":400,"num_write_kb":100535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"61'444","reported_seq":669,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:23.424561+0000","last_change":"2024-09-12T22:51:23.424617+0000","last_active":"2024-09-12T22:51:23.424561+0000","last_peered":"2024-09-12T22:51:23.424561+0000","last_clean":"2024-09-12T22:51:23.424561+0000","last_became_active":"2024-09-12T22:48:05.176680+0000","last_became_peered":"2024-09-12T22:48:05.176680+0000","last_unstale":"2024-09-12T22:51:23.424561+0000","last_undegraded":"2024-09-12T22:51:23.424561+0000","last_fullsized":"2024-09-12T22:51:23.424561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'444","last_scrub_stamp":"2024-09-12T22:51:23.424460+0000","last_deep_scrub":"61'444","last_deep_scrub_stamp":"2024-09-12T22:51:23.424460+0000","last_clean_scrub_stamp":"2024-09-12T22:51:23.424460+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:04.269715+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":42758,"num_write":403,"num_write_kb":67827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"61'433","reported_seq":571,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723715+0000","last_change":"2024-09-12T22:51:02.711577+0000","last_active":"2024-09-12T22:51:05.723715+0000","last_peered":"2024-09-12T22:51:05.723715+0000","last_clean":"2024-09-12T22:51:05.723715+0000","last_became_active":"2024-09-12T22:51:02.708090+0000","last_became_peered":"2024-09-12T22:51:02.708090+0000","last_unstale":"2024-09-12T22:51:05.723715+0000","last_undegraded":"2024-09-12T22:51:05.723715+0000","last_fullsized":"2024-09-12T22:51:05.723715+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":10750,"num_write":397,"num_write_kb":34708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"61'413","reported_seq":597,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:28.971245+0000","last_change":"2024-09-12T22:51:28.971283+0000","last_active":"2024-09-12T22:51:28.971245+0000","last_peered":"2024-09-12T22:51:28.971245+0000","last_clean":"2024-09-12T22:51:28.971245+0000","last_became_active":"2024-09-12T22:50:58.699982+0000","last_became_peered":"2024-09-12T22:50:58.699982+0000","last_unstale":"2024-09-12T22:51:28.971245+0000","last_undegraded":"2024-09-12T22:51:28.971245+0000","last_fullsized":"2024-09-12T22:51:28.971245+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'413","last_scrub_stamp":"2024-09-12T22:51:28.971124+0000","last_deep_scrub":"61'413","last_deep_scrub_stamp":"2024-09-12T22:51:28.971124+0000","last_clean_scrub_stamp":"2024-09-12T22:51:28.971124+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:41:37.457817+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":25621,"num_write":385,"num_write_kb":63908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"61'462","reported_seq":1067,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723557+0000","last_change":"2024-09-12T22:50:58.701216+0000","last_active":"2024-09-12T22:51:05.723557+0000","last_peered":"2024-09-12T22:51:05.723557+0000","last_clean":"2024-09-12T22:51:05.723557+0000","last_became_active":"2024-09-12T22:50:58.700047+0000","last_became_peered":"2024-09-12T22:50:58.700047+0000","last_unstale":"2024-09-12T22:51:05.723557+0000","last_undegraded":"2024-09-12T22:51:05.723557+0000","last_fullsized":"2024-09-12T22:51:05.723557+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28920,"num_write":428,"num_write_kb":76277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"61'413","reported_seq":949,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342456+0000","last_change":"2024-09-12T22:50:57.861973+0000","last_active":"2024-09-12T22:51:06.342456+0000","last_peered":"2024-09-12T22:51:06.342456+0000","last_clean":"2024-09-12T22:51:06.342456+0000","last_became_active":"2024-09-12T22:50:57.860819+0000","last_became_peered":"2024-09-12T22:50:57.860819+0000","last_unstale":"2024-09-12T22:51:06.342456+0000","last_undegraded":"2024-09-12T22:51:06.342456+0000","last_fullsized":"2024-09-12T22:51:06.342456+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":14661,"num_write":381,"num_write_kb":72596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"61'475","reported_seq":689,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:25.495344+0000","last_change":"2024-09-12T22:51:25.495369+0000","last_active":"2024-09-12T22:51:25.495344+0000","last_peered":"2024-09-12T22:51:25.495344+0000","last_clean":"2024-09-12T22:51:25.495344+0000","last_became_active":"2024-09-12T22:48:05.172437+0000","last_became_peered":"2024-09-12T22:48:05.172437+0000","last_unstale":"2024-09-12T22:51:25.495344+0000","last_undegraded":"2024-09-12T22:51:25.495344+0000","last_fullsized":"2024-09-12T22:51:25.495344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'475","last_scrub_stamp":"2024-09-12T22:51:25.495255+0000","last_deep_scrub":"61'475","last_deep_scrub_stamp":"2024-09-12T22:51:25.495255+0000","last_clean_scrub_stamp":"2024-09-12T22:51:25.495255+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:50:22.396824+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":32397,"num_write":452,"num_write_kb":105406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"61'413","reported_seq":964,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724534+0000","last_change":"2024-09-12T22:51:02.709686+0000","last_active":"2024-09-12T22:51:05.724534+0000","last_peered":"2024-09-12T22:51:05.724534+0000","last_clean":"2024-09-12T22:51:05.724534+0000","last_became_active":"2024-09-12T22:51:02.708084+0000","last_became_peered":"2024-09-12T22:51:02.708084+0000","last_unstale":"2024-09-12T22:51:05.724534+0000","last_undegraded":"2024-09-12T22:51:05.724534+0000","last_fullsized":"2024-09-12T22:51:05.724534+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4773,"num_write":395,"num_write_kb":21871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"61'453","reported_seq":1028,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343580+0000","last_change":"2024-09-12T22:50:58.700787+0000","last_active":"2024-09-12T22:51:06.343580+0000","last_peered":"2024-09-12T22:51:06.343580+0000","last_clean":"2024-09-12T22:51:06.343580+0000","last_became_active":"2024-09-12T22:50:58.699585+0000","last_became_peered":"2024-09-12T22:50:58.699585+0000","last_unstale":"2024-09-12T22:51:06.343580+0000","last_undegraded":"2024-09-12T22:51:06.343580+0000","last_fullsized":"2024-09-12T22:51:06.343580+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18201,"num_write":409,"num_write_kb":47008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"61'402","reported_seq":580,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:19.026955+0000","last_change":"2024-09-12T22:51:19.027019+0000","last_active":"2024-09-12T22:51:19.026955+0000","last_peered":"2024-09-12T22:51:19.026955+0000","last_clean":"2024-09-12T22:51:19.026955+0000","last_became_active":"2024-09-12T22:51:01.701850+0000","last_became_peered":"2024-09-12T22:51:01.701850+0000","last_unstale":"2024-09-12T22:51:19.026955+0000","last_undegraded":"2024-09-12T22:51:19.026955+0000","last_fullsized":"2024-09-12T22:51:19.026955+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'402","last_scrub_stamp":"2024-09-12T22:51:19.026854+0000","last_deep_scrub":"61'402","last_deep_scrub_stamp":"2024-09-12T22:51:19.026854+0000","last_clean_scrub_stamp":"2024-09-12T22:51:19.026854+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:57:34.383642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":21641,"num_write":372,"num_write_kb":63613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"61'436","reported_seq":1074,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724196+0000","last_change":"2024-09-12T22:50:59.703836+0000","last_active":"2024-09-12T22:51:05.724196+0000","last_peered":"2024-09-12T22:51:05.724196+0000","last_clean":"2024-09-12T22:51:05.724196+0000","last_became_active":"2024-09-12T22:50:59.702766+0000","last_became_peered":"2024-09-12T22:50:59.702766+0000","last_unstale":"2024-09-12T22:51:05.724196+0000","last_undegraded":"2024-09-12T22:51:05.724196+0000","last_fullsized":"2024-09-12T22:51:05.724196+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":65550,"num_write":412,"num_write_kb":134233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"61'393","reported_seq":599,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:25.456868+0000","last_change":"2024-09-12T22:51:25.456899+0000","last_active":"2024-09-12T22:51:25.456868+0000","last_peered":"2024-09-12T22:51:25.456868+0000","last_clean":"2024-09-12T22:51:25.456868+0000","last_became_active":"2024-09-12T22:48:05.176735+0000","last_became_peered":"2024-09-12T22:48:05.176735+0000","last_unstale":"2024-09-12T22:51:25.456868+0000","last_undegraded":"2024-09-12T22:51:25.456868+0000","last_fullsized":"2024-09-12T22:51:25.456868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'393","last_scrub_stamp":"2024-09-12T22:51:25.456783+0000","last_deep_scrub":"61'393","last_deep_scrub_stamp":"2024-09-12T22:51:25.456783+0000","last_clean_scrub_stamp":"2024-09-12T22:51:25.456783+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:32.363803+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":36009,"num_write":361,"num_write_kb":71487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"61'456","reported_seq":1020,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723719+0000","last_change":"2024-09-12T22:51:00.699523+0000","last_active":"2024-09-12T22:51:05.723719+0000","last_peered":"2024-09-12T22:51:05.723719+0000","last_clean":"2024-09-12T22:51:05.723719+0000","last_became_active":"2024-09-12T22:51:00.698377+0000","last_became_peered":"2024-09-12T22:51:00.698377+0000","last_unstale":"2024-09-12T22:51:05.723719+0000","last_undegraded":"2024-09-12T22:51:05.723719+0000","last_fullsized":"2024-09-12T22:51:05.723719+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4316,"num_write":417,"num_write_kb":34284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"61'440","reported_seq":623,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:27.484762+0000","last_change":"2024-09-12T22:51:27.484788+0000","last_active":"2024-09-12T22:51:27.484762+0000","last_peered":"2024-09-12T22:51:27.484762+0000","last_clean":"2024-09-12T22:51:27.484762+0000","last_became_active":"2024-09-12T22:48:05.176327+0000","last_became_peered":"2024-09-12T22:48:05.176327+0000","last_unstale":"2024-09-12T22:51:27.484762+0000","last_undegraded":"2024-09-12T22:51:27.484762+0000","last_fullsized":"2024-09-12T22:51:27.484762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'440","last_scrub_stamp":"2024-09-12T22:51:27.484666+0000","last_deep_scrub":"61'440","last_deep_scrub_stamp":"2024-09-12T22:51:27.484666+0000","last_clean_scrub_stamp":"2024-09-12T22:51:27.484666+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:56.730585+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15052,"num_write":399,"num_write_kb":71703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"61'424","reported_seq":591,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:15.055895+0000","last_change":"2024-09-12T22:51:15.055996+0000","last_active":"2024-09-12T22:51:15.055895+0000","last_peered":"2024-09-12T22:51:15.055895+0000","last_clean":"2024-09-12T22:51:15.055895+0000","last_became_active":"2024-09-12T22:51:01.700878+0000","last_became_peered":"2024-09-12T22:51:01.700878+0000","last_unstale":"2024-09-12T22:51:15.055895+0000","last_undegraded":"2024-09-12T22:51:15.055895+0000","last_fullsized":"2024-09-12T22:51:15.055895+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'424","last_scrub_stamp":"2024-09-12T22:51:15.055797+0000","last_deep_scrub":"61'424","last_deep_scrub_stamp":"2024-09-12T22:51:15.055797+0000","last_clean_scrub_stamp":"2024-09-12T22:51:15.055797+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:34:40.186129+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25587,"num_write":397,"num_write_kb":46651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"61'384","reported_seq":546,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724066+0000","last_change":"2024-09-12T22:48:05.171573+0000","last_active":"2024-09-12T22:51:05.724066+0000","last_peered":"2024-09-12T22:51:05.724066+0000","last_clean":"2024-09-12T22:51:05.724066+0000","last_became_active":"2024-09-12T22:48:05.171036+0000","last_became_peered":"2024-09-12T22:48:05.171036+0000","last_unstale":"2024-09-12T22:51:05.724066+0000","last_undegraded":"2024-09-12T22:51:05.724066+0000","last_fullsized":"2024-09-12T22:51:05.724066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9715,"num_write":345,"num_write_kb":63048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"81'454","reported_seq":598,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:28.020882+0000","last_change":"2024-09-12T22:51:28.020920+0000","last_active":"2024-09-12T22:51:28.020882+0000","last_peered":"2024-09-12T22:51:28.020882+0000","last_clean":"2024-09-12T22:51:28.020882+0000","last_became_active":"2024-09-12T22:50:55.851443+0000","last_became_peered":"2024-09-12T22:50:55.851443+0000","last_unstale":"2024-09-12T22:51:28.020882+0000","last_undegraded":"2024-09-12T22:51:28.020882+0000","last_fullsized":"2024-09-12T22:51:28.020882+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'454","last_scrub_stamp":"2024-09-12T22:51:28.020764+0000","last_deep_scrub":"81'454","last_deep_scrub_stamp":"2024-09-12T22:51:28.020764+0000","last_clean_scrub_stamp":"2024-09-12T22:51:28.020764+0000","objects_scrubbed":4,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:54.627592+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":387,"num_write_kb":8369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"61'389","reported_seq":577,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:19.562470+0000","last_change":"2024-09-12T22:51:19.562512+0000","last_active":"2024-09-12T22:51:19.562470+0000","last_peered":"2024-09-12T22:51:19.562470+0000","last_clean":"2024-09-12T22:51:19.562470+0000","last_became_active":"2024-09-12T22:48:05.172801+0000","last_became_peered":"2024-09-12T22:48:05.172801+0000","last_unstale":"2024-09-12T22:51:19.562470+0000","last_undegraded":"2024-09-12T22:51:19.562470+0000","last_fullsized":"2024-09-12T22:51:19.562470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'389","last_scrub_stamp":"2024-09-12T22:51:19.562343+0000","last_deep_scrub":"61'389","last_deep_scrub_stamp":"2024-09-12T22:51:19.562343+0000","last_clean_scrub_stamp":"2024-09-12T22:51:19.562343+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:28.225518+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":21115,"num_write":354,"num_write_kb":59128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"61'60","reported_seq":215,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:18.526880+0000","last_change":"2024-09-12T22:51:18.526913+0000","last_active":"2024-09-12T22:51:18.526880+0000","last_peered":"2024-09-12T22:51:18.526880+0000","last_clean":"2024-09-12T22:51:18.526880+0000","last_became_active":"2024-09-12T22:50:52.859975+0000","last_became_peered":"2024-09-12T22:50:52.859975+0000","last_unstale":"2024-09-12T22:51:18.526880+0000","last_undegraded":"2024-09-12T22:51:18.526880+0000","last_fullsized":"2024-09-12T22:51:18.526880+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'60","last_scrub_stamp":"2024-09-12T22:51:18.526792+0000","last_deep_scrub":"61'60","last_deep_scrub_stamp":"2024-09-12T22:51:18.526792+0000","last_clean_scrub_stamp":"2024-09-12T22:51:18.526792+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:27:51.518928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"61'433","reported_seq":998,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342484+0000","last_change":"2024-09-12T22:50:57.863647+0000","last_active":"2024-09-12T22:51:06.342484+0000","last_peered":"2024-09-12T22:51:06.342484+0000","last_clean":"2024-09-12T22:51:06.342484+0000","last_became_active":"2024-09-12T22:50:57.861719+0000","last_became_peered":"2024-09-12T22:50:57.861719+0000","last_unstale":"2024-09-12T22:51:06.342484+0000","last_undegraded":"2024-09-12T22:51:06.342484+0000","last_fullsized":"2024-09-12T22:51:06.342484+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17599,"num_write":404,"num_write_kb":59440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"61'63","reported_seq":218,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:16.528385+0000","last_change":"2024-09-12T22:51:16.528410+0000","last_active":"2024-09-12T22:51:16.528385+0000","last_peered":"2024-09-12T22:51:16.528385+0000","last_clean":"2024-09-12T22:51:16.528385+0000","last_became_active":"2024-09-12T22:50:52.857343+0000","last_became_peered":"2024-09-12T22:50:52.857343+0000","last_unstale":"2024-09-12T22:51:16.528385+0000","last_undegraded":"2024-09-12T22:51:16.528385+0000","last_fullsized":"2024-09-12T22:51:16.528385+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'63","last_scrub_stamp":"2024-09-12T22:51:16.528299+0000","last_deep_scrub":"61'63","last_deep_scrub_stamp":"2024-09-12T22:51:16.528299+0000","last_clean_scrub_stamp":"2024-09-12T22:51:16.528299+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:31.533066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"61'407","reported_seq":933,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343525+0000","last_change":"2024-09-12T22:50:55.853362+0000","last_active":"2024-09-12T22:51:06.343525+0000","last_peered":"2024-09-12T22:51:06.343525+0000","last_clean":"2024-09-12T22:51:06.343525+0000","last_became_active":"2024-09-12T22:50:55.851934+0000","last_became_peered":"2024-09-12T22:50:55.851934+0000","last_unstale":"2024-09-12T22:51:06.343525+0000","last_undegraded":"2024-09-12T22:51:06.343525+0000","last_fullsized":"2024-09-12T22:51:06.343525+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":24842,"num_write":378,"num_write_kb":79144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"61'62","reported_seq":52,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722749+0000","last_change":"2024-09-12T22:50:52.859828+0000","last_active":"2024-09-12T22:51:05.722749+0000","last_peered":"2024-09-12T22:51:05.722749+0000","last_clean":"2024-09-12T22:51:05.722749+0000","last_became_active":"2024-09-12T22:50:52.858911+0000","last_became_peered":"2024-09-12T22:50:52.858911+0000","last_unstale":"2024-09-12T22:51:05.722749+0000","last_undegraded":"2024-09-12T22:51:05.722749+0000","last_fullsized":"2024-09-12T22:51:05.722749+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"81'154","reported_seq":299,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:25.970377+0000","last_change":"2024-09-12T22:51:25.970406+0000","last_active":"2024-09-12T22:51:25.970377+0000","last_peered":"2024-09-12T22:51:25.970377+0000","last_clean":"2024-09-12T22:51:25.970377+0000","last_became_active":"2024-09-12T22:50:55.851050+0000","last_became_peered":"2024-09-12T22:50:55.851050+0000","last_unstale":"2024-09-12T22:51:25.970377+0000","last_undegraded":"2024-09-12T22:51:25.970377+0000","last_fullsized":"2024-09-12T22:51:25.970377+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'154","last_scrub_stamp":"2024-09-12T22:51:25.970294+0000","last_deep_scrub":"81'154","last_deep_scrub_stamp":"2024-09-12T22:51:25.970294+0000","last_clean_scrub_stamp":"2024-09-12T22:51:25.970294+0000","objects_scrubbed":2,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:17.818054+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"61'392","reported_seq":899,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:15.524978+0000","last_change":"2024-09-12T22:51:15.525004+0000","last_active":"2024-09-12T22:51:15.524978+0000","last_peered":"2024-09-12T22:51:15.524978+0000","last_clean":"2024-09-12T22:51:15.524978+0000","last_became_active":"2024-09-12T22:50:56.853383+0000","last_became_peered":"2024-09-12T22:50:56.853383+0000","last_unstale":"2024-09-12T22:51:15.524978+0000","last_undegraded":"2024-09-12T22:51:15.524978+0000","last_fullsized":"2024-09-12T22:51:15.524978+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'392","last_scrub_stamp":"2024-09-12T22:51:15.524885+0000","last_deep_scrub":"61'392","last_deep_scrub_stamp":"2024-09-12T22:51:15.524885+0000","last_clean_scrub_stamp":"2024-09-12T22:51:15.524885+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:09.273828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":9675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"81'239","reported_seq":401,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:28.408843+0000","last_change":"2024-09-12T22:51:28.408879+0000","last_active":"2024-09-12T22:51:28.408843+0000","last_peered":"2024-09-12T22:51:28.408843+0000","last_clean":"2024-09-12T22:51:28.408843+0000","last_became_active":"2024-09-12T22:50:55.852034+0000","last_became_peered":"2024-09-12T22:50:55.852034+0000","last_unstale":"2024-09-12T22:51:28.408843+0000","last_undegraded":"2024-09-12T22:51:28.408843+0000","last_fullsized":"2024-09-12T22:51:28.408843+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'239","last_scrub_stamp":"2024-09-12T22:51:28.408760+0000","last_deep_scrub":"81'239","last_deep_scrub_stamp":"2024-09-12T22:51:28.408760+0000","last_clean_scrub_stamp":"2024-09-12T22:51:28.408760+0000","objects_scrubbed":2,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:00:19.367010+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"61'464","reported_seq":638,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723461+0000","last_change":"2024-09-12T22:48:05.171143+0000","last_active":"2024-09-12T22:51:05.723461+0000","last_peered":"2024-09-12T22:51:05.723461+0000","last_clean":"2024-09-12T22:51:05.723461+0000","last_became_active":"2024-09-12T22:48:05.170374+0000","last_became_peered":"2024-09-12T22:48:05.170374+0000","last_unstale":"2024-09-12T22:51:05.723461+0000","last_undegraded":"2024-09-12T22:51:05.723461+0000","last_fullsized":"2024-09-12T22:51:05.723461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15522,"num_write":440,"num_write_kb":60335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"81'472","reported_seq":617,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:20.986643+0000","last_change":"2024-09-12T22:51:20.986672+0000","last_active":"2024-09-12T22:51:20.986643+0000","last_peered":"2024-09-12T22:51:20.986643+0000","last_clean":"2024-09-12T22:51:20.986643+0000","last_became_active":"2024-09-12T22:50:55.852074+0000","last_became_peered":"2024-09-12T22:50:55.852074+0000","last_unstale":"2024-09-12T22:51:20.986643+0000","last_undegraded":"2024-09-12T22:51:20.986643+0000","last_fullsized":"2024-09-12T22:51:20.986643+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'472","last_scrub_stamp":"2024-09-12T22:51:20.986558+0000","last_deep_scrub":"81'472","last_deep_scrub_stamp":"2024-09-12T22:51:20.986558+0000","last_clean_scrub_stamp":"2024-09-12T22:51:20.986558+0000","objects_scrubbed":2,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:12:43.272175+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":4267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"61'449","reported_seq":645,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:19.997376+0000","last_change":"2024-09-12T22:51:19.997441+0000","last_active":"2024-09-12T22:51:19.997376+0000","last_peered":"2024-09-12T22:51:19.997376+0000","last_clean":"2024-09-12T22:51:19.997376+0000","last_became_active":"2024-09-12T22:51:00.699592+0000","last_became_peered":"2024-09-12T22:51:00.699592+0000","last_unstale":"2024-09-12T22:51:19.997376+0000","last_undegraded":"2024-09-12T22:51:19.997376+0000","last_fullsized":"2024-09-12T22:51:19.997376+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'449","last_scrub_stamp":"2024-09-12T22:51:19.997252+0000","last_deep_scrub":"61'449","last_deep_scrub_stamp":"2024-09-12T22:51:19.997252+0000","last_clean_scrub_stamp":"2024-09-12T22:51:19.997252+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:31:23.493566+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":36634,"num_write":415,"num_write_kb":84238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"61'52","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723540+0000","last_change":"2024-09-12T22:50:52.857863+0000","last_active":"2024-09-12T22:51:05.723540+0000","last_peered":"2024-09-12T22:51:05.723540+0000","last_clean":"2024-09-12T22:51:05.723540+0000","last_became_active":"2024-09-12T22:50:52.857342+0000","last_became_peered":"2024-09-12T22:50:52.857342+0000","last_unstale":"2024-09-12T22:51:05.723540+0000","last_undegraded":"2024-09-12T22:51:05.723540+0000","last_fullsized":"2024-09-12T22:51:05.723540+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"61'434","reported_seq":1028,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343199+0000","last_change":"2024-09-12T22:50:58.701303+0000","last_active":"2024-09-12T22:51:06.343199+0000","last_peered":"2024-09-12T22:51:06.343199+0000","last_clean":"2024-09-12T22:51:06.343199+0000","last_became_active":"2024-09-12T22:50:58.700178+0000","last_became_peered":"2024-09-12T22:50:58.700178+0000","last_unstale":"2024-09-12T22:51:06.343199+0000","last_undegraded":"2024-09-12T22:51:06.343199+0000","last_fullsized":"2024-09-12T22:51:06.343199+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":39364,"num_write":402,"num_write_kb":59313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"81'197","reported_seq":361,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:24.488083+0000","last_change":"2024-09-12T22:51:24.488150+0000","last_active":"2024-09-12T22:51:24.488083+0000","last_peered":"2024-09-12T22:51:24.488083+0000","last_clean":"2024-09-12T22:51:24.488083+0000","last_became_active":"2024-09-12T22:50:55.852479+0000","last_became_peered":"2024-09-12T22:50:55.852479+0000","last_unstale":"2024-09-12T22:51:24.488083+0000","last_undegraded":"2024-09-12T22:51:24.488083+0000","last_fullsized":"2024-09-12T22:51:24.488083+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'197","last_scrub_stamp":"2024-09-12T22:51:24.487981+0000","last_deep_scrub":"81'197","last_deep_scrub_stamp":"2024-09-12T22:51:24.487981+0000","last_clean_scrub_stamp":"2024-09-12T22:51:24.487981+0000","objects_scrubbed":3,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:55.372926+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"61'457","reported_seq":592,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723851+0000","last_change":"2024-09-12T22:51:03.707374+0000","last_active":"2024-09-12T22:51:05.723851+0000","last_peered":"2024-09-12T22:51:05.723851+0000","last_clean":"2024-09-12T22:51:05.723851+0000","last_became_active":"2024-09-12T22:51:03.704514+0000","last_became_peered":"2024-09-12T22:51:03.704514+0000","last_unstale":"2024-09-12T22:51:05.723851+0000","last_undegraded":"2024-09-12T22:51:05.723851+0000","last_fullsized":"2024-09-12T22:51:05.723851+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10832,"num_write":419,"num_write_kb":34901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"61'106","reported_seq":233,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722979+0000","last_change":"2024-09-12T22:50:55.851086+0000","last_active":"2024-09-12T22:51:05.722979+0000","last_peered":"2024-09-12T22:51:05.722979+0000","last_clean":"2024-09-12T22:51:05.722979+0000","last_became_active":"2024-09-12T22:50:55.850764+0000","last_became_peered":"2024-09-12T22:50:55.850764+0000","last_unstale":"2024-09-12T22:51:05.722979+0000","last_undegraded":"2024-09-12T22:51:05.722979+0000","last_fullsized":"2024-09-12T22:51:05.722979+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"61'431","reported_seq":572,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723686+0000","last_change":"2024-09-12T22:51:02.710383+0000","last_active":"2024-09-12T22:51:05.723686+0000","last_peered":"2024-09-12T22:51:05.723686+0000","last_clean":"2024-09-12T22:51:05.723686+0000","last_became_active":"2024-09-12T22:51:02.707646+0000","last_became_peered":"2024-09-12T22:51:02.707646+0000","last_unstale":"2024-09-12T22:51:05.723686+0000","last_undegraded":"2024-09-12T22:51:05.723686+0000","last_fullsized":"2024-09-12T22:51:05.723686+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":10443,"num_write":392,"num_write_kb":63957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"61'49","reported_seq":204,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:18.585186+0000","last_change":"2024-09-12T22:51:18.585211+0000","last_active":"2024-09-12T22:51:18.585186+0000","last_peered":"2024-09-12T22:51:18.585186+0000","last_clean":"2024-09-12T22:51:18.585186+0000","last_became_active":"2024-09-12T22:50:52.857301+0000","last_became_peered":"2024-09-12T22:50:52.857301+0000","last_unstale":"2024-09-12T22:51:18.585186+0000","last_undegraded":"2024-09-12T22:51:18.585186+0000","last_fullsized":"2024-09-12T22:51:18.585186+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'49","last_scrub_stamp":"2024-09-12T22:51:18.585100+0000","last_deep_scrub":"61'49","last_deep_scrub_stamp":"2024-09-12T22:51:18.585100+0000","last_clean_scrub_stamp":"2024-09-12T22:51:18.585100+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:00:47.842878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"61'351","reported_seq":484,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:22.958605+0000","last_change":"2024-09-12T22:51:22.958631+0000","last_active":"2024-09-12T22:51:22.958605+0000","last_peered":"2024-09-12T22:51:22.958605+0000","last_clean":"2024-09-12T22:51:22.958605+0000","last_became_active":"2024-09-12T22:50:56.853610+0000","last_became_peered":"2024-09-12T22:50:56.853610+0000","last_unstale":"2024-09-12T22:51:22.958605+0000","last_undegraded":"2024-09-12T22:51:22.958605+0000","last_fullsized":"2024-09-12T22:51:22.958605+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'351","last_scrub_stamp":"2024-09-12T22:51:22.958519+0000","last_deep_scrub":"61'351","last_deep_scrub_stamp":"2024-09-12T22:51:22.958519+0000","last_clean_scrub_stamp":"2024-09-12T22:51:22.958519+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:53.587489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":137,"num_write":315,"num_write_kb":37943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"61'588","reported_seq":728,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723525+0000","last_change":"2024-09-12T22:48:04.174281+0000","last_active":"2024-09-12T22:51:05.723525+0000","last_peered":"2024-09-12T22:51:05.723525+0000","last_clean":"2024-09-12T22:51:05.723525+0000","last_became_active":"2024-09-12T22:48:04.173942+0000","last_became_peered":"2024-09-12T22:48:04.173942+0000","last_unstale":"2024-09-12T22:51:05.723525+0000","last_undegraded":"2024-09-12T22:51:05.723525+0000","last_fullsized":"2024-09-12T22:51:05.723525+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":4334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"61'400","reported_seq":569,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:19.557789+0000","last_change":"2024-09-12T22:51:19.557815+0000","last_active":"2024-09-12T22:51:19.557789+0000","last_peered":"2024-09-12T22:51:19.557789+0000","last_clean":"2024-09-12T22:51:19.557789+0000","last_became_active":"2024-09-12T22:48:05.176813+0000","last_became_peered":"2024-09-12T22:48:05.176813+0000","last_unstale":"2024-09-12T22:51:19.557789+0000","last_undegraded":"2024-09-12T22:51:19.557789+0000","last_fullsized":"2024-09-12T22:51:19.557789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'400","last_scrub_stamp":"2024-09-12T22:51:19.557704+0000","last_deep_scrub":"61'400","last_deep_scrub_stamp":"2024-09-12T22:51:19.557704+0000","last_clean_scrub_stamp":"2024-09-12T22:51:19.557704+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:45.672718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":9179,"num_write":363,"num_write_kb":67046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":243,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722648+0000","last_change":"2024-09-12T22:50:52.860243+0000","last_active":"2024-09-12T22:51:05.722648+0000","last_peered":"2024-09-12T22:51:05.722648+0000","last_clean":"2024-09-12T22:51:05.722648+0000","last_became_active":"2024-09-12T22:50:52.859754+0000","last_became_peered":"2024-09-12T22:50:52.859754+0000","last_unstale":"2024-09-12T22:51:05.722648+0000","last_undegraded":"2024-09-12T22:51:05.722648+0000","last_fullsized":"2024-09-12T22:51:05.722648+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:55.016634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:55.016634+0000","last_clean_scrub_stamp":"2024-09-12T22:47:55.016634+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":70,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723075+0000","last_change":"2024-09-12T22:50:52.858727+0000","last_active":"2024-09-12T22:51:05.723075+0000","last_peered":"2024-09-12T22:51:05.723075+0000","last_clean":"2024-09-12T22:51:05.723075+0000","last_became_active":"2024-09-12T22:50:52.857759+0000","last_became_peered":"2024-09-12T22:50:52.857759+0000","last_unstale":"2024-09-12T22:51:05.723075+0000","last_undegraded":"2024-09-12T22:51:05.723075+0000","last_fullsized":"2024-09-12T22:51:05.723075+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"61'506","reported_seq":646,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343127+0000","last_change":"2024-09-12T22:48:04.169704+0000","last_active":"2024-09-12T22:51:06.343127+0000","last_peered":"2024-09-12T22:51:06.343127+0000","last_clean":"2024-09-12T22:51:06.343127+0000","last_became_active":"2024-09-12T22:48:04.169474+0000","last_became_peered":"2024-09-12T22:48:04.169474+0000","last_unstale":"2024-09-12T22:51:06.343127+0000","last_undegraded":"2024-09-12T22:51:06.343127+0000","last_fullsized":"2024-09-12T22:51:06.343127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":444,"num_write_kb":8407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"61'422","reported_seq":596,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723838+0000","last_change":"2024-09-12T22:51:00.700237+0000","last_active":"2024-09-12T22:51:05.723838+0000","last_peered":"2024-09-12T22:51:05.723838+0000","last_clean":"2024-09-12T22:51:05.723838+0000","last_became_active":"2024-09-12T22:51:00.698391+0000","last_became_peered":"2024-09-12T22:51:00.698391+0000","last_unstale":"2024-09-12T22:51:05.723838+0000","last_undegraded":"2024-09-12T22:51:05.723838+0000","last_fullsized":"2024-09-12T22:51:05.723838+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":38484,"num_write":383,"num_write_kb":67099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722972+0000","last_change":"2024-09-12T22:50:52.859530+0000","last_active":"2024-09-12T22:51:05.722972+0000","last_peered":"2024-09-12T22:51:05.722972+0000","last_clean":"2024-09-12T22:51:05.722972+0000","last_became_active":"2024-09-12T22:50:52.858480+0000","last_became_peered":"2024-09-12T22:50:52.858480+0000","last_unstale":"2024-09-12T22:51:05.722972+0000","last_undegraded":"2024-09-12T22:51:05.722972+0000","last_fullsized":"2024-09-12T22:51:05.722972+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"81'108","reported_seq":314,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:28.519974+0000","last_change":"2024-09-12T22:51:28.520002+0000","last_active":"2024-09-12T22:51:28.519974+0000","last_peered":"2024-09-12T22:51:28.519974+0000","last_clean":"2024-09-12T22:51:28.519974+0000","last_became_active":"2024-09-12T22:50:55.852965+0000","last_became_peered":"2024-09-12T22:50:55.852965+0000","last_unstale":"2024-09-12T22:51:28.519974+0000","last_undegraded":"2024-09-12T22:51:28.519974+0000","last_fullsized":"2024-09-12T22:51:28.519974+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'108","last_scrub_stamp":"2024-09-12T22:51:28.519884+0000","last_deep_scrub":"81'108","last_deep_scrub_stamp":"2024-09-12T22:51:28.519884+0000","last_clean_scrub_stamp":"2024-09-12T22:51:28.519884+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:52.946262+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1463793,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":1459,"num_write":45,"num_write_kb":1459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1463793,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"61'436","reported_seq":619,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724296+0000","last_change":"2024-09-12T22:48:05.171819+0000","last_active":"2024-09-12T22:51:05.724296+0000","last_peered":"2024-09-12T22:51:05.724296+0000","last_clean":"2024-09-12T22:51:05.724296+0000","last_became_active":"2024-09-12T22:48:05.171293+0000","last_became_peered":"2024-09-12T22:48:05.171293+0000","last_unstale":"2024-09-12T22:51:05.724296+0000","last_undegraded":"2024-09-12T22:51:05.724296+0000","last_fullsized":"2024-09-12T22:51:05.724296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":27936,"num_write":401,"num_write_kb":51013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":161,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:31.456815+0000","last_change":"2024-09-12T22:51:31.456836+0000","last_active":"2024-09-12T22:51:31.456815+0000","last_peered":"2024-09-12T22:51:31.456815+0000","last_clean":"2024-09-12T22:51:31.456815+0000","last_became_active":"2024-09-12T22:48:00.042007+0000","last_became_peered":"2024-09-12T22:48:00.042007+0000","last_unstale":"2024-09-12T22:51:31.456815+0000","last_undegraded":"2024-09-12T22:51:31.456815+0000","last_fullsized":"2024-09-12T22:51:31.456815+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:51:31.456714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:51:31.456714+0000","last_clean_scrub_stamp":"2024-09-12T22:51:31.456714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:57:23.524239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036893100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"81'359","reported_seq":522,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:26.475989+0000","last_change":"2024-09-12T22:51:26.476020+0000","last_active":"2024-09-12T22:51:26.475989+0000","last_peered":"2024-09-12T22:51:26.475989+0000","last_clean":"2024-09-12T22:51:26.475989+0000","last_became_active":"2024-09-12T22:50:55.852029+0000","last_became_peered":"2024-09-12T22:50:55.852029+0000","last_unstale":"2024-09-12T22:51:26.475989+0000","last_undegraded":"2024-09-12T22:51:26.475989+0000","last_fullsized":"2024-09-12T22:51:26.475989+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'359","last_scrub_stamp":"2024-09-12T22:51:26.475898+0000","last_deep_scrub":"81'359","last_deep_scrub_stamp":"2024-09-12T22:51:26.475898+0000","last_clean_scrub_stamp":"2024-09-12T22:51:26.475898+0000","objects_scrubbed":2,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:12:58.416844+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":8307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"61'343","reported_seq":512,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:14.446520+0000","last_change":"2024-09-12T22:51:14.446546+0000","last_active":"2024-09-12T22:51:14.446520+0000","last_peered":"2024-09-12T22:51:14.446520+0000","last_clean":"2024-09-12T22:51:14.446520+0000","last_became_active":"2024-09-12T22:48:05.178010+0000","last_became_peered":"2024-09-12T22:48:05.178010+0000","last_unstale":"2024-09-12T22:51:14.446520+0000","last_undegraded":"2024-09-12T22:51:14.446520+0000","last_fullsized":"2024-09-12T22:51:14.446520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'343","last_scrub_stamp":"2024-09-12T22:51:14.446422+0000","last_deep_scrub":"61'343","last_deep_scrub_stamp":"2024-09-12T22:51:14.446422+0000","last_clean_scrub_stamp":"2024-09-12T22:51:14.446422+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:41.971251+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":6704,"num_write":316,"num_write_kb":42458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.722855+0000","last_change":"2024-09-12T22:50:52.858195+0000","last_active":"2024-09-12T22:51:05.722855+0000","last_peered":"2024-09-12T22:51:05.722855+0000","last_clean":"2024-09-12T22:51:05.722855+0000","last_became_active":"2024-09-12T22:50:52.857746+0000","last_became_peered":"2024-09-12T22:50:52.857746+0000","last_unstale":"2024-09-12T22:51:05.722855+0000","last_undegraded":"2024-09-12T22:51:05.722855+0000","last_fullsized":"2024-09-12T22:51:05.722855+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052714799999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"61'78","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723152+0000","last_change":"2024-09-12T22:50:52.858808+0000","last_active":"2024-09-12T22:51:05.723152+0000","last_peered":"2024-09-12T22:51:05.723152+0000","last_clean":"2024-09-12T22:51:05.723152+0000","last_became_active":"2024-09-12T22:50:52.858372+0000","last_became_peered":"2024-09-12T22:50:52.858372+0000","last_unstale":"2024-09-12T22:51:05.723152+0000","last_undegraded":"2024-09-12T22:51:05.723152+0000","last_fullsized":"2024-09-12T22:51:05.723152+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"61'404","reported_seq":623,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:21.513951+0000","last_change":"2024-09-12T22:51:21.513986+0000","last_active":"2024-09-12T22:51:21.513951+0000","last_peered":"2024-09-12T22:51:21.513951+0000","last_clean":"2024-09-12T22:51:21.513951+0000","last_became_active":"2024-09-12T22:48:05.177164+0000","last_became_peered":"2024-09-12T22:48:05.177164+0000","last_unstale":"2024-09-12T22:51:21.513951+0000","last_undegraded":"2024-09-12T22:51:21.513951+0000","last_fullsized":"2024-09-12T22:51:21.513951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'404","last_scrub_stamp":"2024-09-12T22:51:21.513822+0000","last_deep_scrub":"61'404","last_deep_scrub_stamp":"2024-09-12T22:51:21.513822+0000","last_clean_scrub_stamp":"2024-09-12T22:51:21.513822+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:49:34.958749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":35084,"num_write":365,"num_write_kb":71560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"61'269","reported_seq":396,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723471+0000","last_change":"2024-09-12T22:50:55.850951+0000","last_active":"2024-09-12T22:51:05.723471+0000","last_peered":"2024-09-12T22:51:05.723471+0000","last_clean":"2024-09-12T22:51:05.723471+0000","last_became_active":"2024-09-12T22:50:55.850689+0000","last_became_peered":"2024-09-12T22:50:55.850689+0000","last_unstale":"2024-09-12T22:51:05.723471+0000","last_undegraded":"2024-09-12T22:51:05.723471+0000","last_fullsized":"2024-09-12T22:51:05.723471+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":4189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":161,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:32.418795+0000","last_change":"2024-09-12T22:51:32.418817+0000","last_active":"2024-09-12T22:51:32.418795+0000","last_peered":"2024-09-12T22:51:32.418795+0000","last_clean":"2024-09-12T22:51:32.418795+0000","last_became_active":"2024-09-12T22:48:00.042132+0000","last_became_peered":"2024-09-12T22:48:00.042132+0000","last_unstale":"2024-09-12T22:51:32.418795+0000","last_undegraded":"2024-09-12T22:51:32.418795+0000","last_fullsized":"2024-09-12T22:51:32.418795+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:51:32.418694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:51:32.418694+0000","last_clean_scrub_stamp":"2024-09-12T22:51:32.418694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:09:39.426948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047590600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"61'362","reported_seq":852,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723548+0000","last_change":"2024-09-12T22:50:59.708186+0000","last_active":"2024-09-12T22:51:05.723548+0000","last_peered":"2024-09-12T22:51:05.723548+0000","last_clean":"2024-09-12T22:51:05.723548+0000","last_became_active":"2024-09-12T22:50:59.707126+0000","last_became_peered":"2024-09-12T22:50:59.707126+0000","last_unstale":"2024-09-12T22:51:05.723548+0000","last_undegraded":"2024-09-12T22:51:05.723548+0000","last_fullsized":"2024-09-12T22:51:05.723548+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":10445,"num_write":331,"num_write_kb":30096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"61'56","reported_seq":196,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.343461+0000","last_change":"2024-09-12T22:48:04.169109+0000","last_active":"2024-09-12T22:51:06.343461+0000","last_peered":"2024-09-12T22:51:06.343461+0000","last_clean":"2024-09-12T22:51:06.343461+0000","last_became_active":"2024-09-12T22:48:04.168655+0000","last_became_peered":"2024-09-12T22:48:04.168655+0000","last_unstale":"2024-09-12T22:51:06.343461+0000","last_undegraded":"2024-09-12T22:51:06.343461+0000","last_fullsized":"2024-09-12T22:51:06.343461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":153,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724515+0000","last_change":"2024-09-12T22:48:02.045390+0000","last_active":"2024-09-12T22:51:05.724515+0000","last_peered":"2024-09-12T22:51:05.724515+0000","last_clean":"2024-09-12T22:51:05.724515+0000","last_became_active":"2024-09-12T22:48:00.045356+0000","last_became_peered":"2024-09-12T22:48:00.045356+0000","last_unstale":"2024-09-12T22:51:05.724515+0000","last_undegraded":"2024-09-12T22:51:05.724515+0000","last_fullsized":"2024-09-12T22:51:05.724515+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040621599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"61'408","reported_seq":991,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:13.548235+0000","last_change":"2024-09-12T22:51:13.548260+0000","last_active":"2024-09-12T22:51:13.548235+0000","last_peered":"2024-09-12T22:51:13.548235+0000","last_clean":"2024-09-12T22:51:13.548235+0000","last_became_active":"2024-09-12T22:50:57.863486+0000","last_became_peered":"2024-09-12T22:50:57.863486+0000","last_unstale":"2024-09-12T22:51:13.548235+0000","last_undegraded":"2024-09-12T22:51:13.548235+0000","last_fullsized":"2024-09-12T22:51:13.548235+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'408","last_scrub_stamp":"2024-09-12T22:51:13.548143+0000","last_deep_scrub":"61'408","last_deep_scrub_stamp":"2024-09-12T22:51:13.548143+0000","last_clean_scrub_stamp":"2024-09-12T22:51:13.548143+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:00.237151+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":42311,"num_write":379,"num_write_kb":75412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"81'62","reported_seq":210,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:33.382870+0000","last_change":"2024-09-12T22:51:33.382943+0000","last_active":"2024-09-12T22:51:33.382870+0000","last_peered":"2024-09-12T22:51:33.382870+0000","last_clean":"2024-09-12T22:51:33.382870+0000","last_became_active":"2024-09-12T22:48:04.168244+0000","last_became_peered":"2024-09-12T22:48:04.168244+0000","last_unstale":"2024-09-12T22:51:33.382870+0000","last_undegraded":"2024-09-12T22:51:33.382870+0000","last_fullsized":"2024-09-12T22:51:33.382870+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'62","last_scrub_stamp":"2024-09-12T22:51:33.382778+0000","last_deep_scrub":"81'62","last_deep_scrub_stamp":"2024-09-12T22:51:33.382778+0000","last_clean_scrub_stamp":"2024-09-12T22:51:33.382778+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:00.519567+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":161,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:30.505975+0000","last_change":"2024-09-12T22:51:30.506010+0000","last_active":"2024-09-12T22:51:30.505975+0000","last_peered":"2024-09-12T22:51:30.505975+0000","last_clean":"2024-09-12T22:51:30.505975+0000","last_became_active":"2024-09-12T22:48:00.040536+0000","last_became_peered":"2024-09-12T22:48:00.040536+0000","last_unstale":"2024-09-12T22:51:30.505975+0000","last_undegraded":"2024-09-12T22:51:30.505975+0000","last_fullsized":"2024-09-12T22:51:30.505975+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:51:30.505859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:51:30.505859+0000","last_clean_scrub_stamp":"2024-09-12T22:51:30.505859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:00:21.464109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057699499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"61'430","reported_seq":991,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342801+0000","last_change":"2024-09-12T22:51:01.701692+0000","last_active":"2024-09-12T22:51:06.342801+0000","last_peered":"2024-09-12T22:51:06.342801+0000","last_clean":"2024-09-12T22:51:06.342801+0000","last_became_active":"2024-09-12T22:51:01.700292+0000","last_became_peered":"2024-09-12T22:51:01.700292+0000","last_unstale":"2024-09-12T22:51:06.342801+0000","last_undegraded":"2024-09-12T22:51:06.342801+0000","last_fullsized":"2024-09-12T22:51:06.342801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":26700,"num_write":399,"num_write_kb":55331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"81'115","reported_seq":277,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:22.473955+0000","last_change":"2024-09-12T22:51:22.473983+0000","last_active":"2024-09-12T22:51:22.473955+0000","last_peered":"2024-09-12T22:51:22.473955+0000","last_clean":"2024-09-12T22:51:22.473955+0000","last_became_active":"2024-09-12T22:50:55.851975+0000","last_became_peered":"2024-09-12T22:50:55.851975+0000","last_unstale":"2024-09-12T22:51:22.473955+0000","last_undegraded":"2024-09-12T22:51:22.473955+0000","last_fullsized":"2024-09-12T22:51:22.473955+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'115","last_scrub_stamp":"2024-09-12T22:51:22.473860+0000","last_deep_scrub":"81'115","last_deep_scrub_stamp":"2024-09-12T22:51:22.473860+0000","last_clean_scrub_stamp":"2024-09-12T22:51:22.473860+0000","objects_scrubbed":1,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:36:14.493054+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":1201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723769+0000","last_change":"2024-09-12T22:50:52.857531+0000","last_active":"2024-09-12T22:51:05.723769+0000","last_peered":"2024-09-12T22:51:05.723769+0000","last_clean":"2024-09-12T22:51:05.723769+0000","last_became_active":"2024-09-12T22:50:52.856757+0000","last_became_peered":"2024-09-12T22:50:52.856757+0000","last_unstale":"2024-09-12T22:51:05.723769+0000","last_undegraded":"2024-09-12T22:51:05.723769+0000","last_fullsized":"2024-09-12T22:51:05.723769+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:47:59.028872+0000","last_clean_scrub_stamp":"2024-09-12T22:47:59.028872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"61'406","reported_seq":930,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723458+0000","last_change":"2024-09-12T22:50:56.855069+0000","last_active":"2024-09-12T22:51:05.723458+0000","last_peered":"2024-09-12T22:51:05.723458+0000","last_clean":"2024-09-12T22:51:05.723458+0000","last_became_active":"2024-09-12T22:50:56.853376+0000","last_became_peered":"2024-09-12T22:50:56.853376+0000","last_unstale":"2024-09-12T22:51:05.723458+0000","last_undegraded":"2024-09-12T22:51:05.723458+0000","last_fullsized":"2024-09-12T22:51:05.723458+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17112,"num_write":373,"num_write_kb":79947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"61'378","reported_seq":542,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:26.958523+0000","last_change":"2024-09-12T22:51:26.958549+0000","last_active":"2024-09-12T22:51:26.958523+0000","last_peered":"2024-09-12T22:51:26.958523+0000","last_clean":"2024-09-12T22:51:26.958523+0000","last_became_active":"2024-09-12T22:50:57.861280+0000","last_became_peered":"2024-09-12T22:50:57.861280+0000","last_unstale":"2024-09-12T22:51:26.958523+0000","last_undegraded":"2024-09-12T22:51:26.958523+0000","last_fullsized":"2024-09-12T22:51:26.958523+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'378","last_scrub_stamp":"2024-09-12T22:51:26.958404+0000","last_deep_scrub":"61'378","last_deep_scrub_stamp":"2024-09-12T22:51:26.958404+0000","last_clean_scrub_stamp":"2024-09-12T22:51:26.958404+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:48.297955+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15048,"num_write":339,"num_write_kb":35238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"63'249","reported_seq":392,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723375+0000","last_change":"2024-09-12T22:50:55.849742+0000","last_active":"2024-09-12T22:51:05.723375+0000","last_peered":"2024-09-12T22:51:05.723375+0000","last_clean":"2024-09-12T22:51:05.723375+0000","last_became_active":"2024-09-12T22:50:55.849531+0000","last_became_peered":"2024-09-12T22:50:55.849531+0000","last_unstale":"2024-09-12T22:51:05.723375+0000","last_undegraded":"2024-09-12T22:51:05.723375+0000","last_fullsized":"2024-09-12T22:51:05.723375+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8461053,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":8364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8456257,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"61'405","reported_seq":578,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:29.541408+0000","last_change":"2024-09-12T22:51:29.541434+0000","last_active":"2024-09-12T22:51:29.541408+0000","last_peered":"2024-09-12T22:51:29.541408+0000","last_clean":"2024-09-12T22:51:29.541408+0000","last_became_active":"2024-09-12T22:48:05.176344+0000","last_became_peered":"2024-09-12T22:48:05.176344+0000","last_unstale":"2024-09-12T22:51:29.541408+0000","last_undegraded":"2024-09-12T22:51:29.541408+0000","last_fullsized":"2024-09-12T22:51:29.541408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'405","last_scrub_stamp":"2024-09-12T22:51:29.541317+0000","last_deep_scrub":"61'405","last_deep_scrub_stamp":"2024-09-12T22:51:29.541317+0000","last_clean_scrub_stamp":"2024-09-12T22:51:29.541317+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:07.482340+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":25018,"num_write":372,"num_write_kb":42936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"81'87","reported_seq":247,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:22.520095+0000","last_change":"2024-09-12T22:51:22.520147+0000","last_active":"2024-09-12T22:51:22.520095+0000","last_peered":"2024-09-12T22:51:22.520095+0000","last_clean":"2024-09-12T22:51:22.520095+0000","last_became_active":"2024-09-12T22:50:52.861594+0000","last_became_peered":"2024-09-12T22:50:52.861594+0000","last_unstale":"2024-09-12T22:51:22.520095+0000","last_undegraded":"2024-09-12T22:51:22.520095+0000","last_fullsized":"2024-09-12T22:51:22.520095+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'87","last_scrub_stamp":"2024-09-12T22:51:22.519986+0000","last_deep_scrub":"81'87","last_deep_scrub_stamp":"2024-09-12T22:51:22.519986+0000","last_clean_scrub_stamp":"2024-09-12T22:51:22.519986+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:40:55.944441+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"81'214","reported_seq":348,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:23.988689+0000","last_change":"2024-09-12T22:51:23.988721+0000","last_active":"2024-09-12T22:51:23.988689+0000","last_peered":"2024-09-12T22:51:23.988689+0000","last_clean":"2024-09-12T22:51:23.988689+0000","last_became_active":"2024-09-12T22:50:55.851798+0000","last_became_peered":"2024-09-12T22:50:55.851798+0000","last_unstale":"2024-09-12T22:51:23.988689+0000","last_undegraded":"2024-09-12T22:51:23.988689+0000","last_fullsized":"2024-09-12T22:51:23.988689+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'214","last_scrub_stamp":"2024-09-12T22:51:23.988604+0000","last_deep_scrub":"81'214","last_deep_scrub_stamp":"2024-09-12T22:51:23.988604+0000","last_clean_scrub_stamp":"2024-09-12T22:51:23.988604+0000","objects_scrubbed":1,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:05.350121+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":4171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"61'478","reported_seq":1108,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342686+0000","last_change":"2024-09-12T22:50:56.856443+0000","last_active":"2024-09-12T22:51:06.342686+0000","last_peered":"2024-09-12T22:51:06.342686+0000","last_clean":"2024-09-12T22:51:06.342686+0000","last_became_active":"2024-09-12T22:50:56.855150+0000","last_became_peered":"2024-09-12T22:50:56.855150+0000","last_unstale":"2024-09-12T22:51:06.342686+0000","last_undegraded":"2024-09-12T22:51:06.342686+0000","last_fullsized":"2024-09-12T22:51:06.342686+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":41320,"num_write":445,"num_write_kb":84826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":209,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"61'55","reported_seq":210,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:16.445712+0000","last_change":"2024-09-12T22:51:16.445736+0000","last_active":"2024-09-12T22:51:16.445712+0000","last_peered":"2024-09-12T22:51:16.445712+0000","last_clean":"2024-09-12T22:51:16.445712+0000","last_became_active":"2024-09-12T22:50:52.859296+0000","last_became_peered":"2024-09-12T22:50:52.859296+0000","last_unstale":"2024-09-12T22:51:16.445712+0000","last_undegraded":"2024-09-12T22:51:16.445712+0000","last_fullsized":"2024-09-12T22:51:16.445712+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'55","last_scrub_stamp":"2024-09-12T22:51:16.445610+0000","last_deep_scrub":"61'55","last_deep_scrub_stamp":"2024-09-12T22:51:16.445610+0000","last_clean_scrub_stamp":"2024-09-12T22:51:16.445610+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:10.194553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"61'447","reported_seq":635,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342752+0000","last_change":"2024-09-12T22:48:05.169648+0000","last_active":"2024-09-12T22:51:06.342752+0000","last_peered":"2024-09-12T22:51:06.342752+0000","last_clean":"2024-09-12T22:51:06.342752+0000","last_became_active":"2024-09-12T22:48:05.168356+0000","last_became_peered":"2024-09-12T22:48:05.168356+0000","last_unstale":"2024-09-12T22:51:06.342752+0000","last_undegraded":"2024-09-12T22:51:06.342752+0000","last_fullsized":"2024-09-12T22:51:06.342752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25877,"num_write":417,"num_write_kb":39269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"61'371","reported_seq":889,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724547+0000","last_change":"2024-09-12T22:51:02.709645+0000","last_active":"2024-09-12T22:51:05.724547+0000","last_peered":"2024-09-12T22:51:05.724547+0000","last_clean":"2024-09-12T22:51:05.724547+0000","last_became_active":"2024-09-12T22:51:02.708091+0000","last_became_peered":"2024-09-12T22:51:02.708091+0000","last_unstale":"2024-09-12T22:51:05.724547+0000","last_undegraded":"2024-09-12T22:51:05.724547+0000","last_fullsized":"2024-09-12T22:51:05.724547+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20950,"num_write":339,"num_write_kb":39207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"61'601","reported_seq":741,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342911+0000","last_change":"2024-09-12T22:48:04.169111+0000","last_active":"2024-09-12T22:51:06.342911+0000","last_peered":"2024-09-12T22:51:06.342911+0000","last_clean":"2024-09-12T22:51:06.342911+0000","last_became_active":"2024-09-12T22:48:04.168743+0000","last_became_peered":"2024-09-12T22:48:04.168743+0000","last_unstale":"2024-09-12T22:51:06.342911+0000","last_undegraded":"2024-09-12T22:51:06.342911+0000","last_fullsized":"2024-09-12T22:51:06.342911+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":535,"num_write_kb":8445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"61'438","reported_seq":979,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:06.342466+0000","last_change":"2024-09-12T22:50:57.863618+0000","last_active":"2024-09-12T22:51:06.342466+0000","last_peered":"2024-09-12T22:51:06.342466+0000","last_clean":"2024-09-12T22:51:06.342466+0000","last_became_active":"2024-09-12T22:50:57.861695+0000","last_became_peered":"2024-09-12T22:50:57.861695+0000","last_unstale":"2024-09-12T22:51:06.342466+0000","last_undegraded":"2024-09-12T22:51:06.342466+0000","last_fullsized":"2024-09-12T22:51:06.342466+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":16921,"num_write":411,"num_write_kb":146790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"81'186","reported_seq":347,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:26.462203+0000","last_change":"2024-09-12T22:51:26.462235+0000","last_active":"2024-09-12T22:51:26.462203+0000","last_peered":"2024-09-12T22:51:26.462203+0000","last_clean":"2024-09-12T22:51:26.462203+0000","last_became_active":"2024-09-12T22:50:55.852796+0000","last_became_peered":"2024-09-12T22:50:55.852796+0000","last_unstale":"2024-09-12T22:51:26.462203+0000","last_undegraded":"2024-09-12T22:51:26.462203+0000","last_fullsized":"2024-09-12T22:51:26.462203+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'186","last_scrub_stamp":"2024-09-12T22:51:26.462116+0000","last_deep_scrub":"81'186","last_deep_scrub_stamp":"2024-09-12T22:51:26.462116+0000","last_clean_scrub_stamp":"2024-09-12T22:51:26.462116+0000","objects_scrubbed":1,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:19:09.019048+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"61'386","reported_seq":887,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724188+0000","last_change":"2024-09-12T22:51:01.702122+0000","last_active":"2024-09-12T22:51:05.724188+0000","last_peered":"2024-09-12T22:51:05.724188+0000","last_clean":"2024-09-12T22:51:05.724188+0000","last_became_active":"2024-09-12T22:51:01.701006+0000","last_became_peered":"2024-09-12T22:51:01.701006+0000","last_unstale":"2024-09-12T22:51:05.724188+0000","last_undegraded":"2024-09-12T22:51:05.724188+0000","last_fullsized":"2024-09-12T22:51:05.724188+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":21487,"num_write":344,"num_write_kb":72645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"61'180","reported_seq":320,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723866+0000","last_change":"2024-09-12T22:48:04.174205+0000","last_active":"2024-09-12T22:51:05.723866+0000","last_peered":"2024-09-12T22:51:05.723866+0000","last_clean":"2024-09-12T22:51:05.723866+0000","last_became_active":"2024-09-12T22:48:04.173902+0000","last_became_peered":"2024-09-12T22:48:04.173902+0000","last_unstale":"2024-09-12T22:51:05.723866+0000","last_undegraded":"2024-09-12T22:51:05.723866+0000","last_fullsized":"2024-09-12T22:51:05.723866+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":12355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"61'396","reported_seq":561,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:23.537596+0000","last_change":"2024-09-12T22:51:23.537623+0000","last_active":"2024-09-12T22:51:23.537596+0000","last_peered":"2024-09-12T22:51:23.537596+0000","last_clean":"2024-09-12T22:51:23.537596+0000","last_became_active":"2024-09-12T22:48:05.172493+0000","last_became_peered":"2024-09-12T22:48:05.172493+0000","last_unstale":"2024-09-12T22:51:23.537596+0000","last_undegraded":"2024-09-12T22:51:23.537596+0000","last_fullsized":"2024-09-12T22:51:23.537596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'396","last_scrub_stamp":"2024-09-12T22:51:23.537469+0000","last_deep_scrub":"61'396","last_deep_scrub_stamp":"2024-09-12T22:51:23.537469+0000","last_clean_scrub_stamp":"2024-09-12T22:51:23.537469+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:44.314218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9980,"num_write":370,"num_write_kb":80321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"81'65","reported_seq":225,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:20.556732+0000","last_change":"2024-09-12T22:51:20.556757+0000","last_active":"2024-09-12T22:51:20.556732+0000","last_peered":"2024-09-12T22:51:20.556732+0000","last_clean":"2024-09-12T22:51:20.556732+0000","last_became_active":"2024-09-12T22:50:52.858938+0000","last_became_peered":"2024-09-12T22:50:52.858938+0000","last_unstale":"2024-09-12T22:51:20.556732+0000","last_undegraded":"2024-09-12T22:51:20.556732+0000","last_fullsized":"2024-09-12T22:51:20.556732+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'65","last_scrub_stamp":"2024-09-12T22:51:20.556625+0000","last_deep_scrub":"81'65","last_deep_scrub_stamp":"2024-09-12T22:51:20.556625+0000","last_clean_scrub_stamp":"2024-09-12T22:51:20.556625+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:00.739728+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"61'370","reported_seq":516,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723357+0000","last_change":"2024-09-12T22:50:59.705667+0000","last_active":"2024-09-12T22:51:05.723357+0000","last_peered":"2024-09-12T22:51:05.723357+0000","last_clean":"2024-09-12T22:51:05.723357+0000","last_became_active":"2024-09-12T22:50:59.704074+0000","last_became_peered":"2024-09-12T22:50:59.704074+0000","last_unstale":"2024-09-12T22:51:05.723357+0000","last_undegraded":"2024-09-12T22:51:05.723357+0000","last_fullsized":"2024-09-12T22:51:05.723357+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16468,"num_write":341,"num_write_kb":50344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"81'189","reported_seq":332,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:29.993909+0000","last_change":"2024-09-12T22:51:29.993969+0000","last_active":"2024-09-12T22:51:29.993909+0000","last_peered":"2024-09-12T22:51:29.993909+0000","last_clean":"2024-09-12T22:51:29.993909+0000","last_became_active":"2024-09-12T22:50:55.851467+0000","last_became_peered":"2024-09-12T22:50:55.851467+0000","last_unstale":"2024-09-12T22:51:29.993909+0000","last_undegraded":"2024-09-12T22:51:29.993909+0000","last_fullsized":"2024-09-12T22:51:29.993909+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'189","last_scrub_stamp":"2024-09-12T22:51:29.993826+0000","last_deep_scrub":"81'189","last_deep_scrub_stamp":"2024-09-12T22:51:29.993826+0000","last_clean_scrub_stamp":"2024-09-12T22:51:29.993826+0000","objects_scrubbed":2,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:07.320092+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"61'438","reported_seq":637,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723082+0000","last_change":"2024-09-12T22:50:59.706857+0000","last_active":"2024-09-12T22:51:05.723082+0000","last_peered":"2024-09-12T22:51:05.723082+0000","last_clean":"2024-09-12T22:51:05.723082+0000","last_became_active":"2024-09-12T22:50:59.703786+0000","last_became_peered":"2024-09-12T22:50:59.703786+0000","last_unstale":"2024-09-12T22:51:05.723082+0000","last_undegraded":"2024-09-12T22:51:05.723082+0000","last_fullsized":"2024-09-12T22:51:05.723082+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":38460,"num_write":412,"num_write_kb":96626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"61'185","reported_seq":343,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.724308+0000","last_change":"2024-09-12T22:50:55.853065+0000","last_active":"2024-09-12T22:51:05.724308+0000","last_peered":"2024-09-12T22:51:05.724308+0000","last_clean":"2024-09-12T22:51:05.724308+0000","last_became_active":"2024-09-12T22:50:55.852654+0000","last_became_peered":"2024-09-12T22:50:55.852654+0000","last_unstale":"2024-09-12T22:51:05.724308+0000","last_undegraded":"2024-09-12T22:51:05.724308+0000","last_fullsized":"2024-09-12T22:51:05.724308+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:03.149914+0000","last_clean_scrub_stamp":"2024-09-12T22:48:03.149914+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":12349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"61'418","reported_seq":600,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723779+0000","last_change":"2024-09-12T22:48:05.171815+0000","last_active":"2024-09-12T22:51:05.723779+0000","last_peered":"2024-09-12T22:51:05.723779+0000","last_clean":"2024-09-12T22:51:05.723779+0000","last_became_active":"2024-09-12T22:48:05.171361+0000","last_became_peered":"2024-09-12T22:48:05.171361+0000","last_unstale":"2024-09-12T22:51:05.723779+0000","last_undegraded":"2024-09-12T22:51:05.723779+0000","last_fullsized":"2024-09-12T22:51:05.723779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":27427,"num_write":388,"num_write_kb":67745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"81'160","reported_seq":295,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:24.498552+0000","last_change":"2024-09-12T22:51:24.498581+0000","last_active":"2024-09-12T22:51:24.498552+0000","last_peered":"2024-09-12T22:51:24.498552+0000","last_clean":"2024-09-12T22:51:24.498552+0000","last_became_active":"2024-09-12T22:50:55.851948+0000","last_became_peered":"2024-09-12T22:50:55.851948+0000","last_unstale":"2024-09-12T22:51:24.498552+0000","last_undegraded":"2024-09-12T22:51:24.498552+0000","last_fullsized":"2024-09-12T22:51:24.498552+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'160","last_scrub_stamp":"2024-09-12T22:51:24.498465+0000","last_deep_scrub":"81'160","last_deep_scrub_stamp":"2024-09-12T22:51:24.498465+0000","last_clean_scrub_stamp":"2024-09-12T22:51:24.498465+0000","objects_scrubbed":1,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:19:07.055397+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"61'479","reported_seq":653,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723118+0000","last_change":"2024-09-12T22:51:03.707091+0000","last_active":"2024-09-12T22:51:05.723118+0000","last_peered":"2024-09-12T22:51:05.723118+0000","last_clean":"2024-09-12T22:51:05.723118+0000","last_became_active":"2024-09-12T22:51:03.704137+0000","last_became_peered":"2024-09-12T22:51:03.704137+0000","last_unstale":"2024-09-12T22:51:05.723118+0000","last_undegraded":"2024-09-12T22:51:05.723118+0000","last_fullsized":"2024-09-12T22:51:05.723118+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":26793,"num_write":459,"num_write_kb":138325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"81'52","reported_seq":212,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:20.543143+0000","last_change":"2024-09-12T22:51:20.543198+0000","last_active":"2024-09-12T22:51:20.543143+0000","last_peered":"2024-09-12T22:51:20.543143+0000","last_clean":"2024-09-12T22:51:20.543143+0000","last_became_active":"2024-09-12T22:50:52.859983+0000","last_became_peered":"2024-09-12T22:50:52.859983+0000","last_unstale":"2024-09-12T22:51:20.543143+0000","last_undegraded":"2024-09-12T22:51:20.543143+0000","last_fullsized":"2024-09-12T22:51:20.543143+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'52","last_scrub_stamp":"2024-09-12T22:51:20.543052+0000","last_deep_scrub":"81'52","last_deep_scrub_stamp":"2024-09-12T22:51:20.543052+0000","last_clean_scrub_stamp":"2024-09-12T22:51:20.543052+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:00.609182+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2742,"num_read_kb":1405479,"num_write":24656,"num_write_kb":4261796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7339,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26737,"ondisk_log_size":26737,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127366156,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":45,"num_read_kb":1459,"num_write":4460,"num_write_kb":127655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":93806220,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254799872,"data_stored":254732312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5569,"internal_metadata":0},"log_size":6272,"ondisk_log_size":6272,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":67,"seq":287762808842,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150988,"kb_used_data":92924,"kb_used_omap":6,"kb_used_meta":58041,"kb_avail":94220852,"statfs":{"total":96636764160,"available":96482152448,"internally_reserved":0,"allocated":95154176,"data_stored":94739479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7164,"internal_metadata":59433988},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738415,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":169448,"kb_used_data":75864,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94202392,"statfs":{"total":96636764160,"available":96463249408,"internally_reserved":0,"allocated":77684736,"data_stored":77299268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738416,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":172708,"kb_used_data":83284,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94199132,"statfs":{"total":96636764160,"available":96459911168,"internally_reserved":0,"allocated":85282816,"data_stored":84886443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83980288,"data_stored":83958707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":76972032,"data_stored":76961881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":93847552,"data_stored":93811724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5569,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:51:35.231 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.232 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.232 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.232 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.232 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.232 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.232 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.232 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.233 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.233 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.233 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.233 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.233 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.233 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.233 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.234 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.234 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.234 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.234 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.234 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.234 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.234 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.235 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.235 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.236 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.236 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T22:47:55.016634+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=47, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.236 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T22:47:59.028872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=47, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.236 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.236 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.236 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T22:47:59.028872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=47, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.236 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.236 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T22:47:59.028872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=47, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.237 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.237 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.237 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.237 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.237 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T22:47:59.028872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=47, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.237 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.237 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T22:47:59.028872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=47, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.237 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.238 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.238 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.238 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.238 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.238 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.238 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.238 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.238 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.239 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.239 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.239 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T22:48:03.149914+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.239 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.239 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:35.239 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T22:51:55.240 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:51:55.550 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:51:55.552 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-09-12T22:51:55.561 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2024-09-12T22:51:54.186084+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127956543,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":2923,"num_read_kb":1407056,"num_write":29321,"num_write_kb":4392913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7366,"num_bytes_recovered":93806220,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33197,"ondisk_log_size":33197,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":493144,"kb_used_data":252072,"kb_used_omap":10,"kb_used_meta":241013,"kb_avail":282622376,"statfs":{"total":289910292480,"available":289405313024,"internally_reserved":0,"allocated":258121728,"data_stored":256925190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10354,"internal_metadata":246798222},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003073"},"pg_stats":[{"pgid":"4.3f","version":"61'404","reported_seq":572,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:17.547756+0000","last_change":"2024-09-12T22:51:17.547783+0000","last_active":"2024-09-12T22:51:17.547756+0000","last_peered":"2024-09-12T22:51:17.547756+0000","last_clean":"2024-09-12T22:51:17.547756+0000","last_became_active":"2024-09-12T22:48:05.172964+0000","last_became_peered":"2024-09-12T22:48:05.172964+0000","last_unstale":"2024-09-12T22:51:17.547756+0000","last_undegraded":"2024-09-12T22:51:17.547756+0000","last_fullsized":"2024-09-12T22:51:17.547756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'404","last_scrub_stamp":"2024-09-12T22:51:17.547649+0000","last_deep_scrub":"61'404","last_deep_scrub_stamp":"2024-09-12T22:51:17.547649+0000","last_clean_scrub_stamp":"2024-09-12T22:51:17.547649+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:03:32.488397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9582,"num_write":371,"num_write_kb":42180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"61'425","reported_seq":642,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:21.520920+0000","last_change":"2024-09-12T22:51:21.520960+0000","last_active":"2024-09-12T22:51:21.520920+0000","last_peered":"2024-09-12T22:51:21.520920+0000","last_clean":"2024-09-12T22:51:21.520920+0000","last_became_active":"2024-09-12T22:48:05.172684+0000","last_became_peered":"2024-09-12T22:48:05.172684+0000","last_unstale":"2024-09-12T22:51:21.520920+0000","last_undegraded":"2024-09-12T22:51:21.520920+0000","last_fullsized":"2024-09-12T22:51:21.520920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'425","last_scrub_stamp":"2024-09-12T22:51:21.520763+0000","last_deep_scrub":"61'425","last_deep_scrub_stamp":"2024-09-12T22:51:21.520763+0000","last_clean_scrub_stamp":"2024-09-12T22:51:21.520763+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:08.747037+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":40466,"num_write":394,"num_write_kb":96045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"61'385","reported_seq":525,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:16.998541+0000","last_change":"2024-09-12T22:51:16.998566+0000","last_active":"2024-09-12T22:51:16.998541+0000","last_peered":"2024-09-12T22:51:16.998541+0000","last_clean":"2024-09-12T22:51:16.998541+0000","last_became_active":"2024-09-12T22:51:00.700490+0000","last_became_peered":"2024-09-12T22:51:00.700490+0000","last_unstale":"2024-09-12T22:51:16.998541+0000","last_undegraded":"2024-09-12T22:51:16.998541+0000","last_fullsized":"2024-09-12T22:51:16.998541+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'385","last_scrub_stamp":"2024-09-12T22:51:16.998452+0000","last_deep_scrub":"61'385","last_deep_scrub_stamp":"2024-09-12T22:51:16.998452+0000","last_clean_scrub_stamp":"2024-09-12T22:51:16.998452+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:25.166404+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":7348,"num_write":352,"num_write_kb":34517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"61'395","reported_seq":572,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:48.116245+0000","last_change":"2024-09-12T22:51:48.116266+0000","last_active":"2024-09-12T22:51:48.116245+0000","last_peered":"2024-09-12T22:51:48.116245+0000","last_clean":"2024-09-12T22:51:48.116245+0000","last_became_active":"2024-09-12T22:51:02.708216+0000","last_became_peered":"2024-09-12T22:51:02.708216+0000","last_unstale":"2024-09-12T22:51:48.116245+0000","last_undegraded":"2024-09-12T22:51:48.116245+0000","last_fullsized":"2024-09-12T22:51:48.116245+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'395","last_scrub_stamp":"2024-09-12T22:51:48.116167+0000","last_deep_scrub":"61'395","last_deep_scrub_stamp":"2024-09-12T22:51:48.116167+0000","last_clean_scrub_stamp":"2024-09-12T22:51:48.116167+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:17.024058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":25803,"num_write":361,"num_write_kb":71646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"61'410","reported_seq":582,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:35.335077+0000","last_change":"2024-09-12T22:51:35.335105+0000","last_active":"2024-09-12T22:51:35.335077+0000","last_peered":"2024-09-12T22:51:35.335077+0000","last_clean":"2024-09-12T22:51:35.335077+0000","last_became_active":"2024-09-12T22:48:05.169940+0000","last_became_peered":"2024-09-12T22:48:05.169940+0000","last_unstale":"2024-09-12T22:51:35.335077+0000","last_undegraded":"2024-09-12T22:51:35.335077+0000","last_fullsized":"2024-09-12T22:51:35.335077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'410","last_scrub_stamp":"2024-09-12T22:51:35.334987+0000","last_deep_scrub":"61'410","last_deep_scrub_stamp":"2024-09-12T22:51:35.334987+0000","last_clean_scrub_stamp":"2024-09-12T22:51:35.334987+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:43.999399+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":20544,"num_write":387,"num_write_kb":55745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"61'384","reported_seq":508,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:50.082674+0000","last_change":"2024-09-12T22:51:50.082700+0000","last_active":"2024-09-12T22:51:50.082674+0000","last_peered":"2024-09-12T22:51:50.082674+0000","last_clean":"2024-09-12T22:51:50.082674+0000","last_became_active":"2024-09-12T22:51:03.704293+0000","last_became_peered":"2024-09-12T22:51:03.704293+0000","last_unstale":"2024-09-12T22:51:50.082674+0000","last_undegraded":"2024-09-12T22:51:50.082674+0000","last_fullsized":"2024-09-12T22:51:50.082674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'384","last_scrub_stamp":"2024-09-12T22:51:50.082584+0000","last_deep_scrub":"61'384","last_deep_scrub_stamp":"2024-09-12T22:51:50.082584+0000","last_clean_scrub_stamp":"2024-09-12T22:51:50.082584+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:31:07.256104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5069,"num_write":355,"num_write_kb":38430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"61'461","reported_seq":665,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:24.933889+0000","last_change":"2024-09-12T22:51:24.933916+0000","last_active":"2024-09-12T22:51:24.933889+0000","last_peered":"2024-09-12T22:51:24.933889+0000","last_clean":"2024-09-12T22:51:24.933889+0000","last_became_active":"2024-09-12T22:50:56.856720+0000","last_became_peered":"2024-09-12T22:50:56.856720+0000","last_unstale":"2024-09-12T22:51:24.933889+0000","last_undegraded":"2024-09-12T22:51:24.933889+0000","last_fullsized":"2024-09-12T22:51:24.933889+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'461","last_scrub_stamp":"2024-09-12T22:51:24.933802+0000","last_deep_scrub":"61'461","last_deep_scrub_stamp":"2024-09-12T22:51:24.933802+0000","last_clean_scrub_stamp":"2024-09-12T22:51:24.933802+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:19:33.581183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":30574,"num_write":435,"num_write_kb":92996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"61'385","reported_seq":527,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:18.026449+0000","last_change":"2024-09-12T22:51:18.026473+0000","last_active":"2024-09-12T22:51:18.026449+0000","last_peered":"2024-09-12T22:51:18.026449+0000","last_clean":"2024-09-12T22:51:18.026449+0000","last_became_active":"2024-09-12T22:51:00.700472+0000","last_became_peered":"2024-09-12T22:51:00.700472+0000","last_unstale":"2024-09-12T22:51:18.026449+0000","last_undegraded":"2024-09-12T22:51:18.026449+0000","last_fullsized":"2024-09-12T22:51:18.026449+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'385","last_scrub_stamp":"2024-09-12T22:51:18.026325+0000","last_deep_scrub":"61'385","last_deep_scrub_stamp":"2024-09-12T22:51:18.026325+0000","last_clean_scrub_stamp":"2024-09-12T22:51:18.026325+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:33.411721+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9031,"num_write":340,"num_write_kb":84729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"61'435","reported_seq":594,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:17.493544+0000","last_change":"2024-09-12T22:51:17.493570+0000","last_active":"2024-09-12T22:51:17.493544+0000","last_peered":"2024-09-12T22:51:17.493544+0000","last_clean":"2024-09-12T22:51:17.493544+0000","last_became_active":"2024-09-12T22:48:05.177284+0000","last_became_peered":"2024-09-12T22:48:05.177284+0000","last_unstale":"2024-09-12T22:51:17.493544+0000","last_undegraded":"2024-09-12T22:51:17.493544+0000","last_fullsized":"2024-09-12T22:51:17.493544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'435","last_scrub_stamp":"2024-09-12T22:51:17.493458+0000","last_deep_scrub":"61'435","last_deep_scrub_stamp":"2024-09-12T22:51:17.493458+0000","last_clean_scrub_stamp":"2024-09-12T22:51:17.493458+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:21.403217+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8316,"num_write":403,"num_write_kb":71851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"61'443","reported_seq":657,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:27.442616+0000","last_change":"2024-09-12T22:51:27.442641+0000","last_active":"2024-09-12T22:51:27.442616+0000","last_peered":"2024-09-12T22:51:27.442616+0000","last_clean":"2024-09-12T22:51:27.442616+0000","last_became_active":"2024-09-12T22:48:05.171686+0000","last_became_peered":"2024-09-12T22:48:05.171686+0000","last_unstale":"2024-09-12T22:51:27.442616+0000","last_undegraded":"2024-09-12T22:51:27.442616+0000","last_fullsized":"2024-09-12T22:51:27.442616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'443","last_scrub_stamp":"2024-09-12T22:51:27.442524+0000","last_deep_scrub":"61'443","last_deep_scrub_stamp":"2024-09-12T22:51:27.442524+0000","last_clean_scrub_stamp":"2024-09-12T22:51:27.442524+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:24.651831+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40751,"num_write":407,"num_write_kb":116626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"61'383","reported_seq":518,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:49.071239+0000","last_change":"2024-09-12T22:51:49.071282+0000","last_active":"2024-09-12T22:51:49.071239+0000","last_peered":"2024-09-12T22:51:49.071239+0000","last_clean":"2024-09-12T22:51:49.071239+0000","last_became_active":"2024-09-12T22:51:02.710579+0000","last_became_peered":"2024-09-12T22:51:02.710579+0000","last_unstale":"2024-09-12T22:51:49.071239+0000","last_undegraded":"2024-09-12T22:51:49.071239+0000","last_fullsized":"2024-09-12T22:51:49.071239+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'383","last_scrub_stamp":"2024-09-12T22:51:49.071138+0000","last_deep_scrub":"61'383","last_deep_scrub_stamp":"2024-09-12T22:51:49.071138+0000","last_clean_scrub_stamp":"2024-09-12T22:51:49.071138+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:56.043201+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5475,"num_write":365,"num_write_kb":63204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"61'366","reported_seq":900,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:14.539254+0000","last_change":"2024-09-12T22:51:14.539280+0000","last_active":"2024-09-12T22:51:14.539254+0000","last_peered":"2024-09-12T22:51:14.539254+0000","last_clean":"2024-09-12T22:51:14.539254+0000","last_became_active":"2024-09-12T22:50:58.698711+0000","last_became_peered":"2024-09-12T22:50:58.698711+0000","last_unstale":"2024-09-12T22:51:14.539254+0000","last_undegraded":"2024-09-12T22:51:14.539254+0000","last_fullsized":"2024-09-12T22:51:14.539254+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'366","last_scrub_stamp":"2024-09-12T22:51:14.539130+0000","last_deep_scrub":"61'366","last_deep_scrub_stamp":"2024-09-12T22:51:14.539130+0000","last_clean_scrub_stamp":"2024-09-12T22:51:14.539130+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:42.502517+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":35222,"num_write":342,"num_write_kb":74947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"61'434","reported_seq":631,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:37.341971+0000","last_change":"2024-09-12T22:51:37.341999+0000","last_active":"2024-09-12T22:51:37.341971+0000","last_peered":"2024-09-12T22:51:37.341971+0000","last_clean":"2024-09-12T22:51:37.341971+0000","last_became_active":"2024-09-12T22:48:05.170794+0000","last_became_peered":"2024-09-12T22:48:05.170794+0000","last_unstale":"2024-09-12T22:51:37.341971+0000","last_undegraded":"2024-09-12T22:51:37.341971+0000","last_fullsized":"2024-09-12T22:51:37.341971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'434","last_scrub_stamp":"2024-09-12T22:51:37.341864+0000","last_deep_scrub":"61'434","last_deep_scrub_stamp":"2024-09-12T22:51:37.341864+0000","last_clean_scrub_stamp":"2024-09-12T22:51:37.341864+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:37.381989+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":19623,"num_write":389,"num_write_kb":83457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"61'432","reported_seq":610,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:30.965788+0000","last_change":"2024-09-12T22:51:30.965845+0000","last_active":"2024-09-12T22:51:30.965788+0000","last_peered":"2024-09-12T22:51:30.965788+0000","last_clean":"2024-09-12T22:51:30.965788+0000","last_became_active":"2024-09-12T22:50:58.700107+0000","last_became_peered":"2024-09-12T22:50:58.700107+0000","last_unstale":"2024-09-12T22:51:30.965788+0000","last_undegraded":"2024-09-12T22:51:30.965788+0000","last_fullsized":"2024-09-12T22:51:30.965788+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'432","last_scrub_stamp":"2024-09-12T22:51:30.965666+0000","last_deep_scrub":"61'432","last_deep_scrub_stamp":"2024-09-12T22:51:30.965666+0000","last_clean_scrub_stamp":"2024-09-12T22:51:30.965666+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:27:20.749081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":23332,"num_write":401,"num_write_kb":75871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"61'406","reported_seq":582,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:22.007624+0000","last_change":"2024-09-12T22:51:22.007658+0000","last_active":"2024-09-12T22:51:22.007624+0000","last_peered":"2024-09-12T22:51:22.007624+0000","last_clean":"2024-09-12T22:51:22.007624+0000","last_became_active":"2024-09-12T22:50:55.849568+0000","last_became_peered":"2024-09-12T22:50:55.849568+0000","last_unstale":"2024-09-12T22:51:22.007624+0000","last_undegraded":"2024-09-12T22:51:22.007624+0000","last_fullsized":"2024-09-12T22:51:22.007624+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'406","last_scrub_stamp":"2024-09-12T22:51:22.007494+0000","last_deep_scrub":"61'406","last_deep_scrub_stamp":"2024-09-12T22:51:22.007494+0000","last_clean_scrub_stamp":"2024-09-12T22:51:22.007494+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:28:45.134382+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":18162,"num_write":365,"num_write_kb":58919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"61'444","reported_seq":584,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:16.031447+0000","last_change":"2024-09-12T22:51:16.031494+0000","last_active":"2024-09-12T22:51:16.031447+0000","last_peered":"2024-09-12T22:51:16.031447+0000","last_clean":"2024-09-12T22:51:16.031447+0000","last_became_active":"2024-09-12T22:51:01.700744+0000","last_became_peered":"2024-09-12T22:51:01.700744+0000","last_unstale":"2024-09-12T22:51:16.031447+0000","last_undegraded":"2024-09-12T22:51:16.031447+0000","last_fullsized":"2024-09-12T22:51:16.031447+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'444","last_scrub_stamp":"2024-09-12T22:51:16.031333+0000","last_deep_scrub":"61'444","last_deep_scrub_stamp":"2024-09-12T22:51:16.031333+0000","last_clean_scrub_stamp":"2024-09-12T22:51:16.031333+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:38.746367+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":410,"num_write_kb":63144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"61'443","reported_seq":625,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:15.477254+0000","last_change":"2024-09-12T22:51:15.477280+0000","last_active":"2024-09-12T22:51:15.477254+0000","last_peered":"2024-09-12T22:51:15.477254+0000","last_clean":"2024-09-12T22:51:15.477254+0000","last_became_active":"2024-09-12T22:48:05.177965+0000","last_became_peered":"2024-09-12T22:48:05.177965+0000","last_unstale":"2024-09-12T22:51:15.477254+0000","last_undegraded":"2024-09-12T22:51:15.477254+0000","last_fullsized":"2024-09-12T22:51:15.477254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'443","last_scrub_stamp":"2024-09-12T22:51:15.477164+0000","last_deep_scrub":"61'443","last_deep_scrub_stamp":"2024-09-12T22:51:15.477164+0000","last_clean_scrub_stamp":"2024-09-12T22:51:15.477164+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:21.477261+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":14687,"num_write":408,"num_write_kb":80026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"61'439","reported_seq":674,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:36.339107+0000","last_change":"2024-09-12T22:51:36.339134+0000","last_active":"2024-09-12T22:51:36.339107+0000","last_peered":"2024-09-12T22:51:36.339107+0000","last_clean":"2024-09-12T22:51:36.339107+0000","last_became_active":"2024-09-12T22:48:05.170578+0000","last_became_peered":"2024-09-12T22:48:05.170578+0000","last_unstale":"2024-09-12T22:51:36.339107+0000","last_undegraded":"2024-09-12T22:51:36.339107+0000","last_fullsized":"2024-09-12T22:51:36.339107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'439","last_scrub_stamp":"2024-09-12T22:51:36.339005+0000","last_deep_scrub":"61'439","last_deep_scrub_stamp":"2024-09-12T22:51:36.339005+0000","last_clean_scrub_stamp":"2024-09-12T22:51:36.339005+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:46.777468+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":47063,"num_write":400,"num_write_kb":100535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"61'444","reported_seq":669,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:23.424561+0000","last_change":"2024-09-12T22:51:23.424617+0000","last_active":"2024-09-12T22:51:23.424561+0000","last_peered":"2024-09-12T22:51:23.424561+0000","last_clean":"2024-09-12T22:51:23.424561+0000","last_became_active":"2024-09-12T22:48:05.176680+0000","last_became_peered":"2024-09-12T22:48:05.176680+0000","last_unstale":"2024-09-12T22:51:23.424561+0000","last_undegraded":"2024-09-12T22:51:23.424561+0000","last_fullsized":"2024-09-12T22:51:23.424561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'444","last_scrub_stamp":"2024-09-12T22:51:23.424460+0000","last_deep_scrub":"61'444","last_deep_scrub_stamp":"2024-09-12T22:51:23.424460+0000","last_clean_scrub_stamp":"2024-09-12T22:51:23.424460+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:04.269715+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":42758,"num_write":403,"num_write_kb":67827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"61'433","reported_seq":579,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:47.122207+0000","last_change":"2024-09-12T22:51:47.122230+0000","last_active":"2024-09-12T22:51:47.122207+0000","last_peered":"2024-09-12T22:51:47.122207+0000","last_clean":"2024-09-12T22:51:47.122207+0000","last_became_active":"2024-09-12T22:51:02.708090+0000","last_became_peered":"2024-09-12T22:51:02.708090+0000","last_unstale":"2024-09-12T22:51:47.122207+0000","last_undegraded":"2024-09-12T22:51:47.122207+0000","last_fullsized":"2024-09-12T22:51:47.122207+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'433","last_scrub_stamp":"2024-09-12T22:51:47.122131+0000","last_deep_scrub":"61'433","last_deep_scrub_stamp":"2024-09-12T22:51:47.122131+0000","last_clean_scrub_stamp":"2024-09-12T22:51:47.122131+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:25.826957+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":10750,"num_write":397,"num_write_kb":34708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"61'413","reported_seq":597,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:28.971245+0000","last_change":"2024-09-12T22:51:28.971283+0000","last_active":"2024-09-12T22:51:28.971245+0000","last_peered":"2024-09-12T22:51:28.971245+0000","last_clean":"2024-09-12T22:51:28.971245+0000","last_became_active":"2024-09-12T22:50:58.699982+0000","last_became_peered":"2024-09-12T22:50:58.699982+0000","last_unstale":"2024-09-12T22:51:28.971245+0000","last_undegraded":"2024-09-12T22:51:28.971245+0000","last_fullsized":"2024-09-12T22:51:28.971245+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'413","last_scrub_stamp":"2024-09-12T22:51:28.971124+0000","last_deep_scrub":"61'413","last_deep_scrub_stamp":"2024-09-12T22:51:28.971124+0000","last_clean_scrub_stamp":"2024-09-12T22:51:28.971124+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:41:37.457817+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":25621,"num_write":385,"num_write_kb":63908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"61'462","reported_seq":1075,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:41.322361+0000","last_change":"2024-09-12T22:51:41.322388+0000","last_active":"2024-09-12T22:51:41.322361+0000","last_peered":"2024-09-12T22:51:41.322361+0000","last_clean":"2024-09-12T22:51:41.322361+0000","last_became_active":"2024-09-12T22:50:58.700047+0000","last_became_peered":"2024-09-12T22:50:58.700047+0000","last_unstale":"2024-09-12T22:51:41.322361+0000","last_undegraded":"2024-09-12T22:51:41.322361+0000","last_fullsized":"2024-09-12T22:51:41.322361+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'462","last_scrub_stamp":"2024-09-12T22:51:41.322253+0000","last_deep_scrub":"61'462","last_deep_scrub_stamp":"2024-09-12T22:51:41.322253+0000","last_clean_scrub_stamp":"2024-09-12T22:51:41.322253+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:03:59.104498+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28920,"num_write":428,"num_write_kb":76277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"61'413","reported_seq":957,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:40.347956+0000","last_change":"2024-09-12T22:51:40.347986+0000","last_active":"2024-09-12T22:51:40.347956+0000","last_peered":"2024-09-12T22:51:40.347956+0000","last_clean":"2024-09-12T22:51:40.347956+0000","last_became_active":"2024-09-12T22:50:57.860819+0000","last_became_peered":"2024-09-12T22:50:57.860819+0000","last_unstale":"2024-09-12T22:51:40.347956+0000","last_undegraded":"2024-09-12T22:51:40.347956+0000","last_fullsized":"2024-09-12T22:51:40.347956+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'413","last_scrub_stamp":"2024-09-12T22:51:40.347817+0000","last_deep_scrub":"61'413","last_deep_scrub_stamp":"2024-09-12T22:51:40.347817+0000","last_clean_scrub_stamp":"2024-09-12T22:51:40.347817+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:52.345890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":14661,"num_write":381,"num_write_kb":72596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"61'475","reported_seq":689,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:25.495344+0000","last_change":"2024-09-12T22:51:25.495369+0000","last_active":"2024-09-12T22:51:25.495344+0000","last_peered":"2024-09-12T22:51:25.495344+0000","last_clean":"2024-09-12T22:51:25.495344+0000","last_became_active":"2024-09-12T22:48:05.172437+0000","last_became_peered":"2024-09-12T22:48:05.172437+0000","last_unstale":"2024-09-12T22:51:25.495344+0000","last_undegraded":"2024-09-12T22:51:25.495344+0000","last_fullsized":"2024-09-12T22:51:25.495344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'475","last_scrub_stamp":"2024-09-12T22:51:25.495255+0000","last_deep_scrub":"61'475","last_deep_scrub_stamp":"2024-09-12T22:51:25.495255+0000","last_clean_scrub_stamp":"2024-09-12T22:51:25.495255+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:50:22.396824+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":32397,"num_write":452,"num_write_kb":105406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"61'413","reported_seq":972,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:47.455302+0000","last_change":"2024-09-12T22:51:47.455330+0000","last_active":"2024-09-12T22:51:47.455302+0000","last_peered":"2024-09-12T22:51:47.455302+0000","last_clean":"2024-09-12T22:51:47.455302+0000","last_became_active":"2024-09-12T22:51:02.708084+0000","last_became_peered":"2024-09-12T22:51:02.708084+0000","last_unstale":"2024-09-12T22:51:47.455302+0000","last_undegraded":"2024-09-12T22:51:47.455302+0000","last_fullsized":"2024-09-12T22:51:47.455302+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'413","last_scrub_stamp":"2024-09-12T22:51:47.455189+0000","last_deep_scrub":"61'413","last_deep_scrub_stamp":"2024-09-12T22:51:47.455189+0000","last_clean_scrub_stamp":"2024-09-12T22:51:47.455189+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:46.028115+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4773,"num_write":395,"num_write_kb":21871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"61'453","reported_seq":1036,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:43.347316+0000","last_change":"2024-09-12T22:51:43.347342+0000","last_active":"2024-09-12T22:51:43.347316+0000","last_peered":"2024-09-12T22:51:43.347316+0000","last_clean":"2024-09-12T22:51:43.347316+0000","last_became_active":"2024-09-12T22:50:58.699585+0000","last_became_peered":"2024-09-12T22:50:58.699585+0000","last_unstale":"2024-09-12T22:51:43.347316+0000","last_undegraded":"2024-09-12T22:51:43.347316+0000","last_fullsized":"2024-09-12T22:51:43.347316+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'453","last_scrub_stamp":"2024-09-12T22:51:43.347226+0000","last_deep_scrub":"61'453","last_deep_scrub_stamp":"2024-09-12T22:51:43.347226+0000","last_clean_scrub_stamp":"2024-09-12T22:51:43.347226+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:12.758755+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18201,"num_write":409,"num_write_kb":47008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"61'402","reported_seq":580,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:19.026955+0000","last_change":"2024-09-12T22:51:19.027019+0000","last_active":"2024-09-12T22:51:19.026955+0000","last_peered":"2024-09-12T22:51:19.026955+0000","last_clean":"2024-09-12T22:51:19.026955+0000","last_became_active":"2024-09-12T22:51:01.701850+0000","last_became_peered":"2024-09-12T22:51:01.701850+0000","last_unstale":"2024-09-12T22:51:19.026955+0000","last_undegraded":"2024-09-12T22:51:19.026955+0000","last_fullsized":"2024-09-12T22:51:19.026955+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'402","last_scrub_stamp":"2024-09-12T22:51:19.026854+0000","last_deep_scrub":"61'402","last_deep_scrub_stamp":"2024-09-12T22:51:19.026854+0000","last_clean_scrub_stamp":"2024-09-12T22:51:19.026854+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:57:34.383642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":21641,"num_write":372,"num_write_kb":63613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"61'436","reported_seq":1082,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:42.297181+0000","last_change":"2024-09-12T22:51:42.297209+0000","last_active":"2024-09-12T22:51:42.297181+0000","last_peered":"2024-09-12T22:51:42.297181+0000","last_clean":"2024-09-12T22:51:42.297181+0000","last_became_active":"2024-09-12T22:50:59.702766+0000","last_became_peered":"2024-09-12T22:50:59.702766+0000","last_unstale":"2024-09-12T22:51:42.297181+0000","last_undegraded":"2024-09-12T22:51:42.297181+0000","last_fullsized":"2024-09-12T22:51:42.297181+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'436","last_scrub_stamp":"2024-09-12T22:51:42.297084+0000","last_deep_scrub":"61'436","last_deep_scrub_stamp":"2024-09-12T22:51:42.297084+0000","last_clean_scrub_stamp":"2024-09-12T22:51:42.297084+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:17.671589+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":65550,"num_write":412,"num_write_kb":134233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"61'393","reported_seq":599,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:25.456868+0000","last_change":"2024-09-12T22:51:25.456899+0000","last_active":"2024-09-12T22:51:25.456868+0000","last_peered":"2024-09-12T22:51:25.456868+0000","last_clean":"2024-09-12T22:51:25.456868+0000","last_became_active":"2024-09-12T22:48:05.176735+0000","last_became_peered":"2024-09-12T22:48:05.176735+0000","last_unstale":"2024-09-12T22:51:25.456868+0000","last_undegraded":"2024-09-12T22:51:25.456868+0000","last_fullsized":"2024-09-12T22:51:25.456868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'393","last_scrub_stamp":"2024-09-12T22:51:25.456783+0000","last_deep_scrub":"61'393","last_deep_scrub_stamp":"2024-09-12T22:51:25.456783+0000","last_clean_scrub_stamp":"2024-09-12T22:51:25.456783+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:32.363803+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":36009,"num_write":361,"num_write_kb":71487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"61'456","reported_seq":1028,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:44.354815+0000","last_change":"2024-09-12T22:51:44.354842+0000","last_active":"2024-09-12T22:51:44.354815+0000","last_peered":"2024-09-12T22:51:44.354815+0000","last_clean":"2024-09-12T22:51:44.354815+0000","last_became_active":"2024-09-12T22:51:00.698377+0000","last_became_peered":"2024-09-12T22:51:00.698377+0000","last_unstale":"2024-09-12T22:51:44.354815+0000","last_undegraded":"2024-09-12T22:51:44.354815+0000","last_fullsized":"2024-09-12T22:51:44.354815+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'456","last_scrub_stamp":"2024-09-12T22:51:44.354720+0000","last_deep_scrub":"61'456","last_deep_scrub_stamp":"2024-09-12T22:51:44.354720+0000","last_clean_scrub_stamp":"2024-09-12T22:51:44.354720+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:51:27.152785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4316,"num_write":417,"num_write_kb":34284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"61'440","reported_seq":623,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:27.484762+0000","last_change":"2024-09-12T22:51:27.484788+0000","last_active":"2024-09-12T22:51:27.484762+0000","last_peered":"2024-09-12T22:51:27.484762+0000","last_clean":"2024-09-12T22:51:27.484762+0000","last_became_active":"2024-09-12T22:48:05.176327+0000","last_became_peered":"2024-09-12T22:48:05.176327+0000","last_unstale":"2024-09-12T22:51:27.484762+0000","last_undegraded":"2024-09-12T22:51:27.484762+0000","last_fullsized":"2024-09-12T22:51:27.484762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'440","last_scrub_stamp":"2024-09-12T22:51:27.484666+0000","last_deep_scrub":"61'440","last_deep_scrub_stamp":"2024-09-12T22:51:27.484666+0000","last_clean_scrub_stamp":"2024-09-12T22:51:27.484666+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:56.730585+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15052,"num_write":399,"num_write_kb":71703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"61'424","reported_seq":591,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:15.055895+0000","last_change":"2024-09-12T22:51:15.055996+0000","last_active":"2024-09-12T22:51:15.055895+0000","last_peered":"2024-09-12T22:51:15.055895+0000","last_clean":"2024-09-12T22:51:15.055895+0000","last_became_active":"2024-09-12T22:51:01.700878+0000","last_became_peered":"2024-09-12T22:51:01.700878+0000","last_unstale":"2024-09-12T22:51:15.055895+0000","last_undegraded":"2024-09-12T22:51:15.055895+0000","last_fullsized":"2024-09-12T22:51:15.055895+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'424","last_scrub_stamp":"2024-09-12T22:51:15.055797+0000","last_deep_scrub":"61'424","last_deep_scrub_stamp":"2024-09-12T22:51:15.055797+0000","last_clean_scrub_stamp":"2024-09-12T22:51:15.055797+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:34:40.186129+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25587,"num_write":397,"num_write_kb":46651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"61'384","reported_seq":554,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:39.298183+0000","last_change":"2024-09-12T22:51:39.298210+0000","last_active":"2024-09-12T22:51:39.298183+0000","last_peered":"2024-09-12T22:51:39.298183+0000","last_clean":"2024-09-12T22:51:39.298183+0000","last_became_active":"2024-09-12T22:48:05.171036+0000","last_became_peered":"2024-09-12T22:48:05.171036+0000","last_unstale":"2024-09-12T22:51:39.298183+0000","last_undegraded":"2024-09-12T22:51:39.298183+0000","last_fullsized":"2024-09-12T22:51:39.298183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'384","last_scrub_stamp":"2024-09-12T22:51:39.298077+0000","last_deep_scrub":"61'384","last_deep_scrub_stamp":"2024-09-12T22:51:39.298077+0000","last_clean_scrub_stamp":"2024-09-12T22:51:39.298077+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:54.252384+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9715,"num_write":345,"num_write_kb":63048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"81'454","reported_seq":598,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:28.020882+0000","last_change":"2024-09-12T22:51:28.020920+0000","last_active":"2024-09-12T22:51:28.020882+0000","last_peered":"2024-09-12T22:51:28.020882+0000","last_clean":"2024-09-12T22:51:28.020882+0000","last_became_active":"2024-09-12T22:50:55.851443+0000","last_became_peered":"2024-09-12T22:50:55.851443+0000","last_unstale":"2024-09-12T22:51:28.020882+0000","last_undegraded":"2024-09-12T22:51:28.020882+0000","last_fullsized":"2024-09-12T22:51:28.020882+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'454","last_scrub_stamp":"2024-09-12T22:51:28.020764+0000","last_deep_scrub":"81'454","last_deep_scrub_stamp":"2024-09-12T22:51:28.020764+0000","last_clean_scrub_stamp":"2024-09-12T22:51:28.020764+0000","objects_scrubbed":4,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:54.627592+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":387,"num_write_kb":8369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"61'389","reported_seq":577,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:19.562470+0000","last_change":"2024-09-12T22:51:19.562512+0000","last_active":"2024-09-12T22:51:19.562470+0000","last_peered":"2024-09-12T22:51:19.562470+0000","last_clean":"2024-09-12T22:51:19.562470+0000","last_became_active":"2024-09-12T22:48:05.172801+0000","last_became_peered":"2024-09-12T22:48:05.172801+0000","last_unstale":"2024-09-12T22:51:19.562470+0000","last_undegraded":"2024-09-12T22:51:19.562470+0000","last_fullsized":"2024-09-12T22:51:19.562470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'389","last_scrub_stamp":"2024-09-12T22:51:19.562343+0000","last_deep_scrub":"61'389","last_deep_scrub_stamp":"2024-09-12T22:51:19.562343+0000","last_clean_scrub_stamp":"2024-09-12T22:51:19.562343+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:28.225518+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":21115,"num_write":354,"num_write_kb":59128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"61'60","reported_seq":215,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:18.526880+0000","last_change":"2024-09-12T22:51:18.526913+0000","last_active":"2024-09-12T22:51:18.526880+0000","last_peered":"2024-09-12T22:51:18.526880+0000","last_clean":"2024-09-12T22:51:18.526880+0000","last_became_active":"2024-09-12T22:50:52.859975+0000","last_became_peered":"2024-09-12T22:50:52.859975+0000","last_unstale":"2024-09-12T22:51:18.526880+0000","last_undegraded":"2024-09-12T22:51:18.526880+0000","last_fullsized":"2024-09-12T22:51:18.526880+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'60","last_scrub_stamp":"2024-09-12T22:51:18.526792+0000","last_deep_scrub":"61'60","last_deep_scrub_stamp":"2024-09-12T22:51:18.526792+0000","last_clean_scrub_stamp":"2024-09-12T22:51:18.526792+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:27:51.518928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"61'433","reported_seq":1006,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:42.349279+0000","last_change":"2024-09-12T22:51:42.349305+0000","last_active":"2024-09-12T22:51:42.349279+0000","last_peered":"2024-09-12T22:51:42.349279+0000","last_clean":"2024-09-12T22:51:42.349279+0000","last_became_active":"2024-09-12T22:50:57.861719+0000","last_became_peered":"2024-09-12T22:50:57.861719+0000","last_unstale":"2024-09-12T22:51:42.349279+0000","last_undegraded":"2024-09-12T22:51:42.349279+0000","last_fullsized":"2024-09-12T22:51:42.349279+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'433","last_scrub_stamp":"2024-09-12T22:51:42.349189+0000","last_deep_scrub":"61'433","last_deep_scrub_stamp":"2024-09-12T22:51:42.349189+0000","last_clean_scrub_stamp":"2024-09-12T22:51:42.349189+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:35.244519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17599,"num_write":404,"num_write_kb":59440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"61'63","reported_seq":218,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:16.528385+0000","last_change":"2024-09-12T22:51:16.528410+0000","last_active":"2024-09-12T22:51:16.528385+0000","last_peered":"2024-09-12T22:51:16.528385+0000","last_clean":"2024-09-12T22:51:16.528385+0000","last_became_active":"2024-09-12T22:50:52.857343+0000","last_became_peered":"2024-09-12T22:50:52.857343+0000","last_unstale":"2024-09-12T22:51:16.528385+0000","last_undegraded":"2024-09-12T22:51:16.528385+0000","last_fullsized":"2024-09-12T22:51:16.528385+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'63","last_scrub_stamp":"2024-09-12T22:51:16.528299+0000","last_deep_scrub":"61'63","last_deep_scrub_stamp":"2024-09-12T22:51:16.528299+0000","last_clean_scrub_stamp":"2024-09-12T22:51:16.528299+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:31.533066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"61'407","reported_seq":941,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:38.291276+0000","last_change":"2024-09-12T22:51:38.291320+0000","last_active":"2024-09-12T22:51:38.291276+0000","last_peered":"2024-09-12T22:51:38.291276+0000","last_clean":"2024-09-12T22:51:38.291276+0000","last_became_active":"2024-09-12T22:50:55.851934+0000","last_became_peered":"2024-09-12T22:50:55.851934+0000","last_unstale":"2024-09-12T22:51:38.291276+0000","last_undegraded":"2024-09-12T22:51:38.291276+0000","last_fullsized":"2024-09-12T22:51:38.291276+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'407","last_scrub_stamp":"2024-09-12T22:51:38.291132+0000","last_deep_scrub":"61'407","last_deep_scrub_stamp":"2024-09-12T22:51:38.291132+0000","last_clean_scrub_stamp":"2024-09-12T22:51:38.291132+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:48.729595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":24842,"num_write":378,"num_write_kb":79144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"81'66","reported_seq":64,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:43.075128+0000","last_change":"2024-09-12T22:51:43.075163+0000","last_active":"2024-09-12T22:51:43.075128+0000","last_peered":"2024-09-12T22:51:43.075128+0000","last_clean":"2024-09-12T22:51:43.075128+0000","last_became_active":"2024-09-12T22:50:52.858911+0000","last_became_peered":"2024-09-12T22:50:52.858911+0000","last_unstale":"2024-09-12T22:51:43.075128+0000","last_undegraded":"2024-09-12T22:51:43.075128+0000","last_fullsized":"2024-09-12T22:51:43.075128+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'66","last_scrub_stamp":"2024-09-12T22:51:43.075026+0000","last_deep_scrub":"81'66","last_deep_scrub_stamp":"2024-09-12T22:51:43.075026+0000","last_clean_scrub_stamp":"2024-09-12T22:51:43.075026+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:19.052791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"81'154","reported_seq":299,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:25.970377+0000","last_change":"2024-09-12T22:51:25.970406+0000","last_active":"2024-09-12T22:51:25.970377+0000","last_peered":"2024-09-12T22:51:25.970377+0000","last_clean":"2024-09-12T22:51:25.970377+0000","last_became_active":"2024-09-12T22:50:55.851050+0000","last_became_peered":"2024-09-12T22:50:55.851050+0000","last_unstale":"2024-09-12T22:51:25.970377+0000","last_undegraded":"2024-09-12T22:51:25.970377+0000","last_fullsized":"2024-09-12T22:51:25.970377+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'154","last_scrub_stamp":"2024-09-12T22:51:25.970294+0000","last_deep_scrub":"81'154","last_deep_scrub_stamp":"2024-09-12T22:51:25.970294+0000","last_clean_scrub_stamp":"2024-09-12T22:51:25.970294+0000","objects_scrubbed":2,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:17.818054+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"61'392","reported_seq":899,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:15.524978+0000","last_change":"2024-09-12T22:51:15.525004+0000","last_active":"2024-09-12T22:51:15.524978+0000","last_peered":"2024-09-12T22:51:15.524978+0000","last_clean":"2024-09-12T22:51:15.524978+0000","last_became_active":"2024-09-12T22:50:56.853383+0000","last_became_peered":"2024-09-12T22:50:56.853383+0000","last_unstale":"2024-09-12T22:51:15.524978+0000","last_undegraded":"2024-09-12T22:51:15.524978+0000","last_fullsized":"2024-09-12T22:51:15.524978+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'392","last_scrub_stamp":"2024-09-12T22:51:15.524885+0000","last_deep_scrub":"61'392","last_deep_scrub_stamp":"2024-09-12T22:51:15.524885+0000","last_clean_scrub_stamp":"2024-09-12T22:51:15.524885+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:09.273828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":9675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"81'239","reported_seq":401,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:28.408843+0000","last_change":"2024-09-12T22:51:28.408879+0000","last_active":"2024-09-12T22:51:28.408843+0000","last_peered":"2024-09-12T22:51:28.408843+0000","last_clean":"2024-09-12T22:51:28.408843+0000","last_became_active":"2024-09-12T22:50:55.852034+0000","last_became_peered":"2024-09-12T22:50:55.852034+0000","last_unstale":"2024-09-12T22:51:28.408843+0000","last_undegraded":"2024-09-12T22:51:28.408843+0000","last_fullsized":"2024-09-12T22:51:28.408843+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'239","last_scrub_stamp":"2024-09-12T22:51:28.408760+0000","last_deep_scrub":"81'239","last_deep_scrub_stamp":"2024-09-12T22:51:28.408760+0000","last_clean_scrub_stamp":"2024-09-12T22:51:28.408760+0000","objects_scrubbed":2,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:00:19.367010+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"61'464","reported_seq":646,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:38.303842+0000","last_change":"2024-09-12T22:51:38.303892+0000","last_active":"2024-09-12T22:51:38.303842+0000","last_peered":"2024-09-12T22:51:38.303842+0000","last_clean":"2024-09-12T22:51:38.303842+0000","last_became_active":"2024-09-12T22:48:05.170374+0000","last_became_peered":"2024-09-12T22:48:05.170374+0000","last_unstale":"2024-09-12T22:51:38.303842+0000","last_undegraded":"2024-09-12T22:51:38.303842+0000","last_fullsized":"2024-09-12T22:51:38.303842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'464","last_scrub_stamp":"2024-09-12T22:51:38.303713+0000","last_deep_scrub":"61'464","last_deep_scrub_stamp":"2024-09-12T22:51:38.303713+0000","last_clean_scrub_stamp":"2024-09-12T22:51:38.303713+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:50.301785+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15522,"num_write":440,"num_write_kb":60335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"81'472","reported_seq":617,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:20.986643+0000","last_change":"2024-09-12T22:51:20.986672+0000","last_active":"2024-09-12T22:51:20.986643+0000","last_peered":"2024-09-12T22:51:20.986643+0000","last_clean":"2024-09-12T22:51:20.986643+0000","last_became_active":"2024-09-12T22:50:55.852074+0000","last_became_peered":"2024-09-12T22:50:55.852074+0000","last_unstale":"2024-09-12T22:51:20.986643+0000","last_undegraded":"2024-09-12T22:51:20.986643+0000","last_fullsized":"2024-09-12T22:51:20.986643+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'472","last_scrub_stamp":"2024-09-12T22:51:20.986558+0000","last_deep_scrub":"81'472","last_deep_scrub_stamp":"2024-09-12T22:51:20.986558+0000","last_clean_scrub_stamp":"2024-09-12T22:51:20.986558+0000","objects_scrubbed":2,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:12:43.272175+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":4267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"61'449","reported_seq":645,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:19.997376+0000","last_change":"2024-09-12T22:51:19.997441+0000","last_active":"2024-09-12T22:51:19.997376+0000","last_peered":"2024-09-12T22:51:19.997376+0000","last_clean":"2024-09-12T22:51:19.997376+0000","last_became_active":"2024-09-12T22:51:00.699592+0000","last_became_peered":"2024-09-12T22:51:00.699592+0000","last_unstale":"2024-09-12T22:51:19.997376+0000","last_undegraded":"2024-09-12T22:51:19.997376+0000","last_fullsized":"2024-09-12T22:51:19.997376+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'449","last_scrub_stamp":"2024-09-12T22:51:19.997252+0000","last_deep_scrub":"61'449","last_deep_scrub_stamp":"2024-09-12T22:51:19.997252+0000","last_clean_scrub_stamp":"2024-09-12T22:51:19.997252+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:31:23.493566+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":36634,"num_write":415,"num_write_kb":84238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"61'52","reported_seq":56,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:38.060462+0000","last_change":"2024-09-12T22:51:38.060505+0000","last_active":"2024-09-12T22:51:38.060462+0000","last_peered":"2024-09-12T22:51:38.060462+0000","last_clean":"2024-09-12T22:51:38.060462+0000","last_became_active":"2024-09-12T22:50:52.857342+0000","last_became_peered":"2024-09-12T22:50:52.857342+0000","last_unstale":"2024-09-12T22:51:38.060462+0000","last_undegraded":"2024-09-12T22:51:38.060462+0000","last_fullsized":"2024-09-12T22:51:38.060462+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'52","last_scrub_stamp":"2024-09-12T22:51:38.060319+0000","last_deep_scrub":"61'52","last_deep_scrub_stamp":"2024-09-12T22:51:38.060319+0000","last_clean_scrub_stamp":"2024-09-12T22:51:38.060319+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:15.868780+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"61'434","reported_seq":1036,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:44.345321+0000","last_change":"2024-09-12T22:51:44.345372+0000","last_active":"2024-09-12T22:51:44.345321+0000","last_peered":"2024-09-12T22:51:44.345321+0000","last_clean":"2024-09-12T22:51:44.345321+0000","last_became_active":"2024-09-12T22:50:58.700178+0000","last_became_peered":"2024-09-12T22:50:58.700178+0000","last_unstale":"2024-09-12T22:51:44.345321+0000","last_undegraded":"2024-09-12T22:51:44.345321+0000","last_fullsized":"2024-09-12T22:51:44.345321+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'434","last_scrub_stamp":"2024-09-12T22:51:44.345218+0000","last_deep_scrub":"61'434","last_deep_scrub_stamp":"2024-09-12T22:51:44.345218+0000","last_clean_scrub_stamp":"2024-09-12T22:51:44.345218+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:19.719723+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":39364,"num_write":402,"num_write_kb":59313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"81'197","reported_seq":361,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:24.488083+0000","last_change":"2024-09-12T22:51:24.488150+0000","last_active":"2024-09-12T22:51:24.488083+0000","last_peered":"2024-09-12T22:51:24.488083+0000","last_clean":"2024-09-12T22:51:24.488083+0000","last_became_active":"2024-09-12T22:50:55.852479+0000","last_became_peered":"2024-09-12T22:50:55.852479+0000","last_unstale":"2024-09-12T22:51:24.488083+0000","last_undegraded":"2024-09-12T22:51:24.488083+0000","last_fullsized":"2024-09-12T22:51:24.488083+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'197","last_scrub_stamp":"2024-09-12T22:51:24.487981+0000","last_deep_scrub":"81'197","last_deep_scrub_stamp":"2024-09-12T22:51:24.487981+0000","last_clean_scrub_stamp":"2024-09-12T22:51:24.487981+0000","objects_scrubbed":3,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:55.372926+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"61'457","reported_seq":592,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723851+0000","last_change":"2024-09-12T22:51:03.707374+0000","last_active":"2024-09-12T22:51:05.723851+0000","last_peered":"2024-09-12T22:51:05.723851+0000","last_clean":"2024-09-12T22:51:05.723851+0000","last_became_active":"2024-09-12T22:51:03.704514+0000","last_became_peered":"2024-09-12T22:51:03.704514+0000","last_unstale":"2024-09-12T22:51:05.723851+0000","last_undegraded":"2024-09-12T22:51:05.723851+0000","last_fullsized":"2024-09-12T22:51:05.723851+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10832,"num_write":419,"num_write_kb":34901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"81'107","reported_seq":242,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:32.017709+0000","last_change":"2024-09-12T22:51:32.017740+0000","last_active":"2024-09-12T22:51:32.017709+0000","last_peered":"2024-09-12T22:51:32.017709+0000","last_clean":"2024-09-12T22:51:32.017709+0000","last_became_active":"2024-09-12T22:50:55.850764+0000","last_became_peered":"2024-09-12T22:50:55.850764+0000","last_unstale":"2024-09-12T22:51:32.017709+0000","last_undegraded":"2024-09-12T22:51:32.017709+0000","last_fullsized":"2024-09-12T22:51:32.017709+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'107","last_scrub_stamp":"2024-09-12T22:51:32.017620+0000","last_deep_scrub":"81'107","last_deep_scrub_stamp":"2024-09-12T22:51:32.017620+0000","last_clean_scrub_stamp":"2024-09-12T22:51:32.017620+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:36.313389+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"61'431","reported_seq":580,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:46.136997+0000","last_change":"2024-09-12T22:51:46.137023+0000","last_active":"2024-09-12T22:51:46.136997+0000","last_peered":"2024-09-12T22:51:46.136997+0000","last_clean":"2024-09-12T22:51:46.136997+0000","last_became_active":"2024-09-12T22:51:02.707646+0000","last_became_peered":"2024-09-12T22:51:02.707646+0000","last_unstale":"2024-09-12T22:51:46.136997+0000","last_undegraded":"2024-09-12T22:51:46.136997+0000","last_fullsized":"2024-09-12T22:51:46.136997+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'431","last_scrub_stamp":"2024-09-12T22:51:46.136898+0000","last_deep_scrub":"61'431","last_deep_scrub_stamp":"2024-09-12T22:51:46.136898+0000","last_clean_scrub_stamp":"2024-09-12T22:51:46.136898+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:35:44.102904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":10443,"num_write":392,"num_write_kb":63957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"61'49","reported_seq":204,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:18.585186+0000","last_change":"2024-09-12T22:51:18.585211+0000","last_active":"2024-09-12T22:51:18.585186+0000","last_peered":"2024-09-12T22:51:18.585186+0000","last_clean":"2024-09-12T22:51:18.585186+0000","last_became_active":"2024-09-12T22:50:52.857301+0000","last_became_peered":"2024-09-12T22:50:52.857301+0000","last_unstale":"2024-09-12T22:51:18.585186+0000","last_undegraded":"2024-09-12T22:51:18.585186+0000","last_fullsized":"2024-09-12T22:51:18.585186+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'49","last_scrub_stamp":"2024-09-12T22:51:18.585100+0000","last_deep_scrub":"61'49","last_deep_scrub_stamp":"2024-09-12T22:51:18.585100+0000","last_clean_scrub_stamp":"2024-09-12T22:51:18.585100+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:00:47.842878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"61'351","reported_seq":484,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:22.958605+0000","last_change":"2024-09-12T22:51:22.958631+0000","last_active":"2024-09-12T22:51:22.958605+0000","last_peered":"2024-09-12T22:51:22.958605+0000","last_clean":"2024-09-12T22:51:22.958605+0000","last_became_active":"2024-09-12T22:50:56.853610+0000","last_became_peered":"2024-09-12T22:50:56.853610+0000","last_unstale":"2024-09-12T22:51:22.958605+0000","last_undegraded":"2024-09-12T22:51:22.958605+0000","last_fullsized":"2024-09-12T22:51:22.958605+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'351","last_scrub_stamp":"2024-09-12T22:51:22.958519+0000","last_deep_scrub":"61'351","last_deep_scrub_stamp":"2024-09-12T22:51:22.958519+0000","last_clean_scrub_stamp":"2024-09-12T22:51:22.958519+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:53.587489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":137,"num_write":315,"num_write_kb":37943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"81'589","reported_seq":737,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:34.367399+0000","last_change":"2024-09-12T22:51:34.367443+0000","last_active":"2024-09-12T22:51:34.367399+0000","last_peered":"2024-09-12T22:51:34.367399+0000","last_clean":"2024-09-12T22:51:34.367399+0000","last_became_active":"2024-09-12T22:48:04.173942+0000","last_became_peered":"2024-09-12T22:48:04.173942+0000","last_unstale":"2024-09-12T22:51:34.367399+0000","last_undegraded":"2024-09-12T22:51:34.367399+0000","last_fullsized":"2024-09-12T22:51:34.367399+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'589","last_scrub_stamp":"2024-09-12T22:51:34.367281+0000","last_deep_scrub":"81'589","last_deep_scrub_stamp":"2024-09-12T22:51:34.367281+0000","last_clean_scrub_stamp":"2024-09-12T22:51:34.367281+0000","objects_scrubbed":1,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:02.186418+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":4334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"61'400","reported_seq":569,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:19.557789+0000","last_change":"2024-09-12T22:51:19.557815+0000","last_active":"2024-09-12T22:51:19.557789+0000","last_peered":"2024-09-12T22:51:19.557789+0000","last_clean":"2024-09-12T22:51:19.557789+0000","last_became_active":"2024-09-12T22:48:05.176813+0000","last_became_peered":"2024-09-12T22:48:05.176813+0000","last_unstale":"2024-09-12T22:51:19.557789+0000","last_undegraded":"2024-09-12T22:51:19.557789+0000","last_fullsized":"2024-09-12T22:51:19.557789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'400","last_scrub_stamp":"2024-09-12T22:51:19.557704+0000","last_deep_scrub":"61'400","last_deep_scrub_stamp":"2024-09-12T22:51:19.557704+0000","last_clean_scrub_stamp":"2024-09-12T22:51:19.557704+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:45.672718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":9179,"num_write":363,"num_write_kb":67046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"81'159","reported_seq":253,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:44.124284+0000","last_change":"2024-09-12T22:51:44.124329+0000","last_active":"2024-09-12T22:51:44.124284+0000","last_peered":"2024-09-12T22:51:44.124284+0000","last_clean":"2024-09-12T22:51:44.124284+0000","last_became_active":"2024-09-12T22:50:52.859754+0000","last_became_peered":"2024-09-12T22:50:52.859754+0000","last_unstale":"2024-09-12T22:51:44.124284+0000","last_undegraded":"2024-09-12T22:51:44.124284+0000","last_fullsized":"2024-09-12T22:51:44.124284+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'159","last_scrub_stamp":"2024-09-12T22:51:44.124194+0000","last_deep_scrub":"81'159","last_deep_scrub_stamp":"2024-09-12T22:51:44.124194+0000","last_clean_scrub_stamp":"2024-09-12T22:51:44.124194+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:36:56.359831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"81'2","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:40.001056+0000","last_change":"2024-09-12T22:51:40.001095+0000","last_active":"2024-09-12T22:51:40.001056+0000","last_peered":"2024-09-12T22:51:40.001056+0000","last_clean":"2024-09-12T22:51:40.001056+0000","last_became_active":"2024-09-12T22:50:52.857759+0000","last_became_peered":"2024-09-12T22:50:52.857759+0000","last_unstale":"2024-09-12T22:51:40.001056+0000","last_undegraded":"2024-09-12T22:51:40.001056+0000","last_fullsized":"2024-09-12T22:51:40.001056+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-12T22:51:40.000969+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-12T22:51:40.000969+0000","last_clean_scrub_stamp":"2024-09-12T22:51:40.000969+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:33.398780+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"81'508","reported_seq":656,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:36.348123+0000","last_change":"2024-09-12T22:51:36.348150+0000","last_active":"2024-09-12T22:51:36.348123+0000","last_peered":"2024-09-12T22:51:36.348123+0000","last_clean":"2024-09-12T22:51:36.348123+0000","last_became_active":"2024-09-12T22:48:04.169474+0000","last_became_peered":"2024-09-12T22:48:04.169474+0000","last_unstale":"2024-09-12T22:51:36.348123+0000","last_undegraded":"2024-09-12T22:51:36.348123+0000","last_fullsized":"2024-09-12T22:51:36.348123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'508","last_scrub_stamp":"2024-09-12T22:51:36.348038+0000","last_deep_scrub":"81'508","last_deep_scrub_stamp":"2024-09-12T22:51:36.348038+0000","last_clean_scrub_stamp":"2024-09-12T22:51:36.348038+0000","objects_scrubbed":2,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:04.167175+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":444,"num_write_kb":8407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"61'422","reported_seq":604,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:45.122992+0000","last_change":"2024-09-12T22:51:45.123034+0000","last_active":"2024-09-12T22:51:45.122992+0000","last_peered":"2024-09-12T22:51:45.122992+0000","last_clean":"2024-09-12T22:51:45.122992+0000","last_became_active":"2024-09-12T22:51:00.698391+0000","last_became_peered":"2024-09-12T22:51:00.698391+0000","last_unstale":"2024-09-12T22:51:45.122992+0000","last_undegraded":"2024-09-12T22:51:45.122992+0000","last_fullsized":"2024-09-12T22:51:45.122992+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'422","last_scrub_stamp":"2024-09-12T22:51:45.122896+0000","last_deep_scrub":"61'422","last_deep_scrub_stamp":"2024-09-12T22:51:45.122896+0000","last_clean_scrub_stamp":"2024-09-12T22:51:45.122896+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:57.741188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":38484,"num_write":383,"num_write_kb":67099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":77,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:42.093294+0000","last_change":"2024-09-12T22:51:42.093321+0000","last_active":"2024-09-12T22:51:42.093294+0000","last_peered":"2024-09-12T22:51:42.093294+0000","last_clean":"2024-09-12T22:51:42.093294+0000","last_became_active":"2024-09-12T22:50:52.858480+0000","last_became_peered":"2024-09-12T22:50:52.858480+0000","last_unstale":"2024-09-12T22:51:42.093294+0000","last_undegraded":"2024-09-12T22:51:42.093294+0000","last_fullsized":"2024-09-12T22:51:42.093294+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:51:42.093200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:51:42.093200+0000","last_clean_scrub_stamp":"2024-09-12T22:51:42.093200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:15.344944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"81'108","reported_seq":314,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:28.519974+0000","last_change":"2024-09-12T22:51:28.520002+0000","last_active":"2024-09-12T22:51:28.519974+0000","last_peered":"2024-09-12T22:51:28.519974+0000","last_clean":"2024-09-12T22:51:28.519974+0000","last_became_active":"2024-09-12T22:50:55.852965+0000","last_became_peered":"2024-09-12T22:50:55.852965+0000","last_unstale":"2024-09-12T22:51:28.519974+0000","last_undegraded":"2024-09-12T22:51:28.519974+0000","last_fullsized":"2024-09-12T22:51:28.519974+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'108","last_scrub_stamp":"2024-09-12T22:51:28.519884+0000","last_deep_scrub":"81'108","last_deep_scrub_stamp":"2024-09-12T22:51:28.519884+0000","last_clean_scrub_stamp":"2024-09-12T22:51:28.519884+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:52.946262+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1463793,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":1459,"num_write":45,"num_write_kb":1459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1463793,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"61'436","reported_seq":627,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:29.365822+0000","last_change":"2024-09-12T22:51:29.365848+0000","last_active":"2024-09-12T22:51:29.365822+0000","last_peered":"2024-09-12T22:51:29.365822+0000","last_clean":"2024-09-12T22:51:29.365822+0000","last_became_active":"2024-09-12T22:48:05.171293+0000","last_became_peered":"2024-09-12T22:48:05.171293+0000","last_unstale":"2024-09-12T22:51:29.365822+0000","last_undegraded":"2024-09-12T22:51:29.365822+0000","last_fullsized":"2024-09-12T22:51:29.365822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'436","last_scrub_stamp":"2024-09-12T22:51:29.365736+0000","last_deep_scrub":"61'436","last_deep_scrub_stamp":"2024-09-12T22:51:29.365736+0000","last_clean_scrub_stamp":"2024-09-12T22:51:29.365736+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:57:21.433261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":27936,"num_write":401,"num_write_kb":51013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":161,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:31.456815+0000","last_change":"2024-09-12T22:51:31.456836+0000","last_active":"2024-09-12T22:51:31.456815+0000","last_peered":"2024-09-12T22:51:31.456815+0000","last_clean":"2024-09-12T22:51:31.456815+0000","last_became_active":"2024-09-12T22:48:00.042007+0000","last_became_peered":"2024-09-12T22:48:00.042007+0000","last_unstale":"2024-09-12T22:51:31.456815+0000","last_undegraded":"2024-09-12T22:51:31.456815+0000","last_fullsized":"2024-09-12T22:51:31.456815+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:51:31.456714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:51:31.456714+0000","last_clean_scrub_stamp":"2024-09-12T22:51:31.456714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:57:23.524239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036893100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"81'359","reported_seq":522,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:26.475989+0000","last_change":"2024-09-12T22:51:26.476020+0000","last_active":"2024-09-12T22:51:26.475989+0000","last_peered":"2024-09-12T22:51:26.475989+0000","last_clean":"2024-09-12T22:51:26.475989+0000","last_became_active":"2024-09-12T22:50:55.852029+0000","last_became_peered":"2024-09-12T22:50:55.852029+0000","last_unstale":"2024-09-12T22:51:26.475989+0000","last_undegraded":"2024-09-12T22:51:26.475989+0000","last_fullsized":"2024-09-12T22:51:26.475989+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'359","last_scrub_stamp":"2024-09-12T22:51:26.475898+0000","last_deep_scrub":"81'359","last_deep_scrub_stamp":"2024-09-12T22:51:26.475898+0000","last_clean_scrub_stamp":"2024-09-12T22:51:26.475898+0000","objects_scrubbed":2,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:12:58.416844+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":8307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"61'343","reported_seq":512,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:14.446520+0000","last_change":"2024-09-12T22:51:14.446546+0000","last_active":"2024-09-12T22:51:14.446520+0000","last_peered":"2024-09-12T22:51:14.446520+0000","last_clean":"2024-09-12T22:51:14.446520+0000","last_became_active":"2024-09-12T22:48:05.178010+0000","last_became_peered":"2024-09-12T22:48:05.178010+0000","last_unstale":"2024-09-12T22:51:14.446520+0000","last_undegraded":"2024-09-12T22:51:14.446520+0000","last_fullsized":"2024-09-12T22:51:14.446520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'343","last_scrub_stamp":"2024-09-12T22:51:14.446422+0000","last_deep_scrub":"61'343","last_deep_scrub_stamp":"2024-09-12T22:51:14.446422+0000","last_clean_scrub_stamp":"2024-09-12T22:51:14.446422+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:41.971251+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":6704,"num_write":316,"num_write_kb":42458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"81'3","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:39.026255+0000","last_change":"2024-09-12T22:51:39.026285+0000","last_active":"2024-09-12T22:51:39.026255+0000","last_peered":"2024-09-12T22:51:39.026255+0000","last_clean":"2024-09-12T22:51:39.026255+0000","last_became_active":"2024-09-12T22:50:52.857746+0000","last_became_peered":"2024-09-12T22:50:52.857746+0000","last_unstale":"2024-09-12T22:51:39.026255+0000","last_undegraded":"2024-09-12T22:51:39.026255+0000","last_fullsized":"2024-09-12T22:51:39.026255+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-09-12T22:51:39.026168+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-09-12T22:51:39.026168+0000","last_clean_scrub_stamp":"2024-09-12T22:51:39.026168+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:57.836410+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00052714799999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"61'78","reported_seq":56,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:41.044385+0000","last_change":"2024-09-12T22:51:41.044411+0000","last_active":"2024-09-12T22:51:41.044385+0000","last_peered":"2024-09-12T22:51:41.044385+0000","last_clean":"2024-09-12T22:51:41.044385+0000","last_became_active":"2024-09-12T22:50:52.858372+0000","last_became_peered":"2024-09-12T22:50:52.858372+0000","last_unstale":"2024-09-12T22:51:41.044385+0000","last_undegraded":"2024-09-12T22:51:41.044385+0000","last_fullsized":"2024-09-12T22:51:41.044385+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'78","last_scrub_stamp":"2024-09-12T22:51:41.044264+0000","last_deep_scrub":"61'78","last_deep_scrub_stamp":"2024-09-12T22:51:41.044264+0000","last_clean_scrub_stamp":"2024-09-12T22:51:41.044264+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:49:36.969761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"61'404","reported_seq":623,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:21.513951+0000","last_change":"2024-09-12T22:51:21.513986+0000","last_active":"2024-09-12T22:51:21.513951+0000","last_peered":"2024-09-12T22:51:21.513951+0000","last_clean":"2024-09-12T22:51:21.513951+0000","last_became_active":"2024-09-12T22:48:05.177164+0000","last_became_peered":"2024-09-12T22:48:05.177164+0000","last_unstale":"2024-09-12T22:51:21.513951+0000","last_undegraded":"2024-09-12T22:51:21.513951+0000","last_fullsized":"2024-09-12T22:51:21.513951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'404","last_scrub_stamp":"2024-09-12T22:51:21.513822+0000","last_deep_scrub":"61'404","last_deep_scrub_stamp":"2024-09-12T22:51:21.513822+0000","last_clean_scrub_stamp":"2024-09-12T22:51:21.513822+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:49:34.958749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":35084,"num_write":365,"num_write_kb":71560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"81'270","reported_seq":405,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:34.028186+0000","last_change":"2024-09-12T22:51:34.028241+0000","last_active":"2024-09-12T22:51:34.028186+0000","last_peered":"2024-09-12T22:51:34.028186+0000","last_clean":"2024-09-12T22:51:34.028186+0000","last_became_active":"2024-09-12T22:50:55.850689+0000","last_became_peered":"2024-09-12T22:50:55.850689+0000","last_unstale":"2024-09-12T22:51:34.028186+0000","last_undegraded":"2024-09-12T22:51:34.028186+0000","last_fullsized":"2024-09-12T22:51:34.028186+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'270","last_scrub_stamp":"2024-09-12T22:51:34.028090+0000","last_deep_scrub":"81'270","last_deep_scrub_stamp":"2024-09-12T22:51:34.028090+0000","last_clean_scrub_stamp":"2024-09-12T22:51:34.028090+0000","objects_scrubbed":1,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:20.743115+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":4189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":161,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:32.418795+0000","last_change":"2024-09-12T22:51:32.418817+0000","last_active":"2024-09-12T22:51:32.418795+0000","last_peered":"2024-09-12T22:51:32.418795+0000","last_clean":"2024-09-12T22:51:32.418795+0000","last_became_active":"2024-09-12T22:48:00.042132+0000","last_became_peered":"2024-09-12T22:48:00.042132+0000","last_unstale":"2024-09-12T22:51:32.418795+0000","last_undegraded":"2024-09-12T22:51:32.418795+0000","last_fullsized":"2024-09-12T22:51:32.418795+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:51:32.418694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:51:32.418694+0000","last_clean_scrub_stamp":"2024-09-12T22:51:32.418694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:09:39.426948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047590600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"61'362","reported_seq":860,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:43.342905+0000","last_change":"2024-09-12T22:51:43.342932+0000","last_active":"2024-09-12T22:51:43.342905+0000","last_peered":"2024-09-12T22:51:43.342905+0000","last_clean":"2024-09-12T22:51:43.342905+0000","last_became_active":"2024-09-12T22:50:59.707126+0000","last_became_peered":"2024-09-12T22:50:59.707126+0000","last_unstale":"2024-09-12T22:51:43.342905+0000","last_undegraded":"2024-09-12T22:51:43.342905+0000","last_fullsized":"2024-09-12T22:51:43.342905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'362","last_scrub_stamp":"2024-09-12T22:51:43.342803+0000","last_deep_scrub":"61'362","last_deep_scrub_stamp":"2024-09-12T22:51:43.342803+0000","last_clean_scrub_stamp":"2024-09-12T22:51:43.342803+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:56.841704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":10445,"num_write":331,"num_write_kb":30096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"61'56","reported_seq":204,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:35.357399+0000","last_change":"2024-09-12T22:51:35.357428+0000","last_active":"2024-09-12T22:51:35.357399+0000","last_peered":"2024-09-12T22:51:35.357399+0000","last_clean":"2024-09-12T22:51:35.357399+0000","last_became_active":"2024-09-12T22:48:04.168655+0000","last_became_peered":"2024-09-12T22:48:04.168655+0000","last_unstale":"2024-09-12T22:51:35.357399+0000","last_undegraded":"2024-09-12T22:51:35.357399+0000","last_fullsized":"2024-09-12T22:51:35.357399+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'56","last_scrub_stamp":"2024-09-12T22:51:35.357308+0000","last_deep_scrub":"61'56","last_deep_scrub_stamp":"2024-09-12T22:51:35.357308+0000","last_clean_scrub_stamp":"2024-09-12T22:51:35.357308+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:36:54.762450+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":161,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:32.301395+0000","last_change":"2024-09-12T22:51:32.301417+0000","last_active":"2024-09-12T22:51:32.301395+0000","last_peered":"2024-09-12T22:51:32.301395+0000","last_clean":"2024-09-12T22:51:32.301395+0000","last_became_active":"2024-09-12T22:48:00.045356+0000","last_became_peered":"2024-09-12T22:48:00.045356+0000","last_unstale":"2024-09-12T22:51:32.301395+0000","last_undegraded":"2024-09-12T22:51:32.301395+0000","last_fullsized":"2024-09-12T22:51:32.301395+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:51:32.301293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:51:32.301293+0000","last_clean_scrub_stamp":"2024-09-12T22:51:32.301293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:44.445434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040621599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"61'408","reported_seq":991,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:13.548235+0000","last_change":"2024-09-12T22:51:13.548260+0000","last_active":"2024-09-12T22:51:13.548235+0000","last_peered":"2024-09-12T22:51:13.548235+0000","last_clean":"2024-09-12T22:51:13.548235+0000","last_became_active":"2024-09-12T22:50:57.863486+0000","last_became_peered":"2024-09-12T22:50:57.863486+0000","last_unstale":"2024-09-12T22:51:13.548235+0000","last_undegraded":"2024-09-12T22:51:13.548235+0000","last_fullsized":"2024-09-12T22:51:13.548235+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'408","last_scrub_stamp":"2024-09-12T22:51:13.548143+0000","last_deep_scrub":"61'408","last_deep_scrub_stamp":"2024-09-12T22:51:13.548143+0000","last_clean_scrub_stamp":"2024-09-12T22:51:13.548143+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:00.237151+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":42311,"num_write":379,"num_write_kb":75412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"81'62","reported_seq":210,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:33.382870+0000","last_change":"2024-09-12T22:51:33.382943+0000","last_active":"2024-09-12T22:51:33.382870+0000","last_peered":"2024-09-12T22:51:33.382870+0000","last_clean":"2024-09-12T22:51:33.382870+0000","last_became_active":"2024-09-12T22:48:04.168244+0000","last_became_peered":"2024-09-12T22:48:04.168244+0000","last_unstale":"2024-09-12T22:51:33.382870+0000","last_undegraded":"2024-09-12T22:51:33.382870+0000","last_fullsized":"2024-09-12T22:51:33.382870+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'62","last_scrub_stamp":"2024-09-12T22:51:33.382778+0000","last_deep_scrub":"81'62","last_deep_scrub_stamp":"2024-09-12T22:51:33.382778+0000","last_clean_scrub_stamp":"2024-09-12T22:51:33.382778+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:00.519567+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":161,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:30.505975+0000","last_change":"2024-09-12T22:51:30.506010+0000","last_active":"2024-09-12T22:51:30.505975+0000","last_peered":"2024-09-12T22:51:30.505975+0000","last_clean":"2024-09-12T22:51:30.505975+0000","last_became_active":"2024-09-12T22:48:00.040536+0000","last_became_peered":"2024-09-12T22:48:00.040536+0000","last_unstale":"2024-09-12T22:51:30.505975+0000","last_undegraded":"2024-09-12T22:51:30.505975+0000","last_fullsized":"2024-09-12T22:51:30.505975+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:51:30.505859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:51:30.505859+0000","last_clean_scrub_stamp":"2024-09-12T22:51:30.505859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:00:21.464109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057699499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"61'430","reported_seq":999,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:45.331984+0000","last_change":"2024-09-12T22:51:45.332008+0000","last_active":"2024-09-12T22:51:45.331984+0000","last_peered":"2024-09-12T22:51:45.331984+0000","last_clean":"2024-09-12T22:51:45.331984+0000","last_became_active":"2024-09-12T22:51:01.700292+0000","last_became_peered":"2024-09-12T22:51:01.700292+0000","last_unstale":"2024-09-12T22:51:45.331984+0000","last_undegraded":"2024-09-12T22:51:45.331984+0000","last_fullsized":"2024-09-12T22:51:45.331984+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'430","last_scrub_stamp":"2024-09-12T22:51:45.331871+0000","last_deep_scrub":"61'430","last_deep_scrub_stamp":"2024-09-12T22:51:45.331871+0000","last_clean_scrub_stamp":"2024-09-12T22:51:45.331871+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:58.830772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":26700,"num_write":399,"num_write_kb":55331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"81'115","reported_seq":277,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:22.473955+0000","last_change":"2024-09-12T22:51:22.473983+0000","last_active":"2024-09-12T22:51:22.473955+0000","last_peered":"2024-09-12T22:51:22.473955+0000","last_clean":"2024-09-12T22:51:22.473955+0000","last_became_active":"2024-09-12T22:50:55.851975+0000","last_became_peered":"2024-09-12T22:50:55.851975+0000","last_unstale":"2024-09-12T22:51:22.473955+0000","last_undegraded":"2024-09-12T22:51:22.473955+0000","last_fullsized":"2024-09-12T22:51:22.473955+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'115","last_scrub_stamp":"2024-09-12T22:51:22.473860+0000","last_deep_scrub":"81'115","last_deep_scrub_stamp":"2024-09-12T22:51:22.473860+0000","last_clean_scrub_stamp":"2024-09-12T22:51:22.473860+0000","objects_scrubbed":1,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:36:14.493054+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":1201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":77,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:37.054688+0000","last_change":"2024-09-12T22:51:37.054748+0000","last_active":"2024-09-12T22:51:37.054688+0000","last_peered":"2024-09-12T22:51:37.054688+0000","last_clean":"2024-09-12T22:51:37.054688+0000","last_became_active":"2024-09-12T22:50:52.856757+0000","last_became_peered":"2024-09-12T22:50:52.856757+0000","last_unstale":"2024-09-12T22:51:37.054688+0000","last_undegraded":"2024-09-12T22:51:37.054688+0000","last_fullsized":"2024-09-12T22:51:37.054688+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:51:37.054550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:51:37.054550+0000","last_clean_scrub_stamp":"2024-09-12T22:51:37.054550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:23.766084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"61'406","reported_seq":938,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:40.318800+0000","last_change":"2024-09-12T22:51:40.318851+0000","last_active":"2024-09-12T22:51:40.318800+0000","last_peered":"2024-09-12T22:51:40.318800+0000","last_clean":"2024-09-12T22:51:40.318800+0000","last_became_active":"2024-09-12T22:50:56.853376+0000","last_became_peered":"2024-09-12T22:50:56.853376+0000","last_unstale":"2024-09-12T22:51:40.318800+0000","last_undegraded":"2024-09-12T22:51:40.318800+0000","last_fullsized":"2024-09-12T22:51:40.318800+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'406","last_scrub_stamp":"2024-09-12T22:51:40.318700+0000","last_deep_scrub":"61'406","last_deep_scrub_stamp":"2024-09-12T22:51:40.318700+0000","last_clean_scrub_stamp":"2024-09-12T22:51:40.318700+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:33.214030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17112,"num_write":373,"num_write_kb":79947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"61'378","reported_seq":542,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:26.958523+0000","last_change":"2024-09-12T22:51:26.958549+0000","last_active":"2024-09-12T22:51:26.958523+0000","last_peered":"2024-09-12T22:51:26.958523+0000","last_clean":"2024-09-12T22:51:26.958523+0000","last_became_active":"2024-09-12T22:50:57.861280+0000","last_became_peered":"2024-09-12T22:50:57.861280+0000","last_unstale":"2024-09-12T22:51:26.958523+0000","last_undegraded":"2024-09-12T22:51:26.958523+0000","last_fullsized":"2024-09-12T22:51:26.958523+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'378","last_scrub_stamp":"2024-09-12T22:51:26.958404+0000","last_deep_scrub":"61'378","last_deep_scrub_stamp":"2024-09-12T22:51:26.958404+0000","last_clean_scrub_stamp":"2024-09-12T22:51:26.958404+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:48.297955+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15048,"num_write":339,"num_write_kb":35238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"81'255","reported_seq":406,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:36.025377+0000","last_change":"2024-09-12T22:51:36.025408+0000","last_active":"2024-09-12T22:51:36.025377+0000","last_peered":"2024-09-12T22:51:36.025377+0000","last_clean":"2024-09-12T22:51:36.025377+0000","last_became_active":"2024-09-12T22:50:55.849531+0000","last_became_peered":"2024-09-12T22:50:55.849531+0000","last_unstale":"2024-09-12T22:51:36.025377+0000","last_undegraded":"2024-09-12T22:51:36.025377+0000","last_fullsized":"2024-09-12T22:51:36.025377+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'255","last_scrub_stamp":"2024-09-12T22:51:36.025297+0000","last_deep_scrub":"81'255","last_deep_scrub_stamp":"2024-09-12T22:51:36.025297+0000","last_clean_scrub_stamp":"2024-09-12T22:51:36.025297+0000","objects_scrubbed":6,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:07.658793+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8461053,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":8364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8456257,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"61'405","reported_seq":578,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:29.541408+0000","last_change":"2024-09-12T22:51:29.541434+0000","last_active":"2024-09-12T22:51:29.541408+0000","last_peered":"2024-09-12T22:51:29.541408+0000","last_clean":"2024-09-12T22:51:29.541408+0000","last_became_active":"2024-09-12T22:48:05.176344+0000","last_became_peered":"2024-09-12T22:48:05.176344+0000","last_unstale":"2024-09-12T22:51:29.541408+0000","last_undegraded":"2024-09-12T22:51:29.541408+0000","last_fullsized":"2024-09-12T22:51:29.541408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'405","last_scrub_stamp":"2024-09-12T22:51:29.541317+0000","last_deep_scrub":"61'405","last_deep_scrub_stamp":"2024-09-12T22:51:29.541317+0000","last_clean_scrub_stamp":"2024-09-12T22:51:29.541317+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:07.482340+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":25018,"num_write":372,"num_write_kb":42936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"81'87","reported_seq":247,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:22.520095+0000","last_change":"2024-09-12T22:51:22.520147+0000","last_active":"2024-09-12T22:51:22.520095+0000","last_peered":"2024-09-12T22:51:22.520095+0000","last_clean":"2024-09-12T22:51:22.520095+0000","last_became_active":"2024-09-12T22:50:52.861594+0000","last_became_peered":"2024-09-12T22:50:52.861594+0000","last_unstale":"2024-09-12T22:51:22.520095+0000","last_undegraded":"2024-09-12T22:51:22.520095+0000","last_fullsized":"2024-09-12T22:51:22.520095+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'87","last_scrub_stamp":"2024-09-12T22:51:22.519986+0000","last_deep_scrub":"81'87","last_deep_scrub_stamp":"2024-09-12T22:51:22.519986+0000","last_clean_scrub_stamp":"2024-09-12T22:51:22.519986+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:40:55.944441+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"81'214","reported_seq":348,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:23.988689+0000","last_change":"2024-09-12T22:51:23.988721+0000","last_active":"2024-09-12T22:51:23.988689+0000","last_peered":"2024-09-12T22:51:23.988689+0000","last_clean":"2024-09-12T22:51:23.988689+0000","last_became_active":"2024-09-12T22:50:55.851798+0000","last_became_peered":"2024-09-12T22:50:55.851798+0000","last_unstale":"2024-09-12T22:51:23.988689+0000","last_undegraded":"2024-09-12T22:51:23.988689+0000","last_fullsized":"2024-09-12T22:51:23.988689+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'214","last_scrub_stamp":"2024-09-12T22:51:23.988604+0000","last_deep_scrub":"81'214","last_deep_scrub_stamp":"2024-09-12T22:51:23.988604+0000","last_clean_scrub_stamp":"2024-09-12T22:51:23.988604+0000","objects_scrubbed":1,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:05.350121+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":4171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"61'478","reported_seq":1116,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:39.323655+0000","last_change":"2024-09-12T22:51:39.323679+0000","last_active":"2024-09-12T22:51:39.323655+0000","last_peered":"2024-09-12T22:51:39.323655+0000","last_clean":"2024-09-12T22:51:39.323655+0000","last_became_active":"2024-09-12T22:50:56.855150+0000","last_became_peered":"2024-09-12T22:50:56.855150+0000","last_unstale":"2024-09-12T22:51:39.323655+0000","last_undegraded":"2024-09-12T22:51:39.323655+0000","last_fullsized":"2024-09-12T22:51:39.323655+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'478","last_scrub_stamp":"2024-09-12T22:51:39.323549+0000","last_deep_scrub":"61'478","last_deep_scrub_stamp":"2024-09-12T22:51:39.323549+0000","last_clean_scrub_stamp":"2024-09-12T22:51:39.323549+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:39.363674+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":41320,"num_write":445,"num_write_kb":84826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":209,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"61'55","reported_seq":210,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:16.445712+0000","last_change":"2024-09-12T22:51:16.445736+0000","last_active":"2024-09-12T22:51:16.445712+0000","last_peered":"2024-09-12T22:51:16.445712+0000","last_clean":"2024-09-12T22:51:16.445712+0000","last_became_active":"2024-09-12T22:50:52.859296+0000","last_became_peered":"2024-09-12T22:50:52.859296+0000","last_unstale":"2024-09-12T22:51:16.445712+0000","last_undegraded":"2024-09-12T22:51:16.445712+0000","last_fullsized":"2024-09-12T22:51:16.445712+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'55","last_scrub_stamp":"2024-09-12T22:51:16.445610+0000","last_deep_scrub":"61'55","last_deep_scrub_stamp":"2024-09-12T22:51:16.445610+0000","last_clean_scrub_stamp":"2024-09-12T22:51:16.445610+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:10.194553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"61'447","reported_seq":643,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:37.321849+0000","last_change":"2024-09-12T22:51:37.321873+0000","last_active":"2024-09-12T22:51:37.321849+0000","last_peered":"2024-09-12T22:51:37.321849+0000","last_clean":"2024-09-12T22:51:37.321849+0000","last_became_active":"2024-09-12T22:48:05.168356+0000","last_became_peered":"2024-09-12T22:48:05.168356+0000","last_unstale":"2024-09-12T22:51:37.321849+0000","last_undegraded":"2024-09-12T22:51:37.321849+0000","last_fullsized":"2024-09-12T22:51:37.321849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'447","last_scrub_stamp":"2024-09-12T22:51:37.321761+0000","last_deep_scrub":"61'447","last_deep_scrub_stamp":"2024-09-12T22:51:37.321761+0000","last_clean_scrub_stamp":"2024-09-12T22:51:37.321761+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:45.986173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25877,"num_write":417,"num_write_kb":39269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"61'371","reported_seq":897,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:46.425041+0000","last_change":"2024-09-12T22:51:46.425071+0000","last_active":"2024-09-12T22:51:46.425041+0000","last_peered":"2024-09-12T22:51:46.425041+0000","last_clean":"2024-09-12T22:51:46.425041+0000","last_became_active":"2024-09-12T22:51:02.708091+0000","last_became_peered":"2024-09-12T22:51:02.708091+0000","last_unstale":"2024-09-12T22:51:46.425041+0000","last_undegraded":"2024-09-12T22:51:46.425041+0000","last_fullsized":"2024-09-12T22:51:46.425041+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'371","last_scrub_stamp":"2024-09-12T22:51:46.424936+0000","last_deep_scrub":"61'371","last_deep_scrub_stamp":"2024-09-12T22:51:46.424936+0000","last_clean_scrub_stamp":"2024-09-12T22:51:46.424936+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:25.289213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20950,"num_write":339,"num_write_kb":39207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"81'603","reported_seq":751,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:34.386436+0000","last_change":"2024-09-12T22:51:34.386463+0000","last_active":"2024-09-12T22:51:34.386436+0000","last_peered":"2024-09-12T22:51:34.386436+0000","last_clean":"2024-09-12T22:51:34.386436+0000","last_became_active":"2024-09-12T22:48:04.168743+0000","last_became_peered":"2024-09-12T22:48:04.168743+0000","last_unstale":"2024-09-12T22:51:34.386436+0000","last_undegraded":"2024-09-12T22:51:34.386436+0000","last_fullsized":"2024-09-12T22:51:34.386436+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'603","last_scrub_stamp":"2024-09-12T22:51:34.386337+0000","last_deep_scrub":"81'603","last_deep_scrub_stamp":"2024-09-12T22:51:34.386337+0000","last_clean_scrub_stamp":"2024-09-12T22:51:34.386337+0000","objects_scrubbed":2,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:46.530479+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":535,"num_write_kb":8445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"61'438","reported_seq":987,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:41.353718+0000","last_change":"2024-09-12T22:51:41.353743+0000","last_active":"2024-09-12T22:51:41.353718+0000","last_peered":"2024-09-12T22:51:41.353718+0000","last_clean":"2024-09-12T22:51:41.353718+0000","last_became_active":"2024-09-12T22:50:57.861695+0000","last_became_peered":"2024-09-12T22:50:57.861695+0000","last_unstale":"2024-09-12T22:51:41.353718+0000","last_undegraded":"2024-09-12T22:51:41.353718+0000","last_fullsized":"2024-09-12T22:51:41.353718+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'438","last_scrub_stamp":"2024-09-12T22:51:41.353630+0000","last_deep_scrub":"61'438","last_deep_scrub_stamp":"2024-09-12T22:51:41.353630+0000","last_clean_scrub_stamp":"2024-09-12T22:51:41.353630+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:56.307938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":16921,"num_write":411,"num_write_kb":146790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"81'186","reported_seq":347,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:26.462203+0000","last_change":"2024-09-12T22:51:26.462235+0000","last_active":"2024-09-12T22:51:26.462203+0000","last_peered":"2024-09-12T22:51:26.462203+0000","last_clean":"2024-09-12T22:51:26.462203+0000","last_became_active":"2024-09-12T22:50:55.852796+0000","last_became_peered":"2024-09-12T22:50:55.852796+0000","last_unstale":"2024-09-12T22:51:26.462203+0000","last_undegraded":"2024-09-12T22:51:26.462203+0000","last_fullsized":"2024-09-12T22:51:26.462203+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'186","last_scrub_stamp":"2024-09-12T22:51:26.462116+0000","last_deep_scrub":"81'186","last_deep_scrub_stamp":"2024-09-12T22:51:26.462116+0000","last_clean_scrub_stamp":"2024-09-12T22:51:26.462116+0000","objects_scrubbed":1,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:19:09.019048+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"61'386","reported_seq":895,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:45.398706+0000","last_change":"2024-09-12T22:51:45.398749+0000","last_active":"2024-09-12T22:51:45.398706+0000","last_peered":"2024-09-12T22:51:45.398706+0000","last_clean":"2024-09-12T22:51:45.398706+0000","last_became_active":"2024-09-12T22:51:01.701006+0000","last_became_peered":"2024-09-12T22:51:01.701006+0000","last_unstale":"2024-09-12T22:51:45.398706+0000","last_undegraded":"2024-09-12T22:51:45.398706+0000","last_fullsized":"2024-09-12T22:51:45.398706+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'386","last_scrub_stamp":"2024-09-12T22:51:45.398570+0000","last_deep_scrub":"61'386","last_deep_scrub_stamp":"2024-09-12T22:51:45.398570+0000","last_clean_scrub_stamp":"2024-09-12T22:51:45.398570+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:04.995247+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":21487,"num_write":344,"num_write_kb":72645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"81'183","reported_seq":331,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:33.369780+0000","last_change":"2024-09-12T22:51:33.369810+0000","last_active":"2024-09-12T22:51:33.369780+0000","last_peered":"2024-09-12T22:51:33.369780+0000","last_clean":"2024-09-12T22:51:33.369780+0000","last_became_active":"2024-09-12T22:48:04.173902+0000","last_became_peered":"2024-09-12T22:48:04.173902+0000","last_unstale":"2024-09-12T22:51:33.369780+0000","last_undegraded":"2024-09-12T22:51:33.369780+0000","last_fullsized":"2024-09-12T22:51:33.369780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'183","last_scrub_stamp":"2024-09-12T22:51:33.369697+0000","last_deep_scrub":"81'183","last_deep_scrub_stamp":"2024-09-12T22:51:33.369697+0000","last_clean_scrub_stamp":"2024-09-12T22:51:33.369697+0000","objects_scrubbed":3,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:36:52.774839+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":12355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"61'396","reported_seq":561,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:23.537596+0000","last_change":"2024-09-12T22:51:23.537623+0000","last_active":"2024-09-12T22:51:23.537596+0000","last_peered":"2024-09-12T22:51:23.537596+0000","last_clean":"2024-09-12T22:51:23.537596+0000","last_became_active":"2024-09-12T22:48:05.172493+0000","last_became_peered":"2024-09-12T22:48:05.172493+0000","last_unstale":"2024-09-12T22:51:23.537596+0000","last_undegraded":"2024-09-12T22:51:23.537596+0000","last_fullsized":"2024-09-12T22:51:23.537596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'396","last_scrub_stamp":"2024-09-12T22:51:23.537469+0000","last_deep_scrub":"61'396","last_deep_scrub_stamp":"2024-09-12T22:51:23.537469+0000","last_clean_scrub_stamp":"2024-09-12T22:51:23.537469+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:44.314218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9980,"num_write":370,"num_write_kb":80321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"81'65","reported_seq":225,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:20.556732+0000","last_change":"2024-09-12T22:51:20.556757+0000","last_active":"2024-09-12T22:51:20.556732+0000","last_peered":"2024-09-12T22:51:20.556732+0000","last_clean":"2024-09-12T22:51:20.556732+0000","last_became_active":"2024-09-12T22:50:52.858938+0000","last_became_peered":"2024-09-12T22:50:52.858938+0000","last_unstale":"2024-09-12T22:51:20.556732+0000","last_undegraded":"2024-09-12T22:51:20.556732+0000","last_fullsized":"2024-09-12T22:51:20.556732+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'65","last_scrub_stamp":"2024-09-12T22:51:20.556625+0000","last_deep_scrub":"81'65","last_deep_scrub_stamp":"2024-09-12T22:51:20.556625+0000","last_clean_scrub_stamp":"2024-09-12T22:51:20.556625+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:00.739728+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"61'370","reported_seq":524,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:33.057215+0000","last_change":"2024-09-12T22:51:33.057273+0000","last_active":"2024-09-12T22:51:33.057215+0000","last_peered":"2024-09-12T22:51:33.057215+0000","last_clean":"2024-09-12T22:51:33.057215+0000","last_became_active":"2024-09-12T22:50:59.704074+0000","last_became_peered":"2024-09-12T22:50:59.704074+0000","last_unstale":"2024-09-12T22:51:33.057215+0000","last_undegraded":"2024-09-12T22:51:33.057215+0000","last_fullsized":"2024-09-12T22:51:33.057215+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'370","last_scrub_stamp":"2024-09-12T22:51:33.057092+0000","last_deep_scrub":"61'370","last_deep_scrub_stamp":"2024-09-12T22:51:33.057092+0000","last_clean_scrub_stamp":"2024-09-12T22:51:33.057092+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:43:01.870992+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16468,"num_write":341,"num_write_kb":50344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"81'189","reported_seq":332,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:29.993909+0000","last_change":"2024-09-12T22:51:29.993969+0000","last_active":"2024-09-12T22:51:29.993909+0000","last_peered":"2024-09-12T22:51:29.993909+0000","last_clean":"2024-09-12T22:51:29.993909+0000","last_became_active":"2024-09-12T22:50:55.851467+0000","last_became_peered":"2024-09-12T22:50:55.851467+0000","last_unstale":"2024-09-12T22:51:29.993909+0000","last_undegraded":"2024-09-12T22:51:29.993909+0000","last_fullsized":"2024-09-12T22:51:29.993909+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'189","last_scrub_stamp":"2024-09-12T22:51:29.993826+0000","last_deep_scrub":"81'189","last_deep_scrub_stamp":"2024-09-12T22:51:29.993826+0000","last_clean_scrub_stamp":"2024-09-12T22:51:29.993826+0000","objects_scrubbed":2,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:07.320092+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"61'438","reported_seq":645,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:35.020938+0000","last_change":"2024-09-12T22:51:35.020999+0000","last_active":"2024-09-12T22:51:35.020938+0000","last_peered":"2024-09-12T22:51:35.020938+0000","last_clean":"2024-09-12T22:51:35.020938+0000","last_became_active":"2024-09-12T22:50:59.703786+0000","last_became_peered":"2024-09-12T22:50:59.703786+0000","last_unstale":"2024-09-12T22:51:35.020938+0000","last_undegraded":"2024-09-12T22:51:35.020938+0000","last_fullsized":"2024-09-12T22:51:35.020938+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'438","last_scrub_stamp":"2024-09-12T22:51:35.020820+0000","last_deep_scrub":"61'438","last_deep_scrub_stamp":"2024-09-12T22:51:35.020820+0000","last_clean_scrub_stamp":"2024-09-12T22:51:35.020820+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:25.292820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":38460,"num_write":412,"num_write_kb":96626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"81'189","reported_seq":355,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:30.368737+0000","last_change":"2024-09-12T22:51:30.368766+0000","last_active":"2024-09-12T22:51:30.368737+0000","last_peered":"2024-09-12T22:51:30.368737+0000","last_clean":"2024-09-12T22:51:30.368737+0000","last_became_active":"2024-09-12T22:50:55.852654+0000","last_became_peered":"2024-09-12T22:50:55.852654+0000","last_unstale":"2024-09-12T22:51:30.368737+0000","last_undegraded":"2024-09-12T22:51:30.368737+0000","last_fullsized":"2024-09-12T22:51:30.368737+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'189","last_scrub_stamp":"2024-09-12T22:51:30.368658+0000","last_deep_scrub":"81'189","last_deep_scrub_stamp":"2024-09-12T22:51:30.368658+0000","last_clean_scrub_stamp":"2024-09-12T22:51:30.368658+0000","objects_scrubbed":4,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:09:37.376911+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":12349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"61'418","reported_seq":608,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:31.344838+0000","last_change":"2024-09-12T22:51:31.344864+0000","last_active":"2024-09-12T22:51:31.344838+0000","last_peered":"2024-09-12T22:51:31.344838+0000","last_clean":"2024-09-12T22:51:31.344838+0000","last_became_active":"2024-09-12T22:48:05.171361+0000","last_became_peered":"2024-09-12T22:48:05.171361+0000","last_unstale":"2024-09-12T22:51:31.344838+0000","last_undegraded":"2024-09-12T22:51:31.344838+0000","last_fullsized":"2024-09-12T22:51:31.344838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'418","last_scrub_stamp":"2024-09-12T22:51:31.344749+0000","last_deep_scrub":"61'418","last_deep_scrub_stamp":"2024-09-12T22:51:31.344749+0000","last_clean_scrub_stamp":"2024-09-12T22:51:31.344749+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:58.481537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":27427,"num_write":388,"num_write_kb":67745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"81'160","reported_seq":295,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:24.498552+0000","last_change":"2024-09-12T22:51:24.498581+0000","last_active":"2024-09-12T22:51:24.498552+0000","last_peered":"2024-09-12T22:51:24.498552+0000","last_clean":"2024-09-12T22:51:24.498552+0000","last_became_active":"2024-09-12T22:50:55.851948+0000","last_became_peered":"2024-09-12T22:50:55.851948+0000","last_unstale":"2024-09-12T22:51:24.498552+0000","last_undegraded":"2024-09-12T22:51:24.498552+0000","last_fullsized":"2024-09-12T22:51:24.498552+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'160","last_scrub_stamp":"2024-09-12T22:51:24.498465+0000","last_deep_scrub":"81'160","last_deep_scrub_stamp":"2024-09-12T22:51:24.498465+0000","last_clean_scrub_stamp":"2024-09-12T22:51:24.498465+0000","objects_scrubbed":1,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:19:07.055397+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"61'479","reported_seq":653,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:05.723118+0000","last_change":"2024-09-12T22:51:03.707091+0000","last_active":"2024-09-12T22:51:05.723118+0000","last_peered":"2024-09-12T22:51:05.723118+0000","last_clean":"2024-09-12T22:51:05.723118+0000","last_became_active":"2024-09-12T22:51:03.704137+0000","last_became_peered":"2024-09-12T22:51:03.704137+0000","last_unstale":"2024-09-12T22:51:05.723118+0000","last_undegraded":"2024-09-12T22:51:05.723118+0000","last_fullsized":"2024-09-12T22:51:05.723118+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:48:04.151535+0000","last_clean_scrub_stamp":"2024-09-12T22:48:04.151535+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":26793,"num_write":459,"num_write_kb":138325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"81'52","reported_seq":212,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:20.543143+0000","last_change":"2024-09-12T22:51:20.543198+0000","last_active":"2024-09-12T22:51:20.543143+0000","last_peered":"2024-09-12T22:51:20.543143+0000","last_clean":"2024-09-12T22:51:20.543143+0000","last_became_active":"2024-09-12T22:50:52.859983+0000","last_became_peered":"2024-09-12T22:50:52.859983+0000","last_unstale":"2024-09-12T22:51:20.543143+0000","last_undegraded":"2024-09-12T22:51:20.543143+0000","last_fullsized":"2024-09-12T22:51:20.543143+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'52","last_scrub_stamp":"2024-09-12T22:51:20.543052+0000","last_deep_scrub":"81'52","last_deep_scrub_stamp":"2024-09-12T22:51:20.543052+0000","last_clean_scrub_stamp":"2024-09-12T22:51:20.543052+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:00.609182+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2742,"num_read_kb":1405479,"num_write":24656,"num_write_kb":4261796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7339,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26737,"ondisk_log_size":26737,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127366156,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":45,"num_read_kb":1459,"num_write":4460,"num_write_kb":127655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":93806220,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254799872,"data_stored":254732312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5569,"internal_metadata":0},"log_size":6296,"ondisk_log_size":6296,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":67,"seq":287762808846,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150988,"kb_used_data":92924,"kb_used_omap":6,"kb_used_meta":58041,"kb_avail":94220852,"statfs":{"total":96636764160,"available":96482152448,"internally_reserved":0,"allocated":95154176,"data_stored":94739479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7164,"internal_metadata":59433988},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738419,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":169448,"kb_used_data":75864,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94202392,"statfs":{"total":96636764160,"available":96463249408,"internally_reserved":0,"allocated":77684736,"data_stored":77299268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738420,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":172708,"kb_used_data":83284,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94199132,"statfs":{"total":96636764160,"available":96459911168,"internally_reserved":0,"allocated":85282816,"data_stored":84886443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83980288,"data_stored":83958707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":76972032,"data_stored":76961881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":93847552,"data_stored":93811724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5569,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:51:55.567 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:55.568 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T22:48:04.151535+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=48, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=51, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:51:55.568 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T22:52:15.569 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:52:15.878 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:52:15.880 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-09-12T22:52:15.893 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":209,"stamp":"2024-09-12T22:52:14.191950+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127956543,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":2923,"num_read_kb":1407056,"num_write":29321,"num_write_kb":4392913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7366,"num_bytes_recovered":93806220,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33197,"ondisk_log_size":33197,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":493144,"kb_used_data":252072,"kb_used_omap":10,"kb_used_meta":241013,"kb_avail":282622376,"statfs":{"total":289910292480,"available":289405313024,"internally_reserved":0,"allocated":258121728,"data_stored":256925190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10354,"internal_metadata":246798222},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003747"},"pg_stats":[{"pgid":"4.3f","version":"61'404","reported_seq":572,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:17.547756+0000","last_change":"2024-09-12T22:51:17.547783+0000","last_active":"2024-09-12T22:51:17.547756+0000","last_peered":"2024-09-12T22:51:17.547756+0000","last_clean":"2024-09-12T22:51:17.547756+0000","last_became_active":"2024-09-12T22:48:05.172964+0000","last_became_peered":"2024-09-12T22:48:05.172964+0000","last_unstale":"2024-09-12T22:51:17.547756+0000","last_undegraded":"2024-09-12T22:51:17.547756+0000","last_fullsized":"2024-09-12T22:51:17.547756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'404","last_scrub_stamp":"2024-09-12T22:51:17.547649+0000","last_deep_scrub":"61'404","last_deep_scrub_stamp":"2024-09-12T22:51:17.547649+0000","last_clean_scrub_stamp":"2024-09-12T22:51:17.547649+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:03:32.488397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9582,"num_write":371,"num_write_kb":42180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"61'425","reported_seq":642,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:21.520920+0000","last_change":"2024-09-12T22:51:21.520960+0000","last_active":"2024-09-12T22:51:21.520920+0000","last_peered":"2024-09-12T22:51:21.520920+0000","last_clean":"2024-09-12T22:51:21.520920+0000","last_became_active":"2024-09-12T22:48:05.172684+0000","last_became_peered":"2024-09-12T22:48:05.172684+0000","last_unstale":"2024-09-12T22:51:21.520920+0000","last_undegraded":"2024-09-12T22:51:21.520920+0000","last_fullsized":"2024-09-12T22:51:21.520920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'425","last_scrub_stamp":"2024-09-12T22:51:21.520763+0000","last_deep_scrub":"61'425","last_deep_scrub_stamp":"2024-09-12T22:51:21.520763+0000","last_clean_scrub_stamp":"2024-09-12T22:51:21.520763+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:08.747037+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":40466,"num_write":394,"num_write_kb":96045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"61'385","reported_seq":525,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:16.998541+0000","last_change":"2024-09-12T22:51:16.998566+0000","last_active":"2024-09-12T22:51:16.998541+0000","last_peered":"2024-09-12T22:51:16.998541+0000","last_clean":"2024-09-12T22:51:16.998541+0000","last_became_active":"2024-09-12T22:51:00.700490+0000","last_became_peered":"2024-09-12T22:51:00.700490+0000","last_unstale":"2024-09-12T22:51:16.998541+0000","last_undegraded":"2024-09-12T22:51:16.998541+0000","last_fullsized":"2024-09-12T22:51:16.998541+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'385","last_scrub_stamp":"2024-09-12T22:51:16.998452+0000","last_deep_scrub":"61'385","last_deep_scrub_stamp":"2024-09-12T22:51:16.998452+0000","last_clean_scrub_stamp":"2024-09-12T22:51:16.998452+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:25.166404+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":7348,"num_write":352,"num_write_kb":34517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"61'395","reported_seq":572,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:48.116245+0000","last_change":"2024-09-12T22:51:48.116266+0000","last_active":"2024-09-12T22:51:48.116245+0000","last_peered":"2024-09-12T22:51:48.116245+0000","last_clean":"2024-09-12T22:51:48.116245+0000","last_became_active":"2024-09-12T22:51:02.708216+0000","last_became_peered":"2024-09-12T22:51:02.708216+0000","last_unstale":"2024-09-12T22:51:48.116245+0000","last_undegraded":"2024-09-12T22:51:48.116245+0000","last_fullsized":"2024-09-12T22:51:48.116245+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'395","last_scrub_stamp":"2024-09-12T22:51:48.116167+0000","last_deep_scrub":"61'395","last_deep_scrub_stamp":"2024-09-12T22:51:48.116167+0000","last_clean_scrub_stamp":"2024-09-12T22:51:48.116167+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:17.024058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":25803,"num_write":361,"num_write_kb":71646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"61'410","reported_seq":582,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:35.335077+0000","last_change":"2024-09-12T22:51:35.335105+0000","last_active":"2024-09-12T22:51:35.335077+0000","last_peered":"2024-09-12T22:51:35.335077+0000","last_clean":"2024-09-12T22:51:35.335077+0000","last_became_active":"2024-09-12T22:48:05.169940+0000","last_became_peered":"2024-09-12T22:48:05.169940+0000","last_unstale":"2024-09-12T22:51:35.335077+0000","last_undegraded":"2024-09-12T22:51:35.335077+0000","last_fullsized":"2024-09-12T22:51:35.335077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'410","last_scrub_stamp":"2024-09-12T22:51:35.334987+0000","last_deep_scrub":"61'410","last_deep_scrub_stamp":"2024-09-12T22:51:35.334987+0000","last_clean_scrub_stamp":"2024-09-12T22:51:35.334987+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:43.999399+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":20544,"num_write":387,"num_write_kb":55745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"61'384","reported_seq":508,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:50.082674+0000","last_change":"2024-09-12T22:51:50.082700+0000","last_active":"2024-09-12T22:51:50.082674+0000","last_peered":"2024-09-12T22:51:50.082674+0000","last_clean":"2024-09-12T22:51:50.082674+0000","last_became_active":"2024-09-12T22:51:03.704293+0000","last_became_peered":"2024-09-12T22:51:03.704293+0000","last_unstale":"2024-09-12T22:51:50.082674+0000","last_undegraded":"2024-09-12T22:51:50.082674+0000","last_fullsized":"2024-09-12T22:51:50.082674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'384","last_scrub_stamp":"2024-09-12T22:51:50.082584+0000","last_deep_scrub":"61'384","last_deep_scrub_stamp":"2024-09-12T22:51:50.082584+0000","last_clean_scrub_stamp":"2024-09-12T22:51:50.082584+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:31:07.256104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5069,"num_write":355,"num_write_kb":38430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"61'461","reported_seq":665,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:24.933889+0000","last_change":"2024-09-12T22:51:24.933916+0000","last_active":"2024-09-12T22:51:24.933889+0000","last_peered":"2024-09-12T22:51:24.933889+0000","last_clean":"2024-09-12T22:51:24.933889+0000","last_became_active":"2024-09-12T22:50:56.856720+0000","last_became_peered":"2024-09-12T22:50:56.856720+0000","last_unstale":"2024-09-12T22:51:24.933889+0000","last_undegraded":"2024-09-12T22:51:24.933889+0000","last_fullsized":"2024-09-12T22:51:24.933889+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'461","last_scrub_stamp":"2024-09-12T22:51:24.933802+0000","last_deep_scrub":"61'461","last_deep_scrub_stamp":"2024-09-12T22:51:24.933802+0000","last_clean_scrub_stamp":"2024-09-12T22:51:24.933802+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:19:33.581183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":30574,"num_write":435,"num_write_kb":92996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"61'385","reported_seq":527,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:18.026449+0000","last_change":"2024-09-12T22:51:18.026473+0000","last_active":"2024-09-12T22:51:18.026449+0000","last_peered":"2024-09-12T22:51:18.026449+0000","last_clean":"2024-09-12T22:51:18.026449+0000","last_became_active":"2024-09-12T22:51:00.700472+0000","last_became_peered":"2024-09-12T22:51:00.700472+0000","last_unstale":"2024-09-12T22:51:18.026449+0000","last_undegraded":"2024-09-12T22:51:18.026449+0000","last_fullsized":"2024-09-12T22:51:18.026449+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'385","last_scrub_stamp":"2024-09-12T22:51:18.026325+0000","last_deep_scrub":"61'385","last_deep_scrub_stamp":"2024-09-12T22:51:18.026325+0000","last_clean_scrub_stamp":"2024-09-12T22:51:18.026325+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:33.411721+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9031,"num_write":340,"num_write_kb":84729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"61'435","reported_seq":594,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:17.493544+0000","last_change":"2024-09-12T22:51:17.493570+0000","last_active":"2024-09-12T22:51:17.493544+0000","last_peered":"2024-09-12T22:51:17.493544+0000","last_clean":"2024-09-12T22:51:17.493544+0000","last_became_active":"2024-09-12T22:48:05.177284+0000","last_became_peered":"2024-09-12T22:48:05.177284+0000","last_unstale":"2024-09-12T22:51:17.493544+0000","last_undegraded":"2024-09-12T22:51:17.493544+0000","last_fullsized":"2024-09-12T22:51:17.493544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'435","last_scrub_stamp":"2024-09-12T22:51:17.493458+0000","last_deep_scrub":"61'435","last_deep_scrub_stamp":"2024-09-12T22:51:17.493458+0000","last_clean_scrub_stamp":"2024-09-12T22:51:17.493458+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:21.403217+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8316,"num_write":403,"num_write_kb":71851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"61'443","reported_seq":657,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:27.442616+0000","last_change":"2024-09-12T22:51:27.442641+0000","last_active":"2024-09-12T22:51:27.442616+0000","last_peered":"2024-09-12T22:51:27.442616+0000","last_clean":"2024-09-12T22:51:27.442616+0000","last_became_active":"2024-09-12T22:48:05.171686+0000","last_became_peered":"2024-09-12T22:48:05.171686+0000","last_unstale":"2024-09-12T22:51:27.442616+0000","last_undegraded":"2024-09-12T22:51:27.442616+0000","last_fullsized":"2024-09-12T22:51:27.442616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'443","last_scrub_stamp":"2024-09-12T22:51:27.442524+0000","last_deep_scrub":"61'443","last_deep_scrub_stamp":"2024-09-12T22:51:27.442524+0000","last_clean_scrub_stamp":"2024-09-12T22:51:27.442524+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:24.651831+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40751,"num_write":407,"num_write_kb":116626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"61'383","reported_seq":518,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:49.071239+0000","last_change":"2024-09-12T22:51:49.071282+0000","last_active":"2024-09-12T22:51:49.071239+0000","last_peered":"2024-09-12T22:51:49.071239+0000","last_clean":"2024-09-12T22:51:49.071239+0000","last_became_active":"2024-09-12T22:51:02.710579+0000","last_became_peered":"2024-09-12T22:51:02.710579+0000","last_unstale":"2024-09-12T22:51:49.071239+0000","last_undegraded":"2024-09-12T22:51:49.071239+0000","last_fullsized":"2024-09-12T22:51:49.071239+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'383","last_scrub_stamp":"2024-09-12T22:51:49.071138+0000","last_deep_scrub":"61'383","last_deep_scrub_stamp":"2024-09-12T22:51:49.071138+0000","last_clean_scrub_stamp":"2024-09-12T22:51:49.071138+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:56.043201+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5475,"num_write":365,"num_write_kb":63204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"61'366","reported_seq":900,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:14.539254+0000","last_change":"2024-09-12T22:51:14.539280+0000","last_active":"2024-09-12T22:51:14.539254+0000","last_peered":"2024-09-12T22:51:14.539254+0000","last_clean":"2024-09-12T22:51:14.539254+0000","last_became_active":"2024-09-12T22:50:58.698711+0000","last_became_peered":"2024-09-12T22:50:58.698711+0000","last_unstale":"2024-09-12T22:51:14.539254+0000","last_undegraded":"2024-09-12T22:51:14.539254+0000","last_fullsized":"2024-09-12T22:51:14.539254+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'366","last_scrub_stamp":"2024-09-12T22:51:14.539130+0000","last_deep_scrub":"61'366","last_deep_scrub_stamp":"2024-09-12T22:51:14.539130+0000","last_clean_scrub_stamp":"2024-09-12T22:51:14.539130+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:42.502517+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":35222,"num_write":342,"num_write_kb":74947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"61'434","reported_seq":631,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:37.341971+0000","last_change":"2024-09-12T22:51:37.341999+0000","last_active":"2024-09-12T22:51:37.341971+0000","last_peered":"2024-09-12T22:51:37.341971+0000","last_clean":"2024-09-12T22:51:37.341971+0000","last_became_active":"2024-09-12T22:48:05.170794+0000","last_became_peered":"2024-09-12T22:48:05.170794+0000","last_unstale":"2024-09-12T22:51:37.341971+0000","last_undegraded":"2024-09-12T22:51:37.341971+0000","last_fullsized":"2024-09-12T22:51:37.341971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'434","last_scrub_stamp":"2024-09-12T22:51:37.341864+0000","last_deep_scrub":"61'434","last_deep_scrub_stamp":"2024-09-12T22:51:37.341864+0000","last_clean_scrub_stamp":"2024-09-12T22:51:37.341864+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:37.381989+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":19623,"num_write":389,"num_write_kb":83457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"61'432","reported_seq":610,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:30.965788+0000","last_change":"2024-09-12T22:51:30.965845+0000","last_active":"2024-09-12T22:51:30.965788+0000","last_peered":"2024-09-12T22:51:30.965788+0000","last_clean":"2024-09-12T22:51:30.965788+0000","last_became_active":"2024-09-12T22:50:58.700107+0000","last_became_peered":"2024-09-12T22:50:58.700107+0000","last_unstale":"2024-09-12T22:51:30.965788+0000","last_undegraded":"2024-09-12T22:51:30.965788+0000","last_fullsized":"2024-09-12T22:51:30.965788+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'432","last_scrub_stamp":"2024-09-12T22:51:30.965666+0000","last_deep_scrub":"61'432","last_deep_scrub_stamp":"2024-09-12T22:51:30.965666+0000","last_clean_scrub_stamp":"2024-09-12T22:51:30.965666+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:27:20.749081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":23332,"num_write":401,"num_write_kb":75871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"61'406","reported_seq":582,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:22.007624+0000","last_change":"2024-09-12T22:51:22.007658+0000","last_active":"2024-09-12T22:51:22.007624+0000","last_peered":"2024-09-12T22:51:22.007624+0000","last_clean":"2024-09-12T22:51:22.007624+0000","last_became_active":"2024-09-12T22:50:55.849568+0000","last_became_peered":"2024-09-12T22:50:55.849568+0000","last_unstale":"2024-09-12T22:51:22.007624+0000","last_undegraded":"2024-09-12T22:51:22.007624+0000","last_fullsized":"2024-09-12T22:51:22.007624+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'406","last_scrub_stamp":"2024-09-12T22:51:22.007494+0000","last_deep_scrub":"61'406","last_deep_scrub_stamp":"2024-09-12T22:51:22.007494+0000","last_clean_scrub_stamp":"2024-09-12T22:51:22.007494+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:28:45.134382+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":18162,"num_write":365,"num_write_kb":58919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"61'444","reported_seq":584,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:16.031447+0000","last_change":"2024-09-12T22:51:16.031494+0000","last_active":"2024-09-12T22:51:16.031447+0000","last_peered":"2024-09-12T22:51:16.031447+0000","last_clean":"2024-09-12T22:51:16.031447+0000","last_became_active":"2024-09-12T22:51:01.700744+0000","last_became_peered":"2024-09-12T22:51:01.700744+0000","last_unstale":"2024-09-12T22:51:16.031447+0000","last_undegraded":"2024-09-12T22:51:16.031447+0000","last_fullsized":"2024-09-12T22:51:16.031447+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'444","last_scrub_stamp":"2024-09-12T22:51:16.031333+0000","last_deep_scrub":"61'444","last_deep_scrub_stamp":"2024-09-12T22:51:16.031333+0000","last_clean_scrub_stamp":"2024-09-12T22:51:16.031333+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:38.746367+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":410,"num_write_kb":63144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"61'443","reported_seq":625,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:15.477254+0000","last_change":"2024-09-12T22:51:15.477280+0000","last_active":"2024-09-12T22:51:15.477254+0000","last_peered":"2024-09-12T22:51:15.477254+0000","last_clean":"2024-09-12T22:51:15.477254+0000","last_became_active":"2024-09-12T22:48:05.177965+0000","last_became_peered":"2024-09-12T22:48:05.177965+0000","last_unstale":"2024-09-12T22:51:15.477254+0000","last_undegraded":"2024-09-12T22:51:15.477254+0000","last_fullsized":"2024-09-12T22:51:15.477254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'443","last_scrub_stamp":"2024-09-12T22:51:15.477164+0000","last_deep_scrub":"61'443","last_deep_scrub_stamp":"2024-09-12T22:51:15.477164+0000","last_clean_scrub_stamp":"2024-09-12T22:51:15.477164+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:21.477261+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":14687,"num_write":408,"num_write_kb":80026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"61'439","reported_seq":674,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:36.339107+0000","last_change":"2024-09-12T22:51:36.339134+0000","last_active":"2024-09-12T22:51:36.339107+0000","last_peered":"2024-09-12T22:51:36.339107+0000","last_clean":"2024-09-12T22:51:36.339107+0000","last_became_active":"2024-09-12T22:48:05.170578+0000","last_became_peered":"2024-09-12T22:48:05.170578+0000","last_unstale":"2024-09-12T22:51:36.339107+0000","last_undegraded":"2024-09-12T22:51:36.339107+0000","last_fullsized":"2024-09-12T22:51:36.339107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'439","last_scrub_stamp":"2024-09-12T22:51:36.339005+0000","last_deep_scrub":"61'439","last_deep_scrub_stamp":"2024-09-12T22:51:36.339005+0000","last_clean_scrub_stamp":"2024-09-12T22:51:36.339005+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:46.777468+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":47063,"num_write":400,"num_write_kb":100535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"61'444","reported_seq":669,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:23.424561+0000","last_change":"2024-09-12T22:51:23.424617+0000","last_active":"2024-09-12T22:51:23.424561+0000","last_peered":"2024-09-12T22:51:23.424561+0000","last_clean":"2024-09-12T22:51:23.424561+0000","last_became_active":"2024-09-12T22:48:05.176680+0000","last_became_peered":"2024-09-12T22:48:05.176680+0000","last_unstale":"2024-09-12T22:51:23.424561+0000","last_undegraded":"2024-09-12T22:51:23.424561+0000","last_fullsized":"2024-09-12T22:51:23.424561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'444","last_scrub_stamp":"2024-09-12T22:51:23.424460+0000","last_deep_scrub":"61'444","last_deep_scrub_stamp":"2024-09-12T22:51:23.424460+0000","last_clean_scrub_stamp":"2024-09-12T22:51:23.424460+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:04.269715+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":42758,"num_write":403,"num_write_kb":67827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"61'433","reported_seq":579,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:47.122207+0000","last_change":"2024-09-12T22:51:47.122230+0000","last_active":"2024-09-12T22:51:47.122207+0000","last_peered":"2024-09-12T22:51:47.122207+0000","last_clean":"2024-09-12T22:51:47.122207+0000","last_became_active":"2024-09-12T22:51:02.708090+0000","last_became_peered":"2024-09-12T22:51:02.708090+0000","last_unstale":"2024-09-12T22:51:47.122207+0000","last_undegraded":"2024-09-12T22:51:47.122207+0000","last_fullsized":"2024-09-12T22:51:47.122207+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'433","last_scrub_stamp":"2024-09-12T22:51:47.122131+0000","last_deep_scrub":"61'433","last_deep_scrub_stamp":"2024-09-12T22:51:47.122131+0000","last_clean_scrub_stamp":"2024-09-12T22:51:47.122131+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:25.826957+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":10750,"num_write":397,"num_write_kb":34708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"61'413","reported_seq":597,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:28.971245+0000","last_change":"2024-09-12T22:51:28.971283+0000","last_active":"2024-09-12T22:51:28.971245+0000","last_peered":"2024-09-12T22:51:28.971245+0000","last_clean":"2024-09-12T22:51:28.971245+0000","last_became_active":"2024-09-12T22:50:58.699982+0000","last_became_peered":"2024-09-12T22:50:58.699982+0000","last_unstale":"2024-09-12T22:51:28.971245+0000","last_undegraded":"2024-09-12T22:51:28.971245+0000","last_fullsized":"2024-09-12T22:51:28.971245+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'413","last_scrub_stamp":"2024-09-12T22:51:28.971124+0000","last_deep_scrub":"61'413","last_deep_scrub_stamp":"2024-09-12T22:51:28.971124+0000","last_clean_scrub_stamp":"2024-09-12T22:51:28.971124+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:41:37.457817+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":25621,"num_write":385,"num_write_kb":63908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"61'462","reported_seq":1075,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:41.322361+0000","last_change":"2024-09-12T22:51:41.322388+0000","last_active":"2024-09-12T22:51:41.322361+0000","last_peered":"2024-09-12T22:51:41.322361+0000","last_clean":"2024-09-12T22:51:41.322361+0000","last_became_active":"2024-09-12T22:50:58.700047+0000","last_became_peered":"2024-09-12T22:50:58.700047+0000","last_unstale":"2024-09-12T22:51:41.322361+0000","last_undegraded":"2024-09-12T22:51:41.322361+0000","last_fullsized":"2024-09-12T22:51:41.322361+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'462","last_scrub_stamp":"2024-09-12T22:51:41.322253+0000","last_deep_scrub":"61'462","last_deep_scrub_stamp":"2024-09-12T22:51:41.322253+0000","last_clean_scrub_stamp":"2024-09-12T22:51:41.322253+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:03:59.104498+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":28920,"num_write":428,"num_write_kb":76277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"61'413","reported_seq":957,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:40.347956+0000","last_change":"2024-09-12T22:51:40.347986+0000","last_active":"2024-09-12T22:51:40.347956+0000","last_peered":"2024-09-12T22:51:40.347956+0000","last_clean":"2024-09-12T22:51:40.347956+0000","last_became_active":"2024-09-12T22:50:57.860819+0000","last_became_peered":"2024-09-12T22:50:57.860819+0000","last_unstale":"2024-09-12T22:51:40.347956+0000","last_undegraded":"2024-09-12T22:51:40.347956+0000","last_fullsized":"2024-09-12T22:51:40.347956+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'413","last_scrub_stamp":"2024-09-12T22:51:40.347817+0000","last_deep_scrub":"61'413","last_deep_scrub_stamp":"2024-09-12T22:51:40.347817+0000","last_clean_scrub_stamp":"2024-09-12T22:51:40.347817+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:52.345890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":14661,"num_write":381,"num_write_kb":72596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"61'475","reported_seq":689,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:25.495344+0000","last_change":"2024-09-12T22:51:25.495369+0000","last_active":"2024-09-12T22:51:25.495344+0000","last_peered":"2024-09-12T22:51:25.495344+0000","last_clean":"2024-09-12T22:51:25.495344+0000","last_became_active":"2024-09-12T22:48:05.172437+0000","last_became_peered":"2024-09-12T22:48:05.172437+0000","last_unstale":"2024-09-12T22:51:25.495344+0000","last_undegraded":"2024-09-12T22:51:25.495344+0000","last_fullsized":"2024-09-12T22:51:25.495344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'475","last_scrub_stamp":"2024-09-12T22:51:25.495255+0000","last_deep_scrub":"61'475","last_deep_scrub_stamp":"2024-09-12T22:51:25.495255+0000","last_clean_scrub_stamp":"2024-09-12T22:51:25.495255+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:50:22.396824+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":32397,"num_write":452,"num_write_kb":105406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"61'413","reported_seq":972,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:47.455302+0000","last_change":"2024-09-12T22:51:47.455330+0000","last_active":"2024-09-12T22:51:47.455302+0000","last_peered":"2024-09-12T22:51:47.455302+0000","last_clean":"2024-09-12T22:51:47.455302+0000","last_became_active":"2024-09-12T22:51:02.708084+0000","last_became_peered":"2024-09-12T22:51:02.708084+0000","last_unstale":"2024-09-12T22:51:47.455302+0000","last_undegraded":"2024-09-12T22:51:47.455302+0000","last_fullsized":"2024-09-12T22:51:47.455302+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'413","last_scrub_stamp":"2024-09-12T22:51:47.455189+0000","last_deep_scrub":"61'413","last_deep_scrub_stamp":"2024-09-12T22:51:47.455189+0000","last_clean_scrub_stamp":"2024-09-12T22:51:47.455189+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:46.028115+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4773,"num_write":395,"num_write_kb":21871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"61'453","reported_seq":1036,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:43.347316+0000","last_change":"2024-09-12T22:51:43.347342+0000","last_active":"2024-09-12T22:51:43.347316+0000","last_peered":"2024-09-12T22:51:43.347316+0000","last_clean":"2024-09-12T22:51:43.347316+0000","last_became_active":"2024-09-12T22:50:58.699585+0000","last_became_peered":"2024-09-12T22:50:58.699585+0000","last_unstale":"2024-09-12T22:51:43.347316+0000","last_undegraded":"2024-09-12T22:51:43.347316+0000","last_fullsized":"2024-09-12T22:51:43.347316+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'453","last_scrub_stamp":"2024-09-12T22:51:43.347226+0000","last_deep_scrub":"61'453","last_deep_scrub_stamp":"2024-09-12T22:51:43.347226+0000","last_clean_scrub_stamp":"2024-09-12T22:51:43.347226+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:12.758755+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18201,"num_write":409,"num_write_kb":47008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"61'402","reported_seq":580,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:19.026955+0000","last_change":"2024-09-12T22:51:19.027019+0000","last_active":"2024-09-12T22:51:19.026955+0000","last_peered":"2024-09-12T22:51:19.026955+0000","last_clean":"2024-09-12T22:51:19.026955+0000","last_became_active":"2024-09-12T22:51:01.701850+0000","last_became_peered":"2024-09-12T22:51:01.701850+0000","last_unstale":"2024-09-12T22:51:19.026955+0000","last_undegraded":"2024-09-12T22:51:19.026955+0000","last_fullsized":"2024-09-12T22:51:19.026955+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'402","last_scrub_stamp":"2024-09-12T22:51:19.026854+0000","last_deep_scrub":"61'402","last_deep_scrub_stamp":"2024-09-12T22:51:19.026854+0000","last_clean_scrub_stamp":"2024-09-12T22:51:19.026854+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:57:34.383642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":21641,"num_write":372,"num_write_kb":63613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"61'436","reported_seq":1082,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:42.297181+0000","last_change":"2024-09-12T22:51:42.297209+0000","last_active":"2024-09-12T22:51:42.297181+0000","last_peered":"2024-09-12T22:51:42.297181+0000","last_clean":"2024-09-12T22:51:42.297181+0000","last_became_active":"2024-09-12T22:50:59.702766+0000","last_became_peered":"2024-09-12T22:50:59.702766+0000","last_unstale":"2024-09-12T22:51:42.297181+0000","last_undegraded":"2024-09-12T22:51:42.297181+0000","last_fullsized":"2024-09-12T22:51:42.297181+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'436","last_scrub_stamp":"2024-09-12T22:51:42.297084+0000","last_deep_scrub":"61'436","last_deep_scrub_stamp":"2024-09-12T22:51:42.297084+0000","last_clean_scrub_stamp":"2024-09-12T22:51:42.297084+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:17.671589+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":65550,"num_write":412,"num_write_kb":134233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"61'393","reported_seq":599,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:25.456868+0000","last_change":"2024-09-12T22:51:25.456899+0000","last_active":"2024-09-12T22:51:25.456868+0000","last_peered":"2024-09-12T22:51:25.456868+0000","last_clean":"2024-09-12T22:51:25.456868+0000","last_became_active":"2024-09-12T22:48:05.176735+0000","last_became_peered":"2024-09-12T22:48:05.176735+0000","last_unstale":"2024-09-12T22:51:25.456868+0000","last_undegraded":"2024-09-12T22:51:25.456868+0000","last_fullsized":"2024-09-12T22:51:25.456868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'393","last_scrub_stamp":"2024-09-12T22:51:25.456783+0000","last_deep_scrub":"61'393","last_deep_scrub_stamp":"2024-09-12T22:51:25.456783+0000","last_clean_scrub_stamp":"2024-09-12T22:51:25.456783+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:32.363803+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":36009,"num_write":361,"num_write_kb":71487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"61'456","reported_seq":1028,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:44.354815+0000","last_change":"2024-09-12T22:51:44.354842+0000","last_active":"2024-09-12T22:51:44.354815+0000","last_peered":"2024-09-12T22:51:44.354815+0000","last_clean":"2024-09-12T22:51:44.354815+0000","last_became_active":"2024-09-12T22:51:00.698377+0000","last_became_peered":"2024-09-12T22:51:00.698377+0000","last_unstale":"2024-09-12T22:51:44.354815+0000","last_undegraded":"2024-09-12T22:51:44.354815+0000","last_fullsized":"2024-09-12T22:51:44.354815+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'456","last_scrub_stamp":"2024-09-12T22:51:44.354720+0000","last_deep_scrub":"61'456","last_deep_scrub_stamp":"2024-09-12T22:51:44.354720+0000","last_clean_scrub_stamp":"2024-09-12T22:51:44.354720+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:51:27.152785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4316,"num_write":417,"num_write_kb":34284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"61'440","reported_seq":623,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:27.484762+0000","last_change":"2024-09-12T22:51:27.484788+0000","last_active":"2024-09-12T22:51:27.484762+0000","last_peered":"2024-09-12T22:51:27.484762+0000","last_clean":"2024-09-12T22:51:27.484762+0000","last_became_active":"2024-09-12T22:48:05.176327+0000","last_became_peered":"2024-09-12T22:48:05.176327+0000","last_unstale":"2024-09-12T22:51:27.484762+0000","last_undegraded":"2024-09-12T22:51:27.484762+0000","last_fullsized":"2024-09-12T22:51:27.484762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'440","last_scrub_stamp":"2024-09-12T22:51:27.484666+0000","last_deep_scrub":"61'440","last_deep_scrub_stamp":"2024-09-12T22:51:27.484666+0000","last_clean_scrub_stamp":"2024-09-12T22:51:27.484666+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:56.730585+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15052,"num_write":399,"num_write_kb":71703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"61'424","reported_seq":591,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:15.055895+0000","last_change":"2024-09-12T22:51:15.055996+0000","last_active":"2024-09-12T22:51:15.055895+0000","last_peered":"2024-09-12T22:51:15.055895+0000","last_clean":"2024-09-12T22:51:15.055895+0000","last_became_active":"2024-09-12T22:51:01.700878+0000","last_became_peered":"2024-09-12T22:51:01.700878+0000","last_unstale":"2024-09-12T22:51:15.055895+0000","last_undegraded":"2024-09-12T22:51:15.055895+0000","last_fullsized":"2024-09-12T22:51:15.055895+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'424","last_scrub_stamp":"2024-09-12T22:51:15.055797+0000","last_deep_scrub":"61'424","last_deep_scrub_stamp":"2024-09-12T22:51:15.055797+0000","last_clean_scrub_stamp":"2024-09-12T22:51:15.055797+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:34:40.186129+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25587,"num_write":397,"num_write_kb":46651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"61'384","reported_seq":554,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:39.298183+0000","last_change":"2024-09-12T22:51:39.298210+0000","last_active":"2024-09-12T22:51:39.298183+0000","last_peered":"2024-09-12T22:51:39.298183+0000","last_clean":"2024-09-12T22:51:39.298183+0000","last_became_active":"2024-09-12T22:48:05.171036+0000","last_became_peered":"2024-09-12T22:48:05.171036+0000","last_unstale":"2024-09-12T22:51:39.298183+0000","last_undegraded":"2024-09-12T22:51:39.298183+0000","last_fullsized":"2024-09-12T22:51:39.298183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'384","last_scrub_stamp":"2024-09-12T22:51:39.298077+0000","last_deep_scrub":"61'384","last_deep_scrub_stamp":"2024-09-12T22:51:39.298077+0000","last_clean_scrub_stamp":"2024-09-12T22:51:39.298077+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:54.252384+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9715,"num_write":345,"num_write_kb":63048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"81'454","reported_seq":598,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:28.020882+0000","last_change":"2024-09-12T22:51:28.020920+0000","last_active":"2024-09-12T22:51:28.020882+0000","last_peered":"2024-09-12T22:51:28.020882+0000","last_clean":"2024-09-12T22:51:28.020882+0000","last_became_active":"2024-09-12T22:50:55.851443+0000","last_became_peered":"2024-09-12T22:50:55.851443+0000","last_unstale":"2024-09-12T22:51:28.020882+0000","last_undegraded":"2024-09-12T22:51:28.020882+0000","last_fullsized":"2024-09-12T22:51:28.020882+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'454","last_scrub_stamp":"2024-09-12T22:51:28.020764+0000","last_deep_scrub":"81'454","last_deep_scrub_stamp":"2024-09-12T22:51:28.020764+0000","last_clean_scrub_stamp":"2024-09-12T22:51:28.020764+0000","objects_scrubbed":4,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:54.627592+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":387,"num_write_kb":8369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"61'389","reported_seq":577,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:19.562470+0000","last_change":"2024-09-12T22:51:19.562512+0000","last_active":"2024-09-12T22:51:19.562470+0000","last_peered":"2024-09-12T22:51:19.562470+0000","last_clean":"2024-09-12T22:51:19.562470+0000","last_became_active":"2024-09-12T22:48:05.172801+0000","last_became_peered":"2024-09-12T22:48:05.172801+0000","last_unstale":"2024-09-12T22:51:19.562470+0000","last_undegraded":"2024-09-12T22:51:19.562470+0000","last_fullsized":"2024-09-12T22:51:19.562470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'389","last_scrub_stamp":"2024-09-12T22:51:19.562343+0000","last_deep_scrub":"61'389","last_deep_scrub_stamp":"2024-09-12T22:51:19.562343+0000","last_clean_scrub_stamp":"2024-09-12T22:51:19.562343+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:28.225518+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":21115,"num_write":354,"num_write_kb":59128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"61'60","reported_seq":215,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:18.526880+0000","last_change":"2024-09-12T22:51:18.526913+0000","last_active":"2024-09-12T22:51:18.526880+0000","last_peered":"2024-09-12T22:51:18.526880+0000","last_clean":"2024-09-12T22:51:18.526880+0000","last_became_active":"2024-09-12T22:50:52.859975+0000","last_became_peered":"2024-09-12T22:50:52.859975+0000","last_unstale":"2024-09-12T22:51:18.526880+0000","last_undegraded":"2024-09-12T22:51:18.526880+0000","last_fullsized":"2024-09-12T22:51:18.526880+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'60","last_scrub_stamp":"2024-09-12T22:51:18.526792+0000","last_deep_scrub":"61'60","last_deep_scrub_stamp":"2024-09-12T22:51:18.526792+0000","last_clean_scrub_stamp":"2024-09-12T22:51:18.526792+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:27:51.518928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"61'433","reported_seq":1006,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:42.349279+0000","last_change":"2024-09-12T22:51:42.349305+0000","last_active":"2024-09-12T22:51:42.349279+0000","last_peered":"2024-09-12T22:51:42.349279+0000","last_clean":"2024-09-12T22:51:42.349279+0000","last_became_active":"2024-09-12T22:50:57.861719+0000","last_became_peered":"2024-09-12T22:50:57.861719+0000","last_unstale":"2024-09-12T22:51:42.349279+0000","last_undegraded":"2024-09-12T22:51:42.349279+0000","last_fullsized":"2024-09-12T22:51:42.349279+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'433","last_scrub_stamp":"2024-09-12T22:51:42.349189+0000","last_deep_scrub":"61'433","last_deep_scrub_stamp":"2024-09-12T22:51:42.349189+0000","last_clean_scrub_stamp":"2024-09-12T22:51:42.349189+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:35.244519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17599,"num_write":404,"num_write_kb":59440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"61'63","reported_seq":218,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:16.528385+0000","last_change":"2024-09-12T22:51:16.528410+0000","last_active":"2024-09-12T22:51:16.528385+0000","last_peered":"2024-09-12T22:51:16.528385+0000","last_clean":"2024-09-12T22:51:16.528385+0000","last_became_active":"2024-09-12T22:50:52.857343+0000","last_became_peered":"2024-09-12T22:50:52.857343+0000","last_unstale":"2024-09-12T22:51:16.528385+0000","last_undegraded":"2024-09-12T22:51:16.528385+0000","last_fullsized":"2024-09-12T22:51:16.528385+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'63","last_scrub_stamp":"2024-09-12T22:51:16.528299+0000","last_deep_scrub":"61'63","last_deep_scrub_stamp":"2024-09-12T22:51:16.528299+0000","last_clean_scrub_stamp":"2024-09-12T22:51:16.528299+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:31.533066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"61'407","reported_seq":941,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:38.291276+0000","last_change":"2024-09-12T22:51:38.291320+0000","last_active":"2024-09-12T22:51:38.291276+0000","last_peered":"2024-09-12T22:51:38.291276+0000","last_clean":"2024-09-12T22:51:38.291276+0000","last_became_active":"2024-09-12T22:50:55.851934+0000","last_became_peered":"2024-09-12T22:50:55.851934+0000","last_unstale":"2024-09-12T22:51:38.291276+0000","last_undegraded":"2024-09-12T22:51:38.291276+0000","last_fullsized":"2024-09-12T22:51:38.291276+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'407","last_scrub_stamp":"2024-09-12T22:51:38.291132+0000","last_deep_scrub":"61'407","last_deep_scrub_stamp":"2024-09-12T22:51:38.291132+0000","last_clean_scrub_stamp":"2024-09-12T22:51:38.291132+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:48.729595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":24842,"num_write":378,"num_write_kb":79144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"81'66","reported_seq":64,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:43.075128+0000","last_change":"2024-09-12T22:51:43.075163+0000","last_active":"2024-09-12T22:51:43.075128+0000","last_peered":"2024-09-12T22:51:43.075128+0000","last_clean":"2024-09-12T22:51:43.075128+0000","last_became_active":"2024-09-12T22:50:52.858911+0000","last_became_peered":"2024-09-12T22:50:52.858911+0000","last_unstale":"2024-09-12T22:51:43.075128+0000","last_undegraded":"2024-09-12T22:51:43.075128+0000","last_fullsized":"2024-09-12T22:51:43.075128+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'66","last_scrub_stamp":"2024-09-12T22:51:43.075026+0000","last_deep_scrub":"81'66","last_deep_scrub_stamp":"2024-09-12T22:51:43.075026+0000","last_clean_scrub_stamp":"2024-09-12T22:51:43.075026+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:19.052791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"81'154","reported_seq":299,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:25.970377+0000","last_change":"2024-09-12T22:51:25.970406+0000","last_active":"2024-09-12T22:51:25.970377+0000","last_peered":"2024-09-12T22:51:25.970377+0000","last_clean":"2024-09-12T22:51:25.970377+0000","last_became_active":"2024-09-12T22:50:55.851050+0000","last_became_peered":"2024-09-12T22:50:55.851050+0000","last_unstale":"2024-09-12T22:51:25.970377+0000","last_undegraded":"2024-09-12T22:51:25.970377+0000","last_fullsized":"2024-09-12T22:51:25.970377+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'154","last_scrub_stamp":"2024-09-12T22:51:25.970294+0000","last_deep_scrub":"81'154","last_deep_scrub_stamp":"2024-09-12T22:51:25.970294+0000","last_clean_scrub_stamp":"2024-09-12T22:51:25.970294+0000","objects_scrubbed":2,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:17.818054+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"61'392","reported_seq":899,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:15.524978+0000","last_change":"2024-09-12T22:51:15.525004+0000","last_active":"2024-09-12T22:51:15.524978+0000","last_peered":"2024-09-12T22:51:15.524978+0000","last_clean":"2024-09-12T22:51:15.524978+0000","last_became_active":"2024-09-12T22:50:56.853383+0000","last_became_peered":"2024-09-12T22:50:56.853383+0000","last_unstale":"2024-09-12T22:51:15.524978+0000","last_undegraded":"2024-09-12T22:51:15.524978+0000","last_fullsized":"2024-09-12T22:51:15.524978+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'392","last_scrub_stamp":"2024-09-12T22:51:15.524885+0000","last_deep_scrub":"61'392","last_deep_scrub_stamp":"2024-09-12T22:51:15.524885+0000","last_clean_scrub_stamp":"2024-09-12T22:51:15.524885+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:09.273828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":9675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"81'239","reported_seq":401,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:28.408843+0000","last_change":"2024-09-12T22:51:28.408879+0000","last_active":"2024-09-12T22:51:28.408843+0000","last_peered":"2024-09-12T22:51:28.408843+0000","last_clean":"2024-09-12T22:51:28.408843+0000","last_became_active":"2024-09-12T22:50:55.852034+0000","last_became_peered":"2024-09-12T22:50:55.852034+0000","last_unstale":"2024-09-12T22:51:28.408843+0000","last_undegraded":"2024-09-12T22:51:28.408843+0000","last_fullsized":"2024-09-12T22:51:28.408843+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'239","last_scrub_stamp":"2024-09-12T22:51:28.408760+0000","last_deep_scrub":"81'239","last_deep_scrub_stamp":"2024-09-12T22:51:28.408760+0000","last_clean_scrub_stamp":"2024-09-12T22:51:28.408760+0000","objects_scrubbed":2,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:00:19.367010+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"61'464","reported_seq":646,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:38.303842+0000","last_change":"2024-09-12T22:51:38.303892+0000","last_active":"2024-09-12T22:51:38.303842+0000","last_peered":"2024-09-12T22:51:38.303842+0000","last_clean":"2024-09-12T22:51:38.303842+0000","last_became_active":"2024-09-12T22:48:05.170374+0000","last_became_peered":"2024-09-12T22:48:05.170374+0000","last_unstale":"2024-09-12T22:51:38.303842+0000","last_undegraded":"2024-09-12T22:51:38.303842+0000","last_fullsized":"2024-09-12T22:51:38.303842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'464","last_scrub_stamp":"2024-09-12T22:51:38.303713+0000","last_deep_scrub":"61'464","last_deep_scrub_stamp":"2024-09-12T22:51:38.303713+0000","last_clean_scrub_stamp":"2024-09-12T22:51:38.303713+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:50.301785+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15522,"num_write":440,"num_write_kb":60335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"81'472","reported_seq":617,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:20.986643+0000","last_change":"2024-09-12T22:51:20.986672+0000","last_active":"2024-09-12T22:51:20.986643+0000","last_peered":"2024-09-12T22:51:20.986643+0000","last_clean":"2024-09-12T22:51:20.986643+0000","last_became_active":"2024-09-12T22:50:55.852074+0000","last_became_peered":"2024-09-12T22:50:55.852074+0000","last_unstale":"2024-09-12T22:51:20.986643+0000","last_undegraded":"2024-09-12T22:51:20.986643+0000","last_fullsized":"2024-09-12T22:51:20.986643+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'472","last_scrub_stamp":"2024-09-12T22:51:20.986558+0000","last_deep_scrub":"81'472","last_deep_scrub_stamp":"2024-09-12T22:51:20.986558+0000","last_clean_scrub_stamp":"2024-09-12T22:51:20.986558+0000","objects_scrubbed":2,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:12:43.272175+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":4267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"61'449","reported_seq":645,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:19.997376+0000","last_change":"2024-09-12T22:51:19.997441+0000","last_active":"2024-09-12T22:51:19.997376+0000","last_peered":"2024-09-12T22:51:19.997376+0000","last_clean":"2024-09-12T22:51:19.997376+0000","last_became_active":"2024-09-12T22:51:00.699592+0000","last_became_peered":"2024-09-12T22:51:00.699592+0000","last_unstale":"2024-09-12T22:51:19.997376+0000","last_undegraded":"2024-09-12T22:51:19.997376+0000","last_fullsized":"2024-09-12T22:51:19.997376+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'449","last_scrub_stamp":"2024-09-12T22:51:19.997252+0000","last_deep_scrub":"61'449","last_deep_scrub_stamp":"2024-09-12T22:51:19.997252+0000","last_clean_scrub_stamp":"2024-09-12T22:51:19.997252+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:31:23.493566+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":36634,"num_write":415,"num_write_kb":84238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"61'52","reported_seq":56,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:38.060462+0000","last_change":"2024-09-12T22:51:38.060505+0000","last_active":"2024-09-12T22:51:38.060462+0000","last_peered":"2024-09-12T22:51:38.060462+0000","last_clean":"2024-09-12T22:51:38.060462+0000","last_became_active":"2024-09-12T22:50:52.857342+0000","last_became_peered":"2024-09-12T22:50:52.857342+0000","last_unstale":"2024-09-12T22:51:38.060462+0000","last_undegraded":"2024-09-12T22:51:38.060462+0000","last_fullsized":"2024-09-12T22:51:38.060462+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'52","last_scrub_stamp":"2024-09-12T22:51:38.060319+0000","last_deep_scrub":"61'52","last_deep_scrub_stamp":"2024-09-12T22:51:38.060319+0000","last_clean_scrub_stamp":"2024-09-12T22:51:38.060319+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:15.868780+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"61'434","reported_seq":1036,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:44.345321+0000","last_change":"2024-09-12T22:51:44.345372+0000","last_active":"2024-09-12T22:51:44.345321+0000","last_peered":"2024-09-12T22:51:44.345321+0000","last_clean":"2024-09-12T22:51:44.345321+0000","last_became_active":"2024-09-12T22:50:58.700178+0000","last_became_peered":"2024-09-12T22:50:58.700178+0000","last_unstale":"2024-09-12T22:51:44.345321+0000","last_undegraded":"2024-09-12T22:51:44.345321+0000","last_fullsized":"2024-09-12T22:51:44.345321+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'434","last_scrub_stamp":"2024-09-12T22:51:44.345218+0000","last_deep_scrub":"61'434","last_deep_scrub_stamp":"2024-09-12T22:51:44.345218+0000","last_clean_scrub_stamp":"2024-09-12T22:51:44.345218+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:19.719723+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":39364,"num_write":402,"num_write_kb":59313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"81'197","reported_seq":361,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:24.488083+0000","last_change":"2024-09-12T22:51:24.488150+0000","last_active":"2024-09-12T22:51:24.488083+0000","last_peered":"2024-09-12T22:51:24.488083+0000","last_clean":"2024-09-12T22:51:24.488083+0000","last_became_active":"2024-09-12T22:50:55.852479+0000","last_became_peered":"2024-09-12T22:50:55.852479+0000","last_unstale":"2024-09-12T22:51:24.488083+0000","last_undegraded":"2024-09-12T22:51:24.488083+0000","last_fullsized":"2024-09-12T22:51:24.488083+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'197","last_scrub_stamp":"2024-09-12T22:51:24.487981+0000","last_deep_scrub":"81'197","last_deep_scrub_stamp":"2024-09-12T22:51:24.487981+0000","last_clean_scrub_stamp":"2024-09-12T22:51:24.487981+0000","objects_scrubbed":3,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:55.372926+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"61'457","reported_seq":600,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:52.032432+0000","last_change":"2024-09-12T22:51:52.032461+0000","last_active":"2024-09-12T22:51:52.032432+0000","last_peered":"2024-09-12T22:51:52.032432+0000","last_clean":"2024-09-12T22:51:52.032432+0000","last_became_active":"2024-09-12T22:51:03.704514+0000","last_became_peered":"2024-09-12T22:51:03.704514+0000","last_unstale":"2024-09-12T22:51:52.032432+0000","last_undegraded":"2024-09-12T22:51:52.032432+0000","last_fullsized":"2024-09-12T22:51:52.032432+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'457","last_scrub_stamp":"2024-09-12T22:51:52.032346+0000","last_deep_scrub":"61'457","last_deep_scrub_stamp":"2024-09-12T22:51:52.032346+0000","last_clean_scrub_stamp":"2024-09-12T22:51:52.032346+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:58.952446+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10832,"num_write":419,"num_write_kb":34901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"81'107","reported_seq":242,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:32.017709+0000","last_change":"2024-09-12T22:51:32.017740+0000","last_active":"2024-09-12T22:51:32.017709+0000","last_peered":"2024-09-12T22:51:32.017709+0000","last_clean":"2024-09-12T22:51:32.017709+0000","last_became_active":"2024-09-12T22:50:55.850764+0000","last_became_peered":"2024-09-12T22:50:55.850764+0000","last_unstale":"2024-09-12T22:51:32.017709+0000","last_undegraded":"2024-09-12T22:51:32.017709+0000","last_fullsized":"2024-09-12T22:51:32.017709+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'107","last_scrub_stamp":"2024-09-12T22:51:32.017620+0000","last_deep_scrub":"81'107","last_deep_scrub_stamp":"2024-09-12T22:51:32.017620+0000","last_clean_scrub_stamp":"2024-09-12T22:51:32.017620+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:36.313389+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"61'431","reported_seq":580,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:46.136997+0000","last_change":"2024-09-12T22:51:46.137023+0000","last_active":"2024-09-12T22:51:46.136997+0000","last_peered":"2024-09-12T22:51:46.136997+0000","last_clean":"2024-09-12T22:51:46.136997+0000","last_became_active":"2024-09-12T22:51:02.707646+0000","last_became_peered":"2024-09-12T22:51:02.707646+0000","last_unstale":"2024-09-12T22:51:46.136997+0000","last_undegraded":"2024-09-12T22:51:46.136997+0000","last_fullsized":"2024-09-12T22:51:46.136997+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'431","last_scrub_stamp":"2024-09-12T22:51:46.136898+0000","last_deep_scrub":"61'431","last_deep_scrub_stamp":"2024-09-12T22:51:46.136898+0000","last_clean_scrub_stamp":"2024-09-12T22:51:46.136898+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:35:44.102904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":10443,"num_write":392,"num_write_kb":63957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"61'49","reported_seq":204,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:18.585186+0000","last_change":"2024-09-12T22:51:18.585211+0000","last_active":"2024-09-12T22:51:18.585186+0000","last_peered":"2024-09-12T22:51:18.585186+0000","last_clean":"2024-09-12T22:51:18.585186+0000","last_became_active":"2024-09-12T22:50:52.857301+0000","last_became_peered":"2024-09-12T22:50:52.857301+0000","last_unstale":"2024-09-12T22:51:18.585186+0000","last_undegraded":"2024-09-12T22:51:18.585186+0000","last_fullsized":"2024-09-12T22:51:18.585186+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'49","last_scrub_stamp":"2024-09-12T22:51:18.585100+0000","last_deep_scrub":"61'49","last_deep_scrub_stamp":"2024-09-12T22:51:18.585100+0000","last_clean_scrub_stamp":"2024-09-12T22:51:18.585100+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:00:47.842878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"61'351","reported_seq":484,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:22.958605+0000","last_change":"2024-09-12T22:51:22.958631+0000","last_active":"2024-09-12T22:51:22.958605+0000","last_peered":"2024-09-12T22:51:22.958605+0000","last_clean":"2024-09-12T22:51:22.958605+0000","last_became_active":"2024-09-12T22:50:56.853610+0000","last_became_peered":"2024-09-12T22:50:56.853610+0000","last_unstale":"2024-09-12T22:51:22.958605+0000","last_undegraded":"2024-09-12T22:51:22.958605+0000","last_fullsized":"2024-09-12T22:51:22.958605+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'351","last_scrub_stamp":"2024-09-12T22:51:22.958519+0000","last_deep_scrub":"61'351","last_deep_scrub_stamp":"2024-09-12T22:51:22.958519+0000","last_clean_scrub_stamp":"2024-09-12T22:51:22.958519+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:53.587489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":137,"num_write":315,"num_write_kb":37943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"81'589","reported_seq":737,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:34.367399+0000","last_change":"2024-09-12T22:51:34.367443+0000","last_active":"2024-09-12T22:51:34.367399+0000","last_peered":"2024-09-12T22:51:34.367399+0000","last_clean":"2024-09-12T22:51:34.367399+0000","last_became_active":"2024-09-12T22:48:04.173942+0000","last_became_peered":"2024-09-12T22:48:04.173942+0000","last_unstale":"2024-09-12T22:51:34.367399+0000","last_undegraded":"2024-09-12T22:51:34.367399+0000","last_fullsized":"2024-09-12T22:51:34.367399+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'589","last_scrub_stamp":"2024-09-12T22:51:34.367281+0000","last_deep_scrub":"81'589","last_deep_scrub_stamp":"2024-09-12T22:51:34.367281+0000","last_clean_scrub_stamp":"2024-09-12T22:51:34.367281+0000","objects_scrubbed":1,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:02.186418+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":4334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"61'400","reported_seq":569,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:19.557789+0000","last_change":"2024-09-12T22:51:19.557815+0000","last_active":"2024-09-12T22:51:19.557789+0000","last_peered":"2024-09-12T22:51:19.557789+0000","last_clean":"2024-09-12T22:51:19.557789+0000","last_became_active":"2024-09-12T22:48:05.176813+0000","last_became_peered":"2024-09-12T22:48:05.176813+0000","last_unstale":"2024-09-12T22:51:19.557789+0000","last_undegraded":"2024-09-12T22:51:19.557789+0000","last_fullsized":"2024-09-12T22:51:19.557789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'400","last_scrub_stamp":"2024-09-12T22:51:19.557704+0000","last_deep_scrub":"61'400","last_deep_scrub_stamp":"2024-09-12T22:51:19.557704+0000","last_clean_scrub_stamp":"2024-09-12T22:51:19.557704+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:45.672718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":9179,"num_write":363,"num_write_kb":67046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"81'159","reported_seq":253,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:44.124284+0000","last_change":"2024-09-12T22:51:44.124329+0000","last_active":"2024-09-12T22:51:44.124284+0000","last_peered":"2024-09-12T22:51:44.124284+0000","last_clean":"2024-09-12T22:51:44.124284+0000","last_became_active":"2024-09-12T22:50:52.859754+0000","last_became_peered":"2024-09-12T22:50:52.859754+0000","last_unstale":"2024-09-12T22:51:44.124284+0000","last_undegraded":"2024-09-12T22:51:44.124284+0000","last_fullsized":"2024-09-12T22:51:44.124284+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'159","last_scrub_stamp":"2024-09-12T22:51:44.124194+0000","last_deep_scrub":"81'159","last_deep_scrub_stamp":"2024-09-12T22:51:44.124194+0000","last_clean_scrub_stamp":"2024-09-12T22:51:44.124194+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:36:56.359831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"81'2","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:40.001056+0000","last_change":"2024-09-12T22:51:40.001095+0000","last_active":"2024-09-12T22:51:40.001056+0000","last_peered":"2024-09-12T22:51:40.001056+0000","last_clean":"2024-09-12T22:51:40.001056+0000","last_became_active":"2024-09-12T22:50:52.857759+0000","last_became_peered":"2024-09-12T22:50:52.857759+0000","last_unstale":"2024-09-12T22:51:40.001056+0000","last_undegraded":"2024-09-12T22:51:40.001056+0000","last_fullsized":"2024-09-12T22:51:40.001056+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-12T22:51:40.000969+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-12T22:51:40.000969+0000","last_clean_scrub_stamp":"2024-09-12T22:51:40.000969+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:33.398780+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"81'508","reported_seq":657,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:36.348150+0000","last_change":"2024-09-12T22:51:36.348150+0000","last_active":"2024-09-12T22:51:36.348150+0000","last_peered":"2024-09-12T22:51:36.348150+0000","last_clean":"2024-09-12T22:51:36.348150+0000","last_became_active":"2024-09-12T22:48:04.169474+0000","last_became_peered":"2024-09-12T22:48:04.169474+0000","last_unstale":"2024-09-12T22:51:36.348150+0000","last_undegraded":"2024-09-12T22:51:36.348150+0000","last_fullsized":"2024-09-12T22:51:36.348150+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'508","last_scrub_stamp":"2024-09-12T22:51:36.348038+0000","last_deep_scrub":"81'508","last_deep_scrub_stamp":"2024-09-12T22:51:36.348038+0000","last_clean_scrub_stamp":"2024-09-12T22:51:36.348038+0000","objects_scrubbed":2,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:04.167175+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":444,"num_write_kb":8407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"61'422","reported_seq":604,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:45.122992+0000","last_change":"2024-09-12T22:51:45.123034+0000","last_active":"2024-09-12T22:51:45.122992+0000","last_peered":"2024-09-12T22:51:45.122992+0000","last_clean":"2024-09-12T22:51:45.122992+0000","last_became_active":"2024-09-12T22:51:00.698391+0000","last_became_peered":"2024-09-12T22:51:00.698391+0000","last_unstale":"2024-09-12T22:51:45.122992+0000","last_undegraded":"2024-09-12T22:51:45.122992+0000","last_fullsized":"2024-09-12T22:51:45.122992+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'422","last_scrub_stamp":"2024-09-12T22:51:45.122896+0000","last_deep_scrub":"61'422","last_deep_scrub_stamp":"2024-09-12T22:51:45.122896+0000","last_clean_scrub_stamp":"2024-09-12T22:51:45.122896+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:57.741188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":38484,"num_write":383,"num_write_kb":67099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":77,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:42.093294+0000","last_change":"2024-09-12T22:51:42.093321+0000","last_active":"2024-09-12T22:51:42.093294+0000","last_peered":"2024-09-12T22:51:42.093294+0000","last_clean":"2024-09-12T22:51:42.093294+0000","last_became_active":"2024-09-12T22:50:52.858480+0000","last_became_peered":"2024-09-12T22:50:52.858480+0000","last_unstale":"2024-09-12T22:51:42.093294+0000","last_undegraded":"2024-09-12T22:51:42.093294+0000","last_fullsized":"2024-09-12T22:51:42.093294+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:51:42.093200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:51:42.093200+0000","last_clean_scrub_stamp":"2024-09-12T22:51:42.093200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:15.344944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"81'108","reported_seq":315,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:28.520002+0000","last_change":"2024-09-12T22:51:28.520002+0000","last_active":"2024-09-12T22:51:28.520002+0000","last_peered":"2024-09-12T22:51:28.520002+0000","last_clean":"2024-09-12T22:51:28.520002+0000","last_became_active":"2024-09-12T22:50:55.852965+0000","last_became_peered":"2024-09-12T22:50:55.852965+0000","last_unstale":"2024-09-12T22:51:28.520002+0000","last_undegraded":"2024-09-12T22:51:28.520002+0000","last_fullsized":"2024-09-12T22:51:28.520002+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'108","last_scrub_stamp":"2024-09-12T22:51:28.519884+0000","last_deep_scrub":"81'108","last_deep_scrub_stamp":"2024-09-12T22:51:28.519884+0000","last_clean_scrub_stamp":"2024-09-12T22:51:28.519884+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:52.946262+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1463793,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":1459,"num_write":45,"num_write_kb":1459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1463793,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"61'436","reported_seq":627,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:29.365822+0000","last_change":"2024-09-12T22:51:29.365848+0000","last_active":"2024-09-12T22:51:29.365822+0000","last_peered":"2024-09-12T22:51:29.365822+0000","last_clean":"2024-09-12T22:51:29.365822+0000","last_became_active":"2024-09-12T22:48:05.171293+0000","last_became_peered":"2024-09-12T22:48:05.171293+0000","last_unstale":"2024-09-12T22:51:29.365822+0000","last_undegraded":"2024-09-12T22:51:29.365822+0000","last_fullsized":"2024-09-12T22:51:29.365822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'436","last_scrub_stamp":"2024-09-12T22:51:29.365736+0000","last_deep_scrub":"61'436","last_deep_scrub_stamp":"2024-09-12T22:51:29.365736+0000","last_clean_scrub_stamp":"2024-09-12T22:51:29.365736+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:57:21.433261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":27936,"num_write":401,"num_write_kb":51013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":162,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:31.456836+0000","last_change":"2024-09-12T22:51:31.456836+0000","last_active":"2024-09-12T22:51:31.456836+0000","last_peered":"2024-09-12T22:51:31.456836+0000","last_clean":"2024-09-12T22:51:31.456836+0000","last_became_active":"2024-09-12T22:48:00.042007+0000","last_became_peered":"2024-09-12T22:48:00.042007+0000","last_unstale":"2024-09-12T22:51:31.456836+0000","last_undegraded":"2024-09-12T22:51:31.456836+0000","last_fullsized":"2024-09-12T22:51:31.456836+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:51:31.456714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:51:31.456714+0000","last_clean_scrub_stamp":"2024-09-12T22:51:31.456714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:57:23.524239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036893100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"81'359","reported_seq":523,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:26.476020+0000","last_change":"2024-09-12T22:51:26.476020+0000","last_active":"2024-09-12T22:51:26.476020+0000","last_peered":"2024-09-12T22:51:26.476020+0000","last_clean":"2024-09-12T22:51:26.476020+0000","last_became_active":"2024-09-12T22:50:55.852029+0000","last_became_peered":"2024-09-12T22:50:55.852029+0000","last_unstale":"2024-09-12T22:51:26.476020+0000","last_undegraded":"2024-09-12T22:51:26.476020+0000","last_fullsized":"2024-09-12T22:51:26.476020+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'359","last_scrub_stamp":"2024-09-12T22:51:26.475898+0000","last_deep_scrub":"81'359","last_deep_scrub_stamp":"2024-09-12T22:51:26.475898+0000","last_clean_scrub_stamp":"2024-09-12T22:51:26.475898+0000","objects_scrubbed":2,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:12:58.416844+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":8307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"61'343","reported_seq":512,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:14.446520+0000","last_change":"2024-09-12T22:51:14.446546+0000","last_active":"2024-09-12T22:51:14.446520+0000","last_peered":"2024-09-12T22:51:14.446520+0000","last_clean":"2024-09-12T22:51:14.446520+0000","last_became_active":"2024-09-12T22:48:05.178010+0000","last_became_peered":"2024-09-12T22:48:05.178010+0000","last_unstale":"2024-09-12T22:51:14.446520+0000","last_undegraded":"2024-09-12T22:51:14.446520+0000","last_fullsized":"2024-09-12T22:51:14.446520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'343","last_scrub_stamp":"2024-09-12T22:51:14.446422+0000","last_deep_scrub":"61'343","last_deep_scrub_stamp":"2024-09-12T22:51:14.446422+0000","last_clean_scrub_stamp":"2024-09-12T22:51:14.446422+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:41.971251+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":6704,"num_write":316,"num_write_kb":42458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"81'3","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:39.026255+0000","last_change":"2024-09-12T22:51:39.026285+0000","last_active":"2024-09-12T22:51:39.026255+0000","last_peered":"2024-09-12T22:51:39.026255+0000","last_clean":"2024-09-12T22:51:39.026255+0000","last_became_active":"2024-09-12T22:50:52.857746+0000","last_became_peered":"2024-09-12T22:50:52.857746+0000","last_unstale":"2024-09-12T22:51:39.026255+0000","last_undegraded":"2024-09-12T22:51:39.026255+0000","last_fullsized":"2024-09-12T22:51:39.026255+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-09-12T22:51:39.026168+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-09-12T22:51:39.026168+0000","last_clean_scrub_stamp":"2024-09-12T22:51:39.026168+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:57.836410+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00052714799999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"61'78","reported_seq":56,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:41.044385+0000","last_change":"2024-09-12T22:51:41.044411+0000","last_active":"2024-09-12T22:51:41.044385+0000","last_peered":"2024-09-12T22:51:41.044385+0000","last_clean":"2024-09-12T22:51:41.044385+0000","last_became_active":"2024-09-12T22:50:52.858372+0000","last_became_peered":"2024-09-12T22:50:52.858372+0000","last_unstale":"2024-09-12T22:51:41.044385+0000","last_undegraded":"2024-09-12T22:51:41.044385+0000","last_fullsized":"2024-09-12T22:51:41.044385+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'78","last_scrub_stamp":"2024-09-12T22:51:41.044264+0000","last_deep_scrub":"61'78","last_deep_scrub_stamp":"2024-09-12T22:51:41.044264+0000","last_clean_scrub_stamp":"2024-09-12T22:51:41.044264+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:49:36.969761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"61'404","reported_seq":623,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:21.513951+0000","last_change":"2024-09-12T22:51:21.513986+0000","last_active":"2024-09-12T22:51:21.513951+0000","last_peered":"2024-09-12T22:51:21.513951+0000","last_clean":"2024-09-12T22:51:21.513951+0000","last_became_active":"2024-09-12T22:48:05.177164+0000","last_became_peered":"2024-09-12T22:48:05.177164+0000","last_unstale":"2024-09-12T22:51:21.513951+0000","last_undegraded":"2024-09-12T22:51:21.513951+0000","last_fullsized":"2024-09-12T22:51:21.513951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'404","last_scrub_stamp":"2024-09-12T22:51:21.513822+0000","last_deep_scrub":"61'404","last_deep_scrub_stamp":"2024-09-12T22:51:21.513822+0000","last_clean_scrub_stamp":"2024-09-12T22:51:21.513822+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:49:34.958749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":35084,"num_write":365,"num_write_kb":71560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"81'270","reported_seq":405,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:34.028186+0000","last_change":"2024-09-12T22:51:34.028241+0000","last_active":"2024-09-12T22:51:34.028186+0000","last_peered":"2024-09-12T22:51:34.028186+0000","last_clean":"2024-09-12T22:51:34.028186+0000","last_became_active":"2024-09-12T22:50:55.850689+0000","last_became_peered":"2024-09-12T22:50:55.850689+0000","last_unstale":"2024-09-12T22:51:34.028186+0000","last_undegraded":"2024-09-12T22:51:34.028186+0000","last_fullsized":"2024-09-12T22:51:34.028186+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'270","last_scrub_stamp":"2024-09-12T22:51:34.028090+0000","last_deep_scrub":"81'270","last_deep_scrub_stamp":"2024-09-12T22:51:34.028090+0000","last_clean_scrub_stamp":"2024-09-12T22:51:34.028090+0000","objects_scrubbed":1,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:20.743115+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":4189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":162,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:32.418817+0000","last_change":"2024-09-12T22:51:32.418817+0000","last_active":"2024-09-12T22:51:32.418817+0000","last_peered":"2024-09-12T22:51:32.418817+0000","last_clean":"2024-09-12T22:51:32.418817+0000","last_became_active":"2024-09-12T22:48:00.042132+0000","last_became_peered":"2024-09-12T22:48:00.042132+0000","last_unstale":"2024-09-12T22:51:32.418817+0000","last_undegraded":"2024-09-12T22:51:32.418817+0000","last_fullsized":"2024-09-12T22:51:32.418817+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:51:32.418694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:51:32.418694+0000","last_clean_scrub_stamp":"2024-09-12T22:51:32.418694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:09:39.426948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047590600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"61'362","reported_seq":860,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:43.342905+0000","last_change":"2024-09-12T22:51:43.342932+0000","last_active":"2024-09-12T22:51:43.342905+0000","last_peered":"2024-09-12T22:51:43.342905+0000","last_clean":"2024-09-12T22:51:43.342905+0000","last_became_active":"2024-09-12T22:50:59.707126+0000","last_became_peered":"2024-09-12T22:50:59.707126+0000","last_unstale":"2024-09-12T22:51:43.342905+0000","last_undegraded":"2024-09-12T22:51:43.342905+0000","last_fullsized":"2024-09-12T22:51:43.342905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'362","last_scrub_stamp":"2024-09-12T22:51:43.342803+0000","last_deep_scrub":"61'362","last_deep_scrub_stamp":"2024-09-12T22:51:43.342803+0000","last_clean_scrub_stamp":"2024-09-12T22:51:43.342803+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:56.841704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":10445,"num_write":331,"num_write_kb":30096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"61'56","reported_seq":205,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:35.357428+0000","last_change":"2024-09-12T22:51:35.357428+0000","last_active":"2024-09-12T22:51:35.357428+0000","last_peered":"2024-09-12T22:51:35.357428+0000","last_clean":"2024-09-12T22:51:35.357428+0000","last_became_active":"2024-09-12T22:48:04.168655+0000","last_became_peered":"2024-09-12T22:48:04.168655+0000","last_unstale":"2024-09-12T22:51:35.357428+0000","last_undegraded":"2024-09-12T22:51:35.357428+0000","last_fullsized":"2024-09-12T22:51:35.357428+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'56","last_scrub_stamp":"2024-09-12T22:51:35.357308+0000","last_deep_scrub":"61'56","last_deep_scrub_stamp":"2024-09-12T22:51:35.357308+0000","last_clean_scrub_stamp":"2024-09-12T22:51:35.357308+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:36:54.762450+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":162,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:32.301417+0000","last_change":"2024-09-12T22:51:32.301417+0000","last_active":"2024-09-12T22:51:32.301417+0000","last_peered":"2024-09-12T22:51:32.301417+0000","last_clean":"2024-09-12T22:51:32.301417+0000","last_became_active":"2024-09-12T22:48:00.045356+0000","last_became_peered":"2024-09-12T22:48:00.045356+0000","last_unstale":"2024-09-12T22:51:32.301417+0000","last_undegraded":"2024-09-12T22:51:32.301417+0000","last_fullsized":"2024-09-12T22:51:32.301417+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:51:32.301293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:51:32.301293+0000","last_clean_scrub_stamp":"2024-09-12T22:51:32.301293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:44.445434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040621599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"61'408","reported_seq":991,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:13.548235+0000","last_change":"2024-09-12T22:51:13.548260+0000","last_active":"2024-09-12T22:51:13.548235+0000","last_peered":"2024-09-12T22:51:13.548235+0000","last_clean":"2024-09-12T22:51:13.548235+0000","last_became_active":"2024-09-12T22:50:57.863486+0000","last_became_peered":"2024-09-12T22:50:57.863486+0000","last_unstale":"2024-09-12T22:51:13.548235+0000","last_undegraded":"2024-09-12T22:51:13.548235+0000","last_fullsized":"2024-09-12T22:51:13.548235+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'408","last_scrub_stamp":"2024-09-12T22:51:13.548143+0000","last_deep_scrub":"61'408","last_deep_scrub_stamp":"2024-09-12T22:51:13.548143+0000","last_clean_scrub_stamp":"2024-09-12T22:51:13.548143+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:00.237151+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":42311,"num_write":379,"num_write_kb":75412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"81'62","reported_seq":210,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:33.382870+0000","last_change":"2024-09-12T22:51:33.382943+0000","last_active":"2024-09-12T22:51:33.382870+0000","last_peered":"2024-09-12T22:51:33.382870+0000","last_clean":"2024-09-12T22:51:33.382870+0000","last_became_active":"2024-09-12T22:48:04.168244+0000","last_became_peered":"2024-09-12T22:48:04.168244+0000","last_unstale":"2024-09-12T22:51:33.382870+0000","last_undegraded":"2024-09-12T22:51:33.382870+0000","last_fullsized":"2024-09-12T22:51:33.382870+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'62","last_scrub_stamp":"2024-09-12T22:51:33.382778+0000","last_deep_scrub":"81'62","last_deep_scrub_stamp":"2024-09-12T22:51:33.382778+0000","last_clean_scrub_stamp":"2024-09-12T22:51:33.382778+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:00.519567+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":161,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:30.505975+0000","last_change":"2024-09-12T22:51:30.506010+0000","last_active":"2024-09-12T22:51:30.505975+0000","last_peered":"2024-09-12T22:51:30.505975+0000","last_clean":"2024-09-12T22:51:30.505975+0000","last_became_active":"2024-09-12T22:48:00.040536+0000","last_became_peered":"2024-09-12T22:48:00.040536+0000","last_unstale":"2024-09-12T22:51:30.505975+0000","last_undegraded":"2024-09-12T22:51:30.505975+0000","last_fullsized":"2024-09-12T22:51:30.505975+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:51:30.505859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:51:30.505859+0000","last_clean_scrub_stamp":"2024-09-12T22:51:30.505859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:00:21.464109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057699499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"61'430","reported_seq":1000,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:45.332008+0000","last_change":"2024-09-12T22:51:45.332008+0000","last_active":"2024-09-12T22:51:45.332008+0000","last_peered":"2024-09-12T22:51:45.332008+0000","last_clean":"2024-09-12T22:51:45.332008+0000","last_became_active":"2024-09-12T22:51:01.700292+0000","last_became_peered":"2024-09-12T22:51:01.700292+0000","last_unstale":"2024-09-12T22:51:45.332008+0000","last_undegraded":"2024-09-12T22:51:45.332008+0000","last_fullsized":"2024-09-12T22:51:45.332008+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'430","last_scrub_stamp":"2024-09-12T22:51:45.331871+0000","last_deep_scrub":"61'430","last_deep_scrub_stamp":"2024-09-12T22:51:45.331871+0000","last_clean_scrub_stamp":"2024-09-12T22:51:45.331871+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:58.830772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":26700,"num_write":399,"num_write_kb":55331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"81'115","reported_seq":277,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:22.473955+0000","last_change":"2024-09-12T22:51:22.473983+0000","last_active":"2024-09-12T22:51:22.473955+0000","last_peered":"2024-09-12T22:51:22.473955+0000","last_clean":"2024-09-12T22:51:22.473955+0000","last_became_active":"2024-09-12T22:50:55.851975+0000","last_became_peered":"2024-09-12T22:50:55.851975+0000","last_unstale":"2024-09-12T22:51:22.473955+0000","last_undegraded":"2024-09-12T22:51:22.473955+0000","last_fullsized":"2024-09-12T22:51:22.473955+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'115","last_scrub_stamp":"2024-09-12T22:51:22.473860+0000","last_deep_scrub":"81'115","last_deep_scrub_stamp":"2024-09-12T22:51:22.473860+0000","last_clean_scrub_stamp":"2024-09-12T22:51:22.473860+0000","objects_scrubbed":1,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:36:14.493054+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":1201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":77,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:37.054688+0000","last_change":"2024-09-12T22:51:37.054748+0000","last_active":"2024-09-12T22:51:37.054688+0000","last_peered":"2024-09-12T22:51:37.054688+0000","last_clean":"2024-09-12T22:51:37.054688+0000","last_became_active":"2024-09-12T22:50:52.856757+0000","last_became_peered":"2024-09-12T22:50:52.856757+0000","last_unstale":"2024-09-12T22:51:37.054688+0000","last_undegraded":"2024-09-12T22:51:37.054688+0000","last_fullsized":"2024-09-12T22:51:37.054688+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:51:37.054550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:51:37.054550+0000","last_clean_scrub_stamp":"2024-09-12T22:51:37.054550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:23.766084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"61'406","reported_seq":938,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:40.318800+0000","last_change":"2024-09-12T22:51:40.318851+0000","last_active":"2024-09-12T22:51:40.318800+0000","last_peered":"2024-09-12T22:51:40.318800+0000","last_clean":"2024-09-12T22:51:40.318800+0000","last_became_active":"2024-09-12T22:50:56.853376+0000","last_became_peered":"2024-09-12T22:50:56.853376+0000","last_unstale":"2024-09-12T22:51:40.318800+0000","last_undegraded":"2024-09-12T22:51:40.318800+0000","last_fullsized":"2024-09-12T22:51:40.318800+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'406","last_scrub_stamp":"2024-09-12T22:51:40.318700+0000","last_deep_scrub":"61'406","last_deep_scrub_stamp":"2024-09-12T22:51:40.318700+0000","last_clean_scrub_stamp":"2024-09-12T22:51:40.318700+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:33.214030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17112,"num_write":373,"num_write_kb":79947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"61'378","reported_seq":542,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:26.958523+0000","last_change":"2024-09-12T22:51:26.958549+0000","last_active":"2024-09-12T22:51:26.958523+0000","last_peered":"2024-09-12T22:51:26.958523+0000","last_clean":"2024-09-12T22:51:26.958523+0000","last_became_active":"2024-09-12T22:50:57.861280+0000","last_became_peered":"2024-09-12T22:50:57.861280+0000","last_unstale":"2024-09-12T22:51:26.958523+0000","last_undegraded":"2024-09-12T22:51:26.958523+0000","last_fullsized":"2024-09-12T22:51:26.958523+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'378","last_scrub_stamp":"2024-09-12T22:51:26.958404+0000","last_deep_scrub":"61'378","last_deep_scrub_stamp":"2024-09-12T22:51:26.958404+0000","last_clean_scrub_stamp":"2024-09-12T22:51:26.958404+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:48.297955+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15048,"num_write":339,"num_write_kb":35238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"81'255","reported_seq":406,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:36.025377+0000","last_change":"2024-09-12T22:51:36.025408+0000","last_active":"2024-09-12T22:51:36.025377+0000","last_peered":"2024-09-12T22:51:36.025377+0000","last_clean":"2024-09-12T22:51:36.025377+0000","last_became_active":"2024-09-12T22:50:55.849531+0000","last_became_peered":"2024-09-12T22:50:55.849531+0000","last_unstale":"2024-09-12T22:51:36.025377+0000","last_undegraded":"2024-09-12T22:51:36.025377+0000","last_fullsized":"2024-09-12T22:51:36.025377+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'255","last_scrub_stamp":"2024-09-12T22:51:36.025297+0000","last_deep_scrub":"81'255","last_deep_scrub_stamp":"2024-09-12T22:51:36.025297+0000","last_clean_scrub_stamp":"2024-09-12T22:51:36.025297+0000","objects_scrubbed":6,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:07.658793+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8461053,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":8364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8456257,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"61'405","reported_seq":578,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:29.541408+0000","last_change":"2024-09-12T22:51:29.541434+0000","last_active":"2024-09-12T22:51:29.541408+0000","last_peered":"2024-09-12T22:51:29.541408+0000","last_clean":"2024-09-12T22:51:29.541408+0000","last_became_active":"2024-09-12T22:48:05.176344+0000","last_became_peered":"2024-09-12T22:48:05.176344+0000","last_unstale":"2024-09-12T22:51:29.541408+0000","last_undegraded":"2024-09-12T22:51:29.541408+0000","last_fullsized":"2024-09-12T22:51:29.541408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'405","last_scrub_stamp":"2024-09-12T22:51:29.541317+0000","last_deep_scrub":"61'405","last_deep_scrub_stamp":"2024-09-12T22:51:29.541317+0000","last_clean_scrub_stamp":"2024-09-12T22:51:29.541317+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:07.482340+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":25018,"num_write":372,"num_write_kb":42936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"81'87","reported_seq":247,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:22.520095+0000","last_change":"2024-09-12T22:51:22.520147+0000","last_active":"2024-09-12T22:51:22.520095+0000","last_peered":"2024-09-12T22:51:22.520095+0000","last_clean":"2024-09-12T22:51:22.520095+0000","last_became_active":"2024-09-12T22:50:52.861594+0000","last_became_peered":"2024-09-12T22:50:52.861594+0000","last_unstale":"2024-09-12T22:51:22.520095+0000","last_undegraded":"2024-09-12T22:51:22.520095+0000","last_fullsized":"2024-09-12T22:51:22.520095+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'87","last_scrub_stamp":"2024-09-12T22:51:22.519986+0000","last_deep_scrub":"81'87","last_deep_scrub_stamp":"2024-09-12T22:51:22.519986+0000","last_clean_scrub_stamp":"2024-09-12T22:51:22.519986+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:40:55.944441+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"81'214","reported_seq":348,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:23.988689+0000","last_change":"2024-09-12T22:51:23.988721+0000","last_active":"2024-09-12T22:51:23.988689+0000","last_peered":"2024-09-12T22:51:23.988689+0000","last_clean":"2024-09-12T22:51:23.988689+0000","last_became_active":"2024-09-12T22:50:55.851798+0000","last_became_peered":"2024-09-12T22:50:55.851798+0000","last_unstale":"2024-09-12T22:51:23.988689+0000","last_undegraded":"2024-09-12T22:51:23.988689+0000","last_fullsized":"2024-09-12T22:51:23.988689+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'214","last_scrub_stamp":"2024-09-12T22:51:23.988604+0000","last_deep_scrub":"81'214","last_deep_scrub_stamp":"2024-09-12T22:51:23.988604+0000","last_clean_scrub_stamp":"2024-09-12T22:51:23.988604+0000","objects_scrubbed":1,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:05.350121+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":4171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"61'478","reported_seq":1116,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:39.323655+0000","last_change":"2024-09-12T22:51:39.323679+0000","last_active":"2024-09-12T22:51:39.323655+0000","last_peered":"2024-09-12T22:51:39.323655+0000","last_clean":"2024-09-12T22:51:39.323655+0000","last_became_active":"2024-09-12T22:50:56.855150+0000","last_became_peered":"2024-09-12T22:50:56.855150+0000","last_unstale":"2024-09-12T22:51:39.323655+0000","last_undegraded":"2024-09-12T22:51:39.323655+0000","last_fullsized":"2024-09-12T22:51:39.323655+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'478","last_scrub_stamp":"2024-09-12T22:51:39.323549+0000","last_deep_scrub":"61'478","last_deep_scrub_stamp":"2024-09-12T22:51:39.323549+0000","last_clean_scrub_stamp":"2024-09-12T22:51:39.323549+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:39.363674+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":41320,"num_write":445,"num_write_kb":84826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":209,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"61'55","reported_seq":210,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:16.445712+0000","last_change":"2024-09-12T22:51:16.445736+0000","last_active":"2024-09-12T22:51:16.445712+0000","last_peered":"2024-09-12T22:51:16.445712+0000","last_clean":"2024-09-12T22:51:16.445712+0000","last_became_active":"2024-09-12T22:50:52.859296+0000","last_became_peered":"2024-09-12T22:50:52.859296+0000","last_unstale":"2024-09-12T22:51:16.445712+0000","last_undegraded":"2024-09-12T22:51:16.445712+0000","last_fullsized":"2024-09-12T22:51:16.445712+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'55","last_scrub_stamp":"2024-09-12T22:51:16.445610+0000","last_deep_scrub":"61'55","last_deep_scrub_stamp":"2024-09-12T22:51:16.445610+0000","last_clean_scrub_stamp":"2024-09-12T22:51:16.445610+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:10.194553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"61'447","reported_seq":643,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:37.321849+0000","last_change":"2024-09-12T22:51:37.321873+0000","last_active":"2024-09-12T22:51:37.321849+0000","last_peered":"2024-09-12T22:51:37.321849+0000","last_clean":"2024-09-12T22:51:37.321849+0000","last_became_active":"2024-09-12T22:48:05.168356+0000","last_became_peered":"2024-09-12T22:48:05.168356+0000","last_unstale":"2024-09-12T22:51:37.321849+0000","last_undegraded":"2024-09-12T22:51:37.321849+0000","last_fullsized":"2024-09-12T22:51:37.321849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'447","last_scrub_stamp":"2024-09-12T22:51:37.321761+0000","last_deep_scrub":"61'447","last_deep_scrub_stamp":"2024-09-12T22:51:37.321761+0000","last_clean_scrub_stamp":"2024-09-12T22:51:37.321761+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:45.986173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25877,"num_write":417,"num_write_kb":39269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"61'371","reported_seq":897,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:46.425041+0000","last_change":"2024-09-12T22:51:46.425071+0000","last_active":"2024-09-12T22:51:46.425041+0000","last_peered":"2024-09-12T22:51:46.425041+0000","last_clean":"2024-09-12T22:51:46.425041+0000","last_became_active":"2024-09-12T22:51:02.708091+0000","last_became_peered":"2024-09-12T22:51:02.708091+0000","last_unstale":"2024-09-12T22:51:46.425041+0000","last_undegraded":"2024-09-12T22:51:46.425041+0000","last_fullsized":"2024-09-12T22:51:46.425041+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'371","last_scrub_stamp":"2024-09-12T22:51:46.424936+0000","last_deep_scrub":"61'371","last_deep_scrub_stamp":"2024-09-12T22:51:46.424936+0000","last_clean_scrub_stamp":"2024-09-12T22:51:46.424936+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:25.289213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20950,"num_write":339,"num_write_kb":39207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"81'603","reported_seq":751,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:34.386436+0000","last_change":"2024-09-12T22:51:34.386463+0000","last_active":"2024-09-12T22:51:34.386436+0000","last_peered":"2024-09-12T22:51:34.386436+0000","last_clean":"2024-09-12T22:51:34.386436+0000","last_became_active":"2024-09-12T22:48:04.168743+0000","last_became_peered":"2024-09-12T22:48:04.168743+0000","last_unstale":"2024-09-12T22:51:34.386436+0000","last_undegraded":"2024-09-12T22:51:34.386436+0000","last_fullsized":"2024-09-12T22:51:34.386436+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'603","last_scrub_stamp":"2024-09-12T22:51:34.386337+0000","last_deep_scrub":"81'603","last_deep_scrub_stamp":"2024-09-12T22:51:34.386337+0000","last_clean_scrub_stamp":"2024-09-12T22:51:34.386337+0000","objects_scrubbed":2,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:46.530479+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":535,"num_write_kb":8445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"61'438","reported_seq":988,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:41.353743+0000","last_change":"2024-09-12T22:51:41.353743+0000","last_active":"2024-09-12T22:51:41.353743+0000","last_peered":"2024-09-12T22:51:41.353743+0000","last_clean":"2024-09-12T22:51:41.353743+0000","last_became_active":"2024-09-12T22:50:57.861695+0000","last_became_peered":"2024-09-12T22:50:57.861695+0000","last_unstale":"2024-09-12T22:51:41.353743+0000","last_undegraded":"2024-09-12T22:51:41.353743+0000","last_fullsized":"2024-09-12T22:51:41.353743+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'438","last_scrub_stamp":"2024-09-12T22:51:41.353630+0000","last_deep_scrub":"61'438","last_deep_scrub_stamp":"2024-09-12T22:51:41.353630+0000","last_clean_scrub_stamp":"2024-09-12T22:51:41.353630+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:56.307938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":16921,"num_write":411,"num_write_kb":146790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"81'186","reported_seq":347,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:26.462203+0000","last_change":"2024-09-12T22:51:26.462235+0000","last_active":"2024-09-12T22:51:26.462203+0000","last_peered":"2024-09-12T22:51:26.462203+0000","last_clean":"2024-09-12T22:51:26.462203+0000","last_became_active":"2024-09-12T22:50:55.852796+0000","last_became_peered":"2024-09-12T22:50:55.852796+0000","last_unstale":"2024-09-12T22:51:26.462203+0000","last_undegraded":"2024-09-12T22:51:26.462203+0000","last_fullsized":"2024-09-12T22:51:26.462203+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'186","last_scrub_stamp":"2024-09-12T22:51:26.462116+0000","last_deep_scrub":"81'186","last_deep_scrub_stamp":"2024-09-12T22:51:26.462116+0000","last_clean_scrub_stamp":"2024-09-12T22:51:26.462116+0000","objects_scrubbed":1,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:19:09.019048+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"61'386","reported_seq":895,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:45.398706+0000","last_change":"2024-09-12T22:51:45.398749+0000","last_active":"2024-09-12T22:51:45.398706+0000","last_peered":"2024-09-12T22:51:45.398706+0000","last_clean":"2024-09-12T22:51:45.398706+0000","last_became_active":"2024-09-12T22:51:01.701006+0000","last_became_peered":"2024-09-12T22:51:01.701006+0000","last_unstale":"2024-09-12T22:51:45.398706+0000","last_undegraded":"2024-09-12T22:51:45.398706+0000","last_fullsized":"2024-09-12T22:51:45.398706+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'386","last_scrub_stamp":"2024-09-12T22:51:45.398570+0000","last_deep_scrub":"61'386","last_deep_scrub_stamp":"2024-09-12T22:51:45.398570+0000","last_clean_scrub_stamp":"2024-09-12T22:51:45.398570+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:04.995247+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":21487,"num_write":344,"num_write_kb":72645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"81'183","reported_seq":331,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:33.369780+0000","last_change":"2024-09-12T22:51:33.369810+0000","last_active":"2024-09-12T22:51:33.369780+0000","last_peered":"2024-09-12T22:51:33.369780+0000","last_clean":"2024-09-12T22:51:33.369780+0000","last_became_active":"2024-09-12T22:48:04.173902+0000","last_became_peered":"2024-09-12T22:48:04.173902+0000","last_unstale":"2024-09-12T22:51:33.369780+0000","last_undegraded":"2024-09-12T22:51:33.369780+0000","last_fullsized":"2024-09-12T22:51:33.369780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'183","last_scrub_stamp":"2024-09-12T22:51:33.369697+0000","last_deep_scrub":"81'183","last_deep_scrub_stamp":"2024-09-12T22:51:33.369697+0000","last_clean_scrub_stamp":"2024-09-12T22:51:33.369697+0000","objects_scrubbed":3,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:36:52.774839+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":12355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"61'396","reported_seq":561,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:23.537596+0000","last_change":"2024-09-12T22:51:23.537623+0000","last_active":"2024-09-12T22:51:23.537596+0000","last_peered":"2024-09-12T22:51:23.537596+0000","last_clean":"2024-09-12T22:51:23.537596+0000","last_became_active":"2024-09-12T22:48:05.172493+0000","last_became_peered":"2024-09-12T22:48:05.172493+0000","last_unstale":"2024-09-12T22:51:23.537596+0000","last_undegraded":"2024-09-12T22:51:23.537596+0000","last_fullsized":"2024-09-12T22:51:23.537596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'396","last_scrub_stamp":"2024-09-12T22:51:23.537469+0000","last_deep_scrub":"61'396","last_deep_scrub_stamp":"2024-09-12T22:51:23.537469+0000","last_clean_scrub_stamp":"2024-09-12T22:51:23.537469+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:44.314218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9980,"num_write":370,"num_write_kb":80321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"81'65","reported_seq":225,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:20.556732+0000","last_change":"2024-09-12T22:51:20.556757+0000","last_active":"2024-09-12T22:51:20.556732+0000","last_peered":"2024-09-12T22:51:20.556732+0000","last_clean":"2024-09-12T22:51:20.556732+0000","last_became_active":"2024-09-12T22:50:52.858938+0000","last_became_peered":"2024-09-12T22:50:52.858938+0000","last_unstale":"2024-09-12T22:51:20.556732+0000","last_undegraded":"2024-09-12T22:51:20.556732+0000","last_fullsized":"2024-09-12T22:51:20.556732+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'65","last_scrub_stamp":"2024-09-12T22:51:20.556625+0000","last_deep_scrub":"81'65","last_deep_scrub_stamp":"2024-09-12T22:51:20.556625+0000","last_clean_scrub_stamp":"2024-09-12T22:51:20.556625+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:00.739728+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"61'370","reported_seq":524,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:33.057215+0000","last_change":"2024-09-12T22:51:33.057273+0000","last_active":"2024-09-12T22:51:33.057215+0000","last_peered":"2024-09-12T22:51:33.057215+0000","last_clean":"2024-09-12T22:51:33.057215+0000","last_became_active":"2024-09-12T22:50:59.704074+0000","last_became_peered":"2024-09-12T22:50:59.704074+0000","last_unstale":"2024-09-12T22:51:33.057215+0000","last_undegraded":"2024-09-12T22:51:33.057215+0000","last_fullsized":"2024-09-12T22:51:33.057215+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'370","last_scrub_stamp":"2024-09-12T22:51:33.057092+0000","last_deep_scrub":"61'370","last_deep_scrub_stamp":"2024-09-12T22:51:33.057092+0000","last_clean_scrub_stamp":"2024-09-12T22:51:33.057092+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:43:01.870992+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16468,"num_write":341,"num_write_kb":50344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"81'189","reported_seq":332,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:29.993909+0000","last_change":"2024-09-12T22:51:29.993969+0000","last_active":"2024-09-12T22:51:29.993909+0000","last_peered":"2024-09-12T22:51:29.993909+0000","last_clean":"2024-09-12T22:51:29.993909+0000","last_became_active":"2024-09-12T22:50:55.851467+0000","last_became_peered":"2024-09-12T22:50:55.851467+0000","last_unstale":"2024-09-12T22:51:29.993909+0000","last_undegraded":"2024-09-12T22:51:29.993909+0000","last_fullsized":"2024-09-12T22:51:29.993909+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'189","last_scrub_stamp":"2024-09-12T22:51:29.993826+0000","last_deep_scrub":"81'189","last_deep_scrub_stamp":"2024-09-12T22:51:29.993826+0000","last_clean_scrub_stamp":"2024-09-12T22:51:29.993826+0000","objects_scrubbed":2,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:07.320092+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"61'438","reported_seq":645,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:35.020938+0000","last_change":"2024-09-12T22:51:35.020999+0000","last_active":"2024-09-12T22:51:35.020938+0000","last_peered":"2024-09-12T22:51:35.020938+0000","last_clean":"2024-09-12T22:51:35.020938+0000","last_became_active":"2024-09-12T22:50:59.703786+0000","last_became_peered":"2024-09-12T22:50:59.703786+0000","last_unstale":"2024-09-12T22:51:35.020938+0000","last_undegraded":"2024-09-12T22:51:35.020938+0000","last_fullsized":"2024-09-12T22:51:35.020938+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'438","last_scrub_stamp":"2024-09-12T22:51:35.020820+0000","last_deep_scrub":"61'438","last_deep_scrub_stamp":"2024-09-12T22:51:35.020820+0000","last_clean_scrub_stamp":"2024-09-12T22:51:35.020820+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:25.292820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":38460,"num_write":412,"num_write_kb":96626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"81'189","reported_seq":355,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:30.368737+0000","last_change":"2024-09-12T22:51:30.368766+0000","last_active":"2024-09-12T22:51:30.368737+0000","last_peered":"2024-09-12T22:51:30.368737+0000","last_clean":"2024-09-12T22:51:30.368737+0000","last_became_active":"2024-09-12T22:50:55.852654+0000","last_became_peered":"2024-09-12T22:50:55.852654+0000","last_unstale":"2024-09-12T22:51:30.368737+0000","last_undegraded":"2024-09-12T22:51:30.368737+0000","last_fullsized":"2024-09-12T22:51:30.368737+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'189","last_scrub_stamp":"2024-09-12T22:51:30.368658+0000","last_deep_scrub":"81'189","last_deep_scrub_stamp":"2024-09-12T22:51:30.368658+0000","last_clean_scrub_stamp":"2024-09-12T22:51:30.368658+0000","objects_scrubbed":4,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:09:37.376911+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":12349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"61'418","reported_seq":608,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:31.344838+0000","last_change":"2024-09-12T22:51:31.344864+0000","last_active":"2024-09-12T22:51:31.344838+0000","last_peered":"2024-09-12T22:51:31.344838+0000","last_clean":"2024-09-12T22:51:31.344838+0000","last_became_active":"2024-09-12T22:48:05.171361+0000","last_became_peered":"2024-09-12T22:48:05.171361+0000","last_unstale":"2024-09-12T22:51:31.344838+0000","last_undegraded":"2024-09-12T22:51:31.344838+0000","last_fullsized":"2024-09-12T22:51:31.344838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'418","last_scrub_stamp":"2024-09-12T22:51:31.344749+0000","last_deep_scrub":"61'418","last_deep_scrub_stamp":"2024-09-12T22:51:31.344749+0000","last_clean_scrub_stamp":"2024-09-12T22:51:31.344749+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:58.481537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":27427,"num_write":388,"num_write_kb":67745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"81'160","reported_seq":295,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:24.498552+0000","last_change":"2024-09-12T22:51:24.498581+0000","last_active":"2024-09-12T22:51:24.498552+0000","last_peered":"2024-09-12T22:51:24.498552+0000","last_clean":"2024-09-12T22:51:24.498552+0000","last_became_active":"2024-09-12T22:50:55.851948+0000","last_became_peered":"2024-09-12T22:50:55.851948+0000","last_unstale":"2024-09-12T22:51:24.498552+0000","last_undegraded":"2024-09-12T22:51:24.498552+0000","last_fullsized":"2024-09-12T22:51:24.498552+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'160","last_scrub_stamp":"2024-09-12T22:51:24.498465+0000","last_deep_scrub":"81'160","last_deep_scrub_stamp":"2024-09-12T22:51:24.498465+0000","last_clean_scrub_stamp":"2024-09-12T22:51:24.498465+0000","objects_scrubbed":1,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:19:07.055397+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"61'479","reported_seq":661,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:51.053266+0000","last_change":"2024-09-12T22:51:51.053292+0000","last_active":"2024-09-12T22:51:51.053266+0000","last_peered":"2024-09-12T22:51:51.053266+0000","last_clean":"2024-09-12T22:51:51.053266+0000","last_became_active":"2024-09-12T22:51:03.704137+0000","last_became_peered":"2024-09-12T22:51:03.704137+0000","last_unstale":"2024-09-12T22:51:51.053266+0000","last_undegraded":"2024-09-12T22:51:51.053266+0000","last_fullsized":"2024-09-12T22:51:51.053266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'479","last_scrub_stamp":"2024-09-12T22:51:51.053174+0000","last_deep_scrub":"61'479","last_deep_scrub_stamp":"2024-09-12T22:51:51.053174+0000","last_clean_scrub_stamp":"2024-09-12T22:51:51.053174+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:19:23.296066+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":26793,"num_write":459,"num_write_kb":138325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"81'52","reported_seq":213,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:51:20.543198+0000","last_change":"2024-09-12T22:51:20.543198+0000","last_active":"2024-09-12T22:51:20.543198+0000","last_peered":"2024-09-12T22:51:20.543198+0000","last_clean":"2024-09-12T22:51:20.543198+0000","last_became_active":"2024-09-12T22:50:52.859983+0000","last_became_peered":"2024-09-12T22:50:52.859983+0000","last_unstale":"2024-09-12T22:51:20.543198+0000","last_undegraded":"2024-09-12T22:51:20.543198+0000","last_fullsized":"2024-09-12T22:51:20.543198+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'52","last_scrub_stamp":"2024-09-12T22:51:20.543052+0000","last_deep_scrub":"81'52","last_deep_scrub_stamp":"2024-09-12T22:51:20.543052+0000","last_clean_scrub_stamp":"2024-09-12T22:51:20.543052+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:00.609182+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2742,"num_read_kb":1405479,"num_write":24656,"num_write_kb":4261796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7339,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26737,"ondisk_log_size":26737,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127366156,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":45,"num_read_kb":1459,"num_write":4460,"num_write_kb":127655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":93806220,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254799872,"data_stored":254732312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5569,"internal_metadata":0},"log_size":6296,"ondisk_log_size":6296,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":67,"seq":287762808850,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150988,"kb_used_data":92924,"kb_used_omap":6,"kb_used_meta":58041,"kb_avail":94220852,"statfs":{"total":96636764160,"available":96482152448,"internally_reserved":0,"allocated":95154176,"data_stored":94739479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7164,"internal_metadata":59433988},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738423,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":169448,"kb_used_data":75864,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94202392,"statfs":{"total":96636764160,"available":96463249408,"internally_reserved":0,"allocated":77684736,"data_stored":77299268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738424,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":172708,"kb_used_data":83284,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94199132,"statfs":{"total":96636764160,"available":96459911168,"internally_reserved":0,"allocated":85282816,"data_stored":84886443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":83980288,"data_stored":83958707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":76972032,"data_stored":76961881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":93847552,"data_stored":93811724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5569,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:52:15.899 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T22:52:16.238 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T22:52:16.239 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T22:52:16.564 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:52:16.565 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":5,"btime":"2024-09-12T22:48:07:173973+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T22:48:04.509445+0000","modified":"2024-09-12T22:48:06.522541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4227},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4227":{"gid":4227,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.66:6803/2680642428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2680642428},{"type":"v1","addr":"172.21.15.66:6803","nonce":2680642428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4227,"qdb_cluster":[4227]},"id":1}]} 2024-09-12T22:52:16.565 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 5 2024-09-12T22:52:16.578 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T22:52:16.905 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:52:16.905 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":5,"btime":"2024-09-12T22:48:07:173973+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T22:48:04.509445+0000","modified":"2024-09-12T22:48:06.522541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4227},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4227":{"gid":4227,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.66:6803/2680642428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2680642428},{"type":"v1","addr":"172.21.15.66:6803","nonce":2680642428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4227,"qdb_cluster":[4227]},"id":1}]} 2024-09-12T22:52:16.905 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 5 2024-09-12T22:52:16.918 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:52:17.207 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T22:52:17.207 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":81,"fsid":"5714c6a5-034c-4330-a57b-d22492ad8e43","created":"2024-09-12T22:47:43.881551+0000","modified":"2024-09-12T22:51:05.718993+0000","last_up_change":"2024-09-12T22:50:51.815832+0000","last_in_change":"2024-09-12T22:47:44.690260+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:47:54.168813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:47:58.920007+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:48:03.033410+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:48:03.489928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ed48fb2-48c2-4ecb-9306-372a05b08cee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6801","nonce":1747255146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6803","nonce":1747255146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6807","nonce":1747255146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1747255146},{"type":"v1","addr":"172.21.15.87:6805","nonce":1747255146}]},"public_addr":"172.21.15.87:6801/1747255146","cluster_addr":"172.21.15.87:6803/1747255146","heartbeat_back_addr":"172.21.15.87:6807/1747255146","heartbeat_front_addr":"172.21.15.87:6805/1747255146","state":["exists","up"]},{"osd":1,"uuid":"af934313-a6b4-4e15-9818-6fc3fb71b949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6801","nonce":1159429503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6803","nonce":1159429503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6807","nonce":1159429503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1159429503},{"type":"v1","addr":"172.21.15.99:6805","nonce":1159429503}]},"public_addr":"172.21.15.99:6801/1159429503","cluster_addr":"172.21.15.99:6803/1159429503","heartbeat_back_addr":"172.21.15.99:6807/1159429503","heartbeat_front_addr":"172.21.15.99:6805/1159429503","state":["exists","up"]},{"osd":2,"uuid":"185ee2bd-8c37-4de1-b6ef-2988144d1470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":22,"up_from":67,"up_thru":78,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":448789353},{"type":"v1","addr":"172.21.15.117:6801","nonce":448789353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":448789353},{"type":"v1","addr":"172.21.15.117:6803","nonce":448789353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":448789353},{"type":"v1","addr":"172.21.15.117:6807","nonce":448789353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":448789353},{"type":"v1","addr":"172.21.15.117:6805","nonce":448789353}]},"public_addr":"172.21.15.117:6801/448789353","cluster_addr":"172.21.15.117:6803/448789353","heartbeat_back_addr":"172.21.15.117:6807/448789353","heartbeat_front_addr":"172.21.15.117:6805/448789353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:47:51.816709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:47:51.376989+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:47:51.833489+0000","dead_epoch":22}],"pg_upmap":[{"pgid":"3.1e","osds":[0,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:52:17.220 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T22:52:17.542 INFO:teuthology.orchestra.run.smithi066.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T22:52:17.557 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T22:52:17.583 INFO:tasks.ceph.mds.a.smithi066.stdout:starting mds.a at 2024-09-12T22:52:18.562 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T22:52:19.552 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_metadata' removed 2024-09-12T22:52:19.566 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T22:52:20.553 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_data' removed 2024-09-12T22:52:20.570 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T22:52:20.571 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T22:52:20.571 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:52:20.581 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T22:52:20.581 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T22:52:20.581 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T22:52:20.581 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:52:20.618 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T22:52:20.618 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T22:52:20.618 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:52:20.655 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T22:52:20.655 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T22:52:20.656 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:52:20.690 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T22:52:20.691 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T22:52:20.691 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T22:52:20.691 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:52:20.721 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T22:52:20.721 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T22:52:20.722 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:52:20.789 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T22:52:20.789 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T22:52:20.790 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T22:52:20.790 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:52:20.843 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T22:52:20.844 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T22:52:20.844 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:52:20.898 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T22:52:20.898 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T22:52:20.898 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:52:20.951 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T22:52:20.952 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T22:52:20.952 DEBUG:teuthology.orchestra.run.smithi066:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-12T22:52:21.030 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi087.front.sepia.ceph.com 2024-09-12T22:52:21.031 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T22:52:21.396 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-12T22:52:21.397 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T22:52:21.502 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi117.front.sepia.ceph.com 2024-09-12T22:52:21.502 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T22:52:21.611 INFO:tasks.ceph:Archiving mon data... 2024-09-12T22:52:21.612 DEBUG:teuthology.misc:Transferring archived files from smithi066:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902947/data/mon.a.tgz 2024-09-12T22:52:21.613 DEBUG:teuthology.orchestra.run.smithi066:> mktemp 2024-09-12T22:52:21.633 INFO:teuthology.orchestra.run.smithi066.stdout:/tmp/tmp.bRW6LyvGtj 2024-09-12T22:52:21.633 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.bRW6LyvGtj 2024-09-12T22:52:21.778 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 0666 /tmp/tmp.bRW6LyvGtj 2024-09-12T22:52:21.867 DEBUG:teuthology.orchestra.remote:smithi066:/tmp/tmp.bRW6LyvGtj is 376KB 2024-09-12T22:52:21.963 DEBUG:teuthology.orchestra.run.smithi066:> rm -fr /tmp/tmp.bRW6LyvGtj 2024-09-12T22:52:21.979 DEBUG:teuthology.misc:Transferring archived files from smithi066:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902947/data/mon.b.tgz 2024-09-12T22:52:21.980 DEBUG:teuthology.orchestra.run.smithi066:> mktemp 2024-09-12T22:52:22.035 INFO:teuthology.orchestra.run.smithi066.stdout:/tmp/tmp.LB8toty5OQ 2024-09-12T22:52:22.035 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.LB8toty5OQ 2024-09-12T22:52:22.204 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 0666 /tmp/tmp.LB8toty5OQ 2024-09-12T22:52:22.288 DEBUG:teuthology.orchestra.remote:smithi066:/tmp/tmp.LB8toty5OQ is 521KB 2024-09-12T22:52:22.389 DEBUG:teuthology.orchestra.run.smithi066:> rm -fr /tmp/tmp.LB8toty5OQ 2024-09-12T22:52:22.405 DEBUG:teuthology.misc:Transferring archived files from smithi066:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902947/data/mon.c.tgz 2024-09-12T22:52:22.405 DEBUG:teuthology.orchestra.run.smithi066:> mktemp 2024-09-12T22:52:22.460 INFO:teuthology.orchestra.run.smithi066.stdout:/tmp/tmp.gudKPo7EwH 2024-09-12T22:52:22.460 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.gudKPo7EwH 2024-09-12T22:52:22.629 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 0666 /tmp/tmp.gudKPo7EwH 2024-09-12T22:52:22.715 DEBUG:teuthology.orchestra.remote:smithi066:/tmp/tmp.gudKPo7EwH is 521KB 2024-09-12T22:52:22.814 DEBUG:teuthology.orchestra.run.smithi066:> rm -fr /tmp/tmp.gudKPo7EwH 2024-09-12T22:52:22.830 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T22:52:22.830 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T22:52:22.872 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T22:52:22.875 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T22:52:22.877 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T22:52:22.952 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T22:52:22.967 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T22:52:22.986 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T22:52:23.008 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T22:52:23.008 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T22:52:23.009 DEBUG:teuthology.misc:Transferring archived files from smithi066:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902947/remote/smithi066/crash 2024-09-12T22:52:23.011 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T22:52:23.036 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902947/remote/smithi087/crash 2024-09-12T22:52:23.037 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T22:52:23.074 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902947/remote/smithi099/crash 2024-09-12T22:52:23.076 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T22:52:23.128 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902947/remote/smithi117/crash 2024-09-12T22:52:23.129 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T22:52:23.163 INFO:tasks.ceph:Compressing logs... 2024-09-12T22:52:23.163 DEBUG:teuthology.orchestra.run.smithi066:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T22:52:23.166 DEBUG:teuthology.orchestra.run.smithi087:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T22:52:23.168 DEBUG:teuthology.orchestra.run.smithi099:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T22:52:23.171 DEBUG:teuthology.orchestra.run.smithi117:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T22:52:23.189 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31300.log 2024-09-12T22:52:23.189 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34072.log 2024-09-12T22:52:23.189 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.31300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30911.log 2024-09-12T22:52:23.189 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31300.log.gz 2024-09-12T22:52:23.190 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37487.log 2024-09-12T22:52:23.190 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T22:52:23.198 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T22:52:23.259 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.781.log 2024-09-12T22:52:23.259 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30287.log 2024-09-12T22:52:23.259 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30367.log 2024-09-12T22:52:23.259 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.781.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.781.log.gz 2024-09-12T22:52:23.259 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.30287.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T22:52:23.259 INFO:teuthology.orchestra.run.smithi117.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30287.log.gz 2024-09-12T22:52:23.260 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.30367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30327.log 2024-09-12T22:52:23.260 INFO:teuthology.orchestra.run.smithi117.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30367.log.gz 2024-09-12T22:52:23.260 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.30327.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30327.log.gz 2024-09-12T22:52:23.269 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33761.log 2024-09-12T22:52:23.269 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.34072.log: /var/log/ceph/ceph-client.admin.30911.log: gzip/var/log/ceph/ceph-client.admin.37487.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.38588.log 2024-09-12T22:52:23.269 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34072.log.gz 2024-09-12T22:52:23.269 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37487.log.gz 2024-09-12T22:52:23.270 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30911.log.gz 2024-09-12T22:52:23.270 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.33761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38168.log 2024-09-12T22:52:23.270 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33761.log.gz 2024-09-12T22:52:23.270 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.38588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34816.log 2024-09-12T22:52:23.270 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38588.log.gz 2024-09-12T22:52:23.270 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.38168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33935.log 2024-09-12T22:52:23.270 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38168.log.gz 2024-09-12T22:52:23.270 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.34816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34552.log 2024-09-12T22:52:23.270 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34816.log.gz 2024-09-12T22:52:23.270 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.33935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37394.log 2024-09-12T22:52:23.270 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33935.log.gz 2024-09-12T22:52:23.270 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.34552.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34552.log.gz 2024-09-12T22:52:23.270 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39050.log 2024-09-12T22:52:23.271 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5/var/log/ceph/ceph-client.admin.37394.log: --verbose -- /var/log/ceph/ceph-client.admin.33400.log 2024-09-12T22:52:23.271 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37394.log.gz 2024-09-12T22:52:23.271 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.39050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37706.log 2024-09-12T22:52:23.271 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39050.log.gz 2024-09-12T22:52:23.271 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.33400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33271.log 2024-09-12T22:52:23.271 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33400.log.gz 2024-09-12T22:52:23.271 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.37706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33316.log 2024-09-12T22:52:23.271 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37706.log.gz 2024-09-12T22:52:23.271 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.33271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35813.log 2024-09-12T22:52:23.271 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33271.log.gz 2024-09-12T22:52:23.271 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.33316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33662.log 2024-09-12T22:52:23.271 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33316.log.gz 2024-09-12T22:52:23.271 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.35813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30149.log 2024-09-12T22:52:23.272 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35813.log.gz 2024-09-12T22:52:23.272 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.33662.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33662.log.gz 2024-09-12T22:52:23.272 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34771.log 2024-09-12T22:52:23.272 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.30149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30701.log 2024-09-12T22:52:23.272 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30149.log.gz 2024-09-12T22:52:23.272 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.34771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33097.log 2024-09-12T22:52:23.272 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34771.log.gz 2024-09-12T22:52:23.272 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.30701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38333.log 2024-09-12T22:52:23.272 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30701.log.gz 2024-09-12T22:52:23.272 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32077.log 2024-09-12T22:52:23.272 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.33097.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33097.log.gz 2024-09-12T22:52:23.272 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.38333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36724.log 2024-09-12T22:52:23.272 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38333.log.gz 2024-09-12T22:52:23.273 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.32077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38840.log 2024-09-12T22:52:23.273 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32077.log.gz 2024-09-12T22:52:23.273 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.36724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33529.log 2024-09-12T22:52:23.273 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36724.log.gz 2024-09-12T22:52:23.273 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.38840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37156.log 2024-09-12T22:52:23.273 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38840.log.gz 2024-09-12T22:52:23.273 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.33529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37748.log 2024-09-12T22:52:23.273 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33529.log.gz 2024-09-12T22:52:23.273 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.37156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38798.log 2024-09-12T22:52:23.273 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37156.log.gz 2024-09-12T22:52:23.273 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.37748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36238.log 2024-09-12T22:52:23.273 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37748.log.gz 2024-09-12T22:52:23.273 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.38798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33802.log 2024-09-12T22:52:23.274 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38798.log.gz 2024-09-12T22:52:23.274 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.36238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35991.log 2024-09-12T22:52:23.274 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36238.log.gz 2024-09-12T22:52:23.274 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.33802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38081.log 2024-09-12T22:52:23.274 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33802.log.gz 2024-09-12T22:52:23.274 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.35991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36033.log 2024-09-12T22:52:23.274 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35991.log.gz 2024-09-12T22:52:23.274 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.38081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33574.log 2024-09-12T22:52:23.274 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38081.log.gz 2024-09-12T22:52:23.274 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.36033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36810.log 2024-09-12T22:52:23.274 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36033.log.gz 2024-09-12T22:52:23.274 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.33574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36280.log 2024-09-12T22:52:23.274 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33574.log.gz 2024-09-12T22:52:23.274 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.36810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39300.log 2024-09-12T22:52:23.275 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36810.log.gz 2024-09-12T22:52:23.275 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.36280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31406.log 2024-09-12T22:52:23.275 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36280.log.gz 2024-09-12T22:52:23.275 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.39300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29642.log 2024-09-12T22:52:23.275 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39300.log.gz 2024-09-12T22:52:23.275 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.31406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30571.log 2024-09-12T22:52:23.275 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31406.log.gz 2024-09-12T22:52:23.275 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.29642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34092.log 2024-09-12T22:52:23.275 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29642.log.gz 2024-09-12T22:52:23.275 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.30571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38672.log 2024-09-12T22:52:23.275 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30571.log.gz 2024-09-12T22:52:23.275 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.34092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37196.log 2024-09-12T22:52:23.275 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34092.log.gz 2024-09-12T22:52:23.276 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.38672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30953.log 2024-09-12T22:52:23.276 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38672.log.gz 2024-09-12T22:52:23.276 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.37196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35772.log 2024-09-12T22:52:23.276 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37196.log.gz 2024-09-12T22:52:23.276 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.30953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31512.log 2024-09-12T22:52:23.276 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30953.log.gz 2024-09-12T22:52:23.276 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.35772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30392.log 2024-09-12T22:52:23.276 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35772.log.gz 2024-09-12T22:52:23.276 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.31512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38000.log 2024-09-12T22:52:23.276 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31512.log.gz 2024-09-12T22:52:23.276 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.30392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39218.log 2024-09-12T22:52:23.276 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30392.log.gz 2024-09-12T22:52:23.276 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.38000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34684.log 2024-09-12T22:52:23.277 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38000.log.gz 2024-09-12T22:52:23.277 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.39218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33052.log 2024-09-12T22:52:23.277 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39218.log.gz 2024-09-12T22:52:23.277 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.34684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32160.log 2024-09-12T22:52:23.277 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34684.log.gz 2024-09-12T22:52:23.277 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.33052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38207.log 2024-09-12T22:52:23.277 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33052.log.gz 2024-09-12T22:52:23.277 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.32160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31722.log 2024-09-12T22:52:23.277 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32160.log.gz 2024-09-12T22:52:23.277 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.38207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31173.log 2024-09-12T22:52:23.277 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38207.log.gz 2024-09-12T22:52:23.277 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.31722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35589.log 2024-09-12T22:52:23.277 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31722.log.gz 2024-09-12T22:52:23.277 INFO:teuthology.orchestra.run.smithi066.stderr:gzip/var/log/ceph/ceph-client.admin.31173.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39384.log 2024-09-12T22:52:23.278 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31173.log.gz 2024-09-12T22:52:23.278 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.35589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39571.log 2024-09-12T22:52:23.278 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35589.log.gz 2024-09-12T22:52:23.278 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.39384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30487.log 2024-09-12T22:52:23.278 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39384.log.gz 2024-09-12T22:52:23.278 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.39571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31446.log 2024-09-12T22:52:23.278 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39571.log.gz 2024-09-12T22:52:23.278 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.30487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34021.log 2024-09-12T22:52:23.278 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30487.log.gz 2024-09-12T22:52:23.278 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.31446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30348.log 2024-09-12T22:52:23.278 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31446.log.gz 2024-09-12T22:52:23.278 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.34021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39486.log 2024-09-12T22:52:23.278 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34021.log.gz 2024-09-12T22:52:23.278 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.30348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38082.log 2024-09-12T22:52:23.279 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30348.log.gz 2024-09-12T22:52:23.279 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.39486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33980.log 2024-09-12T22:52:23.279 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39486.log.gz 2024-09-12T22:52:23.279 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.38082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30996.log 2024-09-12T22:52:23.279 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38082.log.gz 2024-09-12T22:52:23.279 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.33980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31047.log 2024-09-12T22:52:23.279 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33980.log.gz 2024-09-12T22:52:23.279 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.30996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33184.log 2024-09-12T22:52:23.279 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30996.log.gz 2024-09-12T22:52:23.279 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.31047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35946.log 2024-09-12T22:52:23.279 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31047.log.gz 2024-09-12T22:52:23.279 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.33184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39426.log 2024-09-12T22:52:23.279 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33184.log.gz 2024-09-12T22:52:23.280 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36943.log 2024-09-12T22:52:23.280 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.35946.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35946.log.gz 2024-09-12T22:52:23.280 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.39426.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T22:52:23.280 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39426.log.gz 2024-09-12T22:52:23.280 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.36943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34423.log 2024-09-12T22:52:23.280 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36943.log.gz 2024-09-12T22:52:23.280 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38080.log 2024-09-12T22:52:23.280 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36619.log 2024-09-12T22:52:23.280 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.34423.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34423.log.gz 2024-09-12T22:52:23.280 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.38080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39176.log 2024-09-12T22:52:23.280 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38080.log.gz 2024-09-12T22:52:23.280 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.36619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30244.log 2024-09-12T22:52:23.280 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36619.log.gz 2024-09-12T22:52:23.280 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.39176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30659.log 2024-09-12T22:52:23.281 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39176.log.gz 2024-09-12T22:52:23.281 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.30244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33442.log 2024-09-12T22:52:23.281 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30244.log.gz 2024-09-12T22:52:23.281 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.30659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35636.log 2024-09-12T22:52:23.281 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30659.log.gz 2024-09-12T22:52:23.281 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.33442.log: 95.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T22:52:23.281 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38208.log 2024-09-12T22:52:23.281 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33442.log.gz 2024-09-12T22:52:23.281 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.35636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37097.log 2024-09-12T22:52:23.281 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35636.log.gz 2024-09-12T22:52:23.281 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.38208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31764.log 2024-09-12T22:52:23.281 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38208.log.gz 2024-09-12T22:52:23.281 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.37097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32963.log 0.0% 2024-09-12T22:52:23.281 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37097.log.gz 2024-09-12T22:52:23.282 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.31764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37832.log 2024-09-12T22:52:23.282 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31764.log.gz 2024-09-12T22:52:23.282 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.32963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33010.log 2024-09-12T22:52:23.282 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32963.log.gz 2024-09-12T22:52:23.282 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.37832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33137.log 2024-09-12T22:52:23.282 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37832.log.gz 2024-09-12T22:52:23.282 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.33010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38546.log 2024-09-12T22:52:23.282 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33010.log.gz 2024-09-12T22:52:23.282 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.33137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35859.log 2024-09-12T22:52:23.282 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33137.log.gz 2024-09-12T22:52:23.282 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.38546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34291.log 2024-09-12T22:52:23.282 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38546.log.gz 2024-09-12T22:52:23.282 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.35859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36078.log 2024-09-12T22:52:23.282 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35859.log.gz 2024-09-12T22:52:23.283 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.34291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31554.log 2024-09-12T22:52:23.283 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34291.log.gz 2024-09-12T22:52:23.283 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.36078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36769.log 2024-09-12T22:52:23.283 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36078.log.gz 2024-09-12T22:52:23.283 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.31554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36988.log 2024-09-12T22:52:23.283 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31554.log.gz 2024-09-12T22:52:23.283 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.36769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31973.log 2024-09-12T22:52:23.283 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36769.log.gz 2024-09-12T22:52:23.283 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.36988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30093.log 2024-09-12T22:52:23.283 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36988.log.gz 2024-09-12T22:52:23.283 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.31973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35371.log 2024-09-12T22:52:23.283 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31973.log.gz 2024-09-12T22:52:23.283 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.30093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35243.log 2024-09-12T22:52:23.284 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30093.log.gz 2024-09-12T22:52:23.284 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.35371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31299.log 2024-09-12T22:52:23.284 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35371.log.gz 2024-09-12T22:52:23.284 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.35243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35330.log 2024-09-12T22:52:23.284 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35243.log.gz 2024-09-12T22:52:23.284 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.31299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31091.log 2024-09-12T22:52:23.284 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31299.log.gz 2024-09-12T22:52:23.284 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.35330.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T22:52:23.284 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35330.log.gz 2024-09-12T22:52:23.284 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.31091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31260.log 2024-09-12T22:52:23.284 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31091.log.gz 2024-09-12T22:52:23.284 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30743.log 2024-09-12T22:52:23.284 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.31260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33848.log 2024-09-12T22:52:23.284 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31260.log.gz 2024-09-12T22:52:23.285 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.30743.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-12T22:52:23.285 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30743.log.gz 2024-09-12T22:52:23.285 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.33848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34510.log 2024-09-12T22:52:23.285 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33848.log.gz 2024-09-12T22:52:23.285 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39008.log 2024-09-12T22:52:23.285 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.34510.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.28772.log 2024-09-12T22:52:23.285 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34510.log.gz 2024-09-12T22:52:23.285 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.39008.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39008.log.gz 2024-09-12T22:52:23.285 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37659.log 2024-09-12T22:52:23.285 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph.tmp-client.admin.28772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36422.log 2024-09-12T22:52:23.285 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.28772.log.gz 2024-09-12T22:52:23.285 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.37659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30617.log 2024-09-12T22:52:23.285 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37659.log.gz 2024-09-12T22:52:23.286 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.36422.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36422.log.gz 2024-09-12T22:52:23.286 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31680.log 2024-09-12T22:52:23.286 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.30617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34729.log 2024-09-12T22:52:23.286 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30617.log.gz 2024-09-12T22:52:23.286 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.31680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31680.log.gz 2024-09-12T22:52:23.286 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33483.log 2024-09-12T22:52:23.286 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.34729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31931.log 2024-09-12T22:52:23.286 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34729.log.gz 2024-09-12T22:52:23.286 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.33483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31638.log 2024-09-12T22:52:23.286 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33483.log.gz 2024-09-12T22:52:23.286 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.31931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37262.log 2024-09-12T22:52:23.286 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31931.log.gz 2024-09-12T22:52:23.286 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.31638.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31638.log.gz 2024-09-12T22:52:23.286 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29875.log 2024-09-12T22:52:23.287 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T22:52:23.287 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.37262.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37262.log.gz 2024-09-12T22:52:23.287 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.29875.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29875.log.gz 2024-09-12T22:52:23.287 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34858.log 2024-09-12T22:52:23.287 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31806.log 2024-09-12T22:52:23.287 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.34858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36664.log 2024-09-12T22:52:23.287 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34858.log.gz 2024-09-12T22:52:23.287 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.31806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37349.log 2024-09-12T22:52:23.287 INFO:teuthology.orchestra.run.smithi066.stderr: 48.1% -- replaced with /var/log/ceph/ceph-client.admin.31806.log.gz 2024-09-12T22:52:23.287 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.36664.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36664.log.gz 2024-09-12T22:52:23.287 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39092.log 2024-09-12T22:52:23.287 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.37349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35140.log 2024-09-12T22:52:23.287 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37349.log.gz 2024-09-12T22:52:23.287 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.39092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34991.log 2024-09-12T22:52:23.288 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39092.log.gz 2024-09-12T22:52:23.288 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.35140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38756.log 2024-09-12T22:52:23.288 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35140.log.gz 2024-09-12T22:52:23.288 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.34991.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34991.log.gz 2024-09-12T22:52:23.288 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30436.log 2024-09-12T22:52:23.288 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.38756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34465.log 2024-09-12T22:52:23.288 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38756.log.gz 2024-09-12T22:52:23.288 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.30436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33617.log 2024-09-12T22:52:23.288 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30436.log.gz 2024-09-12T22:52:23.288 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.34465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31889.log 2024-09-12T22:52:23.288 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34465.log.gz 2024-09-12T22:52:23.288 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.33617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37916.log 2024-09-12T22:52:23.288 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33617.log.gz 2024-09-12T22:52:23.289 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.31889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36352.log 2024-09-12T22:52:23.289 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31889.log.gz 2024-09-12T22:52:23.289 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.37916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35462.log 2024-09-12T22:52:23.289 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37916.log.gz 2024-09-12T22:52:23.289 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.36352.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36352.log.gz 2024-09-12T22:52:23.289 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34597.log 2024-09-12T22:52:23.289 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.35462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30529.log 2024-09-12T22:52:23.289 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35462.log.gz 2024-09-12T22:52:23.289 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.34597.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T22:52:23.289 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34597.log.gz 2024-09-12T22:52:23.289 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.30529.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.30529.log.gz --verbose 2024-09-12T22:52:23.289 INFO:teuthology.orchestra.run.smithi066.stderr: -- /var/log/ceph/ceph-client.admin.34378.log 2024-09-12T22:52:23.289 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38630.log 2024-09-12T22:52:23.289 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.34378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37874.log 2024-09-12T22:52:23.290 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34378.log.gz 2024-09-12T22:52:23.290 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.38630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29852.log 2024-09-12T22:52:23.290 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38630.log.gz 2024-09-12T22:52:23.290 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T22:52:23.290 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.37874.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37874.log.gz 2024-09-12T22:52:23.290 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.29852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31596.log 2024-09-12T22:52:23.290 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29852.log.gz 2024-09-12T22:52:23.290 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34159.log 2024-09-12T22:52:23.290 INFO:teuthology.orchestra.run.smithi066.stderr:gzip/var/log/ceph/ceph-client.admin.31596.log: -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31596.log.gz 2024-09-12T22:52:23.290 INFO:teuthology.orchestra.run.smithi066.stderr: /var/log/ceph/ceph-client.admin.30785.log 2024-09-12T22:52:23.290 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.34159.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34159.log.gz 2024-09-12T22:52:23.290 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T22:52:23.290 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.30785.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30785.log.gz 2024-09-12T22:52:23.291 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37606.log 2024-09-12T22:52:23.291 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39134.log 2024-09-12T22:52:23.291 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.37606.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34246.log 2024-09-12T22:52:23.291 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37606.log.gz 2024-09-12T22:52:23.291 INFO:teuthology.orchestra.run.smithi066.stderr: 94.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T22:52:23.291 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30306.log 2024-09-12T22:52:23.291 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.39134.log: 0.0%/var/log/ceph/ceph-client.admin.34246.log: -- replaced with /var/log/ceph/ceph-client.admin.39134.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36119.log 2024-09-12T22:52:23.291 INFO:teuthology.orchestra.run.smithi066.stderr: 2024-09-12T22:52:23.291 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34246.log.gz 2024-09-12T22:52:23.291 INFO:teuthology.orchestra.run.smithi066.stderr:gzip/var/log/ceph/ceph-client.admin.30306.log: -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30306.log.gz 2024-09-12T22:52:23.291 INFO:teuthology.orchestra.run.smithi066.stderr: /var/log/ceph/ceph-client.admin.31386.log 2024-09-12T22:52:23.291 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.36119.log: 93.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T22:52:23.291 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36119.log.gz 2024-09-12T22:52:23.292 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33715.log 2024-09-12T22:52:23.292 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.31386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35417.log 2024-09-12T22:52:23.292 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31386.log.gz 2024-09-12T22:52:23.292 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.33715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38882.log 2024-09-12T22:52:23.292 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33715.log.gz 2024-09-12T22:52:23.292 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.35417.log: /var/log/ceph/ceph-client.admin.36875.log 2024-09-12T22:52:23.292 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35417.log.gz 2024-09-12T22:52:23.292 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.38882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35723.log 2024-09-12T22:52:23.292 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38882.log.gz 2024-09-12T22:52:23.292 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.36875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35681.log 2024-09-12T22:52:23.292 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36875.log.gz 2024-09-12T22:52:23.292 INFO:teuthology.orchestra.run.smithi066.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-12T22:52:23.292 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.35723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36489.log 2024-09-12T22:52:23.293 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35723.log.gz 2024-09-12T22:52:23.293 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.35681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32159.log 2024-09-12T22:52:23.293 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35681.log.gz 2024-09-12T22:52:23.293 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.36489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31172.log 2024-09-12T22:52:23.293 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36489.log.gz 2024-09-12T22:52:23.293 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.32159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34204.log 2024-09-12T22:52:23.293 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32159.log.gz 2024-09-12T22:52:23.293 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.31172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36536.log 2024-09-12T22:52:23.293 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31172.log.gz 2024-09-12T22:52:23.293 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.34204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38966.log 2024-09-12T22:52:23.293 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34204.log.gz 2024-09-12T22:52:23.293 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.36536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33893.log 2024-09-12T22:52:23.293 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36536.log.gz 2024-09-12T22:52:23.293 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.38966.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38966.log.gz -5 2024-09-12T22:52:23.294 INFO:teuthology.orchestra.run.smithi066.stderr: --verbose -- /var/log/ceph/ceph-client.admin.36168.log 2024-09-12T22:52:23.294 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.33893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38294.log 2024-09-12T22:52:23.294 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33893.log.gz 2024-09-12T22:52:23.294 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.36168.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36168.log.gzgzip 2024-09-12T22:52:23.294 INFO:teuthology.orchestra.run.smithi066.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.35879.log 2024-09-12T22:52:23.294 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.38294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37563.log 2024-09-12T22:52:23.294 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38294.log.gz 2024-09-12T22:52:23.294 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.35879.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.37958.log -- replaced with /var/log/ceph/ceph-client.admin.35879.log.gz 2024-09-12T22:52:23.294 INFO:teuthology.orchestra.run.smithi066.stderr: 2024-09-12T22:52:23.294 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.37563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38924.log 2024-09-12T22:52:23.294 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37563.log.gz 2024-09-12T22:52:23.294 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.37958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35549.log 2024-09-12T22:52:23.294 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37958.log.gz 2024-09-12T22:52:23.295 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.38924.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T22:52:23.295 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38924.log.gz 2024-09-12T22:52:23.295 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.35549.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.35549.log.gz 2024-09-12T22:52:23.295 INFO:teuthology.orchestra.run.smithi066.stderr: --verbose -- /var/log/ceph/ceph-client.admin.30016.log 2024-09-12T22:52:23.295 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39258.log 2024-09-12T22:52:23.295 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.30016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34943.log 2024-09-12T22:52:23.295 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30016.log.gz 2024-09-12T22:52:23.295 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.39258.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39258.log.gz 2024-09-12T22:52:23.295 INFO:teuthology.orchestra.run.smithi066.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.32783.log 2024-09-12T22:52:23.295 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.34943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30827.log 2024-09-12T22:52:23.295 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34943.log.gz 2024-09-12T22:52:23.295 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.32783.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32783.log.gz 2024-09-12T22:52:23.295 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35036.log 2024-09-12T22:52:23.295 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33358.log 2024-09-12T22:52:23.296 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.30827.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30827.log.gz 2024-09-12T22:52:23.296 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.35036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36876.log 2024-09-12T22:52:23.296 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35036.log.gz 2024-09-12T22:52:23.296 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.33358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34903.log 2024-09-12T22:52:23.296 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33358.log.gz 2024-09-12T22:52:23.296 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.36876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38334.log 2024-09-12T22:52:23.296 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36876.log.gz 2024-09-12T22:52:23.296 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.34903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38459.log 2024-09-12T22:52:23.296 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34903.log.gz 2024-09-12T22:52:23.296 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.38334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32245.log 2024-09-12T22:52:23.296 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38334.log.gz 2024-09-12T22:52:23.296 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.38459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32665.log 2024-09-12T22:52:23.296 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38459.log.gz 2024-09-12T22:52:23.297 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39529.log 2024-09-12T22:52:23.297 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.32245.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32245.log.gz 2024-09-12T22:52:23.297 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.32665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37790.log 2024-09-12T22:52:23.297 INFO:teuthology.orchestra.run.smithi066.stderr: 31.9% -- replaced with /var/log/ceph/ceph-client.0.32665.log.gz 2024-09-12T22:52:23.297 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.39529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38714.log 2024-09-12T22:52:23.297 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39529.log.gz 2024-09-12T22:52:23.297 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.37790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33229.log 2024-09-12T22:52:23.297 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37790.log.gz 2024-09-12T22:52:23.297 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30869.log 2024-09-12T22:52:23.297 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.38714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38714.log.gz 2024-09-12T22:52:23.297 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.33229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39342.log 2024-09-12T22:52:23.297 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33229.log.gz 2024-09-12T22:52:23.297 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34332.log 2024-09-12T22:52:23.298 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.30869.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30869.log.gz 2024-09-12T22:52:23.298 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.39342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34637.log 2024-09-12T22:52:23.298 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39342.log.gz 2024-09-12T22:52:23.298 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.34332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32919.log 2024-09-12T22:52:23.298 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34332.log.gz 2024-09-12T22:52:23.298 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38460.log 2024-09-12T22:52:23.298 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.34637.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34637.log.gz 2024-09-12T22:52:23.298 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35504.log 2024-09-12T22:52:23.298 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.32919.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32919.log.gz 2024-09-12T22:52:23.298 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.38460.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38460.log.gz -5 2024-09-12T22:52:23.298 INFO:teuthology.orchestra.run.smithi066.stderr: --verbose -- /var/log/ceph/ceph-client.admin.32015.log 2024-09-12T22:52:23.298 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31171.log 2024-09-12T22:52:23.298 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.35504.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35504.log.gz 2024-09-12T22:52:23.298 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.32015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37303.log 2024-09-12T22:52:23.299 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32015.log.gz 2024-09-12T22:52:23.299 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.31171.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31171.log.gz 2024-09-12T22:52:23.299 INFO:teuthology.orchestra.run.smithi066.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.30174.log 2024-09-12T22:52:23.299 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.37303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35284.log 2024-09-12T22:52:23.299 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37303.log.gz 2024-09-12T22:52:23.299 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.30174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38420.log 2024-09-12T22:52:23.299 INFO:teuthology.orchestra.run.smithi066.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30174.log.gz 2024-09-12T22:52:23.299 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.35284.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35284.log.gz 2024-09-12T22:52:23.299 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.38420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38420.log.gz 2024-09-12T22:52:23.300 INFO:teuthology.orchestra.run.smithi066.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T22:52:23.333 INFO:teuthology.orchestra.run.smithi066.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T22:52:23.337 INFO:teuthology.orchestra.run.smithi066.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T22:52:23.450 INFO:teuthology.orchestra.run.smithi066.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T22:52:23.452 INFO:teuthology.orchestra.run.smithi066.stderr: 2024-09-12T22:52:23.452 INFO:teuthology.orchestra.run.smithi066.stderr:real 0m0.274s 2024-09-12T22:52:23.453 INFO:teuthology.orchestra.run.smithi066.stderr:user 0m0.587s 2024-09-12T22:52:23.453 INFO:teuthology.orchestra.run.smithi066.stderr:sys 0m0.118s 2024-09-12T22:52:24.090 INFO:teuthology.orchestra.run.smithi117.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T22:52:24.092 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-09-12T22:52:24.092 INFO:teuthology.orchestra.run.smithi117.stderr:real 0m0.868s 2024-09-12T22:52:24.092 INFO:teuthology.orchestra.run.smithi117.stderr:user 0m0.794s 2024-09-12T22:52:24.092 INFO:teuthology.orchestra.run.smithi117.stderr:sys 0m0.046s 2024-09-12T22:52:27.903 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-osd.0.log: 94.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T22:52:27.904 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-09-12T22:52:27.905 INFO:teuthology.orchestra.run.smithi087.stderr:real 0m4.724s 2024-09-12T22:52:27.905 INFO:teuthology.orchestra.run.smithi087.stderr:user 0m4.549s 2024-09-12T22:52:27.905 INFO:teuthology.orchestra.run.smithi087.stderr:sys 0m0.176s 2024-09-12T22:52:28.358 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.1.log: 94.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T22:52:28.359 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-12T22:52:28.359 INFO:teuthology.orchestra.run.smithi099.stderr:real 0m5.174s 2024-09-12T22:52:28.359 INFO:teuthology.orchestra.run.smithi099.stderr:user 0m4.981s 2024-09-12T22:52:28.360 INFO:teuthology.orchestra.run.smithi099.stderr:sys 0m0.194s 2024-09-12T22:52:28.360 INFO:tasks.ceph:Archiving logs... 2024-09-12T22:52:28.360 DEBUG:teuthology.misc:Transferring archived files from smithi066:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902947/remote/smithi066/log 2024-09-12T22:52:28.361 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T22:52:28.643 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902947/remote/smithi087/log 2024-09-12T22:52:28.644 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T22:52:29.405 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902947/remote/smithi099/log 2024-09-12T22:52:29.406 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T22:52:30.161 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902947/remote/smithi117/log 2024-09-12T22:52:30.162 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T22:52:30.321 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T22:52:30.330 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T22:52:30.330 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T22:52:30.333 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T22:52:30.336 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T22:52:30.339 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T22:52:30.461 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T22:52:30.472 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T22:52:30.472 DEBUG:teuthology.orchestra.run.smithi066:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T22:52:30.475 DEBUG:teuthology.orchestra.run.smithi087:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T22:52:30.477 DEBUG:teuthology.orchestra.run.smithi099:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T22:52:30.480 DEBUG:teuthology.orchestra.run.smithi117:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T22:52:30.490 INFO:teuthology.orchestra.run.smithi066.stderr:bash: line 1: ntpq: command not found 2024-09-12T22:52:30.492 INFO:teuthology.orchestra.run.smithi087.stderr:bash: line 1: ntpq: command not found 2024-09-12T22:52:30.494 INFO:teuthology.orchestra.run.smithi099.stderr:bash: line 1: ntpq: command not found 2024-09-12T22:52:30.495 INFO:teuthology.orchestra.run.smithi066.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T22:52:30.495 INFO:teuthology.orchestra.run.smithi066.stdout:=============================================================================== 2024-09-12T22:52:30.495 INFO:teuthology.orchestra.run.smithi066.stdout:^* hv01.front.sepia.ceph.com 3 6 377 7 -276us[ -278us] +/- 48ms 2024-09-12T22:52:30.495 INFO:teuthology.orchestra.run.smithi066.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 8 -47us[ -48us] +/- 62ms 2024-09-12T22:52:30.496 INFO:teuthology.orchestra.run.smithi066.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 7 +445us[ +443us] +/- 68ms 2024-09-12T22:52:30.496 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:52:30.496 INFO:teuthology.orchestra.run.smithi117.stderr:bash: line 1: ntpq: command not found 2024-09-12T22:52:30.497 INFO:teuthology.orchestra.run.smithi087.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T22:52:30.497 INFO:teuthology.orchestra.run.smithi087.stdout:=============================================================================== 2024-09-12T22:52:30.497 INFO:teuthology.orchestra.run.smithi087.stdout:^* hv01.front.sepia.ceph.com 3 6 377 8 -259us[ -241us] +/- 48ms 2024-09-12T22:52:30.497 INFO:teuthology.orchestra.run.smithi087.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 8 -39us[ -39us] +/- 62ms 2024-09-12T22:52:30.497 INFO:teuthology.orchestra.run.smithi087.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 6 +471us[ +471us] +/- 68ms 2024-09-12T22:52:30.497 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:52:30.499 INFO:teuthology.orchestra.run.smithi099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T22:52:30.499 INFO:teuthology.orchestra.run.smithi099.stdout:=============================================================================== 2024-09-12T22:52:30.499 INFO:teuthology.orchestra.run.smithi099.stdout:^* hv01.front.sepia.ceph.com 3 6 377 10 -277us[ -276us] +/- 48ms 2024-09-12T22:52:30.499 INFO:teuthology.orchestra.run.smithi099.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 8 -29us[ -29us] +/- 62ms 2024-09-12T22:52:30.499 INFO:teuthology.orchestra.run.smithi099.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 +462us[ +462us] +/- 68ms 2024-09-12T22:52:30.499 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:52:30.500 INFO:teuthology.orchestra.run.smithi117.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T22:52:30.501 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================== 2024-09-12T22:52:30.501 INFO:teuthology.orchestra.run.smithi117.stdout:^* hv01.front.sepia.ceph.com 3 6 37 46 -277us[ -215us] +/- 48ms 2024-09-12T22:52:30.501 INFO:teuthology.orchestra.run.smithi117.stdout:^+ hv02.front.sepia.ceph.com 3 6 37 46 +4670ns[+4670ns] +/- 61ms 2024-09-12T22:52:30.501 INFO:teuthology.orchestra.run.smithi117.stdout:^+ hv03.front.sepia.ceph.com 3 6 37 45 +479us[ +479us] +/- 68ms 2024-09-12T22:52:30.501 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv04.front.sepia.ceph.com 0 7 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:52:30.501 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T22:52:30.510 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T22:52:30.510 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T22:52:30.519 DEBUG:teuthology.orchestra.run.smithi066:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T22:52:30.612 DEBUG:teuthology.orchestra.run.smithi087:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T22:52:30.684 DEBUG:teuthology.orchestra.run.smithi099:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T22:52:30.757 DEBUG:teuthology.orchestra.run.smithi117:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T22:52:31.141 DEBUG:teuthology.orchestra.run.smithi066:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T22:52:31.176 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:52:31.176 DEBUG:teuthology.orchestra.run.smithi087:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T22:52:31.209 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:52:31.209 DEBUG:teuthology.orchestra.run.smithi099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T22:52:31.242 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:52:31.243 DEBUG:teuthology.orchestra.run.smithi117:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T22:52:31.275 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:52:31.275 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T22:52:31.285 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T22:52:31.294 INFO:teuthology.task.internal:Duration was 639.191281 seconds 2024-09-12T22:52:31.294 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T22:52:31.302 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T22:52:31.302 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T22:52:31.305 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T22:52:31.308 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T22:52:31.310 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T22:52:31.349 INFO:teuthology.orchestra.run.smithi087.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T22:52:31.350 INFO:teuthology.orchestra.run.smithi066.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T22:52:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T22:52:31.380 INFO:teuthology.orchestra.run.smithi117.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T22:52:31.763 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T22:52:31.764 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi066.front.sepia.ceph.com 2024-09-12T22:52:31.764 DEBUG:teuthology.orchestra.run.smithi066:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T22:52:31.789 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi087.front.sepia.ceph.com 2024-09-12T22:52:31.790 DEBUG:teuthology.orchestra.run.smithi087:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T22:52:31.820 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi099.front.sepia.ceph.com 2024-09-12T22:52:31.821 DEBUG:teuthology.orchestra.run.smithi099:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T22:52:31.850 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi117.front.sepia.ceph.com 2024-09-12T22:52:31.850 DEBUG:teuthology.orchestra.run.smithi117:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T22:52:31.881 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T22:52:31.881 DEBUG:teuthology.orchestra.run.smithi066:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T22:52:31.884 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T22:52:31.887 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T22:52:31.892 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T22:52:31.949 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T22:52:31.950 DEBUG:teuthology.orchestra.run.smithi066:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T22:52:31.957 DEBUG:teuthology.orchestra.run.smithi087:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T22:52:31.960 DEBUG:teuthology.orchestra.run.smithi099:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T22:52:31.962 DEBUG:teuthology.orchestra.run.smithi117:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T22:52:32.070 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T22:52:32.081 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T22:52:32.081 DEBUG:teuthology.orchestra.run.smithi066:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T22:52:32.108 DEBUG:teuthology.orchestra.run.smithi087:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T22:52:32.133 DEBUG:teuthology.orchestra.run.smithi099:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T22:52:32.158 DEBUG:teuthology.orchestra.run.smithi117:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T22:52:32.185 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T22:52:32.195 DEBUG:teuthology.orchestra.run.smithi066:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T22:52:32.198 DEBUG:teuthology.orchestra.run.smithi087:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T22:52:32.200 DEBUG:teuthology.orchestra.run.smithi099:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T22:52:32.202 DEBUG:teuthology.orchestra.run.smithi117:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T22:52:32.220 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern = core 2024-09-12T22:52:32.221 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = core 2024-09-12T22:52:32.224 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = core 2024-09-12T22:52:32.257 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = core 2024-09-12T22:52:32.285 DEBUG:teuthology.orchestra.run.smithi066:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T22:52:32.299 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:52:32.300 DEBUG:teuthology.orchestra.run.smithi087:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T22:52:32.314 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:52:32.315 DEBUG:teuthology.orchestra.run.smithi099:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T22:52:32.336 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:52:32.337 DEBUG:teuthology.orchestra.run.smithi117:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T22:52:32.352 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:52:32.352 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T22:52:32.362 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T22:52:32.363 DEBUG:teuthology.misc:Transferring archived files from smithi066:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902947/remote/smithi066 2024-09-12T22:52:32.363 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T22:52:32.399 DEBUG:teuthology.misc:Transferring archived files from smithi087:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902947/remote/smithi087 2024-09-12T22:52:32.399 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T22:52:32.432 DEBUG:teuthology.misc:Transferring archived files from smithi099:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902947/remote/smithi099 2024-09-12T22:52:32.433 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T22:52:32.467 DEBUG:teuthology.misc:Transferring archived files from smithi117:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902947/remote/smithi117 2024-09-12T22:52:32.467 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T22:52:32.498 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T22:52:32.498 DEBUG:teuthology.orchestra.run.smithi066:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T22:52:32.501 DEBUG:teuthology.orchestra.run.smithi087:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T22:52:32.503 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T22:52:32.505 DEBUG:teuthology.orchestra.run.smithi117:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T22:52:32.549 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T22:52:32.561 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T22:52:32.561 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T22:52:32.572 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T22:52:32.572 DEBUG:teuthology.orchestra.run.smithi066:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T22:52:32.575 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T22:52:32.578 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T22:52:32.580 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T22:52:32.588 INFO:teuthology.orchestra.run.smithi066.stdout: 265881 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 22:52 /home/ubuntu/cephtest 2024-09-12T22:52:32.590 INFO:teuthology.orchestra.run.smithi087.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 22:52 /home/ubuntu/cephtest 2024-09-12T22:52:32.592 INFO:teuthology.orchestra.run.smithi099.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 22:52 /home/ubuntu/cephtest 2024-09-12T22:52:32.603 INFO:teuthology.orchestra.run.smithi117.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 22:52 /home/ubuntu/cephtest 2024-09-12T22:52:32.604 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T22:52:32.615 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T22:52:32.638 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-low-osd-mem-target powercycle/default supported-distros/centos_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} duration: 639.1912813186646 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-12T22:52:32.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T22:52:32.739 INFO:teuthology.run:pass